Symbolic Regression for Shared Expressions: Introducing Partial Parameter Sharing
arXiv:2601.04051v2 Announce Type: replace Abstract: Symbolic regression (SR) aims to find symbolic expressions that describe datasets. Due to its inherent interpretability, is a powerful paradigm for scientific discovery. Recent advances have expanded SR to describe related phenomena using a single expression with varying sets of parameters, thereby introducing one categorical variable. To illustrate, this enables the search for a single expression describing temperature-dependent viscosity across multiple fluids, while simultaneously identifying a distinct set of fluid-specific parameters. Ex — Viktor Martinek, Roland Herzog
View PDF HTML (experimental)
Abstract:Symbolic regression (SR) aims to find symbolic expressions that describe datasets. Due to its inherent interpretability, is a powerful paradigm for scientific discovery. Recent advances have expanded SR to describe related phenomena using a single expression with varying sets of parameters, thereby introducing one categorical variable. To illustrate, this enables the search for a single expression describing temperature-dependent viscosity across multiple fluids, while simultaneously identifying a distinct set of fluid-specific parameters. Existing methods utilize only "non-shared" (category-value-specific) and "shared" (category-value-agnostic) parameters. We expand upon those efforts by considering multiple categorical variables, and introduce intermediate levels of parameter sharing. For problems with multiple categorical variables, our novel approach identifies parameters that remain constant across one category while varying across others. This method reduces the total parameter count, reveals category-agnostic trends, isolates category-specific effects, and accounts for unique category-value interactions. We test the limits of this setup in terms of data requirement reduction and transfer learning using a synthetic, fitting-only example. Furthermore, we apply the method to an astrophysics dataset also used in a previous single-category study. In comparison, we achieve comparable fit quality with significantly fewer parameters while extracting additional information about the problem.
Subjects:
Machine Learning (cs.LG)
Cite as: arXiv:2601.04051 [cs.LG]
(or arXiv:2601.04051v2 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2601.04051
arXiv-issued DOI via DataCite
Submission history
From: Roland Herzog [view email] [v1] Wed, 7 Jan 2026 16:12:14 UTC (639 KB) [v2] Fri, 27 Mar 2026 18:01:08 UTC (861 KB)
Sign in to highlight and annotate this article
Conversation starters
Daily AI Digest
Get the top 5 AI stories delivered to your inbox every morning.
More about
researchpaperarxiv
Building a Production RAG Pipeline: Lessons from Real-World AI Apps
Building a Production RAG Pipeline: Lessons from Real-World AI Apps RAG (Retrieval-Augmented Generation) sounds simple on paper — embed your documents, store them in a vector DB, retrieve the relevant chunks, and pass them to an LLM. In practice, getting a RAG pipeline to production quality is significantly harder. Here's what I learned building RAG pipelines for real SaaS products. The Naive Implementation Most tutorials show you this flow: Chunk your documents Embed them with OpenAI Store in Pinecone Retrieve top-k chunks Pass to GPT-4 This works fine in demos. It fails in production for a few key reasons. Problem 1: Chunking Strategy Kills Retrieval Quality Naive fixed-size chunking (every 512 tokens) destroys semantic context. A paragraph about "authentication" gets split mid-sentence,
I Made Parseltongue
Yes, that one from HPMoR by @Eliezer Yudkowsky . And I mean it absolutely literally - this is a language designed to make lies inexpressible. It catches LLMs' ungrounded statements, incoherent logic and hallucinations. Comes with notebooks (Jupyter-style), server for use with agents, and inspection tooling. Github , Documentation . Works everywhere - even in the web Claude with the code execution sandbox. How Unsophisticated lies and manipulations are typically ungrounded or include logical inconsistencies. Coherent, factually grounded deception is a problem whose complexity grows exponentially - and our AI is far from solving such tasks. There will still be a theoretical possibility to do it - especially under incomplete information - and we have a guarantee that there is no full computat
Knowledge Map
Connected Articles — Knowledge Graph
This article is connected to other articles through shared AI topics and tags.
Discussion
Sign in to join the discussion
No comments yet — be the first to share your thoughts!