Nonlinear function-on-function regression by RKHS
We propose a nonlinear function-on-function regression model where both the covariate and the response are random functions. The nonlinear regression is carried out in two steps: we first construct Hilbert spaces to accommodate the functional covariate and the functional response, and then build a second-layer Hilbert space for the covariate to capture nonlinearity. The second-layer space is assumed to be a reproducing kernel Hilbert space, which is generated by a positive definite kernel determined by the inner product of the first-layer Hilbert space for $X$--this structure is known as the nested Hilbert spaces. We develop estimation procedures to implement the proposed method, which allows the functional data to be observed at different time points for different subjects. Furthermore, w
Peijun Sang, Bing Li; 27(12):1−54, 2026.
Abstract
We propose a nonlinear function-on-function regression model where both the covariate and the response are random functions. The nonlinear regression is carried out in two steps: we first construct Hilbert spaces to accommodate the functional covariate and the functional response, and then build a second-layer Hilbert space for the covariate to capture nonlinearity. The second-layer space is assumed to be a reproducing kernel Hilbert space, which is generated by a positive definite kernel determined by the inner product of the first-layer Hilbert space for $X$--this structure is known as the nested Hilbert spaces. We develop estimation procedures to implement the proposed method, which allows the functional data to be observed at different time points for different subjects. Furthermore, we establish the convergence rate of our estimator as well as the weak convergence of the predicted response in the Hilbert space. Numerical studies including both simulations and a data application are conducted to investigate the performance of our estimator in finite sample.
[abs][pdf][bib]
Sign in to highlight and annotate this article
Conversation starters
Daily AI Digest
Get the top 5 AI stories delivered to your inbox every morning.
More about
modelproductapplication
Writing Better RFCs and Design Docs
<p>RFCs (Request for Comments) and design docs are how engineering teams align on the “what” and “why” before writing code. Done well, they reduce rework and create a record of decisions. Done poorly, they sit unread or trigger endless debate. Here’s how to write <strong>better RFCs and design docs</strong> that get read, get feedback, and lead to decisions.</p> <h2> Why Write Them at All? </h2> <ul> <li> <strong>Alignment:</strong> Everyone works from the same understanding of the problem and the approach.</li> <li> <strong>Async review:</strong> People can respond in their own time, including across time zones.</li> <li> <strong>Memory:</strong> Later you have a record of why you chose X and what you rejected.</li> <li> <strong>Onboarding:</strong> New joiners (and future you) can unders
Building Global Crisis Monitor: A Real-Time Geopolitical Intelligence Dashboard
<p><a href="https://global-crisis-monitor.com" rel="noopener noreferrer"><strong>Global Crisis Monitor</strong></a> is a personal, artistic project. I built it in a period when wars that once felt distant became part of everyday conversation-appearing in feeds and notifications alongside everything else. There is something disorienting about that: a bombing in a city you can name, a ceasefire that collapsed overnight, a famine declared-and then, scrolling past it, an advertisement. The architecture of attention flattens everything into the same urgency and the same forgettability.</p> <p>I wanted to refuse that flattening. Not a feed aggregator; a single surface where the signals are collected, held together, and given weight. So I built an ingester that turns 80+ RSS feeds into structured
I Built a Portable Text Editor for Windows — One .exe File, No Installation, Forever Free
<p>A solo developer's story of building the Notepad replacement that should have existed years ago.</p> <p>I've been using Windows my whole life. And my whole life, every time I needed to write something with a bit of formatting — a heading, some bold text, a colored note — I ended up either opening Word (too heavy), using Notepad (too limited), or pasting into a browser-based tool (too many accounts).</p> <p>WordPad was the middle ground. Then Microsoft removed it from Windows 11.<br> That was the moment I decided to build my own.</p> <h2> The Problem I Was Solving </h2> <p>Let me be specific about what I needed, because "text editor" covers everything from Vim to Google Docs.</p> <p>I wanted something that:</p> <ul> <li>Requires zero installation. I work on multiple machines — personal,
Knowledge Map
Connected Articles — Knowledge Graph
This article is connected to other articles through shared AI topics and tags.
More in Products
Writing Better RFCs and Design Docs
<p>RFCs (Request for Comments) and design docs are how engineering teams align on the “what” and “why” before writing code. Done well, they reduce rework and create a record of decisions. Done poorly, they sit unread or trigger endless debate. Here’s how to write <strong>better RFCs and design docs</strong> that get read, get feedback, and lead to decisions.</p> <h2> Why Write Them at All? </h2> <ul> <li> <strong>Alignment:</strong> Everyone works from the same understanding of the problem and the approach.</li> <li> <strong>Async review:</strong> People can respond in their own time, including across time zones.</li> <li> <strong>Memory:</strong> Later you have a record of why you chose X and what you rejected.</li> <li> <strong>Onboarding:</strong> New joiners (and future you) can unders
Building Global Crisis Monitor: A Real-Time Geopolitical Intelligence Dashboard
<p><a href="https://global-crisis-monitor.com" rel="noopener noreferrer"><strong>Global Crisis Monitor</strong></a> is a personal, artistic project. I built it in a period when wars that once felt distant became part of everyday conversation-appearing in feeds and notifications alongside everything else. There is something disorienting about that: a bombing in a city you can name, a ceasefire that collapsed overnight, a famine declared-and then, scrolling past it, an advertisement. The architecture of attention flattens everything into the same urgency and the same forgettability.</p> <p>I wanted to refuse that flattening. Not a feed aggregator; a single surface where the signals are collected, held together, and given weight. So I built an ingester that turns 80+ RSS feeds into structured
How We're Approaching a County-Level Education Data System Engagement
<p>When Los Angeles County needs to evaluate whether a multi-agency data system serving foster youth should be modernized or replaced, the work sits at the intersection of technology, policy, and people. That's exactly where we operate.</p> <h2> The Opportunity </h2> <p>The LA County Office of Child, Youth, and Family Well-Being is looking for a consulting team to analyze the Education Passport System (EPS), a shared data platform that connects 80+ school districts with the Department of Children and Family Services and the Probation Department. The system exists to ensure that when a foster youth moves between placements, their education records follow them.</p> <p>The question on the table: does the current system meet the needs of all stakeholders, or is it time to move to something new
I Built a Portable Text Editor for Windows — One .exe File, No Installation, Forever Free
<p>A solo developer's story of building the Notepad replacement that should have existed years ago.</p> <p>I've been using Windows my whole life. And my whole life, every time I needed to write something with a bit of formatting — a heading, some bold text, a colored note — I ended up either opening Word (too heavy), using Notepad (too limited), or pasting into a browser-based tool (too many accounts).</p> <p>WordPad was the middle ground. Then Microsoft removed it from Windows 11.<br> That was the moment I decided to build my own.</p> <h2> The Problem I Was Solving </h2> <p>Let me be specific about what I needed, because "text editor" covers everything from Vim to Google Docs.</p> <p>I wanted something that:</p> <ul> <li>Requires zero installation. I work on multiple machines — personal,
Discussion
Sign in to join the discussion
No comments yet — be the first to share your thoughts!