Retrospective Counterfactual Prediction by Conditioning on the Factual Outcome: A Cross-World Approach

View PDF HTML (experimental)

Abstract:Retrospective causal questions ask what would have happened to an observed individual had they received a different treatment. We study the problem of estimating $\mu(x,y)=\mathbb{E}[Y(1)\mid X=x,Y(0)=y]$, the expected counterfactual outcome for an individual with covariates $x$ and observed outcome $y$, and constructing valid prediction intervals under the Neyman-Rubin superpopulation model. This quantity is generally not identified without additional assumptions. To link the observed and unobserved potential outcomes, we work with a cross-world correlation $\rho(x)=cor(Y(1),Y(0)\mid X=x)$; plausible bounds on $\rho(x)$ enable a principled approach to this otherwise unidentified problem. We introduce retrospective counterfactual estimators $\hat{\mu}{\rho}(x,y)$ and prediction intervals $C{\rho}(x,y)$ that asymptotically satisfy $P[Y(1)\in C_{\rho}(x,y)\mid X=x, Y(0)=y]\ge1-\alpha$ under standard causal assumptions. Many common baselines implicitly correspond to endpoint choices $\rho=0$ or $\rho=1$ (ignoring the factual outcome or treating the counterfactual as a shifted factual outcome). Interpolating between these cases through cross-world dependence yields substantial gains in both theory and practice.

Subjects:

Methodology (stat.ME); Machine Learning (stat.ML)

MSC classes: 62G08

ACM classes: G.3

Cite as: arXiv:2603.27320 [stat.ME]

(or arXiv:2603.27320v1 [stat.ME] for this version)

https://doi.org/10.48550/arXiv.2603.27320

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Juraj Bodík [view email] [v1] Sat, 28 Mar 2026 15:56:45 UTC (295 KB)