MaskDiME: Adaptive Masked Diffusion for Precise and Efficient Visual Counterfactual Explanations

View PDF HTML (experimental)

Abstract:Visual counterfactual explanations aim to reveal the minimal semantic modifications that can alter a model's prediction, providing causal and interpretable insights into deep neural networks. However, existing diffusion-based counterfactual generation methods are often computationally expensive, slow to sample, and imprecise in localizing the modified regions. To address these limitations, we propose MaskDiME, a simple, fast, yet effective diffusion framework that unifies semantic consistency and spatial precision through localized sampling. Our approach adaptively focuses on decision-relevant regions to achieve localized and semantically consistent counterfactual generation while preserving high image fidelity. Our training-free framework, MaskDiME, performs inference over 30x faster than the baseline and achieves comparable or state-of-the-art performance across five benchmark datasets spanning diverse visual domains, establishing a practical and generalizable solution for efficient counterfactual explanation.

Comments: Accepted by CVPR2026

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as: arXiv:2602.18792 [cs.CV]

(or arXiv:2602.18792v2 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2602.18792

arXiv-issued DOI via DataCite

Submission history

From: Changlu Guo [view email] [v1] Sat, 21 Feb 2026 10:53:50 UTC (1,336 KB) [v2] Mon, 30 Mar 2026 14:49:34 UTC (1,337 KB)