Post-hoc Self-explanation of CNNs

View PDF HTML (experimental)

Abstract:Although standard Convolutional Neural Networks (CNNs) can be mathematically reinterpreted as Self-Explainable Models (SEMs), their built-in prototypes do not on their own accurately represent the data. Replacing the final linear layer with a $k$-means-based classifier addresses this limitation without compromising performance. This work introduces a common formalization of $k$-means-based post-hoc explanations for the classifier, the encoder's final output (B4), and combinations of intermediate feature activations. The latter approach leverages the spatial consistency of convolutional receptive fields to generate concept-based explanation maps, which are supported by gradient-free feature attribution maps. Empirical evaluation with a ResNet34 shows that using shallower, less compressed feature activations, such as those from the last three blocks (B234), results in a trade-off between semantic fidelity and a slight reduction in predictive performance.

Subjects:

Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

Cite as: arXiv:2603.28466 [cs.CV]

(or arXiv:2603.28466v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2603.28466

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Ahcène Boubekki [view email] [v1] Mon, 30 Mar 2026 14:05:37 UTC (484 KB)