An Attention Mechanism for Robust Multimodal Integration in a Global Workspace Architecture

View PDF HTML (experimental)

Abstract:Robust multimodal systems must remain effective when some modalities are noisy, degraded, or unreliable. Existing multimodal fusion methods often learn modality selection jointly with representation learning, making it difficult to determine whether robustness comes from the selector itself or from full end-to-end co-adaptation. Motivated by Global Workspace Theory (GWT), we study this question using a lightweight top-down modality selector operating on top of a frozen multimodal global workspace. We evaluate our method on two multimodal datasets of increasing complexity: Simple Shapes and MM-IMDb 1.0, under structured modality corruptions. The selector improves robustness while using far fewer trainable parameters than end-to-end attention baselines, and the learned selection strategy transfers better across downstream tasks, corruption regimes, and even to a previously unseen modality. Beyond explicit corruption settings, on the MM-IMDb 1.0 benchmark, we show that the same mechanism improves the global workspace over its no-attention counterpart and yields decent benchmark performance.

Subjects:

Artificial Intelligence (cs.AI)

Cite as: arXiv:2602.08597 [cs.AI]

(or arXiv:2602.08597v2 [cs.AI] for this version)

https://doi.org/10.48550/arXiv.2602.08597

arXiv-issued DOI via DataCite

Submission history

From: Roland Bertin-Johannet [view email] [v1] Mon, 9 Feb 2026 12:38:05 UTC (1,021 KB) [v2] Mon, 30 Mar 2026 14:40:05 UTC (964 KB)