Adaptive Multi-Scale Channel-Spatial Attention Aggregation Framework for 3D Indoor Semantic Scene Completion Toward Assisting Visually Impaired

View PDF HTML (experimental)

Abstract:Independent indoor mobility remains a critical challenge for individuals with visual impairments, largely due to the limited capability of existing assistive systems in detecting fine-grained hazardous objects such as chairs, tables, and small obstacles. These perceptual blind zones substantially increase the risk of collision in unfamiliar environments. To bridge the gap between monocular 3D vision research and practical assistive deployment, this paper proposes an Adaptive Multi-scale Attention Aggregation (AMAA) framework for monocular 3D semantic scene completion using only a wearable RGB camera. The proposed framework addresses two major limitations in 2D-to-3D feature lifting: noise diffusion during back-projection and structural instability in multi-scale fusion. A parallel channel--spatial attention mechanism is introduced to recalibrate lifted features along semantic and geometric dimensions, while a hierarchical adaptive gating strategy regulates cross-scale information flow to preserve fine-grained structural details. Experiments on the NYUv2 benchmark demonstrate that AMAA achieves an overall mIoU of 27.88%. Crucially, it yields significant relative improvements of 16.9% for small objects and 10.4% for tables over the MonoScene baseline. Furthermore, a wearable prototype based on an NVIDIA Jetson Orin NX and a ZED~2i camera validates stable real-time performance in indoor environments, demonstrating the feasibility of deploying monocular 3D scene completion for assistive navigation.

Comments: 17 pages, 9 figures, 5 tables

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as: arXiv:2602.16385 [cs.CV]

(or arXiv:2602.16385v3 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2602.16385

arXiv-issued DOI via DataCite

Submission history

From: Qi He [view email] [v1] Wed, 18 Feb 2026 11:45:01 UTC (21,526 KB) [v2] Thu, 19 Feb 2026 08:23:34 UTC (21,526 KB) [v3] Fri, 27 Mar 2026 14:50:16 UTC (28,050 KB)