ToLL: Topological Layout Learning with Structural Multi-view Augmentation for 3D Scene Graph Pretraining

View PDF HTML (experimental)

Abstract:3D Scene Graph (3DSG) generation plays a pivotal role in spatial understanding and semantic-affordance perception. However, its generalizability is often constrained by data scarcity. Current solutions primarily focus on cross-modal assisted representation learning and object-centric generation pre-training. The former relies heavily on predicate annotations, while the latter's predicate learning may be bypassed due to strong object priors. Consequently, they could not often provide a label-free and robust self-supervised proxy task for 3DSG fine-tuning. To bridge this gap, we propose a Topological Layout Learning (ToLL) for 3DSG pretraining framework. In detail, we design an Anchor-Conditioned Topological Geometry Reasoning, with a GNN to recover the global layout of zero-centered subgraphs by the spatial priors from sparse anchors. This process is strictly modulated by predicate features, thereby enforcing the predicate relation learning. Furthermore, we construct a Structural Multi-view Augmentation to avoid semantic corruption, and enhancing representations via self-distillation. The extensive experiments on 3DSSG dataset demonstrate that our ToLL could improve representation quality, outperforming state-of-the-art baselines.

Comments: Under Reivew

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as: arXiv:2603.28178 [cs.CV]

(or arXiv:2603.28178v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2603.28178

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Yucheng Huang [view email] [v1] Mon, 30 Mar 2026 08:43:52 UTC (6,864 KB)