A Hyperbolic Perspective on Hierarchical Structure in Object-Centric Scene Representations

View PDF HTML (experimental)

Abstract:Slot attention has emerged as a powerful framework for unsupervised object-centric learning, decomposing visual scenes into a small set of compact vector representations called \emph{slots}, each capturing a distinct region or object. However, these slots are learned in Euclidean space, which provides no geometric inductive bias for the hierarchical relationships that naturally structure visual scenes. In this work, we propose a simple post-hoc pipeline to project Euclidean slot embeddings onto the Lorentz hyperboloid of hyperbolic space, without modifying the underlying training pipeline. We construct five-level visual hierarchies directly from slot attention masks and analyse whether hyperbolic geometry reveals latent hierarchical structure that remains invisible in Euclidean space. Integrating our pipeline with SPOT (images), VideoSAUR (video), and SlotContrast (video), We find that hyperbolic projection exposes a consistent scene-level to object-level organisation, where coarse slots occupy greater manifold depth than fine slots, which is absent in Euclidean space. We further identify a "curvature--task tradeoff": low curvature ($c{=}0.2$) matches or outperforms Euclidean on parent slot retrieval, while moderate curvature ($c{=}0.5$) achieves better inter-level separation. Together, these findings suggest that slot representations already encode latent hierarchy that hyperbolic geometry reveals, motivating end-to-end hyperbolic training as a natural next step. Code and models are available at \href{this https URL}{this http URL}.

Comments: accepted at CVPR Workshops 2026

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as: arXiv:2603.14022 [cs.CV]

(or arXiv:2603.14022v2 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2603.14022

arXiv-issued DOI via DataCite

Submission history

From: Neelu Madan [view email] [v1] Sat, 14 Mar 2026 16:53:59 UTC (1,430 KB) [v2] Mon, 30 Mar 2026 17:29:33 UTC (1,430 KB)