3D Scene Graphs: Open Challenges and Future Directions

Published June 19, 2026 · Category: Robotics

Overview

arXiv:2606.19383v1 Announce Type: new Abstract: 3D Scene Graphs (3DSGs) have emerged as a powerful representation for spatial AI by combining geometric grounding with semantic and relational abstractions of the environment. Their expressiveness has made them relevant to a broad range of problems in robotics and computer vision, including manipulation, navigation, task planning, scene understanding, and many others. However, the field remains fragmented: different communities adopt distinct formulations, construction pipelines, and evaluation protocols, making it difficult to compare methods, identify common assumptions, and assess remaining challenges for robust real-world deployment. This survey provides a unified and critical review of 3DSGs, with particular emphasis on open challenges and future directions. We first formalize 3DSGs under a common definition and analyze the principal modeling choices that characterize existing formulations, including node and edge attributes, hierarchical structure, dynamic scene representations, and affordance-aware extensions. We then review how 3DSGs are built from raw sensory observations, discussing the most common terminologies, conventions, and techniques. Finally, we examine downstream applications and evaluation strategies, from intrinsic graph quality to task-level performance. To support the community, we also provide a dedicated website that organizes and extends the surveyed content, accessible at https://3dscenegraphs.com/.

Source

Originally published at arxiv.org.

Related Articles

• pdSTL: Probabilistic Differentiable Signal Temporal Logic for Stochastic Systems
• Fail-RAG : A Retrieval Augmented Generation Informed Framework for Robot Failure Identification
• CTS-MoE: Implicit Terrain Adaptation via Mixture-of-Experts for Perceptive Locomotion