Hierarchical 3D Scene Graph Construction and Belief-based Planning for Semantic Navigation

Published July 1, 2026 · Category: Robotics

Overview

arXiv:2606.31071v1 Announce Type: cross Abstract: Semantic navigation is a fundamental task for embodied agents operating in unseen environments, requiring both semantic understanding and long-term decision-making. Recent foundation models have empowered agents with rich semantic priors for this task. However, without structured global representations, decision-making often falls back on local observations and greedy strategies, resulting in inefficient exploration and myopic behaviors, especially in long-distance navigation. To address these challenges, we propose a zero-shot semantic navigation framework. Our method incrementally maintains an online Hierarchical 3D Scene Graph (HSG) to form a multi-granular semantic topology over objects, zones, and regions, serving as a compact state abstraction for global planning. Building on this memory, we introduce a hierarchical belief-based planning framework that fuses semantic priors with exploration evidence on the HSG, and performs finite-horizon rollouts on an HSG-based simulator to explicitly estimate the long-term expected returns of candidate macro-actions. This enables globally consistent decisions and reduces redundant backtracking. Extensive experiments in high-fidelity simulation environments across multiple tasks and datasets demonstrate that our method outperforms existing state-of-the-art methods, particularly in long-distance scenarios, where our approach improves SR and SPL by an average of 9.4\% and 5.0\%, respectively.

Source

Originally published at arxiv.org.

Related Articles

• A Modular Vision-Language-Action Robotics Framework for Indoor Environments
• LeCropFollow: Latent Space Planning for Navigation in Unstructured Crop Fields
• Wavelet Policy: Imitation Learning in the Scale Domain with World Prior Memory