POMDPs for Autonomous Science Exploration

Published August 5, 2026 · Category: Robotics

Overview

arXiv:2608.03155v1 Announce Type: new Abstract: Autonomous exploration missions require decision-making under sensor uncertainty and computational constraints, yet integrating scientific representations into POMDP planning has remained intractable due to high-dimensional observation spaces. Information-theoretic planners overcome this by assuming deterministic observations, sacrificing the principled uncertainty quantification that POMDPs provide. We introduce the Science Hypothesis Map POMDP (SHM-POMDP), which makes science-driven belief-space planning more tractable by branching on inferred physical properties rather than raw sensor data. This preserves full sensor information through learned observation models while enabling the planner to reason jointly about navigation and scientific properties under uncertainty. On an extended RockSample domain with 50-dimensional observations, SHM-POMDP achieves 18.6\% higher rewards and 32.9\% reduced computation time per step than continuous-observation baselines. On realistic geologic exploration using Cuprite hyperspectral data, SHM-POMDP achieves 2.5$\times$ higher information gain than the best information-theoretic baseline by maintaining beliefs and replanning adaptively---reaching 80\% of oracle performance using only uniform priors. These results demonstrate that integrating hierarchical probabilistic models into belief-space planning enables tractable, principled autonomous science that outperforms both traditional POMDP methods and science-aware information-theoretic approaches.

Source

Originally published at arxiv.org.

Related Articles

• From Routes to Steps: Separating Semantic Progress from Local Execution in Vision-and-Language Navigation
• EmbodiedVAE: Disentangled Video VAE for Efficient and Controllable Embodied Manipulation
• Shooting for Contact: Contact-Implicit Multiple Shooting for Dynamic Motion Retargeting