Uncertainty-Guided Sparse Refinement for Action Chunking Transformer Policies

Published September 15, 2026 · Category: Robotics

Overview

arXiv:2609.15840v1 Announce Type: new Abstract: Learning chunk-based visuomotor policies for long-horizon robot manipulation remains challenging. Recent action-chunking methods have shown promising performance by predicting temporally extended action sequences. However, their failures are often dominated by prediction errors at a small number of critical timesteps rather than uniformly poor predictions across the entire action chunk, making uniform refinement inefficient and insufficiently targeted. To address this bottleneck, we propose Uncertainty-Guided Refinement (UGR), a sparse refinement framework for chunk-based visuomotor policies. Specifically, UGR follows a coarse-to-refine design: it first predicts a full action chunk, estimates per-step temporal uncertainty from the coarse hidden states, and applies residual correction only to the most uncertain timesteps selected by a binary mask. The uncertainty branch is decoupled from the coarse action predictor, enabling clean attribution of the refinement gains to uncertainty-guided correction rather than additional predictor capacity. Extensive experiments on five dual-arm manipulation tasks from the RoboTwin benchmark show that UGR achieves the best success rate on four tasks, improves over the ACT baseline by up to 13% absolute, and outperforms both full-chunk and position-agnostic block refinement in ablation studies.

Source

Originally published at arxiv.org.

Related Articles

• Conflict-Predictive Variable Horizons in Multi-Drone Distributed Model Predictive Control
• IMM-based Multiple Object Tracking using a State Prediction Neural Network
• Constraint-Grounded Reinforcement Learning for Variable Impedance Control in Contact-Rich Robotic Insertion