A Practical Recipe Towards Improving Sim-and-Real Correlation for VLA Evaluation

Published June 10, 2026 · Category: Robotics

Overview

arXiv:2606.10366v1 Announce Type: new Abstract: Simulation has become an essential tool for evaluating and improving vision-language-action (VLA) policies, offering scalable, reproducible, and controllable alternatives to costly real-world robot evaluation. Recent simulation benchmarks have made substantial progress on realism and diversity, yet these platforms have not been widely adopted as reliable proxies for real-world policy evaluation. In this work, we investigate this issue through the lens of sim-and-real correlation. We conduct a systematic study across multiple simulation platforms, VLA policies, tasks, and perturbation factors, measuring whether simulated evaluation preserves real-world conclusions in terms of policy ranking consistency, performance correlation, and perturbation-wise failure patterns. This analysis allows us to characterize the limitations of existing simulators and identify what kinds of simulation signals are more aligned with real-world deployment. We further examine how users should exploit simulation for policy improvement, including when simulator-based finetuning is beneficial and how the amount of post-training data affects sim-and-real alignment. Overall, our work provides a unified framework for measuring, interpreting, and improving the usefulness of simulation for VLA policies, offering guidance both for simulator designers and for practitioners who use simulation as part of the policy development pipeline.

Source

Originally published at arxiv.org.

Related Articles

• AgenticNav: Zero-Shot Vision-and-Language Navigation as a Tool-Calling Harness
• Act on What You See: Unlocking Safe Social Navigation in Vision-Language-Action Models
• Dexterous Point Policy: Learning Point-based Dexterous Hand Policies from Human Demonstrations