ProtoAct: Turning Wet-Lab Protocols into Embodied Robotic Actions

Published August 4, 2026 · Category: Robotics

Overview

arXiv:2608.01690v1 Announce Type: new Abstract: Biological wet-lab protocols are written for trained researchers and often leave routine operations, state-dependent conditions, and contextual parameters implicit, making them difficult to translate into robot-executable actions. We present ProtoAct, a structured protocol-grounding framework that converts free-form biological procedures into state-aware, embodiment-ready action sequences. ProtoAct uses ProtoRAG to retrieve manually annotated examples for context-sensitive parsing, employs RefineChecker to detect and revise missing or inconsistent steps, and applies ActSchema to map the refined procedure into constrained JSON function sequences. We further introduce BioP2E, for which we manually annotate 22 cell-culture protocols into 258 monitoring conditions, 910 executable subtasks, and 962 grounded action calls. Evaluation across seven large language models demonstrates that ProtoAct can be effectively instantiated with different backbones. Ablations confirm that retrieval, posterior checking, and schema constraints make complementary contributions. The parsed subtasks further support demonstration collection and VLA model training, enabling successful execution in both simulation and real-robot settings. ProtoAct thus provides a practical interface between biological protocol understanding and embodied robotic execution.

Source

Originally published at arxiv.org.

Related Articles

• ReTouch: Empowering Contact-Rich Dexterous Manipulation with Online-Refined Tactile Prediction
• Hermite Curves as Trajectory Priors for Vision-Language-Action Models
• Long-Term Memory for VLA-based Agents in Open-World Task Execution