Dynamics-Aware Meta-Imitation for Generalization to Unseen Robotic Manipulation

Published July 20, 2026 · Category: Robotics

Overview

arXiv:2607.15880v1 Announce Type: new Abstract: Imitation Learning aims to learn skills from extensive observations and demonstrations for robots, so it suffers from data scarcity and environment generalization. The existing methods predominantly focus on imitation from in-domain tasks and consequently struggle with generalization to unseen tasks. To bridge this generalization gap, we propose the \textbf{D}ynamics-\textbf{A}ware \textbf{M}eta-\textbf{I}mitation (DAMI) framework. By integrating meta-learning to construct a shared skill space, DAMI equips agents for rapid adaptation to novel tasks. We introduce the Visual-Motor Trajectory (VMT) module to capture complex spatio-temporal dynamics within the task latent space. Furthermore, we propose the Unpaired Unified Task (U2T) block to fuse unstructured multimodal observations. To coordinate these representations, we integrate a Task-Conditioned Feature Modulation (TCFM) mechanism customized for modulating low-level 3D features. By capturing intrinsic dynamics from a random complete reference demonstration, our framework learns the underlying task logic rather than memorizing static cues, ensuring effective generalization. Extensive experiments in both simulation and real-world settings demonstrate that our approach outperforms state-of-the-art baselines regarding direct inference on seen tasks and adaptation to unseen tasks via few-shot fine-tuning.

Source

Originally published at arxiv.org.

Related Articles

• A Task-Space Receding Horizon Controller for Fast Collision Avoidance
• Learning a System-Level Surrogate for Hydraulic Excavators: A Simulation-to-Real LSTM Approach
• Passive Phase-Oriented Impedance Shaping for Rapid Acceleration in Soft Robotic Swimmers