← Back to Robotics
cs.RO

Can we fake robot training data without faking the physics?

Junjie Ye, Rong Xue, Basile Van Hoorick, Runhao Li, Harshitha Rajaprakash, Pavel Tokmakov, Muhammad Zubair Irshad, Vitor Guizilini, Yue Wang

June 1, 2026

Real robot learning requires expensive demonstrations collected via teleoperation. RoboDream generates photorealistic training data by anchoring to physically valid robot trajectories while separately synthesizing novel scenes and objects around them. This decoupling enables two tricks: reusing old robot motions in new environments, and "prop-free" teleoperation where operators gesture at empty air and the model adds objects later. Real-world experiments show synthetic data meaningfully improves downstream task performance and cuts demand for expensive real-world collection.
Published as RoboDream: Compositional World Models for Scalable Robot Data Synthesis arXiv:2606.02577
Read the original paper →