← Back to Robotics cs.RO
Can we fake robot training data without faking the physics?
Junjie Ye, Rong Xue, Basile Van Hoorick, Runhao Li, Harshitha Rajaprakash, Pavel Tokmakov, Muhammad Zubair Irshad, Vitor Guizilini, Yue Wang
June 1, 2026
Real robot learning requires expensive demonstrations collected via teleoperation. RoboDream generates photorealistic training data by anchoring to physically valid robot trajectories while separately synthesizing novel scenes and objects around them. This decoupling enables two tricks: reusing old robot motions in new environments, and "prop-free" teleoperation where operators gesture at empty air and the model adds objects later. Real-world experiments show synthetic data meaningfully improves downstream task performance and cuts demand for expensive real-world collection.
Read the original paper →