← Back to Computer Vision
cs.CV

Can you make video generators obey physics?

Yu Yuan, Jianhao Yuan, Xijun Wang, Daiqing Li, Liu He, Lu Ling, Stanley H. Chan

May 30, 2026

Video generators excel at creating plausible motion but ignore real-world physics—objects drift, collide, or waste energy. OptiWorld adds an optimal-control layer at inference: extract compact state, plan trajectories under physical constraints on a learned manifold, then render video along that path. Handles goal-conditioned generation, dynamics editing, and counterfactuals.
Published as OptiWorld: Optimal Control for Video World Generation under Physical Constraints arXiv:2606.00499
Read the original paper →