← Back to Computer Vision cs.CV
How to turn a photo into a physics-safe 3D world?
Xiaoxuan Ma, Jiashun Wang, Nicolas Ugrinovic, Yehonathan Litman, Kris Kitani
May 28, 2026
Converting a photo into a simulation-ready 3D scene is hard—existing methods produce geometrically plausible reconstructions where objects float or penetrate walls. REST3D fixes this by first analyzing the physical relationships between objects (what supports what), then refining the 3D reconstruction to satisfy physics constraints while matching the input image. Tests on synthetic and real photos show it dramatically reduces physical errors and improves stability in VR interactions.
Read the original paper →