← Back to Computer Vision
cs.CV

How to turn a photo into a physics-safe 3D world?

Xiaoxuan Ma, Jiashun Wang, Nicolas Ugrinovic, Yehonathan Litman, Kris Kitani

May 28, 2026

Converting a photo into a simulation-ready 3D scene is hard—existing methods produce geometrically plausible reconstructions where objects float or penetrate walls. REST3D fixes this by first analyzing the physical relationships between objects (what supports what), then refining the 3D reconstruction to satisfy physics constraints while matching the input image. Tests on synthetic and real photos show it dramatically reduces physical errors and improves stability in VR interactions.
Published as REST3D: Reconstructing Physically Stable 3D Scenes from a Single Image arXiv:2605.30338
Read the original paper →