← Back to Computer Vision
cs.CV

How to make hidden objects simulatable in real scenes?

Xin Dong, Weijian Deng, Lihan Zhang, Tianru Dai, Wenfeng Deng, Yansong Tang

May 28, 2026

Reconstructing real-world scenes from photos often leaves objects incomplete and impossible to simulate physically due to occlusion and limited views. SAM3D-Phys combines scene reconstruction with generative 3D models to infer missing geometry, then anchors recovered objects back to their actual locations through physics constraints and texture refinement. The result: clean, simulatable objects you can interact with in a reconstructed environment.
Published as SAM3D-Phys: Towards Multi-Object Interactive Simulation in Real World arXiv:2605.30239
Read the original paper →