← Back to Artificial Intelligence
cs.AI

Turning a single satellite photo into a detailed street-level 3D scene

Ming Qian, Zimin Xia, Changkun Liu, Shuailei Ma, Wen Wang, Zeran Ke, Bin Tan, Hang Zhang, Gui-Song Xia

May 14, 2026

Reconstructing walkable 3D environments from overhead satellite imagery is hampered by the extreme viewpoint shift between satellite and street perspectives. Sat3DGen tackles this with a geometry-first approach: novel geometric constraints and a perspective-view training strategy are added to a feed-forward image-to-3D framework, directly attacking the sparse and inconsistent supervision that causes prior methods to produce wobbly geometry. Evaluated on a new benchmark pairing VIGOR-OOD with high-resolution DSM data, the method improves RMSE from 6.76m to 5.20m and drops FID from ~40 to 19 without dedicated image-quality modules. Code is publicly released, and the pipeline supports downstream tasks including semantic-map-to-3D synthesis, multi-camera video generation, and unsupervised DSM estimation.
Published as Sat3DGen: Comprehensive Street-Level 3D Scene Generation from Single Satellite Image arXiv:2605.14984
Read the original paper →