← Back to Computer Vision
cs.CV

Learning anatomy's consistent patterns across brains and modalities

Tan Pan, Shuhao Mei, Yixuan Sun, Kaiyu Guo, Chen Jiang, Zhaorui Tan, Mengzhu Li, Limei Han, Xiang Zou, Yuan Cheng, Mahsa Baktashmotlagh

May 14, 2026

Medical imaging models typically learn from individual patients in isolation, missing the fact that anatomical structures maintain consistent spatial relationships across people. This work exploits cross-instance topological consistency as a supervisory signal through two alignment strategies: intra-instance alignment using pixel correspondences to preserve local topology across modalities, and inter-instance alignment using pseudo-correspondences to align anatomical neighborhoods without explicit supervision. Tested on 7 downstream tasks across multi-modal 3D medical imaging, the approach achieves 1.1% average improvement in segmentation and 5.94% in classification, with notably better robustness when modalities are missing at test time.
Published as Beyond Instance-Level Self-Supervision in 3D Multi-Modal Medical Imaging arXiv:2605.14654
Read the original paper →