← Back to Computer Vision
cs.CV

Predicting cancer survival by connecting tissue patterns to genes

Amaya Gallagher-Syed, Costantino Pitzalis, Myles J. Lewis, Michael R. Barnes, Gregory Slabaugh

May 20, 2026

ProtoPathway combines whole-slide histopathology images and gene expression data to predict cancer survival with built-in biological interpretability. On the imaging side, learnable morphological prototypes compress variable-length tissue patches into fixed representations; on the genomics side, a graph network encodes genes within their known biological pathways (Reactome). Cross-modal attention connects the two, revealing which tissue patterns correlate with which molecular programs. Tested on five TCGA cancer cohorts, it matches or beats existing methods while cutting computation and providing interpretable pathway-level attribution from genes to tissue.
Published as ProtoPathway: Biologically Structured Prototype-Pathway Fusion for Multimodal Cancer Survival Prediction arXiv:2605.21454
Read the original paper →