TY - GEN
T1 - PEaRL
T2 - 2026 IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2026
AU - Majumder, Sejuti
AU - Kapse, Saarthak
AU - Bhattacharya, Moinak
AU - Xu, Xuan
AU - Yurovsky, Alisa
AU - Prasanna, Prateek
N1 - Publisher Copyright:
© 2026 IEEE.
PY - 2026
Y1 - 2026
N2 - Integrating histopathology with spatial transcriptomics (ST) provides a powerful opportunity to link tissue morphology with molecular function. Yet most existing multimodal approaches rely on a small set of highly variable genes, which limits predictive scope and overlooks the coordinated biological programs that shape tissue phenotypes. We present PEaRL (Pathway Enhanced Representation Learning), a multimodal framework that represents transcriptomics through pathway activation scores computed with ssGSEA. By encoding biologically coherent pathway signals with a transformer and aligning them with histology features via contrastive learning, PEaRL reduces-dimensionality, improves interpretability, and strengthens cross-modal correspondence. Across three cancer ST datasets - breast, skin, and lymph node - PEaRL consistently outperforms SOTA methods, yielding higher accuracy for both gene- and pathway-level expression prediction (up to 58.9% and 20.4% increase in Pearson correlation coefficient compared to SOTA). These results demonstrate that grounding transcriptomic representation in pathways produces more biologically faithful and interpretable multi-modal models, advancing computational pathology beyond gene-level embeddings.
AB - Integrating histopathology with spatial transcriptomics (ST) provides a powerful opportunity to link tissue morphology with molecular function. Yet most existing multimodal approaches rely on a small set of highly variable genes, which limits predictive scope and overlooks the coordinated biological programs that shape tissue phenotypes. We present PEaRL (Pathway Enhanced Representation Learning), a multimodal framework that represents transcriptomics through pathway activation scores computed with ssGSEA. By encoding biologically coherent pathway signals with a transformer and aligning them with histology features via contrastive learning, PEaRL reduces-dimensionality, improves interpretability, and strengthens cross-modal correspondence. Across three cancer ST datasets - breast, skin, and lymph node - PEaRL consistently outperforms SOTA methods, yielding higher accuracy for both gene- and pathway-level expression prediction (up to 58.9% and 20.4% increase in Pearson correlation coefficient compared to SOTA). These results demonstrate that grounding transcriptomic representation in pathways produces more biologically faithful and interpretable multi-modal models, advancing computational pathology beyond gene-level embeddings.
KW - digital pathology
KW - representation learning
KW - spatial transcriptomics
UR - https://www.scopus.com/pages/publications/105041317511
U2 - 10.1109/WACV61042.2026.00777
DO - 10.1109/WACV61042.2026.00777
M3 - Conference contribution
AN - SCOPUS:105041317511
T3 - Proceedings - 2026 IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2026
SP - 8052
EP - 8062
BT - Proceedings - 2026 IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2026
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 6 March 2026 through 10 March 2026
ER -