{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T04:10:42Z","timestamp":1779336642124,"version":"3.51.4"},"reference-count":33,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2026,4,27]],"date-time":"2026-04-27T00:00:00Z","timestamp":1777248000000},"content-version":"vor","delay-in-days":1,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"publisher","award":["2024YFA0919600"],"award-info":[{"award-number":["2024YFA0919600"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["32470704"],"award-info":[{"award-number":["32470704"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,5,3]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Motivation<\/jats:title>\n                    <jats:p>Spatial transcriptomics techniques capture gene expression data and spatial coordinates, while simultaneously correlating them with tissue section images. This advantage makes Spatial transcriptomics data highly valuable for research, such as investigating disease mechanisms and cancer prognosis. However, the extended time and high cost of spatial transcriptomic sequencing currently limit further advancements in this field. The development of numerous deep learning methods aimed at predicting spatial transcriptomics from histology images has advanced significantly. However, these approaches often lack the ability to effectively integrate histology images with spatial transcriptomic data. Here, we propose GR2ST, a deep learning model that learns the underlying connections between image features and gene expression to predict spatial transcriptomics.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>GR2ST leverages a large pre-trained pathology model to extract high-level histological features. We designed a dual-branch graph architecture, consisting of a dynamic threshold-based functional graph and a radius-constrained spatial graph, to capture complex spot interactions within heterogeneous tissues. The model aligns histology images with gene expression representations through a multimodal contrastive learning framework. It achieves adaptive gene expression generation via a Cell-Type Guided Multi-Branch Regression Head supervised by a context-aware weighting network, which is further integrated with cross-sample retrieval to construct an ensemble prediction. The performance of the model is evaluated on three cancer-related spatial transcriptomics datasets, including cutaneous squamous cell carcinoma and two human breast cancer cohorts, to demonstrate its effectiveness and robustness.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Availability<\/jats:title>\n                    <jats:p>https:\/\/github.com\/zjl1109294570\/GR2ST.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btag209","type":"journal-article","created":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T11:42:14Z","timestamp":1776944534000},"source":"Crossref","is-referenced-by-count":0,"title":["GR2ST: spatial transcriptomics prediction based on graph-enhanced multimodal contrastive learning"],"prefix":"10.1093","volume":"42","author":[{"given":"Jingli","family":"Zhou","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen) , Shenzhen, Guangdong 518055,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Siyuan","family":"Li","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen) , Shenzhen, Guangdong 518055,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rui","family":"Han","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen) , Shenzhen, Guangdong 518055,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuan","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen) , Shenzhen, Guangdong 518055,","place":["China"]},{"name":"Guangdong Provincial Key Laboratory of Novel Security Intelligence Technologies, Harbin Institute of Technology (Shenzhen) , Shenzhen, Guangdong 518055,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6500-6217","authenticated-orcid":false,"given":"Yadong","family":"Wang","sequence":"additional","affiliation":[{"name":"Center for Bioinformatics, Faculty of Computing, Harbin Institute of Technology , Harbin, Heilongjiang 150001,","place":["China"]},{"name":"Key Laboratory of Biological Bigdata, Ministry of Education, Harbin Institute of Technology , Harbin, Heilongjiang 150001,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8045-5264","authenticated-orcid":false,"given":"Junyi","family":"Li","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen) , Shenzhen, Guangdong 518055,","place":["China"]},{"name":"Guangdong Provincial Key Laboratory of Novel Security Intelligence Technologies, Harbin Institute of Technology (Shenzhen) , Shenzhen, Guangdong 518055,","place":["China"]},{"name":"Key Laboratory of Biological Bigdata, Ministry of Education, Harbin Institute of Technology , Harbin, Heilongjiang 150001,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2026,4,26]]},"reference":[{"key":"2026052023572516000_btag209-B1","doi-asserted-by":"crossref","first-page":"102027","DOI":"10.1016\/j.compmedimag.2021.102027","article-title":"A survey on graph-based deep learning for computational histopathology","volume":"95","author":"Ahmedt-Aristizabal","year":"2022","journal-title":"Comput Med Imaging Graph"},{"key":"2026052023572516000_btag209-B2","doi-asserted-by":"crossref","first-page":"eaax2656","DOI":"10.1126\/science.aax2656","article-title":"Expansion sequencing: spatially precise in situ transcriptomics in intact biological systems","volume":"371","author":"Alon","year":"2021","journal-title":"Science"},{"key":"2026052023572516000_btag209-B3","doi-asserted-by":"crossref","first-page":"6012","DOI":"10.1038\/s41467-021-26271-2","article-title":"Spatial deconvolution of HER2-positive breast cancer delineates tumor-associated cell type interactions","volume":"12","author":"Andersson","year":"2021","journal-title":"Nat Commun"},{"key":"2026052023572516000_btag209-B4","doi-asserted-by":"crossref","first-page":"1777","DOI":"10.1016\/j.cell.2022.04.003","article-title":"Spatiotemporal transcriptomic atlas of mouse organogenesis using DNA nanoball-patterned arrays","volume":"185","author":"Chen","year":"2022","journal-title":"Cell"},{"key":"2026052023572516000_btag209-B5","doi-asserted-by":"crossref","first-page":"1739","DOI":"10.1038\/s41467-022-29439-6","article-title":"Deciphering spatial domains from spatially resolved transcriptomics with an adaptive graph attention auto-encoder","volume":"13","author":"Dong","year":"2022","journal-title":"Nat Commun"},{"key":"2026052023572516000_btag209-B7","author":"Filiot","year":"2024"},{"key":"2026052023572516000_btag209-B8","first-page":"11","author":"Gamper","year":"2019"},{"key":"2026052023572516000_btag209-B9","doi-asserted-by":"crossref","first-page":"101563","DOI":"10.1016\/j.media.2019.101563","article-title":"HoVer-Net: simultaneous segmentation and classification of nuclei in multi-tissue histology images","volume":"58","author":"Graham","year":"2019","journal-title":"Med Image Anal"},{"key":"2026052023572516000_btag209-B10","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1038\/s41551-020-0578-x","article-title":"Integrating spatial gene expression and breast tumour morphology via deep learning","volume":"4","author":"He","year":"2020","journal-title":"Nat Biomed Eng"},{"key":"2026052023572516000_btag209-B11","first-page":"4700","author":"Huang","year":"2017"},{"key":"2026052023572516000_btag209-B12","doi-asserted-by":"crossref","first-page":"8353","DOI":"10.1038\/s41467-023-43458-x","article-title":"High-resolution mapping of the tumor microenvironment using integrated single-cell, spatial and in situ analysis","volume":"14","author":"Janesick","year":"2023","journal-title":"Nat Commun"},{"key":"2026052023572516000_btag209-B13","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1016\/j.cell.2020.05.039","article-title":"Multimodal analysis of composition and spatial architecture in human squamous cell carcinoma","volume":"182","author":"Ji","year":"2020","journal-title":"Cell"},{"key":"2026052023572516000_btag209-B14","doi-asserted-by":"crossref","first-page":"bbad464","DOI":"10.1093\/bib\/bbad464","article-title":"THItoGene: a deep learning method for predicting spatial transcriptomics from histological images","volume":"25","author":"Jia","year":"2023","journal-title":"Brief Bioinform"},{"key":"2026052023572516000_btag209-B15","doi-asserted-by":"crossref","first-page":"661","DOI":"10.1038\/s41587-021-01139-4","article-title":"Cell2location maps fine-grained cell types in spatial transcriptomics","volume":"40","author":"Kleshchevnikov","year":"2022","journal-title":"Nat Biotechnol"},{"key":"2026052023572516000_btag209-B16","doi-asserted-by":"crossref","first-page":"bbae500","DOI":"10.1093\/bib\/bbae500","article-title":"Gene expression prediction from histology images via hypergraph neural networks","volume":"25","author":"Li","year":"2024","journal-title":"Brief Bioinform"},{"key":"2026052023572516000_btag209-B17","first-page":"11323","author":"Li","year":"2024"},{"key":"2026052023572516000_btag209-B18","doi-asserted-by":"crossref","first-page":"627","DOI":"10.1038\/s41576-021-00370-8","article-title":"Integrating single-cell and spatial transcriptomics to elucidate intercellular tissue dynamics","volume":"22","author":"Longo","year":"2021","journal-title":"Nat Rev Genet"},{"key":"2026052023572516000_btag209-B19","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1038\/s41592-020-01033-y","article-title":"Method of the year: spatially resolved transcriptomics","volume":"18","author":"Marx","year":"2021","journal-title":"Nat Methods"},{"key":"2026052023572516000_btag209-B20","doi-asserted-by":"crossref","first-page":"e1012881","DOI":"10.1371\/journal.pcbi.1012881","article-title":"SpaMask: dual masking graph autoencoder with contrastive learning for spatial transcriptomics","volume":"21","author":"Min","year":"2025","journal-title":"PLoS Comput Biol"},{"key":"2026052023572516000_btag209-B21","doi-asserted-by":"crossref","first-page":"bbae551","DOI":"10.1093\/bib\/bbae551","article-title":"Multimodal contrastive learning for spatial gene expression prediction using histology images","volume":"25","author":"Min","year":"2024","journal-title":"Brief Bioinform"},{"key":"2026052023572516000_btag209-B22","author":"Pang","year":"2021"},{"key":"2026052023572516000_btag209-B23","first-page":"8748","author":"Radford","year":"2021"},{"key":"2026052023572516000_btag209-B24","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/38.946629","article-title":"Color transfer between images","volume":"21","author":"Reinhard","year":"2001","journal-title":"IEEE Comput Grap Appl"},{"key":"2026052023572516000_btag209-B25","doi-asserted-by":"crossref","first-page":"112647","DOI":"10.1016\/j.engappai.2025.112647","article-title":"Geometry-informed multimodal fusion network for enhancing high-density spatial transcriptomics from histology images","volume":"162","author":"Shi","year":"2025","journal-title":"Eng Appl Artif Intell"},{"key":"2026052023572516000_btag209-B26","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1016\/j.ymeth.2024.11.016","article-title":"Inferring multi-slice spatially resolved gene expression from H&E-stained histology images with STMCL","volume":"234","author":"Shi","year":"2025","journal-title":"Methods"},{"key":"2026052023572516000_btag209-B27","doi-asserted-by":"crossref","first-page":"bbaa414","DOI":"10.1093\/bib\/bbaa414","article-title":"DSTG: deconvoluting spatial transcriptomics data through graph-based artificial intelligence","volume":"22","author":"Song","year":"2021","journal-title":"Brief Bioinform"},{"key":"2026052023572516000_btag209-B30","author":"Velickovic","year":"2018"},{"key":"2026052023572516000_btag209-B31","doi-asserted-by":"crossref","first-page":"bbaf425","DOI":"10.1093\/bib\/bbaf425","article-title":"Reg2ST: recognizing potential patterns from gene expression for spatial transcriptomics prediction","volume":"26","author":"Wang","year":"2025","journal-title":"Brief Bioinform"},{"key":"2026052023572516000_btag209-B32","doi-asserted-by":"crossref","first-page":"602","DOI":"10.1038\/s42003-020-01341-1","article-title":"From whole-mount to single-cell spatial assessment of gene expression in 3D","volume":"3","author":"Waylen","year":"2020","journal-title":"Commun Biol"},{"key":"2026052023572516000_btag209-B33","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1186\/s13073-024-01283-x","article-title":"Unsupervised spatially embedded deep representation of spatial transcriptomics","volume":"16","author":"Xu","year":"2024","journal-title":"Genome Med"},{"key":"2026052023572516000_btag209-B35","author":"Xue","year":"2025"},{"key":"2026052023572516000_btag209-B36","doi-asserted-by":"crossref","first-page":"bbac297","DOI":"10.1093\/bib\/bbac297","article-title":"Spatial transcriptomics prediction from histology jointly through transformer and graph neural networks","volume":"23","author":"Zeng","year":"2022","journal-title":"Brief Bioinform"},{"key":"2026052023572516000_btag209-B37","doi-asserted-by":"crossref","first-page":"bbaf433","DOI":"10.1093\/bib\/bbaf433","article-title":"SpaICL: image-guided curriculum strategy-based graph contrastive learning for spatial transcriptomics clustering","volume":"26","author":"Zhao","year":"2025","journal-title":"Brief Bioinform"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/advance-article-pdf\/doi\/10.1093\/bioinformatics\/btag209\/68162161\/btag209.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/42\/5\/btag209\/68162161\/btag209.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/42\/5\/btag209\/68162161\/btag209.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T03:57:51Z","timestamp":1779335871000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/doi\/10.1093\/bioinformatics\/btag209\/8662823"}},"subtitle":[],"editor":[{"given":"Bj\u00f6rn","family":"Gr\u00fcning","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2026,4,26]]},"references-count":33,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2026,5,3]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btag209","relation":{},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,5]]},"published":{"date-parts":[[2026,4,26]]},"article-number":"btag209"}}