{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,11]],"date-time":"2026-01-11T00:56:26Z","timestamp":1768092986468,"version":"3.49.0"},"reference-count":45,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2022,7,29]],"date-time":"2022-07-29T00:00:00Z","timestamp":1659052800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62072058"],"award-info":[{"award-number":["62072058"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61972422"],"award-info":[{"award-number":["61972422"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,9,20]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Motivation<\/jats:title>\n                  <jats:p>Digital pathological analysis is run as the main examination used for cancer diagnosis. Recently, deep learning-driven feature extraction from pathology images is able to detect genetic variations and tumor environment, but few studies focus on differential gene expression in tumor cells.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>In this paper, we propose a self-supervised contrastive learning framework, HistCode, to infer differential gene expression from whole slide images (WSIs). We leveraged contrastive learning on large-scale unannotated WSIs to derive slide-level histopathological features in latent space, and then transfer it to tumor diagnosis and prediction of differentially expressed cancer driver genes. Our experiments showed that our method outperformed other state-of-the-art models in tumor diagnosis tasks, and also effectively predicted differential gene expression. Interestingly, we found the genes with higher fold change can be more precisely predicted. To intuitively illustrate the ability to extract informative features from pathological images, we spatially visualized the WSIs colored by the attention scores of image tiles. We found that the tumor and necrosis areas were highly consistent with the annotations of experienced pathologists. Moreover, the spatial heatmap generated by lymphocyte-specific gene expression patterns was also consistent with the manually labeled WSIs.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/bib\/bbac294","type":"journal-article","created":{"date-parts":[[2022,7,28]],"date-time":"2022-07-28T20:29:19Z","timestamp":1659040159000},"source":"Crossref","is-referenced-by-count":14,"title":["Contrastive learning-based computational histopathology predict differential expression of cancer driver genes"],"prefix":"10.1093","volume":"23","author":[{"given":"Haojie","family":"Huang","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, Central South University , 410075, Changsha , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gongming","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Central South University , 410075, Changsha , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuejun","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Nanjing Tech University , 211816, Nanjing , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lei","family":"Deng","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Central South University , 410075, Changsha , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chen","family":"Wu","sequence":"additional","affiliation":[{"name":"The third affiliated hospital of Soochow University , 213100, Changzhou , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dachuan","family":"Zhang","sequence":"additional","affiliation":[{"name":"The third affiliated hospital of Soochow University , 213100, Changzhou , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hui","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Nanjing Tech University , 211816, Nanjing , China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2022,7,29]]},"reference":[{"issue":"1","key":"2022092013212263000_ref1","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pmed.1002730","article-title":"Predicting survival from colorectal cancer histology slides using deep learning: A retrospective multicenter study","volume":"16","author":"Kather","year":"2019","journal-title":"PLoS Med"},{"key":"2022092013212263000_ref2","article-title":"Deep learning based tissue analysis predicts outcome in colorectal cancer","volume-title":"Scientific reports","author":"Bychkov"},{"issue":"2","key":"2022092013212263000_ref3","doi-asserted-by":"crossref","first-page":"2000","DOI":"10.1002\/hep.31207","article-title":"Predicting survival after hepatocellular carcinoma resection using deep learning on histological slides","volume":"72","author":"Saillard","year":"2020","journal-title":"Hepatology"},{"issue":"12","key":"2022092013212263000_ref4","doi-asserted-by":"crossref","first-page":"103415","DOI":"10.1016\/j.isci.2021.103415","article-title":"Robust deep learning model for prognostic stratification of pancreatic ductal adenocarcinoma patients","volume":"24","author":"Jie","year":"2021","journal-title":"Iscience"},{"issue":"14","key":"2022092013212263000_ref5","doi-asserted-by":"crossref","first-page":"i446","DOI":"10.1093\/bioinformatics\/btz342","article-title":"Deep learning with multimodal representation for pancancer prognosis prediction","volume":"35","author":"Cheerla","year":"2019","journal-title":"Bioinformatics"},{"key":"2022092013212263000_ref6","first-page":"2424","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"Hou","year":"2016"},{"key":"2022092013212263000_ref7","doi-asserted-by":"crossref","DOI":"10.1038\/s41467-020-20030-5","article-title":"Deep learning-based cross-classifications reveal conserved spatial behaviors within tumor histological images","volume":"11","author":"Noorbakhsh","year":"2020","journal-title":"Nat Commun"},{"issue":"13","key":"2022092013212263000_ref8","doi-asserted-by":"crossref","first-page":"E2970","DOI":"10.1073\/pnas.1717139115","article-title":"Predicting cancer outcomes from histology and genomics using convolutional networks","volume":"115","author":"Mobadersany","year":"2018","journal-title":"Proc Natl Acad Sci"},{"issue":"2","key":"2022092013212263000_ref9","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1016\/S1470-2045(19)30738-7","article-title":"Artificial intelligence for diagnosis and grading of prostate cancer in biopsies: a population-based, diagnostic study","volume":"21","author":"Str\u00f6m","year":"2020","journal-title":"Lancet Oncol"},{"key":"2022092013212263000_ref10","volume-title":"Conf Comput Vis Pattern Recognit Workshops","author":"Li"},{"issue":"1","key":"2022092013212263000_ref11","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1016\/j.celrep.2018.03.086","article-title":"Spatial organization and molecular correlation of tumor-infiltrating lymphocytes using deep learning on pathology images","volume":"23","author":"Saltz","year":"2018","journal-title":"Cell Rep"},{"key":"2022092013212263000_ref12","doi-asserted-by":"crossref","DOI":"10.4103\/jpi.jpi_73_17","article-title":"Convolutional deep belief network with feature encoding for classification of neuroblastoma histological images","volume":"9","author":"Gheisari","year":"2018","journal-title":"Journal of pathology informatics"},{"issue":"8","key":"2022092013212263000_ref13","doi-asserted-by":"crossref","first-page":"789","DOI":"10.1038\/s43018-020-0087-6","article-title":"Pan-cancer image-based detection of clinically actionable genetic alterations","volume":"1","author":"Kather","year":"2020","journal-title":"Nature Cancer"},{"issue":"8","key":"2022092013212263000_ref14","doi-asserted-by":"crossref","first-page":"800","DOI":"10.1038\/s43018-020-0085-8","article-title":"Pan-cancer computational histopathology reveals mutations, tumor composition and prognosis","volume":"1","author":"Yu","year":"2020","journal-title":"Nature Cancer"},{"key":"2022092013212263000_ref15","article-title":"Pathomic fusion: an integrated framework for fusing histopathology and genomic features for cancer diagnosis and prognosis","volume":"41","author":"Chen","journal-title":"IEEE Trans Med Imaging"},{"issue":"10","key":"2022092013212263000_ref16","doi-asserted-by":"crossref","first-page":"1559","DOI":"10.1038\/s41591-018-0177-5","article-title":"Classification and mutation prediction from non\u2013small cell lung cancer histopathology images using deep learning","volume":"24","author":"Coudray","year":"2018","journal-title":"Nat Med"},{"issue":"7","key":"2022092013212263000_ref17","doi-asserted-by":"crossref","first-page":"1054","DOI":"10.1038\/s41591-019-0462-y","article-title":"Deep learning can predict microsatellite instability directly from histology in gastrointestinal cancer","volume":"25","author":"Kather","year":"2019","journal-title":"Nat Med"},{"issue":"4","key":"2022092013212263000_ref18","doi-asserted-by":"crossref","first-page":"1406","DOI":"10.1053\/j.gastro.2020.06.021","article-title":"Clinical-grade detection of microsatellite instability in colorectal tumors by deep learning","volume":"159","author":"Echle","year":"2020","journal-title":"Gastroenterology"},{"issue":"24","key":"2022092013212263000_ref19","doi-asserted-by":"crossref","first-page":"11080","DOI":"10.7150\/thno.49864","article-title":"Development and interpretation of a pathomics-based model for the prediction of microsatellite instability in colorectal cancer","volume":"10","author":"Cao","year":"2020","journal-title":"Theranostics"},{"issue":"1","key":"2022092013212263000_ref20","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1016\/S1470-2045(20)30535-0","article-title":"Deep learning model for the prediction of microsatellite instability in colorectal cancer: a diagnostic study","volume":"22","author":"Yamashita","year":"2021","journal-title":"Lancet Oncol"},{"issue":"5","key":"2022092013212263000_ref21","doi-asserted-by":"crossref","first-page":"1313","DOI":"10.1109\/TMI.2016.2528120","article-title":"Aggnet: deep learning from crowds for mitosis detection in breast cancer histology images","volume":"35","author":"Albarqouni","year":"2016","journal-title":"IEEE Trans Med Imaging"},{"issue":"9","key":"2022092013212263000_ref22","doi-asserted-by":"crossref","first-page":"2126","DOI":"10.1109\/TMI.2018.2820199","article-title":"Whole-slide mitosis detection in h&e breast histology using phh3 as a reference to train distilled stain-invariant convolutional networks","volume":"37","author":"Tellez","year":"2018","journal-title":"IEEE Trans Med Imaging"},{"key":"2022092013212263000_ref23","article-title":"Mitos-rcnn: A novel approach to mitotic figure detection in breast cancer histopathology images using region based convolutional neural networks","author":"Rao","year":"2018"},{"key":"2022092013212263000_ref24","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1016\/j.media.2019.01.013","article-title":"Weakly supervised mitosis detection in breast histopathology images using concentric loss","volume":"53","author":"Li","year":"2019","journal-title":"Med Image Anal"},{"key":"2022092013212263000_ref25","doi-asserted-by":"crossref","first-page":"1609","DOI":"10.1038\/s41467-021-21727-x","article-title":"Joint analysis of expression levels and histological images identifies genes associated with tissue morphology","volume":"12","author":"Ash","year":"2021","journal-title":"Nat Commun"},{"issue":"10","key":"2022092013212263000_ref26","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1038\/s41568-020-0290-x","article-title":"A compendium of mutational cancer driver genes","volume":"20","author":"Mart\u00ednez-Jim\u00e9nez","year":"2020","journal-title":"Nat Rev Cancer"},{"key":"2022092013212263000_ref27","doi-asserted-by":"crossref","DOI":"10.4103\/2153-3539.119005","article-title":"Openslide: A vendor-neutral software foundation for digital pathology","volume":"4","author":"Goode","year":"2013","journal-title":"Journal of pathology informatics"},{"issue":"1","key":"2022092013212263000_ref28","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","article-title":"A threshold selection method from gray-level histograms","volume":"9","author":"Otsu","year":"1979","journal-title":"IEEE Trans Syst Man Cybern"},{"issue":"1","key":"2022092013212263000_ref29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-020-17678-4","article-title":"A deep learning model to predict rna-seq expression of tumours from whole slide images","volume":"11","author":"Schmauch","year":"2020","journal-title":"Nat Commun"},{"issue":"4","key":"2022092013212263000_ref30","first-page":"3723","article-title":"Identification of candidate genes associated with the pathogenesis of small cell lung cancer via integrated bioinformatics analysis","volume":"18","author":"Liao","year":"2019","journal-title":"Oncol Lett"},{"key":"2022092013212263000_ref31","first-page":"1074","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, June 19\u201325","author":"Qianjiang","year":"2021"},{"key":"2022092013212263000_ref32","first-page":"177","volume-title":"Proceedings of COMPSTAT\u20192010","author":"Bottou","year":"2010"},{"key":"2022092013212263000_ref33","first-page":"2127","volume-title":"International conference on machine learning","author":"Ilse","year":"2018"},{"issue":"8","key":"2022092013212263000_ref34","doi-asserted-by":"crossref","first-page":"1301","DOI":"10.1038\/s41591-019-0508-1","article-title":"Clinical-grade computational pathology using weakly supervised deep learning on whole slide images","volume":"25","author":"Campanella","year":"2019","journal-title":"Nat Med"},{"issue":"7605","key":"2022092013212263000_ref35","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1038\/nature17676","article-title":"Landscape of somatic mutations in 560 breast cancer whole-genome sequences","volume":"534","author":"Nik-Zainal","year":"2016","journal-title":"Nature"},{"issue":"6148","key":"2022092013212263000_ref36","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1038\/330569a0","article-title":"Identification and sequence of a fourth human t cell antigen receptor chain","volume":"330","author":"Loh","year":"1987","journal-title":"Nature"},{"issue":"6559","key":"2022092013212263000_ref37","doi-asserted-by":"crossref","first-page":"789","DOI":"10.1038\/378789a0","article-title":"Identification of the breast cancer susceptibility gene brca2","volume":"378","author":"Wooster","year":"1995","journal-title":"Nature"},{"issue":"3","key":"2022092013212263000_ref38","doi-asserted-by":"crossref","first-page":"2109","DOI":"10.1007\/s11033-011-0958-0","article-title":"Common brca1 and brca2 mutations in breast cancer families: a meta-analysis from systematic review","volume":"39","author":"Wang","year":"2012","journal-title":"Mol Biol Rep"},{"issue":"2","key":"2022092013212263000_ref39","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1042\/BJ20101603","article-title":"Fibroblast growth factors and their receptors in cancer","volume":"437","author":"Wesche","year":"2011","journal-title":"Biochem J"},{"issue":"9","key":"2022092013212263000_ref40","doi-asserted-by":"crossref","first-page":"1766","DOI":"10.1038\/sj.onc.1207391","article-title":"Esx induces transformation and functional epithelial to mesenchymal transition in mcf-12a mammary epithelial cells","volume":"23","author":"Schedin","year":"2004","journal-title":"Oncogene"},{"issue":"12","key":"2022092013212263000_ref41","doi-asserted-by":"crossref","first-page":"2379","DOI":"10.1016\/j.yexcr.2006.04.001","article-title":"Megap impedes cell migration via regulating actin and microtubule dynamics and focal complex formation","volume":"312","author":"Yang","year":"2006","journal-title":"Exp Cell Res"},{"issue":"2","key":"2022092013212263000_ref42","doi-asserted-by":"crossref","first-page":"388","DOI":"10.1016\/j.molcel.2016.09.017","article-title":"Fancd2 facilitates replication through common fragile sites","volume":"64","author":"Madireddy","year":"2016","journal-title":"Mol Cell"},{"key":"2022092013212263000_ref43","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1038\/s42256-021-00325-y","article-title":"Integration of multiomics data with graph convolutional networks to identify new cancer genes and their associated molecular mechanisms","volume":"3","author":"Schulte-Sasse","year":"2021","journal-title":"Nat Mach Intell"},{"key":"2022092013212263000_ref44","doi-asserted-by":"crossref","DOI":"10.1093\/bib\/bbab432","article-title":"Improving cancer driver gene identification using multi-task learning on graph convolutional network","volume":"23","author":"Peng","year":"2022","journal-title":"Brief Bioinform"},{"key":"2022092013212263000_ref45","article-title":"Data-efficient and weakly supervised computational pathology on whole-slide images","volume-title":"Nature biomedical engineering","author":""}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/23\/5\/bbac294\/45937482\/bbac294.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/23\/5\/bbac294\/45937482\/bbac294.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,20]],"date-time":"2022-09-20T17:42:06Z","timestamp":1663695726000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbac294\/6651307"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,29]]},"references-count":45,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2022,9,20]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbac294","relation":{},"ISSN":["1467-5463","1477-4054"],"issn-type":[{"value":"1467-5463","type":"print"},{"value":"1477-4054","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,9]]},"published":{"date-parts":[[2022,7,29]]},"article-number":"bbac294"}}