{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,22]],"date-time":"2025-02-22T00:45:16Z","timestamp":1740185116334,"version":"3.37.3"},"reference-count":22,"publisher":"Oxford University Press (OUP)","issue":"Supplement_2","license":[{"start":{"date-parts":[[2024,9,4]],"date-time":"2024-09-04T00:00:00Z","timestamp":1725408000000},"content-version":"vor","delay-in-days":3,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"CLIRPath EPSRC","award":["EP\/W00058X\/1"],"award-info":[{"award-number":["EP\/W00058X\/1"]}]},{"name":"University of Manchester Wellcome Institutional Strategic Support","award":["204796\/Z\/16\/Z"],"award-info":[{"award-number":["204796\/Z\/16\/Z"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,9,1]]},"abstract":"Abstract<\/jats:title>\n \n Summary<\/jats:title>\n Imagine if we could simultaneously predict spatial protein expression in tissues from their routine Hematoxylin and Eosin (H&E) stained images, and create tissue images given protein expression profiles thus enabling virtual simulations of how protein expression alterations impact histology in complex diseases like cancer. Such an approach could lead to more informed diagnostic and therapeutic decisions for precision medicine at lower costs and shorter turnaround times, more detailed insights into underlying disease pathology as well as improvement in predictive and generative performance. In this study, we investigate the intricate correlation between protein expressions obtained from Hyperion mass cytometry and histopathological microstructures in conventional H&E stained glioblastoma (GBM) samples, unveiling morphological patterns and cellular-level spatial alterations associated with protein expression changes. To model these complex relationships, we propose a novel generative-predictive framework called Ouroboros for producing H&E images from protein expressions and simultaneously predicting protein expressions from H&E images. Our comprehensive sample-independent validation over 9920 tissue spots from 4 GBM samples encompassing visual image analysis, quantitative analysis, subspace alignment and perturbation experiments shows that the proposed generative-predictive approach offers significant improvements in predicting protein expression from images in comparison to baseline methods as well as accurate generation of virtual GBM sample images. This proof of concept study can contribute to advancing our understanding of histological responses to protein expression perturbations and lays the foundations for further developments in this area.<\/jats:p>\n <\/jats:sec>\n \n Availability and implementation<\/jats:title>\n Implementation and associated data for the proposed approach are available at the URL: https:\/\/github.com\/Srijay\/Ouroboros.<\/jats:p>\n <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btae399","type":"journal-article","created":{"date-parts":[[2024,9,5]],"date-time":"2024-09-05T07:44:11Z","timestamp":1725522251000},"page":"ii174-ii181","source":"Crossref","is-referenced-by-count":0,"title":["Ouroboros: cross-linking protein expression perturbations and cancer histology imaging with generative-predictive modeling"],"prefix":"10.1093","volume":"40","author":[{"given":"Srijay","family":"Deshpande","sequence":"first","affiliation":[{"name":"Department of Computer Science, Tissue Image Analytics Centre, University of Warwick , Coventry, CV4 7AL, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sokratia","family":"Georgaka","sequence":"additional","affiliation":[{"name":"Manchester Academic Health Science Centre, Faculty of Biology, Medicine and Health, University of Manchester , M13 9PL, Manchester, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Haley","sequence":"additional","affiliation":[{"name":"Manchester Academic Health Science Centre, Faculty of Biology, Medicine and Health, University of Manchester , M13 9PL, Manchester, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Robert","family":"Sellers","sequence":"additional","affiliation":[{"name":"Manchester Academic Health Science Centre, Faculty of Biology, Medicine and Health, University of Manchester , M13 9PL, Manchester, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James","family":"Minshull","sequence":"additional","affiliation":[{"name":"Division of Neuroscience and Experimental Psychology, University of Manchester , Manchester, M13 9PL, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jayakrupakar","family":"Nallala","sequence":"additional","affiliation":[{"name":"School of Physics and Astronomy, University of Exeter , Exeter, EX4 4QL, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martin","family":"Fergie","sequence":"additional","affiliation":[{"name":"Division of Informatics, Imaging and Data Science, University of Manchester , Manchester, M13 9PT, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicholas","family":"Stone","sequence":"additional","affiliation":[{"name":"School of Physics and Astronomy, University of Exeter , Exeter, EX4 4QL, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nasir","family":"Rajpoot","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Tissue Image Analytics Centre, University of Warwick , Coventry, CV4 7AL, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Syed Murtuza","family":"Baker","sequence":"additional","affiliation":[{"name":"Manchester Academic Health Science Centre, Faculty of Biology, Medicine and Health, University of Manchester , M13 9PL, Manchester, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mudassar","family":"Iqbal","sequence":"additional","affiliation":[{"name":"Manchester Academic Health Science Centre, Faculty of Biology, Medicine and Health, University of Manchester , M13 9PL, Manchester, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kevin","family":"Couper","sequence":"additional","affiliation":[{"name":"Manchester Academic Health Science Centre, Faculty of Biology, Medicine and Health, University of Manchester , M13 9PL, Manchester, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Federico","family":"Roncaroli","sequence":"additional","affiliation":[{"name":"Division of Neuroscience and Experimental Psychology, University of Manchester , Manchester, M13 9PL, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9129-1189","authenticated-orcid":false,"given":"Fayyaz","family":"Minhas","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Tissue Image Analytics Centre, University of Warwick , Coventry, CV4 7AL, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2024,9,4]]},"reference":[{"key":"2024090413594639900_btae399-B1","doi-asserted-by":"crossref","first-page":"16878","DOI":"10.1038\/s41598-017-17204-5","article-title":"QuPath: open source software for digital pathology image analysis","volume":"7","author":"Bankhead","year":"2017","journal-title":"Sci Rep"},{"key":"2024090413594639900_btae399-B2","doi-asserted-by":"crossref","first-page":"e763","DOI":"10.1016\/S2589-7500(21)00180-1","article-title":"Development and validation of a weakly supervised deep learning framework to predict the status of molecular pathways and key mutations in colorectal cancer from routine histology images: a retrospective study","volume":"3","author":"Bilal","year":"2021","journal-title":"Lancet Digit Health"},{"year":"2019:","author":"Brock","key":"2024090413594639900_btae399-B3"},{"key":"2024090413594639900_btae399-B4","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1007\/978-3-030-93733-1_32","volume-title":"Machine Learning and Principles and Practice of Knowledge Discovery in Databases","author":"Dawood","year":"2021"},{"key":"2024090413594639900_btae399-B5","doi-asserted-by":"crossref","first-page":"112816","DOI":"10.1016\/j.celrep.2023.112816","article-title":"Coexisting cancer stem cells with heterogeneous gene amplifications, transcriptional profiles, and malignancy are isolated from single glioblastomas","volume":"42","author":"De Bacco","year":"2023","journal-title":"Cell Rep"},{"key":"2024090413594639900_btae399-B6","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1038\/nmeth.2869","article-title":"Highly multiplexed imaging of tumor tissues with subcellular resolution by mass cytometry","volume":"11","author":"Giesen","year":"2014","journal-title":"Nat Methods"},{"key":"2024090413594639900_btae399-B7","first-page":"2672","article-title":"Generative adversarial nets","volume":"27","author":"Goodfellow","year":"2014","journal-title":"Adv Neural Inf Process Syst"},{"year":"2017","author":"Heusel","key":"2024090413594639900_btae399-B8"},{"key":"2024090413594639900_btae399-B9","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1038\/s41551-020-0578-x","article-title":"Integrating spatial gene expression and breast tumour morphology via deep learning","volume":"4","author":"He","year":"2020","journal-title":"Nat Biomed Eng"},{"first-page":"770","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","author":"He","key":"2024090413594639900_btae399-B10"},{"key":"2024090413594639900_btae399-B11","doi-asserted-by":"crossref","first-page":"226","DOI":"10.3390\/cancers6010226","article-title":"Glioblastoma multiforme: a look inside its heterogeneous nature","volume":"6","author":"Inda","year":"2014","journal-title":"Cancers (Basel)"},{"key":"2024090413594639900_btae399-B12","doi-asserted-by":"crossref","first-page":"100817","DOI":"10.1016\/j.patter.2023.100817","article-title":"Generative modeling of single-cell gene expression for dose-dependent chemical perturbations","volume":"4","author":"Kana","year":"2023","journal-title":"Patterns (NY)"},{"key":"2024090413594639900_btae399-B13","doi-asserted-by":"crossref","first-page":"789","DOI":"10.1038\/s43018-020-0087-6","article-title":"Pan-cancer image-based detection of clinically actionable genetic alterations","volume":"1","author":"Kather","year":"2020","journal-title":"Nat Cancer"},{"key":"2024090413594639900_btae399-B14","doi-asserted-by":"crossref","first-page":"859414","DOI":"10.3389\/fimmu.2022.859414","article-title":"Application of high-throughput imaging mass cytometry hyperion in cancer research","volume":"13","author":"Le Rochais","year":"2022","journal-title":"Front Immunol"},{"key":"2024090413594639900_btae399-B15","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1038\/s41368-021-00146-0","article-title":"From bulk, single-cell to spatial RNA sequencing","volume":"13","author":"Li","year":"2021","journal-title":"Int J Oral Sci"},{"key":"2024090413594639900_btae399-B16","doi-asserted-by":"crossref","first-page":"1601","DOI":"10.1038\/s41467-023-37123-6","article-title":"IMC-denoise: a content aware denoising pipeline to enhance imaging mass cytometry","volume":"14","author":"Lu","year":"2023","journal-title":"Nat Commun"},{"key":"2024090413594639900_btae399-B17","doi-asserted-by":"crossref","first-page":"534","DOI":"10.1038\/s41592-022-01409-2","article-title":"Museum of spatial transcriptomics","volume":"19","author":"Moses","year":"2022","journal-title":"Nat Methods"},{"key":"2024090413594639900_btae399-B18","doi-asserted-by":"crossref","first-page":"13932","DOI":"10.3390\/molecules190913932","article-title":"Protein expression analyses at the single cell level","volume":"19","author":"Ohno","year":"2014","journal-title":"Molecules"},{"year":"2023","author":"Palma","key":"2024090413594639900_btae399-B19"},{"key":"2024090413594639900_btae399-B20","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1186\/s13059-022-02824-6","article-title":"Spatial omics technologies at multimodal and single cell\/subcellular level","volume":"23","author":"Park","year":"2022","journal-title":"Genome Biol"},{"year":"2018","author":"Schmidt","key":"2024090413594639900_btae399-B21"},{"key":"2024090413594639900_btae399-B22","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1186\/s12859-020-03559-6","article-title":"Simulating ComBat: how batch correction can lead to the systematic introduction of false positive results in DNA methylation microarray studies","volume":"21","author":"Zindler","year":"2020","journal-title":"BMC Bioinformatics"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/40\/Supplement_2\/ii174\/59017010\/btae399.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/40\/Supplement_2\/ii174\/59017010\/btae399.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,5]],"date-time":"2024-09-05T07:44:27Z","timestamp":1725522267000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/40\/Supplement_2\/ii174\/7749080"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,1]]},"references-count":22,"journal-issue":{"issue":"Supplement_2","published-print":{"date-parts":[[2024,9,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btae399","relation":{},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"type":"print","value":"1367-4803"},{"type":"electronic","value":"1367-4811"}],"subject":[],"published-other":{"date-parts":[[2024,9]]},"published":{"date-parts":[[2024,9,1]]}}}