{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,4]],"date-time":"2026-09-04T05:48:33Z","timestamp":1788500913048,"version":"build-2803163510"},"reference-count":48,"publisher":"Public Library of Science (PLoS)","issue":"1","license":[{"start":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T00:00:00Z","timestamp":1769472000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Strukturiertes Doktorandenprogramm zum Erwerb des Dr. med. und Dr. rer. nat.","award":["N\/A"],"award-info":[{"award-number":["N\/A"]}]},{"name":"Strukturiertes Doktorandenprogramm zum Erwerb des Dr. med. und Dr. rer. nat.","award":["N\/A"],"award-info":[{"award-number":["N\/A"]}]},{"name":"Comisi\u00c3\u00b3n Acad\u00c3\u00a9mica de Posgrado","award":["N\/A"],"award-info":[{"award-number":["N\/A"]}]},{"DOI":"10.13039\/100021828","name":"German Academic Exchange Service","doi-asserted-by":"publisher","award":["57645446"],"award-info":[{"award-number":["57645446"]}],"id":[{"id":"10.13039\/100021828","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["EXC-2082\/1-390761711"],"award-info":[{"award-number":["EXC-2082\/1-390761711"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["FOR2509, WI 1824\/9-1"],"award-info":[{"award-number":["FOR2509, WI 1824\/9-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000781","name":"European Research Council","doi-asserted-by":"publisher","award":["810172"],"award-info":[{"award-number":["810172"]}],"id":[{"id":"10.13039\/501100000781","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["INST 35\/1597-1 FUGG"],"award-info":[{"award-number":["INST 35\/1597-1 FUGG"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003542","name":"Ministerium f\u00c3\u00bcr Wissenschaft, Forschung und Kunst Baden-W\u00c3\u00bcrttemberg","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003542","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["INST 35\/1803-1 FUGG and INST 35\/1804-1 LAGG"],"award-info":[{"award-number":["INST 35\/1803-1 FUGG and INST 35\/1804-1 LAGG"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Landesregierung von Baden-W\u00c3\u00bcrttemberg"}],"content-domain":{"domain":["www.plosbiology.org"],"crossmark-restriction":false},"short-container-title":["PLoS Biol"],"abstract":"<jats:p>Retinal organoids have become important models for studying development and disease, yet stochastic heterogeneity in the formation of cell types, tissues, and phenotypes remains a major challenge. This limits our ability to precisely experimentally address the early developmental trajectories towards these outcomes. Here, we utilize deep learning to predict the differentiation path and resulting tissues in retinal organoids well before they become visually discernible. Our approach effectively bypasses the challenge of organoid-related heterogeneity in tissue formation. For this, we acquired a high-resolution time-lapse imaging dataset comprising about 1,000 organoids and over 100,000 images enabling precise temporal tracking of organoid development. By combining expert annotations with advanced image analysis of organoid morphology, we characterized the heterogeneity of the retinal pigmented epithelium (RPE) and lens tissues, as well as global organoid morphologies over time. Using this training set, our deep learning approach accurately predicts the emergence and size of RPE and lens tissue formation as well as similarities in overall organoid morphology on an organoid-by-organoid basis at early developmental stages, refining our understanding of when early lineage decisions are made. This approach advances knowledge of tissue and phenotype decision-making in organoid development and can inform the design of similar predictive platforms for other organoid systems, paving the way for more standardized and reproducible organoid research. Finally, it provides a direct focus on early developmental time points for in-depth molecular analyses, alleviated from confounding effects of heterogeneity.<\/jats:p>","DOI":"10.1371\/journal.pbio.3003597","type":"journal-article","created":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T18:43:53Z","timestamp":1769539433000},"page":"e3003597","update-policy":"https:\/\/doi.org\/10.1371\/journal.pbio.corrections_policy","source":"Crossref","is-referenced-by-count":3,"title":["A deep learning-based computational pipeline predicts developmental outcome in retinal organoids"],"prefix":"10.1371","volume":"24","author":[{"given":"Cassian","family":"Afting","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Norin","family":"Bhatti","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christina","family":"Schlagheck","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Encarnaci\u00f3n S\u00e1nchez","family":"Salvador","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura","family":"Herrera-Astorga","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rashi","family":"Agarwal","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Risa","family":"Suzuki","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicolaj","family":"Hackert","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hanns-Martin","family":"Lorenz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lucie","family":"Zilova","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8550-7377","authenticated-orcid":true,"given":"Joachim","family":"Wittbrodt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3131-2133","authenticated-orcid":true,"given":"Tarik","family":"Exner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2026,1,27]]},"reference":[{"issue":"6","key":"pbio.3003597.ref001","doi-asserted-by":"crossref","first-page":"771","DOI":"10.1016\/j.stem.2012.05.009","article-title":"Self-formation of optic cups and storable stratified neural retina from human ESCs","volume":"10","author":"T Nakano","year":"2012","journal-title":"Cell Stem Cell"},{"issue":"7341","key":"pbio.3003597.ref002","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1038\/nature09941","article-title":"Self-organizing optic-cup morphogenesis in three-dimensional culture","volume":"472","author":"M Eiraku","year":"2011","journal-title":"Nature"},{"key":"pbio.3003597.ref003","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.66998","article-title":"Fish primary embryonic pluripotent cells assemble into retinal tissue mirroring in vivo early eye development","volume":"10","author":"L Zilova","year":"2021","journal-title":"Elife"},{"issue":"5","key":"pbio.3003597.ref004","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1038\/s41578-021-00279-y","article-title":"Engineering organoids","volume":"6","author":"M Hofer","year":"2021","journal-title":"Nat Rev Mater"},{"key":"pbio.3003597.ref005","article-title":"Retinal organoids: cultivation, differentiation, and transplantation","volume":"15","author":"X Li","year":"2021","journal-title":"Front Cell Neurosci"},{"issue":"7828","key":"pbio.3003597.ref006","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1038\/s41586-020-2776-9","article-title":"Phenotypic landscape of intestinal organoid regeneration","volume":"586","author":"I Lukonin","year":"2020","journal-title":"Nature"},{"issue":"3","key":"pbio.3003597.ref007","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1038\/s41592-021-01391-1","article-title":"Deterministic scRNA-seq captures variation in intestinal crypt and organoid composition","volume":"19","author":"J Bues","year":"2022","journal-title":"Nat Methods"},{"issue":"24","key":"pbio.3003597.ref008","article-title":"Retinal organoids: a window into human retinal development","volume":"147","author":"M O\u2019Hara-Wright","year":"2020","journal-title":"Development"},{"issue":"1","key":"pbio.3003597.ref009","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1038\/s43586-022-00174-y","article-title":"Organoids","volume":"2","author":"Z Zhao","year":"2022","journal-title":"Nat Rev Methods Primers"},{"issue":"6","key":"pbio.3003597.ref010","doi-asserted-by":"crossref","DOI":"10.1016\/j.cell.2020.08.013","article-title":"Cell types of the human retina and its organoids at single-cell resolution","volume":"182","author":"CS Cowan","year":"2020","journal-title":"Cell"},{"issue":"8","key":"pbio.3003597.ref011","doi-asserted-by":"crossref","first-page":"100548","DOI":"10.1016\/j.crmeth.2023.100548","article-title":"Single-cell sequencing of individual retinal organoids reveals determinants of cell-fate heterogeneity","volume":"3","author":"A Tresenrider","year":"2023","journal-title":"Cell Rep Methods"},{"issue":"12","key":"pbio.3003597.ref012","doi-asserted-by":"crossref","first-page":"1765","DOI":"10.1038\/s41587-023-01747-2","article-title":"Multimodal spatiotemporal phenotyping of human retinal organoid development","volume":"41","author":"P Wahle","year":"2023","journal-title":"Nat Biotechnol"},{"issue":"18","key":"pbio.3003597.ref013","doi-asserted-by":"crossref","DOI":"10.1242\/dev.199611","article-title":"MOrgAna: accessible quantitative analysis of organoids with machine learning","volume":"148","author":"N Gritti","year":"2021","journal-title":"Development"},{"issue":"1","key":"pbio.3003597.ref014","doi-asserted-by":"crossref","first-page":"12479","DOI":"10.1038\/s41598-019-48874-y","article-title":"OrgaQuant: human intestinal organoid localization and quantification using deep convolutional neural networks","volume":"9","author":"T Kassis","year":"2019","journal-title":"Sci Rep"},{"issue":"10","key":"pbio.3003597.ref015","article-title":"OrganoidTracker: efficient cell tracking using machine learning and manual error correction","volume":"15","author":"RNU Kok","year":"2020","journal-title":"PLoS One"},{"issue":"11","key":"pbio.3003597.ref016","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1010584","article-title":"OrganoID: a versatile deep learning platform for tracking and analysis of single-organoid dynamics","volume":"18","author":"JM Matthews","year":"2022","journal-title":"PLoS Comput Biol"},{"issue":"1","key":"pbio.3003597.ref017","doi-asserted-by":"crossref","first-page":"75","DOI":"10.23876\/j.krcp.22.017","article-title":"Deep learning predicts the differentiation of kidney organoids derived from human induced pluripotent stem cells","volume":"42","author":"K Park","year":"2023","journal-title":"Kidney Res Clin Pract"},{"issue":"1","key":"pbio.3003597.ref018","doi-asserted-by":"crossref","first-page":"22781","DOI":"10.1038\/s41598-023-49758-y","article-title":"Machine learning-based estimation of spatial gene expression pattern during ESC-derived retinal organoid development","volume":"13","author":"Y Fujimura","year":"2023","journal-title":"Sci Rep"},{"key":"pbio.3003597.ref019","doi-asserted-by":"crossref","first-page":"171","DOI":"10.3389\/fncel.2020.00171","article-title":"Convolutional neural networks can predict retinal differentiation in retinal organoids","volume":"14","author":"E Kegeles","year":"2020","journal-title":"Front Cell Neurosci"},{"issue":"3","key":"pbio.3003597.ref020","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1007\/s42242-022-00226-y","article-title":"Organoids revealed: morphological analysis of the profound next generation in-vitro model with artificial intelligence","volume":"6","author":"X Du","year":"2023","journal-title":"Biodes Manuf"},{"issue":"12","key":"pbio.3003597.ref021","doi-asserted-by":"crossref","first-page":"1849","DOI":"10.1038\/s41565-024-01779-y","article-title":"DNA microbeads for spatio-temporally controlled morphogen release within organoids","volume":"19","author":"C Afting","year":"2024","journal-title":"Nat Nanotechnol"},{"key":"pbio.3003597.ref022","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.46188","article-title":"Merging organoid and organ-on-a-chip technology to generate complex multi-layer tissue models in a human retina-on-a-chip platform","volume":"8","author":"K Achberger","year":"2019","journal-title":"Elife"},{"key":"pbio.3003597.ref023","article-title":"Inverted assembly of the lens within ocular organoids reveals alternate paths to ocular morphogenesis","author":"E Stahl","year":"2025","journal-title":"bioRxiv"},{"issue":"8","key":"pbio.3003597.ref024","doi-asserted-by":"crossref","first-page":"101372","DOI":"10.1016\/j.isci.2020.101372","article-title":"Spatiotemporal gradient and instability of Wnt induce heterogeneous growth and differentiation of human intestinal organoids","volume":"23","author":"W Shin","year":"2020","journal-title":"iScience"},{"issue":"2","key":"pbio.3003597.ref025","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1002\/stem.3116","article-title":"Human iPSC differentiation to retinal organoids in response to IGF1 and BMP4 activation is line- and method-dependent","volume":"38","author":"V Chichagova","year":"2020","journal-title":"Stem Cells"},{"issue":"5","key":"pbio.3003597.ref026","doi-asserted-by":"crossref","first-page":"620","DOI":"10.1016\/j.stem.2012.02.013","article-title":"Recurrent variations in DNA methylation in human pluripotent stem cells and their differentiated derivatives","volume":"10","author":"KL Nazor","year":"2012","journal-title":"Cell Stem Cell"},{"issue":"10","key":"pbio.3003597.ref027","doi-asserted-by":"crossref","first-page":"1535","DOI":"10.1002\/stem.2883","article-title":"Human-induced pluripotent stem cells generate light responsive retinal organoids with variable and nutrient-dependent efficiency","volume":"36","author":"D Hallam","year":"2018","journal-title":"Stem Cells"},{"issue":"10","key":"pbio.3003597.ref028","doi-asserted-by":"crossref","first-page":"2601","DOI":"10.1016\/j.celrep.2018.01.075","article-title":"Retinal cell type DNA methylation and histone modifications predict reprogramming efficiency and retinogenesis in 3D organoid cultures","volume":"22","author":"L Wang","year":"2018","journal-title":"Cell Reports"},{"issue":"11","key":"pbio.3003597.ref029","article-title":"The false hope of current approaches to explainable artificial intelligence in health care","volume":"3","author":"M Ghassemi","year":"2021","journal-title":"Lancet Digit Health"},{"issue":"1","key":"pbio.3003597.ref030","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1007\/s10278-022-00719-3","article-title":"An explainable convolutional neural network for the early diagnosis of Alzheimer\u2019s disease from 18F-FDG PET","volume":"36","author":"LA De Santi","year":"2023","journal-title":"J Digit Imaging"},{"key":"pbio.3003597.ref031","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1016\/S0925-4773(00)00406-8","article-title":"A genetic screen for mutations affecting embryonic development in medaka fish (Oryzias latipes)","volume":"97","author":"F Loosli","year":"2000","journal-title":"Mech Dev"},{"key":"pbio.3003597.ref032","doi-asserted-by":"crossref","first-page":"605","DOI":"10.1016\/j.mod.2004.03.012","article-title":"Stages of normal development in the medaka Oryzias latipes","volume":"121","author":"T Iwamatsu","year":"2004","journal-title":"Mech Dev"},{"issue":"6","key":"pbio.3003597.ref033","doi-asserted-by":"crossref","DOI":"10.3390\/ijms20061290","article-title":"A smart imaging workflow for organ-specific screening in a cystic kidney zebrafish disease model","volume":"20","author":"G Pandey","year":"2019","journal-title":"Int J Mol Sci"},{"issue":"3","key":"pbio.3003597.ref034","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1109\/83.366472","article-title":"A new criterion for automatic multilevel thresholding","volume":"4","author":"JC Yen","year":"1995","journal-title":"IEEE Trans Image Process"},{"issue":"2","key":"pbio.3003597.ref035","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1016\/S0031-3203(99)00055-2","article-title":"Adaptive document image binarization","volume":"33","author":"J Sauvola","year":"2000","journal-title":"Pattern Recognition"},{"issue":"7","key":"pbio.3003597.ref036","doi-asserted-by":"crossref","first-page":"676","DOI":"10.1038\/nmeth.2019","article-title":"Fiji: an open-source platform for biological-image analysis","volume":"9","author":"J Schindelin","year":"2012","journal-title":"Nat Methods"},{"key":"pbio.3003597.ref037","unstructured":"Chen LC, Papandreou G, Schroff F, Adam H. Rethinking atrous convolution for semantic image segmentation. 2017. Available from: https:\/\/ui.adsabs.harvard.edu\/abs\/2017arXiv170605587C"},{"issue":"3","key":"pbio.3003597.ref038","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1038\/s41592-019-0686-2","article-title":"SciPy 1.0: fundamental algorithms for scientific computing in Python","volume":"17","author":"P Virtanen","year":"2020","journal-title":"Nat Methods"},{"key":"pbio.3003597.ref039","unstructured":"Huang G, Liu Z, van der Maaten L, Weinberger KQ. Densely connected convolutional networks. 2016. https:\/\/ui.adsabs.harvard.edu\/abs\/2016arXiv160806993H"},{"key":"pbio.3003597.ref040","doi-asserted-by":"crossref","DOI":"10.1109\/CVPR.2016.90","article-title":"Deep residual learning for image recognition.","volume-title":"2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR; 2016 June 01)","author":"K He","year":"2016"},{"key":"pbio.3003597.ref041","doi-asserted-by":"crossref","unstructured":"Howard A, Sandler M, Chu G, Chen LC, Chen B, Tan M. Searching for MobileNetV3. 2019. Available from: https:\/\/ui.adsabs.harvard.edu\/abs\/2019arXiv190502244H","DOI":"10.1109\/ICCV.2019.00140"},{"key":"pbio.3003597.ref042","unstructured":"Guo C, Pleiss G, Sun Y, Weinberger KQ. On calibration of modern neural networks. 2017. Available from: https:\/\/ui.adsabs.harvard.edu\/abs\/2017arXiv170604599G"},{"key":"pbio.3003597.ref043","unstructured":"Sundararajan M, Taly A, Yan Q. Axiomatic attribution for deep networks. 2017. Available from: https:\/\/ui.adsabs.harvard.edu\/abs\/2017arXiv170301365S"},{"key":"pbio.3003597.ref044","unstructured":"Simonyan K, Vedaldi A, Zisserman A. Deep inside convolutional networks: visualising image classification models and saliency maps. 2013. https:\/\/ui.adsabs.harvard.edu\/abs\/2013arXiv1312.6034S"},{"key":"pbio.3003597.ref045","unstructured":"Lundberg SM, Lee SI. A unified approach to interpreting model predictions. In: Advances in neural information processing systems, Long Beach, CA, USA, 2017. 4765\u201374."},{"key":"pbio.3003597.ref046","doi-asserted-by":"crossref","unstructured":"Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D. Grad-CAM: visual explanations from deep networks via gradient-based localization. 2016. Available from: https:\/\/ui.adsabs.harvard.edu\/abs\/2016arXiv161002391S","DOI":"10.1109\/ICCV.2017.74"},{"key":"pbio.3003597.ref047","unstructured":"Zeiler MD, Fergus R. Visualizing and understanding convolutional networks. 2013. Available from: https:\/\/ui.adsabs.harvard.edu\/abs\/2013arXiv1311.2901Z"},{"key":"pbio.3003597.ref048","unstructured":"Kokhlikyan N, Miglani V, Martin M, Wang E, Alsallakh B, Reynolds J. Captum: A unified and generic model interpretability library for pytorch. arXiv preprint. 2020. doi: arXiv:200907896"}],"container-title":["PLOS Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pbio.3003597","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T18:44:15Z","timestamp":1769539455000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pbio.3003597"}},"subtitle":[],"editor":[{"given":"Bon-Kyoung","family":"Koo","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2026,1,27]]},"references-count":48,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,1,27]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pbio.3003597","relation":{},"ISSN":["1545-7885"],"issn-type":[{"value":"1545-7885","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,27]]}}}