{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T00:32:27Z","timestamp":1777595547438,"version":"3.51.4"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1009626","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2022,1,12]],"date-time":"2022-01-12T00:00:00Z","timestamp":1641945600000}}],"reference-count":44,"publisher":"Public Library of Science (PLoS)","issue":"12","license":[{"start":{"date-parts":[[2021,12,30]],"date-time":"2021-12-30T00:00:00Z","timestamp":1640822400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000050","name":"National Heart, Lung, and Blood Institute","doi-asserted-by":"publisher","award":["5R00HL119638"],"award-info":[{"award-number":["5R00HL119638"]}],"id":[{"id":"10.13039\/100000050","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000050","name":"National Heart, Lung, and Blood Institute","doi-asserted-by":"publisher","award":["R01HL146478"],"award-info":[{"award-number":["R01HL146478"]}],"id":[{"id":"10.13039\/100000050","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010280","name":"John H. Tietze Foundation Trust","doi-asserted-by":"crossref","award":["Stem Cell Scientist Award"],"award-info":[{"award-number":["Stem Cell Scientist Award"]}],"id":[{"id":"10.13039\/100010280","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000054","name":"National Cancer Institute","doi-asserted-by":"publisher","award":["P30CA015704"],"award-info":[{"award-number":["P30CA015704"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000054","name":"National Cancer Institute","doi-asserted-by":"publisher","award":["P30CA015704"],"award-info":[{"award-number":["P30CA015704"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000054","name":"National Cancer Institute","doi-asserted-by":"publisher","award":["P01CA077852"],"award-info":[{"award-number":["P01CA077852"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Identification of cell phenotypic states within heterogeneous populations, along with elucidation of their switching dynamics, is a central challenge in modern biology. Conventional single-cell analysis methods typically provide only indirect, static phenotypic readouts. Transmitted light images, on the other hand, provide direct morphological readouts and can be acquired over time to provide a rich data source for dynamic cell phenotypic state identification. Here, we describe an end-to-end deep learning platform, UPSIDE (Unsupervised Phenotypic State IDEntification), for discovering cell states and their dynamics from transmitted light movies. UPSIDE uses the variational auto-encoder architecture to learn latent cell representations, which are then clustered for state identification, decoded for feature interpretation, and linked across movie frames for transition rate inference. Using UPSIDE, we identified distinct blood cell types in a heterogeneous dataset. We then analyzed movies of patient-derived acute myeloid leukemia cells, from which we identified stem-cell associated morphological states as well as the transition rates to and from these states. UPSIDE opens up the use of transmitted light movies for systematic exploration of cell state heterogeneity and dynamics in biology and medicine.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1009626","type":"journal-article","created":{"date-parts":[[2021,12,30]],"date-time":"2021-12-30T13:32:12Z","timestamp":1640871132000},"page":"e1009626","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":9,"title":["Unsupervised discovery of dynamic cell phenotypic states from transmitted light movies"],"prefix":"10.1371","volume":"17","author":[{"given":"Phuc","family":"Nguyen","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sylvia","family":"Chien","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jin","family":"Dai","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Raymond J.","family":"Monnat","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6235-9463","authenticated-orcid":true,"given":"Pamela S.","family":"Becker","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6272-6673","authenticated-orcid":true,"given":"Hao Yuan","family":"Kueh","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2021,12,30]]},"reference":[{"key":"pcbi.1009626.ref001","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/S0022-1759(00)00229-5","article-title":"A practical approach to multicolor flow cytometry for immunophenotyping","volume":"243","author":"N Baumgarth","year":"2000","journal-title":"Journal of Immunological Methods"},{"key":"pcbi.1009626.ref002","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/S0022-1759(00)00224-6","article-title":"Instrumentation for flow cytometry","volume":"243","author":"GV Chapman","year":"2000","journal-title":"Journal of Immunological Methods"},{"key":"pcbi.1009626.ref003","doi-asserted-by":"crossref","first-page":"776","DOI":"10.1126\/science.1247651","article-title":"Massively parallel single cell RNA-Seq for marker-free decomposition of tissues into cell types","volume":"343","author":"DA Jaitin","year":"2014","journal-title":"Science"},{"key":"pcbi.1009626.ref004","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1038\/nmeth.4150","article-title":"Single-cell mRNA quantification and differential analysis with Census","volume":"14","author":"X Qiu","year":"2017","journal-title":"Nature Methods"},{"key":"pcbi.1009626.ref005","doi-asserted-by":"crossref","first-page":"3809","DOI":"10.1021\/ac500882e","article-title":"Single Cell Analysis with Probe ESI-Mass Spectrometry: Detection of Metabolites at Cellular and Subcellular Levels","volume":"86","author":"X Gong","year":"2014","journal-title":"Anal Chem"},{"key":"pcbi.1009626.ref006","volume-title":"Manual de anatom\u00eda patol\u00f3gica general: y fundamentos de bacteriolog\u00eda","author":"SR y Cajal","year":"1905"},{"key":"pcbi.1009626.ref007","doi-asserted-by":"crossref","DOI":"10.5962\/bhl.title.168645","volume-title":"Zellsubstanz Kern und Zelltheilung","author":"W Flemming","year":"1882"},{"key":"pcbi.1009626.ref008","article-title":"Interpretable deep learning uncovers cellular properties in label-free live cell images that are predictive of highly metastatic melanoma","author":"A Zaritsky","year":"2021","journal-title":"Cell Systems"},{"key":"pcbi.1009626.ref009","doi-asserted-by":"crossref","first-page":"13467","DOI":"10.1038\/s41598-019-50010-9","article-title":"Cell Type Classification and Unsupervised Morphological Phenotyping From Low-Resolution Images Using Deep Learning.","volume":"9","author":"K Yao","year":"2019","journal-title":"Scientific Reports"},{"key":"pcbi.1009626.ref010","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1038\/nmeth.4182","article-title":"Prospective identification of hematopoietic lineage choice by deep learning.","volume":"14","author":"F Buggenthin","year":"2017","journal-title":"Nat Methods"},{"key":"pcbi.1009626.ref011","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1038\/s41467-017-00623-3","article-title":"Reconstructing cell cycle and disease progression using deep learning","volume":"8","author":"P Eulenberg","year":"2017","journal-title":"Nature Communications"},{"key":"pcbi.1009626.ref012","first-page":"623793","article-title":"A methodology for morphological feature extraction and unsupervised cell classification","author":"D Bhaskar","year":"2019","journal-title":"bioRxiv"},{"key":"pcbi.1009626.ref013","doi-asserted-by":"crossref","first-page":"R100","DOI":"10.1186\/gb-2006-7-10-r100","article-title":"CellProfiler: image analysis software for identifying and quantifying cell phenotypes","volume":"7","author":"AE Carpenter","year":"2006","journal-title":"Genome Biology"},{"key":"pcbi.1009626.ref014","article-title":"Adversarial Autoencoders.","author":"A Makhzani","year":"2015","journal-title":"arXiv:151105644"},{"key":"pcbi.1009626.ref015","article-title":"Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery.","author":"T Schlegl","year":"2017","journal-title":"arXiv:170305921 [cs]."},{"key":"pcbi.1009626.ref016","article-title":"Improved Techniques for Training GANs.","author":"T Salimans","year":"2016","journal-title":"arXiv:160603498 [cs]."},{"key":"pcbi.1009626.ref017","doi-asserted-by":"crossref","first-page":"e1007348","DOI":"10.1371\/journal.pcbi.1007348","article-title":"Learning unsupervised feature representations for single cell microscopy images with paired cell inpainting","volume":"15","author":"AX Lu","year":"2019","journal-title":"PLOS Computational Biology"},{"key":"pcbi.1009626.ref018","doi-asserted-by":"crossref","first-page":"747","DOI":"10.1038\/nmeth.1486","article-title":"CellCognition: time-resolved phenotype annotation in high-throughput live cell imaging","volume":"7","author":"M Held","year":"2010","journal-title":"Nature Methods"},{"key":"pcbi.1009626.ref019","first-page":"803205","article-title":"Accurate cell tracking and lineage construction in live-cell imaging experiments with deep learning","author":"E Moen","year":"2019","journal-title":"bioRxiv"},{"key":"pcbi.1009626.ref020","doi-asserted-by":"crossref","first-page":"e37851","DOI":"10.7554\/eLife.37851","article-title":"A stochastic epigenetic switch controls the dynamics of T-cell lineage commitment.","volume":"7","author":"KK Ng","year":"2018","journal-title":"eLife"},{"key":"pcbi.1009626.ref021","article-title":"Auto-Encoding Variational Bayes.","author":"DP Kingma","year":"2013","journal-title":"arXiv:13126114 [cs, stat]."},{"key":"pcbi.1009626.ref022","doi-asserted-by":"crossref","first-page":"917","DOI":"10.1038\/s41592-018-0111-2","article-title":"Label-free prediction of three-dimensional fluorescence images from transmitted-light microscopy.","volume":"15","author":"C Ounkomol","year":"2018","journal-title":"Nat Methods"},{"key":"pcbi.1009626.ref023","doi-asserted-by":"crossref","DOI":"10.1088\/1742-5468\/2008\/10\/P10008","article-title":"Fast unfolding of communities in large networks.","author":"VD Blondel","year":"2008"},{"key":"pcbi.1009626.ref024","article-title":"UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction.","author":"L McInnes","year":"2018","journal-title":"arXiv:180203426 [cs, stat]."},{"key":"pcbi.1009626.ref025","volume-title":"Modular Learning in Neural Networks","author":"D. Ballard","year":"1987"},{"key":"pcbi.1009626.ref026","article-title":"ClusterGAN: Latent Space Clustering in Generative Adversarial Networks.","author":"S Mukherjee","year":"2019","journal-title":"arXiv:180903627 [cs, stat]."},{"key":"pcbi.1009626.ref027","doi-asserted-by":"crossref","first-page":"730","DOI":"10.1038\/nm0797-730","article-title":"Human acute myeloid leukemia is organized as a hierarchy that originates from a primitive hematopoietic cell","volume":"3","author":"D Bonnet","year":"1997","journal-title":"Nat Med"},{"key":"pcbi.1009626.ref028","doi-asserted-by":"crossref","first-page":"1315","DOI":"10.1038\/nbt1350","article-title":"Chemotherapy-resistant human AML stem cells home to and engraft within the bone-marrow endosteal region","volume":"25","author":"F Ishikawa","year":"2007","journal-title":"Nature Biotechnology"},{"key":"pcbi.1009626.ref029","doi-asserted-by":"crossref","first-page":"5402","DOI":"10.1182\/bloodadvances.2020001802","article-title":"CD200 expression marks leukemia stem cells in human AML","volume":"4","author":"JM Ho","year":"2020","journal-title":"Blood Adv"},{"key":"pcbi.1009626.ref030","doi-asserted-by":"crossref","first-page":"2198","DOI":"10.1182\/blood-2018-10-881441","article-title":"A stemness screen reveals C3orf54\/INKA1 as a promoter of human leukemia stem cell latency","volume":"133","author":"KB Kaufmann","year":"2019","journal-title":"Blood"},{"key":"pcbi.1009626.ref031","doi-asserted-by":"crossref","first-page":"728","DOI":"10.1038\/leu.2012.217","article-title":"The proportion of CD34 + CD38low or neg myeloblasts, but not side population frequency, predicts initial response to induction therapy in patients with newly diagnosed acute myeloid leukemia","volume":"27","author":"M Roshal","year":"2013","journal-title":"Leukemia"},{"key":"pcbi.1009626.ref032","doi-asserted-by":"crossref","first-page":"196","DOI":"10.4252\/wjsc.v5.i4.196","article-title":"Mobilization of CD34+CD38- hematopoietic stem cells after priming in acute myeloid leukemia","volume":"5","author":"A Plesa","year":"2013","journal-title":"World J Stem Cells"},{"key":"pcbi.1009626.ref033","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nmeth.2847","article-title":"Identification of small molecules that support human leukemia stem cell activity ex vivo","volume":"11","author":"C Pabst","year":"2014","journal-title":"Nature Methods"},{"key":"pcbi.1009626.ref034","doi-asserted-by":"crossref","first-page":"1509","DOI":"10.1126\/science.1256337","article-title":"Pyrimidoindole derivatives are agonists of human hematopoietic stem cell self-renewal","volume":"345","author":"I Fares","year":"2014","journal-title":"Science"},{"key":"pcbi.1009626.ref035","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1126\/science.1191536","article-title":"Aryl Hydrocarbon Receptor Antagonists Promote the Expansion of Human Hematopoietic Stem Cells","volume":"329","author":"AE Boitano","year":"2010","journal-title":"Science"},{"key":"pcbi.1009626.ref036","first-page":"3805","article-title":"Probing cellular processes by long-term live imaging--historic problems and current solutions","volume":"126","author":"DL Coutu","year":"2013","journal-title":"J Cell Sci"},{"key":"pcbi.1009626.ref037","doi-asserted-by":"crossref","first-page":"12240","DOI":"10.1073\/pnas.92.26.12240","article-title":"The stem cell antigen CD34 functions as a regulator of hemopoietic cell adhesion.","volume":"92","author":"L Healy","year":"1995","journal-title":"PNAS"},{"key":"pcbi.1009626.ref038","doi-asserted-by":"crossref","first-page":"1395","DOI":"10.1038\/leu.2008.125","article-title":"Resistance to FLT3 inhibition in an in vitro model of primary AML cells with a stem cell phenotype in a defined microenvironment","volume":"22","author":"U Mony","year":"2008","journal-title":"Leukemia"},{"key":"pcbi.1009626.ref039","doi-asserted-by":"crossref","first-page":"506","DOI":"10.1038\/nature10738","article-title":"Clonal evolution in relapsed acute myeloid leukaemia revealed by whole-genome sequencing","volume":"481","author":"L Ding","year":"2012","journal-title":"Nature"},{"key":"pcbi.1009626.ref040","doi-asserted-by":"crossref","first-page":"1265","DOI":"10.1016\/j.cell.2019.01.031","article-title":"Single-Cell RNA-Seq Reveals AML Hierarchies Relevant to Disease Progression and Immunity","volume":"176","author":"P van Galen","year":"2019","journal-title":"Cell"},{"key":"pcbi.1009626.ref041","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1038\/s41586-020-2864-x","article-title":"Single-cell mutation analysis of clonal evolution in myeloid malignancies","volume":"587","author":"LA Miles","year":"2020","journal-title":"Nature"},{"key":"pcbi.1009626.ref042","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1016\/j.ymeth.2015.08.024","article-title":"A high-content imaging-based screening pipeline for the systematic identification of anti-progeroid compounds.","volume":"96","author":"N Kubben","year":"2016","journal-title":"Methods"},{"key":"pcbi.1009626.ref043","doi-asserted-by":"crossref","first-page":"535","DOI":"10.1021\/ac402546b","article-title":"High-Throughput Screening (HTS) of Anticancer Drug Efficacy on a Micropillar\/Microwell Chip Platform.","volume":"86","author":"DW Lee","year":"2014","journal-title":"Anal Chem"},{"key":"pcbi.1009626.ref044","doi-asserted-by":"crossref","first-page":"e9442","DOI":"10.15252\/msb.20209442","article-title":"High-throughput, microscope-based sorting to dissect cellular heterogeneity","volume":"16","author":"N Hasle","year":"2020","journal-title":"Molecular Systems Biology"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1009626","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2022,1,12]],"date-time":"2022-01-12T00:00:00Z","timestamp":1641945600000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1009626","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,1,12]],"date-time":"2022-01-12T13:38:45Z","timestamp":1641994725000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1009626"}},"subtitle":[],"editor":[{"given":"James","family":"Gallo","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2021,12,30]]},"references-count":44,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2021,12,30]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1009626","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2021.01.26.428210","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,30]]}}}