{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,5]],"date-time":"2026-04-05T09:27:17Z","timestamp":1775381237884,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1009155","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2022,1,28]],"date-time":"2022-01-28T00:00:00Z","timestamp":1643328000000}}],"reference-count":38,"publisher":"Public Library of Science (PLoS)","issue":"1","license":[{"start":{"date-parts":[[2022,1,18]],"date-time":"2022-01-18T00:00:00Z","timestamp":1642464000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Allen Institute"}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>\n                    We introduce a framework for end-to-end integrative modeling of 3D single-cell multi-channel fluorescent image data of diverse subcellular structures. We employ stacked conditional\n                    <jats:italic>\u03b2<\/jats:italic>\n                    -variational autoencoders to first learn a latent representation of cell morphology, and then learn a latent representation of subcellular structure localization which is conditioned on the learned cell morphology. Our model is flexible and can be trained on images of arbitrary subcellular structures and at varying degrees of sparsity and reconstruction fidelity. We train our full model on 3D cell image data and explore design trade-offs in the 2D setting. Once trained, our model can be used to predict plausible locations of structures in cells where these structures were not imaged. The trained model can also be used to quantify the variation in the location of subcellular structures by generating plausible instantiations of each structure in arbitrary cell geometries. We apply our trained model to a small drug perturbation screen to demonstrate its applicability to new data. We show how the latent representations of drugged cells differ from unperturbed cells as expected by on-target effects of the drugs.\n                  <\/jats:p>","DOI":"10.1371\/journal.pcbi.1009155","type":"journal-article","created":{"date-parts":[[2022,1,18]],"date-time":"2022-01-18T15:17:37Z","timestamp":1642519057000},"page":"e1009155","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":45,"title":["A deep generative model of 3D single-cell organization"],"prefix":"10.1371","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8080-9771","authenticated-orcid":true,"given":"Rory M.","family":"Donovan-Maiye","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2564-0373","authenticated-orcid":true,"given":"Jackson M.","family":"Brown","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6367-5617","authenticated-orcid":true,"given":"Caleb K.","family":"Chan","sequence":"additional","affiliation":[]},{"given":"Liya","family":"Ding","sequence":"additional","affiliation":[]},{"given":"Calysta","family":"Yan","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9220-5366","authenticated-orcid":true,"given":"Nathalie","family":"Gaudreault","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2334-2535","authenticated-orcid":true,"given":"Julie A.","family":"Theriot","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7012-3853","authenticated-orcid":true,"given":"Mary M.","family":"Maleckar","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6397-4222","authenticated-orcid":true,"given":"Theo A.","family":"Knijnenburg","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2985-7732","authenticated-orcid":true,"given":"Gregory R.","family":"Johnson","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2022,1,18]]},"reference":[{"issue":"Pt 3","key":"pcbi.1009155.ref001","doi-asserted-by":"crossref","first-page":"535","DOI":"10.1042\/BST0330535","article-title":"Location proteomics: a systems approach to subcellular location","volume":"33","author":"RF Murphy","year":"2005","journal-title":"Biochemical Society transactions"},{"issue":"7502","key":"pcbi.1009155.ref002","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1038\/nature13302","article-title":"A draft map of the human proteome","volume":"509","author":"MS Kim","year":"2014","journal-title":"Nature"},{"issue":"12","key":"pcbi.1009155.ref003","doi-asserted-by":"crossref","first-page":"1213","DOI":"10.1093\/bioinformatics\/17.12.1213","article-title":"A neural network classifier capable of recognizing the patterns of all major subcellular structures in fluorescence microscope images of HeLa cells","volume":"17","author":"MV Boland","year":"2001","journal-title":"Bioinformatics"},{"issue":"10","key":"pcbi.1009155.ref004","doi-asserted-by":"crossref","first-page":"R100","DOI":"10.1186\/gb-2006-7-10-r100","article-title":"CellProfiler: image analysis software for identifying and quantifying cell phenotypes","volume":"7","author":"AE Carpenter","year":"2006","journal-title":"Genome biology"},{"issue":"7","key":"pcbi.1009155.ref005","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1038\/nmeth.2097","article-title":"PhenoRipper: software for rapidly profiling microscopy images","volume":"9","author":"S Rajaram","year":"2012","journal-title":"Nature Methods"},{"key":"pcbi.1009155.ref006","first-page":"491035","article-title":"The Allen Cell Structure Segmenter: a new open source toolkit for segmenting 3D intracellular structures in fluorescence microscopy images","author":"J Chen","year":"2018","journal-title":"bioRxiv"},{"issue":"11","key":"pcbi.1009155.ref007","doi-asserted-by":"crossref","first-page":"e1005177","DOI":"10.1371\/journal.pcbi.1005177","article-title":"Deep Learning Automates the Quantitative Analysis of Individual Cells in Live-Cell Imaging Experiments","volume":"12","author":"DA Van Valen","year":"2016","journal-title":"PLOS Computational Biology"},{"issue":"11","key":"pcbi.1009155.ref008","doi-asserted-by":"crossref","first-page":"917","DOI":"10.1038\/s41592-018-0111-2","article-title":"Label-free prediction of three-dimensional fluorescence images from transmitted-light microscopy","volume":"15","author":"C Ounkomol","year":"2018","journal-title":"Nature methods"},{"issue":"3","key":"pcbi.1009155.ref009","doi-asserted-by":"crossref","first-page":"792","DOI":"10.1016\/j.cell.2018.03.040","article-title":"In silico labeling: predicting fluorescent labels in unlabeled images","volume":"173","author":"EM Christiansen","year":"2018","journal-title":"Cell"},{"issue":"12","key":"pcbi.1009155.ref010","doi-asserted-by":"crossref","first-page":"1090","DOI":"10.1038\/s41592-018-0216-7","article-title":"Content-aware image restoration: pushing the limits of fluorescence microscopy","volume":"15","author":"M Weigert","year":"2018","journal-title":"Nature methods"},{"issue":"5","key":"pcbi.1009155.ref011","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1038\/nbt.4106","article-title":"Deep learning massively accelerates super-resolution localization microscopy","volume":"36","author":"W Ouyang","year":"2018","journal-title":"Nature biotechnology"},{"issue":"4","key":"pcbi.1009155.ref012","doi-asserted-by":"crossref","first-page":"845","DOI":"10.1016\/j.stemcr.2019.02.004","article-title":"Deep learning neural networks highly predict very early onset of pluripotent stem cell differentiation","volume":"12","author":"A Waisman","year":"2019","journal-title":"Stem cell reports"},{"issue":"1","key":"pcbi.1009155.ref013","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-017-00623-3","article-title":"Reconstructing cell cycle and disease progression using deep learning","volume":"8","author":"P Eulenberg","year":"2017","journal-title":"Nature communications"},{"key":"pcbi.1009155.ref014","first-page":"159202","article-title":"Deep convolutional and recurrent neural networks for cell motility discrimination and prediction","author":"JC Kimmel","year":"2019","journal-title":"bioRxiv"},{"issue":"9","key":"pcbi.1009155.ref015","doi-asserted-by":"crossref","first-page":"e1007348","DOI":"10.1371\/journal.pcbi.1007348","article-title":"Learning unsupervised feature representations for single cell microscopy images with paired cell inpainting","volume":"15","author":"AX Lu","year":"2019","journal-title":"PLoS computational biology"},{"issue":"12","key":"pcbi.1009155.ref016","doi-asserted-by":"crossref","first-page":"978","DOI":"10.1002\/cyto.a.20487","article-title":"Automated learning of generative models for subcellular location: Building blocks for systems biology","volume":"71A","author":"T Zhao","year":"2007","journal-title":"Cytometry Part A"},{"issue":"5","key":"pcbi.1009155.ref017","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1002\/cyto.a.21066","article-title":"Image-derived, three-dimensional generative models of cellular organization","volume":"79A","author":"T Peng","year":"2011","journal-title":"Cytometry Part A"},{"key":"pcbi.1009155.ref018","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1007\/978-1-4939-9102-0_11","volume-title":"Modeling Biomolecular Site Dynamics","author":"TD Majarian","year":"2019"},{"key":"pcbi.1009155.ref019","first-page":"227645","article-title":"CytoGAN: Generative Modeling of Cell Images","author":"P Goldsborough","year":"2017","journal-title":"bioRxiv"},{"issue":"4","key":"pcbi.1009155.ref020","doi-asserted-by":"crossref","first-page":"e1007828","DOI":"10.1371\/journal.pcbi.1007828","article-title":"Predicting cell lineages using autoencoders and optimal transport","volume":"16","author":"KD Yang","year":"2020","journal-title":"PLoS computational biology"},{"key":"pcbi.1009155.ref021","doi-asserted-by":"crossref","unstructured":"Yang K, Goldman S, Jin W, Lu A, Barzilay R, Jaakkola T, et al. Improved Conditional Flow Models for Molecule to Image Synthesis. arXiv preprint arXiv:200608532. 2020;.","DOI":"10.1109\/CVPR46437.2021.00662"},{"issue":"1","key":"pcbi.1009155.ref022","first-page":"1","article-title":"Multi-domain translation between single-cell imaging and sequencing data using autoencoders","volume":"12","author":"K Dai Yang","year":"2021","journal-title":"Nature Communications"},{"key":"pcbi.1009155.ref023","unstructured":"Kingma DP, Welling M. Auto-encoding variational bayes. arXiv preprint arXiv:13126114. 2013;."},{"key":"pcbi.1009155.ref024","unstructured":"Alemi AA, Poole B, Fischer I, Dillon JV, Saurous RA, Murphy K. Fixing a broken ELBO. arXiv preprint arXiv:171100464. 2017;."},{"issue":"5","key":"pcbi.1009155.ref025","first-page":"6","article-title":"beta-VAE: Learning Basic Visual Concepts with a Constrained Variational Framework","volume":"2","author":"I Higgins","year":"2017","journal-title":"Iclr"},{"key":"pcbi.1009155.ref026","first-page":"3738","article-title":"Ladder variational autoencoders","author":"CK S\u00f8nderby","year":"2016","journal-title":"Advances in neural information processing systems"},{"key":"pcbi.1009155.ref027","doi-asserted-by":"crossref","unstructured":"Johnson GR, Donovan-Maiye RM, Maleckar MM. Generative Modeling with Conditional Autoencoders: Building an Integrated Cell. arXiv preprint arXiv:170500092. 2017;.","DOI":"10.1101\/238378"},{"key":"pcbi.1009155.ref028","article-title":"Building a 3D Integrated Cell","author":"GR Johnson","year":"2017","journal-title":"bioRxiv"},{"key":"pcbi.1009155.ref029","doi-asserted-by":"crossref","unstructured":"Osokin A, Chessel A, Carazo Salas RE, Vaggi F. GANs for biological image synthesis. In: Proceedings of the IEEE International Conference on Computer Vision; 2017. p. 2233\u20132242.","DOI":"10.1109\/ICCV.2017.245"},{"key":"pcbi.1009155.ref030","unstructured":"Karras T, Aila T, Laine S, Lehtinen J. Progressive growing of gans for improved quality, stability, and variation. arXiv preprint arXiv:171010196. 2017;."},{"key":"pcbi.1009155.ref031","doi-asserted-by":"crossref","unstructured":"Wang TC, Liu MY, Zhu JY, Tao A, Kautz J, Catanzaro B. High-resolution image synthesis and semantic manipulation with conditional gans. In: Proceedings of the IEEE conference on computer vision and pattern recognition; 2018. p. 8798\u20138807.","DOI":"10.1109\/CVPR.2018.00917"},{"key":"pcbi.1009155.ref032","unstructured":"Goodfellow I. NIPS 2016 tutorial: Generative adversarial networks. arXiv preprint arXiv:170100160. 2016;."},{"key":"pcbi.1009155.ref033","unstructured":"Makhzani A, Shlens J, Jaitly N, Goodfellow I, Frey B. Adversarial Autoencoders. arXivorg. 2015;."},{"key":"pcbi.1009155.ref034","article-title":"Deep Feature Consistent Variational Autoencoder","author":"X Hou","year":"2016","journal-title":"CoRR"},{"issue":"12","key":"pcbi.1009155.ref035","doi-asserted-by":"crossref","first-page":"1053","DOI":"10.1038\/s41592-018-0229-2","article-title":"Deep generative modeling for single-cell transcriptomics","volume":"15","author":"R Lopez","year":"2018","journal-title":"Nature methods"},{"key":"pcbi.1009155.ref036","unstructured":"Miyato T, Kataoka T, Koyama M, Yoshida Y. Spectral normalization for generative adversarial networks. arXiv preprint arXiv:180205957. 2018;."},{"key":"pcbi.1009155.ref037","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition; 2016. p. 770\u2013778.","DOI":"10.1109\/CVPR.2016.90"},{"key":"pcbi.1009155.ref038","unstructured":"Kingma DP, Ba J. Adam: A method for stochastic optimization. arXiv preprint arXiv:14126980. 2014;."}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1009155","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2022,1,28]],"date-time":"2022-01-28T00:00:00Z","timestamp":1643328000000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1009155","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,1,28]],"date-time":"2022-01-28T13:45:11Z","timestamp":1643377511000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1009155"}},"subtitle":[],"editor":[{"given":"Jeffrey J.","family":"Saucerman","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2022,1,18]]},"references-count":38,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1,18]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1009155","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2021.06.09.447725","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,18]]}}}