{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T07:53:13Z","timestamp":1777362793608,"version":"3.51.4"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1011890","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2024,3,1]],"date-time":"2024-03-01T00:00:00Z","timestamp":1709251200000}}],"reference-count":39,"publisher":"Public Library of Science (PLoS)","issue":"2","license":[{"start":{"date-parts":[[2024,2,20]],"date-time":"2024-02-20T00:00:00Z","timestamp":1708387200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["STE2802\/2-1"],"award-info":[{"award-number":["STE2802\/2-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["STE2802\/1-1"],"award-info":[{"award-number":["STE2802\/1-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Recent advances in computer vision have led to significant progress in the generation of realistic image data, with denoising diffusion probabilistic models proving to be a particularly effective method. In this study, we demonstrate that diffusion models can effectively generate fully-annotated microscopy image data sets through an unsupervised and intuitive approach, using rough sketches of desired structures as the starting point. The proposed pipeline helps to reduce the reliance on manual annotations when training deep learning-based segmentation approaches and enables the segmentation of diverse datasets without the need for human annotations. We demonstrate that segmentation models trained with a small set of synthetic image data reach accuracy levels comparable to those of generalist models trained with a large and diverse collection of manually annotated image data, thereby offering a streamlined and specialized application of segmentation models.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1011890","type":"journal-article","created":{"date-parts":[[2024,2,20]],"date-time":"2024-02-20T18:35:12Z","timestamp":1708454112000},"page":"e1011890","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":24,"title":["Denoising diffusion probabilistic models for generation of realistic fully-annotated microscopy image datasets"],"prefix":"10.1371","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1041-2810","authenticated-orcid":true,"given":"Dennis","family":"Eschweiler","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-7351-698X","authenticated-orcid":true,"given":"R\u00fcveyda","family":"Yilmaz","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matisse","family":"Baumann","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ina","family":"Laube","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rijo","family":"Roy","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Abin","family":"Jose","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel","family":"Br\u00fcckner","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4072-3759","authenticated-orcid":true,"given":"Johannes","family":"Stegmaier","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2024,2,20]]},"reference":[{"issue":"12","key":"pcbi.1011890.ref001","doi-asserted-by":"crossref","first-page":"1250","DOI":"10.1038\/nbt.3722","article-title":"Imagining the future of bioimage analysis","volume":"34","author":"E Meijering","year":"2016","journal-title":"Nature biotechnology"},{"key":"pcbi.1011890.ref002","doi-asserted-by":"crossref","first-page":"2312","DOI":"10.1016\/j.csbj.2020.08.003","article-title":"A bird\u2019s-eye view of deep learning in bioimage analysis","volume":"18","author":"E Meijering","year":"2020","journal-title":"Computational and structural biotechnology journal"},{"issue":"1","key":"pcbi.1011890.ref003","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-019-0197-0","article-title":"A Survey on Image Data Augmentation for Deep Learning","volume":"6","author":"C Shorten","year":"2019","journal-title":"Journal of Big Data"},{"key":"pcbi.1011890.ref004","doi-asserted-by":"crossref","unstructured":"Zhao A, Balakrishnan G, Durand F, Guttag JV, Dalca AV. Data Augmentation Using Learned Transformations for One-Shot Medical Image Segmentation. Conference on Computer Vision and Pattern Recognition (CVPR). 2019;8543-8553.","DOI":"10.1109\/CVPR.2019.00874"},{"key":"pcbi.1011890.ref005","doi-asserted-by":"crossref","unstructured":"Eschweiler D, Schock J, Stegmaier J. Probabilistic Image Diversification to Improve Segmentation in 3D Microscopy Image Data. International Workshop on Simulation and Synthesis in Medical Imaging (SASHIMI). 2022;24-33.","DOI":"10.1007\/978-3-031-16980-9_3"},{"key":"pcbi.1011890.ref006","doi-asserted-by":"crossref","first-page":"101840","DOI":"10.1016\/j.media.2020.101840","article-title":"Models Genesis","volume":"67","author":"Z Zhou","year":"2021","journal-title":"Medical Image Analysis"},{"issue":"2","key":"pcbi.1011890.ref007","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1038\/s41592-020-01008-z","article-title":"nnU-Net: A Self-Configuring Method for Deep Learning-based Biomedical Image Segmentation","volume":"18","author":"F Isensee","year":"2021","journal-title":"Nature Methods"},{"issue":"1","key":"pcbi.1011890.ref008","doi-asserted-by":"crossref","first-page":"310","DOI":"10.1109\/TMI.2016.2606545","article-title":"MitoGen: A framework for Generating 3D Synthetic Time-lapse Sequences of Cell Populations in Fluorescence Microscopy","volume":"36","author":"D Svoboda","year":"2016","journal-title":"IEEE Transactions on Medical Imaging"},{"key":"pcbi.1011890.ref009","doi-asserted-by":"crossref","unstructured":"B\u00f6hland M, Scherr T, Bartschat A, Mikut R, Reischl M. Influence of Synthetic Label Image Object Properties on GAN Supported Segmentation Pipelines. Workshop Computational Intelligence. 2019;289\u2013305.","DOI":"10.58895\/ksp\/1000098736-19"},{"issue":"12","key":"pcbi.1011890.ref010","doi-asserted-by":"crossref","first-page":"0260509","DOI":"10.1371\/journal.pone.0260509","article-title":"3D Fluorescence Microscopy Data Synthesis for Segmentation and Benchmarking","volume":"16","author":"D Eschweiler","year":"2021","journal-title":"PLOS One"},{"key":"pcbi.1011890.ref011","doi-asserted-by":"crossref","unstructured":"B\u00e4hr D, Eschweiler D, Bhattacharyya A, Moreno-Andr\u00e9s D, Antonin W, Stegmaier J. CellCycleGAN: Spatiotemporal Microscopy Image Synthesis of Cell Populations using Statistical Shape Models and Conditional GANs. IEEE International Symposium on Biomedical Imaging (ISBI). 2021;15\u201319.","DOI":"10.1109\/ISBI48211.2021.9433896"},{"key":"pcbi.1011890.ref012","doi-asserted-by":"crossref","unstructured":"Wiesner D, Suk J, Dummer S, Svoboda D, Wolterink JM. Implicit Neural Representations for Generative Modeling of Living Cell Shapes. International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI). 2022;58\u201367.","DOI":"10.1007\/978-3-031-16440-8_6"},{"issue":"3","key":"pcbi.1011890.ref013","doi-asserted-by":"crossref","first-page":"0283828","DOI":"10.1371\/journal.pone.0283828","article-title":"Synthesis of large scale 3d microscopic images of 3d cell cultures for training and benchmarking","volume":"18","author":"R Bruch","year":"2023","journal-title":"PlOS One"},{"key":"pcbi.1011890.ref014","first-page":"6840","article-title":"Denoising Diffusion Probabilistic Models","volume":"33","author":"J Ho","year":"2020","journal-title":"Advances in Neural Information Processing Systems (NeurIPS)"},{"key":"pcbi.1011890.ref015","first-page":"8780","article-title":"Diffusion models beat GANs on image synthesis","volume":"34","author":"P Dhariwal","year":"2021","journal-title":"Advances in neural information processing systems (NeurIPS)"},{"issue":"1","key":"pcbi.1011890.ref016","doi-asserted-by":"crossref","first-page":"7303","DOI":"10.1038\/s41598-023-34341-2","article-title":"Denoising diffusion probabilistic models for 3D medical image generation","volume":"13","author":"F Khader","year":"2022","journal-title":"Scientific Reports"},{"key":"pcbi.1011890.ref017","doi-asserted-by":"crossref","unstructured":"Thanh-Tung H, Tran T. Catastrophic forgetting and mode collapse in GANs. International Joint Conference on Neural Networks (IJCNN). 2020;1\u201310.","DOI":"10.1109\/IJCNN48605.2020.9207181"},{"issue":"51","key":"pcbi.1011890.ref018","doi-asserted-by":"crossref","first-page":"8238","DOI":"10.1073\/pnas.1616768113","article-title":"Cell Size and Growth Regulation in the Arabidopsis Thaliana Apical Stem Cell Niche","volume":"113","author":"L Willis","year":"2016","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"12","key":"pcbi.1011890.ref019","doi-asserted-by":"crossref","first-page":"1141","DOI":"10.1038\/nmeth.4473","article-title":"An Objective Comparison of Cell-Tracking Algorithms","volume":"14","author":"V Ulman","year":"2017","journal-title":"Nature Methods"},{"issue":"8","key":"pcbi.1011890.ref020","doi-asserted-by":"crossref","first-page":"703","DOI":"10.1038\/nmeth.1228","article-title":"Automated Analysis of Embryonic Gene Expression with Cellular Resolution in C. elegans","volume":"5","author":"JI Murray","year":"2008","journal-title":"Nature Methods"},{"issue":"1","key":"pcbi.1011890.ref021","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/ncomms9674","article-title":"A Workflow to Process 3D+ time Microscopy Images of Developing Organisms and Reconstruct Their Cell Lineage","volume":"7","author":"E Faure","year":"2016","journal-title":"Nature Communications"},{"issue":"12","key":"pcbi.1011890.ref022","doi-asserted-by":"crossref","first-page":"27281","DOI":"10.1371\/journal.pone.0027281","article-title":"Recruitment of Oct4 Protein to UV-Damaged Chromatin in Embryonic Stem Cells","volume":"6","author":"E B\u00e1rtov\u00e1","year":"2011","journal-title":"PLOS One"},{"issue":"7289","key":"pcbi.1011890.ref023","doi-asserted-by":"crossref","first-page":"721","DOI":"10.1038\/nature08869","article-title":"Phenotypic Profiling of the Human Genome by Time-Lapse Microscopy Reveals Cell Division Genes","volume":"464","author":"B Neumann","year":"2010","journal-title":"Nature"},{"issue":"7","key":"pcbi.1011890.ref024","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pone.0270923","article-title":"LiveCellMiner: A New Tool to Analyze Mitotic Progression","volume":"17","author":"D Moreno-Andr\u00e9s","year":"2022","journal-title":"PLOS One"},{"key":"pcbi.1011890.ref025","unstructured":"Meng C, He Y, Song Y, Song J, Wu J, Zhu JY, Ermon S. Sdedit: Guided Image Synthesis and Editing with Stochastic Differential Equations. arXiv. 2021;arXiv:2108.01073."},{"issue":"2","key":"pcbi.1011890.ref026","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pone.0090036","article-title":"Fast Segmentation of Stained Nuclei in Terabyte-scale, Time Resolved 3D Microscopy Image Stacks","volume":"9","author":"J Stegmaier","year":"2014","journal-title":"PLOS One"},{"key":"pcbi.1011890.ref027","doi-asserted-by":"crossref","unstructured":"Eschweiler D, Stegmaier J. Robust 3D Cell Segmentation: Extending the View of Cellpose. IEEE International Conference in Image Processing (ICIP). 2022;191\u2013195.","DOI":"10.1109\/ICIP46576.2022.9897942"},{"issue":"1","key":"pcbi.1011890.ref028","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1038\/s41592-020-01018-x","article-title":"Cellpose: A Generalist Algorithm for Cellular Segmentation","volume":"18","author":"C Stringer","year":"2020","journal-title":"Nature Methods"},{"key":"pcbi.1011890.ref029","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1214\/aoms\/1177730491","article-title":"On a test of whether one of two random variables is stochastically larger than the other","author":"HB Mann","year":"1947","journal-title":"The annals of mathematical statistics"},{"key":"pcbi.1011890.ref030","unstructured":"Nichol AQ, Dhariwal P. Improved Denoising Diffusion Probabilistic Models. International Conference on Machine Learning (ICML). 2021;8162\u20138171."},{"key":"pcbi.1011890.ref031","doi-asserted-by":"crossref","unstructured":"Ronneberger O, Fischer P, Brox T. U-Net: Convolutional Networks for Biomedical Image Segmentation. Medical Image Computing and Computer-Assisted Intervention (MICCAI). 2015;234\u2013241.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"pcbi.1011890.ref032","doi-asserted-by":"crossref","unstructured":"Cicek O, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O. 3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation. Medical Image Computing and Computer-Assisted Intervention (MICCAI). 2016;424\u2013432.","DOI":"10.1007\/978-3-319-46723-8_49"},{"key":"pcbi.1011890.ref033","doi-asserted-by":"crossref","unstructured":"Shi W, Caballero J, Husz\u00e1r F, Totz J, Aitken AP, Bishop R, Rueckert D, Wang Z. Real-time Single Image and Video Super-Resolution using an Efficient Sub-Pixel Convolutional Neural Network. IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2016;1874\u20131883.","DOI":"10.1109\/CVPR.2016.207"},{"issue":"2","key":"pcbi.1011890.ref034","doi-asserted-by":"crossref","first-page":"1005991","DOI":"10.1371\/journal.pcbi.1005991","article-title":"PhysiCell: An Open Source Physics-based Cell Simulator for 3D Multicellular Systems","volume":"14","author":"A Ghaffarizadeh","year":"2018","journal-title":"PLOS Computational Biology"},{"key":"pcbi.1011890.ref035","doi-asserted-by":"crossref","unstructured":"Ducroz C, Olivo-Marin JC, Dufour A. Characterization of Cell Shape and Deformation in 3D Using Spherical Harmonics. IEEE International Symposium on Biomedical Imaging (ISBI). 2012;848\u2013851.","DOI":"10.1109\/ISBI.2012.6235681"},{"key":"pcbi.1011890.ref036","doi-asserted-by":"crossref","unstructured":"Wiesner D, Ne\u010dasov\u00e1 T, Svoboda D. On Generative Modeling of Cell Shape Using 3D GANs. International Conference on Image Analysis and Processing. 2019;672\u2013682.","DOI":"10.1007\/978-3-030-30645-8_61"},{"key":"pcbi.1011890.ref037","doi-asserted-by":"crossref","unstructured":"Chen A, Wu L, Han S, Salama P, Dunn KW, Delp EJ. Three dimensional synthetic non-ellipsoidal nuclei volume generation Using bezier curves. IEEE International Symposium on Biomedical Imaging (ISBI). 2021;961\u2013965.","DOI":"10.1109\/ISBI48211.2021.9434149"},{"issue":"5","key":"pcbi.1011890.ref038","doi-asserted-by":"crossref","first-page":"1097","DOI":"10.1109\/TMI.2018.2878316","article-title":"Pulmonary CT Registration Through Supervised Learning with Convolutional Neural Networks","volume":"38","author":"KAJ Eppenhof","year":"2019","journal-title":"IEEE Transactions on Medical Imaging"},{"issue":"2","key":"pcbi.1011890.ref039","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1109\/JBHI.2016.2519686","article-title":"Evaluation of Three Algorithms for the Segmentation of Overlapping Cervical Cells","volume":"21","author":"Z Lu","year":"2016","journal-title":"IEEE Journal of Biomedical and Health Informatics"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1011890","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2024,3,1]],"date-time":"2024-03-01T00:00:00Z","timestamp":1709251200000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1011890","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,12]],"date-time":"2024-11-12T00:25:51Z","timestamp":1731371151000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1011890"}},"subtitle":[],"editor":[{"given":"Adam","family":"Charles","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2024,2,20]]},"references-count":39,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2024,2,20]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1011890","relation":{"new_version":[{"id-type":"doi","id":"10.1371\/journal.pcbi.1011890","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,20]]}}}