{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,29]],"date-time":"2025-09-29T08:13:09Z","timestamp":1759133589932,"version":"3.37.3"},"reference-count":36,"publisher":"Oxford University Press (OUP)","issue":"20","license":[{"start":{"date-parts":[[2021,5,21]],"date-time":"2021-05-21T00:00:00Z","timestamp":1621555200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/501100002347","name":"Federal Ministry of Education and Research","doi-asserted-by":"publisher","award":["01IS18053E"],"award-info":[{"award-number":["01IS18053E"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,10,25]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Motivation<\/jats:title>\n                  <jats:p>Innovative microfluidic systems carry the promise to greatly facilitate spatio-temporal analysis of single cells under well-defined environmental conditions, allowing novel insights into population heterogeneity and opening new opportunities for fundamental and applied biotechnology. Microfluidics experiments, however, are accompanied by vast amounts of data, such as time series of microscopic images, for which manual evaluation is infeasible due to the sheer number of samples. While classical image processing technologies do not lead to satisfactory results in this domain, modern deep-learning technologies, such as convolutional networks can be sufficiently versatile for diverse tasks, including automatic cell counting as well as the extraction of critical parameters, such as growth rate. However, for successful training, current supervised deep learning requires label information, such as the number or positions of cells for each image in a series; obtaining these annotations is very costly in this setting.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>We propose a novel machine-learning architecture together with a specialized training procedure, which allows us to infuse a deep neural network with human-powered abstraction on the level of data, leading to a high-performing regression model that requires only a very small amount of labeled data. Specifically, we train a generative model simultaneously on natural and synthetic data, so that it learns a shared representation, from which a target variable, such as the cell count, can be reliably estimated.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Availability and implementation<\/jats:title>\n                  <jats:p>The project is cross-platform, open-source and free (MIT licensed) software. We make the source code available at https:\/\/github.com\/dstallmann\/cell_cultivation_analysis; the dataset is available at https:\/\/pub.uni-bielefeld.de\/record\/2945513.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btab386","type":"journal-article","created":{"date-parts":[[2021,5,18]],"date-time":"2021-05-18T03:15:47Z","timestamp":1621307747000},"page":"3632-3639","source":"Crossref","is-referenced-by-count":5,"title":["Towards an automatic analysis of CHO-K1 suspension growth in microfluidic single-cell cultivation"],"prefix":"10.1093","volume":"37","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3809-2356","authenticated-orcid":false,"given":"Dominik","family":"Stallmann","sequence":"first","affiliation":[{"name":"Machine Learning Group, Bielefeld University , Bielefeld 33615, Germany"}]},{"given":"Jan P","family":"G\u00f6pfert","sequence":"additional","affiliation":[{"name":"Machine Learning Group, Bielefeld University , Bielefeld 33615, Germany"}]},{"given":"Julian","family":"Schmitz","sequence":"additional","affiliation":[{"name":"Multiscale Bioengineering, Bielefeld University , Bielefeld 33615, Germany"}]},{"given":"Alexander","family":"Gr\u00fcnberger","sequence":"additional","affiliation":[{"name":"Multiscale Bioengineering, Bielefeld University , Bielefeld 33615, Germany"}]},{"given":"Barbara","family":"Hammer","sequence":"additional","affiliation":[{"name":"Machine Learning Group, Bielefeld University , Bielefeld 33615, Germany"}]}],"member":"286","published-online":{"date-parts":[[2021,5,21]]},"reference":[{"key":"2023051609013122900_btab386-B1","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1007\/978-3-319-10578-9_33","volume-title":"Computer Vision \u2013 ECCV 2014","author":"Arteta","year":"2014"},{"key":"2023051609013122900_btab386-B2","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.media.2015.03.002","article-title":"Detecting overlapping instances in microscopy images using extremal region trees","volume":"27","author":"Arteta","year":"2016","journal-title":"Med. Image Anal"},{"key":"2023051609013122900_btab386-B3","doi-asserted-by":"crossref","first-page":"1226","DOI":"10.1038\/s41592-019-0582-9","article-title":"ilastik: interactive machine learning for (bio)image analysis","volume":"16","author":"Berg","year":"2019","journal-title":"Nat. Methods"},{"volume-title":"Advances in Neural Information Processing Systems","year":"2011","author":"Bergstra","key":"2023051609013122900_btab386-B4"},{"key":"2023051609013122900_btab386-B5","doi-asserted-by":"crossref","first-page":"868","DOI":"10.1038\/s41592-018-0194-9","article-title":"Deep learning to predict microscope images","volume":"15","author":"Brent","year":"2018","journal-title":"Nat. Methods"},{"key":"2023051609013122900_btab386-B6","doi-asserted-by":"crossref","first-page":"781","DOI":"10.1109\/LRA.2017.2651944","article-title":"Counting apples and oranges with deep learning: a data-driven approach","volume":"2","author":"Chen","year":"2017","journal-title":"IEEE Robot. Autom. Lett"},{"key":"2023051609013122900_btab386-B7","doi-asserted-by":"crossref","first-page":"1445","DOI":"10.1039\/b605937f","article-title":"Dynamic single cell culture array","volume":"6","author":"Di Carlo","year":"2006","journal-title":"Lab Chip"},{"key":"2023051609013122900_btab386-B8","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1038\/s41592-018-0261-2","article-title":"U-net: deep learning for cell counting, detection, and morphometry","volume":"16","author":"Falk","year":"2019","journal-title":"Nat. Methods"},{"key":"2023051609013122900_btab386-B9","first-page":"1500","volume-title":"Conference on Learning Theory, COLT 2019, 25-28 June 2019, Phoenix, AZ, USA, Volume 99 of Proceedings of Machine Learning Research","author":"G\u00f6pfert","year":"2019"},{"key":"2023051609013122900_btab386-B10","first-page":"1","volume-title":"2017 IEEE Symposium Series on Computational Intelligence (SSCI)","author":"G\u00f6pfert","year":"2017"},{"key":"2023051609013122900_btab386-B11","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.copbio.2014.02.008","article-title":"Single-cell microfluidics: opportunity for bioprocess development","volume":"29","author":"Gr\u00fcnberger","year":"2014","journal-title":"Curr. Opin. Biotechnol"},{"key":"2023051609013122900_btab386-B12","doi-asserted-by":"crossref","DOI":"10.1016\/j.knosys.2020.106622","article-title":"AutoML: a survey of the state-of-the-art","author":"He","year":"2021"},{"article-title":"Data augmentation instead of explicit regularization","year":"2018","author":"Hern\u00e1ndez-Garc\u00eda","key":"2023051609013122900_btab386-B13"},{"key":"2023051609013122900_btab386-B14","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1038\/s41592-018-0069-0","article-title":"Quanti.us: a tool for rapid, flexible, crowd-based annotation of images","volume":"15","author":"Hughes","year":"2018","journal-title":"Nat. Methods"},{"key":"2023051609013122900_btab386-B15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3042064","article-title":"Deep learning advances in computer vision with 3d data: a survey","volume":"50","author":"Ioannidou","year":"2017","journal-title":"ACM Comput. Surv"},{"volume-title":"Workshop on Deep Learning, Advances in Neural Information Processing Systems (NIPS)","year":"2014","author":"Jaderberg","key":"2023051609013122900_btab386-B16"},{"article-title":"Auto-encoding variational Bayes","year":"2013","author":"Kingma","key":"2023051609013122900_btab386-B17"},{"key":"2023051609013122900_btab386-B18","doi-asserted-by":"crossref","first-page":"4732","DOI":"10.1039\/c2lc40569e","article-title":"Vacuum-assisted cell loading enables shear-free mammalian microfluidic culture","volume":"12","author":"Kolnik","year":"2012","journal-title":"Lab Chip"},{"article-title":"On the variance of the adaptive learning rate and beyond","year":"2020","author":"Liu","key":"2023051609013122900_btab386-B19"},{"key":"2023051609013122900_btab386-B20","doi-asserted-by":"crossref","first-page":"861","DOI":"10.21105\/joss.00861","article-title":"UMAP: uniform manifold approximation and projection","volume":"3","author":"McInnes","year":"2018","journal-title":"J. Open Source Softw"},{"key":"2023051609013122900_btab386-B21","doi-asserted-by":"crossref","first-page":"1233","DOI":"10.1038\/s41592-019-0403-1","article-title":"Deep learning for cellular image analysis","volume":"16","author":"Moen","year":"2019","journal-title":"Nat. Methods"},{"key":"2023051609013122900_btab386-B22","doi-asserted-by":"crossref","first-page":"1251","DOI":"10.1109\/IAdCC.2013.6514407","volume-title":"2013 3rd IEEE International Advance Computing Conference (IACC)","author":"Rahman","year":"2013"},{"key":"2023051609013122900_btab386-B23","first-page":"323","volume-title":"Deep Learning for Medical Image Processing: Overview, Challenges and the Future","author":"Razzak","year":"2018"},{"key":"2023051609013122900_btab386-B24","doi-asserted-by":"crossref","first-page":"310","DOI":"10.1016\/j.tibtech.2018.08.005","article-title":"Deep learning with microfluidics for biotechnology","volume":"37","author":"Riordon","year":"2019","journal-title":"Trends Biotechnol"},{"key":"2023051609013122900_btab386-B25","first-page":"8868","article-title":"Almost unsupervised learning for dense crowd counting","volume":"33","author":"Sam","year":"2019","journal-title":"Proc. AAAI Conf. Artif. Intell"},{"volume-title":"International Conference on Learning Representations, Scottsdale, Arizona, USA","year":"2013","author":"Saxe","key":"2023051609013122900_btab386-B26"},{"key":"2023051609013122900_btab386-B27","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1016\/j.tibtech.2018.11.007","article-title":"Heterogeneity studies of mammalian cells for bioproduction: from tools to application","volume":"37","author":"Schmitz","year":"2019","journal-title":"Trends Biotechnol"},{"key":"2023051609013122900_btab386-B28","doi-asserted-by":"crossref","first-page":"992","DOI":"10.1002\/bit.27627","article-title":"Development and application of a cultivation platform for mammalian suspension cell lines with single-cell resolution","volume":"118","author":"Schmitz","year":"2021","journal-title":"Biotechnol. Bioeng"},{"article-title":"Generalized zero- and few-shot learning via aligned variational autoencoders, CVPR 2019, Long Beach, California, USA","year":"2019","author":"Sch\u00f6nfeld","key":"2023051609013122900_btab386-B29"},{"first-page":"6105","year":"2019","author":"Tan","key":"2023051609013122900_btab386-B30"},{"key":"2023051609013122900_btab386-B31","doi-asserted-by":"crossref","first-page":"1221","DOI":"10.1093\/bioinformatics\/bty776","article-title":"When a single lineage is not enough: uncertainty-aware tracking for spatio-temporal live-cell image analysis","volume":"35","author":"Theorell","year":"2019","journal-title":"Bioinformatics"},{"article-title":"Soft weight-sharing for neural network compression, ICLR 2017, Toulon, France","year":"2017","author":"Ullrich","key":"2023051609013122900_btab386-B32"},{"key":"2023051609013122900_btab386-B33","doi-asserted-by":"crossref","first-page":"1141","DOI":"10.1038\/nmeth.4473","article-title":"An objective comparison of cell-tracking algorithms","volume":"14","author":"Ulman","year":"2017","journal-title":"Nat. Methods"},{"key":"2023051609013122900_btab386-B34","first-page":"514","volume-title":"Advances in Neural Information Processing Systems","author":"Williams","year":"1996"},{"key":"2023051609013122900_btab386-B35","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1080\/21681163.2016.1149104","article-title":"Microscopy cell counting and detection with fully convolutional regression networks","volume":"6","author":"Xie","year":"2018","journal-title":"Comput. Methods Biomech. Biomed. Eng. Imaging Vis"},{"key":"2023051609013122900_btab386-B36","first-page":"358","article-title":"Beyond classification: structured regression for robust cell detection using convolutional neural network","volume":"9351","author":"Xie","year":"2015","journal-title":"Med. Image Comput. Comput. Assist. Interv"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/bioinformatics\/advance-article-pdf\/doi\/10.1093\/bioinformatics\/btab386\/38621074\/btab386.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/37\/20\/3632\/50338237\/btab386.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/37\/20\/3632\/50338237\/btab386.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,16]],"date-time":"2023-05-16T09:02:20Z","timestamp":1684227740000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/37\/20\/3632\/6279745"}},"subtitle":[],"editor":[{"given":"Jinbo","family":"Xu","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2021,5,21]]},"references-count":36,"journal-issue":{"issue":"20","published-print":{"date-parts":[[2021,10,25]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btab386","relation":{},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"type":"print","value":"1367-4803"},{"type":"electronic","value":"1367-4811"}],"subject":[],"published-other":{"date-parts":[[2021,10,15]]},"published":{"date-parts":[[2021,5,21]]}}}