{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T17:47:23Z","timestamp":1777657643966,"version":"3.51.4"},"publisher-location":"Cham","reference-count":44,"publisher":"Springer Nature Switzerland","isbn-type":[{"value":"9783031917202","type":"print"},{"value":"9783031917219","type":"electronic"}],"license":[{"start":{"date-parts":[[2025,1,1]],"date-time":"2025-01-01T00:00:00Z","timestamp":1735689600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,5,12]],"date-time":"2025-05-12T00:00:00Z","timestamp":1747008000000},"content-version":"vor","delay-in-days":131,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Tracking the development of living cells in live-cell time-lapses reveals crucial insights into single-cell behavior and presents tremendous potential for biomedical and biotechnological applications. In microbial live-cell imaging (MLCI), a few to thousands of cells have to be detected and tracked within dozens of growing cell colonies. The challenge of tracking cells is heavily influenced by the experiment parameters, namely the imaging interval and maximal cell number. For now, tracking benchmarks are not widely available in MLCI and the effect of these parameters on the tracking performance are not yet known. Therefore, we present the largest publicly available and annotated dataset for MLCI, containing more than 1.4 million cell instances, 29k cell tracks, and 14k cell divisions. With this dataset at hand, we generalize existing tracking metrics to incorporate relevant imaging and experiment parameters into experiment-aware metrics. These metrics reveal that current cell tracking methods crucially depend on the choice of the experiment parameters, where their performance deteriorates at high imaging intervals and large cell colonies. Thus, our new benchmark quantifies the influence of experiment parameters on the tracking quality, and gives the opportunity to develop new data-driven methods that generalize across imaging and experiment parameters. The benchmark dataset is publicly available at <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"https:\/\/zenodo.org\/doi\/10.5281\/zenodo.7260136\" ext-link-type=\"uri\">https:\/\/zenodo.org\/doi\/10.5281\/zenodo.7260136<\/jats:ext-link>.<\/jats:p>","DOI":"10.1007\/978-3-031-91721-9_20","type":"book-chapter","created":{"date-parts":[[2025,5,29]],"date-time":"2025-05-29T05:03:41Z","timestamp":1748495021000},"page":"318-334","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Tracking One-in-a-Million: Large-Scale Benchmark for\u00a0Microbial Single-Cell Tracking with\u00a0Experiment-Aware Robustness Metrics"],"prefix":"10.1007","author":[{"given":"Johannes","family":"Seiffarth","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3294-1695","authenticated-orcid":false,"given":"Luisa","family":"Bl\u00f6baum","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7433-0075","authenticated-orcid":false,"given":"Richard D.","family":"Paul","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-9377-3140","authenticated-orcid":false,"given":"Nils","family":"Friederich","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-9384-6496","authenticated-orcid":false,"given":"Angelo Jovin Yamachui","family":"Sitcheu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9100-5496","authenticated-orcid":false,"given":"Ralf","family":"Mikut","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8555-6416","authenticated-orcid":false,"given":"Hanno","family":"Scharr","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7564-4957","authenticated-orcid":false,"given":"Alexander","family":"Gr\u00fcnberger","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5407-2275","authenticated-orcid":false,"given":"Katharina","family":"N\u00f6h","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,5,12]]},"reference":[{"key":"20_CR1","doi-asserted-by":"crossref","unstructured":"Anjum, S., Gurari, D.: CTMC: cell tracking with mitosis detection dataset challenge. In: 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 4228\u20134237. IEEE (2020)","DOI":"10.1109\/CVPRW50498.2020.00499"},{"key":"20_CR2","doi-asserted-by":"crossref","unstructured":"Ben-Haim, T., Raviv, T.R.: Graph Neural Network for Cell Tracking in Microscopy Videos (2022). arXiv:2202.04731 [cs]","DOI":"10.1007\/978-3-031-19803-8_36"},{"issue":"1","key":"20_CR3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2008\/246309","volume":"2008","author":"K Bernardin","year":"2008","unstructured":"Bernardin, K., Stiefelhagen, R.: Evaluating multiple object tracking performance: the CLEAR MOT Metrics. EURASIP J. Image Video Process. 2008(1), 1\u201310 (2008). https:\/\/doi.org\/10.1155\/2008\/246309","journal-title":"EURASIP J. Image Video Process."},{"key":"20_CR4","doi-asserted-by":"crossref","unstructured":"Bl\u00f6baum, L., Torello\u00a0Pianale, L., Olsson, L., Gr\u00fcnberger, A.: Quantifying microbial robustness in dynamic environments using microfluidic single-cell cultivation. Microbial Cell Factories, p.\u00a044 (2024)","DOI":"10.21203\/rs.3.rs-3644873\/v1"},{"key":"20_CR5","doi-asserted-by":"crossref","unstructured":"Caicedo, J.C., et al.: Nucleus segmentation across imaging experiments: the 2018 Data Science Bowl. Nature Methods, pp. 1247\u20131253 (2019)","DOI":"10.1038\/s41592-019-0612-7"},{"key":"20_CR6","doi-asserted-by":"crossref","unstructured":"Cordts, M., et al.: The Cityscapes Dataset for Semantic Urban Scene Understanding. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016)","DOI":"10.1109\/CVPR.2016.350"},{"key":"20_CR7","doi-asserted-by":"crossref","unstructured":"Cutler, K.J., et al.: Omnipose: a high-precision morphology-independent solution for bacterial cell segmentation. Nature Methods, pp. 1438\u20141448 (2022)","DOI":"10.1038\/s41592-022-01639-4"},{"key":"20_CR8","doi-asserted-by":"crossref","unstructured":"Edlund, C., et al.: LIVECell-A large-scale dataset for label-free live cell segmentation. Nature Methods, pp. 1038\u20131045 (2021)","DOI":"10.1038\/s41592-021-01249-6"},{"key":"20_CR9","doi-asserted-by":"crossref","unstructured":"Fang, Y., et al.: EVA: exploring the limits of masked visual representation learning at scale (2022). arXiv:2211.07636 [cs]","DOI":"10.1109\/CVPR52729.2023.01855"},{"key":"20_CR10","doi-asserted-by":"crossref","unstructured":"Gallusser, B., Weigert, M.: Trackastra: Transformer-based cell tracking for live-cell microscopy (2024). arXiv:2405.15700 [cs]","DOI":"10.1007\/978-3-031-73116-7_27"},{"key":"20_CR11","doi-asserted-by":"crossref","unstructured":"Geiger, A., Lenz, P., Stiller, C., Urtasun, R.: Vision meets robotics: The KITTI dataset. The International Journal of Robotics Research, pp. 1231\u20131237 (2013)","DOI":"10.1177\/0278364913491297"},{"key":"20_CR12","doi-asserted-by":"crossref","unstructured":"Greenwald, N.F., et al.: Whole-cell segmentation of tissue images with human-level performance using large-scale data annotation and deep learning. Nature Biotechnology, pp. 555\u2013565 (2022)","DOI":"10.1038\/s41587-021-01094-0"},{"key":"20_CR13","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., Girshick, R.: Mask R-CNN. arXiv:1703.06870 [cs] (2018). arXiv: 1703.06870","DOI":"10.1109\/ICCV.2017.322"},{"key":"20_CR14","doi-asserted-by":"crossref","unstructured":"Helfrich, S., et al.: Live cell imaging of SOS and prophage dynamics in isogenic bacterial populations. Molecular Microbiology, pp. 636\u2013650 (2015)","DOI":"10.1111\/mmi.13147"},{"key":"20_CR15","doi-asserted-by":"crossref","unstructured":"Hockenberry, A.M., Micali, G., Tak\u00e1cs, G., Weng, J., Hardt, W.D., Ackermann, M.: Microbiota-derived metabolites inhibit Salmonella virulent subpopulation development by acting on single-cell behaviors. Proceedings of the National Academy of Sciences, p. e2103027118 (2021)","DOI":"10.1101\/2021.02.14.430798"},{"key":"20_CR16","doi-asserted-by":"crossref","unstructured":"Hoebe, R.A., Van\u00a0Oven, C.H., Gadella, T.W.J., Dhonukshe, P.B., Van\u00a0Noorden, C.J.F., Manders, E.M.M.: Controlled light-exposure microscopy reduces photobleaching and phototoxicity in fluorescence live-cell imaging. Nature Biotechnology, pp. 249\u2013253 (2007)","DOI":"10.1038\/nbt1278"},{"key":"20_CR17","doi-asserted-by":"crossref","unstructured":"Jaqaman, K., Loerke, D., Mettlen, M., Kuwata, H., Grinstein, S., Schmid, S.L., Danuser, G.: Robust single-particle tracking in live-cell time-lapse sequences. Nature Methods, pp. 695\u2013702 (2008)","DOI":"10.1038\/nmeth.1237"},{"key":"20_CR18","doi-asserted-by":"crossref","unstructured":"Jeckel, H., Drescher, K.: Advances and opportunities in image analysis of bacterial cells and communities. FEMS Microbiology Reviews (2020)","DOI":"10.1093\/femsre\/fuaa062"},{"key":"20_CR19","doi-asserted-by":"crossref","unstructured":"Kirillov, A., et al.: Segment anything. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), pp. 4015\u20134026 (2023)","DOI":"10.1109\/ICCV51070.2023.00371"},{"key":"20_CR20","doi-asserted-by":"crossref","unstructured":"Liu, Y., Wang, Y., Wang, S., Liang, T., Zhao, Q., Tang, Z., Ling, H.: CBNet: A Novel Composite Backbone Network Architecture for Object Detection (2019). arXiv:1909.03625 [cs]","DOI":"10.1609\/aaai.v34i07.6834"},{"key":"20_CR21","doi-asserted-by":"crossref","unstructured":"Luiten, J., O\u0161ep, A., Dendorfer, P., Torr, P., Geiger, A., Leal-Taix\u00e9, L., Leibe, B.: HOTA: a higher order metric for evaluating multi-object tracking. Int. J. Comput. Vis., 548\u2013578 (2021)","DOI":"10.1007\/s11263-020-01375-2"},{"key":"20_CR22","doi-asserted-by":"crossref","unstructured":"L\u00f6ffler, K., Mikut, R.: EmbedTrack-simultaneous cell segmentation and tracking through learning offsets and clustering bandwidths. IEEE Access, pp. 77147\u201377157 (2022)","DOI":"10.1109\/ACCESS.2022.3192880"},{"key":"20_CR23","doi-asserted-by":"crossref","unstructured":"L\u00f6ffler, K., Scherr, T., Mikut, R.: A graph-based cell tracking algorithm with few manually tunable parameters and automated segmentation error correction. PLOS ONE, p. e0249257 (2021)","DOI":"10.1101\/2021.03.16.435631"},{"key":"20_CR24","doi-asserted-by":"crossref","unstructured":"Matula, P., Ma\u0161ka, M., Sorokin, D.V., Matula, P., Ortiz-de Sol\u00f3rzano, C., Kozubek, M.: Cell tracking accuracy measurement based on comparison of acyclic oriented graphs. PLOS ONE, p. e0144959 (2015)","DOI":"10.1371\/journal.pone.0144959"},{"key":"20_CR25","unstructured":"Ma\u0161ka, M., et al.: The Cell Tracking Challenge: 10 years of objective benchmarking. Nature Methods, pp. 1010\u20131020 (2023)"},{"key":"20_CR26","doi-asserted-by":"crossref","unstructured":"O\u2019Connor, O.M., Alnahhas, R.N., Lugagne, J.B., Dunlop, M.J.: DeLTA 2.0: A deep learning pipeline for quantifying single-cell spatial and temporal dynamics. PLOS Computational Biology, p. e1009797 (2022)","DOI":"10.1371\/journal.pcbi.1009797"},{"key":"20_CR27","doi-asserted-by":"crossref","unstructured":"Pellegrini, S., Ess, A., Schindler, K., van Gool, L.: You\u2019ll never walk alone: Modeling social behavior for multi-target tracking. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 261\u2013268 (2009)","DOI":"10.1109\/ICCV.2009.5459260"},{"key":"20_CR28","doi-asserted-by":"crossref","unstructured":"Qiao, S., Chen, L.C., Yuille, A.: DetectoRS: Detecting Objects with Recursive Feature Pyramid and Switchable Atrous Convolution (2020). arXiv:2006.02334 [cs]","DOI":"10.1109\/CVPR46437.2021.01008"},{"issue":"3","key":"20_CR29","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","volume":"115","author":"O Russakovsky","year":"2015","unstructured":"Russakovsky, O., et al.: ImageNet large scale visual recognition challenge. Int. J. Comput. Vision 115(3), 211\u2013252 (2015). https:\/\/doi.org\/10.1007\/s11263-015-0816-y","journal-title":"Int. J. Comput. Vision"},{"key":"20_CR30","doi-asserted-by":"crossref","unstructured":"Scherr, T., L\u00f6ffler, K., B\u00f6hland, M., Mikut, R.: Cell segmentation and tracking using CNN-based distance predictions and a graph-based matching strategy. PLOS ONE, p. e0243219 (2020)","DOI":"10.1371\/journal.pone.0243219"},{"key":"20_CR31","unstructured":"Schuhmann, C., et al.: LAION-5B: an open large-scale dataset for training next generation image-text models. Advances in Neural Information Processing Systems, pp. 25278\u201325294 (2022)"},{"key":"20_CR32","unstructured":"Schwartz, M.S., et al.: Caliban: accurate cell tracking and lineage construction in live-cell imaging experiments with deep learning. bioRxiv (2023)"},{"key":"20_CR33","doi-asserted-by":"crossref","unstructured":"Seiffarth, J., et al.: ObiWan-Microbi: OMERO-based integrated workflow for annotating microbes in the cloud. SoftwareX (2024)","DOI":"10.1016\/j.softx.2024.101638"},{"key":"20_CR34","doi-asserted-by":"crossref","unstructured":"Sivaraman, D., Biswas, P., Cella, L.N., Yates, M.V., Chen, W.: Detecting RNA viruses in living mammalian cells by fluorescence microscopy. Trends in Biotechnology, pp. 307\u2013313 (2011)","DOI":"10.1016\/j.tibtech.2011.02.006"},{"key":"20_CR35","doi-asserted-by":"crossref","unstructured":"Stringer, C., Wang, T., Michaelos, M., Pachitariu, M.: Cellpose: a generalist algorithm for cellular segmentation. Nature Methods, pp. 100\u2013106 (2021)","DOI":"10.1038\/s41592-020-01018-x"},{"key":"20_CR36","doi-asserted-by":"crossref","unstructured":"Theorell, A., Seiffarth, J., Gr\u00fcnberger, A., N\u00f6h, K.: When a single lineage is not enough: Uncertainty-Aware Tracking for spatio-temporal live-cell image analysis. Bioinformatics, pp. 1221\u20131228 (2019)","DOI":"10.1093\/bioinformatics\/bty776"},{"key":"20_CR37","doi-asserted-by":"crossref","unstructured":"T\u00e4uber, S., Golze, C., Ho, P., Von\u00a0Lieres, E., Gr\u00fcnberger, A.: dMSCC: a microfluidic platform for microbial single-cell cultivation of Corynebacterium glutamicum under dynamic environmental medium conditions. Lab on a Chip, pp. 4442\u20134455 (2020)","DOI":"10.1039\/D0LC00711K"},{"key":"20_CR38","doi-asserted-by":"crossref","unstructured":"T\u00e4uber, S., Schmitz, J., Bl\u00f6baum, L., Fante, N., Steinhoff, H., Gr\u00fcnberger, A.: How to perform a microfluidic cultivation experiment-a guideline to success. Biosensors, p.\u00a0485 (2021)","DOI":"10.3390\/bios11120485"},{"key":"20_CR39","doi-asserted-by":"crossref","unstructured":"Ulman, V., et al.: An objective comparison of cell-tracking algorithms. Nature Methods, pp. 1141\u20131152 (2017)","DOI":"10.1038\/nmeth.4473"},{"key":"20_CR40","doi-asserted-by":"crossref","unstructured":"Upschulte, E., Harmeling, S., Amunts, K., Dickscheid, T.: Uncertainty-aware contour proposal networks for cell segmentation in multi-modality high-resolution microscopy images. In: Proceedings of The Cell Segmentation Challenge in Multi-modality High-Resolution Microscopy Images, pp. 1\u201312. PMLR (2023)","DOI":"10.1016\/j.media.2022.102371"},{"key":"20_CR41","doi-asserted-by":"crossref","unstructured":"van Vliet, S., Dal\u00a0Co, A., Winkler, A.R., Spriewald, S., Stecher, B., Ackermann, M.: Spatially correlated gene expression in bacterial groups: the role of lineage history, spatial gradients, and cell-cell interactions. Cell systems, pp. 496\u2013507.e6 (2018)","DOI":"10.1016\/j.cels.2018.03.009"},{"key":"20_CR42","doi-asserted-by":"crossref","unstructured":"Wang, Y.H., Hsieh, J.W., Chen, P.Y., Chang, M.C., So, H.H., Li, X.: SMILEtrack: SiMIlarity LEarning for Occlusion-Aware Multiple Object Tracking. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 5740\u20135748 (2024)","DOI":"10.1609\/aaai.v38i6.28386"},{"key":"20_CR43","doi-asserted-by":"crossref","unstructured":"Zhang, Y., et al.: ByteTrack: Multi-Object Tracking by Associating Every Detection Box (2022). arXiv:2110.06864 [cs]","DOI":"10.1007\/978-3-031-20047-2_1"},{"issue":"11","key":"20_CR44","doi-asserted-by":"publisher","first-page":"3069","DOI":"10.1007\/s11263-021-01513-4","volume":"129","author":"Y Zhang","year":"2021","unstructured":"Zhang, Y., Wang, C., Wang, X., Zeng, W., Liu, W.: FairMOT: on the fairness of detection and re-identification in multiple object tracking. Int. J. Comput. Vision 129(11), 3069\u20133087 (2021). https:\/\/doi.org\/10.1007\/s11263-021-01513-4","journal-title":"Int. J. Comput. Vision"}],"container-title":["Lecture Notes in Computer Science","Computer Vision \u2013 ECCV 2024 Workshops"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-031-91721-9_20","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,29]],"date-time":"2025-05-29T05:03:58Z","timestamp":1748495038000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-031-91721-9_20"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025]]},"ISBN":["9783031917202","9783031917219"],"references-count":44,"URL":"https:\/\/doi.org\/10.1007\/978-3-031-91721-9_20","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"value":"0302-9743","type":"print"},{"value":"1611-3349","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025]]},"assertion":[{"value":"12 May 2025","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"ECCV","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"European Conference on Computer Vision","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Milan","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Italy","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2024","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"29 September 2024","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"4 October 2024","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"18","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"eccv2024","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/eccv2024.ecva.net\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}}]}}