{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T10:42:22Z","timestamp":1784889742732,"version":"3.55.0"},"reference-count":74,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T00:00:00Z","timestamp":1721347200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T00:00:00Z","timestamp":1721347200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"German Research Foundation (DFG), CRC 1382"},{"name":"German ministry of education and research (BMBF) through the project SynDICAD"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Nat Comput Sci"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Foundational models, pretrained on a large scale, have demonstrated substantial success across non-medical domains. However, training these models typically requires large, comprehensive datasets, which contrasts with the smaller and more specialized datasets common in biomedical imaging. Here we propose a multi-task learning strategy that decouples the number of training tasks from memory requirements. We trained a universal biomedical pretrained model (UMedPT) on a multi-task database including tomographic, microscopic and X-ray images, with various labeling strategies such as classification, segmentation and object detection. The UMedPT foundational model outperformed ImageNet pretraining and previous state-of-the-art models. For classification tasks related to the pretraining database, it maintained its performance with only 1% of the original training data and without fine-tuning. For out-of-domain tasks it required only 50% of the original training data. In an external independent validation, imaging features extracted using UMedPT proved to set a new standard for cross-center transferability.<\/jats:p>","DOI":"10.1038\/s43588-024-00662-z","type":"journal-article","created":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T10:01:44Z","timestamp":1721383304000},"page":"495-509","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":61,"title":["Overcoming data scarcity in biomedical imaging with a foundational multi-task model"],"prefix":"10.1038","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-4776-9333","authenticated-orcid":false,"given":"Raphael","family":"Sch\u00e4fer","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Till","family":"Nicke","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6375-0234","authenticated-orcid":false,"given":"Henning","family":"H\u00f6fener","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Annkristin","family":"Lange","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dorit","family":"Merhof","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Friedrich","family":"Feuerhake","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Volkmar","family":"Schulz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3387-2596","authenticated-orcid":false,"given":"Johannes","family":"Lotz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7341-0399","authenticated-orcid":false,"given":"Fabian","family":"Kiessling","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,7,19]]},"reference":[{"key":"662_CR1","doi-asserted-by":"publisher","unstructured":"Deng, J. et al. ImageNet: a large-scale hierarchical image database. In Proc. 2009 IEEE Conference on Computer Vision and Pattern Recognition 248\u2013255 (IEEE, 2009); https:\/\/doi.org\/10.1109\/CVPR.2009.5206848","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"662_CR2","unstructured":"Schuhmann, Christoph, et al. Laion-5b: an open large-scale dataset for training next generation image-text models. In Advances in Neural Information Processing Systems (eds Koyejo, S. et al.) 25278\u201325294 (Curran Associates, Inc., 2022)."},{"key":"662_CR3","doi-asserted-by":"publisher","DOI":"10.1186\/s12880-022-00793-7","volume":"22","author":"HE Kim","year":"2022","unstructured":"Kim, H. E. et al. Transfer learning for medical image classification: a literature review. BMC Med. Imaging 22, 69 (2022).","journal-title":"BMC Med. Imaging"},{"key":"662_CR4","doi-asserted-by":"publisher","first-page":"1054","DOI":"10.1038\/s41591-019-0462-y","volume":"25","author":"JN Kather","year":"2019","unstructured":"Kather, J. N. et al. Deep learning can predict microsatellite instability directly from histology in gastrointestinal cancer. Nat. Med. 25, 1054\u20131056 (2019).","journal-title":"Nat. Med."},{"key":"662_CR5","doi-asserted-by":"publisher","first-page":"e210315","DOI":"10.1148\/ryai.210315","volume":"4","author":"X Mei","year":"2022","unstructured":"Mei, X. et al. RadImageNet: an open radiologic deep learning research dataset for effective transfer learning. Radiol. Artif. Intell. 4, e210315 (2022).","journal-title":"Radiol. Artif. Intell."},{"key":"662_CR6","unstructured":"Raghu, M., Zhang, C., Kleinberg, J., & Bengio, S. Transfusion: understanding transfer learning for medical imaging. In Advances in Neural Information Processing Systems 32 (NeurIPS 2019), Vol. 32. (eds Wallach, H. et al) (Curran Associates, Inc., 2019)."},{"key":"662_CR7","doi-asserted-by":"publisher","unstructured":"Wang, X. et al. ChestX-ray8: Hospital-scale chest X-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2097\u20132106 (IEEE, 2017); https:\/\/doi.org\/10.1109\/CVPR.2017.369","DOI":"10.1109\/CVPR.2017.369"},{"key":"662_CR8","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1038\/s41586-023-05881-4","volume":"616","author":"M Moor","year":"2023","unstructured":"Moor, M. et al. Foundation models for generalist medical artificial intelligence. Nature 616, 259\u2013265 (2023).","journal-title":"Nature"},{"key":"662_CR9","doi-asserted-by":"publisher","first-page":"e210284","DOI":"10.1148\/ryai.210284","volume":"4","author":"MJ Willemink","year":"2022","unstructured":"Willemink, M. J., Roth, H. R. & Sandfort, V. Toward foundational deep learning models for medical imaging in the new era of transformer networks. Radiol. Artif. Intell. 4, e210284 (2022).","journal-title":"Radiol. Artif. Intell."},{"key":"662_CR10","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1016\/j.media.2017.07.005","volume":"42","author":"G Litjens","year":"2017","unstructured":"Litjens, G. et al. A survey on deep learning in medical image analysis. Med. Image Anal. 42, 60\u201388 (2017).","journal-title":"Med. Image Anal."},{"key":"662_CR11","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1038\/s42256-021-00425-9","volume":"4","author":"H-Y Zhou","year":"2022","unstructured":"Zhou, H.-Y. et al. Generalized radiograph representation learning via cross-supervision between images and free-text radiology reports. Nat. Mach. Intell. 4, 32\u201340 (2022).","journal-title":"Nat. Mach. Intell."},{"key":"662_CR12","doi-asserted-by":"publisher","first-page":"5586","DOI":"10.1109\/TKDE.2021.3070203","volume":"34","author":"Y Zhang","year":"2022","unstructured":"Zhang, Y. & Yang, Q. A survey on multi-task learning. IEEE Trans. Knowl. Data Eng. 34, 5586\u20135609 (2022).","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"662_CR13","doi-asserted-by":"publisher","first-page":"412","DOI":"10.1109\/JBHI.2020.2992878","volume":"25","author":"R Mormont","year":"2021","unstructured":"Mormont, R., Geurts, P. & Mar\u00e9e, R. Multi-task pre-training of deep neural networks for digital pathology. IEEE J. Biomed. Health Inform. 25, 412\u2013421 (2021).","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"662_CR14","unstructured":"Chen, J. et al. TransUNet: transformers make strong encoders for medical image segmentation. Preprint at https:\/\/arxiv.org\/abs\/2102.04306 (2021)."},{"key":"662_CR15","doi-asserted-by":"publisher","first-page":"102685","DOI":"10.1016\/j.media.2022.102685","volume":"83","author":"Simon Graham","year":"2023","unstructured":"Graham, Simon. et al. One model is all you need: multi-task learning enables simultaneous histology image segmentation and classification. Medical Image Analysis 83, 102685 (2023).","journal-title":"Medical Image Analysis"},{"key":"662_CR16","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-022-01721-8","volume":"10","author":"J Yang","year":"2023","unstructured":"Yang, J. et al. MedMNIST v2-a large-scale lightweight benchmark for 2D and 3D biomedical image classification. Sci. Data 10, 41 (2023).","journal-title":"Sci. Data"},{"key":"662_CR17","doi-asserted-by":"publisher","first-page":"e1002730","DOI":"10.1371\/journal.pmed.1002730","volume":"16","author":"JN Kather","year":"2019","unstructured":"Kather, J. N. et al. Predicting survival from colorectal cancer histology slides using deep learning: a retrospective multicenter study. PLoS Med. 16, e1002730 (2019).","journal-title":"PLoS Med."},{"key":"662_CR18","doi-asserted-by":"publisher","first-page":"1122\u20131131.e9","DOI":"10.1016\/j.cell.2018.02.010","volume":"172","author":"DS Kermany","year":"2018","unstructured":"Kermany, D. S. et al. Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell 172, 1122\u20131131.e9 (2018).","journal-title":"Cell"},{"key":"662_CR19","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-020-0528-1","volume":"7","author":"L Hou","year":"2020","unstructured":"Hou, L. et al. Dataset of segmented nuclei in hematoxylin and eosin stained histopathology images of ten cancer types. Sci. Data 7, 185 (2020).","journal-title":"Sci. Data"},{"key":"662_CR20","first-page":"475","volume":"4","author":"S Jaeger","year":"2014","unstructured":"Jaeger, S. et al. Two public chest X-ray datasets for computer-aided screening of pulmonary diseases. Quant. Imaging Med. Surg. 4, 475 (2014).","journal-title":"Quant. Imaging Med. Surg."},{"key":"662_CR21","unstructured":"Brain tumor MRI dataset (Kaggle, accessed 14 January 2023); https:\/\/www.kaggle.com\/datasets\/masoudnickparvar\/brain-tumor-mri-dataset"},{"key":"662_CR22","unstructured":"SemiCOL. SemiCOL: semi-supervised learning for colon histology (accessed 4 July 2023); https:\/\/www.semicol.org\/"},{"key":"662_CR23","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-022-30695-9","volume":"13","author":"M Antonelli","year":"2022","unstructured":"Antonelli, M. et al. The medical segmentation decathlon. Nat. Commun. 13, 4128 (2022).","journal-title":"Nat. Commun."},{"key":"662_CR24","unstructured":"P\u00e9rez-Garc\u00eda, F. et al. RAD-DINO: exploring scalable medical image encoders beyond text supervision. Preprint https:\/\/arxiv.org\/abs\/2401.10815 (2024)."},{"key":"662_CR25","unstructured":"Oliver, Avital, et al. Realistic evaluation of deep semi-supervised learning algorithms. In Proc. 32nd International Conference on Neural Information Processing Systems 3239\u20133250 (Curran Associates, Inc., 2018)."},{"key":"662_CR26","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-17478-w","volume":"11","author":"DC Castro","year":"2020","unstructured":"Castro, D. C., Walker, I. & Glocker, B. Causality matters in medical imaging. Nat. Commun. 11, 3673 (2020).","journal-title":"Nat. Commun."},{"key":"662_CR27","doi-asserted-by":"publisher","first-page":"2774","DOI":"10.1109\/TEM.2021.3103334","volume":"70","author":"P Yadav","year":"2023","unstructured":"Yadav, P., Menon, N., Ravi, V. & Vishvanathan, S. Lung-GANs: unsupervised representation learning for lung disease classification using chest CT and X-ray images. IEEE Trans. Eng. Manag. 70, 2774\u20132786 (2023).","journal-title":"IEEE Trans. Eng. Manag."},{"key":"662_CR28","doi-asserted-by":"publisher","first-page":"21311","DOI":"10.1007\/s11042-022-13844-6","volume":"82","author":"J Arun Prakash","year":"2023","unstructured":"Arun Prakash, J., Asswin, C., Ravi, V., Sowmya, V. & Soman, K. Pediatric pneumonia diagnosis using stacked ensemble learning on multi-model deep CNN architectures. Multimedia Tools Appl. 82, 21311\u201321351 (2023).","journal-title":"Multimedia Tools Appl."},{"key":"662_CR29","unstructured":"Radford, Alec, et al. Learning transferable visual models from natural language supervision. In Proc. 38th International Conference on Machine Learning 8748\u20138763 (2021)."},{"key":"662_CR30","unstructured":"Lin, Y. et al. Speciality vs generality: an empirical study on catastrophic forgetting in fine-tuning foundation models. Preprit https:\/\/arxiv.org\/abs\/2308.08747 (2023)."},{"key":"662_CR31","unstructured":"Zaken, E. B., Ravfogel, S. & Goldberg, Y. BitFit: simple parameter-efficient fine-tuning for transformer-based masked language-models. In Proc. 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) 1\u20139 (ACL, 2022)."},{"key":"662_CR32","unstructured":"Hu, E. J. et al. LoRA: low-rank adaptation of large language models. Preprint at https:\/\/arxiv.org\/abs\/2106.09685 (2021)."},{"key":"662_CR33","doi-asserted-by":"crossref","unstructured":"Liu, Z. et al. Swin transformer: hierarchical vision transformer using shifted windows. In Proc. 2021 IEEE\/CVF International Conference on Computer Vision 9992\u201310002 (IEEE, 2021).","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"662_CR34","doi-asserted-by":"crossref","unstructured":"Liu, Z. et al. A ConvNet for the 2020s. In Proc. 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition 11966\u201311976 (IEEE, 2022).","DOI":"10.1109\/CVPR52688.2022.01167"},{"key":"662_CR35","doi-asserted-by":"publisher","first-page":"1259","DOI":"10.1093\/jamia\/ocaa341","volume":"28","author":"KV Sarma","year":"2021","unstructured":"Sarma, K. V. et al. Federated learning improves site performance in multicenter deep learning without data sharing. J. Am. Med. Inform. Assoc. 28, 1259\u20131264 (2021).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"662_CR36","unstructured":"Paszke, A. et al. PyTorch: an imperative style, high-performance deep learning library. In Advances in Neural Information Processing Systems, Vol. 32 (eds Wallach, H. et al) (Curran Associates, Inc., 2019)."},{"key":"662_CR37","doi-asserted-by":"publisher","unstructured":"Ronneberger, O., Fischer, P. & Brox, T. U-Net: convolutional networks for biomedical image segmentation. In Proc. Medical Image Computing and Computer-Assisted Intervention \u2013 MICCAI 2015 (eds Navab, N. et al.) 234\u2013241 (Springer, 2015); https:\/\/doi.org\/10.1007\/978-3-319-24574-4_28","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"662_CR38","unstructured":"Loshchilov, I. & Hutter, F. Decoupled weight decay regularization. Preprint at https:\/\/arxiv.org\/abs\/1711.05101 (2019)."},{"key":"662_CR39","first-page":"1922","volume":"44","author":"Z Tian","year":"2022","unstructured":"Tian, Z., Shen, C., Chen, H. & He, T. FCOS: a simple and strong anchor-free object detector. IEEE Trans. Pattern Anal. Mach. Intell. 44, 1922\u20131933 (2022).","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"662_CR40","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y. et al. Feature pyramid networks for object detection. In Proc. 2017 IEEE Conference on Computer Vision and Pattern Recognition 936\u2013944 (IEEE, 2017).","DOI":"10.1109\/CVPR.2017.106"},{"key":"662_CR41","unstructured":"Ioffe, S. & Szegedy, C. Batch normalization: accelerating deep network training by reducing internal covariate shift. In Proc. 32nd International Conference on International Conference on Machine Learning, Vol. 37 448\u2013456 (JMLR.org, 2015)."},{"key":"662_CR42","unstructured":"Ba, J. L., Kiros, J. R. & Hinton, G. E. Layer normalization. Preprint at https:\/\/arxiv.org\/abs\/1607.06450 (2016)."},{"key":"662_CR43","unstructured":"Xu, J., Sun, X., Zhang, Z., Zhao, G. & Lin, J. Understanding and improving layer normalization. In Advances in Neural Information Processing Systems, Vol. 32 (eds Wallach, H.) (Curran Associates, Inc., 2019)."},{"key":"662_CR44","unstructured":"Ji, Y. et al. AMOS: a large-scale abdominal multi-organ benchmark for versatile medical image segmentation. In Advances in Neural Information Processing Systems 36722\u201336732 (Curran Associates, Inc., 2022)."},{"key":"662_CR45","doi-asserted-by":"publisher","unstructured":"Lin, T.-Y. et al. Microsoft COCO: common objects in context. In Proc. Computer Vision \u2013 ECCV Lecture Notes in Computer Science, Vol. 8693 (eds Fleet, D. et al.) 740\u2013755 (Springer, 2014); https:\/\/doi.org\/10.1007\/978-3-319-10602-1_48","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"662_CR46","unstructured":"Bakas, S. et al. Identifying the best machine learning algorithms for brain tumor segmentation, progression assessment and overall survival prediction in the BRATS challenge. Preprint at https:\/\/arxiv.org\/abs\/1811.02629 (2019)."},{"key":"662_CR47","doi-asserted-by":"publisher","first-page":"170117","DOI":"10.1038\/sdata.2017.117","volume":"4","author":"S Bakas","year":"2017","unstructured":"Bakas, S. et al. Advancing The Cancer Genome Atlas glioma MRI collections with expert segmentation labels and radiomic features. Sci. Data 4, 170117 (2017).","journal-title":"Sci. Data"},{"key":"662_CR48","unstructured":"Saha, A. et al. Artificial intelligence and radiologists at prostate cancer detection in MRI: the PI-CAI Challenge (study protocol). Zenodo (2022); https:\/\/zenodo.org\/records\/6667655"},{"key":"662_CR49","unstructured":"DungNB et al. VinBigData chest X-ray abnormalities detection (Kaggle, 2020); https:\/\/kaggle.com\/competitions\/vinbigdata-chest-xray-abnormalities-detection"},{"key":"662_CR50","doi-asserted-by":"crossref","unstructured":"Irvin, J. et al. CheXpert: a large chest radiograph dataset with uncertainty labels and expert comparison. In Proc. AAAI Conference on Artificial Intelligence 590\u2013597 (2019).","DOI":"10.1609\/aaai.v33i01.3301590"},{"key":"662_CR51","doi-asserted-by":"publisher","unstructured":"Sch\u00e4fer, R. et al. Overcoming data scarcity in biomedical imaging with a foundational multi-task model\u2014model archive. Zenodo https:\/\/doi.org\/10.5281\/zenodo.11620136 (2024).","DOI":"10.5281\/zenodo.11620136"},{"key":"662_CR52","doi-asserted-by":"crossref","unstructured":"Chhipa, P. C. et al. Magnification prior: a self-supervised method for learning representations on breast cancer histopathological images. In Proc. 2023 IEEE\/CVF Winter Conference on Applications of Computer Vision (WACV) 2716\u20132726 (IEEE, 2023).","DOI":"10.1109\/WACV56688.2023.00274"},{"key":"662_CR53","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-023-36940-5","volume":"13","author":"R-G Dumitru","year":"2023","unstructured":"Dumitru, R.-G., Peteleaza, D. & Craciun, C. Using DUCK-Net for polyp image segmentation. Sci. Rep. 13, 9803 (2023).","journal-title":"Sci. Rep."},{"key":"662_CR54","unstructured":"Langer, S. G. & Shih, G. SIIM-ACR pneumothorax segmentation (Kaggle, retrieved 27 September 2022); https:\/\/www.kaggle.com\/competitions\/siim-acr-pneumothorax-segmentation\/data"},{"key":"662_CR55","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1016\/j.media.2018.12.001","volume":"52","author":"S Graham","year":"2019","unstructured":"Graham, S., Chen, H., Dou, Q., Heng, P., & Rajpoot, N. M. MILD-Net: minimal information loss dilated network for gland instance segmentation in colon histology images. Med. Image Anal. 52, 199\u2013211 (2019).","journal-title":"Med. Image Anal."},{"key":"662_CR56","doi-asserted-by":"publisher","first-page":"1993","DOI":"10.1109\/TMI.2014.2377694","volume":"34","author":"BH Menze","year":"2014","unstructured":"Menze, B. H. et al. The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans. Med. Imaging 34, 1993\u20132024 (2014).","journal-title":"IEEE Trans. Med. Imaging"},{"key":"662_CR57","doi-asserted-by":"publisher","unstructured":"Matek,C., Krappe, S., M\u00fcnzenmayer, C., Haferlach, T. & Marr, C. An expert-annotated dataset of bone marrow cytology in hematologic malignancies [data set] (The Cancer Imaging Archive, 2021); https:\/\/doi.org\/10.7937\/TCIA.AXH3-T579","DOI":"10.7937\/TCIA.AXH3-T579"},{"key":"662_CR58","unstructured":"Zawacki, A. et al. SIIM-ACR pneumothorax segmentation (Kaggle, 2019); https:\/\/kaggle.com\/competitions\/siim-acr-pneumothorax-segmentation"},{"key":"662_CR59","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-018-30535-1","volume":"8","author":"E Arvaniti","year":"2018","unstructured":"Arvaniti, E. et al. Automated Gleason grading of prostate cancer tissue microarrays via deep learning. Sci. Rep. 8, 12054 (2018).","journal-title":"Sci. Rep."},{"key":"662_CR60","unstructured":"Cardoso, M. J. et al. MONAI: an open-source framework for deep learning in healthcare. Preprint at https:\/\/arxiv.org\/abs\/2211.02701 (2022)."},{"key":"662_CR61","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1038\/s41592-020-01008-z","volume":"18","author":"F Isensee","year":"2021","unstructured":"Isensee, F., Jaeger, P. F., Kohl, S. A. A., Petersen, J. & Maier-Hein, K. H. nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation. Nat. Methods 18, 203\u2013211 (2021).","journal-title":"Nat. Methods"},{"key":"662_CR62","doi-asserted-by":"crossref","unstructured":"Buslaev, A., Parinov, A., Khvedchenya, E., Iglovikov, V. I. & Kalinin, A. A. Albumentations: fast and flexible image augmentations. Information 11, 125 (2020).","DOI":"10.3390\/info11020125"},{"key":"662_CR63","unstructured":"Iakubovskii, P. Segmentation models PyTorch https:\/\/github.com\/qubvel\/segmentation_models.pytorch (2019)."},{"key":"662_CR64","doi-asserted-by":"publisher","unstructured":"Jadon, S. A survey of loss functions for semantic segmentation. In Proc. 2020 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB) 1\u20137 (IEEE, 2020); https:\/\/doi.org\/10.1109\/CIBCB48159.2020.9277638","DOI":"10.1109\/CIBCB48159.2020.9277638"},{"key":"662_CR65","doi-asserted-by":"publisher","first-page":"318","DOI":"10.1109\/TPAMI.2018.2858826","volume":"42","author":"T-Y Lin","year":"2020","unstructured":"Lin, T.-Y., Goyal, P., Girshick, R., He, K. & Doll\u00e1r, P. Focal loss for dense object detection. IEEE Trans. Pattern Anal. Mach. Intell. 42, 318\u2013327 (2020).","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"662_CR66","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1016\/j.media.2019.05.010","volume":"56","author":"G Aresta","year":"2019","unstructured":"Aresta, G. et al. BACH: grand challenge on breast cancer histology images. Med. Image Anal. 56, 122\u2013139 (2019).","journal-title":"Med. Image Anal."},{"key":"662_CR67","doi-asserted-by":"publisher","first-page":"1455","DOI":"10.1109\/TBME.2015.2496264","volume":"63","author":"FA Spanhol","year":"2016","unstructured":"Spanhol, F. A., Oliveira, L. S., Petitjean, C. & Heutte, L. A dataset for breast cancer histopathological image classification. IEEE Trans. Biomed. Eng. 63, 1455\u20131462 (2016).","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"662_CR68","doi-asserted-by":"crossref","unstructured":"Jha, D. et al. Ro, Y. M. et al. Kvasir-SEG: a segmented polyp dataset. In MultiMedia Modeling (eds Ro, Y. M. et al.) 451\u2013462 (Springer International Publishing, Cham, 2020).","DOI":"10.1007\/978-3-030-37734-2_37"},{"key":"662_CR69","doi-asserted-by":"publisher","first-page":"567","DOI":"10.1109\/TPAMI.2019.2936841","volume":"43","author":"D Tellez","year":"2021","unstructured":"Tellez, D., Litjens, G., van der Laak, J. & Ciompi, F. Neural image compression for gigapixel histopathology image analysis. IEEE Trans. Pattern Anal. Mach. Intell. 43, 567\u2013578 (2021).","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"662_CR70","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. In Proc. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 770\u2013778 (IEEE, 2016).","DOI":"10.1109\/CVPR.2016.90"},{"key":"662_CR71","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1038\/s41591-021-01620-2","volume":"28","author":"W Bulten","year":"2022","unstructured":"Bulten, W. et al. Artificial intelligence for diagnosis and Gleason grading of prostate cancer: the Panda challenge. Nat. Med. 28, 154\u2013163 (2022).","journal-title":"Nat. Med."},{"key":"662_CR72","doi-asserted-by":"publisher","unstructured":"Graham, S. et al. Lizard: a large-scale dataset for colonic nuclear instance segmentation and classification. In Proc. 2021 IEEE\/CVF International Conference on Computer Vision Workshops (ICCVW) 684\u2013693 (IEEE, 2021); https:\/\/doi.org\/10.1109\/ICCVW54120.2021.00082","DOI":"10.1109\/ICCVW54120.2021.00082"},{"key":"662_CR73","first-page":"1917","volume":"138","author":"C Matek","year":"2021","unstructured":"Matek, C., Krappe, S., M\u00fcnzenmayer, C., Haferlach, T. & Marr, C. Highly accurate differentiation of bone marrow cell morphologies using deep neural networks on a large image data set. Blood J. Am. Soc. Hematol. 138, 1917\u20131927 (2021).","journal-title":"Blood J. Am. Soc. Hematol."},{"key":"662_CR74","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1109\/TMI.2013.2284099","volume":"33","author":"S Jaeger","year":"2013","unstructured":"Jaeger, S. et al. Automatic tuberculosis screening using chest radiographs. IEEE Trans. Med. Imaging 33, 233\u2013245 (2013).","journal-title":"IEEE Trans. Med. Imaging"}],"container-title":["Nature Computational Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s43588-024-00662-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s43588-024-00662-z","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s43588-024-00662-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,30]],"date-time":"2024-07-30T16:18:37Z","timestamp":1722356317000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s43588-024-00662-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,19]]},"references-count":74,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2024,7]]}},"alternative-id":["662"],"URL":"https:\/\/doi.org\/10.1038\/s43588-024-00662-z","relation":{},"ISSN":["2662-8457"],"issn-type":[{"value":"2662-8457","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,19]]},"assertion":[{"value":"21 September 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 June 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 July 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The applicant \u2018Fraunhofer-Gesellschaft zur F\u00f6rderung der angewandten Forschung eingetragener Verein\u2019 has a patent pending related to the training algorithm and neural architecture components presented in this Article (patent application no. EP23209015.9; names of inventors, R.S., T.N., H.H., J.L., F.K.).","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}]}}