{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T15:38:14Z","timestamp":1792856294244,"version":"4.5.0"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,10,5]],"date-time":"2020-10-05T00:00:00Z","timestamp":1601856000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,10,5]],"date-time":"2020-10-05T00:00:00Z","timestamp":1601856000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Jutta und Georg Bruns Stiftung f\u00fcr innovative Veterin\u00e4rmedizin"},{"name":"Projekt DEAL"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Manual count of mitotic figures, which is determined in the tumor region with the highest mitotic activity, is a key parameter of most tumor grading schemes. It can be, however, strongly dependent on the area selection due to uneven mitotic figure distribution in the tumor section. We aimed to assess the question, how significantly the area selection could impact the mitotic count, which has a known high inter-rater disagreement. On a data set of 32 whole slide images of H&amp;E-stained canine cutaneous mast cell tumor, fully annotated for mitotic figures, we asked eight veterinary pathologists (five board-certified, three in training) to select a field of interest for the mitotic count. To assess the potential difference on the mitotic count, we compared the mitotic count of the selected regions to the overall distribution on the slide. Additionally, we evaluated three deep learning-based methods for the assessment of highest mitotic density: In one approach, the model would directly try to predict the mitotic count for the presented image patches as a regression task. The second method aims at deriving a segmentation mask for mitotic figures, which is then used to obtain a mitotic density. Finally, we evaluated a two-stage object-detection pipeline based on state-of-the-art architectures to identify individual mitotic figures. We found that the predictions by all models were, on average, better than those of the experts. The two-stage object detector performed best and outperformed most of the human pathologists on the majority of tumor cases. The correlation between the predicted and the ground truth mitotic count was also best for this approach (0.963\u20130.979). Further, we found considerable differences in position selection between pathologists, which could partially explain the high variance that has been reported for the manual mitotic count. To achieve better inter-rater agreement, we propose to use a computer-based area selection for support of the pathologist in the manual mitotic count.<\/jats:p>","DOI":"10.1038\/s41598-020-73246-2","type":"journal-article","created":{"date-parts":[[2020,10,5]],"date-time":"2020-10-05T10:05:05Z","timestamp":1601892305000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":77,"title":["Deep learning algorithms out-perform veterinary pathologists in detecting the mitotically most active tumor region"],"prefix":"10.1038","volume":"10","author":[{"given":"Marc","family":"Aubreville","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christof A.","family":"Bertram","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christian","family":"Marzahl","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Corinne","family":"Gurtner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martina","family":"Dettwiler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anja","family":"Schmidt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Florian","family":"Bartenschlager","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sophie","family":"Merz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marco","family":"Fragoso","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Olivia","family":"Kershaw","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert","family":"Klopfleisch","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andreas","family":"Maier","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,10,5]]},"reference":[{"key":"73246_CR1","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1016\/j.media.2014.11.010","volume":"20","author":"M Veta","year":"2015","unstructured":"Veta, M. et al. Assessment of algorithms for mitosis detection in breast cancer histopathology images. Med. Image Anal. 20, 237\u2013248 (2015).","journal-title":"Med. Image Anal."},{"key":"73246_CR2","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1007\/s10549-008-0126-y","volume":"115","author":"JPA Baak","year":"2008","unstructured":"Baak, J. P. A. et al. Proliferation is the strongest prognosticator in node-negative breast cancer: significance, error sources, alternatives and comparison with molecular prognostic markers. Breast Cancer Res. Treat. 115, 241\u2013254 (2008).","journal-title":"Breast Cancer Res. Treat."},{"key":"73246_CR3","doi-asserted-by":"publisher","first-page":"403","DOI":"10.1111\/j.1365-2559.1991.tb00229.x","volume":"19","author":"CW Elston","year":"1991","unstructured":"Elston, C. W. & Ellis, I. O. Pathological prognostic factors in breast cancer. I. The value of histological grade in breast cancer: experience from a large study with long-term follow-up. Histopathology 19, 403\u2013410 (1991).","journal-title":"Histopathology"},{"key":"73246_CR4","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1016\/j.tvjl.2016.06.003","volume":"215","author":"DG Sledge","year":"2016","unstructured":"Sledge, D. G., Webster, J. & Kiupel, M. Canine cutaneous mast cell tumors: a combined clinical and pathologic approach to diagnosis, prognosis, and treatment selection. Vet. J. 215, 43\u201354 (2016).","journal-title":"Vet. J."},{"key":"73246_CR5","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1177\/0300985810386469","volume":"48","author":"M Kiupel","year":"2011","unstructured":"Kiupel, M. et al. Proposal of a 2-tier histologic grading system for canine cutaneous mast cell tumors to more accurately predict biological behavior. Vet. Pathol. 48, 147\u2013155 (2011).","journal-title":"Vet. Pathol."},{"key":"73246_CR6","doi-asserted-by":"publisher","first-page":"1488","DOI":"10.1002\/cncr.11196","volume":"97","author":"MF Azzola","year":"2003","unstructured":"Azzola, M. F. et al. Tumor mitotic rate is a more powerful prognostic indicator than ulceration in patients with primary cutaneous melanoma. Cancer 97, 1488\u20131498 (2003).","journal-title":"Cancer"},{"key":"73246_CR7","doi-asserted-by":"publisher","first-page":"942","DOI":"10.1002\/9781119181200.app","volume-title":"Tumors in Domestic Animals","author":"DJ Meuten","year":"2016","unstructured":"Meuten, D. J. Appendix: diagnostic schemes and algorithms. In Tumors in Domestic Animals (ed. Meuten, D. J.) 942\u2013978 (Wiley, Hoboken, 2016)."},{"key":"73246_CR8","doi-asserted-by":"publisher","first-page":"214","DOI":"10.1177\/0300985819890686","volume":"57","author":"CA Bertram","year":"2020","unstructured":"Bertram, C. A. et al. Computerized calculation of mitotic distribution in canine cutaneous mast cell tumor sections: mitotic count is area dependent. Vet. Pathol. 57, 214\u2013226 (2020).","journal-title":"Vet. Pathol."},{"key":"73246_CR9","doi-asserted-by":"publisher","first-page":"421","DOI":"10.1046\/j.1365-2559.1996.d01-509.x","volume":"29","author":"I Jannink","year":"1996","unstructured":"Jannink, I., Risberg, B., Van Diest, P. J. & Baak, J. P. Heterogeneity of mitotic activity in breast cancer. Histopathology 29, 421\u2013428 (1996).","journal-title":"Histopathology"},{"key":"73246_CR10","doi-asserted-by":"publisher","first-page":"451","DOI":"10.1111\/j.1349-7006.2000.tb00966.x","volume":"91","author":"H Tsuda","year":"2000","unstructured":"Tsuda, H. et al. Evaluation of the interobserver agreement in the number of mitotic figures breast carcinoma as simulation of quality monitoring in the Japan national surgical adjuvant study of breast cancer (NSAS-BC) protocol. Jpn. J. Cancer Res. 91, 451\u2013457 (2000).","journal-title":"Jpn. J. Cancer Res."},{"key":"73246_CR11","doi-asserted-by":"publisher","first-page":"849","DOI":"10.1111\/his.13007","volume":"69","author":"CM Focke","year":"2016","unstructured":"Focke, C. M., Decker, T. & van Diest, P. J. Intratumoral heterogeneity of Ki67 expression in early breast cancers exceeds variability between individual tumours. Histopathology 69, 849\u2013861 (2016).","journal-title":"Histopathology"},{"key":"73246_CR12","doi-asserted-by":"publisher","first-page":"318","DOI":"10.1038\/modpathol.2016.34","volume":"29","author":"G St\u00e5lhammar","year":"2016","unstructured":"St\u00e5lhammar, G. et al. Digital image analysis outperforms manual biomarker assessment in breast cancer. Mod. Pathol. 29, 318\u2013329 (2016).","journal-title":"Mod. Pathol."},{"key":"73246_CR13","doi-asserted-by":"publisher","first-page":"1067","DOI":"10.1038\/modpathol.3800388","volume":"18","author":"JS Meyer","year":"2005","unstructured":"Meyer, J. S. et al. Breast carcinoma malignancy grading by Bloom\u2013Richardson system vs proliferation index: reproducibility of grade and advantages of proliferation index. Mod. Pathol. 18, 1067\u20131078 (2005).","journal-title":"Mod. Pathol."},{"key":"73246_CR14","doi-asserted-by":"crossref","first-page":"1826","DOI":"10.5858\/133.11.1826","volume":"133","author":"JS Meyer","year":"2009","unstructured":"Meyer, J. S., Cosatto, E. & Graf, H. P. Mitotic index of invasive breast carcinoma. Achieving clinically meaningful precision and evaluating tertial cutoffs. Arch. Pathol. Lab. Med. 133, 1826\u20131833 (2009).","journal-title":"Arch. Pathol. Lab. Med."},{"key":"73246_CR15","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1186\/s12911-015-0235-6","volume":"15","author":"MFA Fauzi","year":"2015","unstructured":"Fauzi, M. F. A. et al. Classification of follicular lymphoma: the effect of computer aid on pathologists grading. BMC Med. Inform. Decis. 15, 115 (2015).","journal-title":"BMC Med. Inform. Decis."},{"key":"73246_CR16","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1186\/s12938-016-0301-z","volume":"16","author":"M Bonert","year":"2017","unstructured":"Bonert, M. & Tate, A. J. Mitotic counts in breast cancer should be standardized with a uniform sample area. BioMed. Eng. OnLine 16, 28 (2017).","journal-title":"BioMed. Eng. OnLine"},{"key":"73246_CR17","doi-asserted-by":"publisher","first-page":"974","DOI":"10.1111\/his.13452","volume":"72","author":"G St\u00e5lhammar","year":"2018","unstructured":"St\u00e5lhammar, G. et al. Digital image analysis of Ki67 in hot spots is superior to both manual Ki67 and mitotic counts in breast cancer. Histopathology 72, 974\u2013989 (2018).","journal-title":"Histopathology"},{"key":"73246_CR18","doi-asserted-by":"publisher","first-page":"244","DOI":"10.1002\/cyto.990050305","volume":"5","author":"EJ Kaman","year":"1984","unstructured":"Kaman, E. J., Smeulders, A. W. M., Verbeek, P. W., Young, I. T. & Baak, J. P. A. Image processing for mitoses in sections of breast cancer: a feasibility study. Cytometry 5, 244\u2013249 (1984).","journal-title":"Cytometry"},{"key":"73246_CR19","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1016\/j.zemedi.2018.12.003","volume":"29","author":"A Maier","year":"2019","unstructured":"Maier, A., Syben, C., Lasser, T. & Riess, C. A gentle introduction to deep learning in medical image processing. Z. Med. Phys. 29, 86\u2013101 (2019).","journal-title":"Z. Med. Phys."},{"key":"73246_CR20","first-page":"411","volume":"16","author":"DC Cire\u015fan","year":"2013","unstructured":"Cire\u015fan, D. C., Giusti, A., Gambardella, L. M. & Schmidhuber, J. Mitosis detection in breast cancer histology images with deep neural networks. MICCAI 16, 411\u2013418 (2013).","journal-title":"MICCAI"},{"key":"73246_CR21","doi-asserted-by":"publisher","first-page":"8","DOI":"10.4103\/2153-3539.112693","volume":"4","author":"L Roux","year":"2013","unstructured":"Roux, L. et al. Mitosis detection in breast cancer histological images an ICPR 2012 contest. J. Pathol. Inf. 4, 8 (2013).","journal-title":"J. Pathol. Inf."},{"key":"73246_CR22","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1016\/j.media.2019.02.012","volume":"54","author":"M Veta","year":"2019","unstructured":"Veta, M. et al. Predicting breast tumor proliferation from whole-slide images: the TUPAC16 challenge. Med. Image Anal. 54, 111\u2013121 (2019).","journal-title":"Med. Image Anal."},{"key":"73246_CR23","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S. & Sun, J. Deep Residual Learning for Image Recognition. In CVPR, 770\u2013778 (IEEE, 2016).","DOI":"10.1109\/CVPR.2016.90"},{"key":"73246_CR24","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1016\/j.media.2017.12.002","volume":"45","author":"C Li","year":"2018","unstructured":"Li, C., Wang, X., Liu, W. & Latecki, L. J. DeepMitosis: Mitosis detection via deep detection, verification and segmentation networks. Med. Image Anal. 45, 121\u2013133 (2018).","journal-title":"Med. Image Anal."},{"key":"73246_CR25","first-page":"7","volume-title":"Digital Pathology","author":"P Pati","year":"2019","unstructured":"Pati, P., Catena, R., Goksel, O. & Gabrani, M. A deep learning framework for context-aware mitotic activity estimation in whole slide images. In Digital Pathology (eds Tomaszewski, J. E. & Ward, A. D.) 7\u20139 (SPIE, Bellingham, 2019)."},{"key":"73246_CR26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41597-019-0290-4","volume":"6","author":"CA Bertram","year":"2019","unstructured":"Bertram, C. A., Aubreville, M., Marzahl, C., Maier, A. & Klopfleisch, R. A large-scale dataset for mitotic figure assessment on whole slide images of canine cutaneous mast cell tumor. Sci. Data 6, 1\u20139 (2019).","journal-title":"Sci. Data"},{"key":"73246_CR27","doi-asserted-by":"crossref","unstructured":"Aubreville, M., Bertram, C. A., Klopfleisch, R. & Maier, A. SlideRunner - A Tool for Massive Cell Annotations in Whole Slide Images. In Bildverarb. f\u00fcr die Med. 2018, 309\u2013314 (Springer, 2018).","DOI":"10.1007\/978-3-662-56537-7_81"},{"key":"73246_CR28","doi-asserted-by":"crossref","unstructured":"Aubreville, M., Bertram, C. A., Klopfleisch, R. & Maier, A. Augmented mitotic cell count using field of interest proposal. In Bildverarbeitung f\u00fcr die Medizin 2019, 321\u2013326 (Springer, 2019).","DOI":"10.1007\/978-3-658-25326-4_71"},{"issue":"6","key":"73246_CR29","doi-asserted-by":"publisher","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","volume":"39","author":"S Ren","year":"2017","unstructured":"Ren, S., He, K., Girshick, R. & Sun, J. Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans. Pat. Anal. Mach. Intel. 39(6), 1137\u20131149 (2017).","journal-title":"IEEE Trans. Pat. Anal. Mach. Intel."},{"key":"73246_CR30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-020-65958-2","volume":"10","author":"C Marzahl","year":"2020","unstructured":"Marzahl, C. et al. Deep learning-based quantification of pulmonary hemosiderophages in cytology slides. Sci. Rep. 10, 1\u201310 (2020).","journal-title":"Sci. Rep."},{"key":"73246_CR31","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Goyal, P., Girshick, R., He, K. & Dollar, P. Focal loss for dense object detection. In 2017 IEEE International Conference on Computer Vision (ICCV), 2999\u20133007 (IEEE, 2017).","DOI":"10.1109\/ICCV.2017.324"},{"key":"73246_CR32","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P. & Brox, T. U-Net\u2014convolutional networks for biomedical image segmentation. In MICCAI, 234\u2013241 (Springer, 2015).","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"73246_CR33","doi-asserted-by":"crossref","unstructured":"Rahman, M. A. & Wang, Y. Optimizing intersection-over-union in deep neural networks for image segmentation. In Advances in Visual Computing, 234\u2013244 (Springer, Cham, Cham, 2016).","DOI":"10.1007\/978-3-319-50835-1_22"},{"key":"73246_CR34","doi-asserted-by":"publisher","first-page":"1400","DOI":"10.1109\/TBME.2014.2303852","volume":"61","author":"M Veta","year":"2014","unstructured":"Veta, M., Pluim, J. P. W., van Diest, P. J. & Viergever, M. A. Breast cancer histopathology image analysis: a review. IEEE Trans. Biomed. Eng. 61, 1400\u20131411 (2014).","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"73246_CR35","unstructured":"Roux, L. et al. MITOS & ATYPIA Detection of Mitosis and Evaluation of Nuclear Atypia Score in Breast Cencer Histological Images. In Image Pervasive Access Lab (IPAL), Agency Sci., Technol. & Res. Inst. Infocom Res., Singapore, Tech. Rep 1, 1\u20138 (2014)."},{"key":"73246_CR36","doi-asserted-by":"publisher","first-page":"240","DOI":"10.1354\/vp.39-2-240","volume":"39","author":"J Kirpensteijn","year":"2002","unstructured":"Kirpensteijn, J., Kik, M., Rutteman, G. R. & Teske, E. Prognostic significance of a new histologic grading system for canine osteosarcoma. Vet. Pathol. 39, 240\u2013246 (2002).","journal-title":"Vet. Pathol."},{"key":"73246_CR37","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1016\/j.jcpa.2006.11.005","volume":"136","author":"P Loukopoulos","year":"2007","unstructured":"Loukopoulos, P. & Robinson, W. F. Clinicopathological relevance of tumour grading in canine osteosarcoma. J. Comp. Pathol. 136, 65\u201373 (2007).","journal-title":"J. Comp. Pathol."},{"key":"73246_CR38","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1177\/0300985817753869","volume":"55","author":"D Meuten","year":"2018","unstructured":"Meuten, D., Munday, J. S. & Hauck, M. Time to standardize? Time to validate?. Vet. Pathol. 55, 195\u2013199 (2018).","journal-title":"Vet. Pathol."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-73246-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-73246-2","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-73246-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,6]],"date-time":"2022-12-06T20:56:48Z","timestamp":1670360208000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-73246-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,5]]},"references-count":38,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["73246"],"URL":"https:\/\/doi.org\/10.1038\/s41598-020-73246-2","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10,5]]},"assertion":[{"value":"22 January 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 September 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 October 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"16447"}}