{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T01:01:43Z","timestamp":1790211703627,"version":"4.1.0"},"reference-count":44,"publisher":"SPIE-Intl Soc Optical Eng","issue":"01","license":[{"start":{"date-parts":[[2024,1,16]],"date-time":"2024-01-16T00:00:00Z","timestamp":1705363200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Med. Imag."],"published-print":{"date-parts":[[2024,1,16]]},"abstract":"<jats:p>PurposeUncertainty estimation has gained significant attention in recent years for its potential to enhance the performance of deep learning (DL) algorithms in medical applications and even potentially address domain shift challenges. However, it is not straightforward to incorporate uncertainty estimation with a DL system to achieve a tangible positive effect. The objective of our work is to evaluate if the proposed spatial uncertainty aggregation (SUA) framework may improve the effectiveness of uncertainty estimation in segmentation tasks. We evaluate if SUA boosts the observed correlation between the uncertainty estimates and false negative (FN) predictions. We also investigate if the observed benefits can translate to tangible improvements in segmentation performance.ApproachOur SUA framework processes negative prediction regions from a segmentation algorithm and detects FNs based on an aggregated uncertainty score. It can be utilized with many existing uncertainty estimation methods to boost their performance. We compare the SUA framework with a baseline of processing individual pixel\u2019s uncertainty independently.ResultsThe results demonstrate that SUA is able to detect FN regions. It achieved F\u03b2=0.5 of 0.92 on the in-domain and 0.85 on the domain-shift test data compared with 0.81 and 0.48 achieved by the baseline uncertainty, respectively. We also demonstrate that SUA yields improved general segmentation performance compared with utilizing the baseline uncertainty.ConclusionsWe propose the SUA framework for incorporating and utilizing uncertainty estimates for FN detection in DL segmentation algorithms for histopathology. The evaluation confirms the benefits of our approach compared with assessing pixel uncertainty independently.<\/jats:p>","DOI":"10.1117\/1.jmi.11.1.017501","type":"journal-article","created":{"date-parts":[[2024,1,16]],"date-time":"2024-01-16T11:25:42Z","timestamp":1705404342000},"page":"1-14","source":"Crossref","is-referenced-by-count":1,"title":["Benefits of spatial uncertainty aggregation for segmentation in digital pathology"],"prefix":"10.1117","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8734-6500","authenticated-orcid":false,"given":"Milda","family":"Pocevi\u010di\u016bt\u0117","sequence":"first","affiliation":[{"name":"Link\u00f6ping University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gabriel","family":"Eilertsen","sequence":"additional","affiliation":[{"name":"Link\u00f6ping University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Claes","family":"Lundstr\u00f6m","sequence":"additional","affiliation":[{"name":"Link\u00f6ping University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"189","reference":[{"key":"r1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-022-24315-1"},{"key":"r2","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2017.14585"},{"key":"r3","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-019-0508-1"},{"key":"r4","doi-asserted-by":"publisher","DOI":"10.5858\/arpa.2018-0147-OA"},{"key":"r5","doi-asserted-by":"publisher","DOI":"10.1016\/S1470-2045(19)30738-7"},{"key":"r6","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2020.23267"},{"key":"r7","doi-asserted-by":"publisher","DOI":"10.1016\/S2589-7500(20)30159-X"},{"key":"r8","doi-asserted-by":"publisher","DOI":"10.1016\/j.annonc.2021.09.007"},{"key":"r9","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2019.101544"},{"key":"r10","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2020.3032060"},{"key":"r11","first-page":"326","article-title":"CheXstray: a real-time multi-modal monitoring workflow for medical imaging AI","author":"Merkow","year":"2023"},{"key":"r12","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298640"},{"key":"r13","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-021-01343-4"},{"key":"r14","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-022-11826-0"},{"key":"r15","article-title":"Breast cancer"},{"key":"r16","doi-asserted-by":"publisher","DOI":"10.1097\/PAS.0000000000001151"},{"key":"r17","doi-asserted-by":"publisher","DOI":"10.1038\/s41551-020-00682-w"},{"key":"r18","doi-asserted-by":"publisher","DOI":"10.3390\/cancers14215424"},{"key":"r19","article-title":"Simple and scalable predictive uncertainty estimation using deep ensembles","author":"Lakshminarayanan","year":"2017"},{"key":"r20","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-59710-8_80"},{"key":"r21","first-page":"1","article-title":"Test-time data augmentation for estimation of heteroscedastic aleatoric uncertainty in deep neural networks","author":"Ayhan","year":"2018"},{"key":"r22","first-page":"1651","article-title":"Dropout as a Bayesian approximation: representing model uncertainty in deep learning","author":"Gal","year":"2016"},{"key":"r23","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-017-17876-z"},{"key":"r24","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-022-34025-x"},{"key":"r25","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-019-04516-y"},{"key":"r26","doi-asserted-by":"publisher","DOI":"10.1109\/TREX53765.2021.00014"},{"key":"r27","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2022.102655"},{"key":"r28","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2018.12.001"},{"key":"r29","first-page":"2825","article-title":"Scikit-learn: machine learning in Python","author":"Pedregosa","year":"2011"},{"key":"r30","doi-asserted-by":"publisher","DOI":"10.1117\/12.596105"},{"key":"r31","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.243"},{"key":"r32","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2023.102755"},{"key":"r33","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.123"},{"key":"r34","doi-asserted-by":"publisher","DOI":"10.1002\/j.1538-7305.1948.tb01338.x"},{"key":"r35","first-page":"1183","article-title":"Deep Bayesian active learning with image data","author":"Gal","year":"2017"},{"key":"r36","doi-asserted-by":"publisher","DOI":"10.1093\/gigascience\/giy065"},{"key":"r37","article-title":"Axillary lymph nodes in breast cancer cases","author":"Jarkman","year":"2019"},{"key":"r38","first-page":"1","article-title":"Metrics reloaded: a new recommendation framework for biomedical image analysis validation","author":"Reinke","year":"2022"},{"key":"r39","author":"Bishop","year":"2006"},{"key":"r40","article-title":"Camelyon16 results"},{"key":"r41","first-page":"10124","article-title":"Post-hoc uncertainty calibration for domain drift scenarios","author":"Tomani","year":"2021"},{"key":"r42","author":"Brierley","year":"2017"},{"key":"r43","doi-asserted-by":"publisher","DOI":"10.1111\/his.15067"},{"key":"r44","doi-asserted-by":"publisher","DOI":"10.1117\/12.2648769"}],"container-title":["Journal of Medical Imaging"],"original-title":[],"link":[{"URL":"https:\/\/www.spiedigitallibrary.org\/journals\/journal-of-medical-imaging\/volume-11\/issue-01\/017501\/Benefits-of-spatial-uncertainty-aggregation-for-segmentation-in-digital-pathology\/10.1117\/1.JMI.11.1.017501.full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T00:16:39Z","timestamp":1790208999000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.spiedigitallibrary.org\/journals\/journal-of-medical-imaging\/volume-11\/issue-01\/017501\/Benefits-of-spatial-uncertainty-aggregation-for-segmentation-in-digital-pathology\/10.1117\/1.JMI.11.1.017501.full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,16]]},"references-count":44,"journal-issue":{"issue":"01","published-online":{"date-parts":[[2024,1,1]]}},"URL":"https:\/\/doi.org\/10.1117\/1.jmi.11.1.017501","relation":{},"ISSN":["2329-4302","2329-4310"],"issn-type":[{"value":"2329-4302","type":"print"},{"value":"2329-4310","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,16]]}}}