{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T15:35:10Z","timestamp":1787067310620,"version":"build-2736575974"},"reference-count":24,"publisher":"Public Library of Science (PLoS)","issue":"7","license":[{"start":{"date-parts":[[2025,7,3]],"date-time":"2025-07-03T00:00:00Z","timestamp":1751500800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS One"],"abstract":"<jats:p>Endoscopy is a major tool for assessing the physiology of inner organs. Contemporary artificial intelligence methods are used to fully automatically label medical important classes on a pixel-by-pixel level. This so-called semantic segmentation is for example used to detect cancer tissue or to assess laryngeal physiology. However, due to the diversity of patients presenting, it is necessary to judge the segmentation quality. In this study, we present a fully automatic system to evaluate the segmentation performance in laryngeal endoscopy images. We showcase on glottal area segmentation that the predicted segmentation quality represented by the intersection over union metric is on par with human raters. Using a traffic light system, we are able to identify problematic segmentation frames to allow human-in-the-loop improvements, important for the clinical adaptation of automatic analysis procedures.<\/jats:p>","DOI":"10.1371\/journal.pone.0314573","type":"journal-article","created":{"date-parts":[[2025,7,3]],"date-time":"2025-07-03T13:22:32Z","timestamp":1751548952000},"page":"e0314573","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":4,"title":["Predicting semantic segmentation quality in laryngeal endoscopy images"],"prefix":"10.1371","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3643-7776","authenticated-orcid":true,"given":"Andreas M.","family":"Kist","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sina","family":"Razi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ren\u00e9","family":"Groh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Florian","family":"Gritsch","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anne","family":"Sch\u00fctzenberger","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2025,7,3]]},"reference":[{"issue":"7","key":"pone.0314573.ref001","first-page":"3523","article-title":"Image segmentation using deep learning: a survey","volume":"44","author":"S Minaee","year":"2022","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"1","key":"pone.0314573.ref002","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1159\/000111802","article-title":"Clinical implementation of laryngeal high-speed videoendoscopy: challenges and evolution","volume":"60","author":"DD Deliyski","year":"2008","journal-title":"Folia Phoniatr Logop"},{"issue":"2","key":"pone.0314573.ref003","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/j.jvoice.2017.05.002","article-title":"Utility of laryngeal high-speed videoendoscopy in clinical voice assessment","volume":"32","author":"SRC Zacharias","year":"2018","journal-title":"J Voice"},{"issue":"5","key":"pone.0314573.ref004","doi-asserted-by":"crossref","first-page":"1556","DOI":"10.3390\/app10051556","article-title":"Laryngeal image processing of vocal folds motion","volume":"10","author":"G Andrade-Miranda","year":"2020","journal-title":"Appl Sci"},{"issue":"3","key":"pone.0314573.ref005","doi-asserted-by":"crossref","first-page":"795","DOI":"10.1109\/TBME.2014.2364862","article-title":"Fully automated glottis segmentation in endoscopic videos using local color and shape features of glottal regions","volume":"62","author":"O Gloger","year":"2015","journal-title":"IEEE Trans Biomed Eng"},{"issue":"2","key":"pone.0314573.ref006","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0227791","article-title":"Fully automatic segmentation of glottis and vocal folds in endoscopic laryngeal high-speed videos using a deep convolutional LSTM network","volume":"15","author":"MK Fehling","year":"2020","journal-title":"PLoS One"},{"issue":"1","key":"pone.0314573.ref007","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1038\/s41597-020-0526-3","article-title":"BAGLS, a multihospital benchmark for automatic glottis segmentation","volume":"7","author":"P G\u00f3mez","year":"2020","journal-title":"Sci Data"},{"issue":"6","key":"pone.0314573.ref008","doi-asserted-by":"crossref","first-page":"1889","DOI":"10.1044\/2021_JSLHR-20-00498","article-title":"A deep learning enhanced novel software tool for laryngeal dynamics analysis","volume":"64","author":"AM Kist","year":"2021","journal-title":"J Speech Lang Hear Res"},{"key":"pone.0314573.ref009","doi-asserted-by":"crossref","first-page":"139356","DOI":"10.1109\/ACCESS.2020.3012722","article-title":"Efficient biomedical image segmentation on EdgeTPUs at point of care","volume":"8","author":"AM Kist","year":"2020","journal-title":"IEEE Access"},{"issue":"1","key":"pone.0314573.ref010","first-page":"1","article-title":"Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool","volume":"15","author":"AA Taha","year":"2015","journal-title":"BMC Med Imaging"},{"key":"pone.0314573.ref011","first-page":"578","article-title":"Real-time prediction of segmentation quality.","volume-title":"Medical Image Computing and Computer Assisted Intervention\u2013MICCAI 2018: 21st International Conference, Granada, Spain, September 16-20, 2018, Proceedings, Part IV","author":"R Robinson","year":"2018"},{"issue":"8","key":"pone.0314573.ref012","doi-asserted-by":"crossref","first-page":"1597","DOI":"10.1109\/TMI.2017.2665165","article-title":"Reverse classification accuracy: predicting segmentation performance in the absence of ground truth","volume":"36","author":"VV Valindria","year":"2017","journal-title":"IEEE Trans Med Imaging"},{"issue":"11","key":"pone.0314573.ref013","doi-asserted-by":"crossref","DOI":"10.1002\/lary.28475","article-title":"Intersegmenter variability in high-speed laryngoscopy-based glottal area waveform measures","volume":"130","author":"Y Maryn","year":"2020","journal-title":"Laryngoscope"},{"key":"pone.0314573.ref014","article-title":"Mobilenets: efficient convolutional neural networks for mobile vision applications","author":"AG Howard","year":"2017","journal-title":"arXiv preprint"},{"key":"pone.0314573.ref015","doi-asserted-by":"crossref","first-page":"4510","DOI":"10.1109\/CVPR.2018.00474","article-title":"MobileNetV2: inverted residuals and linear bottlenecks.","volume-title":"2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"M Sandler","year":"2018"},{"key":"pone.0314573.ref016","doi-asserted-by":"crossref","first-page":"1314","DOI":"10.1109\/ICCV.2019.00140","article-title":"Searching for MobileNetV3.","volume-title":"2019 IEEE\/CVF International Conference on Computer Vision (ICCV)","author":"A Howard","year":"2019"},{"key":"pone.0314573.ref017","first-page":"770","article-title":"Deep residual learning for image recognition.","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"K He","year":"2016"},{"key":"pone.0314573.ref018","first-page":"6105","article-title":"Efficientnet: Rethinking model scaling for convolutional neural networks.","volume-title":"International Conference on Machine Learning","author":"M Tan","year":"2019"},{"key":"pone.0314573.ref019","doi-asserted-by":"crossref","first-page":"21300","DOI":"10.1109\/ACCESS.2023.3249759","article-title":"Assessing inter-annotator agreement for medical image segmentation","volume":"11","author":"F Yang","year":"2023","journal-title":"IEEE Access"},{"key":"pone.0314573.ref020","unstructured":"Yakubovskiy P. Segmentation models. 2019. https:\/\/github.com\/qubvel\/segmentation_models"},{"issue":"5","key":"pone.0314573.ref021","doi-asserted-by":"crossref","first-page":"443","DOI":"10.3390\/bioengineering11050443","article-title":"Deep learning-based detection of glottis segmentation failures","volume":"11","author":"AA Dadras","year":"2024","journal-title":"Bioengineering (Basel)"},{"issue":"2","key":"pone.0314573.ref022","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1038\/s41592-023-02150-0","article-title":"Understanding metric-related pitfalls in image analysis validation","volume":"21","author":"A Reinke","year":"2024","journal-title":"Nat Methods"},{"key":"pone.0314573.ref023","doi-asserted-by":"crossref","first-page":"106047","DOI":"10.1016\/j.bspc.2024.106047","article-title":"S3AR U-Net: a separable squeezed similarity attention-gated residual U-Net for glottis segmentation","volume":"92","author":"FJP Montalbo","year":"2024","journal-title":"Biomed Signal Process Control"},{"key":"pone.0314573.ref024","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1109\/JTEHM.2023.3237859","article-title":"GlottisNetV2: temporal glottal midline detection using deep convolutional neural networks","volume":"11","author":"E Kruse","year":"2023","journal-title":"IEEE J Transl Eng Health Med"}],"container-title":["PLOS One"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0314573","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,3]],"date-time":"2025-07-03T13:22:38Z","timestamp":1751548958000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0314573"}},"subtitle":[],"editor":[{"given":"Xiaohui","family":"Zhang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2025,7,3]]},"references-count":24,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2025,7,3]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0314573","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2024.11.14.623604","asserted-by":"object"}]},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,3]]}}}