{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T17:47:04Z","timestamp":1791913624248,"version":"4.3.4"},"reference-count":36,"publisher":"Public Library of Science (PLoS)","issue":"9","license":[{"start":{"date-parts":[[2022,9,21]],"date-time":"2022-09-21T00:00:00Z","timestamp":1663718400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["SCHU 3441\/3-2"],"award-info":[{"award-number":["SCHU 3441\/3-2"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>Deep Learning has a large impact on medical image analysis and lately has been adopted for clinical use at the point of care. However, there is only a small number of reports of long-term studies that show the performance of deep neural networks (DNNs) in such an environment. In this study, we measured the long-term performance of a clinically optimized DNN for laryngeal glottis segmentation. We have collected the video footage for two years from an AI-powered laryngeal high-speed videoendoscopy imaging system and found that the footage image quality is stable across time. Next, we determined the DNN segmentation performance on lossy and lossless compressed data revealing that only 9% of recordings contain segmentation artifacts. We found that lossy and lossless compression is on par for glottis segmentation, however, lossless compression provides significantly superior image quality. Lastly, we employed continual learning strategies to continuously incorporate new data into the DNN to remove the aforementioned segmentation artifacts. With modest manual intervention, we were able to largely alleviate these segmentation artifacts by up to 81%. We believe that our suggested deep learning-enhanced laryngeal imaging platform consistently provides clinically sound results, and together with our proposed continual learning scheme will have a long-lasting impact on the future of laryngeal imaging.<\/jats:p>","DOI":"10.1371\/journal.pone.0266989","type":"journal-article","created":{"date-parts":[[2022,9,21]],"date-time":"2022-09-21T13:35:16Z","timestamp":1663767316000},"page":"e0266989","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":6,"title":["Long-term performance assessment of fully automatic biomedical glottis segmentation at the point of care"],"prefix":"10.1371","volume":"17","author":[{"given":"Ren\u00e9","family":"Groh","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephan","family":"D\u00fcrr","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anne","family":"Sch\u00fctzenberger","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marion","family":"Semmler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3643-7776","authenticated-orcid":true,"given":"Andreas M.","family":"Kist","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2022,9,21]]},"reference":[{"issue":"1","key":"pone.0266989.ref001","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1159\/000111802","article-title":"Clinical implementation of laryngeal high-speed videoendoscopy: challenges and evolution","volume":"60","author":"DD Deliyski","year":"2008","journal-title":"Folia Phoniatrica et Logopaedica"},{"issue":"2","key":"pone.0266989.ref002","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/j.jvoice.2017.05.002","article-title":"Utility of laryngeal high-speed videoendoscopy in clinical voice assessment","volume":"32","author":"SR Zacharias","year":"2018","journal-title":"Journal of Voice"},{"issue":"5","key":"pone.0266989.ref003","doi-asserted-by":"crossref","first-page":"981","DOI":"10.1002\/lary.20832","article-title":"Assessment of the variability of vocal fold dynamics within and between recordings with high-speed imaging and by phonovibrogram","volume":"120","author":"M Kunduk","year":"2010","journal-title":"The Laryngoscope"},{"key":"pone.0266989.ref004","article-title":"Spatial segmentation for laryngeal high-speed videoendoscopy in connected speech","author":"AM Yousef","year":"2020","journal-title":"Journal of Voice"},{"issue":"2","key":"pone.0266989.ref005","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1016\/j.jvoice.2017.05.014","article-title":"Temporal segmentation for laryngeal high-speed videoendoscopy in connected speech","volume":"32","author":"M Naghibolhosseini","year":"2018","journal-title":"Journal of Voice"},{"issue":"8","key":"pone.0266989.ref006","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1109\/TBME.2002.800755","article-title":"Vibration parameter extraction from endoscopic image series of the vocal folds","volume":"49","author":"M D\u00f6llinger","year":"2002","journal-title":"IEEE Transactions on Biomedical Engineering"},{"issue":"5","key":"pone.0266989.ref007","doi-asserted-by":"crossref","first-page":"1556","DOI":"10.3390\/app10051556","article-title":"Laryngeal image processing of vocal folds motion","volume":"10","author":"G Andrade-Miranda","year":"2020","journal-title":"Applied Sciences"},{"issue":"3","key":"pone.0266989.ref008","doi-asserted-by":"crossref","first-page":"795","DOI":"10.1109\/TBME.2014.2364862","article-title":"Fully automated glottis segmentation in endoscopic videos using local color and shape features of glottal regions","volume":"62","author":"O Gloger","year":"2014","journal-title":"IEEE Transactions on Biomedical Engineering"},{"key":"pone.0266989.ref009","doi-asserted-by":"crossref","first-page":"139356","DOI":"10.1109\/ACCESS.2020.3012722","article-title":"Efficient biomedical image segmentation on EdgeTPUs at point of care","volume":"8","author":"AM Kist","year":"2020","journal-title":"IEEE Access"},{"issue":"1","key":"pone.0266989.ref010","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1038\/s41597-020-0526-3","article-title":"BAGLS, a multihospital benchmark for automatic glottis segmentation","volume":"7","author":"P G\u00f3mez","year":"2020","journal-title":"Scientific data"},{"issue":"2","key":"pone.0266989.ref011","doi-asserted-by":"crossref","first-page":"e0227791","DOI":"10.1371\/journal.pone.0227791","article-title":"Fully automatic segmentation of glottis and vocal folds in endoscopic laryngeal high-speed videos using a deep convolutional lstm network","volume":"15","author":"MK Fehling","year":"2020","journal-title":"Plos one"},{"issue":"3","key":"pone.0266989.ref012","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1007\/s11548-018-01910-0","article-title":"A dataset of laryngeal endoscopic images with comparative study on convolution neural network-based semantic segmentation","volume":"14","author":"MH Laves","year":"2019","journal-title":"International journal of computer assisted radiology and surgery"},{"key":"pone.0266989.ref013","article-title":"Deep Learning Applied to White Light and Narrow Band Imaging Videolaryngoscopy: Toward Real-Time Laryngeal Cancer Detection","author":"MA Azam","year":"2021","journal-title":"The Laryngoscope"},{"key":"pone.0266989.ref014","first-page":"1","article-title":"A Deep Learning Approach for Quantifying Vocal Fold Dynamics During Connected Speech Using Laryngeal High-Speed Videoendoscopy","author":"AM Yousef","year":"2022","journal-title":"Journal of Speech, Language, and Hearing Research"},{"issue":"11","key":"pone.0266989.ref015","first-page":"E686","article-title":"Automatic recognition of laryngoscopic images using a deep-learning technique","volume":"130","author":"J Ren","year":"2020","journal-title":"The Laryngoscope"},{"issue":"5","key":"pone.0266989.ref016","doi-asserted-by":"crossref","first-page":"1257","DOI":"10.1007\/s00521-017-3158-6","article-title":"Medical image semantic segmentation based on deep learning","volume":"29","author":"F Jiang","year":"2018","journal-title":"Neural Computing and Applications"},{"issue":"2","key":"pone.0266989.ref017","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1007\/s13735-017-0141-z","article-title":"A review of semantic segmentation using deep neural networks","volume":"7","author":"Y Guo","year":"2018","journal-title":"International journal of multimedia information retrieval"},{"key":"pone.0266989.ref018","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1016\/j.neucom.2019.02.003","article-title":"Survey on semantic segmentation using deep learning techniques","volume":"338","author":"F Lateef","year":"2019","journal-title":"Neurocomputing"},{"issue":"1","key":"pone.0266989.ref019","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/s10462-020-09854-1","article-title":"Deep semantic segmentation of natural and medical images: a review","volume":"54","author":"S Asgari Taghanaki","year":"2021","journal-title":"Artificial Intelligence Review"},{"key":"pone.0266989.ref020","doi-asserted-by":"crossref","unstructured":"Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical image computing and computer-assisted intervention. Springer; 2015. p. 234\u2013241.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"pone.0266989.ref021","doi-asserted-by":"crossref","unstructured":"Zhou Z, Rahman Siddiquee MM, Tajbakhsh N, Liang J. Unet++: A nested u-net architecture for medical image segmentation. In: Deep learning in medical image analysis and multimodal learning for clinical decision support. Springer; 2018. p. 3\u201311.","DOI":"10.1007\/978-3-030-00889-5_1"},{"key":"pone.0266989.ref022","unstructured":"Oktay O, Schlemper J, Folgoc LL, Lee M, Heinrich M, Misawa K, et al. Attention u-net: Learning where to look for the pancreas. arXiv preprint arXiv:180403999. 2018."},{"key":"pone.0266989.ref023","doi-asserted-by":"crossref","unstructured":"Alom MZ, Yakopcic C, Taha TM, Asari VK. Nuclei segmentation with recurrent residual convolutional neural networks based U-Net (R2U-Net). In: NAECON 2018-IEEE National Aerospace and Electronics Conference. IEEE; 2018. p. 228\u2013233.","DOI":"10.1109\/NAECON.2018.8556686"},{"issue":"2","key":"pone.0266989.ref024","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1038\/s41592-020-01008-z","article-title":"nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation","volume":"18","author":"F Isensee","year":"2021","journal-title":"Nature methods"},{"issue":"1","key":"pone.0266989.ref025","first-page":"1","article-title":"OpenHSV: an open platform for laryngeal high-speed videoendoscopy","volume":"11","author":"AM Kist","year":"2021","journal-title":"Scientific Reports"},{"issue":"3","key":"pone.0266989.ref026","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1109\/LSP.2012.2227726","article-title":"Making a \u201ccompletely blind\u201d image quality analyzer","volume":"20","author":"A Mittal","year":"2012","journal-title":"IEEE Signal processing letters"},{"issue":"4","key":"pone.0266989.ref027","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: from error visibility to structural similarity","volume":"13","author":"Z Wang","year":"2004","journal-title":"IEEE transactions on image processing"},{"key":"pone.0266989.ref028","first-page":"547","article-title":"\u00c9tude comparative de la distribution florale dans une portion des Alpes et des Jura","volume":"37","author":"P Jaccard","year":"1901","journal-title":"Bull Soc Vaudoise Sci Nat"},{"key":"pone.0266989.ref029","doi-asserted-by":"crossref","unstructured":"Cheng B, Girshick R, Doll\u00e1r P, Berg AC, Kirillov A. Boundary IoU: Improving Object-Centric Image Segmentation Evaluation; 2021. Available from: https:\/\/arxiv.org\/abs\/2103.16562.","DOI":"10.1109\/CVPR46437.2021.01508"},{"key":"pone.0266989.ref030","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1016\/j.neunet.2019.01.012","article-title":"Continual lifelong learning with neural networks: A review","volume":"113","author":"GI Parisi","year":"2019","journal-title":"Neural Networks"},{"issue":"6","key":"pone.0266989.ref031","doi-asserted-by":"crossref","first-page":"e279","DOI":"10.1016\/S2589-7500(20)30102-3","article-title":"Clinical applications of continual learning machine learning","volume":"2","author":"CS Lee","year":"2020","journal-title":"The Lancet Digital Health"},{"issue":"7","key":"pone.0266989.ref032","doi-asserted-by":"crossref","first-page":"1451","DOI":"10.1007\/s11517-019-01965-4","article-title":"Low-light image enhancement of high-speed endoscopic videos using a convolutional neural network","volume":"57","author":"P G\u00f3mez","year":"2019","journal-title":"Medical & biological engineering & computing"},{"issue":"3","key":"pone.0266989.ref033","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1016\/j.jvoice.2004.07.006","article-title":"Endoscope motion compensation for laryngeal high-speed videoendoscopy","volume":"19","author":"DD Deliyski","year":"2005","journal-title":"Journal of Voice"},{"issue":"6","key":"pone.0266989.ref034","doi-asserted-by":"crossref","first-page":"1889","DOI":"10.1044\/2021_JSLHR-20-00498","article-title":"A deep learning enhanced novel software tool for laryngeal dynamics analysis","volume":"64","author":"AM Kist","year":"2021","journal-title":"Journal of Speech, Language, and Hearing Research"},{"key":"pone.0266989.ref035","doi-asserted-by":"crossref","first-page":"102062","DOI":"10.1016\/j.media.2021.102062","article-title":"A survey on active learning and human-in-the-loop deep learning for medical image analysis","volume":"71","author":"S Budd","year":"2021","journal-title":"Medical Image Analysis"},{"issue":"1","key":"pone.0266989.ref036","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s41666-020-00082-4","article-title":"Federated learning for healthcare informatics","volume":"5","author":"J Xu","year":"2021","journal-title":"Journal of Healthcare Informatics Research"}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0266989","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,21]],"date-time":"2022-09-21T13:36:03Z","timestamp":1663767363000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0266989"}},"subtitle":[],"editor":[{"given":"Xiyu","family":"Liu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2022,9,21]]},"references-count":36,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2022,9,21]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0266989","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2022.04.01.22273289","asserted-by":"object"}]},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,21]]}}}