{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T17:46:57Z","timestamp":1791913617046,"version":"4.3.4"},"reference-count":46,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,8,22]],"date-time":"2022-08-22T00:00:00Z","timestamp":1661126400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,8,22]],"date-time":"2022-08-22T00:00:00Z","timestamp":1661126400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["SCHU 3441\/3-2"],"award-info":[{"award-number":["SCHU 3441\/3-2"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001652","name":"Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100001652","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Glottis segmentation is a crucial step to quantify endoscopic footage in laryngeal high-speed videoendoscopy. Recent advances in deep neural networks for glottis segmentation allow for a fully automatic workflow. However, exact knowledge of integral parts of these deep segmentation networks remains unknown, and understanding the inner workings is crucial for acceptance in clinical practice. Here, we show that a single latent channel as a bottleneck layer is sufficient for glottal area segmentation using systematic ablations. We further demonstrate that the latent space is an abstraction of the glottal area segmentation relying on three spatially defined pixel subtypes allowing for a transparent interpretation. We further provide evidence that the latent space is highly correlated with the glottal area waveform, can be encoded with four bits, and decoded using lean decoders while maintaining a high reconstruction accuracy. Our findings suggest that glottis segmentation is a task that can be highly optimized to gain very efficient and explainable deep neural networks, important for application in the clinic. In the future, we believe that online deep learning-assisted monitoring is a game-changer in laryngeal examinations.<\/jats:p>","DOI":"10.1038\/s41598-022-17764-1","type":"journal-article","created":{"date-parts":[[2022,8,22]],"date-time":"2022-08-22T13:05:44Z","timestamp":1661173544000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["A single latent channel is sufficient for biomedical glottis segmentation"],"prefix":"10.1038","volume":"12","author":[{"given":"Andreas M.","family":"Kist","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katharina","family":"Breininger","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marion","family":"D\u00f6rrich","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephan","family":"D\u00fcrr","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anne","family":"Sch\u00fctzenberger","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marion","family":"Semmler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,8,22]]},"reference":[{"key":"17764_CR1","doi-asserted-by":"publisher","first-page":"S1","DOI":"10.1177\/0194599817751030","volume":"158","author":"RJ Stachler","year":"2018","unstructured":"Stachler, R. J. et al. Clinical practice guideline: Hoarseness (dysphonia)(update). Otolaryngol. Head Neck Surg. 158, S1\u2013S42 (2018).","journal-title":"Otolaryngol. Head Neck Surg."},{"key":"17764_CR2","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1159\/000111802","volume":"60","author":"DD Deliyski","year":"2008","unstructured":"Deliyski, D. D. et al. Clinical implementation of laryngeal high-speed videoendoscopy: Challenges and evolution. Folia Phoniatr. Logop. 60, 33\u201344 (2008).","journal-title":"Folia Phoniatr. Logop."},{"key":"17764_CR3","doi-asserted-by":"publisher","first-page":"981","DOI":"10.1002\/lary.20832","volume":"120","author":"M Kunduk","year":"2010","unstructured":"Kunduk, M., Doellinger, M., McWhorter, A. J. & Lohscheller, J. Assessment of the variability of vocal fold dynamics within and between recordings with high-speed imaging and by phonovibrogram. Laryngoscope 120, 981\u2013987 (2010).","journal-title":"Laryngoscope"},{"key":"17764_CR4","doi-asserted-by":"publisher","first-page":"1556","DOI":"10.3390\/app10051556","volume":"10","author":"G Andrade-Miranda","year":"2020","unstructured":"Andrade-Miranda, G., Stylianou, Y., Deliyski, D. D., Godino-Llorente, J. I. & Henrich Bernardoni, N. Laryngeal image processing of vocal folds motion. Appl. Sci. 10, 1556 (2020).","journal-title":"Appl. Sci."},{"key":"17764_CR5","doi-asserted-by":"publisher","first-page":"641","DOI":"10.1016\/j.specom.2011.07.010","volume":"54","author":"S-Z Karakozoglou","year":"2012","unstructured":"Karakozoglou, S.-Z., Henrich, N., d\u2019Alessandro, C. & Stylianou, Y. Automatic glottal segmentation using local-based active contours and application to glottovibrography. Speech Commun. 54, 641\u2013654 (2012).","journal-title":"Speech Commun."},{"key":"17764_CR6","doi-asserted-by":"crossref","unstructured":"Mendez, A., Garcia, B., Ruiz, I. & Iturricha, I. Glottal area segmentation without initialization using gabor filters. In 2008 IEEE International Symposium on Signal Processing and Information Technology, 18\u201322 (IEEE, 2008).","DOI":"10.1109\/ISSPIT.2008.4775678"},{"key":"17764_CR7","doi-asserted-by":"publisher","first-page":"795","DOI":"10.1109\/TBME.2014.2364862","volume":"62","author":"O Gloger","year":"2014","unstructured":"Gloger, O., Lehnert, B., Schrade, A. & V\u00f6lzke, H. Fully automated glottis segmentation in endoscopic videos using local color and shape features of glottal regions. IEEE Trans. Biomed. Eng. 62, 795\u2013806 (2014).","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"17764_CR8","doi-asserted-by":"publisher","first-page":"483","DOI":"10.1007\/s11548-018-01910-0","volume":"14","author":"M-H Laves","year":"2019","unstructured":"Laves, M.-H., Bicker, J., Kahrs, L. A. & Ortmaier, T. A dataset of laryngeal endoscopic images with comparative study on convolution neural network-based semantic segmentation. Int. J. Comput. Assist. Radiol. Surg. 14, 483\u2013492 (2019).","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"17764_CR9","doi-asserted-by":"publisher","first-page":"186","DOI":"10.1038\/s41597-020-0526-3","volume":"7","author":"P G\u00f3mez","year":"2020","unstructured":"G\u00f3mez, P. et al. Bagls, a multihospital benchmark for automatic glottis segmentation. Scientific Data 7, 186 (2020).","journal-title":"Scientific Data"},{"key":"17764_CR10","doi-asserted-by":"publisher","first-page":"139356","DOI":"10.1109\/ACCESS.2020.3012722","volume":"8","author":"AM Kist","year":"2020","unstructured":"Kist, A. M. & D\u00f6llinger, M. Efficient biomedical image segmentation on edgetpus at point of care. IEEE Access 8, 139356\u2013139366 (2020).","journal-title":"IEEE Access"},{"key":"17764_CR11","doi-asserted-by":"crossref","unstructured":"Cadario, R., Longoni, C. & Morewedge, C. K. Understanding, explaining, and utilizing medical artificial intelligence. Nat. Hum. Behav.1 (2021).","DOI":"10.31234\/osf.io\/4kwap"},{"key":"17764_CR12","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E. & Darrell, T. Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition, 3431\u20133440 (2015).","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"17764_CR13","doi-asserted-by":"publisher","first-page":"504","DOI":"10.1126\/science.1127647","volume":"313","author":"GE Hinton","year":"2006","unstructured":"Hinton, G. E. & Salakhutdinov, R. R. Reducing the dimensionality of data with neural networks. Science 313, 504\u2013507 (2006).","journal-title":"Science"},{"key":"17764_CR14","doi-asserted-by":"crossref","unstructured":"Shen, Y., Gu, J., Tang, X. & Zhou, B. Interpreting the latent space of gans for semantic face editing. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 9243\u20139252 (2020).","DOI":"10.1109\/CVPR42600.2020.00926"},{"key":"17764_CR15","unstructured":"Bojanowski, P., Joulin, A., Lopez-Paz, D. & Szlam, A. Optimizing the latent space of generative networks. arXiv preprint arXiv:1707.05776 (2017)."},{"key":"17764_CR16","doi-asserted-by":"crossref","unstructured":"Abdal, R., Qin, Y. & Wonka, P. Image2stylegan: How to embed images into the stylegan latent space? In Proceedings of the IEEE\/CVF International Conference on Computer Vision, 4432\u20134441 (2019).","DOI":"10.1109\/ICCV.2019.00453"},{"key":"17764_CR17","doi-asserted-by":"crossref","unstructured":"Abati, D., Porrello, A., Calderara, S. & Cucchiara, R. Latent space autoregression for novelty detection. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 481\u2013490 (2019).","DOI":"10.1109\/CVPR.2019.00057"},{"key":"17764_CR18","doi-asserted-by":"publisher","first-page":"80654","DOI":"10.1109\/ACCESS.2021.3085218","volume":"9","author":"D Saire","year":"2021","unstructured":"Saire, D. & Rivera, A. R. Empirical study of multi-task hourglass model for semantic segmentation task. IEEE Access 9, 80654\u201380670 (2021).","journal-title":"IEEE Access"},{"key":"17764_CR19","doi-asserted-by":"publisher","first-page":"20723","DOI":"10.1038\/s41598-020-77216-6","volume":"10","author":"AM Kist","year":"2020","unstructured":"Kist, A. M., Zilker, J., G\u00f3mez, P., Sch\u00fctzenberger, A. & D\u00f6llinger, M. Rethinking glottal midline detection. Sci. Rep. 10, 20723 (2020).","journal-title":"Sci. Rep."},{"key":"17764_CR20","doi-asserted-by":"publisher","first-page":"1889","DOI":"10.1044\/2021_JSLHR-20-00498","volume":"64","author":"AM Kist","year":"2021","unstructured":"Kist, A. M. et al. A deep learning enhanced novel software tool for laryngeal dynamics analysis. J. Speech Lang. Hear. Res. 64, 1889\u20131903 (2021).","journal-title":"J. Speech Lang. Hear. Res."},{"key":"17764_CR21","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P. & Brox, T. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention, 234\u2013241 (Springer, 2015).","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"17764_CR22","unstructured":"Kingma, D. P. & Ba, J. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"17764_CR23","unstructured":"Ioffe, S. & Szegedy, C. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In International conference on machine learning, 448\u2013456 (PMLR, 2015)."},{"key":"17764_CR24","unstructured":"Howard, A. G. et al. Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprintarXiv:1704.04861 (2017)."},{"key":"17764_CR25","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A. & Chen, L.-C. Mobilenetv2: Inverted residuals and linear bottlenecks. In Proceedings of the IEEE conference on computer vision and pattern recognition, 4510\u20134520 (2018).","DOI":"10.1109\/CVPR.2018.00474"},{"key":"17764_CR26","unstructured":"Krizhevsky, A. & Hinton, G. Convolutional deep belief networks on cifar-10. Unpublished manuscript40, 1\u20139 (2010)."},{"key":"17764_CR27","doi-asserted-by":"crossref","unstructured":"Milletari, F., Navab, N. & Ahmadi, S.-A. V-net: Fully convolutional neural networks for volumetric medical image segmentation. arXiv:1606.04797 [cs] (2016).","DOI":"10.1109\/3DV.2016.79"},{"key":"17764_CR28","doi-asserted-by":"crossref","unstructured":"Zhou, B., Khosla, A., Lapedriza, A., Oliva, A. & Torralba, A. Learning deep features for discriminative localization. In Proceedings of the IEEE conference on computer vision and pattern recognition, 2921\u20132929 (2016).","DOI":"10.1109\/CVPR.2016.319"},{"key":"17764_CR29","doi-asserted-by":"crossref","unstructured":"Selvaraju, R. R. et al. Grad-cam: Visual explanations from deep networks via gradient-based localization. In Proceedings of the IEEE international conference on computer vision, 618\u2013626 (2017).","DOI":"10.1109\/ICCV.2017.74"},{"key":"17764_CR30","doi-asserted-by":"crossref","unstructured":"Vinogradova, K., Dibrov, A. & Myers, G. Towards interpretable semantic segmentation via gradient-weighted class activation mapping (student abstract). In Proceedings of the AAAI conference on artificial intelligence vol. 34, 13943\u201313944 (2020).","DOI":"10.1609\/aaai.v34i10.7244"},{"key":"17764_CR31","first-page":"547","volume":"37","author":"P Jaccard","year":"1901","unstructured":"Jaccard, P. \u00c9tude comparative de la distribution florale dans une portion des alpes et des jura. Bull. Soc. Vaudoise Sci. Nat. 37, 547\u2013579 (1901).","journal-title":"Bull. Soc. Vaudoise Sci. Nat."},{"key":"17764_CR32","doi-asserted-by":"publisher","first-page":"2117","DOI":"10.1097\/00005537-200012000-00028","volume":"110","author":"H Larsson","year":"2000","unstructured":"Larsson, H., Herteg\u00e5rd, S., Lindestad, P. -\u00c5. & Hammarberg, B. Vocal fold vibrations: High-speed imaging, kymography, and acoustic analysis: A preliminary report. Laryngoscope 110, 2117\u20132122 (2000).","journal-title":"Laryngoscope"},{"key":"17764_CR33","doi-asserted-by":"publisher","first-page":"e745","DOI":"10.1016\/S2589-7500(21)00208-9","volume":"3","author":"M Ghassemi","year":"2021","unstructured":"Ghassemi, M., Oakden-Rayner, L. & Beam, A. L. The false hope of current approaches to explainable artificial intelligence in health care. Lancet Digit. Health 3, e745\u2013e750 (2021).","journal-title":"Lancet Digit. Health"},{"key":"17764_CR34","first-page":"e1424","volume":"11","author":"PP Angelov","year":"2021","unstructured":"Angelov, P. P., Soares, E. A., Jiang, R., Arnold, N. I. & Atkinson, P. M. Explainable artificial intelligence: An analytical review. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 11, e1424 (2021).","journal-title":"Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery"},{"key":"17764_CR35","doi-asserted-by":"crossref","unstructured":"Fragemann, J., Ardizzone, L., Egger, J. & Kleesiek, J. Review of disentanglement approaches for medical applications\u2013towards solving the gordian knot of generative models in healthcare. arXiv preprint arXiv:2203.11132 (2022).","DOI":"10.36227\/techrxiv.19364897"},{"key":"17764_CR36","unstructured":"Higgins, I. et al. beta-vae: Learning basic visual concepts with a constrained variational framework. In 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings (OpenReview.net, 2017)."},{"key":"17764_CR37","unstructured":"Kohl, S. et al. A probabilistic u-net for segmentation of ambiguous images. Advances in neural information processing systems 31 (2018)."},{"key":"17764_CR38","doi-asserted-by":"publisher","first-page":"1856","DOI":"10.1109\/TMI.2019.2959609","volume":"39","author":"Z Zhou","year":"2019","unstructured":"Zhou, Z., Siddiquee, M. M. R., Tajbakhsh, N. & Liang, J. Unet++: Redesigning skip connections to exploit multiscale features in image segmentation. IEEE Trans. Med. Imaging 39, 1856\u20131867 (2019).","journal-title":"IEEE Trans. Med. Imaging"},{"key":"17764_CR39","doi-asserted-by":"publisher","first-page":"400","DOI":"10.1016\/j.media.2007.04.005","volume":"11","author":"J Lohscheller","year":"2007","unstructured":"Lohscheller, J., Toy, H., Rosanowski, F., Eysholdt, U. & D\u00f6llinger, M. Clinically evaluated procedure for the reconstruction of vocal fold vibrations from endoscopic digital high-speed videos. Med. Image Anal. 11, 400\u2013413 (2007).","journal-title":"Med. Image Anal."},{"key":"17764_CR40","doi-asserted-by":"publisher","first-page":"E219","DOI":"10.1002\/lary.28669","volume":"131","author":"N Adamian","year":"2021","unstructured":"Adamian, N., Naunheim, M. R. & Jowett, N. An open-source computer vision tool for automated vocal fold tracking from videoendoscopy. Laryngoscope 131, E219\u2013E225 (2021).","journal-title":"Laryngoscope"},{"key":"17764_CR41","doi-asserted-by":"publisher","first-page":"e0227791","DOI":"10.1371\/journal.pone.0227791","volume":"15","author":"MK Fehling","year":"2020","unstructured":"Fehling, M. K., Grosch, F., Schuster, M. E., Schick, B. & Lohscheller, J. Fully automatic segmentation of glottis and vocal folds in endoscopic laryngeal high-speed videos using a deep convolutional lstm network. PLoS ONE 15, e0227791 (2020).","journal-title":"PLoS ONE"},{"key":"17764_CR42","unstructured":"Xingjian, S. et al. Convolutional lstm network: A machine learning approach for precipitation nowcasting. In Advances in neural information processing systems, 802\u2013810 (2015)."},{"key":"17764_CR43","doi-asserted-by":"publisher","first-page":"967","DOI":"10.1007\/s11548-021-02340-1","volume":"16","author":"W Fu","year":"2021","unstructured":"Fu, W., Breininger, K., Schaffert, R., Pan, Z. & Maier, A. keep it simple, scholar: An experimental analysis of few-parameter segmentation networks for retinal vessels in fundus imaging. Int. J. Comput. Assist. Radiol. Surg. 16, 967\u2013978 (2021).","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"17764_CR44","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, 770\u2013778 (2016).","DOI":"10.1109\/CVPR.2016.90"},{"key":"17764_CR45","unstructured":"Tan, M. & Le, Q. Efficientnet: Rethinking model scaling for convolutional neural networks. In International Conference on Machine Learning, 6105\u20136114 (PMLR, 2019)."},{"key":"17764_CR46","doi-asserted-by":"publisher","first-page":"13760","DOI":"10.1038\/s41598-021-93149-0","volume":"11","author":"AM Kist","year":"2021","unstructured":"Kist, A. M., D\u00fcrr, S., Sch\u00fctzenberger, A. & D\u00f6llinger, M. Openhsv: An open platform for laryngeal high-speed videoendoscopy. Sci. Rep. 11, 13760 (2021).","journal-title":"Sci. Rep."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-022-17764-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-022-17764-1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-022-17764-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,25]],"date-time":"2022-11-25T07:28:28Z","timestamp":1669361308000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-022-17764-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,22]]},"references-count":46,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["17764"],"URL":"https:\/\/doi.org\/10.1038\/s41598-022-17764-1","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,22]]},"assertion":[{"value":"1 April 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 July 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 August 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"14292"}}