{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,17]],"date-time":"2026-11-17T20:30:42Z","timestamp":1794947442254,"version":"4.9.1"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,1,8]],"date-time":"2021-01-08T00:00:00Z","timestamp":1610064000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,1,8]],"date-time":"2021-01-08T00:00:00Z","timestamp":1610064000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Middle- and inner-ear surgery is a vital treatment option in hearing loss, infections, and tumors of the lateral skull base. Segmentation of otologic structures from computed tomography (CT) has many potential applications for improving surgical planning but can be an arduous and time-consuming task. We propose an end-to-end solution for the automated segmentation of temporal bone CT using convolutional neural networks (CNN). Using 150 manually segmented CT scans, a comparison of 3 CNN models (AH-Net, U-Net, ResNet) was conducted to compare Dice coefficient, Hausdorff distance, and speed of segmentation of the inner ear, ossicles, facial nerve and sigmoid sinus. Using AH-Net, the Dice coefficient was 0.91 for the inner ear; 0.85 for the ossicles; 0.75 for the facial nerve; and 0.86 for the sigmoid sinus. The average Hausdorff distance was 0.25, 0.21, 0.24 and 0.45\u00a0mm, respectively. Blinded experts assessed the accuracy of both techniques, and there was no statistical difference between the ratings for the two methods (p\u2009=\u20090.93). Objective and subjective assessment confirm good correlation between automated segmentation of otologic structures and manual segmentation performed by a specialist. This end-to-end automated segmentation pipeline can help to advance the systematic application of augmented reality, simulation, and automation in otologic procedures.<\/jats:p>","DOI":"10.1038\/s41598-020-80619-0","type":"journal-article","created":{"date-parts":[[2021,1,8]],"date-time":"2021-01-08T11:13:01Z","timestamp":1610104381000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":74,"title":["Fully automated preoperative segmentation of temporal bone structures from clinical CT scans"],"prefix":"10.1038","volume":"11","author":[{"given":"C. A.","family":"Neves","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"E. D.","family":"Tran","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"I. M.","family":"Kessler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"N. H.","family":"Blevins","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,1,8]]},"reference":[{"key":"80619_CR1","doi-asserted-by":"publisher","first-page":"1307","DOI":"10.1097\/MAO.0000000000001189","volume":"37","author":"J Meng","year":"2016","unstructured":"Meng, J., Li, S., Zhang, F., Li, Q. & Qin, Z. Cochlear size and shape variability and implications in cochlear implantation surgery. Otol. Neurotol. 37, 1307\u20131313 (2016).","journal-title":"Otol. Neurotol."},{"key":"80619_CR2","doi-asserted-by":"publisher","first-page":"1142","DOI":"10.1177\/0194599817691474","volume":"156","author":"GD Locketz","year":"2017","unstructured":"Locketz, G. D. et al. Anatomy-specific virtual reality simulation in temporal bone dissection: Perceived utility and impact on surgeon confidence. Otolaryngol. Neck Surg. 156, 1142\u20131149 (2017).","journal-title":"Otolaryngol. Neck Surg."},{"key":"80619_CR3","doi-asserted-by":"publisher","first-page":"2473974","DOI":"10.1177\/2473974X18804492","volume":"2","author":"SR Barber","year":"2018","unstructured":"Barber, S. R. et al. Augmented reality, surgical navigation, and 3D printing for transcanal endoscopic approach to the petrous apex. OTO Open 2, 2473974 (2018).","journal-title":"OTO Open"},{"key":"80619_CR4","doi-asserted-by":"publisher","first-page":"920","DOI":"10.1002\/alr.22546","volume":"10","author":"CA Neves","year":"2020","unstructured":"Neves, C. A. et al. Application of holographic augmented reality for external approaches to the frontal sinus. Int. Forum Allergy Rhinol. 10, 920\u2013925 (2020).","journal-title":"Int. Forum Allergy Rhinol."},{"key":"80619_CR5","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1007\/s11548-019-02091-0","volume":"15","author":"BM Gare","year":"2020","unstructured":"Gare, B. M. et al. Multi-atlas segmentation of the facial nerve from clinical CT for virtual reality simulators. Int. J. Comput. Assist. Radiol. Surg. 15, 259\u2013267 (2020).","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"80619_CR6","doi-asserted-by":"publisher","first-page":"910","DOI":"10.1002\/alr.22333","volume":"9","author":"T-B Won","year":"2019","unstructured":"Won, T.-B. et al. Validation of a rhinologic virtual surgical simulator for performing a Draf 3 endoscopic frontal sinusotomy. Int. Forum Allergy Rhinol. 9, 910\u2013917 (2019).","journal-title":"Int. Forum Allergy Rhinol."},{"key":"80619_CR7","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1080\/24699322.2016.1189966","volume":"21","author":"S Chan","year":"2016","unstructured":"Chan, S., Li, P., Locketz, G., Salisbury, K. & Blevins, N. H. High-fidelity haptic and visual rendering for patient-specific simulation of temporal bone surgery. Comput. Assist. Surg. 21, 85\u2013101 (2016).","journal-title":"Comput. Assist. Surg."},{"key":"80619_CR8","doi-asserted-by":"crossref","first-page":"1150","DOI":"10.1288\/00005537-199310000-00013","volume":"103","author":"S Nakashima","year":"1993","unstructured":"Nakashima, S., Sando, I., Takahashi, H. & Fujita, S. Computer-aided 3-D reconstruction and measurement of the facial canal and facial nerve. I. Cross-sectional area and diameter: Preliminary report. Laryngoscope 103, 1150\u20131156 (1993).","journal-title":"Laryngoscope"},{"key":"80619_CR9","doi-asserted-by":"publisher","first-page":"5375","DOI":"10.1118\/1.3005479","volume":"35","author":"JH Noble","year":"2008","unstructured":"Noble, J. H., Warren, F. M., Labadie, R. F. & Dawant, B. M. Automatic segmentation of the facial nerve and chorda tympani in CT images using spatially dependent feature values. Med. Phys. 35, 5375\u20135384 (2008).","journal-title":"Med. Phys."},{"key":"80619_CR10","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1097\/MAO.0b013e31819e61ed","volume":"30","author":"JH Noble","year":"2009","unstructured":"Noble, J. H., Dawant, B. M., Warren, F. M. & Labadie, R. F. Automatic identification and 3D rendering of temporal bone anatomy. Otol. Neurotol. 30, 436\u2013442 (2009).","journal-title":"Otol. Neurotol."},{"key":"80619_CR11","doi-asserted-by":"publisher","first-page":"2625","DOI":"10.1109\/TBME.2011.2160262","volume":"58","author":"JH Noble","year":"2011","unstructured":"Noble, J. H., Labadie, R. F., Majdani, O. & Dawant, B. M. Automatic segmentation of intracochlear anatomy in conventional CT. IEEE Trans. Biomed. Eng. 58, 2625\u20132632 (2011).","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"80619_CR12","doi-asserted-by":"publisher","first-page":"1267","DOI":"10.1007\/s11548-019-01978-2","volume":"14","author":"KA Powell","year":"2019","unstructured":"Powell, K. A. et al. Atlas-based segmentation of temporal bone surface structures. Int. J. Comput. Assist. Radiol. Surg. 14, 1267\u20131273 (2019).","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"80619_CR13","doi-asserted-by":"publisher","first-page":"e378","DOI":"10.1097\/MAO.0000000000002552","volume":"41","author":"TJ Hudson","year":"2020","unstructured":"Hudson, T. J., Gare, B., Allen, D. G., Ladak, H. M. & Agrawal, S. K. Intrinsic measures and shape analysis of the intratemporal facial nerve. Otol. Neurotol. 41, e378\u2013e386 (2020).","journal-title":"Otol. Neurotol."},{"key":"80619_CR14","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1007\/s11548-016-1467-3","volume":"12","author":"F Lu","year":"2017","unstructured":"Lu, F., Wu, F., Hu, P., Peng, Z. & Kong, D. Automatic 3D liver location and segmentation via convolutional neural network and graph cut. Int. J. Comput. Assist. Radiol. Surg. 12, 171\u2013182 (2017).","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"80619_CR15","doi-asserted-by":"publisher","DOI":"10.1007\/s11548-019-01937-x","author":"J Fauser","year":"2019","unstructured":"Fauser, J. et al. Toward an automatic preoperative pipeline for image-guided temporal bone surgery. Int. J. Comput. Assist. Radiol. Surg. https:\/\/doi.org\/10.1007\/s11548-019-01937-x (2019).","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"80619_CR16","doi-asserted-by":"publisher","first-page":"1449","DOI":"10.3389\/fnins.2019.01449","volume":"13","author":"P-Y Kao","year":"2019","unstructured":"Kao, P.-Y. et al. Improving patch-based convolutional neural networks for MRI brain tumor segmentation by leveraging location information. Front. Neurosci. 13, 1449 (2019).","journal-title":"Front. Neurosci."},{"key":"80619_CR17","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1007\/s10916-019-1358-6","volume":"43","author":"J Sun","year":"2019","unstructured":"Sun, J., Chen, W., Peng, S. & Liu, B. DRRNet: Dense residual refine networks for automatic brain tumor segmentation. J. Med. Syst. 43, 221 (2019).","journal-title":"J. Med. Syst."},{"key":"80619_CR18","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12880-019-0399-0","volume":"20","author":"X Hu","year":"2020","unstructured":"Hu, X. et al. Brain SegNet: 3D local refinement network for brain lesion segmentation. BMC Med. Imaging 20, 1\u201310 (2020).","journal-title":"BMC Med. Imaging"},{"key":"80619_CR19","unstructured":"Clara Training Framework\u2014Clara Train SDK v2.0 documentation. https:\/\/docs.nvidia.com\/clara\/tlt-mi\/clara-train-sdk-v2.0\/index.html (2019)."},{"key":"80619_CR20","unstructured":"Sachidanand, A., Lasso, A., Hsieh, Y.-T. & Pieper, S. Nvidia AI-assisted annotation (AIAA) for 3D Slicer. https:\/\/github.com\/NVIDIA\/ai-assisted-annotation-client\/blob\/master\/slicer-plugin\/README.md (2019)."},{"key":"80619_CR21","doi-asserted-by":"crossref","unstructured":"Zhu, W. et al. Neural Multi-Scale Self-Supervised Registration for Echocardiogram Dense Tracking. (2019).","DOI":"10.1101\/674630"},{"key":"80619_CR22","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. 2016, 770\u2013778 (2016).","DOI":"10.1109\/CVPR.2016.90"},{"key":"80619_CR23","doi-asserted-by":"publisher","first-page":"e0146996","DOI":"10.1371\/journal.pone.0146996","volume":"11","author":"L Li","year":"2016","unstructured":"Li, L. et al. A novel augmented reality navigation system for endoscopic sinus and skull base surgery: A feasibility study. PLoS ONE 11, e0146996 (2016).","journal-title":"PLoS ONE"},{"key":"80619_CR24","doi-asserted-by":"publisher","first-page":"105387","DOI":"10.1016\/j.cmpb.2020.105387","volume":"191","author":"F Heutink","year":"2020","unstructured":"Heutink, F. et al. Multi-Scale deep learning framework for cochlea localization, segmentation and analysis on clinical ultra-high-resolution CT images. Comput. Methods Programs Biomed. 191, 105387 (2020).","journal-title":"Comput. Methods Programs Biomed."},{"key":"80619_CR25","doi-asserted-by":"crossref","unstructured":"Liu, S. et al. 3D anisotropic hybrid network: Transferring convolutional features from 2D images to 3D anisotropic volumes. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) vol. 11071 LNCS (Springer International Publishing, New York, 2018).","DOI":"10.1007\/978-3-030-00934-2_94"},{"key":"80619_CR26","doi-asserted-by":"publisher","first-page":"101659","DOI":"10.1016\/j.media.2020.101659","volume":"61","author":"D Zhang","year":"2020","unstructured":"Zhang, D., Wang, J., Noble, J. H. & Dawant, B. M. HeadLocNet: Deep convolutional neural networks for accurate classification and multi-landmark localization of head CTs. Med. Image Anal. 61, 101659 (2020).","journal-title":"Med. Image Anal."},{"key":"80619_CR27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.media.2017.11.005","volume":"44","author":"M Drozdzal","year":"2018","unstructured":"Drozdzal, M. et al. Learning normalized inputs for iterative estimation in medical image segmentation. Med. Image Anal. 44, 1\u201313 (2018).","journal-title":"Med. Image Anal."},{"key":"80619_CR28","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1016\/j.neunet.2020.01.005","volume":"124","author":"X Li","year":"2020","unstructured":"Li, X. et al. A 3D deep supervised densely network for small organs of human temporal bone segmentation in CT images. Neural Netw. 124, 75\u201385 (2020).","journal-title":"Neural Netw."},{"key":"80619_CR29","doi-asserted-by":"crossref","unstructured":"Dubuisson, M., Jain, A. K., & Lansing, E. A modified Hausdorff distance for object matching cor-1 Introduction two point sets A and B can be combined in the follow-2 Distance Between Point Sets Research supported by a. Proc. 12th Int. Conf. Pattern Recognit. 566\u2013568 (1994).","DOI":"10.1109\/ICPR.1994.576361"},{"key":"80619_CR30","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1002\/alr.22037","volume":"8","author":"T-B Won","year":"2018","unstructured":"Won, T.-B. et al. Early experience with a patient-specific virtual surgical simulation for rehearsal of endoscopic skull-base surgery. Int. Forum Allergy Rhinol. 8, 54\u201363 (2018).","journal-title":"Int. Forum Allergy Rhinol."},{"key":"80619_CR31","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1186\/s40463-019-0324-0","volume":"48","author":"K Van Osch","year":"2019","unstructured":"Van Osch, K. et al. Morphological analysis of sigmoid sinus anatomy: Clinical applications to neurotological surgery. J. Otolaryngol. Head Neck Surg. 48, 2 (2019).","journal-title":"J. Otolaryngol. Head Neck Surg."},{"key":"80619_CR32","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1258\/0022215011908135","volume":"115","author":"A Aslan","year":"2001","unstructured":"Aslan, A., Goktan, C., Okumus, M., Tarhan, S. & Unlu, H. Morphometric analysis of anatomical relationships of the facial nerve for mastoid surgery. J. Laryngol. Otol. 115, 447\u2013449 (2001).","journal-title":"J. Laryngol. Otol."},{"key":"80619_CR33","doi-asserted-by":"publisher","first-page":"e311","DOI":"10.1055\/s-0039-1688455","volume":"23","author":"A Singh","year":"2019","unstructured":"Singh, A., Irugu, D. V. K., Sikka, K., Verma, H. & Thakar, A. Study of sigmoid sinus variations in the temporal bone by micro dissection and its classification: A cadaveric study. Int. Arch. Otorhinolaryngol. 23, e311\u2013e316 (2019).","journal-title":"Int. Arch. Otorhinolaryngol."},{"key":"80619_CR34","doi-asserted-by":"publisher","first-page":"1323","DOI":"10.1016\/j.mri.2012.05.001","volume":"30","author":"A Fedorov","year":"2012","unstructured":"Fedorov, A. et al. 3D Slicer as an image computing platform for the quantitative imaging network. Magn. Reson. Imaging 30, 1323\u20131341 (2012).","journal-title":"Magn. Reson. Imaging"},{"key":"80619_CR35","unstructured":"Kingma, D. P. & Ba, J. L. Adam: A method for stochastic optimization. 3rd Int. Conf. Learn. Represent. ICLR 2015 Conf. Track Proc. 1\u201315 (2015)."},{"key":"80619_CR36","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P. & Brox, T. U-net: Convolutional networks for biomedical image segmentation. Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics) 9351, 234\u2013241 (2015).","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"80619_CR37","doi-asserted-by":"crossref","unstructured":"\u00c7i\u00e7ek, \u00d6., Abdulkadir, A., Lienkamp, S. S., Brox, T. & Ronneberger, O. 3D U-net: Learning dense volumetric segmentation from sparse annotation. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) vol. 9901 LNCS 424\u2013432 (2016).","DOI":"10.1007\/978-3-319-46723-8_49"},{"key":"80619_CR38","unstructured":"Neves, C. A. Temporal bone auto-segmentation module for 3D Slicer. https:\/\/github.com\/caioath\/Auto-segmentation\/blob\/master\/temporal_bone_slicer_module.py (2020)."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-80619-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-80619-0","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-80619-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,22]],"date-time":"2024-08-22T02:32:39Z","timestamp":1724293959000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-020-80619-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,8]]},"references-count":38,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["80619"],"URL":"https:\/\/doi.org\/10.1038\/s41598-020-80619-0","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,8]]},"assertion":[{"value":"27 May 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 December 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 January 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"116"}}