{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T04:03:52Z","timestamp":1791432232450,"version":"4.3.3"},"reference-count":32,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2024,12,25]],"date-time":"2024-12-25T00:00:00Z","timestamp":1735084800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&amp;D Program of China","doi-asserted-by":"publisher","award":["2022YFC2504100"],"award-info":[{"award-number":["2022YFC2504100"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key R&amp;D Program of China","doi-asserted-by":"publisher","award":["23ZR1458000"],"award-info":[{"award-number":["23ZR1458000"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key R&amp;D Program of China","doi-asserted-by":"publisher","award":["SHDC12024126"],"award-info":[{"award-number":["SHDC12024126"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key R&amp;D Program of China","doi-asserted-by":"publisher","award":["ZHYY-ZXYJHZX-202118"],"award-info":[{"award-number":["ZHYY-ZXYJHZX-202118"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Science Foundation of Shanghai","award":["2022YFC2504100"],"award-info":[{"award-number":["2022YFC2504100"]}]},{"name":"National Science Foundation of Shanghai","award":["23ZR1458000"],"award-info":[{"award-number":["23ZR1458000"]}]},{"name":"National Science Foundation of Shanghai","award":["SHDC12024126"],"award-info":[{"award-number":["SHDC12024126"]}]},{"name":"National Science Foundation of Shanghai","award":["ZHYY-ZXYJHZX-202118"],"award-info":[{"award-number":["ZHYY-ZXYJHZX-202118"]}]},{"name":"Shanghai Hospital Development Center foundation","award":["2022YFC2504100"],"award-info":[{"award-number":["2022YFC2504100"]}]},{"name":"Shanghai Hospital Development Center foundation","award":["23ZR1458000"],"award-info":[{"award-number":["23ZR1458000"]}]},{"name":"Shanghai Hospital Development Center foundation","award":["SHDC12024126"],"award-info":[{"award-number":["SHDC12024126"]}]},{"name":"Shanghai Hospital Development Center foundation","award":["ZHYY-ZXYJHZX-202118"],"award-info":[{"award-number":["ZHYY-ZXYJHZX-202118"]}]},{"name":"Shanghai General Hospital Integrated Traditional Chinese and Western Medicine","award":["2022YFC2504100"],"award-info":[{"award-number":["2022YFC2504100"]}]},{"name":"Shanghai General Hospital Integrated Traditional Chinese and Western Medicine","award":["23ZR1458000"],"award-info":[{"award-number":["23ZR1458000"]}]},{"name":"Shanghai General Hospital Integrated Traditional Chinese and Western Medicine","award":["SHDC12024126"],"award-info":[{"award-number":["SHDC12024126"]}]},{"name":"Shanghai General Hospital Integrated Traditional Chinese and Western Medicine","award":["ZHYY-ZXYJHZX-202118"],"award-info":[{"award-number":["ZHYY-ZXYJHZX-202118"]}]},{"name":"Shanghai Oriental Talent Programme","award":["2022YFC2504100"],"award-info":[{"award-number":["2022YFC2504100"]}]},{"name":"Shanghai Oriental Talent Programme","award":["23ZR1458000"],"award-info":[{"award-number":["23ZR1458000"]}]},{"name":"Shanghai Oriental Talent Programme","award":["SHDC12024126"],"award-info":[{"award-number":["SHDC12024126"]}]},{"name":"Shanghai Oriental Talent Programme","award":["ZHYY-ZXYJHZX-202118"],"award-info":[{"award-number":["ZHYY-ZXYJHZX-202118"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Bioengineering"],"abstract":"<jats:p>Objective: We aim to construct an artificial intelligence (AI)-assisted nasal endoscopy diagnostic system capable of preliminary differentiation and identification of nasal neoplasia properties, as well as intraoperative tracking, providing an important basis for nasal endoscopic surgery. Methods: We retrospectively analyzed 1050 video data of nasal endoscopic surgeries involving four types of nasal neoplasms. Using Deep Snake, U-Net, and Att-Res2-UNet, we developed a nasal neoplastic detection network based on endoscopic images. After deep learning, the optimal network was selected as the initialization model and trained to optimize the SiamMask online tracking algorithm. Results: The Att-Res2-UNet network demonstrated the highest accuracy and precision, with the most accurate recognition results. The overall accuracy of the model established by us achieved an overall accuracy similar to that of residents (0.9707 \u00b1 0.00984), while slightly lower than that of rhinologists (0.9790 \u00b1 0.00348). SiamMask\u2019s segmentation range was consistent with rhinologists, with a 99% compliance rate and a neoplasm probability value \u2265 0.5. Conclusions: This study successfully established an AI-assisted nasal endoscopic diagnostic system that can preliminarily identify nasal neoplasms from endoscopic images and automatically track them in real time during surgery, enhancing the efficiency of endoscopic diagnosis and surgery.<\/jats:p>","DOI":"10.3390\/bioengineering12010010","type":"journal-article","created":{"date-parts":[[2024,12,25]],"date-time":"2024-12-25T19:19:32Z","timestamp":1735154372000},"page":"10","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Neoplasms in the Nasal Cavity Identified and Tracked with an Artificial Intelligence-Assisted Nasal Endoscopic Diagnostic System"],"prefix":"10.3390","volume":"12","author":[{"given":"Xiayue","family":"Xu","sequence":"first","affiliation":[{"name":"Department of Otolaryngology and Neck Surgery, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China"},{"name":"Department of Allergy, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Boxiang","family":"Yun","sequence":"additional","affiliation":[{"name":"Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University, Shanghai 200241, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yumin","family":"Zhao","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology and Neck Surgery, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China"},{"name":"Department of Allergy, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ling","family":"Jin","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology and Neck Surgery, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China"},{"name":"Department of Allergy, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yanning","family":"Zong","sequence":"additional","affiliation":[{"name":"Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University, Shanghai 200241, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guanzhen","family":"Yu","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology and Neck Surgery, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China"},{"name":"Laboratory of Digital Health and Artificial Intelligence, Zhejiang Digital Content Research Institute, Shaoxing 312000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chuanliang","family":"Zhao","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology and Neck Surgery, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China"},{"name":"Department of Allergy, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kai","family":"Fan","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology and Neck Surgery, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China"},{"name":"Department of Allergy, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaolin","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology and Neck Surgery, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China"},{"name":"Department of Allergy, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shiwang","family":"Tan","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology and Neck Surgery, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China"},{"name":"Department of Allergy, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zimu","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology and Neck Surgery, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China"},{"name":"Department of Allergy, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yan","family":"Wang","sequence":"additional","affiliation":[{"name":"Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University, Shanghai 200241, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5063-8801","authenticated-orcid":false,"given":"Qingli","family":"Li","sequence":"additional","affiliation":[{"name":"Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University, Shanghai 200241, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2208-4535","authenticated-orcid":false,"given":"Shaoqing","family":"Yu","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology and Neck Surgery, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China"},{"name":"Department of Allergy, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,12,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1637","DOI":"10.1002\/alr.22854","article-title":"Feasibility of a deep learning-based algorithm for automated detection and classification of nasal polyps and inverted papillomas on nasal endoscopic images","volume":"11","author":"Girdler","year":"2021","journal-title":"Int. Forum Allergy Rhinol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"744","DOI":"10.1093\/annonc\/mdz084","article-title":"Head and neck cancer prevention: From primary prevention to impact of clinicians on reducing burden","volume":"30","author":"Hashim","year":"2019","journal-title":"Ann Oncol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.4193\/Rhin20.401","article-title":"European Position Paper on Rhinosinusitis and Nasal Polyps 2020","volume":"58","author":"Fokkens","year":"2020","journal-title":"Rhinology"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"e253","DOI":"10.1016\/S1470-2045(19)30154-8","article-title":"Digital pathology and artificial intelligence","volume":"20","author":"Niazi","year":"2019","journal-title":"Lancet Oncol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1016\/j.ebiom.2019.08.075","article-title":"Computer-aided diagnosis of laryngeal cancer via deep learning based on laryngoscopic images","volume":"48","author":"Xiong","year":"2019","journal-title":"Ebiomedicine"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"e051403","DOI":"10.1136\/bmjopen-2021-051403","article-title":"Predicting hospitalisations related to ambulatory care sensitive conditions with machine learning for population health planning: Derivation and validation cohort study","volume":"12","author":"Yi","year":"2022","journal-title":"BMJ Open"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zhao, A., Sunny, A.I., Li, L., and Wang, T. (2022). Machine Learning-Based Structural Health Monitoring Using RFID for Harsh Environmental Conditions. Electronics, 11.","DOI":"10.3390\/electronics11111740"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"102470","DOI":"10.1016\/j.media.2022.102470","article-title":"Explainable artificial intelligence (XAI) in deep learning-based medical image analysis","volume":"79","author":"Kuijf","year":"2022","journal-title":"Med. Image Anal."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Venkatesh, G.M., Naresh, Y.G., Little, S., and O\u2019Connor, N.E. (2018). A Deep Residual Architecture for Skin Lesion Segmentation, Springer. Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-030-01201-4_30"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zunair, H., and Ben Hamza, A. (2021). Sharp U-Net: Depthwise convolutional network for biomedical image segmentation. Comput. Biol. Med., 136.","DOI":"10.1016\/j.compbiomed.2021.104699"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Wang, Q., Zhang, L., Bertinetto, L., Hu, W., and Torr, P.H. (2019, January 15\u201320). Fast Online Object Tracking and Segmentation: A Unifying Approach. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00142"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"E686","DOI":"10.1002\/lary.28539","article-title":"Automatic Recognition of Laryngoscopic Images Using a Deep-Learning Technique","volume":"130","author":"Ren","year":"2020","journal-title":"Laryngoscope"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"698","DOI":"10.1016\/j.jaci.2019.12.002","article-title":"Expert-level diagnosis of nasal polyps using deep learning on whole-slide imaging","volume":"145","author":"Wu","year":"2020","journal-title":"J. Allergy Clin. Immunol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3754","DOI":"10.1007\/s00464-020-07585-6","article-title":"Diagnostic value of contrast-enhanced harmonic endoscopic ultrasonography in predicting the malignancy potential of submucosal tumours: A systematic review and meta-analysis","volume":"34","author":"Yang","year":"2020","journal-title":"Surg. Endosc."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2700","DOI":"10.1177\/14759217211069842","article-title":"Non-parametric empirical machine learning for short-term and long-term structural health monitoring","volume":"21","author":"Entezami","year":"2022","journal-title":"Struct. Health Monit."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"e32903","DOI":"10.2196\/32903","article-title":"Strategies to Address the Lack of Labeled Data for Supervised Machine Learning Training With Electronic Health Records: Case Study for the Extraction of Symptoms From Clinical Notes","volume":"10","author":"Mukherjee","year":"2022","journal-title":"JMIR Med. Inform."},{"key":"ref_18","first-page":"234","article-title":"U-Net: Convolutional Networks for Biomedical Image Segmentation","volume":"Volume 9351","author":"Ronneberger","year":"2015","journal-title":"Medical Image Computing and Computer-Assisted Intervention, Proceedings of the 18th International Conference, Munich, Germany, 5\u20139 October 2015"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"S71","DOI":"10.1080\/0284186X.2019.1581372","article-title":"Screening individuals\u2019 experiences of colonoscopy and colon capsule endoscopy; a mixed methods study","volume":"58","author":"Thygesen","year":"2019","journal-title":"Acta Oncol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"e33182","DOI":"10.2196\/33182","article-title":"Machine Learning-Based Short-Term Mortality Prediction Models for Patients With Cancer Using Electronic Health Record Data: Systematic Review and Critical Appraisal","volume":"10","author":"Lu","year":"2022","journal-title":"JMIR Med. Inform."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"102444","DOI":"10.1016\/j.media.2022.102444","article-title":"Recent advances and clinical applications of deep learning in medical image analysis","volume":"79","author":"Chen","year":"2022","journal-title":"Med. Image Anal."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Carneiro, G., Tavares, J.M.R., Bradley, A.P., Papa, J.P., Belagiannis, V., Nascimento, J.C., and Lu, Z. (2020). Special issue: 4th MICCAI workshop on deep learning in medical image analysis. Comput. Methods Biomech. Biomed. Eng. Imaging Vis., 8.","DOI":"10.1080\/21681163.2020.1847815"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Jeric\u00f3, C., Zalba-Marcos, S., Quintana-D\u00edaz, M., L\u00f3pez-Villar, O., Santolalla-Arnedo, I., Abad-Motos, A., Lco-Morales, M.J., Sancho, E., Subira, M., and Bassas, E. (2022). Relationship between ABO Blood Group Distribution and COVID-19 Infection in Patients Admitted to the ICU: A Multicenter Observational Spanish Study. J. Clin. Med., 11.","DOI":"10.3390\/jcm11113042"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Apostolidis, K.D., and Papakostas, G.A. (2021). A Survey on Adversarial Deep Learning Robustness in Medical Image Analysis. Electronics, 10.","DOI":"10.3390\/electronics10172132"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1017\/S0022215120000444","article-title":"An artificial intelligence algorithm that identifies middle turbinate pneumatisation (concha bullosa) on sinus computed tomography scans","volume":"134","author":"Parmar","year":"2020","journal-title":"J. Laryngol. Otol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1002\/alr.22196","article-title":"Automated classification of osteomeatal complex inflammation on computed tomography using convolutional neural networks","volume":"9","author":"Chowdhury","year":"2019","journal-title":"Int. Forum Allergy Rhinol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1170","DOI":"10.1177\/0003489419863822","article-title":"Unsupervised Learning Techniques for the Investigation of Chronic Rhinosinusitis","volume":"128","author":"Walker","year":"2019","journal-title":"Ann. Otol. Rhinol. Laryngol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"4905","DOI":"10.1109\/TIP.2021.3077135","article-title":"SRGAT: Single Image Super-Resolution With Graph Attention Network","volume":"30","author":"Yan","year":"2021","journal-title":"IEEE Trans Image Process."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Akbar, K., Zou, Y., Awais, Q., Baig, M.J.A., and Jamil, M. (2022). A Machine Learning-Based Robust State of Health (SOH) Prediction Model for Electric Vehicle Batteries. Electronics, 11.","DOI":"10.3390\/electronics11081216"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"E302","DOI":"10.1093\/ons\/opab187","article-title":"Machine Vision for Real-Time Intraoperative Anatomic Guidance: A Proof-of-Concept Study in Endoscopic Pituitary Surgery","volume":"21","author":"Staartjes","year":"2021","journal-title":"Oper. Neurosurg."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1563","DOI":"10.1177\/2050640618798182","article-title":"Intra and inter-observer agreement on polyp detection in colon capsule endoscopy evaluations","volume":"6","author":"Buijs","year":"2018","journal-title":"United Eur. Gastroenterol. J."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.ijmedinf.2018.11.010","article-title":"Nasal cytology with deep learning techniques","volume":"122","author":"Dimauro","year":"2018","journal-title":"Int. J. Med. Inform."}],"container-title":["Bioengineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2306-5354\/12\/1\/10\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:59:56Z","timestamp":1760115596000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2306-5354\/12\/1\/10"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,25]]},"references-count":32,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,1]]}},"alternative-id":["bioengineering12010010"],"URL":"https:\/\/doi.org\/10.3390\/bioengineering12010010","relation":{},"ISSN":["2306-5354"],"issn-type":[{"value":"2306-5354","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,25]]}}}