{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,20]],"date-time":"2026-11-20T18:25:22Z","timestamp":1795199122280,"version":"4.10.3"},"reference-count":63,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,4,1]],"date-time":"2023-04-01T00:00:00Z","timestamp":1680307200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,4,1]],"date-time":"2023-04-01T00:00:00Z","timestamp":1680307200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003354","name":"Garnett Passe and Rodney Williams Memorial Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003354","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Microsoft AI for Humanitarian Action Fund Grant"},{"DOI":"10.13039\/501100020021","name":"Avant Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100020021","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>To evaluate the generalizability of artificial intelligence (AI) algorithms that use deep learning methods to identify middle ear disease from otoscopic images, between internal to external performance. 1842 otoscopic images were collected from three independent sources: (a) Van, Turkey, (b) Santiago, Chile, and (c) Ohio, USA. Diagnostic categories consisted of (i) normal or (ii) abnormal. Deep learning methods were used to develop models to evaluate internal and external performance, using area under the curve (AUC) estimates. A pooled assessment was performed by combining all cohorts together with fivefold cross validation. AI-otoscopy algorithms achieved high internal performance (mean AUC: 0.95, 95%CI: 0.80\u20131.00). However, performance was reduced when tested on external otoscopic images not used for training (mean AUC: 0.76, 95%CI: 0.61\u20130.91). Overall, external performance was significantly lower than internal performance (mean difference in AUC: \u22120.19, p \u2264 0.04). Combining cohorts achieved a substantial pooled performance (AUC: 0.96, standard error: 0.01). Internally applied algorithms for otoscopy performed well to identify middle ear disease from otoscopy images. However, external performance was reduced when applied to new test cohorts. Further efforts are required to explore data augmentation and pre-processing techniques that might improve external performance and develop a robust, generalizable algorithm for real-world clinical applications.<\/jats:p>","DOI":"10.1038\/s41598-023-31921-0","type":"journal-article","created":{"date-parts":[[2023,4,3]],"date-time":"2023-04-03T01:50:55Z","timestamp":1680486655000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":43,"title":["Evaluating the generalizability of deep learning image classification algorithms to detect middle ear disease using otoscopy"],"prefix":"10.1038","volume":"13","author":[{"given":"Al-Rahim","family":"Habib","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yixi","family":"Xu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kris","family":"Bock","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shrestha","family":"Mohanty","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tina","family":"Sederholm","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"William B.","family":"Weeks","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rahul","family":"Dodhia","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Juan Lavista","family":"Ferres","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chris","family":"Perry","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Raymond","family":"Sacks","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Narinder","family":"Singh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,4,1]]},"reference":[{"key":"31921_CR1","unstructured":"World Health Organisation. World Report on Hearing [Internet]. Geneva; 2021. https:\/\/www.who.int\/publications\/i\/item\/world-report-on-hearing. Accessed 28 Aug 2022 (2021)."},{"key":"31921_CR2","unstructured":"World Health Organization. Global Costs of Unaddressed Hearing Loss and Cost-Effectiveness of Interventions: A WHO Report [Internet]. Geneva; 2017. https:\/\/apps.who.int\/iris\/bitstream\/handle\/10665\/254659\/9789241512046-eng.pdf. Accessed 28 Aug 2022 (2017)."},{"key":"31921_CR3","unstructured":"Deloitte Access Economics. The Social and Economic Costs of Hearing Loss in Australia [Internet]. https:\/\/apo.org.au\/node\/102776. Accessed 28 Aug 2022 (2017)"},{"key":"31921_CR4","unstructured":"Shield, B. Evaluation of the Social and Economic Costs of Hearing Impairment: A Report for Hear-It [Internet]. https:\/\/www.hear-it.org\/sites\/default\/files\/multimedia\/documents\/Hear_It_Report_October_2006.pdf. Accessed 28 Aug 2022 (2006)."},{"key":"31921_CR5","unstructured":"World Health Organization. Childhood Hearing Loss\u2014Act Now, Here\u2019s How! [Internet]. Geneva; 2016. https:\/\/apps.who.int\/iris\/handle\/10665\/204507. Accessed 28 Aug 2022 (2016)."},{"issue":"12","key":"31921_CR6","doi-asserted-by":"publisher","first-page":"33049","DOI":"10.2196\/33049","volume":"9","author":"D Cha","year":"2021","unstructured":"Cha, D. et al. Differential biases and variabilities of deep learning-based artificial intelligence and human experts in clinical diagnosis: Retrospective cohort and survey study. JMIR Med. Inform. 9(12), 33049 (2021).","journal-title":"JMIR Med. Inform."},{"issue":"46","key":"31921_CR7","doi-asserted-by":"publisher","first-page":"150","DOI":"10.1016\/j.ajem.2021.04.030","volume":"1","author":"K Kleinman","year":"2021","unstructured":"Kleinman, K. et al. Evaluation of digital otoscopy in pediatric patients: A prospective randomized controlled clinical trial. Am. J. Emerg. Med. 1(46), 150\u2013155 (2021).","journal-title":"Am. J. Emerg. Med."},{"issue":"3","key":"31921_CR8","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1016\/j.ijporl.2004.10.013","volume":"69","author":"ME Pichichero","year":"2005","unstructured":"Pichichero, M. E. & Poole, M. D. Comparison of performance by otolaryngologists, pediatricians, and general practioners on an otoendoscopic diagnostic video examination. Int. J. Pediatr. Otorhinolaryngol. 69(3), 361\u2013366 (2005).","journal-title":"Int. J. Pediatr. Otorhinolaryngol."},{"issue":"2","key":"31921_CR9","first-page":"137","volume":"92","author":"ME Pichichero","year":"2002","unstructured":"Pichichero, M. E. Assessing diagnostic accuracy and tympanocentesis skills of South African physicians in management of otitis media [7]. S. Afr. Med. J. 92(2), 137\u2013138 (2002).","journal-title":"S. Afr. Med. J."},{"issue":"1","key":"31921_CR10","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1111\/j.1365-2273.1995.tb00014.x","volume":"20","author":"PJ Wormald","year":"1995","unstructured":"Wormald, P. J., Browning, G. G. & Robinson, K. Is otoscopy reliable? A structured teaching method to improve otoscopic accuracy in trainees. Clin. Otolaryngol. Allied Sci. 20(1), 63\u201367 (1995).","journal-title":"Clin. Otolaryngol. Allied Sci."},{"key":"31921_CR11","doi-asserted-by":"publisher","first-page":"384","DOI":"10.1016\/j.neunet.2020.03.023","volume":"126","author":"MA Khan","year":"2020","unstructured":"Khan, M. A. et al. Automatic detection of tympanic membrane and middle ear infection from oto-endoscopic images via convolutional neural networks. Neural Netw. [Internet]. 126, 384\u2013394. https:\/\/doi.org\/10.1016\/j.neunet.2020.03.023 (2020).","journal-title":"Neural Netw. [Internet]."},{"issue":"1","key":"31921_CR12","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1017\/S0022215118001275","volume":"133","author":"K Graydon","year":"2019","unstructured":"Graydon, K., Waterworth, C., Miller, H. & Gunasekera, H. Global burden of hearing impairment and ear disease. J. Laryngol. Otol. 133(1), 18\u201325 (2019).","journal-title":"J. Laryngol. Otol."},{"key":"31921_CR13","first-page":"1","volume":"1","author":"J Zhang","year":"2022","unstructured":"Zhang, J., Li, C., Yin, Y., Zhang, J. & Grzegorzek, M. Applications of artificial neural networks in microorganism image analysis: A comprehensive review from conventional multilayer perceptron to popular convolutional neural network and potential visual transformer. Artif. Intell. Rev. 1, 1\u201358 (2022).","journal-title":"Artif. Intell. Rev."},{"issue":"6","key":"31921_CR14","doi-asserted-by":"publisher","first-page":"1318","DOI":"10.3390\/diagnostics12061318","volume":"12","author":"J Sandstr\u00f6m","year":"2022","unstructured":"Sandstr\u00f6m, J., Myburgh, H., Laurent, C., Swanepoel, D. W. & Lundberg, T. A machine learning approach to screen for otitis media using digital otoscope images labelled by an expert panel. Diagnostics 12(6), 1318 (2022).","journal-title":"Diagnostics"},{"issue":"4","key":"31921_CR15","doi-asserted-by":"publisher","DOI":"10.1542\/peds.2020-034546","volume":"147","author":"MG Crowson","year":"2021","unstructured":"Crowson, M. G. et al. Machine learning for accurate intraoperative pediatric middle ear effusion diagnosis. Pediatrics 147(4), e2020034546 (2021).","journal-title":"Pediatrics"},{"issue":"15","key":"31921_CR16","doi-asserted-by":"publisher","first-page":"3198","DOI":"10.3390\/jcm10153198","volume":"10","author":"H Byun","year":"2021","unstructured":"Byun, H. et al. An assistive role of a machine learning network in diagnosis of middle ear diseases. J. Clin. Med. 10(15), 3198 (2021).","journal-title":"J. Clin. Med."},{"issue":"4","key":"31921_CR17","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1017\/S0022215120000717","volume":"134","author":"AR Habib","year":"2020","unstructured":"Habib, A. R., Wong, E., Sacks, R. & Singh, N. Artificial intelligence to detect tympanic membrane perforations. J. Laryngol. Otol. 134(4), 311\u2013315 (2020).","journal-title":"J. Laryngol. Otol."},{"issue":"3","key":"31921_CR18","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pone.0229226","volume":"15","author":"M Viscaino","year":"2020","unstructured":"Viscaino, M. et al. Computer-aided diagnosis of external and middle ear conditions: A machine learning approach. PLoS One [Internet]. 15(3), 1\u201318. https:\/\/doi.org\/10.1371\/journal.pone.0229226 (2020).","journal-title":"PLoS One [Internet]."},{"key":"31921_CR19","unstructured":"Goshtasbi, K. Machine Learning Models to Predict Diagnosis and Surgical Outcomes in Otolaryngology [Internet]. https:\/\/escholarship.org\/uc\/item\/1tr0c2p0 (University of California Irvine, 2020)."},{"issue":"66","key":"31921_CR20","first-page":"1","volume":"48","author":"D Livingstone","year":"2019","unstructured":"Livingstone, D., Talai, A. S., Chau, J. & Forkert, N. D. Building an otoscopic screening prototype tool using deep learning. J. Otolaryngol. Head Neck Surg. 48(66), 1\u20135 (2019).","journal-title":"J. Otolaryngol. Head Neck Surg."},{"key":"31921_CR21","first-page":"1","volume":"13","author":"D Livingstone","year":"2019","unstructured":"Livingstone, D. & Chau, J. Otoscopic diagnosis using computer vision: An automated machine learning approach. Laryngoscope 13, 1\u20136 (2019).","journal-title":"Laryngoscope"},{"key":"31921_CR22","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1016\/j.bspc.2017.07.015","volume":"39","author":"HC Myburgh","year":"2018","unstructured":"Myburgh, H. C., Jose, S., Swanepoel, D. W. & Laurent, C. Towards low cost automated smartphone- and cloud-based otitis media diagnosis. Biomed. Signal Process. Control [Internet]. 39, 34\u201352. https:\/\/doi.org\/10.1016\/j.bspc.2017.07.015 (2018).","journal-title":"Biomed. Signal Process. Control [Internet]."},{"key":"31921_CR23","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1016\/j.ebiom.2016.02.017","volume":"5","author":"HC Myburgh","year":"2016","unstructured":"Myburgh, H. C., van Zijl, W. H., Swanepoel, D. W., Hellstr\u00f6m, S. & Laurent, C. Otitis media diagnosis for developing countries using tympanic membrane image-analysis. EBioMedicine [Internet] 5, 156\u2013160. https:\/\/doi.org\/10.1016\/j.ebiom.2016.02.017 (2016).","journal-title":"EBioMedicine [Internet]"},{"issue":"8","key":"31921_CR24","doi-asserted-by":"publisher","first-page":"6027","DOI":"10.1007\/s00521-021-06810-0","volume":"34","author":"E Ba\u015faran","year":"2022","unstructured":"Ba\u015faran, E., C\u00f6mert, Z. & \u00c7elik, Y. Neighbourhood component analysis and deep feature-based diagnosis model for middle ear otoscope images. Neural Comput. Appl. 34(8), 6027\u20136038 (2022).","journal-title":"Neural Comput. Appl."},{"key":"31921_CR25","doi-asserted-by":"publisher","DOI":"10.1101\/2021.08.05.21261672","author":"H Binol","year":"2021","unstructured":"Binol, H. et al. OtoXNet\u2014Automated identification of eardrum diseases from otoscope videos: A deep learning study for video-representing images. medRxiv (Internet) https:\/\/doi.org\/10.1101\/2021.08.05.21261672 (2021).","journal-title":"medRxiv (Internet)"},{"key":"31921_CR26","doi-asserted-by":"publisher","unstructured":"Binol, H., Niazi, M.K.K., Elmaraghy, C., Moberly, A.C., & Gurcan, M.N. Automated video summarization and label assignment for otoscopy videos using deep learning and natural language processing. in Medical Imaging 2021: Imaging Informatics for Healthcare, Research, and Applications [Internet] (Park, B.J., Deserno, T.M. Eds.). 28. https:\/\/www.spiedigitallibrary.org\/conference-proceedings-of-spie\/11601\/2582009\/Automated-video-summarization-and-label-assignment-for-otoscopy-videos-using\/https:\/\/doi.org\/10.1117\/12.2582009.full. Accessed 17 Mar 2021 (SPIE, 2021).","DOI":"10.1117\/12.2582009.full"},{"issue":"17","key":"31921_CR27","first-page":"1","volume":"10","author":"H Binol","year":"2020","unstructured":"Binol, H. et al. SelectStitch: Automated frame segmentation and stitching to create composite images from otoscope video clips. Appl. Sci. (Switzerland) 10(17), 1\u201313 (2020).","journal-title":"Appl. Sci. (Switzerland)"},{"issue":"5","key":"31921_CR28","doi-asserted-by":"publisher","first-page":"E1668","DOI":"10.1002\/lary.29253","volume":"131","author":"H Binol","year":"2021","unstructured":"Binol, H. et al. Digital otoscopy videos versus composite images: A reader study to compare the accuracy of ENT physicians. Laryngoscope 131(5), E1668\u2013E1676 (2021).","journal-title":"Laryngoscope"},{"key":"31921_CR29","doi-asserted-by":"publisher","unstructured":"Wang, W., Tamhane, A., Rzasa, J., Clark, J., Canares, T., & Unberath, M. Otoscopy video screening with deep anomaly detection. in (Drukker, K., Mazurowski, M.A. eds.) Medical Imaging 2021: Computer-Aided Diagnosis [Internet]. 50. https:\/\/www.spiedigitallibrary.org\/conference-proceedings-of-spie\/11597\/2581902\/Otoscopy-video-screening-with-deep-anomaly-detection\/https:\/\/doi.org\/10.1117\/12.2581902.full. Accessed 17 Mar 2021. (SPIE, 2021)","DOI":"10.1117\/12.2581902.full"},{"key":"31921_CR30","doi-asserted-by":"crossref","unstructured":"Wang, W., Tamhane, A., Santos, C., Rzasa, J.R., Clark, J.H., Canares, T.L. et al. Pediatric Otoscopy Video Screening with Shift Contrastive Anomaly Detection. http:\/\/arxiv.org\/abs\/2110.13254. Accessed 25 Oct 2021 (2021).","DOI":"10.3389\/fdgth.2021.810427"},{"key":"31921_CR31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.irbm.2021.01.001","volume":"1","author":"M U\u00e7ar","year":"2021","unstructured":"U\u00e7ar, M., Akyol, K. & AtilaU\u00e7ar, E. Classification of different tympanic membrane conditions using fused deep hypercolumn features and bidirectional LSTM. Irbm (Internet) 1, 1\u201311. https:\/\/doi.org\/10.1016\/j.irbm.2021.01.001 (2021).","journal-title":"Irbm (Internet)"},{"key":"31921_CR32","doi-asserted-by":"publisher","DOI":"10.7717\/peerj-cs.405","volume":"7","author":"A Alhudhaif","year":"2021","unstructured":"Alhudhaif, A., C\u00f6mert, Z. & Polat, K. Otitis media detection using tympanic membrane images with a novel multi-class machine learning algorithm. PeerJ Comput. Sci. 7, e405 (2021).","journal-title":"PeerJ Comput. Sci."},{"key":"31921_CR33","first-page":"71","volume":"1","author":"JV Sundgaard","year":"2021","unstructured":"Sundgaard, J. V. et al. Deep metric learning for otitis media classification. Med. Image Anal. 1, 71 (2021).","journal-title":"Med. Image Anal."},{"issue":"1","key":"31921_CR34","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1016\/j.bbe.2019.11.001","volume":"40","author":"Z C\u00f6mert","year":"2020","unstructured":"C\u00f6mert, Z. Fusing fine-tuned deep features for recognizing different tympanic membranes. Biocybern. Biomed. Eng. (Internet) 40(1), 40\u201351. https:\/\/doi.org\/10.1016\/j.bbe.2019.11.001 (2020).","journal-title":"Biocybern. Biomed. Eng. (Internet)"},{"key":"31921_CR35","first-page":"1","volume":"131","author":"Z Wu","year":"2020","unstructured":"Wu, Z. et al. Deep learning for classification of pediatric otitis media. Laryngoscope. 131, 1\u20138 (2020).","journal-title":"Laryngoscope."},{"key":"31921_CR36","first-page":"141","volume":"1","author":"W Liu","year":"2022","unstructured":"Liu, W. et al. Is the aspect ratio of cells important in deep learning? A robust comparison of deep learning methods for multi-scale cytopathology cell image classification: From convolutional neural networks to visual transformers. Comput. Biol. Med. 1, 141 (2022).","journal-title":"Comput. Biol. Med."},{"issue":"6","key":"31921_CR37","doi-asserted-by":"publisher","first-page":"4809","DOI":"10.1007\/s10462-021-10121-0","volume":"55","author":"X Li","year":"2022","unstructured":"Li, X. et al. A comprehensive review of computer-aided whole-slide image analysis: From datasets to feature extraction, segmentation, classification and detection approaches. Artif. Intell. Rev. 55(6), 4809\u20134878 (2022).","journal-title":"Artif. Intell. Rev."},{"issue":"4","key":"31921_CR38","doi-asserted-by":"publisher","first-page":"481","DOI":"10.1097\/MAO.0000000000003484","volume":"43","author":"AR Habib","year":"2022","unstructured":"Habib, A. R. et al. An artificial intelligence computer-vision algorithm to triage otoscopic images from Australian Aboriginal and Torres Strait Islander children. Otol. Neurotol. 43(4), 481\u2013488 (2022).","journal-title":"Otol. Neurotol."},{"issue":"3","key":"31921_CR39","doi-asserted-by":"publisher","first-page":"401","DOI":"10.1111\/coa.13925","volume":"47","author":"AR Habib","year":"2022","unstructured":"Habib, A. R. et al. Artificial intelligence to classify ear disease from otoscopy: A systematic review and meta-analysis. Clin. Otolaryngol. 47(3), 401\u2013413 (2022).","journal-title":"Clin. Otolaryngol."},{"key":"31921_CR40","first-page":"143","volume":"1","author":"H Chen","year":"2022","unstructured":"Chen, H. et al. IL-MCAM: An interactive learning and multi-channel attention mechanism-based weakly supervised colorectal histopathology image classification approach. Comput. Biol. Med. 1, 143 (2022).","journal-title":"Comput. Biol. Med."},{"key":"31921_CR41","unstructured":"Chen, H., Li, C., Wang, G., Li, X., Rahaman, M., Sun, H. et al. GasHis-Transformer: A Multi-scale Visual Transformer Approach for Gastric Histopathological Image Detection. http:\/\/arxiv.org\/abs\/2104.14528. Accessed 29 Apr 2021 (2021)."},{"issue":"11","key":"31921_CR42","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1136\/bmjopen-2016-012799","volume":"6","author":"JF Cohen","year":"2016","unstructured":"Cohen, J. F. et al. STARD 2015 guidelines for reporting diagnostic accuracy studies: Explanation and elaboration. BMJ Open 6(11), 1\u201317 (2016).","journal-title":"BMJ Open"},{"key":"31921_CR43","doi-asserted-by":"publisher","first-page":"1364","DOI":"10.1038\/s41591-020-1034-x","volume":"26","author":"X Liu","year":"2020","unstructured":"Liu, X. et al. CONSORT-AI extension. Nat Med. 26, 1364\u20131374 (2020).","journal-title":"Nat Med."},{"issue":"66","key":"31921_CR44","doi-asserted-by":"publisher","first-page":"919","DOI":"10.21205\/deufmd.2020226625","volume":"22","author":"E Ba\u015faran","year":"2020","unstructured":"Ba\u015faran, E., C\u00f6mert, Z., Celik, Y., Velappan, S. & Togacar, M. Determination of tympanic membrane region in the middle ear otoscope images with convolutional neural network based YOLO method. Deu Muhendislik Fakultesi Fen ve Muhendislik. 22(66), 919\u2013928 (2020).","journal-title":"Deu Muhendislik Fakultesi Fen ve Muhendislik."},{"issue":"5","key":"31921_CR45","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pone.0232776","volume":"15","author":"S Camalan","year":"2020","unstructured":"Camalan, S. et al. OtoMatch: Content-based eardrum image retrieval using deep learning. PLoS One [Internet]. 15(5), 1\u201316. https:\/\/doi.org\/10.1371\/journal.pone.0232776 (2020).","journal-title":"PLoS One [Internet]."},{"key":"31921_CR46","unstructured":"He K, Zhang X, Ren S, Sun J. Deep Residual Learning for Image Recognition. http:\/\/arxiv.org\/abs\/1512.03385. Accessed 10 Dec 2015 (2015)."},{"key":"31921_CR47","unstructured":"Simonyan, K., & Zisserman, A. Very Deep Convolutional Networks for Large-Scale Image Recognition. http:\/\/arxiv.org\/abs\/1409.1556. Accessed 4 Sep 2014 (2014)."},{"key":"31921_CR48","unstructured":"Huang, G., Liu, Z., van der Maaten, L., & Weinberger, K.Q. Densely Connected Convolutional Networks. http:\/\/arxiv.org\/abs\/1608.06993. Accessed 24 Aug 2016 (2016)."},{"key":"31921_CR49","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T. et al. An Image is Worth 16 x 16 Words: Transformers for Image Recognition at Scale. arXiv [Internet]. 11929. http:\/\/arxiv.org\/abs\/2010.11929 (2020)."},{"key":"31921_CR50","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1093\/ckj\/sfaa188","volume":"14","author":"CL Ramspek","year":"2021","unstructured":"Ramspek, C. L., Jager, K. J., Dekker, F. W., Zoccali, C. & van Diepen, M. External validation of prognostic models: What, why, how, when and where?. Clin. Kidney J. (Oxford University Press) 14, 49\u201358 (2021).","journal-title":"Clin. Kidney J. (Oxford University Press)"},{"key":"31921_CR51","doi-asserted-by":"publisher","first-page":"25759","DOI":"10.2196\/25759","volume":"23","author":"J Yin","year":"2021","unstructured":"Yin, J., Ngiam, K. Y. & Teo, H. H. Role of artificial intelligence applications in real-life clinical practice: Systematic review. J. Med. Internet Res. (JMIR Publications Inc.) 23, 25759 (2021).","journal-title":"J. Med. Internet Res. (JMIR Publications Inc.)"},{"issue":"1","key":"31921_CR52","first-page":"1","volume":"56","author":"E Basaran","year":"2020","unstructured":"Basaran, E., Comert, Z. & Celik, Y. Convolutional neural network approach for automatic tympanic membrane detection and classification. Biomed. Signal Process Control 56(1), 1\u201314 (2020).","journal-title":"Biomed. Signal Process Control"},{"key":"31921_CR53","doi-asserted-by":"crossref","unstructured":"Basaran, E., Sengur, A., Comert, Z., Budak, U., Celik, Y., & Velappan, S. Normal and acute tympanic membrane diagnosis based on gray level co-occurrence matrix and artificial neural networks. in 2019 International Conference on Artificial Intelligence and Data Processing Symposium, IDAP 2019. 5\u201310 (2019).","DOI":"10.1109\/IDAP.2019.8875973"},{"key":"31921_CR54","doi-asserted-by":"crossref","unstructured":"Basaran, E., Comert, Z., Sengur, A., Budak, U., Celik, Y., & Togacar, M. Chronic tympanic membrane diagnosis based on deep convolutional neural network. in UBMK 2019\u2014Proceedings, 4th International Conference on Computer Science and Engineering. 635\u2013638 (2019).","DOI":"10.1109\/UBMK.2019.8907070"},{"issue":"9","key":"31921_CR55","first-page":"1827","volume":"9","author":"JY Lee","year":"2019","unstructured":"Lee, J. Y., Choi, S. H. & Chung, J. W. Automated classification of the tympanic membrane using a convolutional neural network. Appl. Sci. (Switzerland). 9(9), 1827 (2019).","journal-title":"Appl. Sci. (Switzerland)."},{"key":"31921_CR56","doi-asserted-by":"publisher","unstructured":"Seok, J., Song, J.J., Koo, J.W., Kin, H.C., & Choi, B.Y. The semantic segmentation approach for normal and pathologic tympanic membrane using deep learning (internet). BioRxiv. https:\/\/doi.org\/10.1101\/515007v2.full. Accessed 3 Mar 2019 (2019).","DOI":"10.1101\/515007v2.full"},{"issue":"2","key":"31921_CR57","first-page":"e489","volume":"1","author":"J Futoma","year":"2020","unstructured":"Futoma, J., Simons, M., Panch, T., Doshi-Velez, F. & Celi, L. A. The myth of generalisability in clinical research and machine learning in health care. Lancet 1(2), e489\u2013e492 (2020).","journal-title":"Lancet"},{"issue":"7","key":"31921_CR58","doi-asserted-by":"publisher","first-page":"1145","DOI":"10.1016\/S0031-3203(96)00142-2","volume":"30","author":"AP Bradley","year":"1997","unstructured":"Bradley, A. P. The use of the area under the ROC curve in the evaluation of machine learning algorithms. Patter Recognit. 30(7), 1145\u20131159 (1997).","journal-title":"Patter Recognit."},{"issue":"3","key":"31921_CR59","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1109\/TKDE.2005.50","volume":"17","author":"J Huang","year":"2005","unstructured":"Huang, J. & Ling, C. X. Using AUC and accuracy in evaluating learning algorithms. IEEE Trans. Knowl. Data Eng. 17(3), 299\u2013310 (2005).","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"31921_CR60","first-page":"921","volume":"61","author":"EMA Alenezi","year":"2021","unstructured":"Alenezi, E. M. A. et al. The reliability of video otoscopy recordings and still images in the asynchronous diagnosis of middle-ear disease. Int. J. Audiol. 61, 921 (2021).","journal-title":"Int. J. Audiol."},{"key":"31921_CR61","doi-asserted-by":"crossref","first-page":"1357633X2098778","DOI":"10.1177\/1357633X20987783","volume":"26","author":"EMA Alenezi","year":"2021","unstructured":"Alenezi, E. M. A. et al. Clinician-rated quality of video otoscopy recordings and still images for the asynchronous assessment of middle-ear disease. J. Telemed. Telecare 26, 1357633X20987783 (2021).","journal-title":"J. Telemed. Telecare"},{"issue":"4","key":"31921_CR62","doi-asserted-by":"publisher","first-page":"e000798","DOI":"10.1136\/bmjgh-2018-000798","volume":"3","author":"B Wahl","year":"2018","unstructured":"Wahl, B., Cossy-Gantner, A., Germann, S. & Schwalbe, N. R. Artificial intelligence (AI) and global health: how can AI contribute to health in resource-poor settings?. BMJ Glob Health (Internet) 3(4), e000798. https:\/\/doi.org\/10.1136\/bmjgh-2018-000798 (2018).","journal-title":"BMJ Glob Health (Internet)"},{"issue":"1","key":"31921_CR63","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12992-019-0531-5","volume":"16","author":"H Alami","year":"2020","unstructured":"Alami, H. et al. Artificial intelligence in health care: Laying the foundation for responsible, sustainable, and inclusive innovation in low- and middle-income countries. Global Health. 16(1), 1\u20136 (2020).","journal-title":"Global Health."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-31921-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-31921-0","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-31921-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,3]],"date-time":"2023-04-03T02:06:23Z","timestamp":1680487583000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-31921-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,1]]},"references-count":63,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["31921"],"URL":"https:\/\/doi.org\/10.1038\/s41598-023-31921-0","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-2014320\/v1","asserted-by":"object"}]},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,1]]},"assertion":[{"value":"30 August 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 March 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 April 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A-RH discloses research funding from the Garnett Passe and Rodney Williams Memorial Foundation, Microsoft\u2019s AI for Humanitarian Action grant, and the Avant Mutual Foundation Doctor-in-Training\u00a0and Early Career research grants. CP discloses conflict of interest from Australian Medical Association (Queensland) and provides consulting services for the Deadly Ears Program. RS is a consultant for Medtronic. NS discloses research funding from Microsoft\u2019s AI for Humanitarian Action grant, consultant for ResMed, Optinose, Nasus, GSK, and ENT Technologies, and has received conference funding from Medtronic, Karl Storz, and NeilMed. YX, KB, SM, TS, RD, and JLF are affiliated with the AI for Good Research Lab.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"5368"}}