{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,7]],"date-time":"2026-11-07T13:21:04Z","timestamp":1794057664989,"version":"4.8.0"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,5,13]],"date-time":"2021-05-13T00:00:00Z","timestamp":1620864000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,5,13]],"date-time":"2021-05-13T00:00:00Z","timestamp":1620864000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Orthopantomogram (OPG) is important for primary diagnosis of temporomandibular joint osteoarthritis (TMJOA), because of cost and the radiation associated with computed tomograms (CT). The aims of this study were to develop an artificial intelligence (AI) model and compare its TMJOA diagnostic performance from OPGs with that of an oromaxillofacial radiology (OMFR) expert. An AI model was developed using Karas\u2019 ResNet model and trained to classify images into three categories: normal, indeterminate OA, and OA. This study included 1189 OPG images confirmed by cone-beam CT and evaluated the results by model (accuracy, precision, recall, and F1 score) and diagnostic performance (accuracy, sensitivity, and specificity). The model performance was unsatisfying when AI was developed with 3 categories. After the indeterminate OA images were reclassified as normal, OA, or omission, the AI diagnosed TMJOA in a similar manner to an expert and was in most accord with CBCT when the indeterminate OA category was omitted (accuracy: 0.78, sensitivity: 0.73, and specificity: 0.82). Our deep learning model showed a sensitivity equivalent to that of an expert, with a better balance between sensitivity and specificity, which implies that AI can play an important role in primary diagnosis of TMJOA from OPGs in most general practice clinics where OMFR experts or CT are not available.<\/jats:p>","DOI":"10.1038\/s41598-021-89742-y","type":"journal-article","created":{"date-parts":[[2021,5,13]],"date-time":"2021-05-13T06:04:23Z","timestamp":1620885863000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":69,"title":["Artificial intelligence in detecting temporomandibular joint osteoarthritis on orthopantomogram"],"prefix":"10.1038","volume":"11","author":[{"given":"Eunhye","family":"Choi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Donghyun","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeong-Yun","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hee-Kyung","family":"Park","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,5,13]]},"reference":[{"key":"89742_CR1","doi-asserted-by":"publisher","first-page":"666","DOI":"10.1177\/0022034515574770","volume":"94","author":"X Wang","year":"2015","unstructured":"Wang, X., Zhang, J., Gan, Y. & Zhou, Y. Current understanding of pathogenesis and treatment of TMJ osteoarthritis. J. Dent. Res. 94, 666\u2013673 (2015).","journal-title":"J. Dent. Res."},{"key":"89742_CR2","first-page":"465","volume":"54","author":"JA Buckwalter","year":"2005","unstructured":"Buckwalter, J. A., Mankin, H. J. & Grodzinsky, A. Articular cartilage: Degeneration and osteoarthritis. Instr. Course Lect. 54, 465 (2005).","journal-title":"Instr. Course Lect."},{"key":"89742_CR3","first-page":"7","volume":"24","author":"EL Schiffman","year":"2010","unstructured":"Schiffman, E. L. et al. The research diagnostic criteria for temporomandibular disorders. I: overview and methodology for assessment of validity. J. Oral Facial Pain Headache 24, 7 (2010).","journal-title":"J. Oral Facial Pain Headache"},{"key":"89742_CR4","doi-asserted-by":"publisher","first-page":"20140235","DOI":"10.1259\/dmfr.20140235","volume":"44","author":"T Larheim","year":"2015","unstructured":"Larheim, T., Abrahamsson, A., Kristensen, M. & Arvidsson, L. Temporomandibular joint diagnostics using CBCT. Dentomaxillofac. Radiol. 44, 20140235 (2015).","journal-title":"Dentomaxillofac. Radiol."},{"key":"89742_CR5","first-page":"493","volume-title":"Oral Radiology: Principles and Interpretation (4th edition)","author":"SC White","year":"2009","unstructured":"White, S. C. & Pharaoah, M. J. Oral Radiology: Principles and Interpretation (4th edition) 493\u2013498 (Mosby, 2009)."},{"key":"89742_CR6","doi-asserted-by":"crossref","unstructured":"Wirtz, A., Mirashi, S. G. & Wesarg, S. Automatic teeth segmentation in panoramic X-ray images using a coupled shape model in combination with a neural network. Med. Image Comput. Comput. Assist. Interv. 11073, 712\u2013719 (2018).","DOI":"10.1007\/978-3-030-00937-3_81"},{"key":"89742_CR7","first-page":"42","volume":"35","author":"J De Tobel","year":"2017","unstructured":"De Tobel, J., Radesh, P., Vandermeulen, D. & Thevissen, P. W. An automated technique to stage lower third molar development on panoramic radiographs for age estimation: A pilot study. J. Forens. Odontostomatol. 35, 42 (2017).","journal-title":"J. Forens. Odontostomatol."},{"key":"89742_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-019-45487-3","volume":"9","author":"S Vinayahalingam","year":"2019","unstructured":"Vinayahalingam, S., Xi, T., Berg\u00e9, S., Maal, T. & de Jong, G. Automated detection of third molars and mandibular nerve by deep learning. Sci. Rep. 9, 1\u20137 (2019).","journal-title":"Sci. Rep."},{"key":"89742_CR9","doi-asserted-by":"publisher","first-page":"1839","DOI":"10.3390\/jcm9061839","volume":"9","author":"H Yang","year":"2020","unstructured":"Yang, H. et al. Deep learning for automated detection of cyst and tumors of the jaw in panoramic radiographs. J. Clin. Med. 9, 1839 (2020).","journal-title":"J. Clin. Med."},{"key":"89742_CR10","doi-asserted-by":"publisher","first-page":"392","DOI":"10.3390\/jcm9020392","volume":"9","author":"K-S Lee","year":"2020","unstructured":"Lee, K.-S., Jung, S.-K., Ryu, J.-J., Shin, S.-W. & Choi, J. Evaluation of transfer learning with deep convolutional neural networks for screening osteoporosis in dental panoramic radiographs. J. Clin. Med. 9, 392 (2020).","journal-title":"J. Clin. Med."},{"key":"89742_CR11","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1007\/s11282-018-0363-7","volume":"35","author":"M Murata","year":"2019","unstructured":"Murata, M. et al. Deep-learning classification using convolutional neural network for evaluation of maxillary sinusitis on panoramic radiography. Oral Radiol. 35, 301\u2013307 (2019).","journal-title":"Oral Radiol."},{"key":"89742_CR12","doi-asserted-by":"publisher","first-page":"1363","DOI":"10.1177\/0022034520936950","volume":"99","author":"K Lee","year":"2020","unstructured":"Lee, K. et al. Automated detection of TMJ osteoarthritis based on artificial intelligence. J. Dent. Res. 99, 1363\u20131367 (2020).","journal-title":"J. Dent. Res."},{"key":"89742_CR13","doi-asserted-by":"publisher","first-page":"7464","DOI":"10.3390\/app10217464","volume":"10","author":"D Kim","year":"2020","unstructured":"Kim, D., Choi, E., Jeong, H. G., Chang, J. & Youm, S. J. Expert system for mandibular condylar detection and osteoarthritis classification in panoramic imaging using R-CNN and CNN. Appl. Sci. 10, 7464 (2020).","journal-title":"Appl. Sci."},{"key":"89742_CR14","doi-asserted-by":"publisher","first-page":"844","DOI":"10.1016\/j.tripleo.2009.02.023","volume":"107","author":"M Ahmad","year":"2009","unstructured":"Ahmad, M. et al. Research diagnostic criteria for temporomandibular disorders (RDC\/TMD): Development of image analysis criteria and examiner reliability for image analysis. Oral Surg. Oral Med. Oral Pathol. Oral Radiol. Endod. 107, 844\u2013860 (2009).","journal-title":"Oral Surg. Oral Med. Oral Pathol. Oral Radiol. Endod."},{"key":"89742_CR15","doi-asserted-by":"publisher","first-page":"6","DOI":"10.11607\/jop.1151","volume":"28","author":"E Schiffman","year":"2014","unstructured":"Schiffman, E. et al. Diagnostic criteria for temporomandibular disorders (DC\/TMD) for clinical and research applications: Recommendations of the International RDC\/TMD consortium network and orofacial pain special interest group. J. Oral Facial Pain Headache 28, 6 (2014).","journal-title":"J. Oral Facial Pain Headache"},{"key":"89742_CR16","doi-asserted-by":"publisher","first-page":"337","DOI":"10.3109\/00016357.2015.1136678","volume":"74","author":"K Kim","year":"2016","unstructured":"Kim, K., Wojczy\u0144ska, A. & Lee, J.-Y. The incidence of osteoarthritic change on computed tomography of Korean temporomandibular disorder patients diagnosed by RDC\/TMD; a retrospective study. Acta Odontol. Scand. 74, 337\u2013342 (2016).","journal-title":"Acta Odontol. Scand."},{"key":"89742_CR17","first-page":"195","volume":"33","author":"Y-M Jeon","year":"2008","unstructured":"Jeon, Y.-M. et al. The validity of computed tomography in diagnosis of temporomandibular joint osteoarthritis. J. Oral Med. 33, 195\u2013204 (2008).","journal-title":"J. Oral Med."},{"key":"89742_CR18","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1016\/j.ajodo.2005.10.032","volume":"132","author":"OB Honey","year":"2007","unstructured":"Honey, O. B. et al. Accuracy of cone-beam computed tomography imaging of the temporomandibular joint: Comparisons with panoramic radiology and linear tomography. Am. J. Orthod. Dentofacial Orthop. 132, 429\u2013438 (2007).","journal-title":"Am. J. Orthod. Dentofacial Orthop."},{"key":"89742_CR19","first-page":"168","volume":"9","author":"LS Kamelchuk","year":"1995","unstructured":"Kamelchuk, L. S. & Major, P. W. Degenerative disease of the temporomandibular joint. J. Orofac. Pain 9, 168\u2013180 (1995).","journal-title":"J. Orofac. Pain"},{"key":"89742_CR20","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1016\/j.berh.2005.08.001","volume":"20","author":"J Cibere","year":"2006","unstructured":"Cibere, J. Do we need radiographs to diagnose osteoarthritis?. Best Pract. Res. Clin. Rheumatol. 20, 27\u201338 (2006).","journal-title":"Best Pract. Res. Clin. Rheumatol."},{"key":"89742_CR21","doi-asserted-by":"publisher","first-page":"609","DOI":"10.1016\/S1079-2104(97)90128-1","volume":"83","author":"SL Brooks","year":"1997","unstructured":"Brooks, S. L. et al. Imaging of the temporomandibular joint: A position paper of the American Academy of Oral and Maxillofacial Radiology. Oral Surg. Oral Med. Oral Pathol. Oral Radiol. Endod. 83, 609\u2013618 (1997).","journal-title":"Oral Surg. Oral Med. Oral Pathol. Oral Radiol. Endod."},{"key":"89742_CR22","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1016\/j.tripleo.2004.07.011","volume":"99","author":"F Mawani","year":"2005","unstructured":"Mawani, F. et al. Condylar shape analysis using panoramic radiography units and conventional tomography. Oral Surg. Oral Med. Oral Pathol. Oral Radiol. 99, 341\u2013348 (2005).","journal-title":"Oral Surg. Oral Med. Oral Pathol. Oral Radiol."},{"key":"89742_CR23","doi-asserted-by":"crossref","unstructured":"Deng, J. et al. Imagenet: A large-scale hierarchical image database. in 2009 IEEE Conference on Computer Vision and Pattern Recognition. 248\u2013255 (2009).","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"89742_CR24","first-page":"75","volume":"72","author":"WC Scarfe","year":"2006","unstructured":"Scarfe, W. C., Farman, A. G. & Sukovic, P. Clinical applications of cone-beam computed tomography in dental practice. J. Can. Dent. Assoc. 72, 75 (2006).","journal-title":"J. Can. Dent. Assoc."},{"key":"89742_CR25","doi-asserted-by":"publisher","first-page":"152","DOI":"10.1111\/odi.13223","volume":"26","author":"JH Lee","year":"2020","unstructured":"Lee, J. H., Kim, D. H. & Jeong, S. N. Diagnosis of cystic lesions using panoramic and cone beam computed tomographic images based on deep learning neural network. Oral Dis. 26, 152\u2013158 (2020).","journal-title":"Oral Dis."},{"key":"89742_CR26","doi-asserted-by":"publisher","first-page":"704","DOI":"10.1111\/joor.12846","volume":"46","author":"J Lei","year":"2019","unstructured":"Lei, J., Yap, A. U. J., Liu, M. Q. & Fu, K. Y. Condylar repair and regeneration in adolescents\/young adults with early-stage degenerative temporomandibular joint disease: A randomised controlled study. J. Oral Rehab. 46, 704\u2013714 (2019).","journal-title":"J. Oral Rehab."},{"key":"89742_CR27","doi-asserted-by":"publisher","first-page":"e271","DOI":"10.1016\/S2589-7500(19)30123-2","volume":"1","author":"X Liu","year":"2019","unstructured":"Liu, X. et al. A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: A systematic review and meta-analysis. Lancet Dig. Health 1, e271\u2013e297 (2019).","journal-title":"Lancet Dig. Health"},{"key":"89742_CR28","doi-asserted-by":"publisher","first-page":"33","DOI":"10.3348\/kjr.2019.0312","volume":"21","author":"S Do","year":"2020","unstructured":"Do, S., Song, K. D. & Chung, J. W. Basics of deep learning: A radiologist\u2019s guide to understanding published radiology articles on deep learning. Korean J. Radiol. 21, 33\u201341 (2020).","journal-title":"Korean J. Radiol."},{"key":"89742_CR29","doi-asserted-by":"publisher","first-page":"272","DOI":"10.1016\/0030-4220(84)90052-5","volume":"58","author":"F O'Ryan","year":"1984","unstructured":"O\u2019Ryan, F. & Epker, B. N. Temporomandibular joint function and morphology: Observations on the spectra of normalcy. Oral Surg. Oral Med. Oral Pathol. 58, 272\u2013279 (1984).","journal-title":"Oral Surg. Oral Med. Oral Pathol."},{"key":"89742_CR30","doi-asserted-by":"publisher","first-page":"236","DOI":"10.4258\/hir.2018.24.3.236","volume":"24","author":"W Poedjiastoeti","year":"2018","unstructured":"Poedjiastoeti, W. & Suebnukarn, S. Application of convolutional neural network in the diagnosis of jaw tumors. Health Inform. Res. 24, 236\u2013241 (2018).","journal-title":"Health Inform. Res."},{"key":"89742_CR31","unstructured":"Gal, Y. Uncertainty in deep learning. in Los Altos: IEEE\/ACM Transactions on Audio, Speech, and Language Processing (2017)."},{"key":"89742_CR32","doi-asserted-by":"crossref","unstructured":"Holzinger, A. From machine learning to explainable AI. in 2018 World Symposium on Digital Intelligence for Systems and Machines (DISA). Piscataway: IEEE. 55\u201366 (2018).","DOI":"10.1109\/DISA.2018.8490530"}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-021-89742-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-021-89742-y","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-021-89742-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,3]],"date-time":"2022-12-03T03:24:10Z","timestamp":1670037850000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-021-89742-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,13]]},"references-count":32,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["89742"],"URL":"https:\/\/doi.org\/10.1038\/s41598-021-89742-y","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,13]]},"assertion":[{"value":"21 December 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 April 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 May 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"10246"}}