{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,4]],"date-time":"2026-11-04T08:33:00Z","timestamp":1793781180621,"version":"4.6.1"},"reference-count":53,"publisher":"Public Library of Science (PLoS)","issue":"3","license":[{"start":{"date-parts":[[2024,3,7]],"date-time":"2024-03-07T00:00:00Z","timestamp":1709769600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010002","name":"Ministry of Education","doi-asserted-by":"publisher","award":["CMRC-CENTER-0"],"award-info":[{"award-number":["CMRC-CENTER-0"]}],"id":[{"id":"10.13039\/100010002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100020950","name":"National Science and Technology Council","doi-asserted-by":"publisher","award":["NSTC 112-2320-B-039-046"],"award-info":[{"award-number":["NSTC 112-2320-B-039-046"]}],"id":[{"id":"10.13039\/501100020950","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:sec id=\"sec001\">\n<jats:title>Background<\/jats:title>\n<jats:p>Tongue diagnosis in traditional Chinese medicine (TCM) provides clinically important, objective evidence from direct observation of specific features that assist with diagnosis. However, the current interpretation of tongue features requires a significant amount of manpower and time. TCM physicians may have different interpretations of features displayed by the same tongue. An automated interpretation system that interprets tongue features would expedite the interpretation process and yield more consistent results.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"sec002\">\n<jats:title>Materials and methods<\/jats:title>\n<jats:p>This study applied deep learning visualization to tongue diagnosis. After collecting tongue images and corresponding interpretation reports by TCM physicians in a single teaching hospital, various tongue features such as fissures, tooth marks, and different types of coatings were annotated manually with rectangles. These annotated data and images were used to train a deep learning object detection model. Upon completion of training, the position of each tongue feature was dynamically marked.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"sec003\">\n<jats:title>Results<\/jats:title>\n<jats:p>A large high-quality manually annotated tongue feature dataset was constructed and analyzed. A detection model was trained with average precision (AP) 47.67%, 58.94%, 71.25% and 59.78% for fissures, tooth marks, thick and yellow coatings, respectively. At over 40 frames per second on a NVIDIA GeForce GTX 1060, the model was capable of detecting tongue features from any viewpoint in real time.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"sec004\">\n<jats:title>Conclusions\/Significance<\/jats:title>\n<jats:p>This study constructed a tongue feature dataset and trained a deep learning object detection model to locate tongue features in real time. The model provided interpretability and intuitiveness that are often lacking in general neural network models and implies good feasibility for clinical application.<\/jats:p>\n<\/jats:sec>","DOI":"10.1371\/journal.pone.0296070","type":"journal-article","created":{"date-parts":[[2024,3,7]],"date-time":"2024-03-07T18:46:55Z","timestamp":1709837215000},"page":"e0296070","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":15,"title":["Tongue feature dataset construction and real-time detection"],"prefix":"10.1371","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7161-497X","authenticated-orcid":true,"given":"Wen-Hsien","family":"Chang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4639-2949","authenticated-orcid":true,"given":"Chih-Chieh","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Han-Kuei","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Po-Chi","family":"Hsu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6106-2983","authenticated-orcid":true,"given":"Lun-Chien","family":"Lo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hsueh-Ting","family":"Chu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7840-1504","authenticated-orcid":true,"given":"Hen-Hong","family":"Chang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2024,3,7]]},"reference":[{"key":"pone.0296070.ref001","first-page":"505063","article-title":"The Study on the Agreement between Automatic Tongue Diagnosis System and Traditional Chinese Medicine Practitioners","volume":"2012","author":"LC Lo","year":"2012","journal-title":"Evid Based Complement Alternat Med"},{"issue":"5","key":"pone.0296070.ref002","doi-asserted-by":"crossref","first-page":"527","DOI":"10.1089\/acm.2007.0079","article-title":"Traditional Chinese medicine tongue inspection: an examination of the inter- and intrapractitioner reliability for specific tongue characteristics","volume":"14","author":"M Kim","year":"2008","journal-title":"J Altern Complement Med"},{"key":"pone.0296070.ref003","first-page":"209345","article-title":"Interobserver reliability of tongue diagnosis using traditional korean medicine for stroke patients","volume":"2012","author":"MM Ko","year":"2012","journal-title":"Evid Based Complement Alternat Med"},{"key":"pone.0296070.ref004","doi-asserted-by":"crossref","unstructured":"Lo Lc, Hou MCc, Chen Yl, Chiang JY, Hsu Cc, editors. Automatic Tongue Diagnosis System. 2009 2nd International Conference on Biomedical Engineering and Informatics; 2009 17\u201319 Oct. 2009.","DOI":"10.1109\/BMEI.2009.5304910"},{"key":"pone.0296070.ref005","first-page":"16","article-title":"Automatic tongue feature extraction","author":"Y Hsu","year":"2010","journal-title":"2010 International Computer Symposium (ICS2010)"},{"issue":"7","key":"pone.0296070.ref006","doi-asserted-by":"crossref","first-page":"672","DOI":"10.2174\/1573405614666181009133414","article-title":"Intelligent Diabetes Detection System based on Tongue Datasets","volume":"15","author":"S Naveed","year":"2019","journal-title":"Curr Med Imaging Rev"},{"key":"pone.0296070.ref007","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.neunet.2014.09.003","article-title":"Deep learning in neural networks: an overview","volume":"61","author":"J. Schmidhuber","year":"2015","journal-title":"Neural Netw"},{"issue":"12","key":"pone.0296070.ref008","article-title":"The Future Is Coming: Artificial Intelligence in the Treatment of Infertility Could Improve Assisted Reproduction Outcomes-The Value of Regulatory Frameworks","volume":"12","author":"S Medenica","year":"2022","journal-title":"Diagnostics (Basel)"},{"issue":"10","key":"pone.0296070.ref009","doi-asserted-by":"crossref","first-page":"1990","DOI":"10.1049\/iet-ipr.2019.1646","article-title":"Deep learning-based automated detection of human knee joint\u2019s synovial fluid from magnetic resonance images with transfer learning","volume":"14","author":"I Iqbal","year":"2020","journal-title":"IET Image Processing"},{"issue":"10","key":"pone.0296070.ref010","article-title":"An Intelligent Tongue Diagnosis System via Deep Learning on the Android Platform","volume":"12","author":"Z Yang","year":"2022","journal-title":"Diagnostics (Basel)"},{"key":"pone.0296070.ref011","doi-asserted-by":"crossref","first-page":"973","DOI":"10.1016\/j.csbj.2020.04.002","article-title":"Artificial intelligence in tongue diagnosis: Using deep convolutional neural network for recognizing unhealthy tongue with tooth-mark","volume":"18","author":"X Wang","year":"2020","journal-title":"Comput Struct Biotechnol J"},{"key":"pone.0296070.ref012","doi-asserted-by":"crossref","first-page":"847267","DOI":"10.3389\/fphys.2022.847267","article-title":"Weakly Supervised Deep Learning for Tooth-Marked Tongue Recognition","volume":"13","author":"J Zhou","year":"2022","journal-title":"Front Physiol"},{"issue":"16","key":"pone.0296070.ref013","doi-asserted-by":"crossref","DOI":"10.1002\/cpe.6262","article-title":"A weakly supervised tooth-mark and crack detection method in tongue image","volume":"33","author":"H Weng","year":"2021","journal-title":"CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE"},{"key":"pone.0296070.ref014","doi-asserted-by":"crossref","unstructured":"Wang C-Y, Bochkovskiy A, Liao H-YM. Scaled-YOLOv4: Scaling Cross Stage Partial Network. 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR): IEEE Computer Society; 2021. p. 13024\u201333.","DOI":"10.1109\/CVPR46437.2021.01283"},{"issue":"9","key":"pone.0296070.ref015","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1016\/S0002-9343(02)01379-7","article-title":"Benign migratory glossitis or geographic tongue: an enigmatic oral lesion","volume":"113","author":"D Assimakopoulos","year":"2002","journal-title":"Am J Med"},{"issue":"51","key":"pone.0296070.ref016","doi-asserted-by":"crossref","first-page":"e18350","DOI":"10.1097\/MD.0000000000018350","article-title":"Gender- and age-dependent tongue features in a community-based population","volume":"98","author":"PC Hsu","year":"2019","journal-title":"Medicine (Baltimore)"},{"issue":"6","key":"pone.0296070.ref017","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1016\/j.mehy.2014.03.010","article-title":"Fissured tongue: a sign of tongue edema?","volume":"82","author":"J Jarvinen","year":"2014","journal-title":"Med Hypotheses"},{"issue":"4","key":"pone.0296070.ref018","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1016\/j.oooo.2012.04.006","article-title":"Increased prevalence of geographic tongue in burning mouth complaints: a retrospective study","volume":"114","author":"V Ching","year":"2012","journal-title":"Oral Surg Oral Med Oral Pathol Oral Radiol"},{"key":"pone.0296070.ref019","unstructured":"Soto-Rojas AE, Villa Ar Fau\u2014Sifuentes-Osornio J, Sifuentes-Osornio J Fau\u2014Alarcon-Segovia D, Alarcon-Segovia D Fau\u2014Kraus A, Kraus A. Oral manifestations in patients with Sjogren\u2019s syndrome. (0315-162X (Print))."},{"key":"pone.0296070.ref020","doi-asserted-by":"crossref","unstructured":"Schnorrenberger CC, Schnorrenberger B. Pocket Atlas of tongue diagnosis: With Chinese therapy guidelines for acupuncture, herbal prescriptions, and Nutrition: Thieme; 2011.","DOI":"10.1055\/b-005-148930"},{"issue":"3","key":"pone.0296070.ref021","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1001\/archderm.1954.01540150088007","article-title":"Dermatologic manifestations of mongolism","volume":"69","author":"I Zeligman","year":"1954","journal-title":"AMA Arch Derm Syphilol"},{"issue":"2","key":"pone.0296070.ref022","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/0030-4220(82)90281-X","article-title":"Prevalence of different morphologic forms of the human tongue in young Finns","volume":"53","author":"A Kullaa-Mikkonen","year":"1982","journal-title":"Oral Surg Oral Med Oral Pathol"},{"issue":"5","key":"pone.0296070.ref023","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1111\/j.1399-0004.1996.tb02381.x","article-title":"Dermatological manifestations of 71 Down syndrome children admitted to a clinical genetics unit","volume":"50","author":"M Ercis","year":"1996","journal-title":"CLINICAL GENETICS"},{"issue":"1","key":"pone.0296070.ref024","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1186\/1471-5945-4-16","article-title":"Tongue lesions in psoriasis: a controlled study","volume":"4","author":"M Daneshpazhooh","year":"2004","journal-title":"BMC Dermatol"},{"issue":"2","key":"pone.0296070.ref025","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1111\/j.1365-2230.2005.02028.x","article-title":"The prevalence and significance of fissured tongue and geographical tongue in psoriatic patients","volume":"31","author":"O. Zargari","year":"2006","journal-title":"Clin Exp Dermatol"},{"issue":"6","key":"pone.0296070.ref026","doi-asserted-by":"crossref","first-page":"490","DOI":"10.1016\/j.oooo.2019.01.080","article-title":"Association of geographic tongue and fissured tongue with ABO blood group among adult psoriasis patients: a novel study from a tertiary care hospital in Saudi Arabia","volume":"127","author":"NA Al Qahtani","year":"2019","journal-title":"Oral Surg Oral Med Oral Pathol Oral Radiol"},{"issue":"11","key":"pone.0296070.ref027","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1111\/j.1365-2842.2007.01734.x","article-title":"Influence of tongue pressure and width on tongue indentation formation","volume":"34","author":"K Yanagisawa","year":"2007","journal-title":"J Oral Rehabil"},{"issue":"6","key":"pone.0296070.ref028","doi-asserted-by":"crossref","first-page":"966","DOI":"10.1016\/j.otohns.2005.07.018","article-title":"The association of tongue scalloping with obstructive sleep apnea and related sleep pathology","volume":"133","author":"TM Weiss","year":"2005","journal-title":"OTOLARYNGOLOGY-HEAD AND NECK SURGERY"},{"issue":"8","key":"pone.0296070.ref029","doi-asserted-by":"crossref","first-page":"602","DOI":"10.1111\/joor.12526","article-title":"Scalloped tongue is associated with nocturnal intermittent hypoxia among community-dwelling Japanese: the Toon Health Study","volume":"44","author":"K Tomooka","year":"2017","journal-title":"JOURNAL OF ORAL REHABILITATION"},{"issue":"8","key":"pone.0296070.ref030","doi-asserted-by":"crossref","first-page":"627","DOI":"10.1016\/j.jdent.2007.04.009","article-title":"A review of the current literature on aetiology and measurement methods of halitosis","volume":"35","author":"A van den Broek","year":"2007","journal-title":"JOURNAL OF DENTISTRY"},{"key":"pone.0296070.ref031","first-page":"2015","article-title":"The Metabonomic Studies of Tongue Coating in H. pylori Positive Chronic Gastritis Patients","author":"X Liu","year":"2015","journal-title":"EVIDENCE-BASED COMPLEMENTARY AND ALTERNATIVE MEDICINE"},{"issue":"6","key":"pone.0296070.ref032","doi-asserted-by":"crossref","first-page":"736","DOI":"10.1111\/joor.12964","article-title":"Food intake and oral health status of inpatients with dysphagia in acute care settings","volume":"47","author":"J Furuya","year":"2020","journal-title":"JOURNAL OF ORAL REHABILITATION"},{"issue":"4","key":"pone.0296070.ref033","doi-asserted-by":"crossref","first-page":"563","DOI":"10.1007\/s40257-017-0268-y","article-title":"Black Hairy Tongue: Predisposing Factors, Diagnosis, and Treatment","volume":"18","author":"E Schlager","year":"2017","journal-title":"Am J Clin Dermatol"},{"issue":"6","key":"pone.0296070.ref034","doi-asserted-by":"crossref","first-page":"287","DOI":"10.2188\/jea.JE20160169","article-title":"Yellow Tongue Coating is Associated With Diabetes Mellitus Among Japanese Non-smoking Men and Women: The Toon Health Study","volume":"28","author":"K Tomooka","year":"2018","journal-title":"JOURNAL OF EPIDEMIOLOGY"},{"key":"pone.0296070.ref035","doi-asserted-by":"crossref","first-page":"S143","DOI":"10.3233\/THC-171316","article-title":"Objective research on tongue manifestation of patients with eczema","volume":"25","author":"ZF Yu","year":"2017","journal-title":"TECHNOLOGY AND HEALTH CARE"},{"key":"pone.0296070.ref036","doi-asserted-by":"crossref","first-page":"32496","DOI":"10.1038\/srep32496","article-title":"Bacillus as a potential diagnostic marker for yellow tongue coating","volume":"6","author":"J Ye","year":"2016","journal-title":"Sci Rep"},{"key":"pone.0296070.ref037","author":"K. Wada","journal-title":"Labelme: Image Polygonal Annotation with Python"},{"key":"pone.0296070.ref038","volume-title":"Computer Vision\u2013ECCV 2014","author":"T-Y Lin","year":"2014"},{"issue":"2","key":"pone.0296070.ref039","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s11263-009-0275-4","article-title":"The Pascal Visual Object Classes (VOC) Challenge","volume":"88","author":"M Everingham","year":"2010","journal-title":"International Journal of Computer Vision"},{"issue":"3","key":"pone.0296070.ref040","doi-asserted-by":"crossref","first-page":"400","DOI":"10.1214\/aoms\/1177729586","article-title":"A Stochastic Approximation Method","volume":"22","author":"H Robbins","year":"1951","journal-title":"The Annals of Mathematical Statistics"},{"key":"pone.0296070.ref041","unstructured":"Loshchilov I, Hutter F, editors. SGDR: Stochastic Gradient Descent with Warm Restarts. International Conference on Learning Representations; 2017."},{"issue":"10","key":"pone.0296070.ref042","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1080\/08839514.2021.1922841","article-title":"Comparative Investigation of Learning Algorithms for Image Classification with Small Dataset","volume":"35","author":"I Iqbal","year":"2021","journal-title":"Applied Artificial Intelligence"},{"key":"pone.0296070.ref043","unstructured":"Xu S, Wang X, Lv W, Chang Q, Cui C, Deng K, et al. PP-YOLOE: An evolved version of YOLO2022 March 01, 2022:[arXiv:2203.16250 p.].https:\/\/ui.adsabs.harvard.edu\/abs\/2022arXiv220316250X."},{"key":"pone.0296070.ref044","unstructured":"Zhang H, Li F, Liu S, Zhang L, Su H, Zhu J, et al., editors. DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detection. The Eleventh International Conference on Learning Representations; 2023."},{"key":"pone.0296070.ref045","first-page":"13029","author":"C-Y Wang","year":"2021","journal-title":"Scaled-YOLOv4: Scaling Cross Stage Partial Network"},{"issue":"1","key":"pone.0296070.ref046","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1007\/s44196-023-00302-w","article-title":"Statistical Analysis of Design Aspects of Various YOLO-Based Deep Learning Models for Object Detection","volume":"16","author":"U Sirisha","year":"2023","journal-title":"International Journal of Computational Intelligence Systems"},{"issue":"7","key":"pone.0296070.ref047","doi-asserted-by":"crossref","first-page":"677","DOI":"10.3390\/machines11070677","article-title":"YOLO-v1 to YOLO-v8, the Rise of YOLO and Its Complementary Nature toward Digital Manufacturing and Industrial Defect Detection","volume":"11","author":"M. Hussain","year":"2023","journal-title":"Machines"},{"key":"pone.0296070.ref048","first-page":"132","article-title":"A comprehensive review of object detection with deep learning","author":"R Kaur","year":"2023","journal-title":"DIGITAL SIGNAL PROCESSING"},{"issue":"3","key":"pone.0296070.ref049","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1109\/JPROC.2023.3238524","article-title":"Object Detection in 20 Years: A Survey","volume":"111","author":"Z Zou","year":"2023","journal-title":"Proceedings of the IEEE"},{"issue":"14","key":"pone.0296070.ref050","doi-asserted-by":"crossref","first-page":"21353","DOI":"10.1007\/s11042-022-13801-3","article-title":"A survey: object detection methods from CNN to transformer","volume":"82","author":"E Arkin","year":"2023","journal-title":"Multimedia Tools and Applications"},{"key":"pone.0296070.ref051","doi-asserted-by":"crossref","first-page":"7452427","DOI":"10.1155\/2017\/7452427","article-title":"Tongue Images Classification Based on Constrained High Dispersal Network","volume":"2017","author":"D Meng","year":"2017","journal-title":"Evid Based Complement Alternat Med"},{"key":"pone.0296070.ref052","doi-asserted-by":"crossref","unstructured":"Hou J, Su H, Yan B, Zheng H, Sun Z, Cai X, editors. Classification of tongue color based on CNN. 2017 IEEE 2nd International Conference on Big Data Analysis (ICBDA)(2017 10\u201312 March 2017.","DOI":"10.1109\/ICBDA.2017.8078731"},{"key":"pone.0296070.ref053","first-page":"239","article-title":"A two-stage deep transfer learning model and its application for medical image processing in Traditional Chinese Medicine","author":"X Zhang","year":"2022","journal-title":"KNOWLEDGE-BASED SYSTEMS"}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0296070","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,7]],"date-time":"2024-03-07T18:47:40Z","timestamp":1709837260000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0296070"}},"subtitle":[],"editor":[{"given":"Kathiravan","family":"Srinivasan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2024,3,7]]},"references-count":53,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2024,3,7]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0296070","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,7]]}}}