{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,10]],"date-time":"2026-10-10T06:33:56Z","timestamp":1791614036460,"version":"4.3.4"},"reference-count":55,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,3,13]],"date-time":"2023-03-13T00:00:00Z","timestamp":1678665600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Med. Technol."],"abstract":"\n Background<\/jats:title>\n In Kampo medicine, tongue examination is used to diagnose the pathological condition \u201cSho,\u201d but an objective evaluation method for its diagnostic ability has not been established. We constructed a tongue diagnosis electronic learning and evaluation system based on a standardized tongue image database.<\/jats:p>\n <\/jats:sec>\n \n Purpose<\/jats:title>\n This study aims to verify the practicality of this assessment system by evaluating the tongue diagnosis ability of Kampo specialists (KSs), medical professionals, and students.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n In the first study, we analyzed the answer data of 15 KSs in an 80-question tongue diagnosis test that assesses eight aspects of tongue findings and evaluated the (i) test score, (ii) test difficulty and discrimination index, (iii) diagnostic consistency, and (iv) diagnostic match rate between KSs. In the second study, we administered a 20-question common Kampo test and analyzed the answer data of 107 medical professionals and 56 students that assessed the tongue color discrimination ability and evaluated the (v) correct answer rate, (vi) test difficulty, and (vii) factors related to the correct answer rate.<\/jats:p>\n <\/jats:sec>\n \n Result<\/jats:title>\n \n In the first study, the average test score was 62.2\u2009\u00b1\u200910.7 points. Twenty-eight questions were difficult (correct answer rate, &lt;50%), 34 were moderate (50%\u201385%), and 18 were easy (\u226585%). Regarding intrarater reliability, the average diagnostic match rate of five KSs involved in database construction was 0.66\u2009\u00b1\u20090.08, and as for interrater reliability, the diagnostic match rate between the 15 KSs was 0.52 (95% confidence interval, 0.38\u20130.65) for Gwet's agreement coefficient 1, and the degree of the match rate was moderate. In the second study, the difficulty level of questions was moderate, with a correct rate of 81.3% for medical professionals and 82.1% for students. The discrimination index was good for medical professionals (0.35) and poor for students (0.06). Among medical professionals, the correct answer group of this question had a significantly higher total score on the Kampo common test than the incorrect answer group (85.3\u2009\u00b1\u20098.4 points vs. 75.8\u2009\u00b1\u200911.8 points,\n p<\/jats:italic>\n \u2009&lt;\u20090.01).\n <\/jats:p>\n <\/jats:sec>\n \n Conclusion<\/jats:title>\n This system can objectively evaluate tongue diagnosis ability and has high practicality. Utilizing this system can be expected to contribute to improving learners\u2019 tongue diagnosis ability and standardization of tongue diagnosis.<\/jats:p>\n <\/jats:sec>","DOI":"10.3389\/fmedt.2023.1050909","type":"journal-article","created":{"date-parts":[[2023,3,13]],"date-time":"2023-03-13T01:40:11Z","timestamp":1678671611000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Objective evaluation of tongue diagnosis ability using a tongue diagnosis e-learning\/e-assessment system based on a standardized tongue image database"],"prefix":"10.3389","volume":"5","author":[{"given":"Makoto","family":"Segawa","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Norio","family":"Iizuka","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hiroyuki","family":"Ogihara","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Koichiro","family":"Tanaka","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hajime","family":"Nakae","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Koichiro","family":"Usuku","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kojiro","family":"Yamaguchi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kentaro","family":"Wada","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Akihiro","family":"Uchizono","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuji","family":"Nakamura","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yoshihiro","family":"Nishida","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Toshiko","family":"Ueda","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Atsuko","family":"Shiota","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Naoko","family":"Hasunuma","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kyoko","family":"Nakahara","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Miwa","family":"Hebiguchi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yoshihiko","family":"Hamamoto","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2023,3,13]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1007\/s10120-016-0680-7","article-title":"Development of an e-learning system for teaching endoscopists how to diagnose early gastric cancer: basic principles for improving early detection","volume":"20","author":"Yao","year":"2017","journal-title":"Gastric Cancer"},{"key":"B2","doi-asserted-by":"publisher","first-page":"565","DOI":"10.1016\/j.radi.2021.12.002","article-title":"A narrative review of e-learning in professional education of healthcare professionals in medical imaging and radiation therapy","volume":"28","author":"Konstantinidis","year":"2022","journal-title":"Radiography"},{"key":"B3","doi-asserted-by":"publisher","first-page":"152","DOI":"10.1542\/peds.110.1.152","article-title":"Continuous professional development: raising the bar for pediatricians","volume":"110","author":"Sectish","year":"2002","journal-title":"Pediatrics"},{"key":"B4","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1177\/147323000603400301","article-title":"Traditional Chinese medicine and Kampo: a review from the distant past for the future","volume":"34","author":"Yu","year":"2006","journal-title":"J Int Med Res"},{"key":"B5","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1093\/ecam\/neh022","article-title":"Evidence-based reconstruction of Kampo medicine: part II\u2014the concept of Sho","volume":"1","author":"Terasawa","year":"2004","journal-title":"Evid Based Comp Alternat Med"},{"key":"B6","year":""},{"key":"B7","year":""},{"key":"B8","doi-asserted-by":"publisher","first-page":"224","DOI":"10.3937\/kampomed.65.224","article-title":"Japanese literature survey of tongue findings for the purpose of creating a unified multicenter description of clinical tongue diagnoses","volume":"65","author":"Oji","year":"2014","journal-title":"Kampo Med"},{"key":"B9","doi-asserted-by":"publisher","first-page":"284","DOI":"10.3937\/kampomed.71.284","article-title":"Solution proposal for 5 challenges to be resolved in formalizing the local format of Kampo-based diagnosis by building consensus among 6 medical institutions specialized in Kampo herbal medicine (in Japanese)","volume":"73","author":"Odaguchi","year":"2020","journal-title":"Kampo Med"},{"key":"B10","doi-asserted-by":"publisher","first-page":"760542","DOI":"10.3389\/fmedt.2021.760542","article-title":"Construction of a standardized tongue image database for diagnostic education: development of a tongue diagnosis e-learning system","volume":"3","author":"Segawa","year":"2021","journal-title":"Front Med Technol"},{"key":"B11","first-page":"38","article-title":"Examination method in Kampo","volume-title":"Textbook of Kampo medicine for experts.","author":"Hanawa","year":"2009"},{"key":"B12","year":""},{"key":"B13","first-page":"19","article-title":"Item analysis of non-curriculum-based ability test based upon discrimination index","volume":"35","author":"Akane","year":"2006","journal-title":"Res Bull."},{"key":"B14","volume-title":"Handbook of inter-rater reliability. The definitive guide to measuring the extent of agreement among raters. Fifth edition. Volume 1. Analysis of categorical rating","author":"Gwet","year":"2021"},{"key":"B15","doi-asserted-by":"publisher","first-page":"1485","DOI":"10.6009\/jjrt.66.1485","article-title":"A robust statistic AC1 for assessing inter-observer agreement in reliability studies","volume":"66","author":"Nishiura","year":"2010","journal-title":"Jpn J Radiol Technol"},{"key":"B16","volume-title":"Essential lecture on Kampo medicine","year":"2020"},{"key":"B17","article-title":"Report of the 71st annual meeting of the Japanese society for oriental medicine special program 1\u2014\u201cPre-and post-graduation education of Kampo medicine for the next generation\u201d: system construction, practice, and question explanation for the common Kampo test","author":"Iizuka","year":"2022","journal-title":"Kampo Med"},{"key":"B18","doi-asserted-by":"publisher","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","volume":"33","author":"Landis","year":"1977","journal-title":"Biometrics"},{"key":"B19","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1037\/1040-3590.6.4.284","article-title":"Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology","volume":"6","author":"Cicchetti","year":"1994","journal-title":"Psychol Assess"},{"key":"B20","doi-asserted-by":"publisher","first-page":"249609","DOI":"10.1155\/2015\/249609","article-title":"Proposal for a new noncontact method for measuring tongue moisture to assist in tongue diagnosis and development of the tongue image analyzing system, which can separately record the gloss components of the tongue","volume":"2015","author":"Nakaguchi","year":"2015","journal-title":"Biomed Res Int"},{"key":"B21","doi-asserted-by":"publisher","first-page":"104358","DOI":"10.1016\/j.compbiomed.2021.104358","article-title":"Computational traditional Chinese medicine diagnosis: a literature survey","volume":"133","author":"Qi","year":"2021","journal-title":"Comput Biol Med"},{"key":"B22","first-page":"3","article-title":"Introduction to tongue image analysis","volume-title":"Tongue image analysis","author":"Zhang","year":"2016"},{"key":"B23","doi-asserted-by":"publisher","first-page":"973","DOI":"10.1016\/j.csbj.2020.04.002","article-title":"Artificial intelligence in tongue diagnosis: using deep convolutional neural network for recognizing unhealthy tongue with tooth-mark","volume":"18","author":"Wang","year":"2020","journal-title":"Comput Struct Biotechnol J"},{"key":"B24","doi-asserted-by":"publisher","first-page":"6656053","DOI":"10.1155\/2021\/6656053","article-title":"Development and application of artificial intelligence in auxiliary TCM diagnosis","volume":"2021","author":"Feng","year":"2021","journal-title":"Evid Based Comp Alternat Med"},{"key":"B25","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1186\/s12911-021-01508-8","article-title":"Tongue image quality assessment based on a deep convolutional neural network","volume":"21","author":"Jiang","year":"2021","journal-title":"BMC Med Inform Decis Mak"},{"key":"B26","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1016\/j.cmpb.2017.12.029","article-title":"Automated tongue diagnosis on the smartphone and its applications","volume":"174","author":"Hu","year":"2019","journal-title":"Comput Methods Programs Biomed"},{"key":"B27","doi-asserted-by":"publisher","first-page":"177","DOI":"10.3390\/healthcare9020177","article-title":"Can traditional Chinese medicine diagnosis be parameterized and standardized? A narrative review","volume":"9","author":"Matos","year":"2021","journal-title":"Healthcare"},{"key":"B28","doi-asserted-by":"publisher","first-page":"1938504","DOI":"10.1080\/10872981.2021.1938504","article-title":"Development of Kampo (traditional Japanese medicine) e-learning program: evaluation of the flipped classroom for medical students","volume":"26","author":"Ito","year":"2021","journal-title":"Med Educ Online"},{"key":"B29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11655-015-2135-0","article-title":"Education of Chinese medicine tongue by automatic tongue diagnosis system","author":"Lo","year":"2015","journal-title":"Chin Integr Ed"},{"key":"B30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11655-016-2733-5","article-title":"Digital education and dynamic assessment of tongue diagnosis based on mashup technique","author":"Tsai","year":"2017","journal-title":"Chin Integr Med"},{"key":"B31","doi-asserted-by":"publisher","first-page":"2043535","DOI":"10.1155\/2016\/2043535","article-title":"Web-based evaluation system to measure learning effectiveness in Kampo medicine","volume":"2016","author":"Iizuka","year":"2016","journal-title":"Evid Based Complement Alternat Med"},{"key":"B32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/tkm2.1207","article-title":"Web-based evaluation system for closing the education gap in Kampo medicine between facilities","volume":"6","author":"Iizuka","year":"2019","journal-title":"Trad Kampo Med"},{"key":"B33","doi-asserted-by":"publisher","first-page":"8491057","DOI":"10.1155\/2018\/8491057","article-title":"Tongue image database construction based on the expert opinions: assessment for individual agreement and methods for expert selection","volume":"2018","author":"Qi","year":"2018","journal-title":"Evid Based Complement Alternat Med"},{"key":"B34","doi-asserted-by":"publisher","first-page":"727","DOI":"10.1089\/acm.2008.0554","article-title":"Understanding the reliability of diagnostic variables in a Chinese medicine examination","volume":"15","author":"O'Brien","year":"2009","journal-title":"J Altern Complement Med"},{"key":"B35","doi-asserted-by":"publisher","first-page":"527","DOI":"10.1089\/acm.2007.0079","article-title":"Traditional Chinese medicine tongue inspection: an examination of the inter- and intrapractitioner reliability for specific tongue characteristics","volume":"14","author":"Kim","year":"2008","journal-title":"J Altern Complement Med"},{"key":"B36","doi-asserted-by":"publisher","first-page":"e16018","DOI":"10.2196\/16018","article-title":"Intra-rater and inter-rater reliability of tongue coating diagnosis in traditional Chinese medicine using smartphones: quasi-Delphi study","volume":"8","author":"Wang","year":"2020","journal-title":"JMIR Mhealth Uhealth"},{"key":"B37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1515\/mr-2021-0018","article-title":"Digital tongue image analyses for health assessment","author":"Xie","year":"2022","journal-title":"Med Rev"},{"key":"B38","doi-asserted-by":"publisher","first-page":"376716","DOI":"10.1155\/2015\/376716","article-title":"Advances in patient classification for traditional Chinese medicine: a machine learning perspective","volume":"2015","author":"Zhao","year":"2015","journal-title":"Evid Based Complement Alternat Med"},{"key":"B39","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1016\/j.imr.2018.03.001","article-title":"Advances in automated tongue diagnosis techniques","volume":"8","author":"Tania","year":"2019","journal-title":"Integr Med Res"},{"key":"B40","doi-asserted-by":"publisher","first-page":"505063","DOI":"10.1155\/2012\/505063","article-title":"The study on the agreement between automatic tongue diagnosis system and traditional Chinese medicine practitioners","volume":"2012","author":"Lo","year":"2012","journal-title":"Evid Based Complement Alternat Med"},{"key":"B41","doi-asserted-by":"publisher","first-page":"1014","DOI":"10.1002\/bjs.10837","article-title":"Interobserver variability in the classification of appendicitis during laparoscopy","volume":"105","author":"van den Boom","year":"2018","journal-title":"Br J Surg"},{"key":"B42","first-page":"18","article-title":"Understanding diagnostic reasoning in TCM practice: tongue diagnosis","volume":"15","author":"Anastasi","year":"2009","journal-title":"Altern Ther Health Med"},{"key":"B43","doi-asserted-by":"publisher","first-page":"380","DOI":"10.1109\/TCYB.2017.2772289","article-title":"Tooth-marked tongue recognition using multiple instance learning and CNN features","volume":"49","author":"Li","year":"2019","journal-title":"IEEE Trans Cybern"},{"key":"B44","doi-asserted-by":"publisher","first-page":"458","DOI":"10.1016\/j.clindermatol.2016.02.018","article-title":"Diseases of the tongue","volume":"34","author":"Mangold","year":"2016","journal-title":"Clin Dermatol"},{"key":"B45","doi-asserted-by":"crossref","first-page":"886","DOI":"10.61872\/sdj-2016-10-204","article-title":"Frequency of fissured tongue (lingua plicata) as a function of age","volume":"126","author":"Feil","year":"2016","journal-title":"Swiss Dent J"},{"key":"B46","doi-asserted-by":"publisher","first-page":"4596560","DOI":"10.1155\/2019\/4596560","article-title":"Predictive value of fissured tongue in functional dyspepsia combined with depression","volume":"2019","author":"Song","year":"2019","journal-title":"Gastroenterol Res Pract"},{"key":"B47","doi-asserted-by":"publisher","first-page":"442","DOI":"10.1111\/j.1365-2842.2007.01733.x","article-title":"New method for evaluation of tongue-coating status","volume":"34","author":"Shimizu","year":"2007","journal-title":"J Oral Rehabil"},{"key":"B48","year":""},{"key":"B49","first-page":"13","article-title":"The foundations of tongue diagnosis","volume-title":"Atlas of Chinese tongue diagnosis","author":"Kirschbaum","year":"2010"},{"key":"B50","doi-asserted-by":"publisher","first-page":"e18350","DOI":"10.1097\/MD.0000000000018350","article-title":"Gender- and age-dependent tongue features in a community-based population","volume":"98","author":"Hsu","year":"2019","journal-title":"Medicine"},{"key":"B51","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1016\/j.jtcme.2015.07.004","article-title":"Tongue color changes within a menstrual cycle in eumenorrheic women","volume":"6","author":"Hsieh","year":"2015","journal-title":"J Tradit Complement Med"},{"key":"B52","doi-asserted-by":"publisher","first-page":"5336","DOI":"10.1109\/TI.P.2013.2284070","article-title":"Statistical analysis of tongue images for feature extraction and diagnostics","volume":"22","author":"Wang","year":"2013","journal-title":"IEEE Trans Image Process"},{"key":"B53","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1016\/j.survophthal.2015.11.004","article-title":"Acquired color vision deficiency","volume":"61","author":"Simunovic","year":"2016","journal-title":"Surv Ophthalmol"},{"key":"B54","doi-asserted-by":"publisher","first-page":"1408","DOI":"10.1136\/bjo.86.12.1408","article-title":"New Farnsworth-Munsell 100 hue test norms of normal observers for each year of age 5\u201322 and for age decades 30\u201370","volume":"86","author":"Kinnear","year":"2002","journal-title":"Br J Ophthalmol"},{"key":"B55","doi-asserted-by":"publisher","first-page":"783102","DOI":"10.1155\/2014\/783102","article-title":"Study of factors involved in tongue color diagnosis by Kampo medical practitioners using the Farnsworth-Munsell 100 hue test and tongue color images","volume":"2014","author":"Oji","year":"2014","journal-title":"Evid Based Complementary Altern"}],"container-title":["Frontiers in Medical Technology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fmedt.2023.1050909\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,16]],"date-time":"2024-10-16T02:24:56Z","timestamp":1729045496000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fmedt.2023.1050909\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,13]]},"references-count":55,"alternative-id":["10.3389\/fmedt.2023.1050909"],"URL":"https:\/\/doi.org\/10.3389\/fmedt.2023.1050909","relation":{},"ISSN":["2673-3129"],"issn-type":[{"value":"2673-3129","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,13]]},"article-number":"1050909"}}