{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,21]],"date-time":"2026-10-21T16:51:57Z","timestamp":1792601517745,"version":"4.5.0"},"reference-count":55,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,12,15]],"date-time":"2025-12-15T00:00:00Z","timestamp":1765756800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003593","name":"Conselho Nacional de Desenvolvimento Cient\u00edfico e Tecnol\u00f3gico","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004901","name":"Funda\u00e7\u00e3o de Amparo \u00e0 Pesquisa do Estado de Minas Gerais","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100004901","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Oral Health"],"abstract":"<jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To compare the accuracy and consistency of five large language models (LLMs) in generating responses about dental trauma.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and methods<\/jats:title>\n                    <jats:p>\n                      Sixty dichotomous (true\/false) questions were submitted daily to each LLM (ChatGPT, Google Gemini, Microsoft Copilot, DeepSeek, and Meta AI) for 30 days, totaling 18,000 responses. All interactions were performed under two prompting conditions (zero-shot and zero-shot with context). LLM responses were compared against the International Association of Dental Traumatology (IADT) guidelines. Statistical analysis was conducted using a generalized linear mixed model (GLMM) with a binomial distribution (\n                      <jats:italic>\u03b1<\/jats:italic>\n                      \u2009=\u20090.05), alongside calculation of sensitivity, specificity, accuracy, and area under the ROC curve (AUC) based on the 60-item set. Temporal stability was assessed using the intraclass correlation coefficient ICC.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      All LLMs achieved accuracy above 85%, with Microsoft Copilot (91.1%) and DeepSeek (90%) performing best; no significant difference was observed between them (\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&amp;gt;\u20090.05), but both outperformed the other models (\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&amp;lt;\u20090.05). DeepSeek and Microsoft Copilot also showed the highest consistency over 30 days (ICC\u2009&amp;gt;\u20090.90).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>All evaluated LLMs, particularly Copilot and DeepSeek, demonstrated high accuracy in providing information on dental trauma, with stable performance over time. While the use of a context prompt did not significantly affect accuracy or stability.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/froh.2025.1737114","type":"journal-article","created":{"date-parts":[[2025,12,16]],"date-time":"2025-12-16T11:56:10Z","timestamp":1765886170000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":15,"title":["Performance of five free large language models in dental trauma: a 30-day longitudinal benchmark study"],"prefix":"10.3389","volume":"6","author":[{"given":"Rafaela Mancini","family":"Lisboa","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arian","family":"Braido","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adriana","family":"de-Jesus-Soares","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nitesh","family":"Tewari","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carlos Jos\u00e9","family":"Soares","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Luiz Renato","family":"Paranhos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Walbert A.","family":"Vieira","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2025,12,15]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"103002","DOI":"10.1016\/j.technovation.2024.103002","article-title":"Future applications of generative large language models: a data-driven case study on ChatGPT","volume":"133","author":"Chiarello","year":"2024","journal-title":"Technovation"},{"key":"B2","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1038\/s41746-025-01546-w","article-title":"Evaluating search engines and large language models for answering health questions","volume":"8","author":"Fern\u00e1ndez-Pichel","year":"2025","journal-title":"NPJ Digit Med"},{"key":"B3","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1016\/j.iotcps.2023.04.003","article-title":"ChatGPT: a comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope","volume":"3","author":"Ray","year":"2023","journal-title":"Internet Things Cyber Phys Syst"},{"key":"B4","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1016\/j.jpainsymman.2024.11.016","article-title":"Large language models to identify advance care planning in patients with advanced cancer","volume":"69","author":"Agaronnik","year":"2025","journal-title":"J Pain Symptom Manage"},{"key":"B5","doi-asserted-by":"publisher","first-page":"109267","DOI":"10.1016\/j.surg.2025.109267","article-title":"Use of large language models as clinical decision support tools for management pancreatic adenocarcinoma using national comprehensive cancer network guidelines","volume":"182","author":"Kaiser","year":"2025","journal-title":"Surgery"},{"key":"B6","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1007\/s10916-025-02170-7","article-title":"Large language Models\u2019 responses to spinal cord injury: a comparative study of performance","volume":"49","author":"Li","year":"2025","journal-title":"J Med Syst"},{"key":"B7","doi-asserted-by":"publisher","first-page":"19028","DOI":"10.1038\/s41598-025-04309-5","article-title":"Evaluating performance of large language models for atrial fibrillation management using different prompting strategies and languages","volume":"15","author":"Li","year":"2025","journal-title":"Sci Rep"},{"key":"B8","doi-asserted-by":"publisher","first-page":"1546","DOI":"10.1111\/iej.14127","article-title":"Artificial intelligence in endodontics: fundamental principles, workflow, and tasks","volume":"57","author":"Ourang","year":"2024","journal-title":"Int Endodontic J"},{"key":"B9","doi-asserted-by":"publisher","first-page":"530","DOI":"10.1111\/edt.12953","article-title":"Epidemiological profile of luxations injuries with or without dental fractures in permanent teeth: a 10-years retrospective study","volume":"40","author":"Amilcar","year":"2024","journal-title":"Dent Traumatol"},{"key":"B10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1590\/0103-6440202305257","article-title":"Epidemiology and severity of traumatic dental injuries in permanent teeth: a 20-year retrospective study","volume":"34","author":"Vieira","year":"2023","journal-title":"Braz Dent J"},{"key":"B11","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1111\/edt.12389","article-title":"World traumatic dental injury prevalence and incidence, a meta-analysis\u2014one billion living people have had traumatic dental injuries","volume":"34","author":"Petti","year":"2018","journal-title":"Dent Traumatol"},{"key":"B12","doi-asserted-by":"publisher","first-page":"e00015920","DOI":"10.1590\/0102-311x00015920","article-title":"Prevalence of dental trauma in Brazilian children and adolescents: a systematic review and meta-analysis","volume":"37","author":"Vieira","year":"2021","journal-title":"Cad Saude Publica"},{"key":"B13","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1038\/s41415-024-7641-z","article-title":"Long-term complications and management of dental trauma in the adult patient\u2014part 1: fractured teeth, pulpal complications and resorption","volume":"237","author":"Jogezai","year":"2024","journal-title":"Br Dent J"},{"key":"B14","doi-asserted-by":"publisher","first-page":"481","DOI":"10.1007\/s40368-024-00906-6","article-title":"Dental pain in Brazilian preschool children: association with the severity of dental caries and impact on oral health-related quality of life","volume":"25","author":"Fernandez","year":"2024","journal-title":"Eur Arch Paediatr Dent"},{"key":"B15","doi-asserted-by":"publisher","first-page":"612","DOI":"10.1111\/edt.12967","article-title":"Public health policies in dental traumatology: a call for action!","volume":"40","author":"Brandini","year":"2024","journal-title":"Dent Traumatol"},{"key":"B16","doi-asserted-by":"publisher","first-page":"477","DOI":"10.1111\/edt.12987","article-title":"The importance of immediate dental trauma care: comprehensive education, treatment approaches, and their profound impact on patients\u2019 quality of life","volume":"40","author":"Budak","year":"2024","journal-title":"Dent Traumatol"},{"key":"B17","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1038\/s41432-023-00883-7","article-title":"Global status of knowledge of parents for emergency management of traumatic dental injuries: a systematic review and meta-analysis","volume":"24","author":"Tewari","year":"2023","journal-title":"Evid Based Dent"},{"key":"B18","doi-asserted-by":"publisher","first-page":"2025","DOI":"10.1016\/j.injury.2021.06.006","article-title":"Global status of knowledge for the prevention and emergency management of traumatic dental injuries among non-dental healthcare professionals: a systematic review and meta-analysis","volume":"52","author":"Tewari","year":"2021","journal-title":"Injury"},{"key":"B19","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1111\/edt.12621","article-title":"Global status of knowledge for prevention and emergency management of traumatic dental injuries in dental professionals: systematic review and meta-analysis","volume":"37","author":"Tewari","year":"2021","journal-title":"Dent Traumatol"},{"key":"B20","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1111\/j.1600-9657.2009.00818.x","article-title":"Contradictions in the treatment of traumatic dental injuries and ways to proceed in dental trauma research*","volume":"26","author":"Andreasen","year":"2010","journal-title":"Dent Traumatol"},{"key":"B21","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1111\/edt.13018","article-title":"Management of complications in dental traumatology","volume":"41","author":"de Gregorio","year":"2025","journal-title":"Dent Traumatol"},{"key":"B22","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1111\/edt.12927","article-title":"The international association of dental traumatology (IADT) and the academy for sports dentistry (ASD) guidelines for prevention of traumatic dental injuries: part 7: orthodontics for the prevention of dental and oral trauma","volume":"40","author":"Abbott","year":"2024","journal-title":"Dent Traumatol"},{"key":"B23","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1111\/edt.12925","article-title":"The international association of dental traumatology (IADT) and the academy for sports dentistry (ASD) guidelines for prevention of traumatic dental injuries: part 3: mouthguards for the prevention of dental and oral trauma","volume":"40","author":"Abbott","year":"2024","journal-title":"Dent Traumatol"},{"key":"B24","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1111\/edt.12924","article-title":"The international association of dental traumatology (IADT) and the academy for sports dentistry (ASD) guidelines for prevention of traumatic dental injuries: part 2: primary prevention of dental trauma across the life course","volume":"40","author":"O\u2019Connell","year":"2024","journal-title":"Dent Traumatol"},{"key":"B25","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1111\/edt.12929","article-title":"The international association of dental traumatology (IADT) and the academy for sports dentistry (ASD) guidelines for prevention of traumatic dental injuries: part 5: secondary prevention of dental injuries","volume":"40","author":"Tewari","year":"2024","journal-title":"Dent Traumatol"},{"key":"B26","doi-asserted-by":"publisher","first-page":"1229","DOI":"10.1016\/j.joen.2025.05.012","article-title":"Dental trauma evo\u2014development of an artificial intelligence-powered chatbot to support professional management of dental trauma","volume":"51","author":"Bubna","year":"2025","journal-title":"J Endod"},{"key":"B27","doi-asserted-by":"publisher","first-page":"616","DOI":"10.1016\/j.identj.2023.12.007","article-title":"Performance of generative artificial intelligence in dental licensing examinations","volume":"74","author":"Chau","year":"2024","journal-title":"Int Dent J"},{"key":"B28","doi-asserted-by":"publisher","first-page":"279","DOI":"10.3390\/dj13070279","article-title":"Evaluation of chatbot responses to text-based multiple-choice questions in prosthodontic and restorative dentistry","volume":"13","author":"Chau","year":"2025","journal-title":"Dent J"},{"key":"B29","doi-asserted-by":"publisher","first-page":"719","DOI":"10.1016\/j.oooo.2024.12.028","article-title":"Efficacy and empathy of AI chatbots in answering frequently asked questions on oral oncology","volume":"139","author":"Rokhshad","year":"2025","journal-title":"Oral Surg Oral Med Oral Pathol Oral Radiol"},{"key":"B30","doi-asserted-by":"publisher","first-page":"e0317423","DOI":"10.1371\/journal.pone.0317423","article-title":"Accuracy of latest large language models in answering multiple choice questions in dentistry: a comparative study","volume":"20","author":"Nguyen","year":"2025","journal-title":"PLoS One"},{"key":"B31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.11607\/ijp.9504","article-title":"Comparative performance of deep-reasoning and lightweight large language models on oral implantology multiple-choice questions","author":"Nguyen","year":"2025","journal-title":"Int J Prosthodont"},{"key":"B32","doi-asserted-by":"publisher","first-page":"696","DOI":"10.1111\/edt.13078","article-title":"Evaluation of the performance of artificial intelligence based chatbots in providing first aid information on dental trauma according to the ToothSOS application","volume":"41","author":"\u00c7ege","year":"2025","journal-title":"Dent Traumatol"},{"key":"B33","doi-asserted-by":"publisher","first-page":"437","DOI":"10.1111\/edt.13041","article-title":"Evaluation of chatbots in the emergency management of avulsion injuries","author":"Mustulo\u011flu","year":"2025","journal-title":"Dent Traumatol"},{"key":"B34","doi-asserted-by":"publisher","first-page":"722","DOI":"10.1111\/edt.12965","article-title":"Assessment of artificial intelligence applications in responding to dental trauma","volume":"40","author":"Ozden","year":"2024","journal-title":"Dent Traumatol"},{"key":"B35","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1111\/edt.13004","article-title":"Accuracy and consistency of gemini responses regarding the management of traumatized permanent teeth","volume":"41","author":"Portilla","year":"2025","journal-title":"Dent Traumatol"},{"key":"B36","doi-asserted-by":"publisher","first-page":"178","DOI":"10.1111\/edt.12999","article-title":"Evidence-based potential of generative artificial intelligence large language models on dental avulsion: ChatGPT versus gemini","volume":"41","author":"Tokg\u00f6z Kaplan","year":"2025","journal-title":"Dent Traumatol"},{"key":"B37","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1038\/s41591-024-03425-5","article-title":"The TRIPOD-LLM reporting guideline for studies using large language models","volume":"31","author":"Gallifant","year":"2025","journal-title":"Nat Med"},{"key":"B38","doi-asserted-by":"publisher","first-page":"e2530220","DOI":"10.1001\/jamanetworkopen.2025.30220","article-title":"Reporting guideline for chatbot health advice studies: the CHART statement","volume":"8","author":"Huo","year":"2025","journal-title":"JAMA Netw Open"},{"key":"B39","volume-title":"Statistical Power Analysis for the Behavioral Sciences","author":"Cohen","year":"1988"},{"key":"B40","doi-asserted-by":"publisher","first-page":"1574287","DOI":"10.3389\/fdgth.2025.1574287","article-title":"Accuracy of ChatGPT-3.5, ChatGPT-4o, copilot, gemini, claude, and perplexity in advising on lumbosacral radicular pain against clinical practice guidelines: cross-sectional study","volume":"7","author":"Rossettini","year":"2025","journal-title":"Front Digit Health"},{"key":"B41","doi-asserted-by":"publisher","first-page":"e64486","DOI":"10.2196\/64486","article-title":"Accuracy of large language models when answering clinical research questions: systematic review and network meta-analysis","volume":"27","author":"Wang","year":"2025","journal-title":"J Med Internet Res"},{"key":"B42","doi-asserted-by":"publisher","first-page":"100230","DOI":"10.1016\/j.mcpdig.2025.100230","article-title":"Battle of the bots: solving clinical cases in osteoarticular infections with large language models","volume":"3","author":"Borgonovo","year":"2025","journal-title":"Mayo Clin Proc Digit Health"},{"key":"B43","doi-asserted-by":"publisher","first-page":"6743","DOI":"10.1021\/acs.jctc.5c00605","article-title":"Fusing domain knowledge with a fine-tuned large language model for enhanced molecular property prediction","volume":"21","author":"Xie","year":"2025","journal-title":"J Chem Theory Comput"},{"key":"B44","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1016\/j.aopr.2025.05.001","article-title":"DeepSeek-R1 outperforms gemini 2.0 pro, OpenAI o1, and o3-mini in bilingual complex ophthalmology reasoning","volume":"5","author":"Xu","year":"2025","journal-title":"Adv Ophthalmol Pract Res"},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.1016\/j.prosdent.2025.04.038","article-title":"Comparing the performance of ChatGPT 4o, DeepSeek R1, and gemini 2 pro in answering fixed prosthodontics questions over time","author":"Shirani","year":"2025","journal-title":"J Prosthet Dent"},{"key":"B46","doi-asserted-by":"publisher","DOI":"10.1111\/iej.14231","article-title":"Artificial intelligence chatbots in endodontic education\u2014concepts and potential applications","author":"Mohammad-Rahimi","year":"2025","journal-title":"Int Endodontic J"},{"key":"B47","doi-asserted-by":"publisher","first-page":"482","DOI":"10.1007\/s13187-025-02592-4","article-title":"Evidence-Based analysis of AI chatbots in oncology patient education: implications for trust, perceived realness, and misinformation management","volume":"40","author":"Lawson McLean","year":"2025","journal-title":"J Canc Educ"},{"key":"B48","doi-asserted-by":"publisher","first-page":"1506","DOI":"10.1038\/s41598-024-85003-w","article-title":"Evaluation of LLMs accuracy and consistency in the registered dietitian exam through prompt engineering and knowledge retrieval","volume":"15","author":"Azimi","year":"2025","journal-title":"Sci Rep"},{"key":"B49","doi-asserted-by":"publisher","first-page":"586","DOI":"10.1007\/s11604-024-01712-2","article-title":"Structured clinical reasoning prompt enhances LLM\u2019s diagnostic capabilities in diagnosis please quiz cases","volume":"43","author":"Sonoda","year":"2025","journal-title":"Jpn J Radiol"},{"key":"B50","doi-asserted-by":"publisher","first-page":"e55318","DOI":"10.2196\/55318","article-title":"An empirical evaluation of prompting strategies for large language models in zero-shot clinical natural language processing: algorithm development and validation study","volume":"12","author":"Sivarajkumar","year":"2024","journal-title":"JMIR Med Inform"},{"key":"B51","doi-asserted-by":"publisher","first-page":"e50638","DOI":"10.2196\/50638","article-title":"Prompt engineering as an important emerging skill for medical professionals: tutorial","volume":"25","author":"Mesk\u00f3","year":"2023","journal-title":"J Med Internet Res"},{"key":"B52","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1038\/s41586-023-06291-2","article-title":"Large language models encode clinical knowledge","volume":"620","author":"Singhal","year":"2023","journal-title":"Nature"},{"key":"B53","doi-asserted-by":"publisher","first-page":"109332","DOI":"10.1016\/j.compbiomed.2024.109332","article-title":"Comparative accuracy of artificial intelligence chatbots in pulpal and periradicular diagnosis: a cross-sectional study","volume":"183","author":"Mendon\u00e7a De Moura","year":"2024","journal-title":"Comput Biol Med"},{"key":"B54","doi-asserted-by":"publisher","first-page":"e428","DOI":"10.1016\/S2589-7500(24)00061-X","article-title":"Ethical and regulatory challenges of large language models in medicine","volume":"6","author":"Ong","year":"2024","journal-title":"Lancet"},{"key":"B55","doi-asserted-by":"publisher","first-page":"e0335775","DOI":"10.1371\/journal.pone.0335775","article-title":"Benchmarking large-language-model vision capabilities in oral and maxillofacial anatomy: A cross-sectional study","volume":"20","author":"Nguyen","year":"2025","journal-title":"PloS one"}],"container-title":["Frontiers in Oral Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/froh.2025.1737114\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,16]],"date-time":"2025-12-16T14:27:48Z","timestamp":1765895268000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/froh.2025.1737114\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,15]]},"references-count":55,"alternative-id":["10.3389\/froh.2025.1737114"],"URL":"https:\/\/doi.org\/10.3389\/froh.2025.1737114","relation":{},"ISSN":["2673-4842"],"issn-type":[{"value":"2673-4842","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,15]]},"article-number":"1737114"}}