{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T16:09:27Z","timestamp":1781626167716,"version":"3.54.5"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,12,26]],"date-time":"2025-12-26T00:00:00Z","timestamp":1766707200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T00:00:00Z","timestamp":1769558400000},"content-version":"vor","delay-in-days":33,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100006389","name":"University of Geneva","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006389","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Res Methodol"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Tracking the evolution of scientific knowledge is challenging due to the scale and complexity of the biomedical literature. Neurosyphilis is a clinically complex and historically stigmatized condition that remains difficult to diagnose and manage. Its underexplored literature offers an ideal test case to evaluate digital methods for mapping research trends and identifying knowledge gaps. We aim to assess how large language models (LLMs), network analysis, and interrupted time series analysis (ITSA) can be combined to automate literature classification and examine how knowledge of neurosyphilis has evolved.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We systematically searched Web of Science, Embase, PubMed Central, the Cochrane Library, and Lens for records on neurosyphilis published until December 31, 2024. We included records with available titles and abstracts in which GPT-4o mini was identified as being focused primarily on syphilis or neurosyphilis. Eligible records were classified into 23 research fields via LLM-based prompts. Network analysis visualized changes in research structures over time, and the ITSA assessed associations between publication trends and major clinical or technological milestones.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Among the 14 934 retrieved records, 4 646 met the inclusion criteria. LLM-based classification showed high repeatability (agreement\u2009=\u200999\u00b767%, 95% CI 99\u00b747\u201399\u00b780; Cohen\u2019s \u03ba\u2009=\u20090\u00b799, 95% CI 0\u00b796\u20131\u00b700). Biomedical, Clinical, and Health sciences were the most common domains. Network analysis revealed a shift from dense, discipline-specific clusters to larger interdisciplinary structures. ITSA revealed significant increases in publication activity following the introduction of penicillin G, HIV emergence, genome sequencing of\n                      <jats:italic>Treponema pallidum<\/jats:italic>\n                      , and the rise of digital dissemination platforms.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Combining LLMs with bibliometric and network methods provides a scalable framework for analyzing large-scale biomedical literature. When applied to neurosyphilis, the approach revealed links between research activity and clinical and technological advances. In addition to this case study, the method could support meta-research and inform evidence-based decision-making across other complex medical conditions.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12874-025-02750-8","type":"journal-article","created":{"date-parts":[[2025,12,26]],"date-time":"2025-12-26T04:04:15Z","timestamp":1766721855000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["AI-powered classification and network analysis for knowledge mapping in medicine: a century of neurosyphilis research"],"prefix":"10.1186","volume":"26","author":[{"given":"Justine","family":"Falciola","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Myriam","family":"Lamrayah","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fran\u00e7ois R.","family":"Herrmann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexandre","family":"Wenger","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laurence","family":"Toutous Trellu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,12,26]]},"reference":[{"key":"2750_CR1","doi-asserted-by":"publisher","first-page":"e35","DOI":"10.1016\/S2589-7500(24)00246-2","volume":"7","author":"MCS Menezes","year":"2025","unstructured":"Menezes MCS, Hoffmann AF, Tan ALM, Nalbandyan M, Omenn GS, Mazzotti DR, et al. The potential of generative Pre-trained transformer 4 (GPT-4) to analyse medical notes in three different languages: a retrospective model-evaluation study. Lancet Digit Health. 2025;7:e35\u201343. https:\/\/doi.org\/10.1016\/S2589-7500(24)00246-2.","journal-title":"Lancet Digit Health"},{"key":"2750_CR2","doi-asserted-by":"publisher","first-page":"8384","DOI":"10.1038\/s41467-024-52417-z","volume":"15","author":"P Qiu","year":"2024","unstructured":"Qiu P, Wu C, Zhang X, Lin W, Wang H, Zhang Y, et al. Towards Building multilingual Language model for medicine. Nat Commun. 2024;15:8384. https:\/\/doi.org\/10.1038\/s41467-024-52417-z.","journal-title":"Nat Commun"},{"key":"2750_CR3","doi-asserted-by":"publisher","first-page":"e1544","DOI":"10.1016\/S2214-109X(24)00266-3","volume":"12","author":"SL Gottlieb","year":"2024","unstructured":"Gottlieb SL, Spielman E, Abu-Raddad L, Aderoba AK, Bachmann LH, Blondeel K, et al. WHO global research priorities for sexually transmitted infections. Lancet Global Health. 2024;12:e1544\u201351. https:\/\/doi.org\/10.1016\/S2214-109X(24)00266-3.","journal-title":"Lancet Global Health"},{"key":"2750_CR4","doi-asserted-by":"publisher","first-page":"e57","DOI":"10.1093\/cid\/ciad437","volume":"78","author":"MM Hamill","year":"2024","unstructured":"Hamill MM, Ghanem KG, Tuddenham S. State-of-the-Art review: neurosyphilis. Clin Infect Dis. 2024;78:e57\u201368. https:\/\/doi.org\/10.1093\/cid\/ciad437.","journal-title":"Clin Infect Dis"},{"key":"2750_CR5","doi-asserted-by":"publisher","first-page":"472","DOI":"10.1097\/OLQ.0000000000001813","volume":"50","author":"ZW Lorenz","year":"2023","unstructured":"Lorenz ZW, Nijhar S, Caufield-Noll C, Ghanem KG, Hamill MM. The utility of biomarkers in the clinical management of syphilis: A systematic review. Sex Trans Dis. 2023;50:472\u20138. https:\/\/doi.org\/10.1097\/OLQ.0000000000001813.","journal-title":"Sex Trans Dis"},{"key":"2750_CR6","doi-asserted-by":"publisher","first-page":"e01153","DOI":"10.1128\/mBio.01153-18","volume":"9","author":"DG Edmondson","year":"2018","unstructured":"Edmondson DG, Hu B, Norris SJ. Long-Term in vitro culture of the syphilis spirochete Treponema Pallidum subsp. Pallidum. mBio. 2018;9:e01153\u201318. https:\/\/doi.org\/10.1128\/mBio.01153-18.","journal-title":"mBio"},{"key":"2750_CR7","doi-asserted-by":"publisher","first-page":"375","DOI":"10.1126\/science.281.5375.375","volume":"281","author":"CM Fraser","year":"1998","unstructured":"Fraser CM, Norris SJ, Weinstock GM, White O, Sutton GG, Dodson R, et al. Complete genome sequence of Treponema pallidum, the syphilis spirochete. Science. 1998;281:375\u201388. https:\/\/doi.org\/10.1126\/science.281.5375.375.","journal-title":"Science"},{"key":"2750_CR8","doi-asserted-by":"publisher","first-page":"1549","DOI":"10.1038\/s41564-021-01000-z","volume":"6","author":"MA Beale","year":"2021","unstructured":"Beale MA, Marks M, Cole MJ, Lee M-K, Pitt R, Ruis C, et al. Global phylogeny of Treponema pallidum lineages reveals recent expansion and spread of contemporary syphilis. Nat Microbiol. 2021;6:1549\u201360. https:\/\/doi.org\/10.1038\/s41564-021-01000-z.","journal-title":"Nat Microbiol"},{"key":"2750_CR9","doi-asserted-by":"publisher","first-page":"789","DOI":"10.1016\/j.respol.2006.12.007","volume":"36","author":"A Mina","year":"2007","unstructured":"Mina A, Ramlogan R, Tampubolon G, Metcalfe JS. Mapping evolutionary trajectories: applications to the growth and transformation of medical knowledge. Res Policy. 2007;36:789\u2013806. https:\/\/doi.org\/10.1016\/j.respol.2006.12.007.","journal-title":"Res Policy"},{"key":"2750_CR10","doi-asserted-by":"publisher","first-page":"n71","DOI":"10.1136\/bmj.n71","volume":"372","author":"MJ Page","year":"2021","unstructured":"Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. https:\/\/doi.org\/10.1136\/bmj.n71.","journal-title":"BMJ"},{"key":"2750_CR11","unstructured":"Python Software Foundation. Python Programming Language. 2024."},{"key":"2750_CR12","unstructured":"OpenAI. GPT-4o mini: advancing cost-efficient intelligence. 2024. https:\/\/openai.com\/index\/GPT-4omini-advancing-cost-efficient-intelligence\/. Accessed 20 Feb 2025."},{"key":"2750_CR13","unstructured":"Australian and New Zealand Standard Research Classification (ANZSRC). 2020 | Australian Bureau of Statistics. 2020. https:\/\/www.abs.gov.au\/statistics\/classifications\/australian-and-new-zealand-standard-research-classification-anzsrc\/latest-release. Accessed 20 Feb 2025."},{"key":"2750_CR14","unstructured":"JetBrains. PyCharm: the Python IDE for data science and web development. 2024."},{"key":"2750_CR15","doi-asserted-by":"publisher","unstructured":"Hagberg AA, Schult DA, Swart PJ. Exploring Network Structure, Dynamics, and Function using NetworkX. In Proceedings of the Python in Science Conference, p. 11-15. SciPy. 2008. https:\/\/doi.org\/10.25080\/TCWV9851.","DOI":"10.25080\/TCWV9851"},{"key":"2750_CR16","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1109\/MCSE.2007.55","volume":"9","author":"JD Hunter","year":"2007","unstructured":"Hunter JD, Matplotlib. A 2D graphics environment. Comput Sci Eng. 2007;9:90\u20135. https:\/\/doi.org\/10.1109\/MCSE.2007.55.","journal-title":"Comput Sci Eng"},{"key":"2750_CR17","doi-asserted-by":"publisher","first-page":"348","DOI":"10.1093\/ije\/dyw098","volume":"46","author":"JL Bernal","year":"2017","unstructured":"Bernal JL, Cummins S, Gasparrini A. Interrupted time series regression for the evaluation of public health interventions: a tutorial. Int J Epidemiol. 2017;46:348\u201355. https:\/\/doi.org\/10.1093\/ije\/dyw098.","journal-title":"Int J Epidemiol"},{"key":"2750_CR18","doi-asserted-by":"publisher","first-page":"480","DOI":"10.1177\/1536867X1501500208","volume":"15","author":"A Linden","year":"2015","unstructured":"Linden A. Conducting interrupted Time-series analysis for Single- and Multiple-group comparisons. Stata Journal: Promoting Commun Stat Stata. 2015;15:480\u2013500. https:\/\/doi.org\/10.1177\/1536867X1501500208.","journal-title":"Stata Journal: Promoting Commun Stat Stata"},{"key":"2750_CR19","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1177\/001316446002000104","volume":"20","author":"J Cohen","year":"1960","unstructured":"Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20:37\u201346. https:\/\/doi.org\/10.1177\/001316446002000104.","journal-title":"Educ Psychol Meas"},{"key":"2750_CR20","doi-asserted-by":"publisher","first-page":"159","DOI":"10.2307\/2529310","volume":"33","author":"JR Landis","year":"1977","unstructured":"Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159\u201374.","journal-title":"Biometrics"},{"key":"2750_CR21","doi-asserted-by":"publisher","first-page":"851","DOI":"10.1111\/jep.12544","volume":"22","author":"A Linden","year":"2016","unstructured":"Linden A, Yarnold PR. Using machine learning to identify structural breaks in single-group interrupted time series designs. J Eval Clin Pract. 2016;22:851\u20135. https:\/\/doi.org\/10.1111\/jep.12544.","journal-title":"J Eval Clin Pract"},{"key":"2750_CR22","doi-asserted-by":"publisher","first-page":"2215","DOI":"10.1002\/asi.23329","volume":"66","author":"L Bornmann","year":"2015","unstructured":"Bornmann L, Mutz R. Growth rates of modern science: A bibliometric analysis based on the number of publications and cited references. J Association Inform Sci Technol. 2015;66:2215\u201322. https:\/\/doi.org\/10.1002\/asi.23329.","journal-title":"J Association Inform Sci Technol"},{"key":"2750_CR23","unstructured":"Garfield E. Citation Indexing - Its theory and application in Science, Technology, and humanities. University of California. Wiley; 1979."},{"key":"2750_CR24","doi-asserted-by":"publisher","first-page":"799","DOI":"10.1002\/(SICI)1097-4571(1999)50:9<799::AID-ASI9>3.0.CO;2-G","volume":"50","author":"H Small","year":"1999","unstructured":"Small H. Visualizing science by citation mapping. J Am Soc Inform Sci. 1999;50:799\u2013813. https:\/\/doi.org\/10.1002\/(SICI)1097-4571(1999)50:9%253C799::AID-ASI9%253E3.0.CO;2-G.","journal-title":"J Am Soc Inform Sci"},{"key":"2750_CR25","doi-asserted-by":"publisher","first-page":"100163","DOI":"10.1016\/j.lana.2021.100163","volume":"7","author":"R De Pinto","year":"2022","unstructured":"Pinto R, Valentim R, Fernandes Da Silva L, Fontoura De Souza G, G\u00f3is Farias De Moura Santos, Lima T, De Pereira CA, et al. Use of Interrupted Time Series Analysis in Understanding the Course of the Congenital Syphilis Epidemic in Brazil. Lancet Reg Health Am. 2022;7:100163. https:\/\/doi.org\/10.1016\/j.lana.2021.100163.","journal-title":"Lancet Reg Health Am"},{"key":"2750_CR26","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1038\/s41576-020-00305-9","volume":"22","author":"ML Benton","year":"2021","unstructured":"Benton ML, Abraham A, LaBella AL, Abbot P, Rokas A, Capra JA. The influence of evolutionary history on human health and disease. Nat Rev Genet. 2021;22:269\u201383. https:\/\/doi.org\/10.1038\/s41576-020-00305-9.","journal-title":"Nat Rev Genet"},{"key":"2750_CR27","doi-asserted-by":"publisher","first-page":"9405","DOI":"10.1007\/s11192-021-04172-x","volume":"126","author":"M Coccia","year":"2021","unstructured":"Coccia M. Evolution and structure of research fields driven by crises and environmental threats: the COVID-19 research. Scientometrics. 2021;126:9405\u201329. https:\/\/doi.org\/10.1007\/s11192-021-04172-x.","journal-title":"Scientometrics"},{"key":"2750_CR28","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1057\/s41599-021-00891-x","volume":"8","author":"R Heyard","year":"2021","unstructured":"Heyard R, Hottenrott H. The value of research funding for knowledge creation and dissemination: A study of SNSF research grants. Humanit Soc Sci Commun. 2021;8:217. https:\/\/doi.org\/10.1057\/s41599-021-00891-x.","journal-title":"Humanit Soc Sci Commun"},{"key":"2750_CR29","doi-asserted-by":"publisher","first-page":"456","DOI":"10.1016\/S1473-3099(04)01061-8","volume":"4","author":"WA Lynn","year":"2004","unstructured":"Lynn WA, Lightman S. Syphilis and HIV: a dangerous combination. Lancet Infect Dis. 2004;4:456\u201366. https:\/\/doi.org\/10.1016\/S1473-3099(04)01061-8.","journal-title":"Lancet Infect Dis"},{"key":"2750_CR30","doi-asserted-by":"publisher","unstructured":"Yermukhanova L, Kuzembayev M, Salkhanova A, Narymbayeva N, Tazhiyeva A, Makhanbetkulova DN, et al. Exploring socio-economic dimensions in HIV research: a comprehensive bibliometric analysis (1992\u20132024). Glob Health Action. 18;2474787. https:\/\/doi.org\/10.1080\/16549716.2025.2474787.","DOI":"10.1080\/16549716.2025.2474787"},{"key":"2750_CR31","doi-asserted-by":"publisher","first-page":"1478187","DOI":"10.3389\/fimmu.2025.1478187","volume":"16","author":"T Zhou","year":"2025","unstructured":"Zhou T, Chen X, Lai Y. Development of research on HIV-associated neurocognitive disorder and emerging trends: a visualization analysis via CiteSpace. Front Immunol. 2025;16:1478187. https:\/\/doi.org\/10.3389\/fimmu.2025.1478187.","journal-title":"Front Immunol"},{"key":"2750_CR32","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1093\/inthealth\/ihad087","volume":"16","author":"F Seghers","year":"2024","unstructured":"Seghers F, Taylor MM, Storey A, Dong J, Wi TC, Wyber R, et al. Securing the supply of benzathine penicillin: a global perspective on risks and mitigation strategies to prevent future shortages. Int Health. 2024;16:279\u201382. https:\/\/doi.org\/10.1093\/inthealth\/ihad087.","journal-title":"Int Health"}],"container-title":["BMC Medical Research Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12874-025-02750-8","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-025-02750-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-025-02750-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T15:48:32Z","timestamp":1781624912000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s12874-025-02750-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,26]]},"references-count":32,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["2750"],"URL":"https:\/\/doi.org\/10.1186\/s12874-025-02750-8","relation":{},"ISSN":["1471-2288"],"issn-type":[{"value":"1471-2288","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,26]]},"assertion":[{"value":"27 May 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 December 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 December 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This study did not involve human participants, identifiable personal data, or biological materials. All the data analyzed were publicly available bibliometric or publication metadata. Therefore, ethical approval is not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"12"}}