{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,28]],"date-time":"2026-08-28T13:27:29Z","timestamp":1787923649648,"version":"build-2784847793"},"reference-count":19,"publisher":"Oxford University Press (OUP)","issue":"7","license":[{"start":{"date-parts":[[2026,7,28]],"date-time":"2026-07-28T00:00:00Z","timestamp":1785196800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,7,29]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Aims<\/jats:title>\n                    <jats:p>The rapid expansion of biomedical literature challenges clinicians\u2019 and researchers\u2019 ability to identify clinically meaningful evidence. We systematically compared five literature search tools, four artificial intelligence (AI)-assisted and one conventional, across clinically relevant cardiology research scenarios, using a blinded expert-validated gold standard to assess their ability to retrieve relevant and key references.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods and results<\/jats:title>\n                    <jats:p>We evaluated ChatGPT-5, Elicit, Consensus, Scite, and PubMed across four cardiology topics defined by maturity and specificity, with multiple standardized prompts. Three electrophysiology experts independently and blindly rated all retrieved references, defining two gold standards: expert-rated relevance and expert-selected key references. ChatGPT-5 achieved the highest proportion of relevant articles (90% [88\u2013100], P &amp;lt; 0.001) and the highest key-reference overlap (60% [43\u201368], P &amp;lt; 0.001), whereas Scite performed lowest (20% and 10%, respectively). The tool was the primary determinant of performance (partial R2 = 0.50), whereas prompt formulation had no significant effect. In a pre-specified subanalysis restricted to clinical studies, ChatGPT-5 and human-conducted systematic reviews overlapped by 42% (96% of shared articles highly relevant), with 58% distinct references, indicating complementary AI and human retrieval; ChatGPT-5 produced hallucinated citations when long reference lists were requested for emerging topics, underscoring the need for human verification.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>AI-assisted tools showed heterogeneous performance, ChatGPT-5 performing best in this cardiology setting. These preliminary, context-specific findings support hybrid human\u2013AI strategies in which AI complements rather than replaces transparent database searches such as PubMed; larger-scale, multi-domain studies are needed to confirm and generalize them.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/ehjdh\/ztag125","type":"journal-article","created":{"date-parts":[[2026,7,27]],"date-time":"2026-07-27T13:43:09Z","timestamp":1785159789000},"source":"Crossref","is-referenced-by-count":0,"title":["Comparative evaluation of artificial intelligence\u2013assisted literature search tools for identifying clinically meaningful evidence in cardiology"],"prefix":"10.1093","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-9378-5026","authenticated-orcid":false,"given":"Riccardo","family":"Di Febo","sequence":"first","affiliation":[{"name":"Department of Cardiology, H\u00f4pital Saint Philibert, Groupement des H\u00f4pitaux de L'Institut Catholique de Lille, Universit\u00e9 Catholique de Lille , 115 Rue du Grand But, 59160 Lille ,","place":["France"]},{"name":"Laboratoire ETHICS, DataC\u0153ur Research Team, Groupement des H\u00f4pitaux de L\u2019Institut Catholique de Lille , 115 Rue du Grand But, 59160 Lille ,","place":["France"]},{"name":"Division of Cardiology, Department of Health Sciences, San Paolo Hospital, University of Milan , Via Antonio di Rudin\u00ec, 8, 20142 Milan ,","place":["Italy"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maximiliano","family":"Jeanneret Medina","sequence":"additional","affiliation":[{"name":"HEG Arc, HES-SO, University of Applied Sciences Western Switzerland , 2000 Neuch\u00e2tel ,","place":["Switzerland"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7367-6640","authenticated-orcid":false,"given":"Alexandre","family":"Renaud","sequence":"additional","affiliation":[{"name":"EM Normandie Business School, M\u00e9tis Lab , 30-32, Rue Henri-Barbusse, Clichy 92110 ,","place":["France"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-5905-2591","authenticated-orcid":false,"given":"Maryam","family":"Dridi","sequence":"additional","affiliation":[{"name":"Department of Cardiology, H\u00f4pital Saint Philibert, Groupement des H\u00f4pitaux de L'Institut Catholique de Lille, Universit\u00e9 Catholique de Lille , 115 Rue du Grand But, 59160 Lille ,","place":["France"]},{"name":"Laboratoire ETHICS, DataC\u0153ur Research Team, Groupement des H\u00f4pitaux de L\u2019Institut Catholique de Lille , 115 Rue du Grand But, 59160 Lille ,","place":["France"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Valentine","family":"Pecriaux","sequence":"additional","affiliation":[{"name":"Department of Cardiology, H\u00f4pital Saint Philibert, Groupement des H\u00f4pitaux de L'Institut Catholique de Lille, Universit\u00e9 Catholique de Lille , 115 Rue du Grand But, 59160 Lille ,","place":["France"]},{"name":"Laboratoire ETHICS, DataC\u0153ur Research Team, Groupement des H\u00f4pitaux de L\u2019Institut Catholique de Lille , 115 Rue du Grand But, 59160 Lille ,","place":["France"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benoit","family":"Lequeux","sequence":"additional","affiliation":[{"name":"Cardiology Department, University Hospital of Poitiers , 2 Rue de la Mil\u00e9trie, Poitiers F-86021 ,","place":["France"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephane","family":"Lafitte","sequence":"additional","affiliation":[{"name":"Bordeaux University, Department of Cardiology, Bordeaux University Hospital , Bordeaux F-33000 ,","place":["France"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2639-9593","authenticated-orcid":false,"given":"Baptiste","family":"Maille","sequence":"additional","affiliation":[{"name":"Department of Cardiology, Marseille University Hospital Timone , 13005 Marseille ,","place":["France"]},{"name":"Department of Cardiology, Aix-Marseille University, 13005 Marseille ,","place":["France"]},{"name":"Center for CardioVascular and Nutrition Research (C2VN), INSERM, INRA , 13005 Marseille ,","place":["France"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4823-1556","authenticated-orcid":false,"given":"Aymeric","family":"Menet","sequence":"additional","affiliation":[{"name":"Department of Cardiology, H\u00f4pital Saint Philibert, Groupement des H\u00f4pitaux de L'Institut Catholique de Lille, Universit\u00e9 Catholique de Lille , 115 Rue du Grand But, 59160 Lille ,","place":["France"]},{"name":"Laboratoire ETHICS, DataC\u0153ur Research Team, Groupement des H\u00f4pitaux de L\u2019Institut Catholique de Lille , 115 Rue du Grand But, 59160 Lille ,","place":["France"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,7,28]]},"reference":[{"key":"2026082805512297600_ztag125-B1","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1186\/s12874-025-02528-y","article-title":"Using artificial intelligence for systematic review: the example of elicit","volume":"25","author":"Bernard","year":"2025","journal-title":"BMC Med Res Methodol"},{"key":"2026082805512297600_ztag125-B2","doi-asserted-by":"crossref","first-page":"e12234","DOI":"10.1002\/jcv2.12234","article-title":"How to optimize the systematic review process using AI tools","volume":"4","author":"Fabiano","year":"2024","journal-title":"JCPP Adv"},{"key":"2026082805512297600_ztag125-B3","doi-asserted-by":"crossref","first-page":"616","DOI":"10.1002\/jrsm.1715","article-title":"Can large language models replace humans in systematic reviews? Evaluating GPT-4's efficacy in screening and extracting data from peer-reviewed and grey literature in multiple languages","volume":"15","author":"Khraisha","year":"2024","journal-title":"Res Synth Methods"},{"key":"2026082805512297600_ztag125-B4","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1038\/s41746-023-00896-7","article-title":"Evaluating large language models on medical evidence summarization","volume":"6","author":"Tang","year":"2023","journal-title":"NPJ Digit Med"},{"key":"2026082805512297600_ztag125-B5","doi-asserted-by":"crossref","first-page":"332","DOI":"10.1093\/eurheartj\/ehad838","article-title":"Artificial intelligence: revolutionizing cardiology with large language models","volume":"45","author":"Boonstra","year":"2024","journal-title":"Eur Heart J"},{"key":"2026082805512297600_ztag125-B6","doi-asserted-by":"crossref","first-page":"540","DOI":"10.1093\/ehjdh\/ztaf028","article-title":"Applications of large language models in cardiovascular disease: a systematic review","volume":"6","author":"Ferreira Santos","year":"2025","journal-title":"Eur Heart J Digit Health"},{"key":"2026082805512297600_ztag125-B7","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1186\/s13054-023-04425-6","article-title":"Artificial hallucination: GPT on LSD?","volume":"27","author":"Beutel","year":"2023","journal-title":"Crit Care"},{"key":"2026082805512297600_ztag125-B8","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1145\/3637211","article-title":"A systematic review of fairness, accountability, transparency, and ethics in information retrieval","volume":"57","author":"Bernard","year":"2025","journal-title":"ACM Comput Surv"},{"key":"2026082805512297600_ztag125-B9","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1007\/s13278-025-01476-1","article-title":"Comprehensive review of academic search systems: evolution, analysis, and future research directions","volume":"15","author":"Khalid","year":"2025","journal-title":"Soc Netw Anal Min"},{"key":"2026082805512297600_ztag125-B10","first-page":"4910","volume-title":"Proceedings of the 31st International Conference on Computational Linguistics; 2025","author":"Aubert-Beduchaud","year":"2025"},{"key":"2026082805512297600_ztag125-B11"},{"key":"2026082805512297600_ztag125-B12","volume-title":"Cochrane Handbook for Systematic Reviews of Interventions. Version 6.4","author":"Higgins","year":"2023"},{"key":"2026082805512297600_ztag125-B13","doi-asserted-by":"crossref","first-page":"n71","DOI":"10.1136\/bmj.n71","article-title":"The PRISMA 2020 statement: an updated guideline for reporting systematic reviews","volume":"372","author":"Page","year":"2021","journal-title":"BMJ"},{"key":"2026082805512297600_ztag125-B14","doi-asserted-by":"crossref","first-page":"e537","DOI":"10.1016\/S2589-7500(20)30218-1","article-title":"Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extension","volume":"2","author":"Liu","year":"2020","journal-title":"Lancet Digit Health"},{"key":"2026082805512297600_ztag125-B15","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/BF02019280","article-title":"Co-word analysis as a tool for describing the network of interactions between basic and technological research: the case of polymer chemistry","volume":"22","author":"Callon","year":"1991","journal-title":"Scientometrics"},{"key":"2026082805512297600_ztag125-B16","doi-asserted-by":"crossref","first-page":"7055","DOI":"10.1007\/s11192-024-05161-6","article-title":"Comparative science mapping: a novel conceptual structure analysis with metadata","volume":"129","author":"Aria","year":"2024","journal-title":"Scientometrics"},{"key":"2026082805512297600_ztag125-B17","doi-asserted-by":"crossref","first-page":"857","DOI":"10.1038\/s41586-025-10072-4","article-title":"Synthesizing scientific literature with retrieval-augmented language models","volume":"650","author":"Asai","year":"2026","journal-title":"Nature"},{"key":"2026082805512297600_ztag125-B18","doi-asserted-by":"crossref","first-page":"14045","DOI":"10.1038\/s41598-023-41032-5","article-title":"Fabrication and errors in the bibliographic citations generated by ChatGPT","volume":"13","author":"Walters","year":"2023","journal-title":"Sci Rep"},{"key":"2026082805512297600_ztag125-B19","doi-asserted-by":"crossref","DOI":"10.2196\/80371","article-title":"Influence of topic familiarity and prompt specificity on citation fabrication in mental health research using large language models: experimental study","volume":"12","author":"Linardon","year":"2025","journal-title":"JMIR Ment Health"}],"container-title":["European Heart Journal - Digital Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/ehjdh\/advance-article-pdf\/doi\/10.1093\/ehjdh\/ztag125\/70299308\/ztag125.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/ehjdh\/article-pdf\/7\/7\/ztag125\/70299308\/ztag125.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/ehjdh\/article-pdf\/7\/7\/ztag125\/70299308\/ztag125.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,28]],"date-time":"2026-08-28T12:45:31Z","timestamp":1787921131000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/ehjdh\/article\/doi\/10.1093\/ehjdh\/ztag125\/8746387"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,28]]},"references-count":19,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2026,7,29]]}},"URL":"https:\/\/doi.org\/10.1093\/ehjdh\/ztag125","relation":{},"ISSN":["2634-3916"],"issn-type":[{"value":"2634-3916","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,8]]},"published":{"date-parts":[[2026,7,28]]},"article-number":"ztag125"}}