{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T07:15:56Z","timestamp":1792739756122,"version":"4.5.0"},"reference-count":34,"publisher":"BMJ","issue":"1","license":[{"start":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T00:00:00Z","timestamp":1785283200000},"content-version":"unspecified","delay-in-days":28,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["BMJ Digit Health"],"accepted":{"date-parts":[[2026,7,13]]},"published-print":{"date-parts":[[2026,7]]},"abstract":"<jats:p>Although artificial intelligence (AI) shows considerable promise in healthcare, its introduction and safe and effective exploitation involve several challenges. We argue that to maximise the benefits of AI and understand, track and mitigate potential harms there must be a shift in how AI is evaluated. Evaluation should be more closely linked to the local contexts in which AI is deployed and used and better integrated with clinical practice.<\/jats:p>\n                  <jats:p>To support this shift, we propose three interrelated levels of evaluation: evaluation of implementation, which examines transformations in contextually situated practices; evaluation of optimisation, which explores changes to clinical pathways over extended periods; and evaluation of scaling, which focuses on coordination through regional and national structures. This approach offers significant opportunities to advance both healthcare practice and the epistemology of medical knowledge.<\/jats:p>","DOI":"10.1136\/bmjdh-2026-000104","type":"journal-article","created":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T11:10:21Z","timestamp":1785323421000},"page":"e000104","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":1,"title":["How artificial intelligence is disrupting the field of medical knowledge and evaluation: a narrative review"],"prefix":"10.1136","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6634-9537","authenticated-orcid":false,"given":"Kathrin","family":"Cresswell","sequence":"first","affiliation":[{"name":"Usher Institute, The University of Edinburgh, Edinburgh, Scotland, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robin","family":"Williams","sequence":"additional","affiliation":[{"name":"Institute for the Study of Science, Technology and Innovation, The University of Edinburgh, Edinburgh, Scotland, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2026,7,29]]},"reference":[{"key":"2026072904100727000_2.1.e000104.1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2021.25181"},{"key":"2026072904100727000_2.1.e000104.2","doi-asserted-by":"crossref","DOI":"10.3389\/frai.2024.1430756","article-title":"Artificial intelligence: promise and peril in achieving the quadruple aim in healthcare","volume":"7","author":"Weeks","year":"2024","journal-title":"Front Artif Intell"},{"key":"2026072904100727000_2.1.e000104.3","doi-asserted-by":"crossref","DOI":"10.2196\/46407","article-title":"Evaluating Artificial Intelligence in Clinical Settings-Let Us Not Reinvent the Wheel","volume":"26","author":"Cresswell","year":"2024","journal-title":"J Med Internet Res"},{"key":"2026072904100727000_2.1.e000104.4","doi-asserted-by":"crossref","first-page":"i68","DOI":"10.1136\/qshc.2010.042085","article-title":"A new sociotechnical model for studying health information technology in complex adaptive healthcare systems","volume":"19 Suppl 3","author":"Sittig","year":"2010","journal-title":"Qual Saf Health Care"},{"key":"2026072904100727000_2.1.e000104.5","doi-asserted-by":"publisher","DOI":"10.1016\/S1386-5056(99)00011-8"},{"key":"2026072904100727000_2.1.e000104.6","doi-asserted-by":"publisher","DOI":"10.1197\/jamia.M2384"},{"key":"2026072904100727000_2.1.e000104.7","doi-asserted-by":"publisher","DOI":"10.1177\/15553434221097357"},{"key":"2026072904100727000_2.1.e000104.8","doi-asserted-by":"crossref","DOI":"10.2196\/15068","article-title":"Developing and Applying a Formative Evaluation Framework for Health Information Technology Implementations: Qualitative Investigation","volume":"22","author":"Cresswell","year":"2020","journal-title":"J Med Internet Res"},{"key":"2026072904100727000_2.1.e000104.9","doi-asserted-by":"crossref","first-page":"910","DOI":"10.1111\/risa.14273","article-title":"Managing risk and resilience in autonomous and intelligent systems: Exploring safety in the development, deployment, and use of artificial intelligence in healthcare","volume":"45","author":"Macrae","year":"2025","journal-title":"Risk Anal"},{"key":"2026072904100727000_2.1.e000104.10","doi-asserted-by":"crossref","DOI":"10.1186\/s12911-023-02103-9","article-title":"Ethics and governance of trustworthy medical artificial intelligence","volume":"23","author":"Zhang","year":"2023","journal-title":"BMC Med Inform Decis Mak"},{"key":"2026072904100727000_2.1.e000104.11","doi-asserted-by":"crossref","DOI":"10.1136\/bmj-2024-081554","article-title":"FUTURE-AI: international consensus guideline for trustworthy and deployable artificial intelligence in healthcare","volume":"388","author":"Lekadir","year":"2025","journal-title":"BMJ"},{"key":"2026072904100727000_2.1.e000104.12","article-title":"Large language models and global health equity: a roadmap for equitable adoption in LMICs","volume":"63","author":"Chen","year":"2025","journal-title":"Lancet Reg Health West Pac"},{"key":"2026072904100727000_2.1.e000104.13","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1038\/s44360-025-00024-7","article-title":"Large language models in global health","volume":"1","author":"Ong","year":"2026","journal-title":"Nat Health"},{"key":"2026072904100727000_2.1.e000104.14","first-page":"7","article-title":"Ethical Prompt Design for Health Equity: Preventing Hallucination and Addressing Bias in AI Diagnoses","volume":"6","author":"Mishra","year":"2025","journal-title":"IJAIDSML"},{"key":"2026072904100727000_2.1.e000104.15","doi-asserted-by":"crossref","DOI":"10.2196\/56764","article-title":"Large Language Models and User Trust: Consequence of Self-Referential Learning Loop and the Deskilling of Health Care Professionals","volume":"26","author":"Choudhury","year":"2024","journal-title":"J Med Internet Res"},{"key":"2026072904100727000_2.1.e000104.16","unstructured":"Hesketh R . Trusted autonomous systems in healthcare: a policy landscape review. 2021. Available: https:\/\/kclpure.kcl.ac.uk\/ws\/portalfiles\/portal\/164706904\/trusted_autonomous_systems_in_healthcare_1_.pdf"},{"key":"2026072904100727000_2.1.e000104.17","doi-asserted-by":"crossref","DOI":"10.2196\/67485","article-title":"AI for IMPACTS Framework for Evaluating the Long-Term Real-World Impacts of AI-Powered Clinician Tools: Systematic Review and Narrative Synthesis","volume":"27","author":"Jacob","year":"2025","journal-title":"J Med Internet Res"},{"key":"2026072904100727000_2.1.e000104.18","doi-asserted-by":"crossref","unstructured":"Alger BE . Defense of the scientific hypothesis: from reproducibility crisis to big data. Oxford University Press, 2020.","DOI":"10.1093\/oso\/9780190881481.001.0001"},{"key":"2026072904100727000_2.1.e000104.19","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.envsci.2020.01.008","article-title":"The technique is never neutral. How methodological choices condition the generation of narratives for sustainability","volume":"106","author":"Saltelli","year":"2020","journal-title":"Environ Sci Policy"},{"key":"2026072904100727000_2.1.e000104.20","doi-asserted-by":"crossref","DOI":"10.1148\/ryai.2019190058","article-title":"Will Artificial Intelligence Replace Radiologists?","volume":"1","author":"Langlotz","year":"2019","journal-title":"Radiol Artif Intell"},{"key":"2026072904100727000_2.1.e000104.21","doi-asserted-by":"crossref","DOI":"10.1038\/s41598-025-03332-w","article-title":"New care pathways for supporting transitional care from hospitals to home using AI and personalized digital assistance","volume":"15","author":"Anghel","year":"2025","journal-title":"Sci Rep"},{"key":"2026072904100727000_2.1.e000104.22","doi-asserted-by":"crossref","first-page":"1991","DOI":"10.1111\/joms.12936","article-title":"How Professionals Adapt to Artificial Intelligence: The Role of Intertwined Boundary Work","volume":"62","author":"Faulconbridge","year":"2025","journal-title":"J Management Studies"},{"key":"2026072904100727000_2.1.e000104.23","doi-asserted-by":"crossref","DOI":"10.1186\/s12911-023-02162-y","article-title":"The impact of artificial intelligence on the person-centred, doctor-patient relationship: some problems and solutions","volume":"23","author":"Sauerbrei","year":"2023","journal-title":"BMC Med Inform Decis Mak"},{"key":"2026072904100727000_2.1.e000104.24","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs-2025-019475"},{"key":"2026072904100727000_2.1.e000104.25","doi-asserted-by":"crossref","first-page":"3610","DOI":"10.1007\/s11606-023-08405-y","article-title":"Evaluation of Digitalisation in Healthcare and the Quantification of the \u201cUnmeasurable\u201d","volume":"38","author":"Cresswell","year":"2023","journal-title":"J Gen Intern Med"},{"key":"2026072904100727000_2.1.e000104.26","doi-asserted-by":"crossref","DOI":"10.1136\/bmj.h1258","article-title":"Process evaluation of complex interventions: Medical Research Council guidance","volume":"350","author":"Moore","year":"2015","journal-title":"BMJ"},{"key":"2026072904100727000_2.1.e000104.27","unstructured":"World Health Organization . Harnessing Artificial Intelligence for Health. Available: https:\/\/www.who.int\/teams\/digital-health-and-innovation\/harnessing-artificial-intelligence-for-health [Accessed 6 May 2026]."},{"key":"2026072904100727000_2.1.e000104.28","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1055\/s-0038-1633922","article-title":"An Inventory of Evaluation Studies of Information Technology in Health Care","volume":"44","author":"Ammenwerth","year":"2005","journal-title":"Methods Inf Med"},{"key":"2026072904100727000_2.1.e000104.29","unstructured":"World Health Organization . Health technology assessment of medical devices. World Health Organization; 2025."},{"key":"2026072904100727000_2.1.e000104.30","doi-asserted-by":"crossref","unstructured":"Cresswell K , Rigby M , Magrabi F , et al . The need to strengthen the evaluation of the impact of Artificial Intelligence-based decision support systems on healthcare provision. Health Policy 2023;136. doi:10.1016\/j.healthpol.2023.104889","DOI":"10.1016\/j.healthpol.2023.104889"},{"key":"2026072904100727000_2.1.e000104.31","doi-asserted-by":"crossref","DOI":"10.1038\/s41746-025-01805-w","article-title":"A mixed methods formative evaluation of the United Kingdom National Health Service Artificial Intelligence Lab","volume":"8","author":"Cresswell","year":"2025","journal-title":"NPJ Digit Med"},{"key":"2026072904100727000_2.1.e000104.32","doi-asserted-by":"crossref","DOI":"10.1038\/s41746-026-02495-8","article-title":"Large-scale system-level digitalisation initiatives in the National Health Service in England: insights from three national evaluations","volume":"9","author":"Cresswell","year":"2026","journal-title":"NPJ Digit Med"},{"key":"2026072904100727000_2.1.e000104.33","doi-asserted-by":"crossref","first-page":"I","DOI":"10.17705\/1jais.00359","article-title":"Innovation in Information Infrastructures: Introduction to the Special Issue","volume":"15","author":"Monteiro","year":"2014","journal-title":"JAIS"},{"key":"2026072904100727000_2.1.e000104.34","doi-asserted-by":"publisher","DOI":"10.1136\/jamia.2010.010306"}],"container-title":["BMJ Digital Health &amp; AI"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmjdh-2026-000104","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T11:10:26Z","timestamp":1785323426000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmjdigitalhealth.bmj.com\/lookup\/doi\/10.1136\/bmjdh-2026-000104"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7]]},"references-count":34,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,7,29]]},"published-print":{"date-parts":[[2026,7]]}},"alternative-id":["10.1136\/bmjdh-2026-000104"],"URL":"https:\/\/doi.org\/10.1136\/bmjdh-2026-000104","relation":{},"ISSN":["3049-575X"],"issn-type":[{"value":"3049-575X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7]]}}}