{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,21]],"date-time":"2026-11-21T00:05:59Z","timestamp":1795219559597,"version":"4.10.3"},"reference-count":52,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2023,9,25]],"date-time":"2023-09-25T00:00:00Z","timestamp":1695600000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Health Service Artificial Intelligence in Health and Care","award":["2119C25043"],"award-info":[{"award-number":["2119C25043"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,12,22]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objectives<\/jats:title>\n                  <jats:p>Artificial intelligence (AI)-based clinical decision support systems to aid diagnosis are increasingly being developed and implemented but with limited understanding of how such systems integrate with existing clinical work and organizational practices. We explored the early experiences of stakeholders using an AI-based imaging software tool Veye Lung Nodules (VLN) aiding the detection, classification, and measurement of pulmonary nodules in computed tomography scans of the chest.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and methods<\/jats:title>\n                  <jats:p>We performed semistructured interviews and observations across early adopter deployment sites with clinicians, strategic decision-makers, suppliers, patients with long-term chest conditions, and academics with expertise in the use of diagnostic AI in radiology settings. We coded the data using the Technology, People, Organizations, and Macroenvironmental factors framework.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>We conducted 39 interviews. Clinicians reported VLN to be easy to use with little disruption to the workflow. There were differences in patterns of use between experts and novice users with experts critically evaluating system recommendations and actively compensating for system limitations to achieve more reliable performance. Patients also viewed the tool positively. There were contextual variations in tool performance and use between different hospital sites and different use cases. Implementation challenges included integration with existing information systems, data protection, and perceived issues surrounding wider and sustained adoption, including procurement costs.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>Tool performance was variable, affected by integration into workflows and divisions of labor and knowledge, as well as technical configuration and infrastructure.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>The socio-organizational factors affecting performance of diagnostic AI are under-researched and require attention and further research.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocad191","type":"journal-article","created":{"date-parts":[[2023,9,25]],"date-time":"2023-09-25T22:15:41Z","timestamp":1695680141000},"page":"24-34","source":"Crossref","is-referenced-by-count":46,"title":["Early experiences of integrating an artificial intelligence-based diagnostic decision support system into radiology settings: a qualitative study"],"prefix":"10.1093","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2826-1478","authenticated-orcid":false,"given":"Nu\u0161a","family":"Fari\u010d","sequence":"first","affiliation":[{"name":"Usher Institute, University of Edinburgh , Edinburgh, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sue","family":"Hinder","sequence":"additional","affiliation":[{"name":"Usher Institute, University of Edinburgh , Edinburgh, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robin","family":"Williams","sequence":"additional","affiliation":[{"name":"Institute for the Study of Science, Technology and Innovation, University of Edinburgh , Edinburgh, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rishi","family":"Ramaesh","sequence":"additional","affiliation":[{"name":"Department of Radiology, Royal Infirmary Hospital , Edinburgh, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Miguel O","family":"Bernabeu","sequence":"additional","affiliation":[{"name":"Usher Institute, University of Edinburgh , Edinburgh, United Kingdom"},{"name":"The Bayes Centre, University of Edinburgh , Edinburgh, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Edwin","family":"van Beek","sequence":"additional","affiliation":[{"name":"Centre for Cardiovascular Science, Edinburgh Imaging and Neuroscience, University of Edinburgh , Edinburgh, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kathrin","family":"Cresswell","sequence":"additional","affiliation":[{"name":"Usher Institute, University of Edinburgh , Edinburgh, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2023,9,25]]},"reference":[{"issue":"7","key":"2023122220294331800_ocad191-B1","doi-asserted-by":"crossref","first-page":"e17707","DOI":"10.2196\/17707","article-title":"Artificial intelligence and health technology assessment: anticipating a new level of complexity","volume":"22","author":"Alami","year":"2020","journal-title":"J Med Internet Res"},{"issue":"1","key":"2023122220294331800_ocad191-B2","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1038\/s41746-021-00423-6","article-title":"The potential of artificial intelligence to improve patient safety: a scoping review","volume":"4","author":"Bates","year":"2021","journal-title":"NPJ Digit Med"},{"issue":"1","key":"2023122220294331800_ocad191-B3","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1038\/s41746-021-00438-z","article-title":"Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis","volume":"4","author":"Aggarwal","year":"2021","journal-title":"NPJ Digit Med"},{"issue":"1","key":"2023122220294331800_ocad191-B4","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1038\/s41591-018-0300-7","article-title":"High-performance medicine: the convergence of human and artificial intelligence","volume":"25","author":"Topol","year":"2019","journal-title":"Nat Med"},{"issue":"2","key":"2023122220294331800_ocad191-B5","doi-asserted-by":"crossref","first-page":"94","DOI":"10.7861\/futurehosp.6-2-94","article-title":"The potential for artificial intelligence in healthcare","volume":"6","author":"Davenport","year":"2019","journal-title":"Future Healthc J"},{"key":"2023122220294331800_ocad191-B6","author":"Technical Specialist Education and Training","year":"2023"},{"key":"2023122220294331800_ocad191-B7","first-page":"1","volume-title":"Clinical Decision Support the Road Ahead","author":"Greenes","year":"2007"},{"issue":"21","key":"2023122220294331800_ocad191-B8","doi-asserted-by":"crossref","first-page":"2199","DOI":"10.1001\/jama.2018.17163","article-title":"Clinical decision support in the era of artificial intelligence","volume":"320","author":"Shortliffe","year":"2018","journal-title":"JAMA"},{"issue":"1","key":"2023122220294331800_ocad191-B9","doi-asserted-by":"crossref","first-page":"29","DOI":"10.7326\/0003-4819-157-1-201207030-00450","article-title":"Effect of clinical decision-support systems: a systematic review","volume":"157","author":"Bright","year":"2012","journal-title":"Ann Intern Med"},{"issue":"5","key":"2023122220294331800_ocad191-B10","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1093\/jamia\/ocx115","article-title":"Medication-related clinical decision support alert overrides in inpatients","volume":"25","author":"Nanji","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"8","key":"2023122220294331800_ocad191-B11","doi-asserted-by":"crossref","first-page":"1252","DOI":"10.1093\/jamia\/ocaa098","article-title":"The tradeoffs between safety and alert fatigue: data from a national evaluation of hospital medication-related clinical decision support","volume":"27","author":"Co","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"2023122220294331800_ocad191-B12","doi-asserted-by":"crossref","first-page":"741","DOI":"10.1016\/j.jacr.2020.11.014","article-title":"Development and cost analysis of a lung nodule management strategy combining artificial intelligence and lung-RADS for baseline lung cancer screening","volume":"18","author":"Adams","year":"2021","journal-title":"J Am Coll Radiol"},{"issue":"5","key":"2023122220294331800_ocad191-B13","doi-asserted-by":"crossref","first-page":"e0266799","DOI":"10.1371\/journal.pone.0266799","article-title":"Validation of a deep learning computer aided system for CT based lung nodule detection, classification, and growth rate estimation in a routine clinical population","volume":"17","author":"Murchison","year":"2022","journal-title":"PLoS ONE"},{"issue":"2","key":"2023122220294331800_ocad191-B14","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1016\/j.jacr.2022.08.006","article-title":"Clinical impact and generalizability of a computer-assisted diagnostic tool to risk-stratify lung nodules with CT","volume":"20","author":"Adams","year":"2022","journal-title":"J Am Coll Radiol"},{"key":"2023122220294331800_ocad191-B15","first-page":"1","article-title":"Artificial intelligence for early diagnosis of lung cancer through incidental nodule detection in low-and middle-income countries-acceleration during the COVID-19 pandemic but here to stay","volume":"1","author":"Goncalves","year":"2022","journal-title":"Am J Cancer Res"},{"issue":"18","key":"2023122220294331800_ocad191-B16","doi-asserted-by":"crossref","first-page":"1126","DOI":"10.21037\/atm-20-4461","article-title":"DeepLN: an artificial intelligence-based automated system for lung cancer screening","volume":"8","author":"Guo","year":"2020","journal-title":"Ann Transl Med"},{"issue":"7834","key":"2023122220294331800_ocad191-B17","first-page":"S20","article-title":"Artificial intelligence is improving the detection of lung cancer","volume":"587","author":"Svoboda","year":"2020","journal-title":"Nat Outlook"},{"key":"2023122220294331800_ocad191-B18","author":"FDA","year":"2022"},{"issue":"3","key":"2023122220294331800_ocad191-B19","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1053\/j.ro.2015.01.008","article-title":"Pitfalls in chest radiographic interpretation: blind spots","volume":"50","author":"de Groot","year":"2015","journal-title":"Semin Roentgenol"},{"issue":"1","key":"2023122220294331800_ocad191-B20","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1038\/s41591-018-0307-0","article-title":"The practical implementation of artificial intelligence technologies in medicine","volume":"25","author":"He","year":"2019","journal-title":"Nat Med"},{"issue":"2","key":"2023122220294331800_ocad191-B21","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1148\/radiol.2017162326","article-title":"Deep learning at chest radiography: automated classification of pulmonary tuberculosis by using convolutional neural networks","volume":"284","author":"Lakhani","year":"2017","journal-title":"Radiology"},{"issue":"7","key":"2023122220294331800_ocad191-B22","doi-asserted-by":"crossref","first-page":"3660","DOI":"10.1007\/s00330-020-06771-3","article-title":"Deep learning algorithm for surveillance of pneumothorax after lung biopsy: a multicenter diagnostic cohort study","volume":"30","author":"Hwang","year":"2020","journal-title":"Eur Radiol"},{"issue":"1","key":"2023122220294331800_ocad191-B23","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1148\/radiol.2018180237","article-title":"Development and validation of deep learning-based automatic detection algorithm for malignant pulmonary nodules on chest radiographs","volume":"290","author":"Nam","year":"2019","journal-title":"Radiology"},{"issue":"5","key":"2023122220294331800_ocad191-B24","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1183\/13993003.03061-2020","article-title":"Development and validation of a deep learning algorithm detecting 10 common abnormalities on chest radiographs","volume":"57","author":"Nam","year":"2021","journal-title":"Eur Respir J"},{"key":"2023122220294331800_ocad191-B25","author":"NICE","year":"2022"},{"issue":"2","key":"2023122220294331800_ocad191-B26","doi-asserted-by":"crossref","DOI":"10.1148\/ryai.220056","article-title":"Hurdles to artificial intelligence deployment: noise in schemas and \u201cgold\u201d labels","volume":"5","author":"Abdalla","year":"2023","journal-title":"Radiol Artif Intell"},{"issue":"9","key":"2023122220294331800_ocad191-B27","doi-asserted-by":"crossref","first-page":"7058","DOI":"10.1007\/s00330-021-07781-5","article-title":"An international survey on AI in radiology in 1,041 radiologists and radiology residents part 1: fear of replacement, knowledge, and attitude","volume":"31","author":"Huisman","year":"2021","journal-title":"Eur Radiol"},{"issue":"11","key":"2023122220294331800_ocad191-B28","doi-asserted-by":"crossref","first-page":"8797","DOI":"10.1007\/s00330-021-07782-4","article-title":"An international survey on AI in radiology in 1041 radiologists and radiology residents part 2: expectations, hurdles to implementation, and education","volume":"31","author":"Merel","year":"2021","journal-title":"Eur Radiol"},{"issue":"10","key":"2023122220294331800_ocad191-B29","doi-asserted-by":"crossref","first-page":"1416","DOI":"10.1016\/j.jacr.2018.12.043","article-title":"A qualitative study to understand patient perspective on the use of artificial intelligence in radiology","volume":"16","author":"Haan","year":"2019","journal-title":"J Am Coll Radiol"},{"key":"2023122220294331800_ocad191-B30","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1007\/978-3-030-71885-5_4","volume-title":"Basic Knowledge of Medical Imaging Informatics","author":"Kotter","year":"2021"},{"issue":"15","key":"2023122220294331800_ocad191-B31","doi-asserted-by":"crossref","first-page":"1152","DOI":"10.1093\/jnci\/djr206","article-title":"Effectiveness of computer-aided detection in community mammography practice","volume":"103","author":"Fenton","year":"2011","journal-title":"J Natl Cancer Inst"},{"issue":"2","key":"2023122220294331800_ocad191-B32","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1191\/1478088706qp063oa","article-title":"Using thematic analysis in psychology","volume":"3","author":"Braun","year":"2006","journal-title":"Qual Res Psychol"},{"issue":"6","key":"2023122220294331800_ocad191-B33","doi-asserted-by":"crossref","first-page":"e15068","DOI":"10.2196\/15068","article-title":"Developing and applying a formative evaluation framework for health information technology implementations: qualitative investigation","volume":"22","author":"Cresswell","year":"2020","journal-title":"J Med Internet Res"},{"key":"2023122220294331800_ocad191-B34","author":"The Economist","year":"2018"},{"key":"2023122220294331800_ocad191-B35","author":"Gelman","year":"2021"},{"key":"2023122220294331800_ocad191-B36","doi-asserted-by":"crossref","first-page":"l2068","DOI":"10.1136\/bmj.l2068","article-title":"Spreading and scaling up innovation and improvement","volume":"365","author":"Greenhalgh","year":"2019","journal-title":"BMJ"},{"issue":"4","key":"2023122220294331800_ocad191-B37","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1111\/j.0887-378X.2004.00325.x","article-title":"Diffusion of innovations in service organizations: systematic review and recommendations","volume":"82","author":"Greenhalgh","year":"2004","journal-title":"Milbank Q"},{"key":"2023122220294331800_ocad191-B38","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1016\/j.jbi.2015.03.006","article-title":"Usability flaws of medication-related alerting functions: a systematic qualitative review","volume":"55","author":"Marcilly","year":"2015","journal-title":"J Biomed Inform"},{"issue":"5","key":"2023122220294331800_ocad191-B39","doi-asserted-by":"crossref","first-page":"891","DOI":"10.1093\/jamia\/ocv192","article-title":"Effects of an e-prescribing interface redesign on rates of generic drug prescribing: exploiting default options","volume":"123","author":"Malhotra","year":"2016","journal-title":"J Am Med Inform Assoc"},{"key":"2023122220294331800_ocad191-B40","first-page":"362","volume-title":"Decision Making in Healthcare: Theory, Psychology, and Applications","author":"Geissbuhler","year":"2000"},{"issue":"8","key":"2023122220294331800_ocad191-B41","doi-asserted-by":"crossref","first-page":"500","DOI":"10.1038\/s41568-018-0016-5","article-title":"Artificial intelligence in radiology","volume":"18","author":"Hosny","year":"2018","journal-title":"Nat Rev Cancer"},{"issue":"1","key":"2023122220294331800_ocad191-B42","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1007\/s00330-020-07148-2","article-title":"Challenges and solutions for introducing artificial intelligence (AI) in daily clinical workflow","volume":"31","author":"Kotter","year":"2021","journal-title":"Eur Radiol"},{"issue":"4","key":"2023122220294331800_ocad191-B43","doi-asserted-by":"crossref","first-page":"1805","DOI":"10.1007\/s00330-020-07230-9","article-title":"Applications of artificial intelligence (AI) in diagnostic radiology: a technography study","volume":"31","author":"Mehrizi","year":"2021","journal-title":"Eur Radiol"},{"issue":"1","key":"2023122220294331800_ocad191-B44","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.acra.2020.09.014","article-title":"Assessment of the willingness of radiologists and radiographers to accept the integration of artificial intelligence into radiology practice","volume":"29","author":"Abuzaid","year":"2022","journal-title":"Acad Radiol"},{"issue":"6","key":"2023122220294331800_ocad191-B45","doi-asserted-by":"crossref","first-page":"e15154","DOI":"10.2196\/15154","article-title":"Artificial Intelligence and human trust in healthcare: focus on clinicians","volume":"22","author":"Asan","year":"2020","journal-title":"J Med Internet Res"},{"issue":"2","key":"2023122220294331800_ocad191-B46","doi-asserted-by":"crossref","first-page":"e28236","DOI":"10.2196\/28236","article-title":"Research trends in artificial intelligence applications in human factors health care: mapping review","volume":"8","author":"Asan","year":"2021","journal-title":"JMIR Hum Factors"},{"key":"2023122220294331800_ocad191-B47","doi-asserted-by":"crossref","first-page":"103708","DOI":"10.1016\/j.apergo.2022.103708","article-title":"Effect of risk, expectancy, and trust on clinicians\u2019 intent to use an artificial intelligence system - blood utilization calculator","volume":"101","author":"Choudhury","year":"2022","journal-title":"Appl Ergon"},{"key":"2023122220294331800_ocad191-B48","first-page":"1","article-title":"Holding AI to account: challenges for the delivery of trustworthy AI in healthcare","author":"Procter","year":"2022","journal-title":"ACM Trans Comput Hum Interact"},{"issue":"9","key":"2023122220294331800_ocad191-B49","doi-asserted-by":"crossref","first-page":"e447","DOI":"10.1016\/S2589-7500(20)30187-4","article-title":"Approaching autonomy in medical artificial intelligence","volume":"2","author":"Bitterman","year":"2020","journal-title":"Lancet Digit Health"},{"issue":"8","key":"2023122220294331800_ocad191-B50","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1016\/j.acra.2021.09.007","article-title":"Artificial intelligence has similar performance to subjective assessment of emphysema severity on chest CT","volume":"29","author":"Ebrahimian","year":"2022","journal-title":"Acad Radiol"},{"key":"2023122220294331800_ocad191-B51","doi-asserted-by":"crossref","first-page":"e43682","DOI":"10.2196\/43682","article-title":"Learning from experience and finding the right balance in the governance of artificial intelligence and digital health technologies","volume":"25","author":"Gilbert","year":"2023","journal-title":"J Med Internet Res"},{"issue":"1","key":"2023122220294331800_ocad191-B52","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1177\/0846537120941434","article-title":"Artificial intelligence in lung cancer: bridging the gap between computational power and clinical decision-making","volume":"72","author":"Christie","year":"2021","journal-title":"Can Assoc Radiol J"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/1\/24\/54762031\/ocad191.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/1\/24\/54762031\/ocad191.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,22]],"date-time":"2023-12-22T20:30:32Z","timestamp":1703277032000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/1\/24\/7281919"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,25]]},"references-count":52,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,9,25]]},"published-print":{"date-parts":[[2023,12,22]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocad191","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,1,1]]},"published":{"date-parts":[[2023,9,25]]}}}