{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,27]],"date-time":"2026-08-27T16:08:06Z","timestamp":1787846886146,"version":"build-2784847793"},"reference-count":48,"publisher":"National Institute for Health and Care Research","license":[{"start":{"date-parts":[[2024,8,1]],"date-time":"2024-08-01T00:00:00Z","timestamp":1722470400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000664","name":"Health Technology Assessment programme","doi-asserted-by":"publisher","award":["NIHR135755"],"award-info":[{"award-number":["NIHR135755"]}],"id":[{"id":"10.13039\/501100000664","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journalslibrary.nihr.ac.uk"],"crossmark-restriction":false},"short-container-title":["Health Technol Assess"],"abstract":"<jats:sec id=\"abs1-1\"><jats:title>Background<\/jats:title>\n<jats:p>Lung cancer is one of the most common types of cancer in the United Kingdom. It is often diagnosed late. The 5-year survival rate for lung cancer is below 10%. Early diagnosis may improve survival. Software that has an artificial intelligence-developed algorithm might be useful in assisting with the identification of suspected lung cancer.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"abs1-2\"><jats:title>Objectives<\/jats:title>\n<jats:p>This review sought to identify evidence on adjunct artificial intelligence software for analysing chest X-rays for suspected lung cancer, and to develop a conceptual cost-effectiveness model to inform discussion of what would be required to develop a fully executable cost-effectiveness model for future economic evaluation.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"abs1-3\"><jats:title>Data sources<\/jats:title>\n<jats:p>The data sources were MEDLINE All, EMBASE, Cochrane Database of Systematic Reviews, Cochrane CENTRAL, Epistemonikos, ACM Digital Library, World Health Organization International Clinical Trials Registry Platform, clinical experts, Tufts Cost-Effectiveness Analysis Registry, company submissions and clinical experts. Searches were conducted from 25 November 2022 to 18 January 2023.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"abs1-4\"><jats:title>Methods<\/jats:title>\n<jats:p>Rapid evidence synthesis methods were employed. Data from companies were scrutinised. The eligibility criteria were (1) primary care populations referred for chest X-ray due to symptoms suggestive of lung cancer or reasons unrelated to lung cancer; (2) study designs that compared radiology specialist assessing chest X-ray with adjunct artificial intelligence software versus radiology specialists alone and (3) outcomes relating to test accuracy, practical implications of using artificial intelligence software and patient-related outcomes. A conceptual decision-analytic model was developed to inform a potential full cost-effectiveness evaluation of adjunct artificial intelligence software for analysing chest X-ray images to identify suspected lung cancer.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"abs1-5\"><jats:title>Results<\/jats:title>\n<jats:p>None of the studies identified in the searches or submitted by the companies met the inclusion criteria of the review. Contextual information from six studies that did not meet the inclusion criteria provided some evidence that sensitivity for lung cancer detection (but not nodule detection) might be higher when chest X-rays are interpreted by radiology specialists in combination with artificial intelligence software than when they are interpreted by radiology specialists alone. No significant differences were observed for specificity, positive predictive value or number of cancers detected. None of the six studies provided evidence on the clinical effectiveness of adjunct artificial intelligence software. The conceptual model highlighted a paucity of input data along the course of the diagnostic pathway and identified key assumptions required for evidence linkage.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"abs1-6\"><jats:title>Limitations<\/jats:title>\n<jats:p>This review employed rapid evidence synthesis methods. This included only one reviewer conducting all elements of the review, and targeted searches that were conducted in English only. No eligible studies were identified.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"abs1-7\"><jats:title>Conclusions<\/jats:title>\n<jats:p>There is currently no evidence applicable to this review on the use of adjunct artificial intelligence software for the detection of suspected lung cancer on chest X-ray in either people referred from primary care with symptoms of lung cancer or people referred from primary care for other reasons.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"abs1-8\"><jats:title>Future work<\/jats:title>\n<jats:p>Future research is required to understand the accuracy of adjunct artificial intelligence software to detect lung nodules and cancers, as well as its impact on clinical decision-making and patient outcomes. Research generating key input parameters for the conceptual model will enable refinement of the model structure, and conversion to a full working model, to analyse the cost-effectiveness of artificial intelligence software for this indication.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"abs1-9\"><jats:title>Study registration<\/jats:title>\n<jats:p>This study is registered as PROSPERO CRD42023384164.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"abs1-10\"><jats:title>Funding<\/jats:title>\n<jats:p>This award was funded by the National Institute for Health and Care Research (NIHR) Evidence Synthesis programme (NIHR award ref: NIHR135755) and is published in full in <jats:italic>Health Technology Assessment<\/jats:italic>; Vol. 28, No. 50. See the NIHR Funding and Awards website for further award information.<\/jats:p>\n<\/jats:sec>","DOI":"10.3310\/lkrt4721","type":"journal-article","created":{"date-parts":[[2024,9,10]],"date-time":"2024-09-10T12:19:45Z","timestamp":1725970785000},"page":"1-75","update-policy":"https:\/\/doi.org\/10.3310\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":8,"title":["Artificial intelligence software for analysing chest X-ray images to identify suspected lung cancer: an evidence synthesis early value assessment"],"prefix":"10.3310","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5962-2689","authenticated-orcid":true,"given":"Jill","family":"Colquitt","sequence":"first","affiliation":[{"name":"Effective Evidence, Waterlooville, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0497-8634","authenticated-orcid":true,"given":"Mary","family":"Jordan","sequence":"additional","affiliation":[{"name":"Warwick Medical School, University of Warwick, Coventry, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4567-2586","authenticated-orcid":true,"given":"Rachel","family":"Court","sequence":"additional","affiliation":[{"name":"Warwick Medical School, University of Warwick, Coventry, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8226-2634","authenticated-orcid":true,"given":"Emma","family":"Loveman","sequence":"additional","affiliation":[{"name":"Warwick Medical School, University of Warwick, Coventry, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0629-1596","authenticated-orcid":true,"given":"Janette","family":"Parr","sequence":"additional","affiliation":[{"name":"Warwick Medical School, University of Warwick, Coventry, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7073-7468","authenticated-orcid":true,"given":"Iman","family":"Ghosh","sequence":"additional","affiliation":[{"name":"Warwick Medical School, University of Warwick, Coventry, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5143-3218","authenticated-orcid":true,"given":"Peter","family":"Auguste","sequence":"additional","affiliation":[{"name":"Warwick Medical School, University of Warwick, Coventry, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7573-1447","authenticated-orcid":true,"given":"Mubarak","family":"Patel","sequence":"additional","affiliation":[{"name":"Warwick Medical School, University of Warwick, Coventry, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9054-1940","authenticated-orcid":true,"given":"Chris","family":"Stinton","sequence":"additional","affiliation":[{"name":"Warwick Medical School, University of Warwick, Coventry, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"6221","published-online":{"date-parts":[[2024,8]]},"reference":[{"key":"key2024091017461400_ref3-bib3","volume-title":"Overview: Lung Cancer","author":"NHS","year":"2022"},{"key":"key2024091017461400_ref4-bib4","volume-title":"Lung Cancer Incidence by Age","author":"Cancer Research UK","year":"2021"},{"key":"key2024091017461400_ref5-bib5","volume-title":"Lung Cancer","author":"Cancer Research UK","year":"2019"},{"key":"key2024091017461400_ref6-bib6","volume-title":"NHS Long Term Plan","author":"NHS","year":"2021"},{"key":"key2024091017461400_ref7-bib7","volume-title":"What is artificial intelligence (AI)","author":"IBM Cloud Education","year":"2020"},{"key":"key2024091017461400_ref8-bib8","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1007\/s00138-020-01101-5","article-title":"Deep learning applications in pulmonary medical imaging: recent updates and insights on COVID-19","volume":"31","author":"Farhat","year":"2020","journal-title":"Mach Vis Appl"},{"key":"key2024091017461400_ref13-bib13","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1038\/s41746-021-00438-z","article-title":"Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis","volume":"4","author":"Aggarwal","year":"2021","journal-title":"NPJ Digit Med"},{"key":"key2024091017461400_ref14-bib14","volume-title":"JBI Critical Appraisal Tools","author":"The Joanna Briggs Institute","year":"2021"},{"key":"key2024091017461400_ref15-bib15","volume-title":"Conceptual Modelling for Health Economic Model Development [HEDS Discussion Paper 12\/05]","author":"Tappenden","year":"2012"},{"key":"key2024091017461400_ref16-bib16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1136\/thoraxjnl-2015-207168","article-title":"British Thoracic Society guidelines for the investigation and management of pulmonary nodules","volume":"70","author":"Callister","year":"2015","journal-title":"Thorax"},{"key":"key2024091017461400_ref20-bib20","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1111\/j.1524-4733.2007.00187.x","article-title":"Principles of good practice for budget impact analysis: report of the ISPOR Task Force on good research practices \u2013 budget impact analysis","volume":"10","author":"Mauskopf","year":"2007","journal-title":"Value Health"},{"key":"key2024091017461400_ref21-bib21","first-page":"25","article-title":"Validation study of machine-learning chest radiograph software in primary and emergency medicine","volume":"78","author":"van Beek","year":"2022","journal-title":"Clin Radiol"},{"key":"key2024091017461400_ref22-bib22","volume-title":"Enhancing Early Lung Cancer Detection on Chest Radiographs with AI-Assistance: A Multi-Reader Study [Preprint]","author":"Dissez","year":"2022"},{"key":"key2024091017461400_ref23-bib23","doi-asserted-by":"crossref","first-page":"e190222","DOI":"10.1148\/ryct.2020190222","article-title":"Undetected lung cancer at posteroanterior chest radiography: potential role of a deep learning-based detection algorithm","volume":"2","author":"Nam","year":"2020","journal-title":"Radiol Cardiothorac Imaging"},{"key":"key2024091017461400_ref24-bib24","doi-asserted-by":"crossref","first-page":"652","DOI":"10.1148\/radiol.2020200165","article-title":"Deep learning-based automatic detection algorithm for reducing overlooked lung cancers on chest radiographs","volume":"296","author":"Jang","year":"2020","journal-title":"Radiology"},{"key":"key2024091017461400_ref25-bib25","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1111\/1754-9485.13105","article-title":"Extravalidation and reproducibility results of a commercial deep learning-based automatic detection algorithm for pulmonary nodules on chest radiographs at tertiary hospital","volume":"65","author":"Koo","year":"2021","journal-title":"J Med Imaging Radiat Oncol"},{"key":"key2024091017461400_ref26-bib26","doi-asserted-by":"crossref","first-page":"e2141096","DOI":"10.1001\/jamanetworkopen.2021.41096","article-title":"An artificial intelligence-based chest X-ray model on human nodule detection accuracy from a multicenter study","volume":"4","author":"Homayounieh","year":"2021","journal-title":"JAMA Netw Open"},{"key":"key2024091017461400_ref27-bib27","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1148\/radiol.2491072025","article-title":"The \u2018laboratory\u2019 effect: comparing radiologists\u2019 performance and variability during prospective clinical and laboratory mammography interpretations","volume":"249","author":"Gur","year":"2008","journal-title":"Radiology"},{"key":"key2024091017461400_ref28-bib28","volume-title":"Global Cancer Observatory: Cancer Today","author":"Ferlay","year":"2020"},{"key":"key2024091017461400_ref29-bib29","first-page":"MR000033","article-title":"Industry sponsorship and research outcome","volume":"2","author":"Lundh","year":"2017","journal-title":"Cochrane Database Syst Rev"},{"key":"key2024091017461400_ref30-bib30","volume-title":"Prospective Evaluation of Deep Learning-Based Detection Model for Chest Radiographs in Outpatient Respiratory Clinic","author":"Kim","year":"2020"},{"key":"key2024091017461400_ref31-bib31","volume-title":"A Study to Assess the Impact of an Artificial Intelligence (AI) System on Chest X-ray Reporting","author":"Avery","year":"2022"},{"key":"key2024091017461400_ref32-bib32","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1016\/j.radi.2017.07.011","article-title":"Expanding the role of radiographers in reporting suspected lung cancer: a cost-effectiveness analysis using a decision tree model","volume":"23","author":"Bajre","year":"2017","journal-title":"Radiography (Lond)"},{"key":"key2024091017461400_ref33-bib33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3310\/hta22690","article-title":"Low-dose computed tomography for lung cancer screening in high-risk populations: a systematic review and economic evaluation","volume":"22","author":"Snowsill","year":"2018","journal-title":"Health Technol Assess"},{"key":"key2024091017461400_ref35-bib35","doi-asserted-by":"crossref","first-page":"6269","DOI":"10.1007\/s00330-021-07708-0","article-title":"Chest X-ray in suspected lung cancer is harmful","volume":"31","author":"Foley","year":"2021","journal-title":"Eur Radiol"},{"key":"key2024091017461400_ref36-bib36","doi-asserted-by":"crossref","first-page":"e862","DOI":"10.3399\/BJGP.2020.1099","article-title":"Chest X-ray sensitivity and lung cancer outcomes: a retrospective observational study","volume":"71","author":"Bradley","year":"2021","journal-title":"Br J Gen Pract"},{"key":"key2024091017461400_ref37-bib37","doi-asserted-by":"crossref","first-page":"507.e1","DOI":"10.1016\/j.crad.2017.11.016","article-title":"Immediate reporting of chest X-rays referred from general practice by reporting radiographers: a single centre feasibility study","volume":"73","author":"Woznitza","year":"2018","journal-title":"Clin Radiol"},{"key":"key2024091017461400_ref38-bib38","doi-asserted-by":"crossref","first-page":"890","DOI":"10.1136\/thorax-2022-219210","article-title":"Impact of radiographer immediate reporting of X-rays of the chest from general practice on the lung cancer pathway (RadioX): a randomised controlled trial","volume":"78","author":"Woznitza","year":"2022","journal-title":"Thorax"},{"key":"key2024091017461400_ref39-bib39","first-page":"20210005","article-title":"The diagnostic performance of chest radiographs for lung malignancy in symptomatic primary-care populations: a systematic review and meta-analysis","volume":"3","author":"Dwyer-Hemmings","year":"2021","journal-title":"BJR Open"},{"key":"key2024091017461400_ref40-bib40","doi-asserted-by":"crossref","first-page":"6614","DOI":"10.1200\/jco.2015.33.15_suppl.6614","article-title":"Stage specific health utility index scores of Canadian cancer patients","volume":"33","author":"Naik","year":"2015","journal-title":"J Clin Oncol"},{"key":"key2024091017461400_ref41-bib41","doi-asserted-by":"crossref","first-page":"e827","DOI":"10.3399\/bjgp19X706853","article-title":"Sensitivity of chest X-ray for detecting lung cancer in people presenting with symptoms: a systematic review","volume":"69","author":"Bradley","year":"2019","journal-title":"Br J Gen Pract"},{"key":"key2024091017461400_ref42-bib42","first-page":"A92","article-title":"P13 Mapping the lung cancer pathway","volume":"76","author":"Lawson","year":"2021","journal-title":"Thorax"},{"key":"key2024091017461400_ref43-bib43","volume-title":"Radiology Reporting Figures for Service Planning","author":"Royal College of Radiologists","year":"2022"},{"key":"key2024091017461400_ref44-bib44","volume-title":"Health Technol Assess","author":"Field","year":"2016"},{"key":"key2024091017461400_ref45-bib45","volume-title":"Software with Artificial Intelligence Derived Algorithms for Automated Detection and Analysis of Lung Nodules from CT Scan Images: A Diagnostics Assessment Report","author":"Geppert","year":"2022"},{"key":"key2024091017461400_ref46-bib46","doi-asserted-by":"crossref","first-page":"1332","DOI":"10.1016\/S1470-2045(14)70389-4","article-title":"Lung cancer probability in patients with CT-detected pulmonary nodules: a prespecified analysis of data from the NELSON trial of low-dose CT screening","volume":"15","author":"Horeweg","year":"2014","journal-title":"Lancet Oncol"},{"key":"key2024091017461400_ref48-bib48","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1513\/AnnalsATS.201301-007OC","article-title":"Quality of life and healthcare use in a randomized controlled lung cancer screening study","volume":"10","author":"Mazzone","year":"2013","journal-title":"Ann Am Thorac Soc"},{"key":"key2024091017461400_ref49-bib49","doi-asserted-by":"crossref","first-page":"e0237492","DOI":"10.1371\/journal.pone.0237492","article-title":"Cost-effectiveness of a new autoantibody test added to Computed Tomography (CT) compared to CT surveillance alone in the diagnosis of lung cancer amongst patients with indeterminate pulmonary nodules","volume":"15","author":"Sutton","year":"2020","journal-title":"PLOS ONE"},{"key":"key2024091017461400_ref50-bib50","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3310\/hta16040","article-title":"Non-invasive diagnostic assessment tools for the detection of liver fibrosis in patients with suspected alcohol-related liver disease: a systematic review and economic evaluation","volume":"16","author":"Stevenson","year":"2012","journal-title":"Health Technol Assess"},{"key":"key2024091017461400_ref51-bib51","volume-title":"Unit Costs of Health and Social Care","author":"Jones","year":"2021"},{"key":"key2024091017461400_ref52-bib52","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1016\/j.radi.2015.09.004","article-title":"An economic evaluation of introducing a skills mix approach to CT head reporting in clinical practice","volume":"22","author":"Lockwood","year":"2016","journal-title":"Radiography"},{"key":"key2024091017461400_ref53-bib53","volume-title":"Unit Costs of Health and Social Care 2021","author":"Jones","year":"2021"},{"key":"key2024091017461400_ref54-bib54","volume-title":"Saving Lives, Averting Costs: An Analysis of the Financial Implications of Achieving Earlier Diagnosis of Colorectal, Lung and Ovarian Cancer","author":"Birtwistle","year":"2014"},{"key":"key2024091017461400_ref55-bib55","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/j.lungcan.2016.04.009","article-title":"Factors affecting hospital costs in lung cancer patients in the United Kingdom","volume":"97","author":"Kennedy","year":"2016","journal-title":"Lung Cancer"},{"key":"key2024091017461400_ref56-bib56","doi-asserted-by":"crossref","first-page":"525","DOI":"10.3111\/13696998.2015.1032974","article-title":"Treatment cost of non-small cell lung cancer in three European countries: comparisons across France, Germany, and England using administrative databases","volume":"18","author":"McGuire","year":"2015","journal-title":"J Med Econ"},{"key":"key2024091017461400_ref57-bib57","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1002\/jrsm.1255","article-title":"Comparison of a full systematic review versus rapid review approaches to assess a newborn screening test for tyrosinemia type 1","volume":"8","author":"Taylor\u2010Phillips","year":"2017","journal-title":"Res Synth Methods"},{"key":"key2024091017461400_ref58-bib58","doi-asserted-by":"crossref","first-page":"286","DOI":"10.5694\/j.1326-5377.2007.tb01245.x","article-title":"Health technology assessment in Canada: diversity and evolution","volume":"187","author":"Hailey","year":"2007","journal-title":"Med J Aust"},{"key":"key2024091017461400_ref59-bib59","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1017\/S0266462308080185","article-title":"Rapid reviews versus full systematic reviews: an inventory of current methods and practice in health technology assessment","volume":"24","author":"Watt","year":"2008","journal-title":"Int J Technol Assess Health Care"}],"container-title":["Health Technology Assessment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/njl-admin.nihr.ac.uk\/document\/download\/2045881","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.journalslibrary.nihr.ac.uk\/publications\/LKRT4721\/LKRT4721.xml","content-type":"text\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/njl-admin.nihr.ac.uk\/document\/download\/2045881","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,10]],"date-time":"2024-09-10T12:20:22Z","timestamp":1725970822000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.journalslibrary.nihr.ac.uk\/hta\/LKRT4721"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8]]},"references-count":48,"alternative-id":["10.3310\/LKRT4721"],"URL":"https:\/\/doi.org\/10.3310\/lkrt4721","relation":{},"ISSN":["2046-4924"],"issn-type":[{"value":"2046-4924","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8]]},"assertion":[{"value":"This content has been made freely available to all.","name":"free","label":"Free to read"},{"value":"11-2022","name":"contractual_start_date","label":"contractual_start_date","group":{"name":"article_history","label":"Article History"}},{"value":"02-2023","name":"editorial_review_begun","label":"editorial review begun","group":{"name":"article_history","label":"Article History"}},{"value":"12-2023","name":"accepted_for_publication","label":"Accepted for publication","group":{"name":"article_history","label":"Article History"}}]}}