{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,26]],"date-time":"2026-08-26T18:18:48Z","timestamp":1787768328392,"version":"build-2784847793"},"reference-count":27,"publisher":"Public Library of Science (PLoS)","issue":"8","license":[{"start":{"date-parts":[[2026,8,26]],"date-time":"2026-08-26T00:00:00Z","timestamp":1787702400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.plosdigitalhealth.org"],"crossmark-restriction":false},"short-container-title":["PLOS Digit Health"],"abstract":"<jats:p>Conducting a health technology assessment (HTA) for each indication of a medicine contributes to increasing demand on HTA systems and results in delays in access. Streamlining assessments for subsequent indications has been proposed, but there is limited evidence on how this could be achieved. We aimed to quantify semantic similarity between HTA documents for different indications of the same medicine to explore whether concepts could be carried forward to subsequent assessments. Public Summary Documents (PSDs) from July 2019 to November 2024 were included if they related to new major submissions to the Australian Pharmaceutical Benefits Advisory Committee. Each paragraph was embedded using the Sentence-Bidirectional Encoder Representations from Transformers (SBERT) model. Pairwise Euclidean distances (measuring semantic similarity) were quantified between embeddings across indications for multi-indication medicines and were compared with those for single-indication medicines. Cluster analysis, followed by manual thematic review, identified recurrent concepts across indications of the same medicine. A total of 326 PSDs were included (154 single-indication medicines, 59 multi-indication medicines). Multi-indication medicines demonstrated significantly greater semantic similarity across their indications compared with single-indication medicines. However, recurrence of specific concepts across either all or similar indications of a medicine was infrequent. Despite the greater semantic similarity observed across indications of multi-indication medicines, this did not translate into substantial opportunities to carry forward assessment concepts. Therefore, it is unlikely that any concepts or information from assessments undertaken for previous indications could be carried forward to subsequent indications. The methods described provide a foundation for future research on semantic overlap in HTA and other policy areas.<\/jats:p>","DOI":"10.1371\/journal.pdig.0001657","type":"journal-article","created":{"date-parts":[[2026,8,26]],"date-time":"2026-08-26T17:28:47Z","timestamp":1787765327000},"page":"e0001657","update-policy":"https:\/\/doi.org\/10.1371\/journal.pdig.corrections_policy","source":"Crossref","is-referenced-by-count":0,"title":["A natural language processing approach to determine whether streamlined health technology assessment for multi-indication medicines is feasible"],"prefix":"10.1371","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5954-3216","authenticated-orcid":true,"given":"Isaiah","family":"Luc","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Drew","family":"Carter","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Erik","family":"Bergman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gabriel","family":"Westman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tracy","family":"Merlin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2026,8,26]]},"reference":[{"issue":"2","key":"pdig.0001657.ref001","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1007\/s40258-025-01020-4","article-title":"Funding multi-indication medicines: a scoping review of health technology assessment and reimbursement frameworks","volume":"24","author":"I Luc","year":"2026","journal-title":"Appl Health Econ Health Policy"},{"issue":"1","key":"pdig.0001657.ref002","doi-asserted-by":"crossref","first-page":"1964791","DOI":"10.1080\/20016689.2021.1964791","article-title":"Accelerating patient access to oncology medicines with multiple indications in Europe","volume":"9","author":"R Lawlor","year":"2021","journal-title":"J Mark Access Health Policy"},{"key":"pdig.0001657.ref003","unstructured":"Australian Government Department of Health, Disability and Ageing. Submissions to the March 2025 meeting of the Pharmaceutical Benefits Advisory Committee; 2024 [cited 2024 Oct 28]. Available from: https:\/\/www.pbs.gov.au\/info\/news\/2024\/10\/submissions-to-the-march-2025-meeting-of-the-pbac"},{"key":"pdig.0001657.ref004","unstructured":"Merlin T, Laka M, Carter D, Gao Y, Choi YS, Parsons J, et al. Health technology assessment policy and methods review: HTA pathways and processes, clinical evaluation methods and horizon scanning. 2024."},{"key":"pdig.0001657.ref005","unstructured":"Medicines Australia. PD-1 and PD-L1 checkpoint inhibitor immunotherapies: options for subsidy consideration for multiple cancer types. 2018."},{"issue":"1","key":"pdig.0001657.ref006","doi-asserted-by":"crossref","first-page":"2","DOI":"10.3390\/jmahp13010002","article-title":"Multi-year multi-indication agreements for supporting patient access to oncology medicines with multiple indications: an experimental approach or here to stay?","volume":"13","author":"H Armstrong","year":"2025","journal-title":"J Mark Access Health Policy"},{"key":"pdig.0001657.ref007","unstructured":"Australian Government Department of Health, Disability and Ageing. Public Summary Documents; 2025. Available from: https:\/\/www.pbs.gov.au\/info\/industry\/listing\/elements\/pbac-meetings\/psd\/public-summary-documents-by-product"},{"issue":"12","key":"pdig.0001657.ref008","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0294560","article-title":"A full-document analysis of the semantic relation between European Public Assessment Reports and EMA guidelines using a BERT language model","volume":"18","author":"E Bergman","year":"2023","journal-title":"PLoS One"},{"issue":"10","key":"pdig.0001657.ref009","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0275386","article-title":"A natural language processing approach towards harmonisation of European medicinal product information","volume":"17","author":"E Bergman","year":"2022","journal-title":"PLoS One"},{"issue":"4","key":"pdig.0001657.ref010","doi-asserted-by":"crossref","first-page":"871","DOI":"10.1002\/cpt.3195","article-title":"A natural language processing approach towards harmonized communication of uncertainties identified during the European medicine authorization process","volume":"115","author":"S Verweij","year":"2024","journal-title":"Clin Pharmacol Ther"},{"key":"pdig.0001657.ref011","doi-asserted-by":"crossref","unstructured":"Reimers N, Gurevych I. Sentence-bert: sentence embeddings using siamese bert-networks. arXiv:190810084 [Preprint]. 2019.","DOI":"10.18653\/v1\/D19-1410"},{"issue":"13","key":"pdig.0001657.ref012","doi-asserted-by":"crossref","first-page":"13","DOI":"10.5120\/11638-7118","article-title":"A survey of text similarity approaches","volume":"68","author":"W Gomaa","year":"2013","journal-title":"IJCA"},{"issue":"3","key":"pdig.0001657.ref013","doi-asserted-by":"crossref","DOI":"10.1145\/3068335","article-title":"DBSCAN revisited, revisited: why and how you should (still) use DBSCAN","volume":"42","author":"E Schubert","year":"2017","journal-title":"ACM Trans Database Syst"},{"key":"pdig.0001657.ref014","unstructured":"Independent Health and Aged Care Pricing Authority. AR-DRG Version 11.0; 2023. Available from: https:\/\/www.ihacpa.gov.au\/resources\/ar-drg-version-110"},{"key":"pdig.0001657.ref015","unstructured":"U.S. Food & Drug Administration. Determining the extent of safety data collection needed in late stage premarket and postapproval clinical investigations. 2016."},{"key":"pdig.0001657.ref016","unstructured":"International Network of Agencies for Health Technology Assessment. HTA Glossary. Available from: https:\/\/htaglossary.net\/HomePage"},{"key":"pdig.0001657.ref017","volume-title":"SBERT studies meaning representations: decomposing sentence embeddings into explainable semantic features","author":"J Opitz","year":"2022"},{"key":"pdig.0001657.ref018","unstructured":"U.S. Food & Drug Administration. Use of Bayesian methodology in clinical trials of drug and biological products. 2026."},{"key":"pdig.0001657.ref019","unstructured":"Australian Government Department of Health, Disability and Ageing. Options for listing PD-(L)1 checkpoint inhibitors for multiple cancer indications on the PBS. 2018."},{"issue":"3","key":"pdig.0001657.ref020","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1377\/hlthaff.21.3.166","article-title":"Globalize the evidence, localize the decision: evidence-based medicine and international diversity","volume":"21","author":"JM Eisenberg","year":"2002","journal-title":"Health Aff (Millwood)"},{"issue":"6","key":"pdig.0001657.ref021","article-title":"Towards a coordinated approach for managing accelerated patient access to potentially beneficial medicines: reporting the perspectives of a multi-stakeholder, international workshop","volume":"2","author":"M Phillips","year":"2024","journal-title":"Health Aff Sch"},{"key":"pdig.0001657.ref022","unstructured":"Australian Government Department of Health, Disability and Ageing. NIVOLUMAB, injection concentrate for I.V. infusion 40 mg in 4 mL, injection concentrate for I.V. infusion 100 mg in 10 mL, Opdivo, IPILIMUMAB injection concentrate for I.V. infusion 50 mg in 10 mL, injection concentrate for I.V. infusion 200 mg in 40 mL, Yervoy. 2025."},{"issue":"3","key":"pdig.0001657.ref023","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1007\/s41669-024-00556-w","article-title":"From vision to reality: the EU\u2019s pharmaceutical reforms and the path to improved access","volume":"9","author":"C Main","year":"2025","journal-title":"PharmacoEcon - Open"},{"issue":"4","key":"pdig.0001657.ref024","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1016\/j.eiar.2009.01.004","article-title":"Multi-jurisdictional environmental impact assessment: Canadian experiences","volume":"29","author":"P Fitzpatrick","year":"2009","journal-title":"Environ Impact Assess Rev"},{"key":"pdig.0001657.ref025","unstructured":"Banerjee D, Singh P, Avadhanam A, Srivastava S. Benchmarking LLM powered chatbots: methods and metrics. arXiv:230804624 [Preprint]. 2023."},{"issue":"1","key":"pdig.0001657.ref026","doi-asserted-by":"crossref","first-page":"196","DOI":"10.54216\/JISIoT.130115","article-title":"Systematic analysis based on conflux of machine learning and internet of things using bibliometric analysis","volume":"13","author":"A Chahal","year":"2024","journal-title":"JISIoT"},{"key":"pdig.0001657.ref027","doi-asserted-by":"crossref","unstructured":"Sapkota R, Raza S, Karkee M. Comprehensive analysis of transparency and accessibility of ChatGPT, DeepSeek, and other SoTA large language models. arXiv [Preprint]. 2025.","DOI":"10.20944\/preprints202502.1608.v1"}],"container-title":["PLOS Digital Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pdig.0001657","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,26]],"date-time":"2026-08-26T17:28:51Z","timestamp":1787765331000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pdig.0001657"}},"subtitle":[],"editor":[{"given":"Dukyong","family":"Yoon","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2026,8,26]]},"references-count":27,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2026,8,26]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pdig.0001657","relation":{},"ISSN":["2767-3170"],"issn-type":[{"value":"2767-3170","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,26]]}}}