{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,10]],"date-time":"2026-10-10T02:31:27Z","timestamp":1791599487873,"version":"4.3.4"},"reference-count":53,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T00:00:00Z","timestamp":1769558400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,2,20]],"date-time":"2026-02-20T00:00:00Z","timestamp":1771545600000},"content-version":"vor","delay-in-days":23,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Real-world evidence (RWE) is increasingly recognized as a valuable type of oncology research but extracting fit-for-purpose real-world data (RWD) from electronic health records (EHRs) remains challenging. Manual abstraction from free-text clinical documents, although the gold standard for information extraction, is resource-intensive. RWD generation using natural language processing (NLP) has been limited by performance ceilings and annotation requirements, which recent LLMs improve on. Multiple myeloma (MM) is the second most common hematological malignancy, with many opportunities for RWE to expand knowledge of disease and treatment. We evaluate new NLP workflows in abstracting MM-related clinical data fields from de-identified EHRs.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>\n                      NLP workflows (BERT and Llama-based, using various prompt types) were developed for 12 MM-specific data fields and evaluated with manually curated data from 125 clinical notes. Statistical analysis was conducted to evaluate characteristics of models and data associated with F\n                      <jats:sub>1<\/jats:sub>\n                      scores. For 200 randomly selected patients, three illustrative data fields (MM status, transplant status, and extramedullary disease) were extracted with a corresponding timestamp from all patient notes within a 120-day window of the index MM diagnosis date using the best-performing Llama workflow. Abstracted data field labels were then plotted on a timeline to display the frequency with which these data fields are documented in patient records.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Average F\n                      <jats:sub>1<\/jats:sub>\n                      across the 12 data fields for the best Llama and BERT workflows was 0.82 and 0.65 respectively. Best workflow performance ranged across the data fields (F\n                      <jats:sub>1<\/jats:sub>\n                      \u2009=\u20090.59\u20130.99). Statistical analysis of the results showed model size, inter-rater reliability (IRR), variable type, and prompt design significantly predicted workflow performance, in descending order of significance (\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u20090.05).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Performance improvements with larger LLMs and chain-of-thought prompting was greater in data fields with greater difficulty of abstraction. IRR can prioritize NLP resources, increasing efficiency of RWD generation without sacrificing data quality. Strategic selection of NLP tool using the proposed framework has the potential to inform planning of RWD generation, ultimately accelerating insights from RWE.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12911-026-03345-z","type":"journal-article","created":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T14:14:59Z","timestamp":1769609699000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Automated abstraction of clinical parameters of multiple myeloma from real-world clinical notes using large language models"],"prefix":"10.1186","volume":"26","author":[{"given":"Alana O\u2019Brien","family":"Del Campo","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dmytro","family":"Lituiev","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gowtham","family":"Varma","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mithun","family":"Manoharan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sunil","family":"Kumar Ravi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Avinash","family":"Aman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ankit","family":"Kansagra","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joel","family":"Greshock","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"AJ","family":"Venkatakrishnan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ashita S.","family":"Batavia","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,1,28]]},"reference":[{"issue":"5","key":"3345_CR1","doi-asserted-by":"publisher","first-page":"907","DOI":"10.1093\/jnci\/djae321","volume":"117","author":"A Mafra","year":"2024","unstructured":"Mafra A, Laversanne M, Marcos-Gragera R, Chaves HVS, Mcshane C, Bray F, et al. The global multiple myeloma incidence and mortality burden in 2022 and predictions for 2045. J Natl Cancer Inst. 2024;117(5):907\u201314.","journal-title":"J Natl Cancer Inst"},{"key":"3345_CR2","doi-asserted-by":"crossref","unstructured":"Richardson PG, San Miguel JF, Moreau P, Hajek R, Dimopoulos MA, Laubach JP, et al. Interpreting clinical trial data in multiple myeloma: translating findings to the real-world setting. Blood Cancer J. 2018;8(11).","DOI":"10.1038\/s41408-018-0141-0"},{"key":"3345_CR3","doi-asserted-by":"crossref","unstructured":"Bertamini L, Bertuglia G, Oliva S. Beyond clinical trials in patients with multiple myeloma: a critical review of real-world results. Front Oncol. 2022;12.","DOI":"10.3389\/fonc.2022.844779"},{"key":"3345_CR4","doi-asserted-by":"crossref","unstructured":"Eichler H, Pignatti F, Schwarzer-Daum B, Hidalgo\u2010Simon A, Eichler I, Arlett P, et al. Randomised controlled trials versus real world evidence: neither magic nor myth. Clin Pharmacol Ther. 2020.","DOI":"10.1002\/cpt.2083"},{"key":"3345_CR5","doi-asserted-by":"crossref","unstructured":"Sherman RE, Anderson SA, Dal Pan GJ, Gray GW, Gross T, Hunter NL, et al. Real-world evidence \u2014 What is it and What can it tell us? N Engl J Med. 2016;(23):2293\u20137.","DOI":"10.1056\/NEJMsb1609216"},{"issue":"8","key":"3345_CR6","doi-asserted-by":"publisher","first-page":"E328","DOI":"10.1016\/S1470-2045(16)30206-6","volume":"17","author":"P Kumar","year":"2016","unstructured":"Kumar P, Anderson, Durie, Landgren M, et al. International myeloma working group consensus criteria for response and minimal residual disease assessment in multiple myeloma. Lancet Oncol. 2016;17(8):E328\u201346.","journal-title":"Lancet Oncol"},{"issue":"12","key":"3345_CR7","doi-asserted-by":"publisher","first-page":"E538","DOI":"10.1016\/S1470-2045(14)70442-5","volume":"15","author":"D Rajkumar","year":"2014","unstructured":"Rajkumar D, Palumbo, Blade, Merlini M, et al. International myeloma working group updated criteria for the diagnosis of multiple myeloma. Lancet Oncol. 2014;15(12):E538\u201348.","journal-title":"Lancet Oncol"},{"key":"3345_CR8","first-page":"E2300197","volume":"8","author":"SD Goryachev","year":"2024","unstructured":"Goryachev SD, Yildirim C, DuMontier C, La J, Dharne M, Gaziano JM, et al. Natural Language processing algorithm to extract multiple myeloma stage from oncology notes in the veterans affairs healthcare system. JCO Clin Cancer Inf. 2024;8:E2300197.","journal-title":"JCO Clin Cancer Inf"},{"key":"3345_CR9","doi-asserted-by":"crossref","unstructured":"Wang M, Yu Y-C, Liu L, Schoen MW, Kumar A, Vargo K, et al. Natural Language Processing\u2013Assisted classification models to confirm monoclonal gammopathy of undetermined significance and progression in Veterans\u2019 electronic health records. JCO Clin Cancer Inf. 2023;(7).","DOI":"10.1200\/CCI.23.00081"},{"key":"3345_CR10","doi-asserted-by":"crossref","unstructured":"Loda S, Krebs J, Danhof S, Schreder M, Solimando AG, Strifler S, et al. Exploration of artificial intelligence use with ARIES in multiple myeloma research. J Clin Med. 2019;8(7).","DOI":"10.3390\/jcm8070999"},{"key":"3345_CR11","doi-asserted-by":"publisher","first-page":"4700","DOI":"10.1182\/blood-2023-182252","volume":"142","author":"S Graham","year":"2023","unstructured":"Graham S, Graham J, O\u2019Rourke J, Deveras C, Theocharous P, Rose V, et al. Machine learning approach to estimating ECOG PS for a Multiple-Myeloma cohort from real world data. Blood. 2023;142:4700.","journal-title":"Blood"},{"issue":"2","key":"3345_CR12","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1111\/bjh.20136","volume":"207","author":"M Mittelman","year":"2025","unstructured":"Mittelman M, Israel A, Oster HS, Leshchinsky M, Ben-Shlomo Y, Kepten E, et al. Can we identify individuals at risk to develop multiple myeloma? A machine learning\u2010based predictive model. Br J Haematol. 2025;207(2):387\u201394.","journal-title":"Br J Haematol"},{"key":"3345_CR13","doi-asserted-by":"crossref","unstructured":"Chandradevan Ramraj A, Ahmed D, Bradley K, Nilakshan A, Mohamed GD, et al. Machine-based detection and classification for bone marrow aspirate differential counts: initial development focusing on nonneoplastic cells. Lab Invest. 2019;100(1).","DOI":"10.1038\/s41374-019-0325-7"},{"key":"3345_CR14","unstructured":"Vaswani A. Attention is all you need. Adv Neural Inf Process Syst. 2017."},{"issue":"3","key":"3345_CR15","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1093\/jamia\/ocz200","volume":"27","author":"S Wu","year":"2020","unstructured":"Wu S, Roberts K, Datta S, Du J, Ji Z, Si Y, et al. Deep learning in clinical natural Language processing: a methodical review. J Am Med Inf Assoc. 2020;27(3):457\u201370.","journal-title":"J Am Med Inf Assoc"},{"key":"3345_CR16","doi-asserted-by":"crossref","unstructured":"Li I, Pan J, Goldwasser J, Verma N, Wong WP, Nuzumlal\u0131 MY, et al. Neural natural Language processing for unstructured data in electronic health records: a review. Comput Sci Rev. 2022;46.","DOI":"10.1016\/j.cosrev.2022.100511"},{"key":"3345_CR17","doi-asserted-by":"crossref","unstructured":"Fu C, He L, Moon P, et al. Clinical concept extraction: a methodology review. J Biomed Inform. 2020;109.","DOI":"10.1016\/j.jbi.2020.103526"},{"issue":"16 Suppl","key":"3345_CR18","doi-asserted-by":"publisher","first-page":"11176","DOI":"10.1200\/JCO.2024.42.16_suppl.11176","volume":"42","author":"G Varma","year":"2024","unstructured":"Varma G, Yenukoti RK, Kumar MP, Ashrit BS, Purushotham K, S C, et al. A deep learning\u2013enabled workflow to estimate real world progression-free survival in patients with metastatic breast cancer. J Clin Oncol. 2024;42(16 Suppl):11176.","journal-title":"J Clin Oncol"},{"key":"3345_CR19","doi-asserted-by":"crossref","unstructured":"Wagner T, Shweta F, Murugadoss K, Awasthi S, Venkatakrishnan AJ, Bade S, et al. Augmented curation of clinical notes from a massive EHR system reveals symptoms of impending COVID-19 diagnosis. elife. 2020;9.","DOI":"10.7554\/eLife.58227"},{"key":"3345_CR20","first-page":"E2300151","volume":"8","author":"H Barman","year":"2024","unstructured":"Barman H, Venkateswaran S, Santo AD, Yoo U, Silvert E, Rao K, et al. Identification and characterization of immune checkpoint Inhibitor\u2013Induced toxicities from electronic health records using natural language processing. JCO Clin Cancer Inf. 2024;8:E2300151.","journal-title":"JCO Clin Cancer Inf"},{"key":"3345_CR21","unstructured":"Devlin J, Bert. Pre-training of deep bidirectional transformers for language understanding. ArXiv Preprint arXiv. 2018;1810(04805)."},{"issue":"11692","key":"3345_CR22","first-page":"364","volume":"1907","author":"Y Liu","year":"2019","unstructured":"Liu Y, Roberta. A robustly optimized Bert pretraining approach. ArXiv Preprint arXiv. 2019;1907(11692):364.","journal-title":"ArXiv Preprint arXiv"},{"key":"3345_CR23","unstructured":"Jaiswal A, Evangelos Milios. Breaking the token barrier: chunking and convolution for efficient long text classification with BERT. ArXiv Preprint arXiv. 2023;2310(20558)."},{"key":"3345_CR24","first-page":"03066","volume":"2405","author":"L Li","year":"2024","unstructured":"Li L, et al. A scoping review of using large Language models (llms) to investigate electronic health records (ehrs). ArXiv Preprint arXiv. 2024;2405:03066.","journal-title":"ArXiv Preprint arXiv"},{"issue":"4","key":"3345_CR25","doi-asserted-by":"publisher","first-page":"400","DOI":"10.1111\/head.14702","volume":"64","author":"C Chiang","year":"2024","unstructured":"Chiang C, Luo M, Dumkrieger G, Trivedi S, Chen Y, Chao C, et al. A large Language model\u2013based generative natural Language processing framework fine-tuned on clinical notes accurately extracts headache frequency from electronic health records. Headache. 2024;64(4):400\u20139.","journal-title":"Headache"},{"issue":"3","key":"3345_CR26","doi-asserted-by":"publisher","first-page":"209","DOI":"10.3857\/roj.2023.00633","volume":"41","author":"HS Choi","year":"2023","unstructured":"Choi HS, Song JY, Shin KH, Chang JH, Jang B-S. Developing prompts from large Language model for extracting clinical information from pathology and ultrasound reports in breast cancer. Radiat Oncol J. 2023;41(3):209\u201316.","journal-title":"Radiat Oncol J"},{"key":"3345_CR27","doi-asserted-by":"crossref","unstructured":"Lee DT, et al. Development of a privacy preserving large language model for automated data extraction from thyroid cancer pathology reports. MedRxiv. 2023;11\u20132023.","DOI":"10.1101\/2023.11.08.23298252"},{"key":"3345_CR28","doi-asserted-by":"crossref","unstructured":"Fink MA, Bischoff A, Fink CA, Moll M, Kroschke J, Dulz L, et al. Potential of ChatGPT and GPT-4 for data mining of free-text CT reports on lung cancer. Radiology. 2023;308(3).","DOI":"10.1148\/radiol.231362"},{"key":"3345_CR29","doi-asserted-by":"crossref","unstructured":"Hu D, Liu B, Zhu X, Lu X, Wu N. Zero-shot information extraction from radiological reports using ChatGPT. Int J Med Inform. 2024;183.","DOI":"10.1016\/j.ijmedinf.2023.105321"},{"key":"3345_CR30","doi-asserted-by":"crossref","unstructured":"Alsentzer E, Rasmussen MJ, Fontoura R, Cull AL, Beaulieu-Jones B, Gray KJ, et al. Zero-shot interpretable phenotyping of postpartum hemorrhage using large language models. NPJ Digit Med. 2023;6(1).","DOI":"10.1038\/s41746-023-00957-x"},{"key":"3345_CR31","first-page":"12297","volume":"2403","author":"M Mahbub","year":"2024","unstructured":"Mahbub M, et al. Leveraging large Language models to extract information on substance use disorder severity from clinical notes: A Zero-shot learning approach. ArXiv Preprint arXiv. 2024;2403:12297.","journal-title":"ArXiv Preprint arXiv"},{"key":"3345_CR32","doi-asserted-by":"crossref","unstructured":"Guevara M, Chen S, Thomas S, Chaunzwa TL, Franco I, Kann BH, et al. Large language models to identify social determinants of health in electronic health records. NPJ Digit Med. 2024;7(1).","DOI":"10.1038\/s41746-023-00970-0"},{"key":"3345_CR33","doi-asserted-by":"publisher","first-page":"E55318","DOI":"10.2196\/55318","volume":"12","author":"S Sivarajkumar","year":"2024","unstructured":"Sivarajkumar S, Kelley M, Samolyk-Mazzanti A, Visweswaran S, Wang Y. An empirical evaluation of prompting strategies for large Language models in Zero-Shot clinical natural Language processing: algorithm development and validation study. JMIR Med Inf. 2024;12:E55318.","journal-title":"JMIR Med Inf"},{"issue":"9","key":"3345_CR34","doi-asserted-by":"publisher","first-page":"1929","DOI":"10.1093\/jamia\/ocae095","volume":"31","author":"M Li","year":"2024","unstructured":"Li M, Zhou H, Yang H, Zhang R. RT: a retrieving and Chain-of-Thought framework for few-shot medical named entity recognition. J Am Med Inf Assoc. 2024;31(9):1929\u201338.","journal-title":"J Am Med Inf Assoc"},{"issue":"3","key":"3345_CR35","doi-asserted-by":"publisher","first-page":"E298892","DOI":"10.1371\/journal.pone.0298892","volume":"19","author":"N Tavabi","year":"2024","unstructured":"Tavabi N, Singh M, Pruneski J, Kiapour AM. Systematic evaluation of common natural Language processing techniques to codify clinical notes. PLoS ONE. 2024;19(3):E298892.","journal-title":"PLoS ONE"},{"key":"3345_CR36","unstructured":"Meta. Introducing Meta Llama 3: The most capable openly available LLM to date. Introducing Meta Llama 3: The most capable openly available LLM to date. 2024."},{"key":"3345_CR37","doi-asserted-by":"crossref","unstructured":"Murugadoss R, Malin, Agarwal, Bade, Anderson, et al. Building a best-in-class automated de-identification tool for electronic health records through ensemble learning. Patterns. 2021;2(6).","DOI":"10.1016\/j.patter.2021.100255"},{"key":"3345_CR38","doi-asserted-by":"crossref","unstructured":"Beckler DT, Thumser ZC, Schofield JS, Marasco PD. Reliability in evaluator-based tests: using simulation-constructed models to determine contextually relevant agreement thresholds. BMC Med Res Methodol. 2018;18(1).","DOI":"10.1186\/s12874-018-0606-7"},{"key":"3345_CR39","doi-asserted-by":"crossref","unstructured":"Beltagy I, Lo K, Cohan A. SciBERT: A pretrained language model for scientific text. ArXiv cs. 2019.","DOI":"10.18653\/v1\/D19-1371"},{"key":"3345_CR40","unstructured":"Huang K, Altosaar J, Ranganath R, ClinicalBERT. Modeling clinical notes and predicting hospital readmission. ArXiv cs. 2019."},{"key":"3345_CR41","unstructured":"McKinney W. Data structures for statistical computing in Python. In: van der Walt S, Millman J, editors. Proceedings of the 9th Python in Science Conference. 445."},{"key":"3345_CR42","unstructured":"Python Reference Manual, Van Python G, Drake F. 1995;L."},{"issue":"7825","key":"3345_CR43","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1038\/s41586-020-2649-2","volume":"585","author":"CR Harris","year":"2020","unstructured":"Harris CR, van der Millman KJ, Gommers R, Virtanen P, Cournapeau D, et al. Array programming with numpy. Nature. 2020;585(7825):357\u201362.","journal-title":"Nature"},{"issue":"3","key":"3345_CR44","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1038\/s41592-019-0686-2","volume":"17","author":"P Virtanen","year":"2020","unstructured":"Virtanen P, Gommers R, Oliphant TE, Haberland M, Reddy T, Cournapeau D, et al. SciPy 1.0: fundamental algorithms for scientific computing in python. Nat Methods. 2020;17(3):261\u201372.","journal-title":"Nat Methods"},{"issue":"3","key":"3345_CR45","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1109\/MCSE.2007.55","volume":"9","author":"JD Hunter","year":"2007","unstructured":"Hunter JD, Matplotlib. A 2D graphics environment. Comput Sci Eng. 2007;9(3):90\u20135.","journal-title":"Comput Sci Eng"},{"issue":"60","key":"3345_CR46","doi-asserted-by":"publisher","first-page":"3021","DOI":"10.21105\/joss.03021","volume":"6","author":"M Waskom","year":"2021","unstructured":"Waskom M. Seaborn: statistical data visualization. J Open Source Softw. 2021;6(60):3021.","journal-title":"J Open Source Softw"},{"key":"3345_CR47","doi-asserted-by":"crossref","unstructured":"Irizarry RA. ggplot2. In: Introduction Data Science. 2024;107\u201325.","DOI":"10.1201\/9781003220923-8"},{"key":"3345_CR48","volume-title":"A Language and environment for statistical computing","author":"R","year":"2013","unstructured":"R. A Language and environment for statistical computing. Vienna, Austria: Foundation for Statistical Computing; 2013."},{"key":"3345_CR49","doi-asserted-by":"crossref","unstructured":"Garza MY, Williams T, Ounpraseuth S, Hu Z, Lee J, Snowden J, et al. Error rates of data processing methods in clinical research: a systematic review and meta-analysis of manuscripts identified through pubmed. Res Sq [Preprint]. 2023;3.","DOI":"10.21203\/rs.3.rs-2386986\/v2"},{"issue":"11","key":"3345_CR50","doi-asserted-by":"publisher","first-page":"1189","DOI":"10.1093\/jamia\/ocz119","volume":"26","author":"T Hernandez-Boussard","year":"2019","unstructured":"Hernandez-Boussard T, Monda KL, Crespo BC, Riskin D. Real world evidence in cardiovascular medicine: ensuring data validity in electronic health record-based studies. J Am Med Inf Assoc. 2019;26(11):1189\u201394.","journal-title":"J Am Med Inf Assoc"},{"issue":"12","key":"3345_CR51","doi-asserted-by":"publisher","first-page":"S470","DOI":"10.1016\/j.jval.2022.09.2337","volume":"25","author":"A Sondhi","year":"2022","unstructured":"Sondhi A, Benedum C, Cohen A, Nemeth S, Bozkurt S. RWD112 can ML-Extracted variables reproduce real world comparative effectiveness results from Expert-Abstracted data? A case study in metastatic Non-Small cell lung cancer treatment. Value Health. 2022;25(12):S470.","journal-title":"Value Health"},{"issue":"12","key":"3345_CR52","doi-asserted-by":"publisher","first-page":"S13","DOI":"10.1016\/j.jval.2022.09.069","volume":"25","author":"C Benedum","year":"2022","unstructured":"Benedum C, Adamson B, Cohen A, Estevez M, Sondhi A, Fidyk E, et al. P57 machine Learning-Accelerated outcomes research: A Real-World case study of Biomarker-Associated overall survival in oncology. Value Health. 2022;25(12):S13\u20134.","journal-title":"Value Health"},{"key":"3345_CR53","doi-asserted-by":"crossref","unstructured":"Grotenhuis Z, Mosteiro PJ, Leeuwenberg AM. Modest performance of text mining to extract health outcomes may be almost sufficient for high-quality prognostic model development. Comput Biol Med. 2024;170.","DOI":"10.1016\/j.compbiomed.2024.108014"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-026-03345-z","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-026-03345-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-026-03345-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T17:16:32Z","timestamp":1781630192000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s12911-026-03345-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,28]]},"references-count":53,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["3345"],"URL":"https:\/\/doi.org\/10.1186\/s12911-026-03345-z","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,28]]},"assertion":[{"value":"6 February 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 January 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 January 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This study involves analysis of de-identified data via the nference nSights Platform. In accordance with the Code of Federal Regulations, 45 CFR 46.102(e)(1), analysis of de-identified data does not constitute human subjects research and therefore does not require IRB review. Data used in this analysis have been extracted from this environment using an established protocol for data extraction, aimed at preserving patient privacy. The data have been de-identified pursuant to an expert determination in accordance with the HIPAA Privacy Rule (45 CFR 164.514(b)(1)). This study was also conducted in accordance with the ethical principles outlined in the Declaration of Helsinki.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"ASB, AOD, JG, DL, and AK are current employees of Johnson & Johnson, which funded the execution of this study. ASB, JG, DL, and AK are minor stockholders of Johnson & Johnson. AOD is a former employee of nference and a minor stockholder of an nference subsidiary. AA, MM, SKR, GV, and AJV are current employees and minor stockholders of nference.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"51"}}