{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T10:07:22Z","timestamp":1775902042152,"version":"3.50.1"},"reference-count":56,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,1,13]],"date-time":"2025-01-13T00:00:00Z","timestamp":1736726400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,1,13]],"date-time":"2025-01-13T00:00:00Z","timestamp":1736726400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Measures of diagnostic test accuracy provide evidence of how well a test correctly identifies or rules-out disease. Commonly used diagnostic accuracy measures (DAMs) include sensitivity and specificity, predictive values, likelihood ratios, area under the receiver operator characteristic curve (AUROC), area under precision-recall curves (AUPRC), diagnostic effectiveness (accuracy), disease prevalence, and diagnostic odds ratio (DOR) etc. Most available analysis tools perform accuracy testing for a single diagnostic test using summarized data. We developed a SAS macro for evaluating multiple diagnostic tests using individual-level data that creates a 2\u2009\u00d7\u20092 summary table, AUROC and AUPRC as part of output.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>The SAS macro presented here is automated to reduce analysis time and transcription errors. It is simple to use as the user only needs to specify the input dataset, \u201cstandard\u201d and \u201ctest\u201d variables and threshold values. It creates a publication-quality output in Microsoft Word and Excel showing more than 15 different accuracy measures together with overlaid AUROC and AUPRC graphics to help the researcher in making decisions to adopt or reject diagnostic tests. Further, it provides for additional variance estimation methods other than the normal distribution approximation.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We tested the macro for quality control purposes by reproducing results from published work on evaluation of multiple types of dried blood spots (DBS) as an alternative for human immunodeficiency virus (HIV) viral load (VL) monitoring in resource-limited settings compared to plasma, the gold-standard. Plasma viral load reagents are costly, and blood must be prepared in a reference laboratory setting by a qualified technician. On the other hand, DBS are easy to prepare without these restrictions. This study evaluated the suitability of DBS from venous, microcapillary and direct spotting DBS, hence multiple diagnostic tests which were compared to plasma specimen.\u00a0We also used the macro to reproduce results of published work on evaluating performance of multiple classification machine learning algorithms for predicting coronary artery disease.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>The SAS macro presented here is a powerful analytic tool for analyzing data from multiple diagnostic tests. The SAS programmer can modify the source code to include other diagnostic measures and variance estimation methods. By automating analysis, the macro adds value by saving analysis time, reducing transcription errors, and producing publication-quality outputs.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12911-024-02808-5","type":"journal-article","created":{"date-parts":[[2025,1,13]],"date-time":"2025-01-13T10:20:49Z","timestamp":1736763649000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["%diag_test: a generic SAS macro for evaluating diagnostic accuracy measures for multiple diagnostic tests"],"prefix":"10.1186","volume":"25","author":[{"given":"Jacques K.","family":"Muthusi","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter W.","family":"Young","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Frankline O.","family":"Mboya","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Samuel M.","family":"Mwalili","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,1,13]]},"reference":[{"key":"2808_CR1","volume-title":"Immunobiology: the immune system in health and disease","author":"CA Janeway Jr","year":"2001","unstructured":"Janeway CA Jr, Travers P, Walport M, Shlomchik MJ. Immunobiology: the immune system in health and disease. 5th ed. New York: Garland Publishing; 2001.","edition":"5"},{"key":"2808_CR2","first-page":"1","volume":"56","author":"PD Bigbee","year":"1987","unstructured":"Bigbee PD. Collecting and handling evidence infected with human disease-causing organisms. FBI L Enforc Bull. 1987;56:1.","journal-title":"FBI L Enforc Bull"},{"key":"2808_CR3","doi-asserted-by":"crossref","unstructured":"Whelton PK, Carey RM, Aronow WS, Casey DE, Collins KJ, Himmelfarb CD, et al. 2017 ACC\/AHA\/AAPA\/ABC\/ACPM\/AGS\/APhA\/ASH\/ASPC\/NMA\/PCNA Guideline for the Prevention, detection, evaluation, and management of high blood pressure in adults. J Am Coll Cardiol. 2018;71(19):e127\u2013248.","DOI":"10.1016\/j.jacc.2017.11.006"},{"issue":"6","key":"2808_CR4","doi-asserted-by":"publisher","first-page":"1326","DOI":"10.1097\/AOG.0b013e3181c2bde8","volume":"114","author":"M Abbassi-Ghanavati","year":"2009","unstructured":"Abbassi-Ghanavati M, Greer LG, Cunningham FG. Pregnancy and laboratory studies: a reference table for clinicians. Obstet Gynecol. 2009;114(6):1326\u201331.","journal-title":"Obstet Gynecol"},{"key":"2808_CR5","volume-title":"The Seventh Report of the Joint National Committee on Prevention, detection, evaluation, and treatment of high blood pressure","author":"National High Blood Pressure Education Program","year":"2003","unstructured":"National High Blood Pressure Education Program. The Seventh Report of the Joint National Committee on Prevention, detection, evaluation, and treatment of high blood pressure. Bethesda, MD: National Heart, Lung, and Blood Institute of National Health Insitute; 2003."},{"issue":"9","key":"2808_CR6","doi-asserted-by":"publisher","first-page":"739","DOI":"10.1093\/eurheartj\/ehy891","volume":"40","author":"EL Schiffrin","year":"2019","unstructured":"Schiffrin EL. New blood pressure cut-offs, prevalence of hypertension and control, and mood disorders: are patients benefitting from lower cut-offs for defining hypertension? Eur Heart J. 2019;40(9):739\u201342.","journal-title":"Eur Heart J"},{"key":"2808_CR7","volume-title":"Consolidated guidelines on HIV, viral hepatitis and STI prevention, diagnosis, treatment and care for key populations","author":"World Health Organization","year":"2022","unstructured":"World Health Organization. Consolidated guidelines on HIV, viral hepatitis and STI prevention, diagnosis, treatment and care for key populations. Geneva: World Health Organization; 2022. 29 July 2022."},{"key":"2808_CR8","unstructured":"Simundic A-M. Measures of diagnostic accuracy: Basic definitions. Med Biol Sci. 2008;22."},{"issue":"4","key":"2808_CR9","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1159\/000353863","volume":"36","author":"P Eusebi","year":"2013","unstructured":"Eusebi P. Diagnostic accuracy measures. Cerebrovasc Diesease. 2013;36(4):267\u201372.","journal-title":"Cerebrovasc Diesease"},{"issue":"12","key":"2808_CR10","doi-asserted-by":"publisher","first-page":"1257","DOI":"10.1038\/ki.2009.92","volume":"75","author":"VS Stralen KJv, Stel","year":"2009","unstructured":"Stralen KJv, Stel VS, Reitsma JB, Dekker FW, Zoccali C, Jager KJ. Diagnostic methods I: sensitivity, specificity, and other measures of accuracy. Kidney Int. 2009;75(12):1257\u201363.","journal-title":"Kidney Int"},{"key":"2808_CR11","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1177\/001316446002000104","volume":"20","author":"J Cohen","year":"1960","unstructured":"Cohen J. A coefficient of Agreement for Nominal scales. Educ Psychol Meas. 1960;20:37\u201346.","journal-title":"Educ Psychol Meas"},{"issue":"1","key":"2808_CR12","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1002\/1097-0142(1950)3:1<32::AID-CNCR2820030106>3.0.CO;2-3","volume":"3","author":"WJ Youden","year":"1950","unstructured":"Youden WJ. Index for rating diagnostic tests. Cancer. 1950;3(1):32\u20135.","journal-title":"Cancer"},{"key":"2808_CR13","doi-asserted-by":"crossref","unstructured":"Chinchor N, editor. Evaluation Metrics. MUC4 \u201892: Proceedings of the 4th Conference on Message Understanding; 1992 June 16\u201318, 1992; McLean, Virginia: Association for Computational Linguistics, USA.","DOI":"10.3115\/1072064.1072067"},{"issue":"3","key":"2808_CR14","first-page":"307","volume":"29","author":"JA Hanley","year":"1989","unstructured":"Hanley JA. Receiver operating characteristic (ROC) methodology: the state of the art. Crit Rev Diagn Imaging. 1989;29(3):307\u201335.","journal-title":"Crit Rev Diagn Imaging"},{"issue":"3","key":"2808_CR15","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1145\/65943.65945","volume":"7","author":"V Raghavan","year":"1989","unstructured":"Raghavan V, Bollmann P, Jung GS. A critical investigation of Recall and Precision as measures of Retrieval System performance. ACM Trans Inform Syst. 1989;7(3):205\u201329.","journal-title":"ACM Trans Inform Syst"},{"key":"2808_CR16","unstructured":"FDA. Guidance for Industry and FDA Staff. Statistical Guidance on reporting results from studies evaluating diagnostic tests. U.S. Department of Health and Human Services, Food and Drug Administration; 2007."},{"key":"2808_CR17","volume-title":"Base SAS\u00ae 9.3. Cary","author":"SAS Institute Inc","year":"2011","unstructured":"SAS Institute Inc. Base SAS\u00ae 9.3. Cary. NC: SAS Institute Inc; 2011."},{"key":"2808_CR18","unstructured":"Seed P. DIAGT: Stata module to report summary statistics for diagnostic tests compared to true disease status. Statistical Software Components. S423401, Boston College Department of Economics2001."},{"key":"2808_CR19","volume-title":"ROCTABI: Stata module for performing nonparametric ROC analysis using summarized data","author":"A Linden","year":"2016","unstructured":"Linden A. ROCTABI: Stata module for performing nonparametric ROC analysis using summarized data. Boston College Department of Economics: Statistical Software Components; 2016."},{"key":"2808_CR20","doi-asserted-by":"publisher","first-page":"e2019007","DOI":"10.4178\/epih.e2019007","volume":"41","author":"SR Shim","year":"2019","unstructured":"Shim SR, Kim S-J, Lee J. Diagnostic test accuracy: application and practice using R software. Epidemiol Health. 2019;41:e2019007\u2013e.","journal-title":"Epidemiol Health"},{"key":"2808_CR21","unstructured":"MedCalc Software Ltd. Diagnostic test evaluation calculator. 20.027 ed2022."},{"key":"2808_CR22","unstructured":"Schwartz A. Diagnostic test calculator. 2010042101 ed2006."},{"key":"2808_CR23","unstructured":"Chatzimichail T. Calculator for Diagnostic Accuracy Measures Wolfram Demonstrations Project. 2018."},{"issue":"2","key":"2808_CR24","first-page":"119","volume":"52","author":"A Agresti","year":"1998","unstructured":"Agresti A, Coull BA. Approximate is better than Exact for Interval Estimation of Binomial Proportions. Am Stat. 1998;52(2):119\u201326.","journal-title":"Am Stat"},{"key":"2808_CR25","doi-asserted-by":"crossref","unstructured":"Brown LD, Cai TT, DasGupta A. Interval estimation for a binomial proportion. Stat Sci. 2001;16(2):101\u201333. 33.","DOI":"10.1214\/ss\/1009213286"},{"issue":"6943","key":"2808_CR26","doi-asserted-by":"publisher","first-page":"1552","DOI":"10.1136\/bmj.308.6943.1552","volume":"308","author":"DG Altman","year":"1994","unstructured":"Altman DG, Bland JM. Diagnostic tests. 1: sensitivity and specificity. BMJ. 1994;308(6943):1552.","journal-title":"BMJ"},{"issue":"6947","key":"2808_CR27","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1136\/bmj.309.6947.102","volume":"309","author":"DG Altman","year":"1994","unstructured":"Altman DG, Bland JM. Diagnostic tests 2: predictive values. BMJ. 1994;309(6947):102.","journal-title":"BMJ"},{"key":"2808_CR28","volume-title":"Clinical epidemiology: the essentials","author":"RH Fletcher","year":"2005","unstructured":"Fletcher RH, Fletcher SW. Clinical epidemiology: the essentials. Fourth ed. Baltimore, Md: Lippincott Williams & Wilkins; 2005.","edition":"Fourth"},{"issue":"7458","key":"2808_CR29","doi-asserted-by":"publisher","first-page":"168","DOI":"10.1136\/bmj.329.7458.168","volume":"329","author":"JJ Deeks","year":"2004","unstructured":"Deeks JJ, Altman DG. Diagnostic tests 4: likelihood ratios. BMJ. 2004;329(7458):168\u20139.","journal-title":"BMJ"},{"issue":"3","key":"2808_CR30","doi-asserted-by":"publisher","first-page":"561","DOI":"10.1148\/114.3.561","volume":"114","author":"JR Thornbury","year":"1975","unstructured":"Thornbury JR, Fryback DG, Edwards W. Likelihood ratios as a measure of the diagnostic usefulness of excretory urogram information. Radiology. 1975;114(3):561\u20135.","journal-title":"Radiology"},{"issue":"2","key":"2808_CR31","doi-asserted-by":"publisher","first-page":"127","DOI":"10.4103\/0972-6748.62274","volume":"18","author":"A Banerjee","year":"2009","unstructured":"Banerjee A, Chitnis UB, Jadhav SL, Bhawalkar JS, Chaudhury S. Hypothesis testing, type I and type II errors. Ind Psychiatry J. 2009;18(2):127\u201331.","journal-title":"Ind Psychiatry J"},{"issue":"1","key":"2808_CR32","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","volume":"57","author":"Y Benjamini","year":"1995","unstructured":"Benjamini Y, Hochberg Y. Controlling the false Discovery rate: a practical and powerful Approach to multiple testing. J Royal Stat Soc Ser B (Methodological). 1995;57(1):289\u2013300.","journal-title":"J Royal Stat Soc Ser B (Methodological)"},{"issue":"4","key":"2808_CR33","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1111\/j.1467-9868.2010.00746.x","volume":"72","author":"Y Benjamini","year":"2010","unstructured":"Benjamini Y. Discovering the false discovery rate. J Royal Stat Soc Ser B (Methodological). 2010;72(4):405\u201316.","journal-title":"J Royal Stat Soc Ser B (Methodological)"},{"issue":"4","key":"2808_CR34","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1016\/S0001-2998(78)80014-2","volume":"8","author":"CE Metz","year":"1978","unstructured":"Metz CE. Basic principles of ROC analysis. Semin Nucl Med. 1978;8(4):283\u201398.","journal-title":"Semin Nucl Med"},{"key":"2808_CR35","unstructured":"Rothman KJ. Epidemiology: an introduction. OUP USA; 2012."},{"issue":"11","key":"2808_CR36","doi-asserted-by":"publisher","first-page":"1129","DOI":"10.1016\/S0895-4356(03)00177-X","volume":"56","author":"AS Glas","year":"2003","unstructured":"Glas AS, Lijmer JG, Prins MH, Bonsel GJ, Bossuyt PMM. The diagnostic odds ratio: a single indicator of test performance. J Clin Epidemiol. 2003;56(11):1129\u201335.","journal-title":"J Clin Epidemiol"},{"issue":"5","key":"2808_CR37","doi-asserted-by":"publisher","first-page":"654","DOI":"10.1161\/CIRCULATIONAHA.105.594929","volume":"115","author":"KH Zou","year":"2007","unstructured":"Zou KH, O\u2019Malley AJ, Mauri L. Receiver-operating characteristic analysis for evaluating diagnostic tests and predictive models. Circulation. 2007;115(5):654\u20137.","journal-title":"Circulation"},{"key":"2808_CR38","doi-asserted-by":"crossref","unstructured":"Davis J, Goadrich M, editors. The relationship between Precision-Recall and ROC curves. Proceedings of the 23rd international conference on Machine learning; 2006.","DOI":"10.1145\/1143844.1143874"},{"issue":"3","key":"2808_CR39","doi-asserted-by":"publisher","first-page":"178","DOI":"10.1080\/09296174.2013.799918","volume":"20","author":"S Wallis","year":"2013","unstructured":"Wallis S. Binomial confidence intervals and contingency tests: Mathematical fundamentals and the evaluation of alternative methods. J Quant Linguistics. 2013;20(3):178\u2013208.","journal-title":"J Quant Linguistics"},{"issue":"1","key":"2808_CR40","doi-asserted-by":"publisher","first-page":"817","DOI":"10.1214\/14-EJS909","volume":"8","author":"M Thulin","year":"2014","unstructured":"Thulin M. The cost of using exact confidence intervals for a binomial proportion. Electron J Stat. 2014;8(1):817\u201340.","journal-title":"Electron J Stat"},{"issue":"158","key":"2808_CR41","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1080\/01621459.1927.10502953","volume":"22","author":"EB Wilson","year":"1927","unstructured":"Wilson EB. Probable inference, the Law of Succession, and statistical inference. J Am Stat Assoc. 1927;22(158):209\u201312.","journal-title":"J Am Stat Assoc"},{"issue":"10","key":"2808_CR42","doi-asserted-by":"publisher","first-page":"2170","DOI":"10.1002\/sim.2677","volume":"26","author":"ND Mercaldo","year":"2007","unstructured":"Mercaldo ND, Lau KF, Zhou XH. Confidence intervals for predictive values with an emphasis to case-control studies. Stat Med. 2007;26(10):2170\u201383.","journal-title":"Stat Med"},{"issue":"2","key":"2808_CR43","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1016\/S0165-1781(96)02952-6","volume":"69","author":"DP McKenzie","year":"1997","unstructured":"McKenzie DP, Vida S, Mackinnon AJ, Onghena P, Clarke DM. Accurate confidence intervals for measures of test performance. Psychiatry Res. 1997;69(2):207\u20139.","journal-title":"Psychiatry Res"},{"issue":"8","key":"2808_CR44","doi-asserted-by":"publisher","first-page":"857","DOI":"10.1002\/(SICI)1097-0258(19980430)17:8<857::AID-SIM777>3.0.CO;2-E","volume":"17","author":"RG Newcombe","year":"1988","unstructured":"Newcombe RG. Two-sided confidence intervals for the single proportion: comparison of seven methods. Stat Med. 1988;17(8):857\u201372.","journal-title":"Stat Med"},{"issue":"3977","key":"2808_CR45","doi-asserted-by":"publisher","first-page":"1217","DOI":"10.1126\/science.171.3977.1217","volume":"171","author":"LB Lusted","year":"1971","unstructured":"Lusted LB. Signal detectability and medical Decision-Making: Signal detectability studies help radiologists evaluate equipment systems and performance of assistants. Science. 1971;171(3977):1217\u20139.","journal-title":"Science"},{"issue":"9","key":"2808_CR46","doi-asserted-by":"publisher","first-page":"1315","DOI":"10.1097\/JTO.0b013e3181ec173d","volume":"5","author":"JN Mandrekar","year":"2010","unstructured":"Mandrekar JN. Receiver operating characteristic curve in Diagnostic Test Assessment. J Thorac Oncol. 2010;5(9):1315\u20136.","journal-title":"J Thorac Oncol"},{"key":"2808_CR47","volume-title":"Foundations of Statistical Natural Language Processing","author":"C Manning","year":"1999","unstructured":"Manning C, Sch\u00fctze H. Foundations of Statistical Natural Language Processing. Cambridge, MA: MIT Press; 1999."},{"issue":"3","key":"2808_CR48","doi-asserted-by":"publisher","first-page":"e0118432","DOI":"10.1371\/journal.pone.0118432","volume":"10","author":"T Saito","year":"2015","unstructured":"Saito T, Rehmsmeier M. The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets. PLoS ONE. 2015;10(3):e0118432.","journal-title":"PLoS ONE"},{"key":"2808_CR49","doi-asserted-by":"publisher","DOI":"10.1002\/9781118646106","volume-title":"Imbalanced learning: foundations, algorithms, and applications","author":"H He","year":"2013","unstructured":"He H, Ma Y. Imbalanced learning: foundations, algorithms, and applications. Hoboken, New Jersey: John Wiley & Sons, Inc.; 2013."},{"issue":"4","key":"2808_CR50","doi-asserted-by":"publisher","first-page":"399","DOI":"10.1097\/QAI.0000000000001275","volume":"74","author":"MEM Schmitz","year":"2016","unstructured":"Schmitz MEM, Agolory SM, Junghae MP, Broyles LNM, Kimeu MM, Ombayo JB, et al. Field evaluation of dried blood spots for HIV-1 viral load monitoring in adults and children receiving antiretroviral treatment in Kenya: implications for scale-up in resource-limited settings. J Acquir Immune Defic Syndr. 2016;74(4):399\u2013406.","journal-title":"J Acquir Immune Defic Syndr"},{"key":"2808_CR51","unstructured":"Vojnov L, Carmona S, Zeh C, Markby J, Boeras D, Prescott M. The performance of using dried blood spot specimens for HIV-1 viral load testing: a systematic review and meta-analysis. PLoS Med. 2019."},{"key":"2808_CR52","doi-asserted-by":"publisher","first-page":"694","DOI":"10.4236\/ojs.2020.104043","volume":"10","author":"K Dahal","year":"2020","unstructured":"Dahal K, Gautam Y. Argumentative Comparative Analysis of Machine Learning on coronary artery disease. Open J Stat. 2020;10:694\u2013705.","journal-title":"Open J Stat"},{"key":"2808_CR53","unstructured":"Alizadehsani R, Roshanzamir M, Sani Z. Z-Alizadeh Sani. UCI Mach Learn Repository. 2017."},{"key":"2808_CR54","doi-asserted-by":"publisher","DOI":"10.1002\/9781118341544","volume-title":"Medical decision making","author":"HC Sox","year":"2013","unstructured":"Sox HC, Higgins MC, Owens DK. Medical decision making. Second ed. Oxford, UK: John Wiley & Sons, Ltd; 2013.","edition":"Second"},{"key":"2808_CR55","doi-asserted-by":"crossref","unstructured":"Muthusi J, Mwalili S, Young P, %svy_logistic_regression:. A generic SAS macro for simple and multiple logistic regression and creating quality publication-ready tables using survey or non-survey data. PLoS ONE. 2019;14(9):e0214262.","DOI":"10.1371\/journal.pone.0214262"},{"key":"2808_CR56","doi-asserted-by":"crossref","unstructured":"Muthusi J, Young PW, Mwalili S, %svy_freqs:. A generic SAS Macro for creating publication-quality three-way cross-tabulations. J Open Res Softw. 2021;9:30.","DOI":"10.5334\/jors.318"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-024-02808-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-024-02808-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-024-02808-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,13]],"date-time":"2025-01-13T11:00:39Z","timestamp":1736766039000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-024-02808-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,13]]},"references-count":56,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["2808"],"URL":"https:\/\/doi.org\/10.1186\/s12911-024-02808-5","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-3344191\/v1","asserted-by":"object"}]},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,13]]},"assertion":[{"value":"11 September 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 December 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 January 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The work presented here did not involve direct human subjects or materials, hence no ethical approval or consent to participate was required.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the funding agencies.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Disclaimer"}},{"value":"The authors declare no competing interests.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"21"}}