{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T18:16:15Z","timestamp":1790014575785,"version":"4.0.1"},"reference-count":53,"publisher":"Public Library of Science (PLoS)","issue":"9","license":[{"start":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T00:00:00Z","timestamp":1789948800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS One"],"abstract":"<jats:p>Community\u2011ordered laboratory blood tests are frequently re-ordered when the patients arrive at the pediatric emergency departments. When only a few hours separate the initial community blood tests from assessment in the emergency department, repeated laboratory testing often does not contribute to clinical management. Additional testing can inconvenience patients, increase out-of-pocket costs for patients and families, add costs to the healthcare system, and delay clinical decision-making. To address this issue, we collected community-issued laboratory tests for complete blood count, electrolytes, and C-reactive protein for children aged three months to 18 years treated in pediatric emergency departments within a nationwide Health Maintenance Organization. These were compared to repeated laboratory tests performed in the pediatric emergency department within 12 hours. Using these data, we first analyzed the frequency of the justified repeated testing according to pre-set criteria. Next, we developed a decision-support machine learning model to predict whether a laboratory test should be repeated, leveraging the patient\u2019s prior community laboratory results and sociodemographic features. For complete blood count, electrolytes, and C-reactive protein, we found that only 13.3%, 16.3%, and 19.0% of the repeated tests, respectively, were deemed justified. Moreover, we show that an out-of-the-box XGboost model can predict the necessity for repeating these laboratory tests with 91.8%, 89.1%, and 79.2% accuracy, respectively. In the absence of false negatives, a condition of high clinical importance, the model maintains accuracies of 73.9%, 67.3%, and 55.4% for the three laboratory categories, respectively. This performance level remains sufficient to substantially reduce unnecessary repeat testing for complete blood count and electrolyte tests, but less so for C-reactive protein. The benefits of the model in clinical practice should be further studied.<\/jats:p>","DOI":"10.1371\/journal.pone.0352682","type":"journal-article","created":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T17:51:21Z","timestamp":1790013081000},"page":"e0352682","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":0,"title":["Shall we repeat? Predicting the necessity to repeat blood testing in pediatric emergency departments of laboratory tests previously performed in the community using a machine learning model"],"prefix":"10.1371","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5750-1215","authenticated-orcid":true,"given":"Adi","family":"Shuchami","sequence":"first","affiliation":[{"name":"Ariel University","place":["Ariel, Israel"],"department":["Department of Mathematics"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Teddy","family":"Lazebnik","sequence":"additional","affiliation":[{"name":"University of Haifa","place":["Haifa, Israel"],"department":["Department of Information Systems"]},{"name":"J\u00f6nk\u00f6ping University","place":["J\u00f6nk\u00f6ping, Sweden"],"department":["Department of Computing"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shai","family":"Ashkenazi","sequence":"additional","affiliation":[{"name":"Adelson School of Medicine, Ariel University","place":["Ariel, Israel"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Avner Herman","family":"Cohen","sequence":"additional","affiliation":[{"name":"Tel Aviv University","place":["Tel Aviv, Israel"],"department":["Faculty of Medical and Health Sciences"]},{"name":"Dan Petach-Tikva District","place":["Petah Tikva, Central District, Israel"],"department":["Clalit Health Services"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yael","family":"Reichenberg","sequence":"additional","affiliation":[{"name":"Dan Petach-Tikva District","place":["Petah Tikva, Central District, Israel"],"department":["Clalit Health Services"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vered","family":"Shkalim Zemer","sequence":"additional","affiliation":[{"name":"Tel Aviv University","place":["Tel Aviv, Israel"],"department":["Faculty of Medical and Health Sciences"]},{"name":"Dan Petach-Tikva District","place":["Petah Tikva, Central District, Israel"],"department":["Clalit Health Services"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2026,9,21]]},"reference":[{"key":"pone.0352682.ref001","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/j.cca.2013.09.024","article-title":"Calculating cost savings in utilization management","volume":"427","author":"D MacMillan","year":"2014","journal-title":"Clin Chim Acta"},{"issue":"12","key":"pone.0352682.ref002","doi-asserted-by":"crossref","first-page":"1997","DOI":"10.1373\/clinchem.2003.021220","article-title":"Population-based study of repeat laboratory testing","volume":"49","author":"C van Walraven","year":"2003","journal-title":"Clin Chem"},{"issue":"6","key":"pone.0352682.ref003","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1001\/jama.280.6.550","article-title":"Do we know what inappropriate laboratory utilization is? A systematic review of laboratory clinical audits","volume":"280","author":"C van Walraven","year":"1998","journal-title":"JAMA"},{"issue":"2","key":"pone.0352682.ref004","article-title":"Update on pediatric overuse","volume":"139","author":"ER Coon","year":"2017","journal-title":"Pediatrics"},{"issue":"3","key":"pone.0352682.ref005","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1097\/PEC.0000000000001599","article-title":"Repeat Laboratory Testing in the Pediatric Emergency Department: How Often and How Important?","volume":"35","author":"ES Fieldston","year":"2019","journal-title":"Pediatr Emerg Care"},{"issue":"12","key":"pone.0352682.ref006","doi-asserted-by":"crossref","first-page":"844","DOI":"10.12788\/jhm.2978","article-title":"Impact of Clinical Specialty on Attitudes Regarding Overuse of Inpatient Laboratory Testing","volume":"13","author":"D Korenstein","year":"2018","journal-title":"J Hosp Med"},{"key":"pone.0352682.ref007","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1016\/j.clinbiochem.2015.09.010","article-title":"Canadian family physician knowledge and attitudes toward laboratory utilization management","volume":"49","author":"A Thommasen","year":"2016","journal-title":"Clin Biochem"},{"key":"pone.0352682.ref008","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.clinbiochem.2018.01.024","article-title":"Are laboratory tests always needed? Frequency and causes of laboratory overuse in a hospital setting","volume":"54","author":"J Cadamuro","year":"2018","journal-title":"Clin Biochem"},{"issue":"4","key":"pone.0352682.ref009","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1016\/S0002-9343(98)00063-1","article-title":"What proportion of common diagnostic tests appear redundant?","volume":"104","author":"DW Bates","year":"1998","journal-title":"Am J Med"},{"issue":"11","key":"pone.0352682.ref010","doi-asserted-by":"crossref","first-page":"3795","DOI":"10.1128\/JCM.00684-08","article-title":"Nonutility of repeat laboratory testing for detection of Clostridium difficile by use of PCR or enzyme immunoassay","volume":"46","author":"E Aichinger","year":"2008","journal-title":"J Clin Microbiol"},{"issue":"4","key":"pone.0352682.ref011","doi-asserted-by":"crossref","first-page":"784","DOI":"10.1373\/clinchem.2005.064139","article-title":"Potentially inappropriate repeat laboratory testing in inpatients","volume":"52","author":"RC Hawkins","year":"2006","journal-title":"Clin Chem"},{"issue":"5","key":"pone.0352682.ref012","doi-asserted-by":"crossref","first-page":"348","DOI":"10.1002\/jhm.2552","article-title":"Multifaceted intervention including education, rounding checklist implementation, cost feedback, and financial incentives reduces inpatient laboratory costs","volume":"11","author":"PM Yarbrough","year":"2016","journal-title":"J Hosp Med"},{"key":"pone.0352682.ref013","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1186\/s13012-015-0356-4","article-title":"The effectiveness of interventions to improve laboratory requesting patterns among primary care physicians: a systematic review","volume":"10","author":"SL Cadogan","year":"2015","journal-title":"Implement Sci"},{"issue":"7","key":"pone.0352682.ref014","doi-asserted-by":"crossref","first-page":"939","DOI":"10.1001\/jamainternmed.2017.1144","article-title":"Effect of a Price Transparency Intervention in the Electronic Health Record on Clinician Ordering of Inpatient Laboratory Tests: The PRICE Randomized Clinical Trial","volume":"177","author":"MS Sedrak","year":"2017","journal-title":"JAMA Intern Med"},{"issue":"2","key":"pone.0352682.ref015","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/j.amjmed.2015.09.009","article-title":"Optimize Your Electronic Medical Record to Increase Value: Reducing Laboratory Overutilization","volume":"129","author":"E Iturrate","year":"2016","journal-title":"Am J Med"},{"issue":"2","key":"pone.0352682.ref016","doi-asserted-by":"crossref","DOI":"10.1542\/peds.2016-1507","article-title":"The Effect of Price Information on the Ordering of Images and Procedures","volume":"139","author":"AT Chien","year":"2017","journal-title":"Pediatrics"},{"issue":"1","key":"pone.0352682.ref017","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1542\/hpeds.2015-0099","article-title":"Toward High-Value Care: A Quality Improvement Initiative to Reduce Unnecessary Repeat Complete Blood Counts and Basic Metabolic Panels on a Pediatric Hospitalist Service","volume":"6","author":"DP Johnson","year":"2016","journal-title":"Hosp Pediatr"},{"issue":"8","key":"pone.0352682.ref018","doi-asserted-by":"crossref","first-page":"1326","DOI":"10.1111\/jep.13867","article-title":"Diagnostic testing in children: A qualitative study of pediatricians\u2019 considerations","volume":"29","author":"FG Ropers","year":"2023","journal-title":"J Eval Clin Pract"},{"issue":"5","key":"pone.0352682.ref019","doi-asserted-by":"crossref","first-page":"571","DOI":"10.1093\/labmed\/lmae003","article-title":"Laboratory stewardship perceptions and testing patterns at a pediatric tertiary care center","volume":"55","author":"TS Desai","year":"2024","journal-title":"Lab Med"},{"issue":"1","key":"pone.0352682.ref020","doi-asserted-by":"crossref","first-page":"282","DOI":"10.1186\/s12874-022-01758-8","article-title":"Machine learning in medicine: a practical introduction to techniques for data pre-processing, hyperparameter tuning, and model comparison","volume":"22","author":"A Pfob","year":"2022","journal-title":"BMC Med Res Methodol"},{"issue":"14","key":"pone.0352682.ref021","doi-asserted-by":"crossref","first-page":"1347","DOI":"10.1056\/NEJMra1814259","article-title":"Machine Learning in Medicine","volume":"380","author":"A Rajkomar","year":"2019","journal-title":"N Engl J Med"},{"key":"pone.0352682.ref022","doi-asserted-by":"crossref","first-page":"102631","DOI":"10.1016\/j.canep.2024.102631","article-title":"Machine learning computational model to predict lung cancer using electronic medical records","volume":"92","author":"M Levi","year":"2024","journal-title":"Cancer Epidemiol"},{"issue":"1","key":"pone.0352682.ref023","doi-asserted-by":"crossref","first-page":"31","DOI":"10.17849\/insm-47-01-31-39.1","article-title":"Random Forest","volume":"47","author":"SJ Rigatti","year":"2017","journal-title":"J Insurance Med"},{"key":"pone.0352682.ref024","doi-asserted-by":"crossref","unstructured":"Chen I, Guestrin C. Xgboost: A scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2016. 785\u201394.","DOI":"10.1145\/2939672.2939785"},{"issue":"2","key":"pone.0352682.ref025","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0210976","article-title":"Machine learning models for predicting post-cystectomy recurrence and survival in bladder cancer patients","volume":"14","author":"Z Hasnain","year":"2019","journal-title":"PLoS One"},{"key":"pone.0352682.ref026","doi-asserted-by":"crossref","first-page":"100370","DOI":"10.1016\/j.cosrev.2021.100370","article-title":"Role of machine learning in medical research: A survey","volume":"40","author":"A Garg","year":"2021","journal-title":"Computer Science Review"},{"issue":"7","key":"pone.0352682.ref027","article-title":"Blood Diseases Detection using Classical Machine Learning Algorithms","volume":"10","author":"FK Alsheref","year":"2019","journal-title":"Int J Adv Comp Sci App"},{"issue":"1","key":"pone.0352682.ref028","doi-asserted-by":"crossref","first-page":"10738","DOI":"10.1038\/s41598-021-90265-9","article-title":"COVID-19 diagnosis by routine blood tests using machine learning","volume":"11","author":"M Kukar","year":"2021","journal-title":"Sci Rep"},{"issue":"1","key":"pone.0352682.ref029","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1038\/s41598-017-18564-8","article-title":"An application of machine learning to haematological diagnosis","volume":"8","author":"G Gun\u010dar","year":"2018","journal-title":"Scientific Reports"},{"key":"pone.0352682.ref030","volume-title":"Introduction to machine learning","author":"E Alpaydin","year":"2020"},{"key":"pone.0352682.ref031","unstructured":"Davis J, Lantz E, Page D, Struyf J, Peissig P, Vidaillet H, et al. Machine learning for personalized medicine: Will this drug give me a heart attack? In: Proceedings of International Conference on Machine Learning, 2008."},{"issue":"1","key":"pone.0352682.ref032","doi-asserted-by":"crossref","first-page":"9140","DOI":"10.1038\/s41598-021-88712-8","article-title":"Machine learning based models for prediction of subtype diagnosis of primary aldosteronism using blood test","volume":"11","author":"H Kaneko","year":"2021","journal-title":"Sci Rep"},{"issue":"11","key":"pone.0352682.ref033","doi-asserted-by":"crossref","first-page":"1396","DOI":"10.1093\/clinchem\/hvaa200","article-title":"Routine laboratory blood tests predict SARS-CoV-2 infection using machine learning","volume":"66","author":"HS Yang","year":"2020","journal-title":"Clinical Chemistry"},{"issue":"11","key":"pone.0352682.ref034","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0206862","article-title":"Optimal intensive care outcome prediction over time using machine learning","volume":"13","author":"C Meiring","year":"2018","journal-title":"PLoS One"},{"key":"pone.0352682.ref035","doi-asserted-by":"crossref","DOI":"10.1016\/j.wneu.2022.04.044","article-title":"XGBoost Machine Learning Algorism Performed Better Than Regression Models in Predicting Mortality of Moderate-to-Severe Traumatic Brain Injury","volume":"163","author":"R Wang","year":"2022","journal-title":"World Neurosurg"},{"issue":"2","key":"pone.0352682.ref036","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1080\/10408363.2020.1828811","article-title":"Recent evolutions of machine learning applications in clinical laboratory medicine","volume":"58","author":"S De Bruyne","year":"2021","journal-title":"Crit Rev Clin Lab Sci"},{"key":"pone.0352682.ref037","unstructured":"Central Bureau of Statistics. Central Bureau of Statistics. https:\/\/www.cbs.gov.il\/he\/pages\/default.aspx Accessed 2026 February."},{"key":"pone.0352682.ref038","volume-title":"Nelson Textbook of Pediatrics","author":"RM Kliegman","year":"2024","edition":"22"},{"issue":"2","key":"pone.0352682.ref039","doi-asserted-by":"crossref","first-page":"143","DOI":"10.11613\/BM.2013.018","article-title":"The chi-square test of independence","volume":"23","author":"ML McHugh","year":"2013","journal-title":"Biochemia medica"},{"key":"pone.0352682.ref040","first-page":"151","article-title":"TPOT: A Tree-Based Pipeline Optimization Tool for Automating Machine Learning","volume-title":"The Springer Series on Challenges in Machine Learning","author":"RS Olson","year":"2019"},{"issue":"2","key":"pone.0352682.ref041","first-page":"23","article-title":"K-Fold Cross Validation for Selection of Cardiovascular Disease Diagnosis Features by Applying Rule-Based Datamining","volume":"1","author":"D Normawati","year":"2019","journal-title":"SigImgProcLett"},{"key":"pone.0352682.ref042","doi-asserted-by":"crossref","first-page":"102173","DOI":"10.1016\/j.datak.2023.102173","article-title":"Decision tree post-pruning without loss of accuracy using the SAT-PP algorithm with an empirical evaluation on clinical data","volume":"145","author":"T Lazebnik","year":"2023","journal-title":"Data & Knowledge Engineering"},{"issue":"18","key":"pone.0352682.ref043","doi-asserted-by":"crossref","first-page":"1777","DOI":"10.1001\/jama.2019.17304","article-title":"Evaluating Machine Learning Articles","volume":"322","author":"F Doshi-Velez","year":"2019","journal-title":"JAMA"},{"issue":"4","key":"pone.0352682.ref044","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1007\/s10732-007-9066-7","article-title":"A grasp-knapsack hybrid for a nurse-scheduling problem","volume":"15","author":"MD Goodman","year":"2007","journal-title":"J Heuristics"},{"issue":"10","key":"pone.0352682.ref045","doi-asserted-by":"crossref","first-page":"1340","DOI":"10.1093\/bioinformatics\/btq134","article-title":"Permutation importance: a corrected feature importance measure","volume":"26","author":"A Altmann","year":"2010","journal-title":"Bioinformatics"},{"issue":"15","key":"pone.0352682.ref046","doi-asserted-by":"crossref","first-page":"1885","DOI":"10.3390\/diagnostics15151885","article-title":"A Machine Learning-Based Guide for Repeated Laboratory Testing in Pediatric Emergency Departments","volume":"15","author":"A Shuchami","year":"2025","journal-title":"Diagnostics (Basel)"},{"issue":"1","key":"pone.0352682.ref047","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1515\/dx-2024-0139","article-title":"Unnecessary repetitions of C-reactive protein and leukocyte count at the emergency department observation unit contribute to higher hospital admission rates","volume":"12","author":"I Gornik","year":"2024","journal-title":"Diagnosis (Berl)"},{"key":"pone.0352682.ref048","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1542\/peds.103.S1.877","article-title":"The effect of price information on test-ordering behavior and patient outcomes in a pediatric emergency department","volume":"103","author":"LC Hampers","year":"1999","journal-title":"Pediatrics"},{"key":"pone.0352682.ref049","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.clinbiochem.2019.12.011","article-title":"Inappropriate repeat testing of complete blood count (CBC) and electrolyte panels in inpatients from Alberta, Canada","volume":"77","author":"V Kandalam","year":"2020","journal-title":"Clin Biochem"},{"key":"pone.0352682.ref050","doi-asserted-by":"crossref","first-page":"105144","DOI":"10.1016\/j.dib.2020.105144","article-title":"Dataset of test volume and tests repeated for complete blood count and electrolyte panels from hospitals in a Canadian province in 2018","volume":"29","author":"I Ma","year":"2020","journal-title":"Data Brief"},{"issue":"3","key":"pone.0352682.ref051","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1097\/QMH.0000000000000258","article-title":"Choosing daily labs wisely in the hospital: a novel tool for assessing laboratory testing appropriateness","volume":"29","author":"CJ Murphy","year":"2020","journal-title":"Qual Manag Health Care"},{"issue":"1","key":"pone.0352682.ref052","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1097\/JHQ.0000000000000175","article-title":"Alerting Wisely: Reducing Inappropriate Blood Chemistry Panel Orders Using a Clinical Decision Support Tool","volume":"42","author":"JW Anderson","year":"2020","journal-title":"J Healthc Qual"},{"issue":"3","key":"pone.0352682.ref053","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1097\/00003246-199603000-00022","article-title":"Effects of availability of patient-related charges on practice patterns and cost containment in the pediatric intensive care unit","volume":"24","author":"RC Sachdeva","year":"1996","journal-title":"Crit Care Med"}],"container-title":["PLOS One"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0352682","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T17:51:29Z","timestamp":1790013089000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0352682"}},"subtitle":[],"editor":[{"given":"Syeda Humaida","family":"Hasan","sequence":"first","affiliation":[{"name":"Chittagong Medical College","place":["BANGLADESH"]}],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2026,9,21]]},"references-count":53,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2026,9,21]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0352682","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,21]]}}}