{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"institution":[{"name":"Research Square"}],"indexed":{"date-parts":[[2026,8,14]],"date-time":"2026-08-14T02:22:13Z","timestamp":1786674133539,"version":"build-2736575974"},"posted":{"date-parts":[[2025,6,12]]},"group-title":"In Review","reference-count":43,"publisher":"Springer Science and Business Media LLC","license":[{"start":{"date-parts":[[2025,6,12]],"date-time":"2025-06-12T00:00:00Z","timestamp":1749686400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"accepted":{"date-parts":[[2025,5,6]]},"abstract":"<title>Abstract<\/title>\n        <p>Detecting infectious disease outbreaks promptly is crucial for effective public health responses, minimizing transmission, and enabling critical interventions. This study introduces a method that integrates machine learning (ML)-based diagnostic predictions with traditional epidemiological surveillance to enhance biosurveillance systems. Using 4.5 million patient records from 2010 to 2022, ML models were trained to predict, within 24-hour intervals, the likelihood of patients being diagnosed with infectious or unspecified gastrointestinal, respiratory, or neurological diseases. High-confidence predictions were combined with final diagnoses and analyzed using spatiotemporal outbreak detection techniques. Among diseases with five or more outbreaks between 2014 and 2022, 33.3% (41 of 123 outbreaks) were detected earlier, with lead times ranging from 1 to 24 days and an average of 1.33 false positive outbreaks detected annually. This approach demonstrates the potential of integrating ML with conventional methods for faster outbreak detection, provided adequate disease-specific training data is available.<\/p>","DOI":"10.21203\/rs.3.rs-6606632\/v1","type":"posted-content","created":{"date-parts":[[2025,6,12]],"date-time":"2025-06-12T18:50:16Z","timestamp":1749754216000},"source":"Crossref","is-referenced-by-count":1,"title":["AI-Enabled Diagnostic Prediction within Electronic Health Records to Enhance Biosurveillance and Early Outbreak Detection"],"prefix":"10.21203","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0320-280X","authenticated-orcid":false,"given":"Andre","family":"Goncalves","sequence":"first","affiliation":[{"name":"Lawrence Livermore National Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jose","family":"Cadena","sequence":"additional","affiliation":[{"name":"Lawrence Livermore National Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yeping","family":"Hu","sequence":"additional","affiliation":[{"name":"Lawrence Livermore National Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Schlessinger","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Division of Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John","family":"Greene","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Division of Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liam","family":"O'suilleabhain","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Division of Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Heather","family":"Clancy","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Division of Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Vollmer","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Division of Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vincent","family":"Liu","sequence":"additional","affiliation":[{"name":"Kaiser Permanente\u00a0"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tom","family":"Bates","sequence":"additional","affiliation":[{"name":"Lawrence Livermore National Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Priyadip","family":"Ray","sequence":"additional","affiliation":[{"name":"Lawrence Livermore National Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","reference":[{"issue":"10","key":"ref1","doi-asserted-by":"crossref","first-page":"1633","DOI":"10.3201\/eid1410.071341","article-title":"Spinach-associated Escherichia coli O157:H7 outbreak, Utah and New Mexico, 2006","volume":"14","author":"Grant J","year":"2008","unstructured":"Grant J et al (2008) Spinach-associated Escherichia coli O157:H7 outbreak, Utah and New Mexico, 2006. Emerg Infect Dis 14(10):1633\u20131636","journal-title":"Emerg Infect Dis"},{"issue":"2","key":"ref2","doi-asserted-by":"crossref","first-page":"e16579","DOI":"10.1371\/journal.pone.0016579","article-title":"National outbreak of Salmonella serotype saintpaul infections: importance of Texas restaurant investigations in implicating jalapeno peppers","volume":"6","author":"Mody RK","year":"2011","unstructured":"Mody RK et al (2011) National outbreak of Salmonella serotype saintpaul infections: importance of Texas restaurant investigations in implicating jalapeno peppers. PLoS ONE 6(2):e16579","journal-title":"PLoS ONE"},{"key":"ref3","author":"Kman NE","year":"2012","unstructured":"Kman NE, Bachmann DJ (2012) Biosurveillance: a review and update. Adv Prev Med, 2012: p. 301408"},{"key":"ref4","author":"Rutherford GW","year":"2001","unstructured":"Rutherford GW (2001) Principles and Practices of Public Health Surveillance, Second Edition. American Journal of Epidemiology, 154(4): pp. 385\u2013386"},{"issue":"1suppl","key":"ref5","doi-asserted-by":"crossref","first-page":"72S","DOI":"10.1177\/00333549211018673","article-title":"Emergency Medical Services and Syndromic Surveillance: A Comparison With Traditional Surveillance and Effects on Timeliness","volume":"136","author":"Rock PJ","year":"2021","unstructured":"Rock PJ et al (2021) Emergency Medical Services and Syndromic Surveillance: A Comparison With Traditional Surveillance and Effects on Timeliness. Public Health Rep 136(1suppl):72S\u201379S","journal-title":"Public Health Rep"},{"key":"ref6","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1186\/1471-2458-5-105","article-title":"Evaluation of school absenteeism data for early outbreak detection, New York City","volume":"5","author":"Besculides M","year":"2005","unstructured":"Besculides M et al (2005) Evaluation of school absenteeism data for early outbreak detection, New York City. BMC Public Health 5:105","journal-title":"BMC Public Health"},{"issue":"11","key":"ref7","doi-asserted-by":"crossref","first-page":"e1003892","DOI":"10.1371\/journal.pcbi.1003892","article-title":"Global disease monitoring and forecasting with Wikipedia","volume":"10","author":"Generous N","year":"2014","unstructured":"Generous N et al (2014) Global disease monitoring and forecasting with Wikipedia. PLoS Comput Biol 10(11):e1003892","journal-title":"PLoS Comput Biol"},{"issue":"1","key":"ref8","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1016\/j.annemergmed.2011.08.004","article-title":"Using poison center data for national public health surveillance for chemical and poison exposure and associated illness","volume":"59","author":"Wolkin AF","year":"2012","unstructured":"Wolkin AF et al (2012) Using poison center data for national public health surveillance for chemical and poison exposure and associated illness. Ann Emerg Med 59(1):56\u201361","journal-title":"Ann Emerg Med"},{"issue":"3","key":"ref9","doi-asserted-by":"crossref","first-page":"416","DOI":"10.3201\/eid1203.050573","article-title":"Medication sales and syndromic surveillance, France","volume":"12","author":"Vergu E","year":"2006","unstructured":"Vergu E et al (2006) Medication sales and syndromic surveillance, France. Emerg Infect Dis 12(3):416\u2013421","journal-title":"Emerg Infect Dis"},{"issue":"7232","key":"ref10","doi-asserted-by":"crossref","first-page":"1012","DOI":"10.1038\/nature07634","article-title":"Detecting influenza epidemics using search engine query data","volume":"457","author":"Ginsberg J","year":"2009","unstructured":"Ginsberg J et al (2009) Detecting influenza epidemics using search engine query data. Nature 457(7232):1012\u20131014","journal-title":"Nature"},{"issue":"6176","key":"ref11","doi-asserted-by":"crossref","first-page":"1203","DOI":"10.1126\/science.1248506","article-title":"Big data. The parable of Google Flu: traps in big data analysis","volume":"343","author":"Lazer D","year":"2014","unstructured":"Lazer D et al (2014) Big data. The parable of Google Flu: traps in big data analysis. Science 343(6176):1203\u20131205","journal-title":"Science"},{"key":"ref12","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1146\/annurev-publhealth-031914-122747","article-title":"Uses of electronic health records for public health surveillance to advance public health","volume":"36","author":"Birkhead GS","year":"2015","unstructured":"Birkhead GS, Klompas M, Shah NR (2015) Uses of electronic health records for public health surveillance to advance public health. Annu Rev Public Health 36:345\u2013359","journal-title":"Annu Rev Public Health"},{"key":"ref13","first-page":"5","article-title":"What is syndromic surveillance?","volume":"53","author":"Henning KJ","year":"2004","unstructured":"Henning KJ (2004) What is syndromic surveillance? MMWR Suppl 53:5\u201311","journal-title":"MMWR Suppl"},{"issue":"2 Suppl","key":"ref14","doi-asserted-by":"crossref","first-page":"S29","DOI":"10.1097\/DMP.0b013e31819f4483","article-title":"Framework for the development of response protocols for public health syndromic surveillance systems: case studies of 8 US states","volume":"3","author":"Uscher-Pines L","year":"2009","unstructured":"Uscher-Pines L et al (2009) Framework for the development of response protocols for public health syndromic surveillance systems: case studies of 8 US states. Disaster Med Public Health Prep 3(2 Suppl):S29\u201336","journal-title":"Disaster Med Public Health Prep"},{"key":"ref15","author":". BioSense Platform","year":"2024","unstructured":"(NSSP), N.S.S.P (2024) 9\/6\/2024]. BioSense Platform. ; Available from: https:\/\/www.cdc.gov\/nssp\/php\/about\/about-nssp-and-the-biosense-platform.html"},{"issue":"6","key":"ref16","doi-asserted-by":"crossref","first-page":"e26303","DOI":"10.2196\/26303","article-title":"Electronic Surveillance System for the Early Notification of Community-Based Epidemics (ESSENCE): Overview, Components, and Public Health Applications","volume":"7","author":"Burkom H","year":"2021","unstructured":"Burkom H et al (2021) Electronic Surveillance System for the Early Notification of Community-Based Epidemics (ESSENCE): Overview, Components, and Public Health Applications. JMIR Public Health Surveill 7(6):e26303","journal-title":"JMIR Public Health Surveill"},{"issue":"5","key":"ref17","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1197\/jamia.M1345","article-title":"Technical description of RODS: a real-time public health surveillance system","volume":"10","author":"Tsui FC","year":"2003","unstructured":"Tsui FC et al (2003) Technical description of RODS: a real-time public health surveillance system. J Am Med Inf Assoc 10(5):399\u2013408","journal-title":"J Am Med Inf Assoc"},{"issue":"3","key":"ref18","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1093\/cid\/ciab946","article-title":"Whole-Genome Sequencing Surveillance and Machine Learning of the Electronic Health Record for Enhanced Healthcare Outbreak Detection","volume":"75","author":"Sundermann AJ","year":"2022","unstructured":"Sundermann AJ et al (2022) Whole-Genome Sequencing Surveillance and Machine Learning of the Electronic Health Record for Enhanced Healthcare Outbreak Detection. Clin Infect Dis 75(3):476\u2013482","journal-title":"Clin Infect Dis"},{"issue":"5","key":"ref19","doi-asserted-by":"crossref","first-page":"618","DOI":"10.1017\/ice.2019.84","article-title":"Automated data Mining of the electronic health record for investigation of healthcare-associated outbreaks - CORRIGENDUM","volume":"40","year":"2019","unstructured":"Automated data Mining of the electronic health record for investigation of healthcare-associated outbreaks - CORRIGENDUM. Infect Control Hosp Epidemiol, (2019) 40(5): p. 618","journal-title":"Infect Control Hosp Epidemiol"},{"issue":"7","key":"ref20","doi-asserted-by":"crossref","first-page":"e100845","DOI":"10.1371\/journal.pone.0100845","article-title":"Epidemic surveillance using an electronic medical record: an empiric approach to performance improvement","volume":"9","author":"Zheng H","year":"2014","unstructured":"Zheng H et al (2014) Epidemic surveillance using an electronic medical record: an empiric approach to performance improvement. PLoS ONE 9(7):e100845","journal-title":"PLoS ONE"},{"issue":"1","key":"ref21","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1186\/s12879-016-2175-x","article-title":"Influenza epidemic surveillance and prediction based on electronic health record data from an out-of-hours general practitioner cooperative: model development and validation on 2003\u20132015 data","volume":"17","author":"Michiels B","year":"2017","unstructured":"Michiels B et al (2017) Influenza epidemic surveillance and prediction based on electronic health record data from an out-of-hours general practitioner cooperative: model development and validation on 2003\u20132015 data. BMC Infect Dis 17(1):84","journal-title":"BMC Infect Dis"},{"key":"ref22","doi-asserted-by":"crossref","first-page":"105251","DOI":"10.1016\/j.jcv.2022.105251","article-title":"Early detection of COVID-19 outbreaks using textual analysis of electronic medical records","volume":"155","author":"Shapiro M","year":"2022","unstructured":"Shapiro M et al (2022) Early detection of COVID-19 outbreaks using textual analysis of electronic medical records. J Clin Virol 155:105251","journal-title":"J Clin Virol"},{"issue":"2","key":"ref23","first-page":"145","article-title":"A near real-time electronic health record-based COVID-19 surveillance system: An experience from a developing country","volume":"53","author":"Sheikhtaheri A","year":"2024","unstructured":"Sheikhtaheri A et al (2024) A near real-time electronic health record-based COVID-19 surveillance system: An experience from a developing country. Health Inf Manag 53(2):145\u2013154","journal-title":"Health Inf Manag"},{"issue":"7","key":"ref24","doi-asserted-by":"crossref","first-page":"e048211","DOI":"10.1136\/bmjopen-2020-048211","article-title":"Development of a healthcare system COVID Hotspotting Score in California: an observational study with prospective validation","volume":"11","author":"Liu VX","year":"2021","unstructured":"Liu VX et al (2021) Development of a healthcare system COVID Hotspotting Score in California: an observational study with prospective validation. BMJ open 11(7):e048211","journal-title":"BMJ open"},{"issue":"3","key":"ref25","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1089\/hs.2015.0063","article-title":"A Conceptual Architecture for National Biosurveillance: Moving Beyond Situational Awareness to Enable Digital Detection of Emerging Threats","volume":"14","author":"Velsko S","year":"2016","unstructured":"Velsko S, Bates T (2016) A Conceptual Architecture for National Biosurveillance: Moving Beyond Situational Awareness to Enable Digital Detection of Emerging Threats. Health Secur 14(3):189\u2013201","journal-title":"Health Secur"},{"issue":"5","key":"ref26","doi-asserted-by":"crossref","first-page":"781","DOI":"10.1513\/AnnalsATS.202104-451OC","article-title":"Evaluation of Incident 7-Day Infection and Sepsis Hospitalizations in an Integrated Health System","volume":"19","author":"Liu VX","year":"2022","unstructured":"Liu VX et al (2022) Evaluation of Incident 7-Day Infection and Sepsis Hospitalizations in an Integrated Health System. Ann Am Thorac Soc 19(5):781\u2013789","journal-title":"Ann Am Thorac Soc"},{"issue":"3","key":"ref27","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1097\/MLR.0b013e3181589bb6","article-title":"Risk-adjusting hospital inpatient mortality using automated inpatient, outpatient, and laboratory databases","volume":"46","author":"Escobar GJ","year":"2008","unstructured":"Escobar GJ et al (2008) Risk-adjusting hospital inpatient mortality using automated inpatient, outpatient, and laboratory databases. Med Care 46(3):232\u2013239","journal-title":"Med Care"},{"issue":"5","key":"ref28","doi-asserted-by":"crossref","first-page":"446","DOI":"10.1097\/MLR.0b013e3182881c8e","article-title":"Risk-adjusting hospital mortality using a comprehensive electronic record in an integrated health care delivery system","volume":"51","author":"Escobar GJ","year":"2013","unstructured":"Escobar GJ et al (2013) Risk-adjusting hospital mortality using a comprehensive electronic record in an integrated health care delivery system. Med Care 51(5):446\u2013453","journal-title":"Med Care"},{"issue":"12","key":"ref29","doi-asserted-by":"crossref","first-page":"e1916769","DOI":"10.1001\/jamanetworkopen.2019.16769","article-title":"Multiyear Rehospitalization Rates and Hospital Outcomes in an Integrated Health Care System","volume":"2","author":"Escobar GJ","year":"2019","unstructured":"Escobar GJ et al (2019) Multiyear Rehospitalization Rates and Hospital Outcomes in an Integrated Health Care System. JAMA Netw Open 2(12):e1916769","journal-title":"JAMA Netw Open"},{"issue":"20","key":"ref30","doi-asserted-by":"crossref","first-page":"1951","DOI":"10.1056\/NEJMsa2001090","article-title":"Automated Identification of Adults at Risk for In-Hospital Clinical Deterioration","volume":"383","author":"Escobar GJ","year":"2020","unstructured":"Escobar GJ et al (2020) Automated Identification of Adults at Risk for In-Hospital Clinical Deterioration. N Engl J Med 383(20):1951\u20131960","journal-title":"N Engl J Med"},{"key":"ref31","author":"Alsentzer E","year":"2019","unstructured":"Alsentzer E et al (2019) Publicly available clinical BERT embeddings. arXiv preprint arXiv:1904.03323"},{"issue":"9","key":"ref32","doi-asserted-by":"crossref","first-page":"1263","DOI":"10.1109\/TKDE.2008.239","article-title":"Learning from imbalanced data","volume":"21","author":"He H","year":"2009","unstructured":"He H, Garcia EA (2009) Learning from imbalanced data. IEEE Trans Knowl Data Eng 21(9):1263\u20131284","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"ref33","author":"Devlin J","year":"2018","unstructured":"Devlin J (2018) Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805"},{"issue":"4","key":"ref34","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1093\/bioinformatics\/btz682","article-title":"BioBERT: a pre-trained biomedical language representation model for biomedical text mining","volume":"36","author":"Lee J","year":"2020","unstructured":"Lee J et al (2020) BioBERT: a pre-trained biomedical language representation model for biomedical text mining. Bioinformatics 36(4):1234\u20131240","journal-title":"Bioinformatics"},{"key":"ref35","doi-asserted-by":"crossref","first-page":"160035","DOI":"10.1038\/sdata.2016.35","article-title":"MIMIC-III, a freely accessible critical care database","volume":"3","author":"Johnson AE","year":"2016","unstructured":"Johnson AE et al (2016) MIMIC-III, a freely accessible critical care database. Sci Data 3:160035","journal-title":"Sci Data"},{"key":"ref36","first-page":"67125","article-title":"Ehrshot: An ehr benchmark for few-shot evaluation of foundation models","volume":"36","author":"Wornow M","year":"2023","unstructured":"Wornow M et al (2023) Ehrshot: An ehr benchmark for few-shot evaluation of foundation models. Adv Neural Inf Process Syst 36:67125\u201367137","journal-title":"Adv Neural Inf Process Syst"},{"issue":"1","key":"ref37","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1038\/s41746-018-0029-1","article-title":"Scalable and accurate deep learning with electronic health records","volume":"1","author":"Rajkomar A","year":"2018","unstructured":"Rajkomar A et al (2018) Scalable and accurate deep learning with electronic health records. NPJ Digit Med 1(1):18","journal-title":"NPJ Digit Med"},{"issue":"1","key":"ref38","doi-asserted-by":"crossref","first-page":"19543","DOI":"10.1038\/s41598-021-98071-z","article-title":"Budget constrained machine learning for early prediction of adverse outcomes for COVID-19 patients","volume":"11","author":"Nguyen S","year":"2021","unstructured":"Nguyen S et al (2021) Budget constrained machine learning for early prediction of adverse outcomes for COVID-19 patients. Sci Rep 11(1):19543","journal-title":"Sci Rep"},{"issue":"8","key":"ref39","doi-asserted-by":"crossref","first-page":"4258","DOI":"10.1109\/JBHI.2022.3171673","article-title":"Dynamic Sepsis Prediction for Intensive Care Unit Patients Using XGBoost-Based Model With Novel Time-Dependent Features","volume":"26","author":"Liu SH","year":"2022","unstructured":"Liu SH et al (2022) Dynamic Sepsis Prediction for Intensive Care Unit Patients Using XGBoost-Based Model With Novel Time-Dependent Features. Ieee J Biomedical Health Inf 26(8):4258\u20134269","journal-title":"Ieee J Biomedical Health Inf"},{"issue":"6","key":"ref40","doi-asserted-by":"crossref","first-page":"1481","DOI":"10.1080\/03610929708831995","article-title":"A spatial scan statistic","volume":"26","author":"Kulldorff M","year":"1997","unstructured":"Kulldorff M (1997) A spatial scan statistic. Commun Statistics-Theory methods 26(6):1481\u20131496","journal-title":"Commun Statistics-Theory methods"},{"issue":"8","key":"ref41","doi-asserted-by":"crossref","first-page":"1824","DOI":"10.1002\/sim.2818","article-title":"Multivariate scan statistics for disease surveillance","volume":"26","author":"Kulldorff M","year":"2007","unstructured":"Kulldorff M et al (2007) Multivariate scan statistics for disease surveillance. Stat Med 26(8):1824\u20131833","journal-title":"Stat Med"},{"issue":"13","key":"ref42","doi-asserted-by":"crossref","first-page":"2185","DOI":"10.1002\/sim.5675","article-title":"Fast subset scan for multivariate event detection","volume":"32","author":"Neill DB","year":"2013","unstructured":"Neill DB, McFowland E, Iii, Zheng H (2013) Fast subset scan for multivariate event detection. Stat Med 32(13):2185\u20132208","journal-title":"Stat Med"},{"issue":"2","key":"ref43","doi-asserted-by":"crossref","first-page":"e12110","DOI":"10.2196\/12110","article-title":"Detection of spatiotemporal prescription opioid hot spots with network scan statistics: multistate analysis","volume":"5","author":"Basak A","year":"2019","unstructured":"Basak A et al (2019) Detection of spatiotemporal prescription opioid hot spots with network scan statistics: multistate analysis. JMIR public health surveillance 5(2):e12110","journal-title":"JMIR public health surveillance"}],"container-title":[],"original-title":[],"link":[{"URL":"https:\/\/www.researchsquare.com\/article\/rs-6606632\/v1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.researchsquare.com\/article\/rs-6606632\/v1.html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,12]],"date-time":"2025-06-12T18:50:22Z","timestamp":1749754222000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.researchsquare.com\/article\/rs-6606632\/v1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,12]]},"references-count":43,"URL":"https:\/\/doi.org\/10.21203\/rs.3.rs-6606632\/v1","relation":{},"subject":[],"published":{"date-parts":[[2025,6,12]]},"subtype":"preprint"}}