{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,18]],"date-time":"2026-09-18T13:12:40Z","timestamp":1789737160908,"version":"4.0.1"},"reference-count":28,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2024,2,23]],"date-time":"2024-02-23T00:00:00Z","timestamp":1708646400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,9,26]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Background<\/jats:title>\n                  <jats:p>Advancements in machine learning (ML) have improved the accuracy of models that predict human immunodeficiency virus (HIV) incidence. These models have used electronic medical records and registries. We aim to broaden the application of these tools by using deidentified public health datasets for notifiable sexually transmitted infections (STIs) from a southern US county known for high HIV incidence. The goal is to assess the feasibility and accuracy of ML in predicting HIV incidence, which could inform and enhance public health interventions.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>We analyzed 2 deidentified public health datasets from January 2010 to December 2021, focusing on notifiable STIs. Our process involved data processing and feature extraction, including sociodemographic factors, STI cases, and social vulnerability index (SVI) metrics. Various ML models were trained and evaluated for predicting HIV incidence using metrics such as accuracy, precision, recall, and F1 score.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>We included 85 224 individuals; 2027 (2.37%) were newly diagnosed with HIV during the study period. The ML models demonstrated high performance in predicting HIV incidence among males and females. Influential features for males included age at STI diagnosis, previous STI information, provider type, and SVI. For females, predictive features included age, ethnicity, previous STI information, overall SVI, and race.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>The high accuracy of our ML models in predicting HIV incidence highlights the potential of using public health datasets for public health interventions such as tailored HIV testing and prevention. While these findings are promising, further research is needed to translate these models into practical public health applications.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/cid\/ciae100","type":"journal-article","created":{"date-parts":[[2024,2,23]],"date-time":"2024-02-23T17:18:16Z","timestamp":1708708696000},"page":"717-726","source":"Crossref","is-referenced-by-count":9,"title":["Development of a Machine Learning Modeling Tool for Predicting HIV Incidence Using Public Health Data From a County in the Southern United States"],"prefix":"10.1093","volume":"79","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8372-9021","authenticated-orcid":false,"given":"Carlos S","family":"Saldana","sequence":"first","affiliation":[{"name":"Division of Infectious Diseases, Department of Medicine, Emory University School of Medicine , Atlanta, Georgia ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elizabeth","family":"Burkhardt","sequence":"additional","affiliation":[{"name":"Epidemiology Division, Georgia Department of Public Health , Atlanta, Georgia ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alfred","family":"Pennisi","sequence":"additional","affiliation":[{"name":"Epidemiology Division, Georgia Department of Public Health , Atlanta, Georgia ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kirsten","family":"Oliver","sequence":"additional","affiliation":[{"name":"Epidemiology Division, Georgia Department of Public Health , Atlanta, Georgia ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John","family":"Olmstead","sequence":"additional","affiliation":[{"name":"Epidemiology Division, Georgia Department of Public Health , Atlanta, Georgia ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David P","family":"Holland","sequence":"additional","affiliation":[{"name":"Division of Primary Care, Mercy Care Health Systems , Atlanta, Georgia ,","place":["USA"]},{"name":"Fulton County Board of Health , Communicable Disease Prevention Branch, Atlanta, Georgia ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jenna","family":"Gettings","sequence":"additional","affiliation":[{"name":"Epidemiology Division, Georgia Department of Public Health , Atlanta, Georgia ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Mauck","sequence":"additional","affiliation":[{"name":"Epidemiology Division, Georgia Department of Public Health , Atlanta, Georgia ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Austin","sequence":"additional","affiliation":[{"name":"Epidemiology Division, Georgia Department of Public Health , Atlanta, Georgia ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pascale","family":"Wortley","sequence":"additional","affiliation":[{"name":"Epidemiology Division, Georgia Department of Public Health , Atlanta, Georgia ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Karla V Saldana","family":"Ochoa","sequence":"additional","affiliation":[{"name":"School of Architecture, College of Design, Construction, and Planning, University of Florida , Gainesville, Florida ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2024,2,23]]},"reference":[{"key":"2024092615370907500_ciae100-B1","doi-asserted-by":"crossref","first-page":"844","DOI":"10.1001\/jama.2019.1343","article-title":"Ending the HIV epidemic: a plan for the United States","volume":"321","author":"Fauci","year":"2019","journal-title":"JAMA"},{"key":"2024092615370907500_ciae100-B2"},{"key":"2024092615370907500_ciae100-B3","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1521\/aeap.2022.34.3.183","article-title":"Association of race and other social determinants of health with HIV pre-exposure prophylaxis use: a county-level analysis using the PrEP-to-need ratio","volume":"34","author":"Doherty","year":"2022","journal-title":"AIDS Educ Prev"},{"key":"2024092615370907500_ciae100-B4","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1007\/s11606-022-07687-y","article-title":"Examining the correlation between PrEP use and black:white disparities in HIV incidence in the Ending the HIV Epidemic priority jurisdictions","volume":"38","author":"Bunting","year":"2023","journal-title":"J Gen Intern Med"},{"key":"2024092615370907500_ciae100-B5","author":"Centers for Disease Control and Prevention"},{"key":"2024092615370907500_ciae100-B6","doi-asserted-by":"crossref","first-page":"2326","DOI":"10.1093\/cid\/ciz1096","article-title":"Machine learning to identify persons at high-risk of human immunodeficiency virus acquisition in rural Kenya and Uganda","volume":"71","author":"Balzer","year":"2020","journal-title":"Clin Infect Dis"},{"key":"2024092615370907500_ciae100-B7","doi-asserted-by":"crossref","first-page":"e688","DOI":"10.1016\/S2352-3018(19)30137-7","article-title":"Use of electronic health record data and machine learning to identify candidates for HIV pre-exposure prophylaxis: a modeling study","volume":"6","author":"Marcus","year":"2019","journal-title":"Lancet HIV"},{"key":"2024092615370907500_ciae100-B8","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1002\/sim.7296","article-title":"Constrained binary classification using ensemble learning: an application to cost-efficient targeted PrEP strategies","volume":"37","author":"Zheng","year":"2018","journal-title":"Stat Med"},{"key":"2024092615370907500_ciae100-B9","doi-asserted-by":"crossref","first-page":"e0264429","DOI":"10.1371\/journal.pone.0264429","article-title":"Prediction of HIV status based on socio-behavioral characteristics in East and Southern Africa","volume":"17","author":"Orel","year":"2022","journal-title":"PLoS One"},{"key":"2024092615370907500_ciae100-B10","doi-asserted-by":"crossref","first-page":"e696","DOI":"10.1016\/S2352-3018(19)30139-0","article-title":"Development and validation of an automated HIV prediction algorithm to identify candidates for pre-exposure prophylaxis: a modeling study","volume":"6","author":"Krakower","year":"2019","journal-title":"Lancet HIV"},{"key":"2024092615370907500_ciae100-B11","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1097\/QAI.0000000000001580","article-title":"Using clinical notes and natural language processing for automated HIV risk assessment","volume":"77","author":"Feller","year":"2018","journal-title":"J Acquir Immune Defic Syndr"},{"key":"2024092615370907500_ciae100-B12","doi-asserted-by":"crossref","first-page":"1818","DOI":"10.3390\/jcm11071818","article-title":"A machine-learning-based risk-prediction tool for HIV and sexually transmitted infections acquisition over the next 12 months","volume":"11","author":"Xu","year":"2022","journal-title":"J Clin Med"},{"key":"2024092615370907500_ciae100-B13","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1093\/cid\/ciac775","article-title":"Development of a human immunodeficiency virus risk prediction model using electronic health record data from an academic health system in the southern United States","volume":"76","author":"Burns","year":"2023","journal-title":"Clin Infect Dis"},{"key":"2024092615370907500_ciae100-B14","author":"US Census Bureau"},{"key":"2024092615370907500_ciae100-B15","author":"Centers for Disease Control and Prevention\/Agency for Toxic Substances and Disease Registry\/Geospatial Research"},{"key":"2024092615370907500_ciae100-B16","author":"Seger"},{"key":"2024092615370907500_ciae100-B17","first-page":"490","author":"Wang"},{"key":"2024092615370907500_ciae100-B18","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.neucom.2013.11.045","article-title":"Parametric nonlinear dimensionality reduction using kernel t-SNE","volume":"147","author":"Gisbrecht","year":"2015","journal-title":"Neurocomputing"},{"key":"2024092615370907500_ciae100-B19","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1080\/02664769823205","article-title":"Probability models on horse-race outcomes","volume":"25","author":"Ali","year":"1998","journal-title":"J Appl Stat"},{"key":"2024092615370907500_ciae100-B20","doi-asserted-by":"crossref","first-page":"54","DOI":"10.3390\/info14010054","article-title":"A comparison of undersampling, oversampling, and SMOTE methods for dealing with imbalanced classification in educational data mining","volume":"14","author":"Wongvorachan","year":"2023","journal-title":"Information"},{"key":"2024092615370907500_ciae100-B21","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1353\/lan.1977.0043","article-title":"Classifiers","volume":"53","author":"Allan","year":"1977","journal-title":"Language"},{"key":"2024092615370907500_ciae100-B22","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1214\/aos\/1013203451","article-title":"Greedy function approximation: a gradient boosting machine","volume":"29","author":"Friedman","year":"2001","journal-title":"Ann Stat"},{"key":"2024092615370907500_ciae100-B23","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1186\/s12874-021-01346-2","article-title":"Use of machine learning techniques to identify HIV predictors for screening in sub-Saharan Africa","volume":"21","author":"Mutai","year":"2021","journal-title":"BMC Med Res Methodol"},{"key":"2024092615370907500_ciae100-B24","doi-asserted-by":"crossref","first-page":"967681","DOI":"10.3389\/fpubh.2022.967681","article-title":"Application of machine learning algorithms in predicting HIV infection among men who have sex with men: model development and validation","volume":"10","author":"He","year":"2022","journal-title":"Front Public Health"},{"key":"2024092615370907500_ciae100-B25","doi-asserted-by":"crossref","first-page":"e0000260","DOI":"10.1371\/journal.pdig.0000260","article-title":"Predicting HIV infection in the decade (2005\u20132015) pre-COVID-19 in Zimbabwe: a supervised classification-based machine learning approach","volume":"2","author":"Birri Makota","year":"2023","journal-title":"PLoS Digit Health"},{"key":"2024092615370907500_ciae100-B26","doi-asserted-by":"crossref","first-page":"e36388","DOI":"10.2196\/36388","article-title":"Evaluation and mitigation of racial bias in clinical machine learning models: scoping review","volume":"10","author":"Huang","year":"2022","journal-title":"JMIR Med Inform"},{"key":"2024092615370907500_ciae100-B27","doi-asserted-by":"crossref","first-page":"689","DOI":"10.1093\/aje\/kwab289","article-title":"Impact of racial categorization on effect estimates: an HIV stigma analysis","volume":"191","author":"Facente","year":"2022","journal-title":"Am J Epidemiol"},{"key":"2024092615370907500_ciae100-B28","author":"Ai Fairness 360"}],"container-title":["Clinical Infectious Diseases"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/cid\/advance-article-pdf\/doi\/10.1093\/cid\/ciae100\/57121680\/ciae100.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/cid\/article-pdf\/79\/3\/717\/59357071\/ciae100.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/cid\/article-pdf\/79\/3\/717\/59357071\/ciae100.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,26]],"date-time":"2024-09-26T16:03:20Z","timestamp":1727366600000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/cid\/article\/79\/3\/717\/7613230"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,23]]},"references-count":28,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2024,2,23]]},"published-print":{"date-parts":[[2024,9,26]]}},"URL":"https:\/\/doi.org\/10.1093\/cid\/ciae100","relation":{},"ISSN":["1058-4838","1537-6591"],"issn-type":[{"value":"1058-4838","type":"print"},{"value":"1537-6591","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,9,15]]},"published":{"date-parts":[[2024,2,23]]}}}