{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T13:58:29Z","timestamp":1772805509670,"version":"3.50.1"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2023,12,6]],"date-time":"2023-12-06T00:00:00Z","timestamp":1701820800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM J. Comput. Sustain. Soc."],"published-print":{"date-parts":[[2023,12,31]]},"abstract":"<jats:p>The COVID-19 pandemic has mainstreamed human mobility data into the public domain, with research focused on understanding the impact of mobility reduction policies as well as on regional COVID-19 case prediction models. Nevertheless, current research on COVID-19 case prediction tends to focus on performance improvements, masking relevant insights about when mobility data does not help, and more importantly, why, so that it can adequately inform local decision making. In this article, we carry out a systematic analysis to reveal the conditions under which human mobility data provides (or not) an enhancement over individual regional COVID-19 case prediction models that do not use mobility as a source of information. Our analysis\u2014focused on U.S. county-based COVID-19 case prediction models\u2014shows that (1) at most, 60% of counties improve their performance after adding mobility data; (2) the performance improvements are modest, with median correlation improvements of approximately 0.13; (3) improvements were lower for counties with higher Black, Hispanic, and other non-White populations as well as low-income and rural populations, pointing to potential bias in the mobility data negatively impacting predictive performance; and (4) different mobility datasets, predictive models, and training approaches bring about diverse performance improvements.<\/jats:p>","DOI":"10.1145\/3616380","type":"journal-article","created":{"date-parts":[[2023,8,26]],"date-time":"2023-08-26T10:34:58Z","timestamp":1693046098000},"page":"1-36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Analysis of Performance Improvements and Bias Associated with the Use of Human Mobility Data in COVID-19 Case Prediction Models"],"prefix":"10.1145","volume":"1","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3037-0016","authenticated-orcid":false,"given":"Saad Mohammad","family":"Abrar","sequence":"first","affiliation":[{"name":"University of Maryland, College Park, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6036-076X","authenticated-orcid":false,"given":"Naman","family":"Awasthi","sequence":"additional","affiliation":[{"name":"University of Maryland, College Park, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3860-2181","authenticated-orcid":false,"given":"Daniel","family":"Smolyak","sequence":"additional","affiliation":[{"name":"University of Maryland, College Park, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5114-7633","authenticated-orcid":false,"given":"Vanessa","family":"Frias-Martinez","sequence":"additional","affiliation":[{"name":"University of Maryland, College Park, USA"}]}],"member":"320","published-online":{"date-parts":[[2023,12,6]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tjem.2018.08.001"},{"key":"e_1_3_3_3_2","doi-asserted-by":"crossref","unstructured":"Hamada S. Badr Hongru Du Maximilian Marshall Ensheng Dong Marietta M. Squire and Lauren M. Gardner. 2020. Association between mobility patterns and COVID-19 transmission in the USA: A mathematical modelling study. Lancet Infectious Diseases 20 11 (2020) 1247\u20131254.","DOI":"10.1016\/S1473-3099(20)30553-3"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1038\/srep08923"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-020-2923-3"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-020-2923-3"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/3447548.3467182"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445881"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1177\/00139165211031199"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2021.115190"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-021-23440-1"},{"key":"e_1_3_3_12_2","volume-title":"Proceedings of the Workshop on Pervasive Urban Applications","author":"Frias-Martinez Vanessa","year":"2012","unstructured":"Vanessa Frias-Martinez, Victor Soto, Jesus Virseda, and Enrique Frias-Martinez. 2012. Computing cost-effective census maps from cell phone traces. In Proceedings of the Workshop on Pervasive Urban Applications."},{"issue":"2","key":"e_1_3_3_13_2","first-page":"35","article-title":"Cell phone analytics: Scaling human behavior studies into the millions","volume":"9","author":"Frias-Martinez Vanessa","year":"2013","unstructured":"Vanessa Frias-Martinez and Jesus Virseda. 2013. Cell phone analytics: Scaling human behavior studies into the millions. Information Technologies & International Development 9, 2 (2013), 35\u201350.","journal-title":"Information Technologies & International Development"},{"key":"e_1_3_3_14_2","first-page":"1","volume-title":"Proceedings of the Qual Meets Quant Workshop (QMQ\u201910)","author":"Frias-Martinez Vanessa","year":"2010","unstructured":"Vanessa Frias-Martinez, Jesus Virseda, and Enrique Frias-Martinez. 2010. Socio-economic levels and human mobility. In Proceedings of the Qual Meets Quant Workshop (QMQ\u201910). 1\u20136."},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/2371574.2371642"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-022-07757-5"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compenvurbsys.2018.07.003"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-94696-2"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/s1473-3099(20)30725-8"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/MDM.2016.17"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0253865"},{"issue":"7969","key":"e_1_3_3_22_2","article-title":"Estimating Poverty Using Cell Phone Data: Evidence from Guatemala","author":"Hernandez Marco","year":"2017","unstructured":"Marco Hernandez, Lingzi Hong, Vanessa Frias-Martinez, Andrew Whitby, and Enrique Frias-Martinez. 2017. Estimating Poverty Using Cell Phone Data: Evidence from Guatemala. World Bank Policy Research Working Paper7969. World Bank, Washington, DC.","journal-title":"World Bank Policy Research Working Paper"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v30i1.9892"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1140\/epjds\/s13688-020-00247-6"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/3091478.3091502"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2020524118"},{"key":"e_1_3_3_27_2","volume-title":"Forecasting: Principles and Practice","author":"Hyndman Rob J.","year":"2018","unstructured":"Rob J. Hyndman and George Athanasopoulos. 2018. Forecasting: Principles and Practice. OTexts."},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-92892-8"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3209811.3209861"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1101\/2020.03.14.20036178v2"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-020-00734-5"},{"key":"e_1_3_3_32_2","article-title":"Examining COVID-19 forecasting using spatio-temporal graph neural networks","author":"Kapoor Amol","year":"2020","unstructured":"Amol Kapoor, Xue Ben, Luyang Liu, Bryan Perozzi, Matt Barnes, Martin Blais, and Shawn O\u2019Banion. 2020. Examining COVID-19 forecasting using spatio-temporal graph neural networks. arXiv preprint arXiv:2007.03113 (2020).","journal-title":"arXiv preprint arXiv:2007.03113"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1016\/S2589-7500(21)00214-4"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.scitotenv.2020.144151"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3531006"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-01119-3"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.physrep.2021.02.001"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1177\/00333549211041550"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1007\/0-387-25465-X_51"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1101\/2020.04.13.20064220v1"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.idm.2020.03.001"},{"key":"e_1_3_3_42_2","volume-title":"Proceedings of the 2010 AAAI Spring Symposium Series","author":"Rubio Alberto","year":"2010","unstructured":"Alberto Rubio, Vanessa Frias-Martinez, Enrique Frias-Martinez, and Nuria Oliver. 2010. Human mobility in advanced and developing economies: A comparative analysis. In Proceedings of the 2010 AAAI Spring Symposium Series."},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-019-0048-x"},{"key":"e_1_3_3_44_2","article-title":"Biases in human mobility data impact epidemic modeling","author":"Schlosser Frank","year":"2021","unstructured":"Frank Schlosser, Vedran Sekara, Dirk Brockmann, and Manuel Garcia-Herranz. 2021. Biases in human mobility data impact epidemic modeling. arXiv preprint arXiv:2112.12521 (2021).","journal-title":"arXiv preprint arXiv:2112.12521"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2021.751940"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.3390\/ijerph182312567"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/MDM.2010.24"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1101\/2020.12.13.20248129v1"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1223467"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1140\/epjds\/s13688-022-00366-2"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compenvurbsys.2023.101967"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1177\/2399808320985843"},{"key":"e_1_3_3_53_2","article-title":"Predicting onset of COVID-19 with mobility-augmented SEIR model","author":"Wu Neo","year":"2020","unstructured":"Neo Wu, Xue Ben, Bradley Green, Kathryn Rough, Srinivasan Venkatramanan, Madhav Marathe, Paul Eastham, Adam Sadilek, and Shawn O\u2019Banion. 2020. Predicting onset of COVID-19 with mobility-augmented SEIR model. medRxiv. Retrieved September 1, 2023 from 10.1101.2020.07.27.20159996v2","journal-title":"medRxiv."},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jiph.2021.01.019"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-020-05285-9"}],"container-title":["ACM Journal on Computing and Sustainable Societies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3616380","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3616380","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:29:50Z","timestamp":1750285790000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3616380"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,6]]},"references-count":54,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,12,31]]}},"alternative-id":["10.1145\/3616380"],"URL":"https:\/\/doi.org\/10.1145\/3616380","relation":{},"ISSN":["2834-5533"],"issn-type":[{"value":"2834-5533","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,6]]},"assertion":[{"value":"2023-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-07-18","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-12-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}