{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,29]],"date-time":"2026-06-29T19:23:14Z","timestamp":1782760994866,"version":"3.54.5"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2018,11,6]],"date-time":"2018-11-06T00:00:00Z","timestamp":1541462400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2018,11,6]],"date-time":"2018-11-06T00:00:00Z","timestamp":1541462400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000030","name":"U.S. Department of Health & Human Services | Centers for Disease Control and Prevention","doi-asserted-by":"publisher","award":["5U01EH001301"],"award-info":[{"award-number":["5U01EH001301"]}],"id":[{"id":"10.13039\/100000030","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digital Med"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Machine learning has become an increasingly powerful tool for solving complex problems, and its application in public health has been underutilized. The objective of this study is to test the efficacy of a machine-learned model of foodborne illness detection in a real-world setting. To this end, we built FINDER, a machine-learned model for real-time detection of foodborne illness using anonymous and aggregated web search and location data. We computed the fraction of people who visited a particular restaurant and later searched for terms indicative of food poisoning to identify potentially unsafe restaurants. We used this information to focus restaurant inspections in two cities and demonstrated that FINDER improves the accuracy of health inspections; restaurants identified by FINDER are 3.1 times as likely to be deemed unsafe during the inspection as restaurants identified by existing methods. Additionally, FINDER enables us to ascertain previously intractable epidemiological information, for example, in 38% of cases the restaurant potentially causing food poisoning was not the last one visited, which may explain the lower precision of complaint-based inspections. We found that FINDER is able to reliably identify restaurants that have an active lapse in food safety, allowing for implementation of corrective actions that would prevent the potential spread of foodborne illness.<\/jats:p>","DOI":"10.1038\/s41746-018-0045-1","type":"journal-article","created":{"date-parts":[[2018,8,14]],"date-time":"2018-08-14T04:36:01Z","timestamp":1534221361000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":83,"title":["Machine-learned epidemiology: real-time detection of foodborne illness at scale"],"prefix":"10.1038","volume":"1","author":[{"given":"Adam","family":"Sadilek","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephanie","family":"Caty","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lauren","family":"DiPrete","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8484-0730","authenticated-orcid":false,"given":"Raed","family":"Mansour","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7533-1152","authenticated-orcid":false,"suffix":"Jr","given":"Tom","family":"Schenk","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mark","family":"Bergtholdt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ashish","family":"Jha","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Prem","family":"Ramaswami","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Evgeniy","family":"Gabrilovich","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2018,11,6]]},"reference":[{"key":"45_CR1","unstructured":"Snow, J. On the Mode of Communication of Cholera (2nd edn.) John Churchill, London (1855)."},{"key":"45_CR2","doi-asserted-by":"publisher","first-page":"2153","DOI":"10.1056\/NEJMp0900702","volume":"360","author":"JS Brownstein","year":"2009","unstructured":"Brownstein, J. S., Freifeld, C. C. & Madoff, L. C. Digital disease detection \u2014 harnessing the web for public health surveillance. New Engl. J. Med. 360, 2153\u20132157 (2009).","journal-title":"New Engl. J. Med."},{"key":"45_CR3","doi-asserted-by":"publisher","DOI":"10.1186\/1742-7622-11-7","volume":"11","author":"OP W\u00f3jcik","year":"2014","unstructured":"W\u00f3jcik, O. P., Brownstein, J. S., Chunara, R. & Johansson, M. A. Public health for the people: participatory infectious disease surveillance in the digital age. Emerg. Themes Epidemiol. 11, 7 (2014).","journal-title":"Emerg. Themes Epidemiol."},{"key":"45_CR4","doi-asserted-by":"publisher","first-page":"3","DOI":"10.5365\/wpsar.2015.6.1.019","volume":"6","author":"ICH Fung","year":"2015","unstructured":"Fung, I. C.-H., Tse, Z. T. H. & Fu, K.-W. The use of social media in public health surveillance. West. Pac. Surveill. Response J. 6, 3\u20136 (2015).","journal-title":"West. Pac. Surveill. Response J."},{"key":"45_CR5","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1089\/bsp.2011.0088","volume":"10","author":"SS Morse","year":"2012","unstructured":"Morse, S. S. Public health surveillance and infectious disease detection. Biosecur. Bioterror. 10, 6\u201316 (2012).","journal-title":"Biosecur. Bioterror."},{"key":"45_CR6","doi-asserted-by":"crossref","unstructured":"Chen, L., Hossain, K. S. M. T., Butler, P., Ramakrishnan, N. & Aditya Prakash, B. Flu Gone Viral: Syndromic Surveillance of Flu on Twitter Using Temporal Topic Models IEEE Computer Society: USA (2014).","DOI":"10.1109\/ICDM.2014.137"},{"key":"45_CR7","unstructured":"CDC. National Notifiable Disease Surveillance System (NNDSS) https:\/\/wwwn.cdc.gov\/nndss\/ (2018)."},{"key":"45_CR8","unstructured":"CDC. Division of Foodborne, Waterborne, and Environmental Diseases (DFWED): Surveillance & Data Systems https:\/\/www.cdc.gov\/ncezid\/dfwed\/keyprograms\/surveillance.html (2018)."},{"key":"45_CR9","unstructured":"CDC. Guide to Confirming an Etiology in Foodborne Disease Outbreak https:\/\/www.cdc.gov\/foodsafety\/outbreaks\/investigating-outbreaks\/confirming_diagnosis.html (2018)."},{"key":"45_CR10","doi-asserted-by":"publisher","first-page":"551","DOI":"10.3201\/eid0304.970420","volume":"3","author":"J Majkowski","year":"1997","unstructured":"Majkowski, J. Strategies for rapid response to emerging foodborne microbial hazards. Emerg. Infect. Dis. 3, 551\u2013554 (1997).","journal-title":"Emerg. Infect. Dis."},{"key":"45_CR11","doi-asserted-by":"publisher","first-page":"1012","DOI":"10.1038\/nature07634","volume":"457","author":"J Ginsberg","year":"2008","unstructured":"Ginsberg, J. et al. Detecting influenza epidemics using search engine query data. Nature 457, 1012 (2008).","journal-title":"Nature"},{"issue":"1","key":"45_CR12","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1609\/aimag.v38i1.2711","volume":"38","author":"Adam Sadilek","year":"2017","unstructured":"Sadilek, A. et al. Deploying nEmesis: preventing foodborne illness by data mining social media. AI Magazine 38, 37\u201348 (2016).","journal-title":"AI Magazine"},{"key":"45_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/1513876.1513877","volume":"3","author":"E Gabrilovich","year":"2009","unstructured":"Gabrilovich, E. et al. Classifying search queries using the Web as a source of knowledge. ACM Trans. Web 3, 1\u201328 (2009).","journal-title":"ACM Trans. Web"},{"key":"45_CR14","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1016\/0895-4356(90)90060-3","volume":"43","author":"SS Coughlin","year":"1990","unstructured":"Coughlin, S. S. Recall bias in epidemiologic studies. J. Clin. Epidemiol. 43, 87\u201391 (1990).","journal-title":"J. Clin. Epidemiol."},{"key":"45_CR15","doi-asserted-by":"publisher","first-page":"2184","DOI":"10.4315\/0362-028X-68.10.2184","volume":"68","author":"LA Green","year":"2005","unstructured":"Green, L. A. et al. Beliefs about meals eaten outside the home as sources of gastrointestinal illness. J. Food Prot. 68, 2184\u20132189 (2005).","journal-title":"J. Food Prot."},{"key":"45_CR16","doi-asserted-by":"publisher","first-page":"150","DOI":"10.1197\/jamia.M2544","volume":"15","author":"CC Freifeld","year":"2008","unstructured":"Freifeld, C. C., Mandl, K. D., Reis, B. Y. & Brownstein, J. S. HealthMap: global infectious disease monitoring through automated classification and visualization of internet media reports. J. Am. Med. Inform. Assoc. 15, 150\u2013157 (2008).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"45_CR17","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.0030401","volume":"3","author":"JS Brownstein","year":"2006","unstructured":"Brownstein, J. S., Wolfe, C. J. & Mandl, K. D. Empirical evidence for the effect of airline travel on inter-regional influenza spread in the United States. PLoS Med. 3, e401 (2006).","journal-title":"PLoS Med."},{"key":"45_CR18","doi-asserted-by":"publisher","first-page":"1878","DOI":"10.1126\/science.1202775","volume":"333","author":"SA Golder","year":"2011","unstructured":"Golder, S. A. & Macy, M. W. Diurnal and seasonal mood vary with work, sleep, and daylength across diverse cultures. Science 333, 1878\u20131881 (2011).","journal-title":"Science"},{"key":"45_CR19","unstructured":"Thornton, S. Delivering Faster Results with Food Inspection Forecasting: Chicago\u2019s Analytics-Driven Plan to Prevent Foodborne Illness http:\/\/datasmart.ash.harvard.edu\/news\/article\/delivering-faster-results-with-food-inspection-forecasting-631 (2015)."},{"key":"45_CR20","doi-asserted-by":"publisher","first-page":"1130","DOI":"10.2105\/AJPH.2017.303767","volume":"107","author":"Y Hswen","year":"2017","unstructured":"Hswen, Y., Brownstein, J. S., Liu, J. & Hawkins, J. B. Use of a digital health application for influenza surveillance in China. Am. J. Public Health 107, 1130\u20131136 (2017).","journal-title":"Am. J. Public Health"},{"key":"45_CR21","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1097\/PHH.0000000000000516","volume":"23","author":"JK Harris","year":"2017","unstructured":"Harris, J. K. et al. Using Twitter to identify and respond to food poisoning: the food safety STL project. J. Public Health Manag. Pract. 23, 577\u2013580 (2017).","journal-title":"J. Public Health Manag. Pract."},{"key":"45_CR22","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1093\/jpids\/pix004","volume":"7","author":"MP Shah","year":"2018","unstructured":"Shah, M. P. et al. Use of internet search data to monitor rotavirus vaccine impact in the United States, United Kingdom, and Mexico. J. Pediatr. Infect. Dis. Soc. 7, 56\u201363 (2018).","journal-title":"J. Pediatr. Infect. Dis. Soc."},{"key":"45_CR23","doi-asserted-by":"publisher","DOI":"10.1186\/s12879-017-2424-7","volume":"17","author":"S Yang","year":"2017","unstructured":"Yang, S. et al. Using electronic health records and internet search information for accurate influenza forecasting. BMC Infect. Dis. 17, 332 (2017).","journal-title":"BMC Infect. Dis."},{"key":"45_CR24","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0023610","volume":"6","author":"S Cook","year":"2011","unstructured":"Cook, S., Conrad, C., Fowlkes, A. L. & Mohebbi, M. H. Assessing Google Flu Trends performance in the United States during the 2009 influenza virus A (H1N1) pandemic. PLoS ONE 6, e23610 (2011).","journal-title":"PLoS ONE"},{"key":"45_CR25","first-page":"19386","volume":"14","author":"N Wilson","year":"2009","unstructured":"Wilson, N. et al. Interpreting \u201cGoogle Flu Trends\u201d data for pandemic H1N1 influenza: the New Zealand experience. Eurosurveillance 14, 19386 (2009).","journal-title":"Eurosurveillance"},{"key":"45_CR26","doi-asserted-by":"publisher","first-page":"1203","DOI":"10.1126\/science.1248506","volume":"343","author":"D Lazer","year":"2014","unstructured":"Lazer, D., Kennedy, R., King, G. & Vespignani, A. The parable of Google Flu: traps in big data analysis. Science 343, 1203\u20131205 (2014).","journal-title":"Science"},{"key":"45_CR27","first-page":"443","volume":"34","author":"E Gabrilovich","year":"2009","unstructured":"Gabrilovich, E. & Markovitch, S. Wikipedia-based semantic interpretation for natural language processing. J. Artif. Int. Res. 34, 443\u2013498 (2009).","journal-title":"Artif. Int. Res."},{"key":"45_CR28","unstructured":"Google. Google Inside Search: The Knowledge Graph https:\/\/www.google.com\/intl\/en_us\/insidesearch\/features\/search\/knowledge.html (2012)."},{"key":"45_CR29","unstructured":"Harris, J. K. et al. Health Department Use of Social Media to Identify Foodborne Illness - Chicago, Illinois, 2013\u20132014. 681\u2013685 (Center for Disease Control and Prevention, Atlanta, GA, 2014)."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-018-0045-1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-018-0045-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-018-0045-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,21]],"date-time":"2022-12-21T07:40:56Z","timestamp":1671608456000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-018-0045-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,11,6]]},"references-count":29,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2018,12]]}},"alternative-id":["45"],"URL":"https:\/\/doi.org\/10.1038\/s41746-018-0045-1","relation":{"has-review":[{"id-type":"doi","id":"10.3410\/f.734375727.793552688","asserted-by":"object"}]},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,11,6]]},"assertion":[{"value":"12 February 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 July 2018","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 July 2018","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 November 2018","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A.S., P.R., and E.G. are directly employed by Google. The remaining authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"36"}}