{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T07:25:29Z","timestamp":1791530729536,"version":"4.3.4"},"reference-count":19,"publisher":"Wiley","issue":"5","license":[{"start":{"date-parts":[[2006,2,2]],"date-time":"2006-02-02T00:00:00Z","timestamp":1138838400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Statistics in Medicine"],"published-print":{"date-parts":[[2006,3,15]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Since the anthrax attacks of October 2001 and the SARS outbreaks of recent years, there has been an increasing interest in developing surveillance systems to aid in the early detection of such illness. Systems have been established which do this is by monitoring primary health\u2010care visits, pharmacy sales, absenteeism records, and other non\u2010traditional sources of data. While many resources have been invested in establishing such systems, relatively little effort has as yet been expended in evaluating their performance.<\/jats:p><jats:p>One way to evaluate a given surveillance system is to compare the signals it generates with known outbreaks identified in other systems. In public health practice, for example, public health departments investigate reports of illness and sometimes track hospital admissions. Comparison of new systems with extant systems cannot generate estimates of test characteristics such as sensitivity and specificity, since the actual number of positives and negatives cannot be known. However, the comparison can reveal whether a new or proposed system's signals match outbreaks detected by the existing system. This could help support or reject the new system as an alternative or complement to the extant system.<\/jats:p><jats:p>We propose three methods to test the null hypothesis that the new system does not signal true outbreaks more often than would be expected by chance. The methods differ in the restrictiveness of the assumptions required. Each test may detect weaknesses in the new system, depending on the distribution of outbreaks and can be used to construct confidence limits on the agreement between the new system's signals and the outbreaks, given the distribution of the signals. They can be used to assess whether the new system works in that it detects the outbreaks better than chance would suggest and can also determine if the new systems' signals are generated earlier than an extant system. Copyright \u00a9 2006 John Wiley &amp; Sons, Ltd.<\/jats:p>","DOI":"10.1002\/sim.2402","type":"journal-article","created":{"date-parts":[[2006,2,2]],"date-time":"2006-02-02T10:46:49Z","timestamp":1138877209000},"page":"755-769","source":"Crossref","is-referenced-by-count":12,"title":["Evaluating spatial surveillance: detection of known outbreaks in real data"],"prefix":"10.1002","volume":"25","author":[{"given":"Ken","family":"Kleinman","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Allyson","family":"Abrams","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"W.","family":"Katherine Yih","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard","family":"Platt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martin","family":"Kulldorff","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2006,2,2]]},"reference":[{"key":"e_1_2_1_2_2","first-page":"137","article-title":"Evaluation of syndromic surveillance systems: development of an epidemic simulation model","volume":"53","author":"Buckeridge D","year":"2004","journal-title":"Morbidity and Mortality Weekly Report"},{"issue":"2","key":"e_1_2_1_3_2","doi-asserted-by":"crossref","first-page":"i89","DOI":"10.1007\/PL00022319","article-title":"The bioterrorism preparedness and response early aberration reporting system (EARS)","volume":"80","author":"Hutwagner L","year":"2003","journal-title":"Journal of Urban Health"},{"key":"e_1_2_1_4_2","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2458-1-9"},{"key":"e_1_2_1_5_2","doi-asserted-by":"publisher","DOI":"10.3201\/eid0808.020239"},{"issue":"2","key":"e_1_2_1_6_2","doi-asserted-by":"crossref","first-page":"i97","DOI":"10.1007\/PL00022320","article-title":"Syndromic surveillance using automated collection of computerized discharge diagnoses","volume":"80","author":"Lober WB","year":"2003","journal-title":"Journal of Urban Health"},{"issue":"2","key":"e_1_2_1_7_2","doi-asserted-by":"crossref","first-page":"i32","DOI":"10.1007\/PL00022313","article-title":"A systems overview of the electronic surveillance system for the early notification of community\u2010based epidemics (ESSENCE II)","volume":"80","author":"Lombardo J","year":"2003","journal-title":"Journal of Urban Health"},{"issue":"2","key":"e_1_2_1_8_2","doi-asserted-by":"crossref","first-page":"i43","DOI":"10.1007\/PL00022314","article-title":"Use of ambulance dispatch data as an early warning system for communitywide influenza\u2010like illness, New York City","volume":"80","author":"Mostashari F","year":"2003","journal-title":"Journal of Urban Health"},{"issue":"5","key":"e_1_2_1_9_2","first-page":"1","article-title":"Framework for evaluating public health surveillance systems for early detection of outbreaks","volume":"53","author":"CDC","year":"2004","journal-title":"Morbidity and Mortality Weekly Report"},{"key":"e_1_2_1_10_2","doi-asserted-by":"publisher","DOI":"10.1111\/1467-985X.00188"},{"key":"e_1_2_1_11_2","doi-asserted-by":"publisher","DOI":"10.1093\/aje\/kwh029"},{"key":"e_1_2_1_12_2","doi-asserted-by":"publisher","DOI":"10.1111\/1467-985X.00186"},{"key":"e_1_2_1_13_2","doi-asserted-by":"publisher","DOI":"10.2307\/2528932"},{"key":"e_1_2_1_14_2","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177707045"},{"key":"e_1_2_1_15_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-3235-1_13"},{"key":"e_1_2_1_16_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-3235-1"},{"issue":"2","key":"e_1_2_1_17_2","doi-asserted-by":"crossref","first-page":"i25","DOI":"10.1007\/PL00022312","article-title":"Syndromic surveillance using minimum transfer of identifiable data: the example of the national bioterrorism syndromic surveillance demonstration program","volume":"80","author":"Platt R","year":"2003","journal-title":"Journal of Urban Health"},{"key":"e_1_2_1_18_2","doi-asserted-by":"publisher","DOI":"10.1017\/S0950268804003528"},{"key":"e_1_2_1_19_2","series-title":"Division of Epidemiology and Community Health","volume-title":"Rate\u2010limiting Factors in Foodborne Outbreak Detection and Non\u2010traditional Foodborne Illness Surveillance in Minnesota","author":"Neises D","year":"2003"},{"key":"e_1_2_1_20_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.0020059"}],"container-title":["Statistics in Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fsim.2402","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/sim.2402","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,13]],"date-time":"2023-09-13T05:20:21Z","timestamp":1694582421000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/sim.2402"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2006,2,2]]},"references-count":19,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2006,3,15]]}},"alternative-id":["10.1002\/sim.2402"],"URL":"https:\/\/doi.org\/10.1002\/sim.2402","archive":["Portico"],"relation":{},"ISSN":["0277-6715","1097-0258"],"issn-type":[{"value":"0277-6715","type":"print"},{"value":"1097-0258","type":"electronic"}],"subject":[],"published":{"date-parts":[[2006,2,2]]}}}