{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,26]],"date-time":"2025-10-26T22:50:41Z","timestamp":1761519041147},"reference-count":46,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2012,5,8]],"date-time":"2012-05-08T00:00:00Z","timestamp":1336435200000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2012,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Background<\/jats:title>\n            <jats:p>Death records are a rich source of data, which can be used to assist with public surveillance and\/or decision support. However, to use this type of data for such purposes it has to be transformed into a coded format to make it computable. Because the cause of death in the certificates is reported as free text, encoding the data is currently the single largest barrier of using death certificates for surveillance. Therefore, the purpose of this study was to demonstrate the feasibility of using a pipeline, composed of a detection rule and a natural language processor, for the real time encoding of death certificates using the identification of pneumonia and influenza cases as an example and demonstrating that its accuracy is comparable to existing methods.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>A Death Certificates Pipeline (DCP) was developed to automatically code death certificates and identify pneumonia and influenza cases. The pipeline used MetaMap to code death certificates from the Utah Department of Health for the year 2008. The output of MetaMap was then accessed by detection rules which flagged pneumonia and influenza cases based on the Centers of Disease and Control and Prevention (CDC) case definition. The output from the DCP was compared with the current method used by the CDC and with a keyword search. Recall, precision, positive predictive value and F-measure with respect to the CDC method were calculated for the two other methods considered here. The two different techniques compared here with the CDC method showed the following recall\/ precision results: DCP: 0.998\/0.98 and keyword searching: 0.96\/0.96. The F-measure were 0.99 and 0.96 respectively (DCP and keyword searching). Both the keyword and the DCP can run in interactive form with modest computer resources, but DCP showed superior performance.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusion<\/jats:title>\n            <jats:p>The pipeline proposed here for coding death certificates and the detection of cases is feasible and can be extended to other conditions. This method provides an alternative that allows for coding free-text death certificates in real time that may increase its utilization not only in the public health domain but also for biomedical researchers and developers.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Trial Registration<\/jats:title>\n            <jats:p>This study did not involved any clinical trials.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1186\/1472-6947-12-37","type":"journal-article","created":{"date-parts":[[2012,5,8]],"date-time":"2012-05-08T16:27:09Z","timestamp":1336494429000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Identification of pneumonia and influenza deaths using the death certificate pipeline"],"prefix":"10.1186","volume":"12","author":[{"given":"Kailah","family":"Davis","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Catherine","family":"Staes","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jeff","family":"Duncan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sean","family":"Igo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Julio C","family":"Facelli","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2012,5,8]]},"reference":[{"key":"527_CR1","first-page":"E070104","volume":"12","author":"A Mazick","year":"2007","unstructured":"Mazick A: Participants of a workshop on mortality monitoring in Europe: Monitoring excess mortality for public health action: potential for a future European network. Euro Surveill. 2007, 12: E070104-Available from [http:\/\/www.eurosurveillance.org\/ew\/2007\/070104.asp]","journal-title":"Euro Surveill"},{"key":"527_CR2","first-page":"285","volume":"72","author":"S Declich","year":"1994","unstructured":"Declich S, Carter AO: Public health surveillance: historical origins, methods and evaluation. Bull World Health Organ. 1994, 72: 285-304.","journal-title":"Bull World Health Organ"},{"key":"527_CR3","first-page":"127","volume-title":"Recent advances in community medicine, No 2","author":"NS Galbraith","year":"1982","unstructured":"Galbraith NS: Communicable disease surveillance. Recent advances in community medicine, No 2. Edited by: Smith A. 1982, Churchill Livingstone, London, 127-142."},{"key":"527_CR4","volume-title":"Euro Surveill","author":"PJ Nogueira","year":"2010","unstructured":"Nogueira PJ, Machado A, Rodrigues E, Nunes B, Sousa L, Jacinto M, Ferreira A, Falcao JM, Ferrinho P: The new automated daily mortality surveillance system in Portugal. Euro Surveill. 2010, 15: pii 19529. Available from [http:\/\/www.eurosurveillance.org\/ViewArticle.aspx?ArticleId=19529]"},{"key":"527_CR5","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1007\/s10654-005-5923-6","volume":"21","author":"B Sartorius","year":"2006","unstructured":"Sartorius B, Jacobsen H, T\u00f6rner A, Giesecke J: Description of a new all cause mortality surveillance system in Sweden as a warning system using threshold detection algorithms. Eur J Epidemiol. 2006, 21: 181-9. 10.1007\/s10654-005-5923-6.","journal-title":"Eur J Epidemiol"},{"key":"527_CR6","doi-asserted-by":"publisher","first-page":"390","DOI":"10.1097\/00001648-199707000-00007","volume":"8","author":"L Simonsen","year":"1997","unstructured":"Simonsen L, Clarke MJ, Stroup DF, Williamson GD, Arden NH, Cox NJ: A method for timely assessment of influenza-associated mortality in the United States. Epidemiology. 1997, 8: 390-5. 10.1097\/00001648-199707000-00007.","journal-title":"Epidemiology"},{"key":"527_CR7","volume-title":"Mortality surveillance 1968\u20131976, England and Wales. Deaths and rates by sex and age group for 8th revision causes, A-list and chapters","author":"J Haskey","year":"1978","unstructured":"Haskey J: Mortality surveillance 1968\u20131976, England and Wales. Deaths and rates by sex and age group for 8th revision causes, A-list and chapters. 1978, Great Britain Office of Population Census and Surveys, Medical Statistics Division, Crown, London"},{"key":"527_CR8","unstructured":"Influenza WHO Fact sheet No. 211 revised. 2003,http:\/\/www.who.int\/mediacentre\/factsheets\/fs211\/en\/4, March ,"},{"key":"527_CR9","first-page":"1","volume":"58","author":"AE Fiore","year":"2009","unstructured":"Fiore AE, Shay DK, Broder K: Prevention and control of seasonal influenza with vaccines: recommendations of the Advisory Committee on Immunization Practices (ACIP),2009. MMWR Recomm Rep. 2009, 58: 1-52. [Erratum, MMWR Recomm Rep 2009, 58:896\u20137.]","journal-title":"MMWR Recomm Rep"},{"key":"527_CR10","first-page":"1","volume":"26","author":"MJ Hall","year":"2010","unstructured":"Hall MJ, DeFrances CJ, Williams SN, Golosinskiy A, Schwartzman A: National Hospital Discharge Survey: 2007 summary. Natl Health Stat Report. 2010, 26: 1-20.","journal-title":"Natl Health Stat Report"},{"key":"527_CR11","doi-asserted-by":"publisher","first-page":"1333","DOI":"10.1001\/jama.292.11.1333","volume":"292","author":"WW Thompson","year":"2004","unstructured":"Thompson WW, Shay DK, Weintraub E: Influenza-associated hospitalizations in the United States. JAMA. 2004, 292: 1333-40. 10.1001\/jama.292.11.1333.","journal-title":"JAMA"},{"key":"527_CR12","unstructured":"American Lung Association State of Lung Disease in Diverse Communities. 2010, http:\/\/www.lungusa.org\/assets\/documents\/publications\/lung-disease-data\/solddc_2010.pdf]"},{"issue":"suppl1","key":"527_CR13","doi-asserted-by":"publisher","first-page":"33","DOI":"10.2165\/00019053-199916001-00005","volume":"16","author":"M Postma","year":"1999","unstructured":"Postma M, Bos JM, Van Gennep M, Jager JC, Baltussen R, Sprenger MJW: Economic evaluation of influenza vaccination. Assessment for The Netherlands. Pharmacoeconomics. 1999, 16 (suppl1): 33-40.","journal-title":"Pharmacoeconomics"},{"key":"527_CR14","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1001\/jama.289.2.179","volume":"289","author":"WW Thompson","year":"2003","unstructured":"Thompson WW, Shay DK, Weintraub E, Brammer L, Cox N, Anderson LJ, Fukuda K: Mortality associated with influenza and respiratory syncytial virus in the United States. JAMA. 2003, 289: 179-86. 10.1001\/jama.289.2.179.","journal-title":"JAMA"},{"key":"527_CR15","unstructured":"Estimating Seasonal Influenza-Associated Deaths in the United States: CDC Study Confirms Variability of Flu.http:\/\/www.cdc.gov\/flu\/about\/disease\/us_flu-related_deaths.htm,"},{"key":"527_CR16","unstructured":"Flu activity & surveillance: reports and surveillance methods in the United States. , , ,http:\/\/www.cdc.gov\/flu\/weekly\/fluactivity.htm,"},{"key":"527_CR17","unstructured":"121 Cities Mortality Reporting System: history.http:\/\/www.cdc.gov\/epo\/dphsi\/121hist.htm,"},{"key":"527_CR18","unstructured":"Wu WJ, Chaung JH: Real-time Surveillance of Pneumonia and Influenza Mortalities via the National Death Certificate System. [http:\/\/web.cdc.gov.tw\/ct.asp?xItem=14106&ctNode=3842&mp=181"},{"key":"527_CR19","first-page":"435","volume":"32","author":"DJ Muscatello","year":"2008","unstructured":"Muscatello DJ, Morton PM, Evans I, Gilmour R: Prospective surveillance of excess mortality due to influenza in New South Wales: feasibility and statistical approach. Commun Dis Intell. 2008, 32: 435-42.","journal-title":"Commun Dis Intell"},{"key":"527_CR20","volume-title":"Medical Language Processing: Computer Management of Narrative Data","author":"N Sager","year":"1997","unstructured":"Sager N: Medical Language Processing: Computer Management of Narrative Data. 1997, Springer-Verlag, New York"},{"key":"527_CR21","unstructured":"Death Certificate.http:\/\/www.cdc.gov\/NCIPC\/pub-res\/nvdrs-coding\/Death-Certificate.pdf,"},{"key":"527_CR22","first-page":"1","volume":"49","author":"RN Anderson","year":"2001","unstructured":"Anderson RN, Mini\u00f1o AM, Hoyert DL, Rosenberg HM: Comparability of cause of death between ICD-9 and ICD-10: preliminary estimates. Natl Vital Stat Rep. 2001, 49: 1-32.","journal-title":"Natl Vital Stat Rep"},{"key":"527_CR23","volume-title":"International Statistical Classification of Disease and Related Health Problems, Tenth Revision Version for 2007 (ICD-10)","author":"World Health Organization","year":"2006","unstructured":"World Health Organization: International Statistical Classification of Disease and Related Health Problems, Tenth Revision Version for 2007 (ICD-10). 2006"},{"key":"527_CR24","volume-title":"Proceedings of the Conference of European Statistics: 2\u20134 June","author":"K Harris","year":"1999","unstructured":"Harris K: Selected data editing procedures in an automated multiple cause of death coding system. Proceedings of the Conference of European Statistics: 2\u20134 June. 1999, , Rome"},{"key":"527_CR25","volume-title":"AMIA Annual Symposium Proceeding 13 Nov","author":"B Riedl","year":"2010","unstructured":"Riedl B, Than N, Hogarth M: Using the UMLS and Simple Statistical Methods to Semantically Categorize Causes of Death on Death Certificates. AMIA Annual Symposium Proceeding 13 Nov. 2010, , Washington D.C.2010:677\u201381"},{"key":"527_CR26","volume-title":"Proceedings of the international collaborative effort on automating mortality Volume I:July","author":"D Glenn","year":"1999","unstructured":"Glenn D: Description of the National Center for Health Statistics Software Systems and Demonstrations. Proceedings of the international collaborative effort on automating mortality Volume I:July. 1999, National Center of Health Statistics, Hyattsville, Maryland"},{"key":"527_CR27","doi-asserted-by":"publisher","first-page":"234","DOI":"10.1097\/00000433-199809000-00007","volume":"19","author":"Toward an electronic death registration system in the United States","year":"1998","unstructured":"Toward an electronic death registration system in the United States: report of the Steering Committee to Reengineer the Death Registration Process. Am J Forensic Med Pathol. 1998, 19: 234-41. 10.1097\/00000433-199809000-00007.","journal-title":"Am J Forensic Med Pathol"},{"key":"527_CR28","volume-title":"Electronic Death Registration Systems by Jurisdiction Updated","author":"National Association for Public Health Statistics and Information Systems","year":"2011","unstructured":"National Association for Public Health Statistics and Information Systems: Electronic Death Registration Systems by Jurisdiction Updated. 2011,http:\/\/www.naphsis.org\/naphsis\/files\/ccLibraryFiles\/Filename\/000000001472\/EDRS_Development_with_territories_July_2011.pdf, July ,"},{"key":"527_CR29","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1016\/j.artmed.2004.04.001","volume":"33","author":"WW Chapman","year":"2005","unstructured":"Chapman WW, Christensen LM, Wagner MM, Haug PJ, Ivanov O, Dowling JN: Classifying free-text triage chief complaints into syndromic categories with natural language processing. Artif Intell Med. 2005, 33: 31-40. 10.1016\/j.artmed.2004.04.001.","journal-title":"Artif Intell Med"},{"key":"527_CR30","doi-asserted-by":"publisher","first-page":"593","DOI":"10.1136\/jamia.2000.0070593","volume":"7","author":"M Fiszman","year":"2000","unstructured":"Fiszman M, Chapman WW, Aronsky D, Evans RS, Haug PJ: Automatic detection of acute bacterial pneumonia from chest X-ray reports. J Am Med Inform Assoc. 2000, 7: 593-604. 10.1136\/jamia.2000.0070593.","journal-title":"J Am Med Inform Assoc"},{"key":"527_CR31","doi-asserted-by":"publisher","first-page":"392","DOI":"10.1197\/jamia.M1552","volume":"11","author":"C Friedman","year":"2004","unstructured":"Friedman C, Shagina L, Lussier Y, Hripcsak G: Automated encoding of clinical documents based on natural language processing. J Am Med Inform Assoc. 2004, 11: 392-402. 10.1197\/jamia.M1552.","journal-title":"J Am Med Inform Assoc"},{"key":"527_CR32","first-page":"34","volume":"5","author":"AV Gundlapalli","year":"2008","unstructured":"Gundlapalli AV, South BR, Chapman WW, Phansalkar S, Shen S, Delisle S, Perl Trish, Samore MH: Using NLP on VA Electronic Medical Records to Facilitate Epidemiologic Case Investigations. Advances in Disease Surveillance. 2008, 5: 34-","journal-title":"Advances in Disease Surveillance"},{"key":"527_CR33","volume-title":"Proc 36thSymposium on the Interface","author":"WW Chapman","year":"2004","unstructured":"Chapman WW, Dowling JN, Ivanov O, Gesteland PH, Espino JU, Wagner MM: Evaluating natural language processing applications applied to outbreak and disease surveillance. Proc 36thSymposium on the Interface. 2004, Computing Science and Statistics, Baltimore"},{"key":"527_CR34","first-page":"17","volume-title":"Proc AMIA Symp","author":"A Aronson","year":"2001","unstructured":"Aronson A: Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program. Proc AMIA Symp. 2001, 17-21."},{"key":"527_CR35","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1197\/jamia.M1474","volume":"11","author":"J Crowell","year":"2004","unstructured":"Crowell J, Zeng Q, Ngo L, Lacroix EM: A Frequency-based technique to improve the spelling suggestion rank in medical queries. J Am Med Inform Assoc. 2004, 11: 179-185. 10.1197\/jamia.M1474.","journal-title":"J Am Med Inform Assoc"},{"key":"527_CR36","volume-title":"Lister Hill National Center for Biomedical Communications, National Library of Medicine","author":"AC Browne","year":"2003","unstructured":"Browne AC, Divita G, Lu C, McCreedy L, Nace D: TECHNICAL REPORT LHNCBC-TR-2003\u2013003, Lexical Systems: A report to the Board of Scientific Counselors. Lister Hill National Center for Biomedical Communications, National Library of Medicine. 2003"},{"key":"527_CR37","first-page":"798","volume-title":"UMLS language and vocabulary tools","author":"AC Browne","year":"2003","unstructured":"Browne AC, Divita G, Aronson AR, McCray AT: UMLS language and vocabulary tools. 2003, Proceedings of the AMIA Annual Symposium, Washington DC, USA, 798-"},{"key":"527_CR38","unstructured":"Atkinson K: GNU Aspell.http:\/\/aspell.sourceforge.net\/,"},{"key":"527_CR39","unstructured":"Aronson AR: MetaMap: Mapping Text to the UMLS Metathesaurus.http:\/\/skr.nlm.nih.gov\/papers\/references\/metamap06.pdf,"},{"key":"527_CR40","doi-asserted-by":"publisher","first-page":"D267","DOI":"10.1093\/nar\/gkh061","volume":"32","author":"O Bodenreider","year":"2004","unstructured":"Bodenreider O: The Unified Language System (UMLS): integrating biomedical terminology. Nucleic Acids Res. 2004, 32: D267-70. 10.1093\/nar\/gkh061.","journal-title":"Nucleic Acids Res"},{"key":"527_CR41","unstructured":"UMLS distribution.http:\/\/www.nlm.nih.gov\/research\/umls\/licensedcontent\/umlsknowledgesources.html,"},{"key":"527_CR42","volume-title":"R: A language and environment for statistical computing","author":"R Core Development Team","year":"2009","unstructured":"R Core Development Team: R: A language and environment for statistical computing. 2009, R Foundation for Statistical Computing, Vienna"},{"key":"527_CR43","unstructured":"National Bureau of Economic Research: Entity axis codes. http:\/\/www.nber.org\/mortality\/1995\/docs\/entity95.txt]"},{"key":"527_CR44","volume-title":"Documentation of the mortality tape file for","author":"National Center for Health Statistics","year":"1997","unstructured":"National Center for Health Statistics: Documentation of the mortality tape file for. 1997,http:\/\/wonder.cdc.gov\/wonder\/sci_data\/mort\/mcmort\/type_txt\/mcmort97.asp, data,"},{"key":"527_CR45","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1177\/0885713X9701200404","volume":"12","author":"J Whittle","year":"1997","unstructured":"Whittle J: Community-acquired pneumonia: can it be defined with claims data?. American Journal of Medical Quality. 1997, 12: 187-193. 10.1177\/0885713X9701200404.","journal-title":"American Journal of Medical Quality"},{"key":"527_CR46","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1017\/S0950268807008564","volume":"136","author":"SA Skull","year":"2008","unstructured":"Skull SA, Andrews RM, Byrnes GB, Campbell DA, Nolan TM, Brown GV, Kelly HA: ICD- 10 codes are a valid tool for identification of pneumonia in hospitalized patients aged > or = 65 years. Epidemiol Infect. 2008, 136: 232-40. Epub 2007 Apr 20","journal-title":"Epidemiol Infect"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/1472-6947-12-37.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/1472-6947-12-37\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/1472-6947-12-37","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1472-6947-12-37.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,1]],"date-time":"2021-09-01T19:44:16Z","timestamp":1630525456000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/1472-6947-12-37"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,5,8]]},"references-count":46,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2012,12]]}},"alternative-id":["527"],"URL":"https:\/\/doi.org\/10.1186\/1472-6947-12-37","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,5,8]]},"assertion":[{"value":"22 September 2011","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 February 2012","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 May 2012","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"37"}}