{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,6,20]],"date-time":"2024-06-20T09:11:29Z","timestamp":1718874689919},"reference-count":39,"publisher":"Oxford University Press (OUP)","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2017,7,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Objective: Every year, thousands of patients die waiting for disability benefits from the Social Security Administration. Some qualify for expedited service under the Compassionate Allowance (CAL) initiative, but CAL software focuses exclusively on information from a single form field. This paper describes the development of a supplemental process for identifying some overlooked but gravely ill applicants, through automatic annotation of health records accompanying new claims. We explore improved prioritization instead of fully autonomous claims approval.<\/jats:p><jats:p>Materials and Methods: We developed a sample of claims containing medical records at the moment of arrival in a single office. A series of tools annotated both patient records and public Web page descriptions of CAL medical conditions. We trained random forests to identify CAL patients and validated each model with 10-fold cross validation.<\/jats:p><jats:p>Results: Our main model, a general CAL classifier, had an area under the receiver operating characteristic curve of 0.915. Combining this classifier with existing software improved sensitivity from 0.960 to 0.994, detecting every deceased patient, but reducing positive predictive value to 0.216.<\/jats:p><jats:p>Discussion: True positive CAL identification is a priority, given CAL patient mortality. Mere prioritization of the false positives would not create a meaningful burden in terms of manual review. Death certificate data suggest the presence of truly ill patients among putative false positives.<\/jats:p><jats:p>Conclusion: To a limited extent, it is possible to identify gravely ill Social Security disability applicants by analyzing annotations of unstructured electronic health records, and the level of identification is sufficient to be useful in prioritizing case reviews.<\/jats:p>","DOI":"10.1093\/jamia\/ocw159","type":"journal-article","created":{"date-parts":[[2016,11,1]],"date-time":"2016-11-01T20:06:22Z","timestamp":1478030782000},"page":"709-716","source":"Crossref","is-referenced-by-count":2,"title":["Automatic health record review to help prioritize gravely ill Social Security disability applicants"],"prefix":"10.1093","volume":"24","author":[{"given":"Kenneth","family":"Abbott","sequence":"first","affiliation":[{"name":"Minnesota Disability Determination Services, Saint Paul, Minnesota, USA"}]},{"given":"Yen-Yi","family":"Ho","sequence":"additional","affiliation":[{"name":"Department of Statistics, College of Arts and Sciences, University of South Carolina, Columbia, SC, USA"}]},{"given":"Jennifer","family":"Erickson","sequence":"additional","affiliation":[{"name":"Minnesota Disability Determination Services, Saint Paul, Minnesota, USA"}]}],"member":"286","published-online":{"date-parts":[[2017,1,19]]},"reference":[{"issue":"11","key":"2020110612442174400_ocw159-B1","doi-asserted-by":"crossref","first-page":"944","DOI":"10.1097\/MLR.0000000000000204","article-title":"First in line: prioritizing receipt of Social Security disability benefits based on likelihood of death during adjudication","volume":"52","author":"Rasch","year":"2014","journal-title":"Med. Care."},{"key":"2020110612442174400_ocw159-B2","volume-title":"Processing Compassionate Allowances (CAL) in the Field Office (FO)","author":"Social Security Administration"},{"key":"2020110612442174400_ocw159-B3","volume-title":"Monthly Statistical Snapshot","author":"Social Security Administration"},{"key":"2020110612442174400_ocw159-B4","volume-title":"Annual Statistical Report on the Social Security Disability Insurance Program, 2013","author":"Office of Retirement and Disability Policy, Evaluation, and Statistics"},{"key":"2020110612442174400_ocw159-B5","volume-title":"Percentage of Fast-track Receipts","author":"Office of Research and Employment Support"},{"key":"2020110612442174400_ocw159-B6","volume-title":"List of Compassionate Allowance (CAL) Conditions","author":"Social Security Administration"},{"issue":"3","key":"2020110612442174400_ocw159-B7","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/j.ajic.2013.09.007","article-title":"Assessing surgical site infection risk factors using electronic medical records and text mining","volume":"42","author":"Michelson","year":"2014","journal-title":"Am. J. Infect. Control."},{"key":"2020110612442174400_ocw159-B8","doi-asserted-by":"crossref","DOI":"10.1016\/j.jbi.2015.06.030","article-title":"Agile text mining for the 2014 i2b2\/UTHealth cardiac risk factors challenge","author":"Cormack","year":"2015","journal-title":"J. Biomed. Inform."},{"issue":"4","key":"2020110612442174400_ocw159-B9","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1176\/appi.ajp.2014.14030423","article-title":"Validation of electronic health record phenotyping of bipolar disorder cases and controls","volume":"172","author":"Castro","year":"2015","journal-title":"Am. J. Psychiatry."},{"issue":"e1","key":"2020110612442174400_ocw159-B10","doi-asserted-by":"crossref","first-page":"e151","DOI":"10.1136\/amiajnl-2014-002642","article-title":"Automatic identification of methotrexate-induced liver toxicity in patients with rheumatoid arthritis from the electronic medical record","volume":"22","author":"Lin","year":"2015","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"2020110612442174400_ocw159-B11","doi-asserted-by":"crossref","first-page":"S86","DOI":"10.1016\/j.jbi.2011.11.001","article-title":"Using statistical text mining to supplement the development of an ontology","volume":"44","author":"Luther","year":"2011","journal-title":"J. Biomed. Inform."},{"key":"2020110612442174400_ocw159-B12","first-page":"71","article-title":"Using a data mining approach to discover behavior correlates of chronic disease: a case study of depression","volume":"201","author":"Yoon","year":"2014","journal-title":"Stud. Health Technol. Inform."},{"issue":"3","key":"2020110612442174400_ocw159-B13","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1016\/j.yebeh.2013.09.025","article-title":"Validating a natural language processing tool to exclude psychogenic nonepileptic seizures in electronic medical record\u2013based epilepsy research","volume":"29","author":"Hamid","year":"2013","journal-title":"Epilepsy Behav."},{"issue":"2","key":"2020110612442174400_ocw159-B14","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1093\/jamia\/ocv091","article-title":"OrderRex: Clinical order decision support and outcome predictions by data-mining electronic medical records","volume":"23","author":"Chen","year":"2016","journal-title":"J. Am. Med. Inform. Assoc"},{"issue":"5","key":"2020110612442174400_ocw159-B15","doi-asserted-by":"crossref","first-page":"906","DOI":"10.1136\/amiajnl-2012-001334","article-title":"Finding falls in ambulatory care clinical documents using statistical text mining","volume":"20","author":"McCart","year":"2013","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"2020110612442174400_ocw159-B16","first-page":"1071","article-title":"An efficacy driven approach for medication recommendation in type 2 diabetes treatment using data mining techniques","volume":"192","author":"Liu","year":"2013","journal-title":"Stud. Health Technol. Inform."},{"issue":"9","key":"2020110612442174400_ocw159-B17","doi-asserted-by":"crossref","first-page":"704","DOI":"10.1089\/tmj.2012.0241","article-title":"Information extraction for tracking liver cancer patients' statuses: from mixture of clinical narrative report types","volume":"19","author":"Ping","year":"2013","journal-title":"Telemed. J. E. Health."},{"issue":"5","key":"2020110612442174400_ocw159-B18","doi-asserted-by":"crossref","first-page":"898","DOI":"10.1136\/amiajnl-2012-001076","article-title":"Longitudinal analysis of pain in patients with metastatic prostate cancer using natural language processing of medical record text","volume":"20","author":"Heintzelman","year":"2013","journal-title":"J. Am. Med. Inform. Assoc."},{"issue":"3","key":"2020110612442174400_ocw159-B19","doi-asserted-by":"crossref","first-page":"448","DOI":"10.1136\/amiajnl-2013-001766","article-title":"Discovering body site and severity modifiers in clinical texts","volume":"21","author":"Dligach","year":"2014","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"2020110612442174400_ocw159-B20","doi-asserted-by":"crossref","DOI":"10.1186\/s13326-015-0010-8","article-title":"Development and validation of a classification approach for extracting severity automatically from electronic health records","volume":"6","author":"Boland","year":"2015","journal-title":"J. Biomed. Semantics"},{"issue":"9","key":"2020110612442174400_ocw159-B21","doi-asserted-by":"crossref","first-page":"799","DOI":"10.1007\/s40264-015-0311-y","article-title":"Detection of drug-drug interactions inducing acute kidney injury by electronic health records mining","volume":"38","author":"Girardeau","year":"2015","journal-title":"Drug Saf."},{"issue":"5","key":"2020110612442174400_ocw159-B22","doi-asserted-by":"crossref","first-page":"776","DOI":"10.1136\/amiajnl-2013-001914","article-title":"Phenotyping for patient safety: algorithm development for electronic health record based automated adverse event and medical error detection in neonatal intensive care","volume":"21","author":"Li","year":"2014","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"2020110612442174400_ocw159-B23","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/j.jtbi.2015.01.023","article-title":"Detecting disease outbreaks using a combined Bayesian network and particle filter approach","volume":"370","author":"Dawson","year":"2015","journal-title":"J. Theor. Biol."},{"key":"2020110612442174400_ocw159-B24","first-page":"589","article-title":"Extracting concepts related to homelessness from the free text of VA electronic medical records","volume":"2014","author":"Gundlapalli","year":"2014","journal-title":"AMIA Annu. Symp. Proc."},{"issue":"5","key":"2020110612442174400_ocw159-B25","doi-asserted-by":"crossref","first-page":"614","DOI":"10.1136\/amiajnl-2011-000093","article-title":"The Yale cTAKES extensions for document classification: architecture and application","volume":"18","author":"Garla","year":"2011","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"2020110612442174400_ocw159-B26","volume-title":"SSA State Agency Fiscal Year Workload Data","author":"Office of Retirement and Disability Policy"},{"key":"2020110612442174400_ocw159-B27","first-page":"17","article-title":"Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program","volume":"2001","author":"Aronson","journal-title":"Proc. AMIA Symp"},{"issue":"5","key":"2020110612442174400_ocw159-B28","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1006\/jbin.2001.1029","article-title":"A simple algorithm for identifying negated findings and diseases in discharge summaries","volume":"34","author":"Chapman","year":"2001","journal-title":"J. Biomed. Inform."},{"key":"2020110612442174400_ocw159-B29","volume-title":"Medical Subject Headings","author":"National Library of Medicine"},{"issue":"Database issue","key":"2020110612442174400_ocw159-B30","doi-asserted-by":"crossref","first-page":"D267","DOI":"10.1093\/nar\/gkh061","article-title":"The Unified Medical Language System (UMLS): integrating biomedical terminology","volume":"32","author":"Bodenreider","year":"2004","journal-title":"Nucleic Acids Res."},{"key":"2020110612442174400_ocw159-B31","volume-title":"GeneralConText Java Implementation v.1.0","author":"Solti"},{"key":"2020110612442174400_ocw159-B32","volume-title":"R: A Language and Environment for Statistical Computing","author":"R Core Team"},{"key":"2020110612442174400_ocw159-B33","volume-title":"Tableone: Create \u201cTable 1\u201d to Describe Baseline Characteristics","author":"Yoshida"},{"issue":"3","key":"2020110612442174400_ocw159-B34","first-page":"18","article-title":"Classification and regression by random Forest","volume":"2","author":"Liaw","year":"2002","journal-title":"R News."},{"issue":"4","key":"2020110612442174400_ocw159-B35","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1093\/bib\/bbr016","article-title":"Letter to the editor: On the stability and ranking of predictors from random forest variable importance measures","volume":"12","author":"Nicodemus","year":"2011","journal-title":"Briefings Bioinform."},{"key":"2020110612442174400_ocw159-B36","doi-asserted-by":"crossref","volume-title":"e1071: Misc Functions of the Department of Statistics, Probability Theory Group (Formerly: E1071), TU Wien","author":"Meyer","DOI":"10.32614\/CRAN.package.e1071"},{"key":"2020110612442174400_ocw159-B37","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1186\/1471-2105-12-77","article-title":"pROC: an open-source package for R and S+ to analyze and compare ROC curves","volume":"12","author":"Xavier","year":"2011","journal-title":"BMC Bioinformatics."},{"issue":"3","key":"2020110612442174400_ocw159-B38","doi-asserted-by":"crossref","first-page":"837","DOI":"10.2307\/2531595","article-title":"Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach","volume":"44","author":"DeLong","year":"1988","journal-title":"Biometrics."},{"issue":"1","key":"2020110612442174400_ocw159-B39","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1002\/1097-0142(1950)3:1<32::AID-CNCR2820030106>3.0.CO;2-3","article-title":"Index for rating diagnostic tests","volume":"3","author":"Youden","year":"1950","journal-title":"Cancer."}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/24\/4\/709\/34149276\/ocw159.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/24\/4\/709\/34149276\/ocw159.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,20]],"date-time":"2024-06-20T08:55:58Z","timestamp":1718873758000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/24\/4\/709\/2930515"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,1,19]]},"references-count":39,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2017,1,19]]},"published-print":{"date-parts":[[2017,7,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocw159","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2017,7]]},"published":{"date-parts":[[2017,1,19]]}}}