{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T23:24:35Z","timestamp":1780356275696,"version":"3.54.1"},"reference-count":53,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2016,10,5]],"date-time":"2016-10-05T00:00:00Z","timestamp":1475625600000},"content-version":"vor","delay-in-days":534,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2015,7,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Background As adoption of electronic health records continues to increase, there is an opportunity to incorporate clinical documentation as well as laboratory values and demographics into risk prediction modeling.<\/jats:p><jats:p>Objective The authors develop a risk prediction model for chronic kidney disease (CKD) progression from stage III to stage IV that includes longitudinal data and features drawn from clinical documentation.<\/jats:p><jats:p>Methods The study cohort consisted of 2908 primary-care clinic patients who had at least three visits prior to January 1, 2013 and developed CKD stage III during their documented history. Development and validation cohorts were randomly selected from this cohort and the study datasets included longitudinal inpatient and outpatient data from these populations. Time series analysis (Kalman filter) and survival analysis (Cox proportional hazards) were combined to produce a range of risk models. These models were evaluated using concordance, a discriminatory statistic.<\/jats:p><jats:p>Results A risk model incorporating longitudinal data on clinical documentation and laboratory test results (concordance 0.849) predicts progression from state III CKD to stage IV CKD more accurately when compared to a similar model without laboratory test results (concordance 0.733, P&amp;lt;.001), a model that only considers the most recent laboratory test results (concordance 0.819, P &amp;lt; .031) and a model based on estimated glomerular filtration rate (concordance 0.779, P &amp;lt; .001).<\/jats:p><jats:p>Conclusions A risk prediction model that takes longitudinal laboratory test results and clinical documentation into consideration can predict CKD progression from stage III to stage IV more accurately than three models that do not take all of these variables into consideration.<\/jats:p>","DOI":"10.1093\/jamia\/ocv024","type":"journal-article","created":{"date-parts":[[2015,4,21]],"date-time":"2015-04-21T02:02:05Z","timestamp":1429581725000},"page":"872-880","source":"Crossref","is-referenced-by-count":98,"title":["Risk prediction for chronic kidney disease progression using heterogeneous electronic health record data and time series analysis"],"prefix":"10.1093","volume":"22","author":[{"given":"Adler","family":"Perotte","sequence":"first","affiliation":[{"name":"Biomedical Informatics Department, Columbia University, New York, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rajesh","family":"Ranganath","sequence":"additional","affiliation":[{"name":"Computer Science Department, Princeton University, Princeton, NJ, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jamie S","family":"Hirsch","sequence":"additional","affiliation":[{"name":"Biomedical Informatics Department, Columbia University, New York, NY, USA"},{"name":"Division of Nephrology, Columbia University, New York, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Blei","sequence":"additional","affiliation":[{"name":"Statistics Department, Columbia University, New York, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"No\u00e9mie","family":"Elhadad","sequence":"additional","affiliation":[{"name":"Biomedical Informatics Department, Columbia University, New York, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2015,4,20]]},"reference":[{"key":"2020110613001520400_ocv024-B1","doi-asserted-by":"crossref","first-page":"e1001344","DOI":"10.1371\/journal.pmed.1001344","article-title":"Risk models to predict chronic kidney disease and its progression: a systematic review","volume":"9","author":"Echouffo-Tcheugui","year":"2012","journal-title":"PLoS Med."},{"key":"2020110613001520400_ocv024-B2","doi-asserted-by":"crossref","first-page":"596","DOI":"10.7326\/0003-4819-158-8-201304160-00004","article-title":"Risk prediction models for patients with chronic kidney disease: a systematic review","volume":"158","author":"Tangri","year":"2013","journal-title":"Ann Intern Med."},{"key":"2020110613001520400_ocv024-B3","doi-asserted-by":"crossref","first-page":"2038","DOI":"10.1001\/jama.298.17.2038","article-title":"Prevalence of chronic kidney disease in the United States","volume":"298","author":"Coresh","year":"2007","journal-title":"JAMA."},{"key":"2020110613001520400_ocv024-B4","doi-asserted-by":"crossref","first-page":"1296","DOI":"10.1056\/NEJMoa041031","article-title":"Chronic kidney disease and the risks of death, cardiovascular events, and hospitalization","volume":"351","author":"Go","year":"2004","journal-title":"N Engl J Med."},{"key":"2020110613001520400_ocv024-B5","doi-asserted-by":"crossref","first-page":"95","DOI":"10.2215\/CJN.06210909","article-title":"Adverse safety events in chronic kidney disease: the frequency of \u201cmultiple hits.\u201d","volume":"5","author":"Chapin","year":"2010","journal-title":"Clin J Am Soc Nephrol."},{"key":"2020110613001520400_ocv024-B6","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1053\/j.ajkd.2008.12.016","article-title":"CKD as an underrecognized threat to patient safety","volume":"53","author":"Fink","year":"2009","journal-title":"Am J Kidney Dis."},{"key":"2020110613001520400_ocv024-B7","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1186\/1471-2369-12-12","article-title":"Characterizing pre-dialysis care in the era of eGFR reporting: a cohort study","volume":"12","author":"Abdel-Kader","year":"2011","journal-title":"BMC Nephrol."},{"key":"2020110613001520400_ocv024-B8","doi-asserted-by":"crossref","first-page":"1061","DOI":"10.1053\/j.ajkd.2008.06.022","article-title":"Awareness and knowledge of clinical practice guidelines for CKD among internal medicine residents: a national online survey","volume":"52","author":"Agrawal","year":"2008","journal-title":"Am J Kidney Dis."},{"key":"2020110613001520400_ocv024-B9","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1053\/j.ajkd.2006.04.073","article-title":"Identification and referral of patients with progressive CKD: a national study","volume":"48","author":"Boulware","year":"2006","journal-title":"Am J Kidney Dis."},{"key":"2020110613001520400_ocv024-B10","doi-asserted-by":"crossref","first-page":"933","DOI":"10.5301\/jn.5000226","article-title":"Knowledge translation for nephrologists: strategies for improving the identification of patients with proteinuria","volume":"25","author":"Hemmelgarn","year":"2012","journal-title":"J Nephrol."},{"key":"2020110613001520400_ocv024-B11","doi-asserted-by":"crossref","first-page":"592","DOI":"10.1053\/j.ajkd.2010.08.029","article-title":"Impact of estimated GFR reporting on patients, clinicians, and health-care systems: a systematic review","volume":"57","author":"Kagoma","year":"2011","journal-title":"Am J Kidney Dis."},{"key":"2020110613001520400_ocv024-B12","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1186\/1471-2369-6-11","article-title":"Barriers to successful care for chronic kidney disease","volume":"6","author":"Lenz","year":"2005","journal-title":"BMC Nephrol"},{"key":"2020110613001520400_ocv024-B13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jcin.2013.06.016","article-title":"Contemporary incidence, predictors, and outcomes of acute kidney injury in patients undergoing percutaneous coronary interventions: insights from the NCDR Cath-PCI Registry","volume":"7","author":"Tsai","year":"2014","journal-title":"JACC Cardiovasc Interv."},{"key":"2020110613001520400_ocv024-B14","doi-asserted-by":"crossref","first-page":"S78","DOI":"10.1053\/j.ajkd.2008.07.051","article-title":"CKD screening and management in the Veterans Health Administration: the impact of system organization and an innovative electronic record","volume":"53","author":"Patel","year":"2009","journal-title":"Am J Kidney Dis."},{"key":"2020110613001520400_ocv024-B15","doi-asserted-by":"crossref","first-page":"S86","DOI":"10.1053\/j.ajkd.2008.07.052","article-title":"Implementing KDOQI CKD definition and staging guidelines in Southern California Kaiser Permanente","volume":"53","author":"Rutkowski","year":"2009","journal-title":"Am J Kidney Dis."},{"key":"2020110613001520400_ocv024-B16","first-page":"1","article-title":"Early referral strategies for management of people with markers of renal disease: a systematic review of the evidence of clinical effectiveness, cost-effectiveness and economic analysis","volume":"14","author":"Black","year":"2010","journal-title":"Heal Technol Assess."},{"key":"2020110613001520400_ocv024-B17","doi-asserted-by":"crossref","first-page":"760","DOI":"10.1016\/j.jbi.2009.08.007","article-title":"What can natural language processing do for clinical decision support?","volume":"42","author":"Demner-Fushman","year":"2009","journal-title":"J Biomed Inf"},{"key":"2020110613001520400_ocv024-B18","article-title":"NLP-derived information improves the estimates of risk of disease compared to estimates based on manually extracted data alone","author":"Callaghan"},{"key":"2020110613001520400_ocv024-B19","doi-asserted-by":"crossref","article-title":"Clinical decision support for colonoscopy surveillance using natural language processing","author":"Wagholikar","DOI":"10.1109\/HISB.2012.11"},{"key":"2020110613001520400_ocv024-B20","doi-asserted-by":"crossref","first-page":"833","DOI":"10.1136\/amiajnl-2012-000820","article-title":"Clinical decision support with automated text processing for cervical cancer screening","volume":"19","author":"Wagholikar","year":"2012","journal-title":"J Am Med Inform Assoc."},{"key":"2020110613001520400_ocv024-B21","first-page":"848","article-title":"Automated identification of postoperative complications within an electronic medical record using natural language processing","volume":"306","author":"Murff","year":"2011","journal-title":"JAMA."},{"key":"2020110613001520400_ocv024-B22","doi-asserted-by":"crossref","first-page":"11","DOI":"10.7326\/0003-4819-156-1-201201030-00003","article-title":"Comparison of natural language processing biosurveillance methods for identifying influenza from encounter notes","volume":"156","author":"Elkin","year":"2012","journal-title":"Ann Intern Med."},{"key":"2020110613001520400_ocv024-B23","doi-asserted-by":"crossref","first-page":"1411","DOI":"10.1097\/MIB.0b013e31828133fd","article-title":"Improving case definition of crohn\u2019s disease and ulcerative colitis in electronic medical records using natural language processing: a novel informatics approach","volume":"19","author":"Ananthakrishnan","year":"2013","journal-title":"Inflamm Bowel Dis."},{"key":"2020110613001520400_ocv024-B24","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1002\/pds.3418","article-title":"Natural language processing to identify pneumonia from radiology reports","volume":"22","author":"Dublin","year":"2013","journal-title":"Pharmacoepidemiol Drug Saf."},{"key":"2020110613001520400_ocv024-B25","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1186\/1472-6947-13-90","article-title":"Automated identification of pneumonia in chest radiograph reports in critically ill patients","volume":"13","author":"Liu","year":"2013","journal-title":"BMC Med Inform Decis Mak."},{"key":"2020110613001520400_ocv024-B26","doi-asserted-by":"crossref","first-page":"681","DOI":"10.7326\/0003-4819-122-9-199505010-00007","article-title":"Unlocking clinical data from narrative reports: a study of natural language processing","volume":"122","author":"Hripcsak","year":"1995","journal-title":"Ann Intern Med."},{"key":"2020110613001520400_ocv024-B27","first-page":"A12035","article-title":"Text and data mining of longitudinal electronic health records (EHRs) in a primary care population can identify heart failure (HF) patients months to years prior to formal diagnosis using the framingham criteria","volume":"124","author":"Steinhubl","year":"2011","journal-title":"Circulation."},{"key":"2020110613001520400_ocv024-B28","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1016\/j.cardfail.2014.03.008","article-title":"Prevalence of heart failure signs and symptoms in a large primary care population identified through the use of text and data mining of the electronic health record","volume":"20","author":"Vijayakrishnan","year":"2014","journal-title":"J Card Fail."},{"key":"2020110613001520400_ocv024-B29","doi-asserted-by":"crossref","first-page":"604","DOI":"10.7326\/0003-4819-150-9-200905050-00006","article-title":"A new equation to estimate glomerular filtration rate","volume":"150","author":"Levey","year":"2009","journal-title":"Ann Intern Med."},{"key":"2020110613001520400_ocv024-B30","first-page":"993","article-title":"Latent Dirichlet allocation","volume":"3","author":"Blei","year":"2003","journal-title":"J Mach Learn Res."},{"key":"2020110613001520400_ocv024-B31","doi-asserted-by":"crossref","first-page":"e87555","DOI":"10.1371\/journal.pone.0087555","article-title":"Redundancy-aware topic modeling for patient record notes","volume":"9","author":"Cohen","year":"2014","journal-title":"PLoS One."},{"key":"2020110613001520400_ocv024-B32","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1080\/00031305.1983.10482723","article-title":"Understanding the Kalman filter","volume":"37","author":"Meinhold","year":"1983","journal-title":"Am Stat."},{"key":"2020110613001520400_ocv024-B33","first-page":"35","article-title":"A new approach to linear filtering and prediction problems","volume":"82","author":"Kalman","year":"1960","journal-title":"J Fluids Eng."},{"key":"2020110613001520400_ocv024-B34","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/2200000001","article-title":"Graphical models, exponential families, and variational inference","volume":"1","author":"Wainwright","year":"2008","journal-title":"Found Trends Mach Learn."},{"key":"2020110613001520400_ocv024-B35","first-page":"1303","article-title":"Stochastic variational inference","volume":"14","author":"Hoffman","year":"2013","journal-title":"J Mach Learn Res."},{"key":"2020110613001520400_ocv024-B36","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1111\/j.2517-6161.1972.tb00899.x","article-title":"Regression models and life-tables","volume":"34","author":"Cox","year":"1972","journal-title":"J R Stat Soc Ser B."},{"key":"2020110613001520400_ocv024-B37","doi-asserted-by":"crossref","first-page":"2109","DOI":"10.1002\/sim.1802","article-title":"Overall C as a measure of discrimination in survival analysis: Model specific population value and confidence interval estimation","volume":"23","author":"Penciana","year":"2004","journal-title":"Stat Med."},{"key":"2020110613001520400_ocv024-B38","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1023\/A:1024068626366","article-title":"Inference for the generalization error","volume":"52","author":"Nadeau","year":"2003","journal-title":"Mach Learn."},{"key":"2020110613001520400_ocv024-B39","first-page":"65","article-title":"A Simple sequentially rejective multiple test procedure","volume":"6","author":"Holm","year":"1979","journal-title":"Scand J Stat"},{"key":"2020110613001520400_ocv024-B40","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1038\/ki.2008.261","article-title":"Gender differences in chronic kidney disease","volume":"74","author":"Iseki","year":"2008","journal-title":"Kidney Int."},{"key":"2020110613001520400_ocv024-B41","doi-asserted-by":"crossref","first-page":"1387","DOI":"10.1007\/s00125-006-0247-y","article-title":"Lower haemoglobin level and subsequent decline in kidney function in type 2 diabetic adults without clinical albuminuria","volume":"49","author":"Babazono","year":"2006","journal-title":"Diabetologia."},{"key":"2020110613001520400_ocv024-B42","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1093\/ndt\/gfi209","article-title":"Haemoglobin at time of referral prior to dialysis predicts survival: an association of haemoglobin with long-term outcomes","volume":"21","author":"Levin","year":"2006","journal-title":"Nephrol Dial Transplant."},{"key":"2020110613001520400_ocv024-B43","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1186\/1471-2369-14-92","article-title":"Re-evaluating the predictive roles of metabolic complications and clinical outcome according to eGFR levels \u2013 a four-years prospective cohort study in Taiwan","volume":"14","author":"Wu","year":"2013","journal-title":"BMC Nephrol."},{"key":"2020110613001520400_ocv024-B44","doi-asserted-by":"crossref","first-page":"e419","DOI":"10.1016\/j.archger.2011.12.010","article-title":"The prevalence and detection of chronic kidney disease (CKD)-related metabolic complications as a function of estimated glomerular filtration rate in the oldest old","volume":"54","author":"Pottelbergh","year":"2012","journal-title":"Arch Gerontol Geriatr."},{"key":"2020110613001520400_ocv024-B45","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1681\/ASN.2008020159","article-title":"Timing of onset of CKD-related metabolic complications","volume":"20","author":"Moranne","year":"2009","journal-title":"J Am Soc Nephrol."},{"key":"2020110613001520400_ocv024-B46","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1038\/sj.ki.5002009","article-title":"Prevalence of abnormal serum vitamin D, PTH, calcium, and phosphorus in patients with chronic kidney disease: results of the study to evaluate early kidney disease","volume":"71","author":"Levin","year":"2007","journal-title":"Kidney Int."},{"key":"2020110613001520400_ocv024-B47","doi-asserted-by":"crossref","first-page":"722","DOI":"10.1016\/j.ejim.2009.07.002","article-title":"eGFR and creatinine clearance in relation to metabolic changes in an unselected patient population","volume":"20","author":"Drion","year":"2009","journal-title":"Eur J Intern Med."},{"key":"2020110613001520400_ocv024-B48","doi-asserted-by":"crossref","first-page":"1192","DOI":"10.1038\/ki.2009.353","article-title":"Occurrence of adverse, often preventable, events in community hospitals involving nephrotoxic drugs or those excreted by the kidney","volume":"76","author":"Hug","year":"2009","journal-title":"Kidney Int."},{"key":"2020110613001520400_ocv024-B49","doi-asserted-by":"crossref","first-page":"479","DOI":"10.7326\/0003-4819-137-6-200209170-00007","article-title":"The timing of specialist evaluation in chronic kidney disease and mortality","volume":"137","author":"Kinchen","year":"2002","journal-title":"Ann Intern Med."},{"key":"2020110613001520400_ocv024-B50","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1038\/ki.2009.158","article-title":"When laboratories report estimated glomerular filtration rates in addition to serum creatinines, nephrology consults increase","volume":"76","author":"Jain","year":"2009","journal-title":"Kidney Int."},{"key":"2020110613001520400_ocv024-B51","doi-asserted-by":"crossref","first-page":"1151","DOI":"10.1001\/jama.2010.303","article-title":"Nephrology visits and health care resource use before and after reporting estimated glomerular filtration rate","volume":"303","author":"Hemmelgarn","year":"2010","journal-title":"JAMA."},{"key":"2020110613001520400_ocv024-B52","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/1471-2369-12-1","article-title":"Effect of primary care physicians\u2019 use of estimated glomerular filtration rate on the timing of their subspecialty referral decisions","volume":"12","author":"Greer","year":"2011","journal-title":"BMC Nephrol."},{"key":"2020110613001520400_ocv024-B53","first-page":"CD007333","article-title":"Early referral to specialist nephrology services for preventing the progression to end-stage kidney disease","volume":"6","author":"Smart","year":"2014","journal-title":"Cochrane Database Syst Rev."}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/22\/4\/872\/34145809\/ocv024.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/22\/4\/872\/34145809\/ocv024.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,8]],"date-time":"2024-06-08T14:15:20Z","timestamp":1717856120000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/22\/4\/872\/1746401"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,4,20]]},"references-count":53,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2015,4,20]]},"published-print":{"date-parts":[[2015,7,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocv024","relation":{},"ISSN":["1527-974X","1067-5027"],"issn-type":[{"value":"1527-974X","type":"electronic"},{"value":"1067-5027","type":"print"}],"subject":[],"published-other":{"date-parts":[[2015,7]]},"published":{"date-parts":[[2015,4,20]]}}}