{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T05:21:11Z","timestamp":1778822471098,"version":"3.51.4"},"reference-count":38,"publisher":"Oxford University Press (OUP)","issue":"9","license":[{"start":{"date-parts":[[2020,7,8]],"date-time":"2020-07-08T00:00:00Z","timestamp":1594166400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["U24TR002306"],"award-info":[{"award-number":["U24TR002306"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["UL1 TR002319"],"award-info":[{"award-number":["UL1 TR002319"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,9,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>The development of predictive models for clinical application requires the availability of electronic health record (EHR) data, which is complicated by patient privacy concerns. We showcase the \u201cModel to Data\u201d (MTD) approach as a new mechanism to make private clinical data available for the development of predictive models. Under this framework, we eliminate researchers\u2019 direct interaction with patient data by delivering containerized models to the EHR data.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We operationalize the MTD framework using the Synapse collaboration platform and an on-premises secure computing environment at the University of Washington hosting EHR data. Containerized mortality prediction models developed by a model developer, were delivered to the University of Washington via Synapse, where the models were trained and evaluated. Model performance metrics were returned to the model developer.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>The model developer was able to develop 3 mortality prediction models under the MTD framework using simple demographic features (area under the receiver-operating characteristic curve [AUROC], 0.693), demographics and 5 common chronic diseases (AUROC, 0.861), and the 1000 most common features from the EHR\u2019s condition\/procedure\/drug domains (AUROC, 0.921).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>We demonstrate the feasibility of the MTD framework to facilitate the development of predictive models on private EHR data, enabled by common data models and containerization software. We identify challenges that both the model developer and the health system information technology group encountered and propose future efforts to improve implementation.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>The MTD framework lowers the barrier of access to EHR data and can accelerate the development and evaluation of clinical prediction models.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocaa083","type":"journal-article","created":{"date-parts":[[2020,5,6]],"date-time":"2020-05-06T11:22:40Z","timestamp":1588764160000},"page":"1393-1400","source":"Crossref","is-referenced-by-count":10,"title":["Piloting a model-to-data approach to enable predictive analytics in health care through patient mortality prediction"],"prefix":"10.1093","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5614-8977","authenticated-orcid":false,"given":"Timothy","family":"Bergquist","sequence":"first","affiliation":[{"name":"Biomedical Informatics and Medical Education, University of Washington, Seattle, Washington, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yao","family":"Yan","sequence":"additional","affiliation":[{"name":"Molecular Engineering and Sciences Institute, University of Washington, Seattle, Washington, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas","family":"Schaffter","sequence":"additional","affiliation":[{"name":"Sage Bionetworks, Seattle, Washington, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas","family":"Yu","sequence":"additional","affiliation":[{"name":"Sage Bionetworks, Seattle, Washington, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vikas","family":"Pejaver","sequence":"additional","affiliation":[{"name":"Biomedical Informatics and Medical Education, University of Washington, Seattle, Washington, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Noah","family":"Hammarlund","sequence":"additional","affiliation":[{"name":"Biomedical Informatics and Medical Education, University of Washington, Seattle, Washington, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Justin","family":"Prosser","sequence":"additional","affiliation":[{"name":"Institute for Translational Health Sciences, University of Washington, Seattle, Washington, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Justin","family":"Guinney","sequence":"additional","affiliation":[{"name":"Biomedical Informatics and Medical Education, University of Washington, Seattle, Washington, USA"},{"name":"Sage Bionetworks, Seattle, Washington, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sean","family":"Mooney","sequence":"additional","affiliation":[{"name":"Biomedical Informatics and Medical Education, University of Washington, Seattle, Washington, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2020,7,8]]},"reference":[{"key":"2020110613115412200_ocaa083-B1","article-title":"Adoption of electronic health record systems among US non-federal acute care hospitals: 2008\u20132014","author":"Charles","journal-title":"ONC data brief"},{"key":"2020110613115412200_ocaa083-B2","volume-title":"Physician Motivations for Adoption of Electronic Health Records","author":"Heisey-Grove","year":"2014"},{"issue":"1","key":"2020110613115412200_ocaa083-B3","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1146\/annurev-publhealth-031914-122747","article-title":"Uses of electronic health records for public health surveillance to advance public health","volume":"36","author":"Birkhead","year":"2015","journal-title":"Annu Rev Public Health"},{"issue":"1","key":"2020110613115412200_ocaa083-B4","doi-asserted-by":"crossref","first-page":"48","DOI":"10.7326\/M13-1531","article-title":"Health information technology: an updated systematic review with a focus on meaningful use","volume":"160","author":"Jones","year":"2014","journal-title":"Ann Intern Med"},{"issue":"10","key":"2020110613115412200_ocaa083-B5","doi-asserted-by":"crossref","first-page":"1419","DOI":"10.1093\/jamia\/ocy068","article-title":"Opportunities and challenges in developing deep learning models using electronic health records data: a systematic review","volume":"25","author":"Xiao","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"6","key":"2020110613115412200_ocaa083-B6","doi-asserted-by":"crossref","first-page":"1236","DOI":"10.1093\/bib\/bbx044","article-title":"Deep learning for healthcare: review, opportunities and challenges","volume":"19","author":"Miotto","year":"2018","journal-title":"Brief Bioinform"},{"issue":"2","key":"2020110613115412200_ocaa083-B7","doi-asserted-by":"crossref","first-page":"e0211057","DOI":"10.1371\/journal.pone.0211057","article-title":"An attention based deep learning model of clinical events in the intensive care unit","volume":"14","author":"Kaji","year":"2019","journal-title":"PLoS One"},{"key":"2020110613115412200_ocaa083-B8","doi-asserted-by":"publisher","DOI":"10.1186\/s40537-017-0110-7","article-title":"Big healthcare data: preserving security and privacy","volume":"5","author":"Abouelmehdi","year":"2018","journal-title":"J Big Data"},{"issue":"1","key":"2020110613115412200_ocaa083-B9","first-page":"1057","article-title":"Data governance and data sharing agreements for community-wide health information exchange: lessons from the beacon communities","volume":"2","author":"Allen","year":"2014","journal-title":"EGEMS (Wash DC)"},{"key":"2020110613115412200_ocaa083-B10","doi-asserted-by":"crossref","first-page":"969","DOI":"10.1093\/jamia\/ocy032","article-title":"Design and implementation of a standardized framework to generate and evaluate patient-level prediction models using observational healthcare data","volume":"25","author":"Reps","year":"2018","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613115412200_ocaa083-B11","first-page":"574","article-title":"Observational Health Data Sciences and Informatics (OHDSI): opportunities for observational researchers","volume":"216","author":"Hripcsak","year":"2015","journal-title":"Stud Health Technol Inform"},{"issue":"2","key":"2020110613115412200_ocaa083-B12","doi-asserted-by":"crossref","first-page":"e0212463","DOI":"10.1371\/journal.pone.0212463","article-title":"Data model harmonization for the All Of Us Research Program: Transforming i2b2 data into the OMOP common data model","volume":"14","author":"Klann","year":"2019","journal-title":"PLoS One"},{"key":"2020110613115412200_ocaa083-B13","doi-asserted-by":"publisher","DOI":"10.6028\/NIST.IR.8053","volume-title":"De-Identification of Personal Information","author":"Garfinkel","year":"2015"},{"key":"2020110613115412200_ocaa083-B14","volume-title":"Trail re-identification: learning who you are from where you have been","author":"Malin","year":"2003"},{"issue":"3","key":"2020110613115412200_ocaa083-B15","doi-asserted-by":"crossref","first-page":"e28","DOI":"10.2196\/medinform.5909","article-title":"Prediction of sepsis in the intensive care unit with minimal electronic health record data: a machine learning approach","volume":"4","author":"Desautels","year":"2016","journal-title":"JMIR Med Inform"},{"key":"2020110613115412200_ocaa083-B16","author":"Choi","year":"2017"},{"issue":"1","key":"2020110613115412200_ocaa083-B17","doi-asserted-by":"crossref","first-page":"160035","DOI":"10.1038\/sdata.2016.35","article-title":"MIMIC-III, a freely accessible critical care database","volume":"3","author":"Johnson","year":"2016","journal-title":"Sci Data"},{"issue":"5","key":"2020110613115412200_ocaa083-B18","first-page":"716","article-title":"Are synthetic data derivatives the future of translational medicine?","volume":"3","author":"Foraker","year":"2018","journal-title":"J Am Coll Cardiol Basic Trans Science"},{"key":"2020110613115412200_ocaa083-B19","first-page":"1176","article-title":"Design and validation of a data simulation model for longitudinal healthcare data","volume":"2011","author":"Murray","year":"2011","journal-title":"AMIA Annu Symp Proc"},{"key":"2020110613115412200_ocaa083-B20","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1093\/jamia\/ocx079","article-title":"Synthea: An approach, method, and software mechanism for generating synthetic patients and the synthetic electronic health care record","volume":"25","author":"Walonoski","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"2020110613115412200_ocaa083-B21","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1038\/nbt.4128","article-title":"Alternative models for sharing confidential biomedical data","volume":"36","author":"Guinney","year":"2018","journal-title":"Nat Biotechnol"},{"key":"2020110613115412200_ocaa083-B22","author":"Docker","year":"2019"},{"key":"2020110613115412200_ocaa083-B23","author":"Sylabs.io. Singularity","year":"2019"},{"issue":"1","key":"2020110613115412200_ocaa083-B24","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1186\/s13059-019-1794-0","article-title":"Reproducible biomedical benchmarking in the cloud: lessons from crowd-sourced data challenges","volume":"20","author":"Ellrott","year":"2019","journal-title":"Genome Biol"},{"key":"2020110613115412200_ocaa083-B25","first-page":"460","article-title":"An interpretable ICU mortality prediction model based on logistic regression and recurrent neural networks with LSTM units","volume":"2018","author":"Ge","year":"2018","journal-title":"AMIA Annu Symp Proc"},{"key":"2020110613115412200_ocaa083-B26","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1186\/s12911-018-0677-8","article-title":"Improving palliative care with deep learning","volume":"18 (Suppl 4","author":"Avati","year":"2018","journal-title":"BMC Med Inform Decis Mak"},{"issue":"1","key":"2020110613115412200_ocaa083-B27","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1093\/jamia\/ocw042","article-title":"Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic review","volume":"24","author":"Goldstein","year":"2017","journal-title":"J Am Med Inform Assoc"},{"issue":"8","key":"2020110613115412200_ocaa083-B28","doi-asserted-by":"crossref","first-page":"470","DOI":"10.1038\/nrg.2016.69","article-title":"Crowdsourcing biomedical research: leveraging communities as innovation engines","volume":"17","author":"Saez-Rodriguez","year":"2016","journal-title":"Nat Rev Genet"},{"issue":"10","key":"2020110613115412200_ocaa083-B29","doi-asserted-by":"crossref","first-page":"1121","DOI":"10.1038\/ng.2761","article-title":"Enabling transparent and collaborative computational analysis of 12 tumor types within The Cancer Genome Atlas","volume":"45","author":"Omberg","year":"2013","journal-title":"Nat Genet"},{"key":"2020110613115412200_ocaa083-B30","author":"Lambert","year":"2016"},{"issue":"3","key":"2020110613115412200_ocaa083-B31","doi-asserted-by":"crossref","first-page":"e0214365","DOI":"10.1371\/journal.pone.0214365","article-title":"Prediction of premature all-cause mortality: A prospective general population cohort study comparing machine-learning and standard epidemiological approaches","volume":"14","author":"Weng","year":"2019","journal-title":"PLoS One"},{"issue":"4","key":"2020110613115412200_ocaa083-B32","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1136\/amiajnl-2014-002747","article-title":"Launching PCORnet, a national patient-centered clinical research network","volume":"21","author":"Fleurence","year":"2014","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"2020110613115412200_ocaa083-B33","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1136\/jamia.2009.000893","article-title":"Serving the enterprise and beyond with informatics for integrating biology and the bedside (i2b2)","volume":"17","author":"Murphy","year":"2010","journal-title":"J Am Med Inform Assoc"},{"issue":"3","key":"2020110613115412200_ocaa083-B34","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1038\/nmeth.2340","article-title":"A large-scale evaluation of computational protein function prediction","volume":"10","author":"Radivojac","year":"2013","journal-title":"Nat Methods"},{"issue":"1","key":"2020110613115412200_ocaa083-B35","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1186\/s13059-016-1037-6","article-title":"An expanded evaluation of protein function prediction methods shows an improvement in accuracy","volume":"17","author":"Jiang","year":"2016","journal-title":"Genome Biol"},{"issue":"9","key":"2020110613115412200_ocaa083-B36","doi-asserted-by":"crossref","first-page":"1266","DOI":"10.1002\/humu.23265","article-title":"Matching phenotypes to whole genomes: Lessons learned from 4 iterations of the personal genome project community challenges","volume":"38","author":"Cai","year":"2017","journal-title":"Hum Mutat"},{"issue":"3","key":"2020110613115412200_ocaa083-B37","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1016\/j.sbi.2005.05.011","article-title":"A decade of CASP: progress, bottlenecks and prognosis in protein structure prediction","volume":"15","author":"Moult","year":"2005","journal-title":"Curr Opin Struct Biol"},{"key":"2020110613115412200_ocaa083-B38","author":"He","year":"2019"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/9\/1393\/34153699\/ocaa083.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/9\/1393\/34153699\/ocaa083.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T19:37:56Z","timestamp":1604691476000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/27\/9\/1393\/5868591"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,8]]},"references-count":38,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2020,7,8]]},"published-print":{"date-parts":[[2020,9,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocaa083","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,9]]},"published":{"date-parts":[[2020,7,8]]}}}