{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T07:48:26Z","timestamp":1791877706354,"version":"4.3.4"},"reference-count":44,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2020,11,23]],"date-time":"2020-11-23T00:00:00Z","timestamp":1606089600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["1418504"],"award-info":[{"award-number":["1418504"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","award":["R01HG006844"],"award-info":[{"award-number":["R01HG006844"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","award":["U2COD023196"],"award-info":[{"award-number":["U2COD023196"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,3,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>Simulating electronic health record data offers an opportunity to resolve the tension between data sharing and patient privacy. Recent techniques based on generative adversarial networks have shown promise but neglect the temporal aspect of healthcare. We introduce a generative framework for simulating the trajectory of patients\u2019 diagnoses and measures to evaluate utility and privacy.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and Methods<\/jats:title>\n                    <jats:p>The framework simulates date-stamped diagnosis sequences based on a 2-stage process that 1) sequentially extracts temporal patterns from clinical visits and 2) generates synthetic data conditioned on the learned patterns. We designed 3 utility measures to characterize the extent to which the framework maintains feature correlations and temporal patterns in clinical events. We evaluated the framework with billing codes, represented as phenome-wide association study codes (phecodes), from over 500\u00a0000 Vanderbilt University Medical Center electronic health records. We further assessed the privacy risks based on membership inference and attribute disclosure attacks.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The simulated temporal sequences exhibited similar characteristics to real sequences on the utility measures. Notably, diagnosis prediction models based on real versus synthetic temporal data exhibited an average relative difference in area under the ROC curve of 1.6% with standard deviation of 3.8% for 1276 phecodes. Additionally, the relative difference in the mean occurrence age and time between visits were 4.9% and 4.2%, respectively. The privacy risks in synthetic data, with respect to the membership and attribute inference were negligible.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>This investigation indicates that temporal diagnosis code sequences can be simulated in a manner that provides utility and respects privacy.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/jamia\/ocaa262","type":"journal-article","created":{"date-parts":[[2020,10,6]],"date-time":"2020-10-06T15:15:36Z","timestamp":1601997336000},"page":"596-604","source":"Crossref","is-referenced-by-count":59,"title":["SynTEG: a framework for temporal structured electronic health data simulation"],"prefix":"10.1093","volume":"28","author":[{"given":"Ziqi","family":"Zhang","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, Tennessee, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chao","family":"Yan","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, Tennessee, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2300-9529","authenticated-orcid":false,"given":"Thomas A","family":"Lasko","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jimeng","family":"Sun","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Illinois Urbana-Champaign, Champaign, Illinois, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bradley A","family":"Malin","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, Tennessee, USA"},{"name":"Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, USA"},{"name":"Department of Biostatistics, Vanderbilt University Medical Center, Nashville, Tennessee, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2020,11,23]]},"reference":[{"issue":"8","key":"2021030612202250900_ocaa262-B1","doi-asserted-by":"crossref","first-page":"1416","DOI":"10.1377\/hlthaff.2016.1651","article-title":"HITECH drove large gains in hospital electronic health record adoption","volume":"36","author":"Adler-Milstein","year":"2017","journal-title":"Health Aff (Millwood)"},{"issue":"01","key":"2021030612202250900_ocaa262-B2","doi-asserted-by":"crossref","first-page":"38","DOI":"10.15265\/IY-2017-007","article-title":"Clinical data reuse and or secondary use: current status and potential future directions","volume":"26","author":"Meystre","year":"2017","journal-title":"Yearb Med Inform"},{"issue":"6","key":"2021030612202250900_ocaa262-B3","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1038\/nrg3208","article-title":"Mining electronic health records: towards better research applications and clinical care","volume":"13","author":"Jensen","year":"2012","journal-title":"Nat Rev Genet"},{"issue":"1","key":"2021030612202250900_ocaa262-B4","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1146\/annurev-publhealth-032315-021353","article-title":"Using electronic health records for population health research: a review of methods and applications","volume":"37","author":"Casey","year":"2016","journal-title":"Annu Rev Public Health"},{"issue":"6","key":"2021030612202250900_ocaa262-B5","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1038\/nrg2999","article-title":"Using electronic health records to drive discovery in disease genomics","volume":"12","author":"Kohane","year":"2011","journal-title":"Nat Rev Genet"},{"issue":"79","key":"2021030612202250900_ocaa262-B6","doi-asserted-by":"crossref","first-page":"79re1","DOI":"10.1126\/scitranslmed.3001807","article-title":"Electronic medical records for genetic research: results of the eMERGE Consortium","volume":"3","author":"Kho","year":"2011","journal-title":"Sci Transl Med"},{"key":"2021030612202250900_ocaa262-B7","year":"2012"},{"key":"2021030612202250900_ocaa262-B8","first-page":"1","year":"2016"},{"key":"2021030612202250900_ocaa262-B9","author":"Meingast"},{"issue":"7","key":"2021030612202250900_ocaa262-B10","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1097\/GIM.0b013e31817a8aaa","article-title":"Confidentiality, privacy, and security of genetic and genomic test information in electronic health records: points to consider","volume":"10","author":"Mcguire","year":"2008","journal-title":"Genet Med"},{"issue":"3","key":"2021030612202250900_ocaa262-B11","first-page":"1560","article-title":"Privacy and security in the era of digital health: what should translational researchers know and do about it?","volume":"8","author":"Filkins","year":"2016","journal-title":"Am J Transl Res"},{"issue":"4","key":"2021030612202250900_ocaa262-B12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1749603.1749605","article-title":"Privacy-preserving data publishing","volume":"42","author":"Fung","year":"2010","journal-title":"ACM Comput Surv"},{"issue":"1","key":"2021030612202250900_ocaa262-B13","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1136\/amiajnl-2012-001047","article-title":"Toward practicing privacy","volume":"20","author":"Dwork","year":"2013","journal-title":"J Am Med Inform Assoc"},{"key":"2021030612202250900_ocaa262-B14","author":"Brickell"},{"issue":"2","key":"2021030612202250900_ocaa262-B15","first-page":"181","article-title":"Inference for partially synthetic, public use microdata sets","volume":"29","author":"Reiter","year":"2003","journal-title":"Surv Methodol"},{"issue":"1","key":"2021030612202250900_ocaa262-B16","first-page":"1","article-title":"Multiple imputation for statistical disclosure limitation","volume":"19","author":"Raghunathan","year":"2003","journal-title":"J Off Stat"},{"issue":"5","key":"2021030612202250900_ocaa262-B17","doi-asserted-by":"crossref","first-page":"1181","DOI":"10.3390\/s19051181","article-title":"SynSys: A synthetic data generation system for healthcare applications","volume":"19","author":"Dahmen","year":"2019","journal-title":"Sensors (Basel)"},{"issue":"141","key":"2021030612202250900_ocaa262-B18","doi-asserted-by":"crossref","first-page":"20170387","DOI":"10.1098\/rsif.2017.0387","article-title":"Opportunities and obstacles for deep learning in biology and medicine","volume":"15","author":"Ching","year":"2018","journal-title":"J R Soc Interface"},{"issue":"3","key":"2021030612202250900_ocaa262-B19","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1001\/jamainternmed.2018.7117","article-title":"Deep learning in medicine\u2014promise, progress, and challenges","volume":"179","author":"Wang","year":"2019","journal-title":"JAMA Intern Med"},{"key":"2021030612202250900_ocaa262-B20","author":"Goodfellow"},{"key":"2021030612202250900_ocaa262-B21","author":"Fedus","year":"2018"},{"key":"2021030612202250900_ocaa262-B22","author":"Engel","year":"2019"},{"issue":"2","key":"2021030612202250900_ocaa262-B23","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1038\/s42256-019-0017-4","article-title":"Feedback GAN for DNA optimizes protein functions","volume":"1","author":"Gupta","year":"2019","journal-title":"Nat Mach Intell"},{"issue":"1","key":"2021030612202250900_ocaa262-B24","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1093\/jamia\/ocz161","article-title":"Ensuring electronic medical record simulation through better training, modeling, and evaluation","volume":"27","author":"Zhang","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"2021030612202250900_ocaa262-B25","author":"Choi"},{"key":"2021030612202250900_ocaa262-B26","author":"Yan","year":"17, 2020;"},{"issue":"3","key":"2021030612202250900_ocaa262-B27","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1093\/jamia\/ocy142","article-title":"Synthesizing electronic health records using improved generative adversarial networks","volume":"26","author":"Baowaly","year":"2019","journal-title":"J Am Med Inform Assoc"},{"key":"2021030612202250900_ocaa262-B28","author":"Ma"},{"key":"2021030612202250900_ocaa262-B29","author":"Lipton","year":"2015"},{"key":"2021030612202250900_ocaa262-B30","author":"Choi"},{"key":"2021030612202250900_ocaa262-B31","author":"Pham"},{"issue":"1","key":"2021030612202250900_ocaa262-B32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/srep26094","article-title":"Deep patient: an unsupervised representation to predict the future of patients from the electronic health records","volume":"6","author":"Miotto","year":"2016","journal-title":"Sci Rep"},{"key":"2021030612202250900_ocaa262-B33","author":"Cheng"},{"key":"2021030612202250900_ocaa262-B34","author":"Metz","year":"2017"},{"key":"2021030612202250900_ocaa262-B35","author":"Dumoulin","year":"2016"},{"key":"2021030612202250900_ocaa262-B36","author":"Berthelot","year":"2017"},{"key":"2021030612202250900_ocaa262-B37","author":"Mao"},{"key":"2021030612202250900_ocaa262-B38","author":"Arjovsky","year":"2017"},{"key":"2021030612202250900_ocaa262-B39","author":"Heusel"},{"key":"2021030612202250900_ocaa262-B40","author":"Gulrajani"},{"key":"2021030612202250900_ocaa262-B41","author":"Vaswani"},{"key":"2021030612202250900_ocaa262-B42","first-page":"392","author":"Chakravarty","year":"1967"},{"issue":"12","key":"2021030612202250900_ocaa262-B43","doi-asserted-by":"crossref","first-page":"1102","DOI":"10.1038\/nbt.2749","article-title":"Systematic comparison of phenome-wide association study of electronic medical record data and genome-wide association study data","volume":"31","author":"Denny","year":"2013","journal-title":"Nat Biotechnol"},{"issue":"7","key":"2021030612202250900_ocaa262-B44","doi-asserted-by":"crossref","first-page":"e0175508","DOI":"10.1371\/journal.pone.0175508","article-title":"Evaluating phecodes, clinical classification software, and ICD-9-CM codes for phenome-wide association studies in the electronic health record","volume":"12","author":"Wei","year":"2017","journal-title":"PLoS One"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/3\/596\/36428712\/ocaa262.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/3\/596\/36428712\/ocaa262.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,6]],"date-time":"2021-03-06T07:20:49Z","timestamp":1615015249000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/28\/3\/596\/6024632"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,23]]},"references-count":44,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2020,11,23]]},"published-print":{"date-parts":[[2021,3,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocaa262","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,3,1]]},"published":{"date-parts":[[2020,11,23]]}}}