{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,28]],"date-time":"2026-03-28T17:16:07Z","timestamp":1774718167762,"version":"3.50.1"},"reference-count":86,"publisher":"Oxford University Press (OUP)","issue":"7","license":[{"start":{"date-parts":[[2021,3,13]],"date-time":"2021-03-13T00:00:00Z","timestamp":1615593600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01LM011369-06"],"award-info":[{"award-number":["R01LM011369-06"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,7,14]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>To propose a paradigm for a scalable time-aware clinical data search, and to describe the design, implementation and use of a search engine realizing this paradigm.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>The Advanced Cohort Engine (ACE) uses a temporal query language and in-memory datastore of patient objects to provide a fast, scalable, and expressive time-aware search. ACE accepts data in the Observational Medicine Outcomes Partnership Common Data Model, and is configurable to balance performance with compute cost. ACE\u2019s temporal query language supports automatic query expansion using clinical knowledge graphs. The ACE API can be used with R, Python, Java, HTTP, and a Web UI.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>ACE offers an expressive query language for complex temporal search across many clinical data types with multiple output options. ACE enables electronic phenotyping and cohort-building with subsecond response times in searching the data of millions of patients for a variety of use cases.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>ACE enables fast, time-aware search using a patient object-centric datastore, thereby overcoming many technical and design shortcomings of relational algebra-based querying. Integrating electronic phenotype development with cohort-building enables a variety of high-value uses for a learning health system. Tradeoffs include the need to learn a new query language and the technical setup burden.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>ACE is a tool that combines a unique query language for time-aware search of longitudinal patient records with a patient object datastore for rapid electronic phenotyping, cohort extraction, and exploratory data analyses.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocab027","type":"journal-article","created":{"date-parts":[[2021,2,24]],"date-time":"2021-02-24T12:19:42Z","timestamp":1614169182000},"page":"1468-1479","source":"Crossref","is-referenced-by-count":18,"title":["ACE: the Advanced Cohort Engine for searching longitudinal patient records"],"prefix":"10.1093","volume":"28","author":[{"given":"Alison","family":"Callahan","sequence":"first","affiliation":[{"name":"Center for Biomedical Informatics Research, School of Medicine, School of Medicine, Stanford University, Stanford, California, USA"}]},{"given":"Vladimir","family":"Polony","sequence":"additional","affiliation":[{"name":"Center for Biomedical Informatics Research, School of Medicine, School of Medicine, Stanford University, Stanford, California, USA"}]},{"given":"Jos\u00e9 D","family":"Posada","sequence":"additional","affiliation":[{"name":"Center for Biomedical Informatics Research, School of Medicine, School of Medicine, Stanford University, Stanford, California, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8499-824X","authenticated-orcid":false,"given":"Juan M","family":"Banda","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Georgia State University, Atlanta, Georgia, USA"}]},{"given":"Saurabh","family":"Gombar","sequence":"additional","affiliation":[{"name":"Department of Pathology, School of Medicine, Stanford University, Stanford, California, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9385-7158","authenticated-orcid":false,"given":"Nigam H","family":"Shah","sequence":"additional","affiliation":[{"name":"Center for Biomedical Informatics Research, School of Medicine, School of Medicine, Stanford University, Stanford, California, USA"}]}],"member":"286","published-online":{"date-parts":[[2021,3,13]]},"reference":[{"issue":"8_Part_2","key":"2021071421220862200_ocab027-B1","doi-asserted-by":"crossref","first-page":"733","DOI":"10.7326\/0003-4819-127-8_Part_2-199710151-00059","article-title":"Process-based measures of quality: the need for detailed clinical data in large health care databases","volume":"127","author":"Palmer","year":"1997","journal-title":"Ann Intern Med"},{"issue":"7","key":"2021071421220862200_ocab027-B2","doi-asserted-by":"crossref","first-page":"1229","DOI":"10.1377\/hlthaff.2014.0099","article-title":"A \u2018green button\u2019 for using aggregate patient data at the point of care","volume":"33","author":"Longhurst","year":"2014","journal-title":"Health Aff"},{"key":"2021071421220862200_ocab027-B3","doi-asserted-by":"publisher","first-page":"7329","DOI":"10.1073\/pnas.1510502113","article-title":"Characterizing treatment pathways at scale using the OHDSI network","volume":"6","author":"Hripcsak","year":"2016","journal-title":"Proc Natl Acad Sci USA"},{"issue":"5","key":"2021071421220862200_ocab027-B4","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1016\/0010-4809(69)90012-3","article-title":"Design and implementation of a clinical data management system","volume":"2","author":"Greenes","year":"1969","journal-title":"Comput Biomed Res"},{"issue":"3","key":"2021071421220862200_ocab027-B5","first-page":"144","article-title":"ClinQuery: searching a large clinical database","volume":"7","author":"Safran","year":"1990","journal-title":"MD Comput"},{"key":"2021071421220862200_ocab027-B6","first-page":"941","article-title":"EMERSE: the Electronic Medical Record Search Engine","volume":"2006","author":"Hanauer","year":"2006","journal-title":"AMIA Annu Symp Proc"},{"key":"2021071421220862200_ocab027-B7","author":"Li"},{"key":"2021071421220862200_ocab027-B8","first-page":"1174","article-title":"Visual query tool for finding patient cohorts from a clinical data warehouse of the partners HealthCare system","volume":"2000","author":"Murphy","year":"2000","journal-title":"Proc AMIA Symp"},{"issue":"1","key":"2021071421220862200_ocab027-B9","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1136\/amiajnl-2012-001050","article-title":"Identifying clinical\/translational research cohorts: ascertainment via querying an integrated multi-source database","volume":"20","author":"Hurdle","year":"2013","journal-title":"J Am Med Inform Assoc"},{"key":"2021071421220862200_ocab027-B10","first-page":"1685","article-title":"Facilitating cohort discovery by enhancing ontology exploration, query management and query sharing for large clinical data repositories","volume":"2017","author":"Tao","year":"2017","journal-title":"AMIA Annu Symp Proc"},{"issue":"1","key":"2021071421220862200_ocab027-B11","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1186\/s12911-018-0682-y","article-title":"X-search: an open access interface for cross-cohort exploration of the National Sleep Research Resource","volume":"18","author":"Cui","year":"2018","journal-title":"BMC Med Inform Decis Mak"},{"key":"2021071421220862200_ocab027-B12","first-page":"147","article-title":"Toward cross-platform electronic health record -driven phenotyping using Clinical Quality Language","volume":"2015","author":"Brandt","year":"2020","journal-title":"Learn Health Sys"},{"issue":"1","key":"2021071421220862200_ocab027-B13","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1093\/jamia\/ocz165","article-title":"Leaf: an open-source, model-agnostic, data-driven web application for cohort discovery and translational biomedical research","volume":"27","author":"Dobbins","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"2021071421220862200_ocab027-B14","year":"2020"},{"issue":"e1","key":"2021071421220862200_ocab027-B15","doi-asserted-by":"crossref","first-page":"e60","DOI":"10.1136\/amiajnl-2011-000133","article-title":"Implementation of a deidentified federated data network for population-based cohort discovery","volume":"19","author":"Anderson","year":"2012","journal-title":"J Am Med Inform Assoc"},{"key":"2021071421220862200_ocab027-B16","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1016\/j.jbi.2014.07.006","article-title":"Modular design, application architecture, and usage of a self-service model for enterprise data delivery: the Duke Enterprise Data Unified Content Explorer (DEDUCE)","volume":"52","author":"Horvath","year":"2014","journal-title":"J Biomed Inform"},{"issue":"3","key":"2021071421220862200_ocab027-B17","doi-asserted-by":"crossref","first-page":"e010579","DOI":"10.1136\/bmjopen-2015-010579","article-title":"EHDViz: clinical dashboard development using open-source technologies","volume":"6","author":"Badgeley","year":"2016","journal-title":"BMJ Open"},{"key":"2021071421220862200_ocab027-B18","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.jbi.2018.02.019","article-title":"A clinician friendly data warehouse oriented toward narrative reports: Dr. Warehouse","volume":"80","author":"Garcelon","year":"2018","journal-title":"J Biomed Inform"},{"issue":"e1","key":"2021071421220862200_ocab027-B19","doi-asserted-by":"crossref","first-page":"e68","DOI":"10.1136\/amiajnl-2011-000115","article-title":"The design and implementation of an open-source, data-driven cohort recruitment system: the Duke Integrated Subject Cohort and Enrollment Research Network (DISCERN)","volume":"19","author":"Ferranti","year":"2012","journal-title":"J Am Med Inform Assoc"},{"issue":"01","key":"2021071421220862200_ocab027-B20","doi-asserted-by":"crossref","first-page":"41","DOI":"10.3414\/ME13-02-0027","article-title":"An eligibility criteria query language for heterogeneous data warehouses","volume":"54","author":"Bache","year":"2015","journal-title":"Methods Inf Med"},{"key":"2021071421220862200_ocab027-B21","first-page":"391","article-title":"STRIDE\u2013An integrated standards-based translational research informatics platform","volume":"2009","author":"Lowe","year":"2009","journal-title":"AMIA Annu Symp Proc"},{"issue":"2","key":"2021071421220862200_ocab027-B22","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1136\/jamia.2009.000893","article-title":"Serving the enterprise and beyond with informatics for integrating biology and the bedside (i2b2)","volume":"17","author":"Murphy","year":"2010","journal-title":"J Am Med Inform Assoc"},{"key":"2021071421220862200_ocab027-B23","author":"Shah","year":"2020"},{"issue":"1","key":"2021071421220862200_ocab027-B24","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1186\/s12911-017-0515-4","article-title":"Examining database persistence of ISO\/EN 13606 standardized electronic health record extracts: relational vs. NoSQL approaches","volume":"17","author":"S\u00e1nchez-de-Madariaga","year":"2017","journal-title":"BMC Med Inform Decis Mak"},{"issue":"4","key":"2021071421220862200_ocab027-B25","doi-asserted-by":"crossref","first-page":"e181755","DOI":"10.1001\/jamanetworkopen.2018.1755","article-title":"Association of hemoglobin A1c levels with use of sulfonylureas, dipeptidyl peptidase 4 inhibitors, and thiazolidinediones in patients with type 2 diabetes treated with metformin: analysis from the observational health data sciences and informatics initiative","volume":"1","author":"Vashisht","year":"2018","journal-title":"JAMA Netw Open"},{"key":"2021071421220862200_ocab027-B26"},{"key":"2021071421220862200_ocab027-B27","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4615-2289-8","volume-title":"The TSQL2 Temporal Query Language","author":"Snodgrass","year":"1995"},{"issue":"04","key":"2021071421220862200_ocab027-B28","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1055\/s-0038-1635036","article-title":"A temporal query system for protocol-directed decision support","volume":"33","author":"Das","year":"1994","journal-title":"Methods Inf Med"},{"issue":"2","key":"2021071421220862200_ocab027-B29","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1136\/jamia.2000.0070152","article-title":"Temporal expressiveness in querying a time-stamp\u2013based clinical database","volume":"7","author":"Nigrin","year":"2000","journal-title":"J Am Med Inform Assoc"},{"key":"2021071421220862200_ocab027-B30","first-page":"567","article-title":"The Chronus II temporal database mediator","volume":"2002","author":"O\u2019Connor","year":"2002","journal-title":"Proc AMIA Symp"},{"key":"2021071421220862200_ocab027-B31","first-page":"603","article-title":"Abstraction-based temporal data retrieval for a Clinical Data Repository","volume":"2007","author":"Post","year":"2007","journal-title":"AMIA Annu Symp Proc"},{"key":"2021071421220862200_ocab027-B32","first-page":"601","article-title":"Searching electronic health records for temporal patterns in patient histories: a case study with microsoft amalga","volume":"2008","author":"Plaisant","year":"2008","journal-title":"AMIA Annu Symp Proc"},{"issue":"2","key":"2021071421220862200_ocab027-B33","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1109\/4233.640654","article-title":"Applying object-oriented technologies in modeling and querying temporally oriented clinical databases dealing with temporal granularity and indeterminacy","volume":"1","author":"Combi","year":"1997","journal-title":"IEEE Trans Inform Technol Biomed"},{"issue":"7","key":"2021071421220862200_ocab027-B34","doi-asserted-by":"crossref","first-page":"1046","DOI":"10.1093\/jamia\/ocaa058","article-title":"Time event ontology (TEO): to support semantic representation and reasoning of complex temporal relations of clinical events","volume":"27","author":"Li","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"2021071421220862200_ocab027-B35","author":"Fries"},{"issue":"5","key":"2021071421220862200_ocab027-B36","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1136\/jamia.2009.001560","article-title":"Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applications","volume":"17","author":"Savova","year":"2010","journal-title":"J Am Med Inform Assoc"},{"key":"2021071421220862200_ocab027-B37","first-page":"542","article-title":"Identification of suspected tuberculosis patients based on natural language processing of chest radiograph reports","volume":"1996","author":"Jain","year":"1996","journal-title":"Proc AMIA Annu Fall Symp"},{"key":"2021071421220862200_ocab027-B38","first-page":"1","article-title":"Relations in biomedical ontologies","volume":"6","author":"Smith","year":"2005","journal-title":"Genome Biol"},{"key":"2021071421220862200_ocab027-B39","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/j.jbi.2016.03.015","article-title":"Transitive closure of subsumption and causal relations in a large ontology of radiological diagnosis","volume":"61","author":"Kahn","year":"2016","journal-title":"J Biomed Inform"},{"issue":"S2","key":"2021071421220862200_ocab027-B40","doi-asserted-by":"crossref","first-page":"S1","DOI":"10.1186\/1471-2105-10-S2-S1","article-title":"Ontology-driven indexing of public datasets for translational bioinformatics","volume":"10","author":"Shah","year":"2009","journal-title":"BMC Bioinformatics"},{"issue":"2","key":"2021071421220862200_ocab027-B41","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1007\/s10844-010-0133-4","article-title":"Using ontology databases for scalable query answering, inconsistency detection, and data integration","volume":"37","author":"Lependu","year":"2011","journal-title":"J Intell Inf Syst"},{"key":"2021071421220862200_ocab027-B42","first-page":"635","article-title":"Graphical methods for reducing, visualizing and analyzing large data sets using hierarchical terminologies","volume":"2011","author":"Jing","year":"2011","journal-title":"AMIA Annu Symp Proc"},{"issue":"01","key":"2021071421220862200_ocab027-B43","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1142\/S1793351X14500032","article-title":"Enabling ontology based semantic queries in biomedical database systems","volume":"08","author":"Zheng","year":"2014","journal-title":"Int J Semant Comput"},{"issue":"2","key":"2021071421220862200_ocab027-B44","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/j.aci.2017.07.003","article-title":"The use of ontologies for effective knowledge modelling and information retrieval","volume":"14","author":"Munir","year":"2018","journal-title":"Appl Comput Inform"},{"issue":"1","key":"2021071421220862200_ocab027-B45","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1186\/s12911-019-0750-y","article-title":"A visual interactive analytic tool for filtering and summarizing large health data sets coded with hierarchical terminologies (VIADS)","volume":"19","author":"Jing","year":"2019","journal-title":"BMC Med Inform Decis Mak"},{"issue":"4","key":"2021071421220862200_ocab027-B46","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1136\/amiajnl-2011-000116","article-title":"Normalized names for clinical drugs: RxNorm at 6 years","volume":"18","author":"Nelson","year":"2011","journal-title":"J Am Med Inform Assoc"},{"key":"2021071421220862200_ocab027-B47","year":"2013"},{"issue":"01","key":"2021071421220862200_ocab027-B48","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1055\/s-0038-1634142","article-title":"A CORBA-based object framework with patient identification translation and dynamic linking. Methods for exchanging patient data","volume":"38","author":"Wang","year":"1999","journal-title":"Methods Inf Med"},{"issue":"Pt 2","key":"2021071421220862200_ocab027-B49","article-title":"A hospital information system based on Common Object Request Broker Architecture (CORBA) for exchanging distributed medical objects\u2013an approach to future environment of sharing healthcare information","volume":"52","author":"Ohe","year":"1998","journal-title":"Stud Health Technol Inform"},{"key":"2021071421220862200_ocab027-B50","first-page":"76","article-title":"LifeLines: using visualization to enhance navigation and analysis of patient records","volume":"1998","author":"Plaisant","year":"1998","journal-title":"Proc AMIA Symp"},{"issue":"5","key":"2021071421220862200_ocab027-B51","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1080\/014492998119328","article-title":"Viewing personal history records: a comparison of tabular format and graphical presentation using LifeLines","volume":"17","author":"Alonso","year":"1998","journal-title":"Behav Inf Technol"},{"issue":"4","key":"2021071421220862200_ocab027-B52","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1109\/TITB.2006.884365","article-title":"TimeLine: visualizing integrated patient records","volume":"11","author":"Bui","year":"2007","journal-title":"IEEE Trans Inform Technol Biomed"},{"issue":"4","key":"2021071421220862200_ocab027-B53","doi-asserted-by":"crossref","first-page":"753","DOI":"10.1016\/j.apergo.2008.07.004","article-title":"The effects of clinical information presentation on physicians\u2019 and nurses' decision-making in ICUs","volume":"40","author":"Miller","year":"2009","journal-title":"Appl Ergon"},{"issue":"4","key":"2021071421220862200_ocab027-B54","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1258\/shorts.2010.010012","article-title":"Presenting patient data in the electronic care record: the role of timelines","volume":"1","author":"Gill","year":"2010","journal-title":"JRSM Short Rep"},{"issue":"1","key":"2021071421220862200_ocab027-B55","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1186\/s12911-018-0667-x","article-title":"Timeline representation of clinical data: usability and added value for pharmacovigilance","volume":"18","author":"Ledieu","year":"2018","journal-title":"BMC Med Inform Decis Mak"},{"issue":"1","key":"2021071421220862200_ocab027-B56","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1186\/s12911-019-0885-x","article-title":"Health timeline: an insight-based study of a timeline visualization of clinical data","volume":"19","author":"Ledesma","year":"2019","journal-title":"BMC Med Inform Decis Mak"},{"issue":"1","key":"2021071421220862200_ocab027-B57","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1146\/annurev-biodatasci-080917-013315","article-title":"Advances in electronic phenotyping: from rule-based definitions to machine learning models","volume":"1","author":"Banda","year":"2018","journal-title":"Annu Rev Biomed Data Sci"},{"issue":"1","key":"2021071421220862200_ocab027-B58","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-019-0091-3","article-title":"It is time to learn from patients like mine","volume":"2","author":"Gombar","year":"2019","journal-title":"NPJ Digit Med"},{"issue":"3","key":"2021071421220862200_ocab027-B59","doi-asserted-by":"crossref","first-page":"563","DOI":"10.1016\/j.jacr.2017.12.023","article-title":"Performing an informatics consult: methods and challenges","volume":"15","author":"Schuler","year":"2018","journal-title":"J Am Coll Radiol"},{"issue":"3","key":"2021071421220862200_ocab027-B60","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/j.cct.2010.03.005","article-title":"Automated matching software for clinical trials eligibility: measuring efficiency and flexibility","volume":"31","author":"Penberthy","year":"2010","journal-title":"Contemp Clin Trials"},{"issue":"6","key":"2021071421220862200_ocab027-B61","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1200\/JOP.2012.000646","article-title":"Effort required in eligibility screening for clinical trials","volume":"8","author":"Penberthy","year":"2012","journal-title":"JOP"},{"issue":"7","key":"2021071421220862200_ocab027-B62","doi-asserted-by":"crossref","first-page":"e161","DOI":"10.2196\/jmir.3446","article-title":"Employing computers for the recruitment into clinical trials: a comprehensive systematic review","volume":"16","author":"K\u00f6pcke","year":"2014","journal-title":"J Med Internet Res"},{"issue":"1","key":"2021071421220862200_ocab027-B63","doi-asserted-by":"crossref","first-page":"478","DOI":"10.1186\/s13063-020-04358-3","article-title":"Digital tools for the recruitment and retention of participants in randomised controlled trials: a systematic map","volume":"21","author":"Frampton","year":"2020","journal-title":"Trials"},{"key":"2021071421220862200_ocab027-B64","author":"Ratner","year":"2017"},{"key":"2021071421220862200_ocab027-B65","doi-asserted-by":"crossref","first-page":"4763","DOI":"10.1609\/aaai.v33i01.33014763","article-title":"Training complex models with multi-task weak supervision","volume":"33","author":"Ratner","year":"2019","journal-title":"AAAI"},{"key":"2021071421220862200_ocab027-B66","first-page":"48","article-title":"Electronic phenotyping with APHRODITE and the Observational Health Sciences and Informatics (OHDSI) data network","volume":"2017","author":"Banda","year":"2017","journal-title":"AMIA Jt Summits Transl Sci Proc"},{"issue":"1","key":"2021071421220862200_ocab027-B67","doi-asserted-by":"crossref","first-page":"3111","DOI":"10.1038\/s41467-019-11012-3","article-title":"Weakly supervised classification of aortic valve malformations using unlabeled cardiac MRI sequences","volume":"10","author":"Fries","year":"2019","journal-title":"Nat Commun"},{"issue":"6","key":"2021071421220862200_ocab027-B68","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1093\/jamia\/ocaa032","article-title":"Development and validation of phenotype classifiers across multiple sites in the observational health data sciences and informatics network","volume":"27","author":"Kashyap","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"2021071421220862200_ocab027-B69","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1038\/s41746-019-0168-z","article-title":"Medical device surveillance with electronic health records","volume":"2","author":"Callahan","year":"2019","journal-title":"NPJ Digit Med"},{"key":"2021071421220862200_ocab027-B70","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1016\/j.ijmedinf.2006.09.004","article-title":"An \u2018honest broker\u2019 mechanism to maintain privacy for patient care and academic medical research","volume":"76","author":"Boyd","year":"2007","journal-title":"Int J Med Inform"},{"key":"2021071421220862200_ocab027-B71","author":"Datta","year":"2020"},{"issue":"6","key":"2021071421220862200_ocab027-B72","doi-asserted-by":"crossref","first-page":"911","DOI":"10.7326\/0003-4819-76-6-911","article-title":"Estimating prognosis with the aid of a conversational-mode computer program","volume":"76","author":"Feinstein","year":"1972","journal-title":"Ann Intern Med"},{"key":"2021071421220862200_ocab027-B73","volume-title":"Clinical Data as the Basic Staple of Health Learning: Creating and Protecting a Public Good","year":"2010"},{"issue":"2","key":"2021071421220862200_ocab027-B74","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1197\/jamia.M3007","article-title":"Using empiric semantic correlation to interpret temporal assertions in clinical texts","volume":"16","author":"Hripcsak","year":"2009","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"2021071421220862200_ocab027-B75","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1097\/MJT.0b013e31816b9027","article-title":"Assessing the impact of protocol design changes on clinical trial performance","volume":"15","author":"Getz","year":"2008","journal-title":"Am J Ther"},{"issue":"3","key":"2021071421220862200_ocab027-B76","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1177\/009286151104500307","article-title":"Measuring the incidence, causes, and repercussions of protocol amendments","volume":"45","author":"Getz","year":"2011","journal-title":"Drug Inform J"},{"key":"2021071421220862200_ocab027-B77","first-page":"26","article-title":"Planned to perfection","volume":"17","author":"Boericke","year":"2010","journal-title":"Int Clin Trials"},{"issue":"5","key":"2021071421220862200_ocab027-B78","doi-asserted-by":"crossref","first-page":"5069","DOI":"10.3390\/ijerph110505069","article-title":"Improving protocol design feasibility to drive drug development economics and performance","volume":"11","author":"Getz","year":"2014","journal-title":"IJERPH"},{"issue":"19","key":"2021071421220862200_ocab027-B79","doi-asserted-by":"crossref","first-page":"1758","DOI":"10.1056\/NEJMp1108726","article-title":"Evidence-based medicine in the EMR era","volume":"365","author":"Frankovich","year":"2011","journal-title":"N Engl J Med"},{"issue":"2","key":"2021071421220862200_ocab027-B80","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1136\/amiajnl-2011-000538","article-title":"iDASH: integrating data for analysis, anonymization, and sharing","volume":"19","author":"Ohno-Machado","year":"2012","journal-title":"J Am Med Inform Assoc"},{"issue":"e1","key":"2021071421220862200_ocab027-B81","doi-asserted-by":"crossref","first-page":"e119","DOI":"10.1136\/amiajnl-2011-000508","article-title":"Practices and perspectives on building integrated data repositories: results from a 2010 CTSA survey","volume":"19","author":"MacKenzie","year":"2012","journal-title":"J Am Med Inform Assoc"},{"issue":"7","key":"2021071421220862200_ocab027-B82","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1016\/j.ijmedinf.2014.04.001","article-title":"Electronically implemented clinical indicators based on a data warehouse in a tertiary hospital: its clinical benefit and effectiveness","volume":"83","author":"Yoo","year":"2014","journal-title":"Int J Med Inform"},{"issue":"2","key":"2021071421220862200_ocab027-B83","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1200\/CCI.17.00067","article-title":"Using a federated network of real-world data to optimize clinical trials operations","volume":"2","author":"Topaloglu","year":"2018","journal-title":"JCO Clin Cancer Inform"},{"issue":"11","key":"2021071421220862200_ocab027-B84","doi-asserted-by":"crossref","first-page":"2376","DOI":"10.1109\/TMI.2017.2724070","article-title":"Constrained deep weak supervision for histopathology image segmentation","volume":"36","author":"Jia","year":"2017","journal-title":"IEEE Trans Med Imaging"},{"key":"2021071421220862200_ocab027-B85","doi-asserted-by":"crossref","first-page":"811","DOI":"10.1007\/978-3-030-32248-9_90","volume-title":"Medical Image Computing and Computer Assisted Intervention \u2013 MICCAI 2019","author":"Saab","year":"2019"},{"key":"2021071421220862200_ocab027-B86","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1038\/s41746-020-0264-0","article-title":"Weak supervision as an efficient approach for automated seizure detection in electroencephalography","volume":"3","author":"Saab","year":"2020","journal-title":"NPJ Digit Med"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/7\/1468\/38983228\/ocab027.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/7\/1468\/38983228\/ocab027.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,14]],"date-time":"2021-07-14T21:24:09Z","timestamp":1626297849000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/28\/7\/1468\/6169466"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,13]]},"references-count":86,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2021,3,13]]},"published-print":{"date-parts":[[2021,7,14]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocab027","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,7,1]]},"published":{"date-parts":[[2021,3,13]]}}}