{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2022,12,14]],"date-time":"2022-12-14T12:19:18Z","timestamp":1671020358659},"reference-count":38,"publisher":"Georg Thieme Verlag KG","issue":"04","funder":[{"DOI":"10.13039\/100000958","name":"American Association for the Advancement of Science","doi-asserted-by":"crossref","award":["75P00120C00035"],"award-info":[{"award-number":["75P00120C00035"]}],"id":[{"id":"10.13039\/100000958","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Appl Clin Inform"],"published-print":{"date-parts":[[2021,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>\n          Background\u2003Pilot-testing is important in standards development because it facilitates agile navigation of the gap between needs for and use of standards in real-world settings and can reveal the practicalities of implementation. As the implementation and use of health data standards are usually more complicated than anticipated, the Office of the National Coordinator for Health Information Technology (ONC) routinely oversees and organizes relevant pilot projects.<\/jats:p><jats:p>\n          Objectives\u2003This article provides an in-depth look into a sample of ONC's standards-focused pilot projects to (1) inform readers of the complexities of developing, implementing, and advancing standards and (2) guide those seeking to evaluate new standards through pilot projects.<\/jats:p><jats:p>\n          Methods\u2003The ONC's approach to conducting pilot projects begins with identifying a clinical care need, research requirement, or policy outcome that is not well supported by existing standards through a landscape review. ONC then selects a testing approach based on the identified need and maturity of relevant standards. Next, ONC identifies use cases and sites to pilot-test the relevant standard. Once complete, ONC publishes a report that informs subsequent projects and standards development.<\/jats:p><jats:p>\n          Results\u2003Pilot projects presented here are organized into three categories related to their demonstrated focus and related approach: (1) improving standards for presenting and sharing clinical genetic data, (2) accelerating the development and implementation of new standards, and (3) facilitating clinical data reuse. Each project illustrates the pilot approach from inception to next steps, capturing the role of collaboration among standards development organizations, stakeholders, and end-users to ensure standards are practical and fit for purpose.<\/jats:p><jats:p>\n          Conclusion\u2003The ONC approach identifies implementation difficulties prior to broader adoption and use of standards, and provides insight into the steps needed to scale use of standards. The ONC's organization of pilot projects serves as a natural accelerator for building communities of practice, often providing a well-connected beneficiary of lessons learned.<\/jats:p>","DOI":"10.1055\/s-0041-1731677","type":"journal-article","created":{"date-parts":[[2021,8,11]],"date-time":"2021-08-11T22:52:26Z","timestamp":1628722346000},"page":"745-756","source":"Crossref","is-referenced-by-count":1,"title":["Fast-Tracking Health Data Standards Development and Adoption in Real-World Settings: A Pilot Approach"],"prefix":"10.1055","volume":"12","author":[{"given":"Allison F.","family":"Dennis","sequence":"additional","affiliation":[{"name":"Office of the National Coordinator for Health Information Technology, Washington, District of Columbia, United States"}]},{"given":"P. Jon","family":"White","sequence":"additional","affiliation":[{"name":"Veterans Affairs Salt Lake City Health Care System, Salt Lake City, Utah, United States"},{"name":"Department of Internal Medicine, University of Utah, Salt Lake City, Utah, United States"}]},{"given":"Teresa","family":"Zayas-Cab\u00e1n","sequence":"additional","affiliation":[{"name":"Office of the National Coordinator for Health Information Technology, Washington, District of Columbia, United States"}]}],"member":"194","published-online":{"date-parts":[[2021,8,11]]},"reference":[{"issue":"02","key":"ref3","doi-asserted-by":"crossref","first-page":"e41","DOI":"10.2196\/jmir.8793","article-title":"Health information technology continues to show positive effect on medical outcomes: systematic review","volume":"20","author":"C S Kruse","year":"2018","journal-title":"J Med Internet Res"},{"issue":"04","key":"ref4","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1377\/hlthaff.2010.0155","article-title":"The effect of health information technology on quality in U.S. hospitals","volume":"29","author":"J S McCullough","year":"2010","journal-title":"Health Aff (Millwood)"},{"key":"ref5","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/j.jhealeco.2013.12.005","article-title":"The effects of health information technology on the costs and quality of medical care","volume":"34","author":"L Agha","year":"2014","journal-title":"J Health Econ"},{"issue":"01","key":"ref6","doi-asserted-by":"crossref","first-page":"48","DOI":"10.7326\/M13-1531","article-title":"Health information technology: an updated systematic review with a focus on meaningful use","volume":"160","author":"S S Jones","year":"2014","journal-title":"Ann Intern Med"},{"issue":"12","key":"ref7","doi-asserted-by":"crossref","first-page":"1173","DOI":"10.15537\/smj.2017.12.20631","article-title":"The impact of health information technology on patient safety","volume":"38","author":"Y K Alotaibi","year":"2017","journal-title":"Saudi Med J"},{"issue":"10","key":"ref8","doi-asserted-by":"crossref","first-page":"742","DOI":"10.7326\/0003-4819-144-10-200605160-00125","article-title":"Systematic review: impact of health information technology on quality, efficiency, and costs of medical care","volume":"144","author":"B Chaudhry","year":"2006","journal-title":"Ann Intern Med"},{"key":"ref9","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1016\/j.cmpb.2018.04.023","article-title":"The impact of health information exchange on healthcare quality and cost-effectiveness: a systematic literature review","volume":"161","author":"F Sadoughi","year":"2018","journal-title":"Comput Methods Programs Biomed"},{"issue":"04","key":"ref10","doi-asserted-by":"crossref","first-page":"e39","DOI":"10.2196\/medinform.5215","article-title":"Outcomes from health information exchange: systematic review and future research needs","volume":"3","author":"W R Hersh","year":"2015","journal-title":"JMIR Med Inform"},{"key":"ref11","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1038\/s41746-019-0158-1","article-title":"Why digital medicine depends on interoperability","volume":"2","author":"M Lehne","year":"2019","journal-title":"NPJ Digit Med"},{"issue":"16","key":"ref12","doi-asserted-by":"crossref","first-page":"1667","DOI":"10.1001\/jama.2016.12337","article-title":"Health information technology interoperability and use for better care and evidence","volume":"316","author":"J B Perlin","year":"2016","journal-title":"JAMA"},{"key":"ref14","first-page":"555","article-title":"Promoting national and international standards to build interoperable clinical applications","volume":"2018","author":"P J Haug","year":"2018","journal-title":"AMIA Annu Symp Proc"},{"issue":"04","key":"ref15","doi-asserted-by":"crossref","first-page":"609","DOI":"10.1016\/j.jbi.2012.06.006","article-title":"Translating standards into practice: experiences and lessons learned in biomedicine and health care","volume":"45","author":"E S Chen","year":"2012","journal-title":"J Biomed Inform"},{"issue":"04","key":"ref18","doi-asserted-by":"crossref","first-page":"652","DOI":"10.1093\/jamia\/ocaa008","article-title":"National health information technology priorities for research: a policy and development agenda","volume":"27","author":"T Zayas-Cab\u00e1n","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"04","key":"ref19","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1093\/jamia\/ocaa011","article-title":"Leveraging the health information technology infrastructure to advance federal research priorities","volume":"27","author":"T Zayas-Cab\u00e1n","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"ref21","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1093\/jamiaopen\/ooaa037","article-title":"Opportunities for the use of health information technology to support research","volume":"3","author":"T Zayas-Cab\u00e1n","year":"2020","journal-title":"JAMIA Open"},{"issue":"06","key":"ref22","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1197\/jamia.M2470","article-title":"Data standards in clinical research: gaps, overlaps, challenges and future directions","volume":"14","author":"R L Richesson","year":"2007","journal-title":"J Am Med Inform Assoc"},{"issue":"04","key":"ref23","doi-asserted-by":"crossref","first-page":"813","DOI":"10.1016\/j.jbi.2012.01.003","article-title":"Translating standards into practice: experience and lessons learned at the Department of Veterans Affairs","volume":"45","author":"O Bouhaddou","year":"2012","journal-title":"J Biomed Inform"},{"key":"ref24","first-page":"70","article-title":"Saving time and money","volume":"16","author":"C Rozwell","year":"2007","journal-title":"Appl Clin Trials"},{"issue":"02","key":"ref25","doi-asserted-by":"crossref","first-page":"w282","DOI":"10.1377\/hlthaff.28.2.w282","article-title":"Costs and benefits of health information technology: new trends from the literature","volume":"28","author":"C L Goldzweig","year":"2009","journal-title":"Health Aff (Millwood)"},{"issue":"04","key":"ref26","doi-asserted-by":"crossref","first-page":"792","DOI":"10.1136\/amiajnl-2012-001422","article-title":"Measuring value for money: a scoping review on economic evaluation of health information systems","volume":"20","author":"J Bassi","year":"2013","journal-title":"J Am Med Inform Assoc"},{"key":"ref28","doi-asserted-by":"crossref","first-page":"S286","DOI":"10.1097\/MLR.0000000000001144","article-title":"Quality enhancement research initiative implementation roadmap: toward sustainability of evidence-based practices in a learning health system","volume":"57","author":"A M Kilbourne","year":"2019","journal-title":"Med Care"},{"key":"ref29","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1186\/1748-5908-7-21","article-title":"Methods for the guideline-based development of quality indicators--a systematic review","volume":"7","author":"T K\u00f6tter","year":"2012","journal-title":"Implement Sci"},{"issue":"04","key":"ref30","doi-asserted-by":"crossref","first-page":"1069","DOI":"10.4338\/ACI-2016-06-R-0105","article-title":"Mind the Gap. A systematic review to identify usability and safety challenges and practices during electronic health record implementation","volume":"7","author":"R Ratwani","year":"2016","journal-title":"Appl Clin Inform"},{"issue":"08","key":"ref33","first-page":"558","article-title":"AHRQ EPC series on improving translation of evidence into practice for the learning health system: introduction","volume":"45","author":"C Fiordalisi","year":"2019","journal-title":"Jt Comm J Qual Patient Saf"},{"issue":"06","key":"ref34","doi-asserted-by":"crossref","first-page":"1188","DOI":"10.1377\/hlthaff.2010.0442","article-title":"Innovation in Medicare and Medicaid will be central to health reform's success","volume":"29","author":"S Guterman","year":"2010","journal-title":"Health Aff (Millwood)"},{"key":"ref35","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1186\/s43058-020-00053-1","article-title":"Implementation and sustainment of diverse practices in a large integrated health system: a mixed methods study","volume":"1","author":"A L Nevedal","year":"2020","journal-title":"Implement Sci Commun"},{"issue":"S 01","key":"ref36","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1002\/pds.2242","article-title":"The organizational structure and governing principles of the Food and Drug Administration's Mini-Sentinel pilot program","volume":"21","author":"S Forrow","year":"2012","journal-title":"Pharmacoepidemiol Drug Saf"},{"issue":"03","key":"ref37","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1017\/cts.2020.25","article-title":"Accelerating implementation of research in learning health systems: lessons learned from VA health services research and NCATS clinical science translation award programs","volume":"4","author":"A M Kilbourne","year":"2020","journal-title":"J Clin Transl Sci"},{"issue":"01","key":"ref38","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1055\/s-0038-1677527","article-title":"Lessons Learned in creating interoperable fast healthcare interoperability resources profiles for large-scale public health programs","volume":"10","author":"S A Matney","year":"2019","journal-title":"Appl Clin Inform"},{"key":"ref41","first-page":"ocab032","article-title":"Meeting the challenge: Health information technology's essential role in achieving precision medicine","author":"T Zayas-Cab\u00e1n","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"ref45","first-page":"19","volume-title":"Standards in Healthcare Data","author":"S Schulz","year":"2019"},{"issue":"02","key":"ref46","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1007\/s10488-010-0319-7","article-title":"Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda","volume":"38","author":"E Proctor","year":"2011","journal-title":"Adm Policy Ment Health"},{"issue":"07","key":"ref50","doi-asserted-by":"crossref","first-page":"668","DOI":"10.1056\/NEJMsr1809937","article-title":"The \u201call of us\u201d research program","volume":"381","author":"J C Denny","year":"2019","journal-title":"N Engl J Med"},{"issue":"02","key":"ref56","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1055\/s-0040-1708051","article-title":"Sync for genes: making clinical genomics available for precision medicine at the point-of-care","volume":"11","author":"S J Garcia","year":"2020","journal-title":"Appl Clin Inform"},{"key":"ref57","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1186\/1477-7525-4-79","article-title":"Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance","volume":"4","author":"U.S. Department of Health and Human Services FDA Center for Drug Evaluation and Research","year":"2006","journal-title":"Health Qual Life Outcomes"},{"key":"ref61","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1038\/s41746-020-0218-6","article-title":"SMART Markers: collecting patient-generated health data as a standardized property of health information technology","volume":"3","author":"R Sayeed","year":"2020","journal-title":"NPJ Digit Med"},{"issue":"01","key":"ref68","first-page":"26","article-title":"The use of clinical registries in the united states: a landscape survey","volume":"5","author":"S Blumenthal","year":"2017","journal-title":"EGEMS (Wash DC)"},{"key":"ref71","volume-title":"Engaging Patients in Information Sharing and Data Collection: The Role of Patient-Powered Registries and Research Networks [Internet]","author":"T A Workman","year":"2013"}],"container-title":["Applied Clinical Informatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.thieme-connect.de\/products\/ejournals\/pdf\/10.1055\/s-0041-1731677.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,8,11]],"date-time":"2021-08-11T22:53:13Z","timestamp":1628722393000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.thieme-connect.de\/DOI\/DOI?10.1055\/s-0041-1731677"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8]]},"references-count":38,"journal-issue":{"issue":"04","published-online":{"date-parts":[[2021,8,4]]},"published-print":{"date-parts":[[2021,8]]}},"URL":"https:\/\/doi.org\/10.1055\/s-0041-1731677","archive":["Portico","CLOCKSS"],"relation":{},"ISSN":["1869-0327"],"issn-type":[{"value":"1869-0327","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8]]}}}