{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,1]],"date-time":"2025-11-01T09:47:06Z","timestamp":1761990426573,"version":"build-2065373602"},"reference-count":17,"publisher":"Oxford University Press (OUP)","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2016,7,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Objective Informatics programs need assurance that their curricula prepare students for intended roles as well as ensuring that students have mastered the appropriate competencies. The objective of this study is to describe a method for using assessment data to identify areas for curriculum, student selection, and assessment improvement.<\/jats:p>\n               <jats:p>Materials and Methods A multiple-choice examination covering the content in the Commission for Health Accreditation of Informatics and Information Management Education curricular facets\/elements was developed and administered to 2 cohorts of entering students prior to the beginning of the program and to the first cohort after completion of the first year\u2019s courses. The reliability of the examination was assessed using Cronbach\u2019s alpha. Content validity was assessed by having 2 raters assess the match of the items to the Commission for Health Accreditation of Informatics and Information Management Education requirements. Construct validation included comparison of exam performance of instructed vs uninstructed students. Criterion-related validity was assessed by examining the relationship of background characteristics to exam performance and by comparing examination performance to graduate Grade Point Average (GPA).<\/jats:p>\n               <jats:p>Results Reliability of the examination was 0.91 and 0.82 (Cohort 1 pre\/post-tests) and 0.43 (Cohort 2 pretest). Both raters judged 76% of the test items as appropriate. There were statistically significant differences between the instructed (Cohort 1 post-test) and uninstructed (Cohort 2 pretest) students (t\u2009=\u20092.95 P\u2009&amp;lt;\u2009.01), as well as between the Cohort 1 pre\/post-tests (t\u2009=\u20096.52, P\u2009&amp;lt;\u2009.001). Neither the background variables nor the graduate GPA were significantly correlated with the examination scores.<\/jats:p>\n               <jats:p>Conclusion We found that the examination had generally good psychometric properties and the exceptions could be used to identify areas for curriculum and assessment improvement.<\/jats:p>","DOI":"10.1093\/jamia\/ocw073","type":"journal-article","created":{"date-parts":[[2016,6,7]],"date-time":"2016-06-07T02:34:40Z","timestamp":1465266880000},"page":"813-818","source":"Crossref","is-referenced-by-count":7,"title":["Assessment-based health informatics curriculum improvement"],"prefix":"10.1093","volume":"23","author":[{"given":"Eta S","family":"Berner","sequence":"first","affiliation":[{"name":"Professor and Director, Center for Health Informatics for Patient Safety\/Quality, Department of Health Services Administration, University of Alabama at Birmingham, Birmingham, AL, USA"}]},{"given":"Amanda D","family":"Dorsey","sequence":"additional","affiliation":[{"name":"Department of Health Services Administration, University of Alabama at Birmingham, Birmingham, AL, USA"}]},{"given":"Robert L","family":"Garrie","sequence":"additional","affiliation":[{"name":"Department of Health Services Administration, University of Alabama at Birmingham, Birmingham, AL, USA"}]},{"given":"Haiyan","family":"Qu","sequence":"additional","affiliation":[{"name":"Department of Health Services Administration, University of Alabama at Birmingham, Birmingham, AL, USA"}]}],"member":"286","published-online":{"date-parts":[[2016,6,5]]},"reference":[{"key":"2020110613004154300_ocw073-B1","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1007\/978-1-4471-4078-8_3","article-title":"Training for informatics research careers: history of extramural informatics training at the National Library of Medicine","volume-title":"Informatics Education in Healthcare: Lessons Learned","author":"Florance","year":"2014"},{"key":"2020110613004154300_ocw073-B2","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1007\/978-1-4471-4078-8_4","article-title":"Clinical informatics subspecialty certification and training","volume-title":"Informatics Education in Healthcare: Lessons Learned","author":"Gardner","year":"2014"},{"key":"2020110613004154300_ocw073-B3","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1197\/jamia.M3046","article-title":"AMIA Board of Directors. Program requirements for fellowship education in the subspecialty of clinical informatics","volume":"16","author":"Safran","year":"2009","journal-title":"J Am Med Inform Assoc."},{"key":"2020110613004154300_ocw073-B4","doi-asserted-by":"crossref","first-page":"267","DOI":"10.4338\/ACI-2015-03-IE-0030","article-title":"Clinical informatics fellowship programs: in search of a viable financial model: an open letter to the Centers for Medicare and Medicaid Services","volume":"6","author":"Lehmann","year":"2015","journal-title":"Appl Clin Inform."},{"author":"Accreditation Council for Graduate Medical Education","key":"2020110613004154300_ocw073-B5","article-title":"ACGME program requirements for graduate medical education in clinical informatics"},{"key":"2020110613004154300_ocw073-B6"},{"key":"2020110613004154300_ocw073-B7","doi-asserted-by":"crossref","first-page":"211","DOI":"10.4338\/ACI-2014-09-RA-0083","article-title":"Bridging the gap: a collaborative approach to health information management and informatics education","volume":"6","author":"Dorsey","year":"2015","journal-title":"Appl Clin Inform."},{"key":"2020110613004154300_ocw073-B8","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1136\/amiajnl-2013-001683","article-title":"Design and evaluation of the ONC health information technology curriculum","volume":"21","author":"Mohan","year":"2014","journal-title":"J Am Med Inform Assoc."},{"volume-title":"Rural Health Information Technology Workforce Program","author":"Health Resources and Services Administration","key":"2020110613004154300_ocw073-B9"},{"volume-title":"Applying Norm-Referenced and Criterion-Referenced Measurement in Education","year":"1977","author":"Martuza","key":"2020110613004154300_ocw073-B10"},{"key":"2020110613004154300_ocw073-B11","doi-asserted-by":"crossref","first-page":"166.e7","DOI":"10.1016\/j.amjmed.2005.10.036","article-title":"Current concepts in validity and reliability for psychometric instruments: theory and application","volume":"119","author":"Cook","year":"2006","journal-title":"Am J Med"},{"issue":"1","key":"2020110613004154300_ocw073-B12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/jedm.12000","article-title":"Validating the interpretations and uses of test scores","volume":"50","author":"Kane","year":"2013","journal-title":"J Educ Meas."},{"key":"2020110613004154300_ocw073-B13","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1111\/j.1547-5069.2007.00161.x","article-title":"A psychometric toolbox for testing validity and reliability","volume":"39","author":"DeVon","year":"2007","journal-title":"J Nurs Scholarsh."},{"author":"Commission on Accreditation for Health Informatics and Information Management Education - CAHIIM","key":"2020110613004154300_ocw073-B14","article-title":"Curricular Requirements"},{"volume-title":"CPHIMS Certification","author":"HIMSS","key":"2020110613004154300_ocw073-B15"},{"key":"2020110613004154300_ocw073-B16","first-page":"3","article-title":"Twelve steps for effective test development","volume-title":"Handbook of Test Development","author":"Downing","year":"2006"},{"issue":"3","key":"2020110613004154300_ocw073-B17","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1007\/BF02310555","article-title":"Coefficient alpha and the internal structure of tests","volume":"16","author":"Cronbach","year":"1951","journal-title":"Psychometrika."}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article\/23\/4\/813\/2201442","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article\/23\/4\/813\/2201442","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T18:44:49Z","timestamp":1604688289000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/23\/4\/813\/2201442"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,6,5]]},"references-count":17,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2016,6,5]]},"published-print":{"date-parts":[[2016,7,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocw073","relation":{},"ISSN":["1527-974X","1067-5027"],"issn-type":[{"type":"electronic","value":"1527-974X"},{"type":"print","value":"1067-5027"}],"subject":[],"published-other":{"date-parts":[[2016,7]]},"published":{"date-parts":[[2016,6,5]]}}}