{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,18]],"date-time":"2026-11-18T06:03:24Z","timestamp":1794981804290,"version":"4.9.1"},"reference-count":31,"publisher":"Wiley","issue":"9","license":[{"start":{"date-parts":[[2003,8,27]],"date-time":"2003-08-27T00:00:00Z","timestamp":1061942400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["asmepublications.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Medical Education"],"published-print":{"date-parts":[[2003,9]]},"abstract":"<jats:p>\n                    <jats:bold>Context\u2002<\/jats:bold>\n                    All assessments in medical education require evidence of validity to be interpreted meaningfully. In contemporary usage, all validity is construct validity, which requires multiple sources of evidence; construct validity is the whole of validity, but has multiple facets. Five sources \u2013 content, response process, internal structure, relationship to other variables and consequences \u2013 are noted by the\n                    <jats:italic>Standards for Educational and Psychological Testing<\/jats:italic>\n                    as fruitful areas to seek validity evidence.\n                  <\/jats:p>\n                  <jats:p>\n                    <jats:bold>Purpose\u2002<\/jats:bold>\n                    The purpose of this article is to discuss construct validity in the context of medical education and to summarize, through example, some typical sources of validity evidence for a written and a performance examination.\n                  <\/jats:p>\n                  <jats:p>\n                    <jats:bold>Summary\u2002<\/jats:bold>\n                    Assessments are not valid or invalid; rather, the scores or outcomes of assessments have more or less evidence to support (or refute) a specific interpretation (such as passing or failing a course). Validity is approached as hypothesis and uses theory, logic and the scientific method to collect and assemble data to support or fail to support the proposed score interpretations, at a given point in time. Data and logic are assembled into arguments \u2013 pro and con \u2013 for some specific interpretation of assessment data. Examples of types of validity evidence, data and information from each source are discussed in the context of a high\u2010stakes written and performance examination in medical education.\n                  <\/jats:p>\n                  <jats:p>\n                    <jats:bold>Conclusion\u2002<\/jats:bold>\n                    All assessments require evidence of the reasonableness of the proposed interpretation, as test data in education have little or no intrinsic meaning. The constructs purported to be measured by our assessments are important to students, faculty, administrators, patients and society and require solid scientific evidence of their meaning.\n                  <\/jats:p>","DOI":"10.1046\/j.1365-2923.2003.01594.x","type":"journal-article","created":{"date-parts":[[2003,8,27]],"date-time":"2003-08-27T10:49:20Z","timestamp":1061981360000},"page":"830-837","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":1191,"title":["Validity: on the meaningful interpretation of assessment data"],"prefix":"10.1111","volume":"37","author":[{"given":"Steven M","family":"Downing","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2003,8,27]]},"reference":[{"key":"e_1_2_15_2_2","volume-title":"Standards for Educational and Psychological Testing","author":"American Educational Research Association, American Psychological Association, National Council on Measurement in Education.","year":"1999"},{"key":"e_1_2_15_3_2","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365-2923.2002.01294.x"},{"key":"e_1_2_15_4_2","first-page":"443","volume-title":"Educational Measurement","author":"Cronbach LJ","year":"1971"},{"key":"e_1_2_15_5_2","first-page":"3","volume-title":"Test Validity","author":"Cronbach LJ","year":"1988"},{"key":"e_1_2_15_6_2","first-page":"147","volume-title":"Intelligence: Measurement, Theory, and Public Policy","author":"Cronbach LJ","year":"1989"},{"key":"e_1_2_15_7_2","doi-asserted-by":"publisher","DOI":"10.1037\/h0040957"},{"key":"e_1_2_15_8_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1984.tb01030.x"},{"key":"e_1_2_15_9_2","first-page":"13","volume-title":"Educational Measurement","author":"Messick S","year":"1989"},{"key":"e_1_2_15_10_2","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.50.9.741"},{"key":"e_1_2_15_11_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3992.1995.tb00881.x"},{"key":"e_1_2_15_12_2","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.112.3.527"},{"key":"e_1_2_15_13_2","doi-asserted-by":"publisher","DOI":"10.1177\/016327879401700202"},{"key":"e_1_2_15_14_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.2001.tb01130.x"},{"key":"e_1_2_15_15_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3992.1999.tb00010.x"},{"key":"e_1_2_15_16_2","first-page":"621","volume-title":"Educational Measurement","author":"Cureton EE","year":"1951"},{"key":"e_1_2_15_17_2","doi-asserted-by":"publisher","DOI":"10.3102\/0013189X022007012"},{"key":"e_1_2_15_18_2","volume-title":"Large\u2010Scale Assessment Programs for All Students: Development, Implementation, and Analysis.","author":"Linn RL","year":"2002"},{"key":"e_1_2_15_19_2","first-page":"635","article-title":"Objective tests as instruments of psychological theory","volume":"3","author":"Loevinger J","year":"1957","journal-title":"Psychol Reports, Monograph"},{"key":"e_1_2_15_20_2","doi-asserted-by":"publisher","DOI":"10.1207\/S15324818AME1503_5"},{"key":"e_1_2_15_21_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022639521218"},{"key":"e_1_2_15_22_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-3456-0"},{"key":"e_1_2_15_23_2","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365-2923.2002.01320.x"},{"key":"e_1_2_15_24_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-2691-6_1"},{"key":"e_1_2_15_25_2","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365-2923.2003.01587.x"},{"key":"e_1_2_15_26_2","volume-title":"Differential Item Functioning","author":"Holland PW","year":"1993"},{"key":"e_1_2_15_27_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3992.2000.tb00033.x"},{"key":"e_1_2_15_28_2","doi-asserted-by":"publisher","DOI":"10.1037\/h0046016"},{"key":"e_1_2_15_29_2","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365-2923.2003.01495.x"},{"key":"e_1_2_15_30_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1988.tb00290.x"},{"key":"e_1_2_15_31_2","first-page":"508","volume-title":"Educational Measurement","author":"Angoff WH","year":"1971"},{"key":"e_1_2_15_32_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2923.1983.tb00657.x"}],"container-title":["Medical Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1046%2Fj.1365-2923.2003.01594.x","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/asmepublications.onlinelibrary.wiley.com\/doi\/pdf\/10.1046\/j.1365-2923.2003.01594.x","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T15:39:36Z","timestamp":1762270776000},"score":1,"resource":{"primary":{"URL":"https:\/\/asmepublications.onlinelibrary.wiley.com\/doi\/10.1046\/j.1365-2923.2003.01594.x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2003,8,27]]},"references-count":31,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2003,9]]}},"alternative-id":["10.1046\/j.1365-2923.2003.01594.x"],"URL":"https:\/\/doi.org\/10.1046\/j.1365-2923.2003.01594.x","archive":["Portico"],"relation":{},"ISSN":["0308-0110","1365-2923"],"issn-type":[{"value":"0308-0110","type":"print"},{"value":"1365-2923","type":"electronic"}],"subject":[],"published":{"date-parts":[[2003,8,27]]},"assertion":[{"value":"2003-08-27","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}