{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,4]],"date-time":"2026-09-04T17:18:22Z","timestamp":1788542302309,"version":"build-2803163510"},"reference-count":79,"publisher":"Wiley","issue":"2","license":[{"start":{"date-parts":[[2006,6,15]],"date-time":"2006-06-15T00:00:00Z","timestamp":1150329600000},"content-version":"vor","delay-in-days":1110,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["J Educational Measurement"],"published-print":{"date-parts":[[2003,6]]},"abstract":"<jats:p>A thorough search of the literature was conducted to locate empirical studies investigating the trait or construct equivalence of multiple\u2010choice (MC) and constructed\u2010response (CR) items. Of the 67 studies identified, 29 studies included 56 correlations between items in both formats. These 56 correlations were corrected for attenuation and synthesized to establish evidence for a common estimate of correlation (true\u2010score correlations). The 56 disattenuated correlations were highly heterogeneous. A search for moderators to explain this variation uncovered the role of the design characteristics of test items used in the studies. When items are constructed in both formats using the same stem (stem equivalent), the mean correlation between the two formats approaches unity and is significantly higher than when using non\u2010stem\u2010equivalent items (particularly when using essay\u2010type items). Construct equivalence, in part, appears to be a function of the item design method or the item writer's intent.<\/jats:p>","DOI":"10.1111\/j.1745-3984.2003.tb01102.x","type":"journal-article","created":{"date-parts":[[2006,6,15]],"date-time":"2006-06-15T15:55:16Z","timestamp":1150386916000},"page":"163-184","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":95,"title":["Construct Equivalence of Multiple\u2010Choice and Constructed\u2010Response Items: A Random Effects Synthesis of Correlations"],"prefix":"10.1111","volume":"40","author":[{"given":"Michael C.","family":"Rodriguez","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2006,6,15]]},"reference":[{"key":"e_1_2_1_2_2","doi-asserted-by":"publisher","DOI":"10.1177\/014662168801200202"},{"key":"e_1_2_1_3_1","volume-title":"Introduction to measurement theory","author":"Allen M. J.","year":"1979"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00138395"},{"key":"e_1_2_1_5_2","doi-asserted-by":"publisher","DOI":"10.1177\/014662169001400204"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1991.tb00345.x"},{"key":"e_1_2_1_7_1","volume-title":"Construction versus choice in cognitive measurement","author":"Bennett R. E.","year":"1993"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1002\/sce.3730780602"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1177\/014662168701100404"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1177\/014662169201600406"},{"key":"e_1_2_1_11_2","doi-asserted-by":"publisher","DOI":"10.1177\/001316447003000218"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1994.tb00447.x"},{"key":"e_1_2_1_13_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1979.tb00093.x"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1992.tb00377.x"},{"key":"e_1_2_1_15_1","doi-asserted-by":"crossref","DOI":"10.1002\/j.2333-8504.1992.tb01459.x","volume-title":"Placement validity of a prototype SAT with an essay","author":"Bridgeman B.","year":"1992"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1994.tb00433.x"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1993.tb00429.x"},{"key":"e_1_2_1_18_1","volume-title":"The effect of item format on phonics subtest scores of standardized reading achievement tests","author":"Carcelli L.","year":"1980"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1080\/87567555.1986.10532328"},{"key":"e_1_2_1_20_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1966.tb00872.x"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0040688"},{"key":"e_1_2_1_22_1","volume-title":"Introduction to classical and modern test theory","author":"Crocker L.","year":"1986"},{"key":"e_1_2_1_23_2","doi-asserted-by":"publisher","DOI":"10.1177\/001316445901900202"},{"key":"e_1_2_1_24_2","unstructured":"DeMars C.(1998.The impact of test consequences and response format on performance.Unpublished doctoral dissertation Michigan State University."},{"key":"e_1_2_1_25_1","unstructured":"Downing S. M. &Norcini J. J.(1998 April).Constructed response or multiple choice: Does the format make a difference for predictionPaper presented at the annual meeting of the American Educational Research Association San Diego."},{"key":"e_1_2_1_26_1","unstructured":"Ercikan K. &Schwarz R.(1995 April).Dimensionality of multiple\u2010choice and constructed\u2010response tests for different ability groups.Paper presented at the annual meeting of the National Council on Measurement in Education San Francisco."},{"key":"e_1_2_1_27_2","doi-asserted-by":"publisher","DOI":"10.1037\/h0075460"},{"key":"e_1_2_1_28_2","unstructured":"Fisher G. L.(1996).The validity of pre\u2010calculus multiple\u2010choice and performance\u2010based testing as a predictor of undergraduate mathematics and chemistry achievement.Unpublished master's thesis University of California Santa Barbara."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1985.tb01046.x"},{"key":"e_1_2_1_30_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1995.tb00456.x"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1980.tb00813.x"},{"key":"e_1_2_1_32_2","volume-title":"The measurement of writing ability","author":"Godshalk F. I.","year":"1966"},{"key":"e_1_2_1_33_1","unstructured":"Haladyna T. M.(1998 April).Fidelity and proximity to criterion: When should we use multiple\u2010choicePaper presented at the annual meeting of the American Educational Research Association San Diego."},{"key":"e_1_2_1_34_1","unstructured":"Halpin G.(1979 April).Retention in an actual classroom setting as a function of type and complexity of tests.Paper presented at the annual meeting of the American Educational Research Association San Francisco."},{"key":"e_1_2_1_35_2","doi-asserted-by":"publisher","DOI":"10.1080\/00220973.1994.9943836"},{"key":"e_1_2_1_36_2","doi-asserted-by":"publisher","DOI":"10.1002\/sce.3730560416"},{"key":"e_1_2_1_37_1","first-page":"29","volume-title":"The handbook of research synthesis","author":"Hedges L. V.","year":"1994"},{"key":"e_1_2_1_38_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.2044-8279.1967.tb01950.x"},{"key":"e_1_2_1_39_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1980.tb00829.x"},{"key":"e_1_2_1_40_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1966.tb00892.x"},{"key":"e_1_2_1_41_2","doi-asserted-by":"publisher","DOI":"10.1080\/00220671.1932.10880276"},{"key":"e_1_2_1_42_2","doi-asserted-by":"publisher","DOI":"10.1080\/00220671.1954.10882143"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/0361-476X(79)90041-9"},{"key":"e_1_2_1_44_2","doi-asserted-by":"publisher","DOI":"10.1080\/0270271860070102"},{"key":"e_1_2_1_45_1","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1111\/j.1745-3984.1994.tb00445.x","article-title":"On the relative value of multiple\u2010choice, constructed\u2010response, and examinee\u2010selected items on two achievement tests","volume":"30","author":"Lukhele R.","year":"1994","journal-title":"Journal of Educational Measurement"},{"key":"e_1_2_1_46_2","doi-asserted-by":"publisher","DOI":"10.1037\/h0072060"},{"key":"e_1_2_1_47_2","unstructured":"Manhart J. J.(1996 April).Factor analytic methods for determining whether multiple\u2010choice and constructed\u2010response tests measure the same construct.Paper presented at the annual meeting of the American Educational Research Association New York."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1991.tb00349.x"},{"key":"e_1_2_1_49_1","unstructured":"Martinez M. E.(1998 April).Cognition and the question of test item format.Paper presented at the annual meeting of the American Educational Research Association San Diego."},{"key":"e_1_2_1_50_1","first-page":"61","volume-title":"Construction versus choice in cognitive measurement","author":"Messick S.","year":"1993"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1080\/00220671.1966.10883354"},{"key":"e_1_2_1_52_1","unstructured":"Morgan R. &Manackshana B.(1996 April).The psychometric perspective: Meeting four decades of challenges.Paper presented at the annual meeting of the National Council on Measurement in Education New York."},{"key":"e_1_2_1_53_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1982.tb00113.x"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1177\/014662168400800305"},{"key":"e_1_2_1_55_2","first-page":"246","article-title":"Do new and old type examinations measure different mental functions","volume":"24","author":"Paterson D. G.","year":"1926","journal-title":"School and Society"},{"key":"e_1_2_1_56_1","volume-title":"Constructed response tests in the NELS:88 high school effectiveness study","author":"Pollock J. M.","year":"1997"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1982.tb00131.x"},{"key":"e_1_2_1_58_1","first-page":"301","volume-title":"The handbook of research synthesis","author":"Raudenbush S. W.","year":"1994"},{"key":"e_1_2_1_59_1","first-page":"213","volume-title":"Large\u2010scale assessment programs for all students: Development, implementation, and analysis","author":"Rodriguez M. C.","year":"2002"},{"key":"e_1_2_1_60_1","first-page":"231","volume-title":"The handbook of research synthesis","author":"Rosenthal R.","year":"1994"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1974.tb00966.x"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0075108"},{"key":"e_1_2_1_63_2","doi-asserted-by":"publisher","DOI":"10.1037\/h0072894"},{"key":"e_1_2_1_64_1","unstructured":"Ryan J. &Franz S.(1998 April).Gender X format interactionist perspective.Paper presented at the annual meeting of the American Educational Research Association San Diego."},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1968.tb00622.x"},{"key":"e_1_2_1_66_1","first-page":"261","volume-title":"The handbook of research synthesis","author":"Shadish W. R.","year":"1994"},{"key":"e_1_2_1_67_2","unstructured":"Smith J. K. &Smith M. R.(1984 April).The influence of item format on measures of reading comprehension.Paper presented at the annual meeting of the American Educational Research Association New Orleans."},{"key":"e_1_2_1_68_2","unstructured":"Thiede K. W. Klockars A. J. &Hancock G. R.(1991 April).Recognition versus recall test formats: A correlational analysis.Paper presented at the annual meeting of the National Council on Measurement in Education Chicago."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1994.tb00437.x"},{"key":"e_1_2_1_70_1","first-page":"29","volume-title":"Construction versus choice in cognitive measurement","author":"Traub R. E.","year":"1993"},{"key":"e_1_2_1_71_2","doi-asserted-by":"publisher","DOI":"10.1177\/014662167700100304"},{"key":"e_1_2_1_72_1","first-page":"128","volume-title":"Tests und trends 8: Jahrbuch der Padagogischen Diagnostik","author":"Traub R. E.","year":"1990"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1177\/014662169001400101"},{"key":"e_1_2_1_74_1","unstructured":"Veloski J. J. Robeson M. R. Rovinelli R. J. &Hojat M.(1993).IRT calibration of open\u2010ended and multiple\u2010choice test questions.Paper presented at the annual meeting of the National Council on Measurement in Education Atlanta."},{"key":"e_1_2_1_75_2","first-page":"430","article-title":"The determinants of reading comprehension","volume":"9","author":"Vernon P. E.","year":"1962","journal-title":"Educational and Psychological Measurement"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15324818ame0602_1"},{"key":"e_1_2_1_77_2","doi-asserted-by":"publisher","DOI":"10.1177\/014662168200600101"},{"key":"e_1_2_1_78_1","doi-asserted-by":"crossref","DOI":"10.1002\/j.2330-8516.1987.tb00224.x","volume-title":"A comparison of free\u2010response and multiple\u2010choice questions in the assessment of reading comprehension","author":"Ward W. C.","year":"1987"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1980.tb00811.x"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1177\/014662169501900107"}],"container-title":["Journal of Educational Measurement"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Fj.1745-3984.2003.tb01102.x","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/j.1745-3984.2003.tb01102.x","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,17]],"date-time":"2023-11-17T03:06:30Z","timestamp":1700190390000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1745-3984.2003.tb01102.x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2003,6]]},"references-count":79,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2003,6]]}},"alternative-id":["10.1111\/j.1745-3984.2003.tb01102.x"],"URL":"https:\/\/doi.org\/10.1111\/j.1745-3984.2003.tb01102.x","archive":["Portico"],"relation":{},"ISSN":["0022-0655","1745-3984"],"issn-type":[{"value":"0022-0655","type":"print"},{"value":"1745-3984","type":"electronic"}],"subject":[],"published":{"date-parts":[[2003,6]]},"assertion":[{"value":"2006-06-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}