none 10.1075/illa.1.07dav John Benjamins Publishing Company John Benjamins Publishing Company 1757 148403569 4533902 4533903 202507022207000042 10.1075 2025-07-02T20:06:58Z 2023-06-05T08:11:35Z 0 2772-9575 10.1075/illa https://benjamins.com/ catalog/illa Spiros Papageorgiou Educational Testing Service https://ror.org/03b5q4637 Venessa F. Manna Educational Testing Service https://ror.org/03b5q4637 Research to enhance score interpretation Research on how stakeholders interpret language test scores and how they make decisions about language proficiency is critical because score-based decisions can be extremely consequential for test takers, score users, such as educational institutions and employers, and the society overall. This edited volume is intended as a primary resource for language assessment researchers, developers, and policy makers interested in efficiently communicating score information related to language proficiency. Its nine chapters report on complicated, often behind-the-scenes research efforts to enhance the interpretation of English language test scores developed by ETS, by employing diverse methodologies such as vertical linking, score mapping, standard setting, scale anchoring, and score concordance. In a post-pandemic era full of challenges and change in the field of language assessment, this volume highlights the ethical responsibility of test providers to engage in sometimes challenging research and development efforts to better serve score users. 1 6 29 2023 6 5 2023 9789027213846 9789027222251 John Benjamins Publishing Company Amsterdam 10.1075/illa.1 http://www.jbe-platform.com/content/books/9789027222251 https://www.jbe-platform.com/deliver/fulltext/9789027222251.pdf https://www.degruyter.com/document/doi/10.1075/illa.1/html Larry Davis Educational Testing Service https://ror.org/03b5q4637 Pablo Garcia Gomez Educational Testing Service https://ror.org/03b5q4637 Shuhong Li Educational Testing Service https://ror.org/03b5q4637 Venessa F. Manna Educational Testing Service https://ror.org/03b5q4637 Abstract This chapter describes a study to map scores from a new English language proficiency assessment, the TOEFL® Essentials™ test, to the Common European Framework of Reference (CEFR). The project started with a comparison of content between the TOEFL Essentials test and the CEFR descriptors, which established a claim that scores were relevant to language ability as described in the CEFR. A standard setting study, using the Performance Profile method, was then conducted to establish cut scores for each CEFR level. Additional information to support the reasonableness of these cut scores is also reported. 6 29 2023 6 5 2023 120 140 10.1075/illa.1.07dav https://benjamins.com/catalog/illa.1.07dav https://www.degruyter.com/document/doi/10.1075/illa.1.07dav/html 10.4135/9781412985918 CEFR Descriptors (searchable) Council of Europe The Common European Framework of Reference for languages: Learning, teaching, assessment Council of Europe 2001 Relating language examinations to the Common European Framework of Reference for Languages: Learning, teaching, assessment. A manual Council of Europe 2009 Common European Framework of Reference for Languages: Learning, teaching, assessment. Companion volume with new descriptors Council of Europe 2020 TOEFL Essentials Test: Speaking Scoring Guide ETS 2021 TOEFL Essentials Test: Writing Scoring Guide ETS 2021 Setting Score Requirements ETS 2021 10.1016/j.asw.2019.100420 10.1111/j.1745-3992.2009.00168.x Meaningful language test scores: Research to enhance score interpretation Gu Equating test scores (without IRT) Livingston 2014 10.1177/0265532209349472 Design framework for the TOEFL® Essentials™ test 2021 Papageorgiou 2021 Meaningful language test scores: Research to enhance score interpretation Papageorgiou 10.1002/ets2.12281 Meaningful language test scores: Research to enhance score interpretation Schmidgall 10.1080/15434303.2013.869815