{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,29]],"date-time":"2025-10-29T13:32:19Z","timestamp":1761744739503,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":24,"publisher":"ACM","license":[{"start":{"date-parts":[[2018,6,26]],"date-time":"2018-06-26T00:00:00Z","timestamp":1529971200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2018,6,26]]},"DOI":"10.1145\/3231644.3231667","type":"proceedings-article","created":{"date-parts":[[2018,6,19]],"date-time":"2018-06-19T12:36:46Z","timestamp":1529411806000},"page":"1-10","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["How do professors format exams?"],"prefix":"10.1145","author":[{"given":"Paul","family":"Laskowski","sequence":"first","affiliation":[{"name":"UC Berkeley"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sergey","family":"Karayev","sequence":"additional","affiliation":[{"name":"Gradescope"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marti A.","family":"Hearst","sequence":"additional","affiliation":[{"name":"UC Berkeley"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,6,26]]},"reference":[{"doi-asserted-by":"publisher","key":"e_1_3_2_1_1_1","DOI":"10.18637\/jss.v067.i01"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_2_1","DOI":"10.1111\/j.1475-4932.1999.tb02571.x"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_3_1","DOI":"10.1037\/0022-0663.88.2.333"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_4_1","DOI":"10.1177\/027347538901100307"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_5_1","DOI":"10.1037\/h0058518"},{"key":"e_1_3_2_1_6_1","volume-title":"Coefficient alpha and the internal structure of tests. psychometrika 16, 3","author":"Cronbach L. J.","year":"1951","unstructured":"Cronbach , L. J. Coefficient alpha and the internal structure of tests. psychometrika 16, 3 ( 1951 ), 297--334. Cronbach, L. J. Coefficient alpha and the internal structure of tests. psychometrika 16, 3 (1951), 297--334."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_7_1","DOI":"10.1111\/j.1745-3984.1975.tb01006.x"},{"key":"e_1_3_2_1_8_1","volume-title":"Essentials of educational measurement","author":"Frisbie D.","year":"1991","unstructured":"Frisbie , D. , and Ebel , R . Essentials of educational measurement , 1991 . Frisbie, D., and Ebel, R. Essentials of educational measurement, 1991."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_9_1","DOI":"10.1111\/j.1745-3984.1973.tb00807.x"},{"key":"e_1_3_2_1_10_1","volume-title":"Ninth Edition. Pearson","author":"Gronlund N. E.","year":"2009","unstructured":"Gronlund , N. E. , and Waugh , C. K . Assessment of Student Achievement , Ninth Edition. Pearson , 2009 . Gronlund, N. E., and Waugh, C. K. Assessment of Student Achievement, Ninth Edition. Pearson, 2009."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_11_1","DOI":"10.1080\/00220973.1974.10806302"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_12_1","DOI":"10.1007\/BF02289270"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_13_1","DOI":"10.1177\/009862838401100405"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_14_1","DOI":"10.1111\/j.1745-3984.1970.tb00704.x"},{"key":"e_1_3_2_1_15_1","volume-title":"E-assessment by design: using multiple-choice tests to good effect. Journal of Further and higher Education 31, 1","author":"Nicol D.","year":"2007","unstructured":"Nicol , D. E-assessment by design: using multiple-choice tests to good effect. Journal of Further and higher Education 31, 1 ( 2007 ), 53--64. Nicol, D. E-assessment by design: using multiple-choice tests to good effect. Journal of Further and higher Education 31, 1 (2007), 53--64."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_16_1","DOI":"10.1186\/1472-6920-7-49"},{"key":"e_1_3_2_1_17_1","first-page":"3","article-title":"Multiple-choice exam question order influences on student performance, completion time, and perceptions","volume":"34","author":"Pettijohn T. F.","year":"2007","unstructured":"Pettijohn , T. F. , Sacco , M. F. , Multiple-choice exam question order influences on student performance, completion time, and perceptions . Journal of Instructional Psychology 34 , 3 ( 2007 ), 142--150. Pettijohn, T. F., Sacco, M. F., et al. Multiple-choice exam question order influences on student performance, completion time, and perceptions. Journal of Instructional Psychology 34, 3 (2007), 142--150.","journal-title":"Journal of Instructional Psychology"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_18_1","DOI":"10.1111\/j.1745-3984.1982.tb00114.x"},{"key":"e_1_3_2_1_19_1","first-page":"4","article-title":"Multiple-choice versus open-ended response formats of reading test items: A two-dimensional irt analysis","volume":"52","author":"Rauch D. P.","year":"2010","unstructured":"Rauch , D. P. , and Hartig , J . Multiple-choice versus open-ended response formats of reading test items: A two-dimensional irt analysis . Psychological Test and Assessment Modeling 52 , 4 ( 2010 ), 354--379. Rauch, D. P., and Hartig, J. Multiple-choice versus open-ended response formats of reading test items: A two-dimensional irt analysis. Psychological Test and Assessment Modeling 52, 4 (2010), 354--379.","journal-title":"Psychological Test and Assessment Modeling"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_20_1","DOI":"10.1023\/A:1003196224280"},{"key":"e_1_3_2_1_21_1","first-page":"2","article-title":"why and how. Bulletin on classroom testing","author":"Stecklein J.","year":"1955","unstructured":"Stecklein , J. Essay tests : why and how. Bulletin on classroom testing . University of Minnesota Bureau of Institutional Research 2 ( 1955 ). Stecklein, J. Essay tests: why and how. Bulletin on classroom testing. University of Minnesota Bureau of Institutional Research 2 (1955).","journal-title":"University of Minnesota Bureau of Institutional Research"},{"key":"e_1_3_2_1_22_1","volume-title":"What is a good test? In Classroom Test Construction","author":"Stecklein J.","year":"1974","unstructured":"Stecklein , J. What is a good test? In Classroom Test Construction , T. Covin, Ed. MSS Information Corporation , 1974 . Stecklein, J. What is a good test? In Classroom Test Construction, T. Covin, Ed. MSS Information Corporation, 1974."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_23_1","DOI":"10.1111\/j.1745-3984.1994.tb00437.x"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_24_1","DOI":"10.1007\/978-0-387-73186-5_11"}],"event":{"acronym":"L@S '18","name":"L@S '18: Fifth (2018) ACM Conference on Learning @ Scale","location":"London United Kingdom"},"container-title":["Proceedings of the Fifth Annual ACM Conference on Learning at Scale"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3231644.3231667","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3231644.3231667","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:08:08Z","timestamp":1750212488000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3231644.3231667"}},"subtitle":["an analysis of question variety at scale"],"short-title":[],"issued":{"date-parts":[[2018,6,26]]},"references-count":24,"alternative-id":["10.1145\/3231644.3231667","10.1145\/3231644"],"URL":"https:\/\/doi.org\/10.1145\/3231644.3231667","relation":{},"subject":[],"published":{"date-parts":[[2018,6,26]]},"assertion":[{"value":"2018-06-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}