{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:35:09Z","timestamp":1750221309549,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":16,"publisher":"ACM","license":[{"start":{"date-parts":[[2017,10,18]],"date-time":"2017-10-18T00:00:00Z","timestamp":1508284800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100003451","name":"Euskal Herriko Unibertsitatea","doi-asserted-by":"publisher","award":["EHUA 16\/22"],"award-info":[{"award-number":["EHUA 16\/22"]}],"id":[{"id":"10.13039\/501100003451","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003329","name":"Ministerio de Econom\u00eda y Competitividad","doi-asserted-by":"publisher","award":["TIN2015-71669-REDT"],"award-info":[{"award-number":["TIN2015-71669-REDT"]}],"id":[{"id":"10.13039\/501100003329","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003086","name":"Eusko Jaurlaritza","doi-asserted-by":"publisher","award":["IT980-16"],"award-info":[{"award-number":["IT980-16"]}],"id":[{"id":"10.13039\/501100003086","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2017,10,18]]},"DOI":"10.1145\/3144826.3145389","type":"proceedings-article","created":{"date-parts":[[2017,11,28]],"date-time":"2017-11-28T13:21:46Z","timestamp":1511875306000},"page":"1-8","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Rating monitoring as a means to mitigate rater effects and controversial evaluations"],"prefix":"10.1145","author":[{"given":"Mikel","family":"Villama\u00f1e","sequence":"first","affiliation":[{"name":"University of the Basque Country UPV\/EHU, Bilbao"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mikel","family":"Larra\u00f1aga","sequence":"additional","affiliation":[{"name":"University of the Basque Country UPV\/EHU, Vitoria-Gasteiz"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ainhoa","family":"\u00c1lvarez","sequence":"additional","affiliation":[{"name":"University of the Basque Country UPV\/EHU, Vitoria-Gasteiz"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,10,18]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/13.940997"},{"key":"e_1_3_2_1_2_1","first-page":"1489","article-title":"Unfolding Rater Accuracy in Performance Assessments","volume":"28","author":"Engelhard Jr.","year":"2015","unstructured":"Jr. Engelhard Jr George and Wang, Jue. 2015 . Unfolding Rater Accuracy in Performance Assessments . Rasch Meas. Trans. 28 , 4 (2015), 1489 -- 1491 . Jr. Engelhard Jr George and Wang, Jue. 2015. Unfolding Rater Accuracy in Performance Assessments. Rasch Meas. Trans. 28, 4 (2015), 1489--1491.","journal-title":"Rasch Meas. Trans."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"crossref","unstructured":"Judy Kay and Susan Bull. 2015. New Opportunities with Open Learner Models and Visual Learning Analytics. In Actas de Artificial Intelligence in Education 666--669.  Judy Kay and Susan Bull. 2015. New Opportunities with Open Learner Models and Visual Learning Analytics. In Actas de Artificial Intelligence in Education 666--669.","DOI":"10.1007\/978-3-319-19773-9_87"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tsc.2014.10.004"},{"key":"e_1_3_2_1_5_1","first-page":"386","article-title":"Detecting and measuring rater effects using many-facet Rasch measurement: part I","volume":"4","author":"Myford Carol M.","year":"2003","unstructured":"Carol M. Myford and Edward W. Wolfe . 2003 . Detecting and measuring rater effects using many-facet Rasch measurement: part I . J. Appl. Meas. 4 , 4 (2003), 386 -- 422 . Carol M. Myford and Edward W. Wolfe. 2003. Detecting and measuring rater effects using many-facet Rasch measurement: part I. J. Appl. Meas. 4, 4 (2003), 386--422.","journal-title":"J. Appl. Meas."},{"key":"e_1_3_2_1_6_1","volume-title":"Learning Analytics: How can Data be used to Improve Learning Practice. In P. Reimann, S. Bull, M. Kickmeier-Rust, R. K. Vatrapu & B","author":"Pardo Abelardo","year":"2016","unstructured":"Abelardo Pardo and Shance Dawson . 2016 . Learning Analytics: How can Data be used to Improve Learning Practice. In P. Reimann, S. Bull, M. Kickmeier-Rust, R. K. Vatrapu & B . Wasson (Eds.), Measuring and visualizing learning in the information-rich classroom,. Routledge , 41--55. Abelardo Pardo and Shance Dawson. 2016. Learning Analytics: How can Data be used to Improve Learning Practice. In P. Reimann, S. Bull, M. Kickmeier-Rust, R. K. Vatrapu & B. Wasson (Eds.), Measuring and visualizing learning in the information-rich classroom,. Routledge, 41--55."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2330601.2330605"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/13.660783"},{"volume-title":"Actas de IEEE Global Engineering Education Conference, 142--151","author":"Tervakari A. M.","key":"e_1_3_2_1_9_1","unstructured":"A. M. Tervakari , K. Silius , J. Koro , J. Paukkeri , and O. Pirttil\u00e4 . 2014. Usefulness of information visualizations based on educational data . In Actas de IEEE Global Engineering Education Conference, 142--151 . A. M. Tervakari, K. Silius, J. Koro, J. Paukkeri, and O. Pirttil\u00e4. 2014. Usefulness of information visualizations based on educational data. In Actas de IEEE Global Engineering Education Conference, 142--151."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/1733663.1733742"},{"key":"e_1_3_2_1_11_1","unstructured":"Mikel Villama\u00f1e. 2017. An\u00e1lisis y mejora de los marcos actuales de desarrollo y evaluaci\u00f3n de los Trabajos Fin de Grado mediante el uso de las TIC. Universidad del Pa\u00eds Vasco\/Euskal Herriko Unibertsitatea UPV\/EHU.  Mikel Villama\u00f1e. 2017. An\u00e1lisis y mejora de los marcos actuales de desarrollo y evaluaci\u00f3n de los Trabajos Fin de Grado mediante el uso de las TIC. Universidad del Pa\u00eds Vasco\/Euskal Herriko Unibertsitatea UPV\/EHU."},{"key":"e_1_3_2_1_12_1","first-page":"17","article-title":"Desarrollo y validaci\u00f3n de un conjunto de r\u00fabricas para la evaluaci\u00f3n de Trabajos Fin de Grado","volume":"10","author":"Villama\u00f1e Mikel","year":"2017","unstructured":"Mikel Villama\u00f1e , Ainhoa \u00c1lvarez , Mikel Larra\u00f1aga , and Bego\u00f1a Ferrero . 2017 . Desarrollo y validaci\u00f3n de un conjunto de r\u00fabricas para la evaluaci\u00f3n de Trabajos Fin de Grado . ReVisi\u00f3n 10 , 1 (2017), 17 -- 27 . Mikel Villama\u00f1e, Ainhoa \u00c1lvarez, Mikel Larra\u00f1aga, and Bego\u00f1a Ferrero. 2017. Desarrollo y validaci\u00f3n de un conjunto de r\u00fabricas para la evaluaci\u00f3n de Trabajos Fin de Grado. ReVisi\u00f3n 10, 1 (2017), 17--27.","journal-title":"ReVisi\u00f3n"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.2014.7044431"},{"key":"e_1_3_2_1_14_1","first-page":"35","article-title":"Identifying rater effects using latent trait models","volume":"46","author":"Wolfe Edward W.","year":"2004","unstructured":"Edward W. Wolfe . 2004 . Identifying rater effects using latent trait models . Psychol. Sci. 46 , 1 (2004), 35 -- 51 . Edward W. Wolfe. 2004. Identifying rater effects using latent trait models. Psychol. Sci. 46, 1 (2004), 35--51.","journal-title":"Psychol. Sci."},{"key":"e_1_3_2_1_15_1","volume-title":"Retrieved","author":"Wolfe Edward W.","year":"2014","unstructured":"Edward W. Wolfe . 2014 . Methods for monitoring rating quality: Current practices and suggested changes. Iowa City IA Pearson (2014) . Retrieved April 17, 2017 from https:\/\/www.pearson.com\/content\/dam\/one-dot-com\/one-dot-com\/global\/Files\/efficacy-and-research\/schools\/015_Wolfe_MethodsForMonitoring_May2014-2.pdf Edward W. Wolfe. 2014. Methods for monitoring rating quality: Current practices and suggested changes. Iowa City IA Pearson (2014). Retrieved April 17, 2017 from https:\/\/www.pearson.com\/content\/dam\/one-dot-com\/one-dot-com\/global\/Files\/efficacy-and-research\/schools\/015_Wolfe_MethodsForMonitoring_May2014-2.pdf"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.92.2.577"}],"event":{"name":"TEEM 2017: 5th International Conference Technological Ecosystems for Enhancing Multiculturality","sponsor":["University of Salamanca University of Salamanca"],"location":"C\u00e1diz Spain","acronym":"TEEM 2017"},"container-title":["Proceedings of the 5th International Conference on Technological Ecosystems for Enhancing Multiculturality"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3144826.3145389","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3144826.3145389","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:13:34Z","timestamp":1750212814000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3144826.3145389"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,10,18]]},"references-count":16,"alternative-id":["10.1145\/3144826.3145389","10.1145\/3144826"],"URL":"https:\/\/doi.org\/10.1145\/3144826.3145389","relation":{},"subject":[],"published":{"date-parts":[[2017,10,18]]},"assertion":[{"value":"2017-10-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}