{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2022,6,2]],"date-time":"2022-06-02T03:40:57Z","timestamp":1654141257283},"reference-count":56,"publisher":"IGI Global","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2013,4,1]]},"abstract":"
Extant literature asserted that peer assessments improved learning but only a few studies had addressed the student rating consistency issue and not had evaluated this within a Learning Management System (LMS). The researcher explored how to conduct peer assessments in Moodle LMS for a hybrid-mode business course (N=90 students) which required 270 (25-page) reports. Rater agreement statistical theory was applied to test the consistency of student peer assessments. The resulting coefficient was 0.79 and statistically significant. A pair-wise t-test and a nonparametric Mann Whitley u-test confirmed there was no significant difference between the student ratings and the scores given by the professor on the same assignments. Nonparametric Spearman correlation was very high between each student rating coefficient as compared to the score given in Moodle, which indicated the LMS was reliable in providing a grade for the quality of student peer assessment. A protocol was developed using SPSS to calculate a peer assessment inter-rater agreement consistency indicator since this was not available in Moodle.<\/p>","DOI":"10.4018\/jwltt.2013040103","type":"journal-article","created":{"date-parts":[[2013,12,16]],"date-time":"2013-12-16T17:08:36Z","timestamp":1387213716000},"page":"58-76","source":"Crossref","is-referenced-by-count":1,"title":["Determining the Consistency of Student Grading in a Hybrid Business Course using a LMS and Statistical Software"],"prefix":"10.4018","volume":"8","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-4333-4399","authenticated-orcid":true,"given":"Kenneth David","family":"Strang","sequence":"first","affiliation":[{"name":"State University of New York, Plattsburgh, NY, USA & APPC Research, Australia"}]}],"member":"2432","reference":[{"key":"jwltt.2013040103-0","author":"L.Anderson","year":"2001","journal-title":"A taxonomy for learning, teaching and assessing: A revision of Bloom's taxonomy of educational objectives"},{"issue":"5","key":"jwltt.2013040103-1","first-page":"891","article-title":"Towards a learner-centred approach: interactive online peer assessment.","volume":"26","author":"A.Bayat","year":"2012","journal-title":"South African Journal of Higher Education"},{"issue":"2","key":"jwltt.2013040103-2","first-page":"11","article-title":"Addressing instructor ambivalence about peer review and self-assessment.","volume":"34","author":"P.Bedore","year":"2011","journal-title":"Journal of the Council of Writing Program Administrators"},{"key":"jwltt.2013040103-3","author":"G. G.Bitter","year":"2008","journal-title":"Using technology in the classroom"},{"key":"jwltt.2013040103-4","doi-asserted-by":"publisher","DOI":"10.1037\/h0026256"},{"key":"jwltt.2013040103-5","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.112.1.155"},{"key":"jwltt.2013040103-6","author":"J.Cohen","year":"2003","journal-title":"Applied multiple regression\/correlation analysis for the behavioral sciences"},{"key":"jwltt.2013040103-7","doi-asserted-by":"publisher","DOI":"10.1504\/IJMIE.2009.027348"},{"key":"jwltt.2013040103-8","author":"J. W.Creswell","year":"2009","journal-title":"Research design: Qualitative, quantitative, and mixed methods approaches"},{"key":"jwltt.2013040103-9","doi-asserted-by":"publisher","DOI":"10.5688\/ajpe76461"},{"issue":"4","key":"jwltt.2013040103-10","first-page":"39","article-title":"An integrated framework for assessing oral presentations using peer, self, and instructor assessment strategies.","volume":"55","author":"A.Dollisso","year":"2011","journal-title":"NACTA Journal"},{"key":"jwltt.2013040103-11","doi-asserted-by":"publisher","DOI":"10.3102\/00346543070003287"},{"key":"jwltt.2013040103-12","doi-asserted-by":"publisher","DOI":"10.3109\/0142159X.2010.546909"},{"key":"jwltt.2013040103-13","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.86.5.974"},{"key":"jwltt.2013040103-14","doi-asserted-by":"publisher","DOI":"10.1080\/02602930903221444"},{"key":"jwltt.2013040103-15","doi-asserted-by":"publisher","DOI":"10.1080\/03075071003759037"},{"key":"jwltt.2013040103-16","author":"J.Gill","year":"2010","journal-title":"Research methods for managers"},{"key":"jwltt.2013040103-17","volume":"Vol. 6","author":"S. K.Green","year":"2010","journal-title":"Essential characteristics of assessment"},{"key":"jwltt.2013040103-18","author":"J. F.Hair","year":"2006","journal-title":"Multivariate data analysis"},{"key":"jwltt.2013040103-19","doi-asserted-by":"publisher","DOI":"10.1080\/02602931003632365"},{"key":"jwltt.2013040103-20","doi-asserted-by":"publisher","DOI":"10.1002\/ace.117"},{"key":"jwltt.2013040103-21","author":"G.Keppel","year":"2004","journal-title":"Design and analysis: A researcher's handbook"},{"issue":"4","key":"jwltt.2013040103-22","first-page":"1979","article-title":"The views of prospective class teachers about peer assessment in teaching practice.","volume":"11","year":"2011","journal-title":"Educational Sciences: Theory and Practice"},{"key":"jwltt.2013040103-23","doi-asserted-by":"publisher","DOI":"10.5688\/ajpe75473"},{"key":"jwltt.2013040103-24","doi-asserted-by":"publisher","DOI":"10.1007\/s10734-006-9044-2"},{"issue":"2","key":"jwltt.2013040103-25","first-page":"1","article-title":"How do students of diverse achievement levels benefit from peer assessment?","volume":"5","author":"L.Li","year":"2011","journal-title":"International Journal for the Scholarship of Teaching & Learning"},{"issue":"3","key":"jwltt.2013040103-26","first-page":"1005","article-title":"On-line peer assessment of Chinese students' oral presentation in English.","volume":"9","author":"L.Li","year":"2012","journal-title":"Sino-US English Teaching"},{"key":"jwltt.2013040103-27","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8535.2011.01180.x"},{"key":"jwltt.2013040103-28","doi-asserted-by":"publisher","DOI":"10.1007\/s11251-011-9177-2"},{"key":"jwltt.2013040103-29","doi-asserted-by":"publisher","DOI":"10.2190\/EC.46.3.f"},{"issue":"1","key":"jwltt.2013040103-30","first-page":"54","article-title":"Assessment, blending and creativity: The abc of technology in mathematics teaching.","volume":"14","author":"M.McCabe","year":"2007","journal-title":"The International Journal for Technology in Mathematics Education"},{"key":"jwltt.2013040103-31","doi-asserted-by":"publisher","DOI":"10.1093\/elt\/ccq062"},{"key":"jwltt.2013040103-32","unstructured":"Mudrak, D. (2011a, January 11). Best assessment rater scoring in Moodle workshop 2.0. Retrieved June 1, 2013, from http:\/\/docs.moodle.org\/24\/en\/Using_Workshop"},{"key":"jwltt.2013040103-33","unstructured":"Mudrak, D. (2011b, January 6). Moodle workshop 2.0 specifications. Retrieved June 1, 2013, from http:\/\/docs.moodle.org\/dev\/Workshop_2.0_specification"},{"key":"jwltt.2013040103-34","doi-asserted-by":"publisher","DOI":"10.1080\/02602930903342315"},{"key":"jwltt.2013040103-35","doi-asserted-by":"publisher","DOI":"10.1080\/03098265.2011.552104"},{"key":"jwltt.2013040103-36","doi-asserted-by":"publisher","DOI":"10.1080\/02602930903540983"},{"key":"jwltt.2013040103-37","volume":"Vol. 5","author":"M. K.Russell","year":"2012","journal-title":"Summative assessments"},{"key":"jwltt.2013040103-38","doi-asserted-by":"publisher","DOI":"10.1080\/03075070802706553"},{"issue":"5","key":"jwltt.2013040103-39","first-page":"829","article-title":"Can web 2.0 technology assist college students in learning English writing? Integrating Facebook and peer assessment with blended learning.","volume":"27","author":"R.-C.Shih","year":"2011","journal-title":"Australasian Journal of Educational Technology"},{"key":"jwltt.2013040103-40","doi-asserted-by":"publisher","DOI":"10.3109\/0142159X.2011.610835"},{"key":"jwltt.2013040103-41","doi-asserted-by":"publisher","DOI":"10.1108\/17504970810911043"},{"issue":"3","key":"jwltt.2013040103-42","first-page":"1","article-title":"Using recursive regression to explore nonlinear relationships and interactions: A tutorial applied to a multicultural education study.","volume":"14","author":"K. D.Strang","year":"2009","journal-title":"Practical Assessment, Research & Evaluation"},{"key":"jwltt.2013040103-43","doi-asserted-by":"publisher","DOI":"10.1080\/14675986.2010.533034"},{"key":"jwltt.2013040103-44","doi-asserted-by":"publisher","DOI":"10.1504\/IJCEELL.2010.036818"},{"key":"jwltt.2013040103-45","doi-asserted-by":"publisher","DOI":"10.1504\/IJIEM.2011.045112"},{"key":"jwltt.2013040103-46","doi-asserted-by":"publisher","DOI":"10.1504\/IJTEL.2013.055947"},{"key":"jwltt.2013040103-47","doi-asserted-by":"publisher","DOI":"10.4018\/ijrcm.2013040101"},{"key":"jwltt.2013040103-48","doi-asserted-by":"publisher","DOI":"10.4018\/ijrcm.2012010103"},{"key":"jwltt.2013040103-49","doi-asserted-by":"publisher","DOI":"10.3102\/00346543076001093"},{"issue":"1","key":"jwltt.2013040103-50","doi-asserted-by":"crossref","first-page":"1","DOI":"10.53761\/1.8.1.5","article-title":"Using self- and peer-assessment to enhance students' future-learning in higher education.","volume":"8","author":"G.Thomas","year":"2011","journal-title":"Journal of University Teaching & Learning Practice"},{"key":"jwltt.2013040103-51","doi-asserted-by":"publisher","DOI":"10.1080\/03043797.2010.490577"},{"key":"jwltt.2013040103-52","doi-asserted-by":"publisher","DOI":"10.5688\/ajpe76462"},{"issue":"3","key":"jwltt.2013040103-53","first-page":"442","article-title":"Exploring students' cognitive dimensions and behavioral patterns during a synchronous peer assessment discussion activity using instant messaging.","volume":"21","author":"S.-Y.Wu","year":"2012","journal-title":"Asia-Pacific Education Researcher"},{"key":"jwltt.2013040103-54","doi-asserted-by":"crossref","first-page":"155","DOI":"10.28945\/1634","article-title":"Peer assessment of soft skills and hard skills.","volume":"11","author":"A.Zhang","year":"2012","journal-title":"Journal of Information Technology Education"},{"issue":"1","key":"jwltt.2013040103-55","first-page":"187","article-title":"Using peer feedback to improve learning via online peer assessment.","volume":"12","author":"E.Zhi-Feng Liu","year":"2013","journal-title":"Turkish Online Journal of Educational Technology"}],"container-title":["International Journal of Web-Based Learning and Teaching Technologies"],"original-title":[],"language":"ng","link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=96898","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,6,2]],"date-time":"2022-06-02T03:02:39Z","timestamp":1654138959000},"score":1,"resource":{"primary":{"URL":"https:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/jwltt.2013040103"}},"subtitle":[""],"short-title":[],"issued":{"date-parts":[[2013,4,1]]},"references-count":56,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2013,4]]}},"URL":"http:\/\/dx.doi.org\/10.4018\/jwltt.2013040103","relation":{},"ISSN":["1548-1093","1548-1107"],"issn-type":[{"value":"1548-1093","type":"print"},{"value":"1548-1107","type":"electronic"}],"subject":["Computer Science Applications","Education"],"published":{"date-parts":[[2013,4,1]]}}}