{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T20:23:17Z","timestamp":1780345397176,"version":"3.54.1"},"reference-count":21,"publisher":"Emerald","issue":"1","license":[{"start":{"date-parts":[[2021,5,12]],"date-time":"2021-05-12T00:00:00Z","timestamp":1620777600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["ITSE"],"published-print":{"date-parts":[[2022,2,10]]},"abstract":"<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title>\n<jats:p>The purpose of this study is to design and implement an intelligent online proctoring system (IOPS) by using the advantage of artificial intelligence technology in order to monitor the online exam, which is urgently needed in online learning settings worldwide. As a pilot application, the authors used this system in an authentic university online exam and checked the proctoring result.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title>\n<jats:p>The IOPS adopts the B\/S (Browser\/Server) architecture. The server side is implemented with programming language C and Python and stores the identification data of all examinees and their important behavior change status, including facial expression, eye and mouth movement and speech. The browser side collects and analyzes multimodal data of the examinee writing the online test locally and transfers the examinee\u2019s most important behavior status change data to the server. Real-time face recognition and voice detection are implemented with the support of open-source software.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Findings<\/jats:title>\n<jats:p>The system was integrated into a Web-based intelligent tutoring system for school mathematics education. As a pilot application, the system was also used for online proctored exam in an undergraduate seminar in Peking University during the epidemic period in 2020. The recorded log data show that all students concentrated themselves on the exam and did not leave the camera and did not speak.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title>\n<jats:p>During the epidemic period of the novel coronavirus outbreak, almost all educational institutions in the world use online learning as the best way to maintain the teaching and learning schedule for all students. However, current online instruction platforms lack the function to prevent the learners from cheating in online exams and cannot guarantee the integrity and equality for all examinees as in traditional classroom exams. The literature review shows that the online proctoring system should become an important component of online exams to tackle the growing online cheating problem. Although such proctoring systems have been developed and put on the market, the practical usage of such systems in authentic exams and its effect have not been reported. Those systems are heavyweight and commercial product and cannot be freely used in education. The light-weight IOPS developed by the authors could meet the need for online exam as a stable and practical approach and could contribute to the growing online learning and distance learning.<\/jats:p>\n<\/jats:sec>","DOI":"10.1108\/itse-12-2020-0246","type":"journal-article","created":{"date-parts":[[2021,5,10]],"date-time":"2021-05-10T04:56:24Z","timestamp":1620622584000},"page":"112-120","source":"Crossref","is-referenced-by-count":43,"title":["The design, implementation and pilot application of an intelligent online proctoring system for online exams"],"prefix":"10.1108","volume":"19","author":[{"given":"Jiyou","family":"Jia","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yunfan","family":"He","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"140","published-online":{"date-parts":[[2021,5,12]]},"reference":[{"issue":"6","key":"key2022022313483227700_ref001","doi-asserted-by":"crossref","first-page":"725","DOI":"10.1007\/BF00974740","article-title":"Detecting, understanding and controlling for cheating on tests","volume":"32","year":"1991","journal-title":"Research in Higher Education"},{"issue":"7","key":"key2022022313483227700_ref002","doi-asserted-by":"crossref","first-page":"1609","DOI":"10.1109\/TMM.2017.2656064","article-title":"Automated online exam proctoring","volume":"19","year":"2017","journal-title":"IEEE Transactions on Multimedia"},{"key":"key2022022313483227700_ref003","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2020.104024","article-title":"A systematic review of online exams: a pedagogical innovation for scalable authentication and integrity","volume":"159","year":"2020","journal-title":"Computers and Education"},{"issue":"1","key":"key2022022313483227700_ref004","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1207\/s15328023top1901_3","article-title":"Academic dishonesty: prevalence, determinants, techniques, and punishments","volume":"19","year":"1992","journal-title":"Teaching of Psychology"},{"key":"key2022022313483227700_ref005","first-page":"27","article-title":"Universal facial expressions of emotion: an old controversy and new findings","volume-title":"Nonverbal Communication: Where Nature Meets Culture","year":"1997"},{"key":"key2022022313483227700_ref006","unstructured":"Foster, D. and Layman, H. (2013), \u201cOnline proctoring systems compared\u201d, Webinar, available at: www.slideshare.net\/caveonweb\/caveon-webinar-series-online-proctoring-best-practicesoct-2013-slideshare-final, Retrieved on Jan. 15, 2021."},{"key":"key2022022313483227700_ref007","article-title":"U.S. Patent application no. 12\/723,663","year":"2011"},{"issue":"4","key":"key2022022313483227700_ref008","doi-asserted-by":"crossref","first-page":"509","DOI":"10.5944\/openpraxis.12.4.1113","article-title":"An evaluation of online proctoring tools","volume":"12","year":"2020","journal-title":"Open Praxis"},{"issue":"2","key":"key2022022313483227700_ref009","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1609\/aimag.v30i2.2232","article-title":"An AI framework to teach English as a foreign language: CSIEC","volume":"30","year":"2009","journal-title":"AI Magazine"},{"key":"key2022022313483227700_ref010","first-page":"211","article-title":"Design, implementation and evaluation of blended learning for the undergraduate course \u2018education and artificial intelligence\u2019","volume-title":"Technology in Education: Innovative Solutions and Practices: Proceedings of ICTE 2018 (Jan. 8-11, Hong Kong China)","year":"2018"},{"key":"key2022022313483227700_ref011","first-page":"213","article-title":"Online learning activity index (OLAI) and its application for adaptive learning","volume-title":"Blended Learning \u2013 New Challenges and Innovative Practices","year":"2017"},{"key":"key2022022313483227700_ref012","first-page":"3","article-title":"A multimodal human-computer interaction system and its application in smart learning environments","volume-title":"Blended Learning. Education in a Smart Learning Environment. ICBL 2020","year":"2020"},{"issue":"1","key":"key2022022313483227700_ref013","article-title":"E-cheating: incidence and trends among college students","volume":"15","year":"2014","journal-title":"Issues in Information Systems"},{"issue":"1","key":"key2022022313483227700_ref014","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1007\/s10734-006-9047-z","article-title":"Academic dishonesty in higher education \u2013 a nationwide study in Taiwan","volume":"54","year":"2007","journal-title":"Higher Education"},{"key":"key2022022313483227700_ref015","volume-title":"Affective Computing","year":"2000"},{"issue":"3","key":"key2022022313483227700_ref016","first-page":"195","article-title":"An integrated approach to preempt cheating on asynchronous, objective, online assessments in graduate business classes","volume":"20","year":"2016","journal-title":"Online Learning"},{"issue":"1","key":"key2022022313483227700_ref017","first-page":"31","article-title":"Ive got my virtual eye on you: remote proctors and academic integrity","volume":"2","year":"2009","journal-title":"Contemporary Issues in Education Research (CIER)"},{"key":"key2022022313483227700_ref018","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1016\/j.patrec.2013.07.003","article-title":"Multimodal interaction: a review","volume":"36","year":"2014","journal-title":"Pattern Recognition Letters"},{"key":"key2022022313483227700_ref019","unstructured":"UNESCO (2020), \u201c1.37 Billion students now home as COVID-19 school closures expand, ministers scale up multimedia approaches to ensure learning continuity\u201d, available at: https:\/\/en.unesco.org\/news\/137-billion-students-now-home-covid-19-school-closures-expand-ministers-scale-multimedia, Retrieved on Jan. 15, 2021."},{"key":"key2022022313483227700_ref020","article-title":"A pilot study of emotion detection using sensors in a learning context: towards an affective learning companion","volume-title":"DeLFI\/GMW Workshops","year":"2017"},{"key":"key2022022313483227700_ref021","first-page":"126","article-title":"Evaluating an intelligent tutoring system for personalized math teaching","year":"2017"}],"container-title":["Interactive Technology and Smart Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/ITSE-12-2020-0246\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/ITSE-12-2020-0246\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T21:57:17Z","timestamp":1753394237000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/itse\/article\/19\/1\/112-120\/178170"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,12]]},"references-count":21,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,5,12]]},"published-print":{"date-parts":[[2022,2,10]]}},"alternative-id":["10.1108\/ITSE-12-2020-0246"],"URL":"https:\/\/doi.org\/10.1108\/itse-12-2020-0246","relation":{},"ISSN":["1741-5659","1741-5659"],"issn-type":[{"value":"1741-5659","type":"print"},{"value":"1741-5659","type":"print"}],"subject":[],"published":{"date-parts":[[2021,5,12]]}}}