{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T01:15:31Z","timestamp":1781313331219,"version":"3.54.1"},"reference-count":70,"publisher":"Emerald","issue":"2","license":[{"start":{"date-parts":[[2021,9,2]],"date-time":"2021-09-02T00:00:00Z","timestamp":1630540800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["ITSE"],"published-print":{"date-parts":[[2022,5,11]]},"abstract":"<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title>\n<jats:p>This study aims to present research evidence on the relevance of online gamification flip learning as a pedagogical instruction in promoting learning engagement when college students are impacted by the coronavirus pandemic. In this study, a gamified formative assessment was used to examine learner engagement and to evaluate the effectiveness of gamification within a synchronous online flipped instruction.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title>\n<jats:p>A multiphase mixed methods research design was used for this study. The evaluation relied on triangulated evidence gathered through questionnaire surveys and semi-structured interviews administered at an Indonesian college setting.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Findings<\/jats:title>\n<jats:p>Based on the findings, gamified learning and formative assessments that adopt online flipped approaches have shown a positive bearing on learner engagement, despite the challenges learners face while harrowing through times of calamity. The results of this study provide prima facie support for the claim that the use of interactive gamified e-quizzes proves to be an innovative means of stimulating student engagement during the online class.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title>\n<jats:p>The results further suggest that a learning framework that incorporates both online flipped and gamification techniques provide the stimulus that is likely to forge an emotional connection that can inspire learner engagement, much needed when learners rally through calamitous events. This study has established evidential links between gamification and flipped classroom instructional delivery, particularly for online class settings. It is well-anticipated that gamification flip learning can continue to be implemented either in online, blended or face-to-face class instruction and particularly after the time of the pandemic.<\/jats:p>\n<\/jats:sec>","DOI":"10.1108\/itse-01-2021-0002","type":"journal-article","created":{"date-parts":[[2021,9,8]],"date-time":"2021-09-08T07:28:46Z","timestamp":1631086126000},"page":"236-259","source":"Crossref","is-referenced-by-count":29,"title":["Synchronous online flip learning with formative gamification quiz: instruction during COVID-19"],"prefix":"10.1108","volume":"19","author":[{"given":"Zamzami","family":"Zainuddin","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ratna","family":"Farida","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cut Muftia","family":"Keumala","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rudi","family":"Kurniawan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hadi","family":"Iskandar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"140","published-online":{"date-parts":[[2021,9,2]]},"reference":[{"issue":"2","key":"key2022051008295291700_ref001","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1037\/adb0000160","article-title":"The relationship between addictive use of social media and video games and symptoms of psychiatric disorders: a large-scale cross-sectional study","volume":"30","year":"2016","journal-title":"Psychology of Addictive Behaviors"},{"key":"key2022051008295291700_ref001a","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1016\/j.chb.2017.10.001","article-title":"A qualitative investigation of student perceptions of game elements in a gamified course","volume":"78","year":"2018","journal-title":"Computers in Human Behavior"},{"key":"key2022051008295291700_ref002","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.tate.2016.11.006","article-title":"Mathematics teachers' motivations for, conceptions of, and experiences with flipped instruction","volume":"62","year":"2017","journal-title":"Teaching and Teacher Education"},{"key":"key2022051008295291700_ref002a","article-title":"Global education Coalition","year":"2021"},{"issue":"3","key":"key2022051008295291700_ref003","doi-asserted-by":"crossref","first-page":"285","DOI":"10.20448\/journal.509.2020.73.285.292","article-title":"Determinants of students\u2019 perceived learning outcome and satisfaction in online learning during the pandemic of COVID-19","volume":"7","year":"2020","journal-title":"Journal of Education and e-Learning Research"},{"issue":"3","key":"key2022051008295291700_ref004","first-page":"119","article-title":"Applying basic gamification techniques to IT compliance training: evidence from the lab and field","volume":"30","year":"2015","journal-title":"Journal of Information Systems"},{"issue":"3","key":"key2022051008295291700_ref005","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1080\/1475939X.2019.1580609","article-title":"The examination of the gamification process in undergraduate education: a scale development study","volume":"28","year":"2019","journal-title":"Technology, Pedagogy and Education"},{"key":"key2022051008295291700_ref006","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.compedu.2017.07.014","article-title":"Re-designed flipped learning model in an academic course: the role of co-creation and co-regulation","volume":"115","year":"2017","journal-title":"Computers and Education"},{"issue":"3","key":"key2022051008295291700_ref007","doi-asserted-by":"publisher","DOI":"10.5817\/cp2015-3-4","article-title":"A conceptual affective design framework for the use of emotions in computer game design","volume":"9","year":"2015","journal-title":"Cyberpsychology: Journal of Psychosocial Research on Cyberspace"},{"issue":"1","key":"key2022051008295291700_ref008","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1108\/ITSE-06-2019-0027","article-title":"The students\u2019 readiness to engage with mobile learning apps","volume":"17","year":"2019","journal-title":"Interactive Technology and Smart Education"},{"issue":"1","key":"key2022051008295291700_ref009","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1080\/14703297.2017.1348960","article-title":"Digital games for learning energy conservation: a study of impacts on motivation, attention, and learning outcomes","volume":"56","year":"2019","journal-title":"Innovations in Education and Teaching International"},{"key":"key2022051008295291700_ref010","volume-title":"Handbook of Research on Student Engagement","year":"2012"},{"key":"key2022051008295291700_ref011","volume-title":"Statistical Power Analysis for the Behavioral Sciences","year":"1988"},{"key":"key2022051008295291700_ref012","volume-title":"Research Design: Qualitative, Quantitative, and Mixed Methods Approaches","year":"2018"},{"key":"key2022051008295291700_ref013","volume-title":"Flow: The Psychology of Optimal Experience","year":"2008"},{"issue":"4","key":"key2022051008295291700_ref014","first-page":"309","article-title":"Gamified information systems and user engagement","volume":"6","year":"2020","journal-title":"The Quarterly Review of Business Disciplines"},{"key":"key2022051008295291700_ref0014","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1016\/j.compedu.2017.06.016","article-title":"Studies of student engagement in gamified online discussions","volume":"115","year":"2017","journal-title":"Computers & Education"},{"key":"key2022051008295291700_ref0015","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1016\/j.compedu.2018.02.007","article-title":"An exploratory study of student engagement in gamified online discussions","volume":"120","year":"2018","journal-title":"Computers & Education"},{"issue":"3","key":"key2022051008295291700_ref015","doi-asserted-by":"crossref","first-page":"409","DOI":"10.17507\/jltr.1103.09","article-title":"An investigation into students\u2019 agentic engagement in online English listening learning","volume":"11","year":"2020","journal-title":"Journal of Language Teaching and Research"},{"issue":"3","key":"key2022051008295291700_ref016","first-page":"479","article-title":"The effects of a flipped classroom approach on class engagement and skill performance in a blackboard course","volume":"49","year":"2017","journal-title":"British Journal of Educational Technology"},{"issue":"1","key":"key2022051008295291700_ref017","doi-asserted-by":"crossref","first-page":"1","DOI":"10.11648\/j.ajtas.20160501.11","article-title":"Comparison of convenience sampling and purposive sampling","volume":"5","year":"2016","journal-title":"American Journal of Theoretical and Applied Statistics"},{"key":"key2022051008295291700_ref018","volume-title":"Handbook of Research on Student-Centered Strategies in Online Adult Learning Environments","year":"2018"},{"key":"key2022051008295291700_ref019","doi-asserted-by":"publisher","DOI":"10.21125\/edulearn.2020.1034","article-title":"Improving flipped learning through gamification","volume-title":"EDULEARN20 Proceedings","year":"2020"},{"key":"key2022051008295291700_ref020","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.compedu.2019.02.015","article-title":"Comparing success and engagement in gamified learning experiences via Kahoot and quizizz","volume":"135","year":"2019","journal-title":"Computers and Education"},{"issue":"1","key":"key2022051008295291700_ref021","doi-asserted-by":"crossref","first-page":"46","DOI":"10.4995\/muse.2019.9959","article-title":"Application of innovative teaching-learning methodologies in the classroom. Coaching, flipped-classroom and gamification. A case study of success","volume":"6","year":"2019","journal-title":"Multidisciplinary Journal for Education, Social and Technological Sciences"},{"issue":"1","key":"key2022051008295291700_ref0021","doi-asserted-by":"crossref","first-page":"67","DOI":"10.4103\/aca.ACA_157_18","article-title":"Descriptive statistics and normality tests for statistical data","volume":"22","year":"2019","journal-title":"Annals of Cardiac Anaesthesia"},{"issue":"1","key":"key2022051008295291700_ref022","doi-asserted-by":"crossref","first-page":"1","DOI":"10.13181\/mji.ed.204629","article-title":"Social responsibility of medical journal: a concern for COVID-19 pandemic","volume":"29","year":"2020","journal-title":"Medical Journal of Indonesia"},{"key":"key2022051008295291700_ref023","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1016\/j.ijinfomgt.2018.12.004","article-title":"How motivational feedback increases user\u2019s benefits and continued use: a study on gamification, quantified-self and social networking","volume":"46","year":"2019","journal-title":"International Journal of Information Management"},{"issue":"8","key":"key2022051008295291700_ref024","doi-asserted-by":"crossref","first-page":"1106","DOI":"10.1080\/10494820.2018.1495653","article-title":"Investigating the effects of gamification-enhanced flipped learning on undergraduate students\u2019 behavioral and cognitive engagement","volume":"27","year":"2019","journal-title":"Interactive Learning Environments"},{"key":"key2022051008295291700_ref025","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1016\/j.chb.2019.05.020","article-title":"Mobile game-based learning in secondary education: students\u2019 immersion, game activities, team performance and learning outcomes","volume":"99","year":"2019","journal-title":"Computers in Human Behavior"},{"key":"key2022051008295291700_ref026","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1016\/j.compedu.2018.06.022","article-title":"Examining competitive, collaborative and adaptive gamification in young learners' math learning","volume":"125","year":"2018","journal-title":"Computers and Education"},{"issue":"5","key":"key2022051008295291700_ref027","doi-asserted-by":"crossref","first-page":"1626","DOI":"10.1002\/cae.21992","article-title":"A comparative study on gamification of the flipped classroom in engineering education to enhance the effects of learning","volume":"26","year":"2018","journal-title":"Computer Applications in Engineering Education"},{"issue":"2","key":"key2022051008295291700_ref028","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1177\/0963721417737877","article-title":"Neuroforecasting aggregate choice","volume":"27","year":"2018","journal-title":"Current Directions in Psychological Science"},{"key":"key2022051008295291700_ref029","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1016\/j.chb.2015.08.025","article-title":"How gamification motivates visits and engagement for online academic dissemination \u2013 an empirical study","volume":"55","year":"2016","journal-title":"Computers in Human Behavior"},{"key":"key2022051008295291700_ref030","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.compedu.2019.02.021","article-title":"Student enrollment, motivation and learning performance in a blended learning environment: the mediating effects of social, teaching, and cognitive presence","volume":"136","year":"2019","journal-title":"Computers and Education"},{"key":"key2022051008295291700_ref031","doi-asserted-by":"publisher","DOI":"10.1111\/bjet.12717","article-title":"What affects learner engagement in flipped learning and what predicts its outcomes?","year":"2018","journal-title":"British Journal of Educational Technology"},{"key":"key2022051008295291700_ref032","first-page":"124","article-title":"How paper and digital children's books support student understanding","volume-title":"In Handbook of Research on Literacy and Digital Technology Integration in Teacher Education, Essay","year":"2020"},{"issue":"4","key":"key2022051008295291700_ref033","first-page":"464","article-title":"A comparison of flipped learning with gamification, traditional learning, and online independent study: the effects on students\u2019 mathematics achievement and cognitive engagement","volume":"28","year":"2018","journal-title":"Interactive Learning Environments"},{"key":"key2022051008295291700_ref034","doi-asserted-by":"publisher","article-title":"Qualitative coding: an approach to assess inter-rater reliability","year":"2017","DOI":"10.18260\/1-2\u201328777"},{"key":"key2022051008295291700_ref035","first-page":"1","article-title":"The effectiveness of formative assessment: student views and staff reflections","year":"2020","journal-title":"Assessment and Evaluation in Higher Education"},{"issue":"6","key":"key2022051008295291700_ref036","doi-asserted-by":"crossref","first-page":"562","DOI":"10.1111\/jcal.12200","article-title":"Diverse delivery methods and strong psychological benefits: a review of online formative assessment","volume":"33","year":"2017","journal-title":"Journal of Computer Assisted Learning"},{"issue":"4","key":"key2022051008295291700_ref037","first-page":"450","article-title":"Development and validation of an enlarged version of the student agentic engagement scale","volume":"37","year":"2018","journal-title":"Journal of Psychoeducational Assessment"},{"key":"key2022051008295291700_ref038","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.compedu.2018.04.012","article-title":"Exploring the impacts of interactions, social presence and emotional engagement on active collaborative learning in a social web-based environment","volume":"123","year":"2018","journal-title":"Computers and Education"},{"key":"key2022051008295291700_ref039","doi-asserted-by":"crossref","first-page":"103608","DOI":"10.1016\/j.compedu.2019.103608","article-title":"How the flipped classroom affects knowledge, skills, and engagement in higher education: effects on students' satisfaction","volume":"141","year":"2019","journal-title":"Computers and Education"},{"issue":"3","key":"key2022051008295291700_ref040","doi-asserted-by":"publisher","DOI":"10.5812\/sdme.67670","article-title":"Snowball sampling: a purposeful method of sampling in qualitative research","volume":"14","year":"2017","journal-title":"Strides in Development of Medical Education"},{"issue":"1","key":"key2022051008295291700_ref041","doi-asserted-by":"publisher","DOI":"10.5206\/cjsotl-rcacea.2019.1.8002","article-title":"A mixed blessing? Students\u2019 and instructors\u2019 perspectives about off-task technology use in the academic classroom","volume":"10","year":"2019","journal-title":"The Canadian Journal for the Scholarship of Teaching and Learning"},{"key":"key2022051008295291700_ref042","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.appdev.2019.01.004","article-title":"Agency and high school science students' motivation, engagement, and classroom support experiences","volume":"62","year":"2019","journal-title":"Journal of Applied Developmental Psychology"},{"key":"key2022051008295291700_ref043","doi-asserted-by":"crossref","first-page":"103682","DOI":"10.1016\/j.compedu.2019.103682","article-title":"Learning and instruction in the hybrid virtual classroom: an investigation of students\u2019 engagement and the effect of quizzes","volume":"143","year":"2020","journal-title":"Computers and Education"},{"issue":"3","key":"key2022051008295291700_ref044","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1037\/a0032690","article-title":"How students create motivationally supportive learning environments for themselves: the concept of agentic engagement","volume":"105","year":"2013","journal-title":"Journal of Educational Psychology"},{"issue":"4","key":"key2022051008295291700_ref045","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1016\/j.cedpsych.2011.05.002","article-title":"Agency as a fourth aspect of students\u2019 engagement during learning activities","volume":"36","year":"2011","journal-title":"Contemporary Educational Psychology"},{"key":"key2022051008295291700_ref046","doi-asserted-by":"publisher","DOI":"10.21125\/edulearn.2016.0170","article-title":"Assessing the impact of gamification on students\u2019 engagement and motivation","volume-title":"EDULEARN16 Proceedings","year":"2016"},{"issue":"4","key":"key2022051008295291700_ref047","doi-asserted-by":"crossref","first-page":"273","DOI":"10.3390\/educsci9040273","article-title":"A review of nontraditional teaching methods: flipped classroom, gamification, case study, self-learning, and social media","volume":"9","year":"2019","journal-title":"Education Sciences"},{"issue":"1","key":"key2022051008295291700_ref048","first-page":"75","article-title":"Gamification of in\u2010class activities in flipped classroom lectures","volume":"52","year":"2020","journal-title":"British Journal of Educational Technology"},{"key":"key2022051008295291700_ref049","doi-asserted-by":"crossref","first-page":"103666","DOI":"10.1016\/j.compedu.2019.103666","article-title":"Gamification in the classroom: examining the impact of gamified quizzes on student learning","volume":"144","year":"2020","journal-title":"Computers and Education"},{"key":"key2022051008295291700_ref050","doi-asserted-by":"crossref","first-page":"103789","DOI":"10.1016\/j.compedu.2019.103789","article-title":"The polarizing effect of the online flipped classroom","volume":"147","year":"2020","journal-title":"Computers and Education"},{"issue":"3","key":"key2022051008295291700_ref051","first-page":"355","article-title":"The effect of flipped classroom on students\u2019 engagement","volume":"24","year":"2017","journal-title":"Technology, Knowledge and Learning"},{"key":"key2022051008295291700_ref052","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.compedu.2018.01.009","article-title":"Enhancing student learning experience with technology-mediated gamification: an empirical study","volume":"121","year":"2018","journal-title":"Computers and Education"},{"issue":"7","key":"key2022051008295291700_ref053","doi-asserted-by":"crossref","first-page":"435","DOI":"10.17705\/1jais.00433","article-title":"Guidelines for conducting mixed-methods research: an extension and illustration","volume":"17","year":"2016","journal-title":"Journal of the Association for Information Systems"},{"issue":"9","key":"key2022051008295291700_ref0053","first-page":"1","article-title":"COVID-19 and higher education: today and tomorrow","author":"UNESCO and IESALC","year":"2020","journal-title":"Impact Analysis, Policy Responses and Recommendations"},{"key":"key2022051008295291700_ref054","unstructured":"Wakefield, C.R. (2016), \u201cAgentic engagement, teacher support, and classmate relatedness- a reciprocal path to student achievement\u201d, UNLV Theses, Dissertations, Professional Papers and Capstones, 2757, available at https:\/\/digitalscholarship.unlv.edu\/thesesdissertations\/2757"},{"key":"key2022051008295291700_ref055","doi-asserted-by":"crossref","first-page":"103653","DOI":"10.1016\/j.compedu.2019.103653","article-title":"On the relationships between behaviors and achievement in technology-mediated flipped classrooms: a two-phase online behavioral PLS-SEM model","volume":"142","year":"2019","journal-title":"Computers and Education"},{"issue":"1","key":"key2022051008295291700_ref056","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1037\/edu0000468","article-title":"Peer social acceptance and academic achievement: a meta-analytic study","volume":"113","year":"2021","journal-title":"Journal of Educational Psychology"},{"key":"key2022051008295291700_ref057","first-page":"286","article-title":"The effectiveness of gamification on student engagement, learning outcomes, and learning experiences\u201d, in handbook of research on creating meaningful experiences in online courses, essay","year":"2020","journal-title":"Information Science Reference, Hershey, PA"},{"key":"key2022051008295291700_ref058","first-page":"255","volume-title":"Five Generations and Only One Workforce How Successful Businesses Are Managing a Multigenerational Workforce, essay","year":"2020"},{"key":"key2022051008295291700_ref059","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.compedu.2018.07.003","article-title":"Students' learning performance and perceived motivation in gamified flipped-class instruction","volume":"126","year":"2018","journal-title":"Computers and Education"},{"key":"key2022051008295291700_ref060","doi-asserted-by":"crossref","first-page":"100326","DOI":"10.1016\/j.edurev.2020.100326","article-title":"The impact of gamification on learning and instruction: a systematic review of empirical evidence","volume":"30","year":"2020","journal-title":"Educational Research Review"},{"issue":"7\/8","key":"key2022051008295291700_ref061","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1108\/ILS-04-2020-0069","article-title":"Literacy in the new norm: stay-home game plan for parents","volume":"121","year":"2020","journal-title":"Information and Learning Sciences"},{"key":"key2022051008295291700_ref062","volume-title":"Gamification by Design","year":"2011"},{"key":"key2022051008295291700_ref063","unstructured":"Iesalc, U. (2020), \u201cCOVID-19 and higher education: today and tomorrow\u201d, (n.d.), available at: http:\/\/www.iesalc.unesco.org\/en\/wp-content\/uploads\/2020\/04\/COVID-19-EN-090420-2.pdf (accessed 2 January 2021)."},{"key":"key2022051008295291700_ref064","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1007\/978-1-4614-2018-7_7","article-title":"A self-determination theory perspective on student engagement","volume-title":"Handbook of Research on Student Engagement","year":"2012"}],"container-title":["Interactive Technology and Smart Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/ITSE-01-2021-0002\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/ITSE-01-2021-0002\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T21:56:31Z","timestamp":1753394191000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/itse\/article\/19\/2\/236-259\/181347"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,2]]},"references-count":70,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2021,9,2]]},"published-print":{"date-parts":[[2022,5,11]]}},"alternative-id":["10.1108\/ITSE-01-2021-0002"],"URL":"https:\/\/doi.org\/10.1108\/itse-01-2021-0002","relation":{},"ISSN":["1741-5659","1741-5659"],"issn-type":[{"value":"1741-5659","type":"print"},{"value":"1741-5659","type":"print"}],"subject":[],"published":{"date-parts":[[2021,9,2]]}}}