{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,15]],"date-time":"2026-06-15T10:29:59Z","timestamp":1781519399921,"version":"3.54.1"},"reference-count":66,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2024,7,23]],"date-time":"2024-07-23T00:00:00Z","timestamp":1721692800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Convocatoria del Fondo de Ciencia, Tecnolog\u00eda e Innovaci\u00f3n del Sistema General de Regal\u00edas para la conformaci\u00f3n de una lista de proyectos elegibles para ser viabilizados, priorizados y aprobados por el OCAD en el marco del Programa de Becas de Excelencia"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>This paper presents a conceptual framework for the development of serious games aimed at cognitive rehabilitation in older adults. Following Jabareen\u2019s methodology, a literature review was conducted to identify concepts and theories that are relevant in this field. The resulting framework comprises the use of virtual reality, integration of physical activity, incorporation of social interaction features, adaptability of difficulty levels, and customization of game content. The interconnections between these concepts and underlying cognitive theories, such as the cognitive reserve hypothesis and the scaffolding theory of aging and cognition, are highlighted. As we are in the early stages of our research, our goal is to introduce and test novel interpretations of current knowledge within this conceptual framework. Additionally, the practical implications of the conceptual framework are discussed, including its strengths and limitations, as well as its relevance for future research and clinical practice in the field of cognitive rehabilitation. It is hoped that this framework will provide a guide for the design and implementation of effective interventions to improve cognitive health and well-being in the older adult population.<\/jats:p>","DOI":"10.3390\/mti8080064","type":"journal-article","created":{"date-parts":[[2024,7,23]],"date-time":"2024-07-23T11:06:42Z","timestamp":1721732802000},"page":"64","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["Serious Games for Cognitive Rehabilitation in Older Adults: A Conceptual Framework"],"prefix":"10.3390","volume":"8","author":[{"given":"Diego E.","family":"Guzm\u00e1n","sequence":"first","affiliation":[{"name":"Doctorado en Ciencias de la Electr\u00f3nica, Universidad del Cauca, Calle 5 No. 4-70, Popay\u00e1n 190002, Cauca, Colombia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0601-3481","authenticated-orcid":false,"given":"Carlos F.","family":"Rengifo","sequence":"additional","affiliation":[{"name":"Departamento de Electr\u00f3nica, Instrumentaci\u00f3n y Control, Universidad del Cauca, Calle 5 No. 4-70, Popay\u00e1n 190002, Cauca, Colombia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1067-0564","authenticated-orcid":false,"given":"Cecilia E.","family":"Garc\u00eda-Cena","sequence":"additional","affiliation":[{"name":"Escuela T\u00e9cnica Superior de Ingenier\u00eda y Dise\u00f1o Industrial, Centro de Autom\u00e1tica y Rob\u00f3tica, Universidad Polit\u00e9cnica de Madrid, C\/Ronda de Valencia 3, 28012 Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,7,23]]},"reference":[{"key":"ref_1","unstructured":"Prince, M., Albanese, E., Guerchet, M., and Prina, M. (2016). World Alzheimer Report 2016: Improving Healthcare for People Living with Dementia, Alzheimer\u2019s Disease International."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1016\/S0140-6736(20)30367-6","article-title":"Dementia prevention, intervention, and care: 2020 report of the Lancet Commission","volume":"396","author":"Livingston","year":"2020","journal-title":"Lancet"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"391","DOI":"10.2165\/00019053-200927050-00004","article-title":"The cost of dementia in Europe: A review of the evidence, and methodological considerations","volume":"27","author":"Wimo","year":"2009","journal-title":"Pharmacoeconomics"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1596","DOI":"10.1053\/apmr.2000.19240","article-title":"Evidence-based cognitive rehabilitation: Recommendations for clinical practice","volume":"81","author":"Cicerone","year":"2000","journal-title":"Arch. Phys. Med. Rehabil."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Kudlicka, A., Martyr, A., Bahar-Fuchs, A., Sabates, J., and Clare, L. (2023). Cognitive rehabilitation for people with mild to moderate dementia. Cochrane Database Syst. Rev., 6.","DOI":"10.1002\/14651858.CD013388.pub2"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1176\/appi.ajp.2016.16030360","article-title":"Computerized Cognitive Training in Older Adults with Mild Cognitive Impairment or Dementia: A Systematic Review and Meta-Analysis","volume":"174","author":"Hill","year":"2017","journal-title":"Am. J. Psychiatry"},{"key":"ref_7","first-page":"CD003260","article-title":"Cognitive training and cognitive rehabilitation for mild to moderate Alzheimer\u2019s disease and vascular dementia","volume":"2013","author":"Clare","year":"2013","journal-title":"Cochrane Database Syst. Rev."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Lee, M.T., Jang, Y., and Chang, W.Y. (2019). How do impairments in cognitive functions affect activities of daily living functions in older adults?. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0218112"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1186\/alzrt189","article-title":"Cognitive training and cognitive rehabilitation for persons with mild to moderate dementia of the Alzheimer\u2019s or vascular type: A review","volume":"5","author":"Clare","year":"2013","journal-title":"Alzheimer\u2019s Res. Ther."},{"key":"ref_10","first-page":"142","article-title":"Cognitive Rehabilitation in Alzheimer\u2019s Disease\u2014A Conceptual and Methodological Review","volume":"2","author":"Kasper","year":"2015","journal-title":"J. Prev. Alzheimer\u2019s Dis."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Kueider, A.M., Parisi, J.M., Gross, A.L., and Rebok, G.W. (2012). Computerized Cognitive Training with Older Adults: A Systematic Review. PLoS ONE, 7.","DOI":"10.1371\/journal.pone.0040588"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"23","DOI":"10.3233\/JAD-191218","article-title":"Use of Immersive Virtual Reality in the Assessment and Treatment of Alzheimer\u2019s Disease: A Systematic Review","volume":"75","author":"Clay","year":"2020","journal-title":"J. Alzheimer\u2019s Dis."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1016\/j.entcom.2013.09.002","article-title":"Serious games for health","volume":"4","author":"Wattanasoontorn","year":"2013","journal-title":"Entertain. Comput."},{"key":"ref_14","first-page":"85","article-title":"Gamification and serious games for personalized health","volume":"177","author":"McCallum","year":"2012","journal-title":"PHealth"},{"key":"ref_15","unstructured":"Chiniara, G. (2019). Chapter 2\u2014The Many Faces of Simulation. Clinical Simulation, Academic Press. [2nd ed.]."},{"key":"ref_16","first-page":"131","article-title":"When Japanese Elderly People Play a Finnish Physical Exercise Game: A Usability Study","volume":"11","author":"Pyae","year":"2016","journal-title":"J. Usability Stud."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Eichhorn, C., Plecher, D.A., Klinker, G., Lurz, M., Leipold, N., B\u00f6hm, M., Krcmar, H., Ott, A., Volkert, D., and Hiyama, A. (2018, January 15\u201320). Innovative game concepts for Alzheimer patients. Proceedings of the Human Aspects of IT for the Aged Population. Applications in Health, Assistance, and Entertainment: 4th International Conference, ITAP 2018, Held as Part of HCI International 2018, Las Vegas, NV, USA.","DOI":"10.1007\/978-3-319-92037-5_37"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Rodr\u00edguez-F\u00f3rtiz, M.J., Rodr\u00edguez-Dom\u00ednguez, C., Cano, P., Revelles, J., Rodr\u00edguez-Almendros, M.L., Hurtado-Torres, M.V., and Rute-P\u00e9rez, S. (2016, January 11\u201313). Serious games for the cognitive stimulation of elderly people. Proceedings of the 4th International Conference on Serious Games and Applications for Health (SeGAH), Orlando, FL, USA.","DOI":"10.1109\/SeGAH.2016.7586261"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Dama\u0161evi\u010dius, R., Maskeli\u016bnas, R., and Bla\u017eauskas, T. (2023). Serious Games and Gamification in Healthcare: A Meta-Review. Information, 14.","DOI":"10.3390\/info14020105"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s41077-017-0036-3","article-title":"Serious games for health: Three steps forwards","volume":"2","author":"Drummond","year":"2017","journal-title":"Adv. Simul."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Rahmani-Katigari, M., Mohammadian, F., and Shahmoradi, L. (2023). Development of a serious game-based cognitive rehabilitation system for patients with brain injury. BMC Psychiatry, 23.","DOI":"10.1186\/s12888-023-05396-2"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/JTEHM.2020.2998055","article-title":"A Review on Serious Games for Dementia Care in Ageing Societies","volume":"8","author":"Ning","year":"2020","journal-title":"IEEE J. Transl. Eng. Health Med."},{"key":"ref_23","first-page":"2017975","article-title":"A Systematic Review on Serious Games in Attention Rehabilitation and Their Effects","volume":"2022","author":"Witt","year":"2022","journal-title":"Behav. Neurol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e36123","DOI":"10.2196\/36123","article-title":"Effectiveness of Serious Games for Improving Executive Functions among Older Adults with Cognitive Impairment: Systematic Review and Meta-analysis","volume":"10","author":"Alhuwail","year":"2022","journal-title":"JMIR Serious Games"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"e35202","DOI":"10.2196\/35202","article-title":"The Effectiveness of Serious Games in Improving Memory among Older Adults with Cognitive Impairment: Systematic Review and Meta-analysis","volume":"10","author":"Alhuwail","year":"2022","journal-title":"JMIR Serious Games"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"e36754","DOI":"10.2196\/36754","article-title":"The Effectiveness of Serious Games on Cognitive Processing Speed among Older Adults with Cognitive Impairment: Systematic Review and Meta-analysis","volume":"10","author":"Ahmed","year":"2022","journal-title":"JMIR Serious Games"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"e34592","DOI":"10.2196\/34592","article-title":"The Effectiveness and Safety of Serious Games for Improving Cognitive Abilities among Elderly People with Cognitive Impairment: Systematic Review and Meta-Analysis","volume":"10","author":"Alajlani","year":"2022","journal-title":"JMIR Serious Games"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"e43607","DOI":"10.2196\/43607","article-title":"Serious Games for Learning among Older Adults with Cognitive Impairment: Systematic Review and Meta-analysis","volume":"25","author":"Abuelezz","year":"2023","journal-title":"J. Med. Internet Res."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"31183","DOI":"10.1007\/s11042-021-11042-4","article-title":"A framework and immersive serious game for mild cognitive impairment","volume":"80","author":"Lau","year":"2021","journal-title":"Multimed. Tools Appl."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Shin, S.W., Lim, C., Moon, H.S., Chung, J.Y., Cho, H.Y., and Chung, S.T. (2018, January 15\u201320). Development of Serious Game and Integrated Management Service Model for the Cognitive Rehabilitation. Proceedings of the International Conference on Human-Computer Interaction, Las Vegas, NV, USA.","DOI":"10.1007\/978-3-319-92279-9_11"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1177\/160940690900800406","article-title":"Building a conceptual framework: Philosophy, definitions, and procedure","volume":"8","author":"Jabareen","year":"2009","journal-title":"Int. J. Qual. Methods"},{"key":"ref_32","first-page":"1","article-title":"Virtual reality games for cognitive rehabilitation of older adults: A review of adaptive games, domains and techniques","volume":"28","author":"Rengifo","year":"2024","journal-title":"Virtual Real."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Tarnanas, I., Laskaris, N., Tsolaki, M., Muri, R., Nef, T., and Mosimann, U.P. (2015). On the comparison of a novel serious game and electroencephalography biomarkers for early dementia screening. GeNeDis 2014, Springer.","DOI":"10.1007\/978-3-319-08939-3_11"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Chen, Y.T., Hou, C.J., Derek, N., Huang, S.B., Huang, M.W., and Wang, Y.Y. (2021). Evaluation of the Reaction Time and Accuracy Rate in Normal Subjects, MCI, and Dementia Using Serious Games. Appl. Sci., 11.","DOI":"10.3390\/app11020628"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Paliokas, I., Kalamaras, E., Votis, K., Doumpoulakis, S., Lakka, E., Kotsani, M., Freminet, A., Benetos, A., Ellul, I., and Polycarpou, M. (2020). Using a Virtual Reality Serious Game to Assess the Performance of Older Adults with Frailty. GeNeDis 2018, Springer.","DOI":"10.1007\/978-3-030-32637-1_13"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"500","DOI":"10.1016\/j.chb.2017.01.021","article-title":"Evaluation of a new serious game based multitasking assessment tool for cognition and activities of daily living: Comparison with a real cooking task","volume":"70","author":"Vallejo","year":"2017","journal-title":"Comput. Hum. Behav."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Ben-Sadoun, G., Manera, V., Alvarez, J., Sacco, G., and Robert, P. (2018). Recommendations for the design of serious games in neurodegenerative diseases. Front. Aging Neurosci., 10.","DOI":"10.3389\/fnagi.2018.00013"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Seyderhelm, A.J., Blackmore, K.L., and Nesbitt, K. (2019, January 11\u201315). Towards cognitive adaptive serious games: A conceptual framework. Proceedings of the Entertainment Computing and Serious Games: First IFIP TC 14 Joint International Conference, ICEC-JCSG 2019, Arequipa, Peru.","DOI":"10.1007\/978-3-030-34644-7_27"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"719","DOI":"10.1109\/TNSRE.2022.3158731","article-title":"Immersive virtual reality for the cognitive rehabilitation of stroke survivors","volume":"30","author":"Chatterjee","year":"2022","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"385","DOI":"10.3109\/09638288.2014.934925","article-title":"Cognitive training on stroke patients via virtual reality-based serious games","volume":"39","author":"Gamito","year":"2017","journal-title":"Disabil. Rehabil."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"4519","DOI":"10.1038\/s41598-019-41200-6","article-title":"Acceptance of immersive head-mounted virtual reality in older adults","volume":"9","author":"Huygelier","year":"2019","journal-title":"Sci. Rep."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Elaklouk, A.M., Mat Zin, N.A., and Shapii, A. (2013, January 13\u201315). Game design for acquired brain injury cognitive rehabilitation: A conceptual framework. Proceedings of the Advances in Visual Informatics: Third International Visual Informatics Conference, IVIC 2013, Selangor, Malaysia.","DOI":"10.1007\/978-3-319-02958-0_21"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Plass, J.L., Moreno, R., and Br\u00fcnken, R. (2010). Cognitive Load Theory, Cambridge University Press.","DOI":"10.1017\/CBO9780511844744"},{"key":"ref_44","first-page":"195","article-title":"Flow theory and research","volume":"Volume 195","author":"Nakamura","year":"2009","journal-title":"Oxford Handbook of Positive Psychology"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Yusoff, A., Crowder, R., Gilbert, L., and Wills, G. (2009, January 15\u201317). A conceptual framework for serious games. Proceedings of the 2009 Ninth IEEE International Conference on Advanced Learning Technologies, Riga, Latvia.","DOI":"10.1109\/ICALT.2009.19"},{"key":"ref_46","unstructured":"Baker, S.E., and Edwards, R. (2012). How Many Qualitative Interviews Is Enough, National Centre for Research Methods. Available online: https:\/\/eprints.ncrm.ac.uk\/2273\/4\/how_many_interviews.pdf."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/B978-012279660-9\/50022-1","article-title":"Concepts and theories","volume":"3","author":"Gelman","year":"1996","journal-title":"Percept. Cogn. Dev."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Jha, M.K., Ben Abdessalem, H., Boukadida, M., Byrns, A., Cuesta, M., Bruneau, M.A., Belleville, S., and Frasson, C. (2020, January 9\u201311). Virtual Reality Orientation Game for Alzheimer\u2019s Disease Using Real-Time Help System. Proceedings of the Brain Function Assessment in Learning: Second International Conference, BFAL 2020, Heraklion, Crete, Greece.","DOI":"10.1007\/978-3-030-60735-7_2"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"e29182","DOI":"10.2196\/29182","article-title":"Development of a Search Task Using Immersive Virtual Reality: Proof-of-Concept Study","volume":"9","author":"Knobel","year":"2021","journal-title":"JMIR Serious Games"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1299","DOI":"10.3233\/JAD-160268","article-title":"Physical and cognitive stimulation using an exergame in subjects with normal aging, mild and moderate cognitive impairment","volume":"53","author":"Sacco","year":"2016","journal-title":"J. Alzheimer\u2019s Dis."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/j.procs.2015.12.233","article-title":"Rehabilitation using kinect-based games and virtual reality","volume":"75","year":"2015","journal-title":"Procedia Comput. Sci."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Liu, Z., Ke, D., Sato, R., Takami, T., and Zhao, L. (2018, January 29\u201330). A Privacy-Aware Exergame Platform for Multi-domain Cognitive Training. Proceedings of the 2018 Nicograph International (NicoInt), Tainan, Taiwan.","DOI":"10.1109\/NICOINT.2018.00019"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1038\/nrn2298","article-title":"Be smart, exercise your heart: Exercise effects on brain and cognition","volume":"9","author":"Hillman","year":"2008","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"1237","DOI":"10.1152\/japplphysiol.00500.2006","article-title":"Exercise, cognition, and the aging brain","volume":"101","author":"Kramer","year":"2006","journal-title":"J. Appl. Physiol."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1016\/j.neubiorev.2015.06.008","article-title":"Maintaining older brain functionality: A targeted review","volume":"55","author":"Ballesteros","year":"2015","journal-title":"Neurosci. Biobehav. Rev."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"767","DOI":"10.1007\/s10209-020-00746-3","article-title":"Key factors that influence the UX of a dual-player game for the cognitive stimulation and motor rehabilitation of older adults","volume":"20","author":"Borrego","year":"2020","journal-title":"Univers. Access Inf. Soc."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Goumopoulos, C., and Igoumenakis, I. (2020, January 3\u20135). An Ontology based Game Platform for Mild Cognitive Impairment Rehabilitation. Proceedings of the ICT4AWE, Prague, Czech Republic.","DOI":"10.5220\/0009793501300141"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"407","DOI":"10.3109\/09638288.2015.1096969","article-title":"Computer-based cognitive rehabilitation: The CoRe system","volume":"39","author":"Alloni","year":"2017","journal-title":"Disabil. Rehabil."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"1424","DOI":"10.1016\/j.protcy.2014.10.162","article-title":"Helping to Stay Aware!\u2014MEM+ a Computerised Application for Alzheimer\u2019s Patients","volume":"16","author":"Caixinha","year":"2014","journal-title":"Procedia Technol."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Brasil, L., Santos, L., Calixto, M., da Silva, J.L., Peron, G., de Meneses, K., and Bombonato, F. (2012, January 26\u201331). Using Computer Games as a Strategy for Maintaining the Cognitive Capacity of the Elderly. Proceedings of the World Congress on Medical Physics and Biomedical Engineering, Beijing, China.","DOI":"10.1007\/978-3-642-29305-4_537"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12984-020-0652-3","article-title":"Adaptive conjunctive cognitive training (ACCT) in virtual reality for chronic stroke patients: A randomized controlled pilot trial","volume":"17","author":"Maier","year":"2020","journal-title":"J. Neuroeng. Rehabil."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1176\/ajp.154.2.165","article-title":"Implications for the cognitive reserve hypothesis","volume":"154","author":"Alexander","year":"1997","journal-title":"Am. J. Psychiatry"},{"key":"ref_63","first-page":"391","article-title":"Neuroplasticity and cognitive aging: The scaffolding theory of aging and cognition","volume":"27","author":"Goh","year":"2009","journal-title":"Restor. Neurol. Neurosci."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1177\/0733464811409034","article-title":"Social engagement and health in younger, older, and oldest-old adults in the Louisiana Healthy Aging Study","volume":"32","author":"Cherry","year":"2013","journal-title":"J. Appl. Gerontol."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1037\/h0031619","article-title":"Measuring nominal scale agreement among many raters","volume":"76","author":"Fleiss","year":"1971","journal-title":"Psychol. Bull."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","volume":"33","author":"Landis","year":"1977","journal-title":"Biometrics"}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/8\/8\/64\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:21:27Z","timestamp":1760109687000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/8\/8\/64"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,23]]},"references-count":66,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2024,8]]}},"alternative-id":["mti8080064"],"URL":"https:\/\/doi.org\/10.3390\/mti8080064","relation":{},"ISSN":["2414-4088"],"issn-type":[{"value":"2414-4088","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,23]]}}}