{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T08:49:54Z","timestamp":1780044594193,"version":"3.53.1"},"reference-count":45,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2021,8,26]],"date-time":"2021-08-26T00:00:00Z","timestamp":1629936000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010677","name":"H2020 Health","doi-asserted-by":"publisher","award":["769830"],"award-info":[{"award-number":["769830"]}],"id":[{"id":"10.13039\/100010677","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Conventional clinical cognitive assessment has its limitations, as evidenced by the environmental shortcomings of various neuropsychological tests conducted away from an older person\u2019s everyday environment. Recent research activities have focused on transferring screening tests to computerized forms, as well as on developing short screening tests for screening large populations for cognitive impairment. The purpose of this study was to present an exergaming platform, which was widely trialed (116 participants) to collect in-game metrics (built-in game performance measures). The potential correlation between in-game metrics and cognition was investigated in-depth by scrutinizing different in-game metrics. The predictive value of high-resolution monitoring games was assessed by correlating it with classical neuropsychological tests; the area under the curve (AUC) in the receiver operating characteristic (ROC) analysis was calculated to determine the sensitivity and specificity of the method for detecting mild cognitive impairment (MCI). Classification accuracy was calculated to be 73.53% when distinguishing between MCI and normal subjects, and 70.69% when subjects with mild dementia were also involved. The results revealed evidence that careful design of serious games, with respect to in-game metrics, could potentially contribute to the early and unobtrusive detection of cognitive decline.<\/jats:p>","DOI":"10.3390\/s21175756","type":"journal-article","created":{"date-parts":[[2021,8,31]],"date-time":"2021-08-31T22:58:15Z","timestamp":1630450695000},"page":"5756","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["Physical Training In-Game Metrics for Cognitive Assessment: Evidence from Extended Trials with the Fitforall Exergaming Platform"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5522-9553","authenticated-orcid":false,"given":"Evdokimos I.","family":"Konstantinidis","sequence":"first","affiliation":[{"name":"Laboratory of Medical Physics and Digital Innovation, School of Medicine, Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9936-5805","authenticated-orcid":false,"given":"Panagiotis D.","family":"Bamidis","sequence":"additional","affiliation":[{"name":"Laboratory of Medical Physics and Digital Innovation, School of Medicine, Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1854-7560","authenticated-orcid":false,"given":"Antonis","family":"Billis","sequence":"additional","affiliation":[{"name":"Laboratory of Medical Physics and Digital Innovation, School of Medicine, Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7835-4763","authenticated-orcid":false,"given":"Panagiotis","family":"Kartsidis","sequence":"additional","affiliation":[{"name":"Laboratory of Medical Physics and Digital Innovation, School of Medicine, Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0273-6890","authenticated-orcid":false,"given":"Despoina","family":"Petsani","sequence":"additional","affiliation":[{"name":"Laboratory of Medical Physics and Digital Innovation, School of Medicine, Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8863-3635","authenticated-orcid":false,"given":"Sokratis G.","family":"Papageorgiou","sequence":"additional","affiliation":[{"name":"Memory Disorders and Rare Dementias Unit, 1st Department of Neurology, Eginiteion University Hospital, National and Kapodistrian University of Athens, 15772 Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,26]]},"reference":[{"key":"ref_1","first-page":"5234","article-title":"Models of cognitive performance based on home monitoring data","volume":"2010","author":"Jimison","year":"2010","journal-title":"Conf. Proc. IEEE Eng. Med. Biol. Soc."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Jimison, H., and Pavel, M. (September, January 30). Embedded assessment algorithms within home-based cognitive computer game exercises for elders. Proceedings of the 2006 International Conference of the IEEE Engineering in Medicine and Biology Society, New York, NY, USA.","DOI":"10.1109\/IEMBS.2006.260303"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1097\/WAD.0b013e3181a6bebc","article-title":"Missed and delayed diagnosis of dementia in primary care: Prevalence and contributing factors","volume":"23","author":"Bradford","year":"2009","journal-title":"Alzheimer\u2019s Dis. Assoc. Disord."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"McKanna, J.A., Jimison, H., and Pavel, M. (2009, January 3\u20136). Divided attention in computer game play: Analysis utilizing unobtrusive health monitoring. Proceedings of the 31st Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Minneapolis, MN, USA.","DOI":"10.1109\/IEMBS.2009.5334662"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/j.acn.2005.12.002","article-title":"Improving the ecological validity of executive functioning assessment","volume":"21","author":"Chaytor","year":"2006","journal-title":"Arch. Clin. Neuropsychol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1016\/j.jalz.2012.08.008","article-title":"Improving dementia care: The role of screening and detection of cognitive impairment","volume":"9","author":"Borson","year":"2013","journal-title":"Alzheimer\u2019s Dement."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1177\/1533317514522852","article-title":"Computerized cognitive testing for older adults a review","volume":"30","author":"Zygouris","year":"2014","journal-title":"Am. J. Alzheimer\u2019s Dis. Other Demen."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"185","DOI":"10.3233\/JAD-2010-1354","article-title":"The computerized self test (CST): An interactive, internet accessible cognitive screening test for dementia","volume":"20","author":"Dougherty","year":"2010","journal-title":"J. Alzheimer\u2019s Dis."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"804723","DOI":"10.1155\/2014\/804723","article-title":"Computerized neuropsychological assessment in aging: Testing efficacy and clinical ecology of different interfaces","volume":"2014","author":"Canini","year":"2014","journal-title":"Comput. Math. Methods Med."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1016\/j.jbi.2016.10.019","article-title":"Trends on the application of serious games to neuropsychological evaluation: A scoping review","volume":"64","year":"2016","journal-title":"J. Biomed. Inform."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"24","DOI":"10.3389\/fnagi.2015.00024","article-title":"\u201cKitchen and cooking\u201d, a serious game for mild cognitive impairment and Alzheimer\u2019s disease: A pilot study","volume":"7","author":"Manera","year":"2015","journal-title":"Front. Aging Neurosci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1080\/13854046.2016.1144793","article-title":"Virtual reality measures in neuropsychological assessment: A meta-analytic review","volume":"30","author":"Negu","year":"2016","journal-title":"Clin. Neuropsychol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"54","DOI":"10.3389\/fnagi.2014.00054","article-title":"Recommendations for the use of Serious Games in people with Alzheimer\u2019s Disease, related disorders and frailty","volume":"6","author":"Robert","year":"2014","journal-title":"Front. Aging Neurosci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2013\/120791","article-title":"Assessment in and of Serious Games: An overview","volume":"2013","author":"Bellotti","year":"2013","journal-title":"Adv. Hum.-Comput. Interact."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1006\/ceps.2001.1094","article-title":"Cognitive test anxiety and academic performance","volume":"27","author":"Cassady","year":"2002","journal-title":"Contemp. Educ. Psychol."},{"key":"ref_16","first-page":"21","article-title":"Defining Exergames & Exergaming","volume":"2010","author":"Oh","year":"2010","journal-title":"Proc. Mean. Play"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1442","DOI":"10.1109\/JBHI.2014.2299793","article-title":"Assessing executive function using a computer game: Computational modeling of cognitive processes","volume":"18","author":"Hagler","year":"2014","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1109\/JBHI.2014.2378814","article-title":"Design, implementation, and wide pilot deployment of FitForAll: An easy to use exergaming platform improving physical fitness and life quality of senior citizens","volume":"20","author":"Konstantinidis","year":"2016","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.entcom.2011.03.008","article-title":"The promise of exergames as tools to measure physical health","volume":"2","author":"Staiano","year":"2011","journal-title":"Entertain. Comput."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"947","DOI":"10.1016\/j.apmr.2011.01.012","article-title":"A Novel Video Game\u2013Based Device for Measuring Stepping Performance and Fall Risk in Older People","volume":"92","author":"Schoene","year":"2011","journal-title":"Arch. Phys. Med. Rehabil."},{"key":"ref_21","first-page":"1","article-title":"Parkinson\u2019s Disease Predictive Analytics through a Pad Game Based on Personal Data","volume":"19","author":"Liu","year":"2013","journal-title":"Int. J. Inf. Technol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"e17810","DOI":"10.2196\/17810","article-title":"Effective gamification of the stop-signal task: Two controlled laboratory experiments","volume":"8","author":"Friehs","year":"2020","journal-title":"JMIR Serious Games"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"16","DOI":"10.2196\/games.2778","article-title":"Ecological validity of virtual reality daily living activities screening for early dementia: Longitudinal study","volume":"1","author":"Tarnanas","year":"2013","journal-title":"JMIR Serious Games"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Tarnanas, I., Papagiannopoulos, S., Kazis, D., Wiederhold, M., Wiederhold, B., Vuillermot, S., and Tsolaki, M. (2015). Reliability of a novel serious game using dual-task gait profiles to early characterize aMCI. Front. Aging Neurosci., 7.","DOI":"10.3389\/fnagi.2015.00050"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Petsani, D., Konstantinidis, E.I., Zilidou, V., and Bamidis, P.D. (2018, January 20\u201322). Exploring health profiles from physical and cognitive serious game analytics. Proceedings of the 2018 2nd International Conference on Technology and Innovation in Sports, Health and Wellbeing (TISHW 2018), Thessaloniki, Greece.","DOI":"10.1109\/TISHW.2018.8559562"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Ritterfeld, U., Cody, M.J., and Vorderer, P. (2009). Melding the power of serious games and embedded assessment to monitor and foster learning. Serious Games: Mechanisms and Effects, Routledge.","DOI":"10.4324\/9780203891650"},{"key":"ref_27","first-page":"32","article-title":"The future value of serious games for assessment: Where do we go now?","volume":"18","author":"Kato","year":"2017","journal-title":"J. Appl. Test. Technol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1094","DOI":"10.1161\/CIRCULATIONAHA.107.185650","article-title":"Physical activity and public health in older adults: Recommendation from the American College of Sports Medicine and the American Heart Association","volume":"116","author":"Nelson","year":"2007","journal-title":"Circulation"},{"key":"ref_29","first-page":"9","article-title":"The Fullerton Fitness Test as an index of fitness in the elderly","volume":"10","author":"Kocur","year":"2006","journal-title":"Med. Rehabil."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Gerling, K., Livingston, I., Nacke, L., and Mandryk, R. (2012, January 5\u201310). Full-body motion-based game interaction for older adults. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Austin, TX, USA.","DOI":"10.1145\/2207676.2208324"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1249\/00005768-198205000-00012","article-title":"Psychophysical bases of perceived exertion","volume":"14","author":"Borg","year":"1982","journal-title":"Med. Sci. Sport. Exerc."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"152","DOI":"10.3389\/fnagi.2015.00152","article-title":"Gains in cognition through combined cognitive and physical training: The role of training dosage and severity of neurocognitive disorder","volume":"7","author":"Bamidis","year":"2015","journal-title":"Front. Aging Neurosci."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1177\/153331750001500604","article-title":"Mini mental state examination (MMSE): A validation study in Greece","volume":"15","author":"Fountoulakis","year":"2000","journal-title":"Am. J. Alzheimer\u2019s Dis. Other Demen."},{"key":"ref_34","unstructured":"Kounti, F., Tsolaki, M., Eleftheriou, M., Agogiatou, C., Karagiozi, K., Bakoglidou, E., Nikolaidou, E., Nakou, S., Poptsi, E., and Zafiropoulou, M. (2007, January 3\u20136). Administration of Montreal Cognitive Assesment (MoCA) test in Greek healthy elderly, patients with mild cognitive impairment and patients with dementia. Proceedings of the European Conference on Psychological Assesment & 2nd International Conference of the Psychological Society of Nothern Greece, Thessaloniki, Greece."},{"key":"ref_35","unstructured":"Poptsi, E., Kounti, F., Karagiozi, K., Eleuftheriou, M., Agogiatou, C., Bacoglidou, E., Nikolaidou, E., Nakou, S., Zafiropoulou, M., and Kioseoglou, G. (2007, January 3\u20135). The administration of trail making test to Greek healthy elderly, to patients with mild cognitive impairment, preclinical dementia and mild dementia. In Proceeding of 2nd International Conference of the Psychological society of Northern Greece, Psychological Assessment, Thessaloniki, Greece."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"939","DOI":"10.1212\/WNL.34.7.939","article-title":"Clinical diagnosis of Alzheimer\u2019s disease Report of the NINCDS-ADRDA Work Group under the auspices of Department of Health and Human Services Task Force on Alzheimer\u2019s Disease","volume":"34","author":"McKhann","year":"1984","journal-title":"Neurology"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1111\/j.1365-2796.2004.01388.x","article-title":"Mild cognitive impairment as a diagnostic entity","volume":"256","author":"Petersen","year":"2004","journal-title":"J. Intern. Med."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/S0735-1097(00)01054-8","article-title":"Age-predicted maximal heart rate revisited","volume":"37","author":"Tanaka","year":"2001","journal-title":"J. Am. Coll. Cardiol."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1186","DOI":"10.1016\/j.neuroimage.2007.09.073","article-title":"Alzheimer\u2019s disease diagnosis in individual subjects using structural MR images: Validation studies","volume":"39","author":"Vemuri","year":"2008","journal-title":"Neuroimage"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Alexandrovsky, D., Friehs, M.A., Birk, M.V., Yates, R.K., and Mandryk, R.L. (2019, January 22\u201325). Game dynamics that support snacking, not feasting. Proceedings of the Annual Symposium on Computer\u2013Human Interaction in Play, Barcelona, Spain.","DOI":"10.1145\/3311350.3347151"},{"key":"ref_41","first-page":"85","article-title":"Gamification and serious games for personalized health","volume":"177","author":"McCallum","year":"2012","journal-title":"Stud. Health Technol. Inform."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1186\/s13326-016-0046-4","article-title":"Towards exergaming commons: Composing the exergame ontology for publishing open game data","volume":"7","author":"Bamparopoulos","year":"2016","journal-title":"J. Biomed. Semantics"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1007\/s10639-013-9263-y","article-title":"Measuring the (dis-)similarity between expert and novice behaviors as serious games analytics","volume":"20","author":"Loh","year":"2013","journal-title":"Educ. Inf. Technol."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1002\/gps.5016","article-title":"Cognitive tests for the detection of mild cognitive impairment (MCI), the prodromal stage of dementia: Meta-analysis of diagnostic accuracy studies","volume":"34","author":"Breton","year":"2019","journal-title":"Int. J. Geriatr. Psychiatry"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Vallejo, V., Wyss, P., Rampa, L., Mitache, A.V., M\u00fcri, R.M., Mosimann, U.P., and Nef, T. (2017). Evaluation of a novel Serious Game based assessment tool for patients with Alzheimer\u2019s disease. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0175999"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/17\/5756\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:52:55Z","timestamp":1760165575000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/17\/5756"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,26]]},"references-count":45,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2021,9]]}},"alternative-id":["s21175756"],"URL":"https:\/\/doi.org\/10.3390\/s21175756","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,26]]}}}