{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,12]],"date-time":"2026-02-12T16:16:20Z","timestamp":1770912980423,"version":"3.50.1"},"reference-count":46,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2025,11,26]],"date-time":"2025-11-26T00:00:00Z","timestamp":1764115200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"},{"start":{"date-parts":[[2025,11,26]],"date-time":"2025-11-26T00:00:00Z","timestamp":1764115200000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"funder":[{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Computer Assisted Learning"],"published-print":{"date-parts":[[2026,2]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background Study<\/jats:title>\n                    <jats:p>Serious games for cultural heritage offer opportunities for enhancement, particularly in user experience and educational impact. This paper presents a Reinforcement Learning (RL)\u2010driven adaptive approach to support CH learning through a graphic adventure game.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objectives<\/jats:title>\n                    <jats:p>The proposed solution integrates an artificial intelligence service based on the Expected State\u2010Action\u2010Reward\u2010State\u2010Action (SARSA) algorithm to provide dynamic, timely, and personalised in\u2010game support. This service adjusts the Level of Detail (LoD) in the assistance offered to players, promoting an engaging learning experience tailored to individual needs and pacing.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>The educational game, ForumSG, reconstructs the Roman Forum of Thessaloniki, offering exploratory learning within a 3D virtual environment. An in\u2010game activity\u2014the lost\u2010wax method of coin production\u2014was used to evaluate the adaptive service with both simulated and real users. The game collects user behavior data and uses the RL service to determine when and how to provide support, for an optimal balance between challenge and skill.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Experimental testing with synthetic users showed that the Expected SARSA agent successfully learned behaviorally consistent action\u2010selection policies, favouring lower LoD in uniform\u2010probability settings and higher LoD in more complex states, driven by reward function and transition efficiency. A preliminary pilot assessment with real users validated the functionality of the RL system. The game was well received, with participants appreciating the timely and supportive guidance, exploratory nature of the experience and its cognitive engagement.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>This work contributes to the field by combining pedagogical, museological, and technological design principles in Cultural Heritage Serious Games. The developed RL architecture is lightweight compared to deep learning methods, allowing for easy integration into other educational games, and providing a foundation for scalable, personalised CH learning systems.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1111\/jcal.70156","type":"journal-article","created":{"date-parts":[[2025,11,26]],"date-time":"2025-11-26T10:45:32Z","timestamp":1764153932000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["An\n                    <scp>RL<\/scp>\n                    \u2010Driven Adaptive Game Approach to Support Cultural Heritage Learning"],"prefix":"10.1111","volume":"42","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2416-7396","authenticated-orcid":false,"given":"Christina","family":"Tsita","sequence":"first","affiliation":[{"name":"Department of Applied Informatics University of Macedonia  Thessaloniki Greece"},{"name":"Information Technologies Institute, Centre for Research &amp; Technology Hellas  Thermi Greece"}]},{"given":"Christos","family":"Gogos","sequence":"additional","affiliation":[{"name":"Information Technologies Institute, Centre for Research &amp; Technology Hellas  Thermi Greece"}]},{"given":"Nikolaos","family":"Dimitriou","sequence":"additional","affiliation":[{"name":"Information Technologies Institute, Centre for Research &amp; Technology Hellas  Thermi Greece"}]},{"given":"Dimitrios","family":"Tzovaras","sequence":"additional","affiliation":[{"name":"Information Technologies Institute, Centre for Research &amp; Technology Hellas  Thermi Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9963-8159","authenticated-orcid":false,"given":"Maya","family":"Satratzemi","sequence":"additional","affiliation":[{"name":"Department of Applied Informatics University of Macedonia  Thessaloniki Greece"}]}],"member":"311","published-online":{"date-parts":[[2025,11,26]]},"reference":[{"key":"e_1_2_12_2_1","unstructured":"Ammanabrolu P. W.Broniec A.Mueller J.Paul andM. O.Riedl.2019.\u201cToward Automated Quest Generation in Text\u2010Adventure Games. arXiv preprint arXiv:1909.06283.\u201d"},{"key":"e_1_2_12_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10055-010-0177-3"},{"key":"e_1_2_12_4_1","volume-title":"A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives: Complete Edition","author":"Anderson L. W.","year":"2001"},{"key":"e_1_2_12_5_1","doi-asserted-by":"publisher","DOI":"10.1075\/ip.00118.bar"},{"key":"e_1_2_12_6_1","doi-asserted-by":"publisher","DOI":"10.3390\/biomimetics6010013"},{"key":"e_1_2_12_7_1","first-page":"483","volume-title":"Handbook i: Cognitive Domain","author":"Bloom B. S.","year":"1956"},{"key":"e_1_2_12_8_1","doi-asserted-by":"publisher","DOI":"10.14742\/ajet.2254"},{"key":"e_1_2_12_9_1","volume-title":"Flow: The Psychology of Optimal Experience","author":"Csikszentmihalyi M.","year":"1990"},{"key":"e_1_2_12_10_1","doi-asserted-by":"publisher","DOI":"10.3390\/educsci13010047"},{"key":"e_1_2_12_11_1","first-page":"141","volume-title":"Advanced Technologies and the University of the Future","author":"Dahan A.","year":"2024"},{"key":"e_1_2_12_12_1","first-page":"220","volume-title":"2015 Annual Proceedings\u2013Indianapolis","author":"Darwazeh A. N.","year":"2015"},{"key":"e_1_2_12_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2008.09.010"},{"key":"e_1_2_12_14_1","unstructured":"Dillon T.2005.\u201cAdventure Games for Learning and Storytelling. UK Futurelab Prototype Context Paper Adventure Author.\u201d"},{"key":"e_1_2_12_15_1","first-page":"411","volume-title":"Cognitive Infocommunications, Theory and Applications","author":"Dobrovsky A.","year":"2018"},{"key":"e_1_2_12_16_1","doi-asserted-by":"crossref","unstructured":"Dormans J.2010.\u201cAdventures in Level Design: Generating Missions and Spaces for Action Adventure Games.\u201dhttps:\/\/api.semanticscholar.org\/CorpusID:207179808.","DOI":"10.1145\/1814256.1814257"},{"issue":"8","key":"e_1_2_12_17_1","first-page":"19","article-title":"Systematic Review on Gamification and Cultural Heritage Dissemination","volume":"3","author":"Khan I.","year":"2020","journal-title":"Journal of Digital Media & Interaction"},{"key":"e_1_2_12_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2012.10.060"},{"key":"e_1_2_12_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10639-021-10831-6"},{"key":"e_1_2_12_20_1","volume-title":"Experiential Learning: Experience as the Source of Learning and Development","author":"Kolb D. A.","year":"2014"},{"key":"e_1_2_12_21_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15430421tip4104_2"},{"key":"e_1_2_12_22_1","doi-asserted-by":"publisher","DOI":"10.1201\/9781003535423-43"},{"key":"e_1_2_12_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978\u20103\u2010319\u201049607\u20108_15"},{"key":"e_1_2_12_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2017.01.007"},{"key":"e_1_2_12_25_1","unstructured":"Mnih V. K.Kavukcuoglu D.Silver et\u00a0al.2013.\u201cPlaying Atari With Deep Reinforcement Learning. arXiv Preprint arXiv:1312.5602.\u201d"},{"key":"e_1_2_12_26_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"key":"e_1_2_12_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.culher.2013.04.004"},{"issue":"11","key":"e_1_2_12_28_1","first-page":"60","article-title":"A Review of Adaptable Serious Games Applied to Professional Training","volume":"4","author":"Pistono A.","year":"2021","journal-title":"Journal of Digital Media & Interaction"},{"key":"e_1_2_12_29_1","unstructured":"Rahimi M. H.Moradi A.\u2010h.Vahabie andH.Kebriaei.2023.\u201cContinuous Reinforcement Learning\u2010Based Dynamic Difficulty Adjustment in a Visual Working Memory Game. arXiv Preprint arXiv:2308.12726.\u201d"},{"key":"e_1_2_12_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292057"},{"key":"e_1_2_12_31_1","doi-asserted-by":"publisher","DOI":"10.3390\/app13148249"},{"key":"e_1_2_12_32_1","volume-title":"Adaptive Serious Educational Games Using Machine Learning","author":"Rosyid H. A.","year":"2018"},{"key":"e_1_2_12_33_1","volume-title":"Reinforcement Learning: An Introduction, 2nd Edition","author":"Sutton R. S.","year":"2018"},{"key":"e_1_2_12_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1077246.1077253"},{"key":"e_1_2_12_35_1","first-page":"97","volume-title":"How Serious Games in Cultural Heritage Are Being Evaluated","author":"Tsita C.","year":"2018"},{"key":"e_1_2_12_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-11548-7_22"},{"key":"e_1_2_12_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-34350-7_42"},{"key":"e_1_2_12_38_1","first-page":"162","volume-title":"Constructivism in Education. The International Encyclopedia of Education\u2010Research and Studies","author":"Von Glasersfeld E.","year":"1989"},{"key":"e_1_2_12_39_1","volume-title":"Interaction Between Learning and Development","author":"Vygotsky L.","year":"2011"},{"key":"e_1_2_12_40_1","unstructured":"Yang L. Y.Zhang J.Wen Q.Zheng P.Li andG.Pan.2019.\u201cExpected Sarsa (\u03bb$$ \\lambda $$) With Control Variate for Variance Reduction. arXiv Preprint arXiv:1906.11058.\u201d"},{"key":"e_1_2_12_41_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i12.17270"},{"key":"e_1_2_12_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-63519-4"},{"key":"e_1_2_12_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-83347-2"},{"key":"e_1_2_12_44_1","doi-asserted-by":"publisher","DOI":"10.1177\/15554120241270058"},{"key":"e_1_2_12_45_1","first-page":"711","volume-title":"Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems","author":"Zhang Y.","year":"2019"},{"key":"e_1_2_12_46_1","doi-asserted-by":"publisher","DOI":"10.54254\/2755-2721\/71\/20241633"},{"key":"e_1_2_12_47_1","volume-title":"\u201c\u0398\u03b5\u03c3\u03c3\u03b1\u03bb\u03bf\u03bd\u03af\u03ba\u03b7: \u03bd\u03b5\u03c1\u03ac\u03b9\u03b4\u03b1, \u03b2\u03b1\u03c3\u03af\u03bb\u03b9\u03c3\u03c3\u03b1, \u03b3\u03bf\u03c1\u03b3\u03cc\u03bd\u03b1\u201d \u0391\u03c1\u03c7\u03b1\u03b9\u03bf\u03bb\u03bf\u03b3\u03b9\u03ba\u03ae \u03c0\u03b5\u03c1\u03b9\u03b4\u03b9\u03ac\u03b2\u03b1\u03c3\u03b7 \u03b1\u03c0\u03cc \u03c4\u03b7\u03bd \u03c0\u03c1\u03bf\u03ca\u03c3\u03c4\u03bf\u03c1\u03af\u03b1 \u03ad\u03c9\u03c2 \u03c4\u03b7\u03bd \u03cd\u03c3\u03c4\u03b5\u03c1\u03b7 \u03b1\u03c1\u03c7\u03b1\u03b9\u03cc\u03c4\u03b7\u03c4\u03b1","author":"\u0391\u03b4\u03ac\u03bc\u2010\u0392\u03b5\u03bb\u03ad\u03bd\u03b7 \u03a0.","year":"2001"}],"container-title":["Journal of Computer Assisted Learning"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/jcal.70156","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/jcal.70156","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/jcal.70156","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,12]],"date-time":"2026-02-12T15:24:16Z","timestamp":1770909856000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/jcal.70156"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,26]]},"references-count":46,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,2]]}},"alternative-id":["10.1111\/jcal.70156"],"URL":"https:\/\/doi.org\/10.1111\/jcal.70156","archive":["Portico"],"relation":{},"ISSN":["0266-4909","1365-2729"],"issn-type":[{"value":"0266-4909","type":"print"},{"value":"1365-2729","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,26]]},"assertion":[{"value":"2025-05-07","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-10-29","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-11-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e70156"}}