{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T21:10:17Z","timestamp":1783113017225,"version":"3.54.6"},"reference-count":67,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2020,3,15]],"date-time":"2020-03-15T00:00:00Z","timestamp":1584230400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Regional Development Fund (ERDF) and the Brussels-Capital Region","award":["ERDF-2020 project ICITY-RDI.BRU"],"award-info":[{"award-number":["ERDF-2020 project ICITY-RDI.BRU"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Most people are using their smartphones daily and carry them all the time. Therefore, mobile learning applications can be integrated in daily routines to make learning a part of daily life. While numerous mobile learning applications exist, each with their own goal, our aim was to explore the possibility of creating an engaging mobile environment that could be useful for informal learning, as well as for other forms of learning, i.e., non-formal and formal learning. The result is TICKLE, a playful learning environment for youngsters. It is a mobile location-based smartphone application that offers youngsters an interactive environment for exploring their surroundings. It offers cards related to physical locations, which can be collected by performing small challenges (based on the principles of micro learning). A design science research approach has been used to develop this software environment. Persuasive techniques and gamification are used to stimulate usage. Furthermore, a personalized approach is applied. The environment was evaluated by means of formative evaluations in different contexts. We obtained positive results and received useful feedback to improve and extend the application. We can conclude that, in the context of these evaluations, the app was usable for youngsters and able to engage them, and we see indications that it may be able to increase the intrinsic motivation and learning capacity of youngsters. In addition, our demonstrations show that the app is usable in different contexts and for different purposes. In this way, the environment can be used to offer youngsters appealing learning related experiences.<\/jats:p>","DOI":"10.3390\/info11030157","type":"journal-article","created":{"date-parts":[[2020,3,17]],"date-time":"2020-03-17T09:27:41Z","timestamp":1584437261000},"page":"157","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Playful Learning with a Location-Based Digital Card Environment: A Promising Tool for Informal, Non-Formal, and Formal Learning"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8457-7143","authenticated-orcid":false,"given":"Olga","family":"De Troyer","sequence":"first","affiliation":[{"name":"Research group WISE, Department Computer Science, Vrije Universiteit Brussel, 1050 Brussel, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jan","family":"Maushagen","sequence":"additional","affiliation":[{"name":"Research group WISE, Department Computer Science, Vrije Universiteit Brussel, 1050 Brussel, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9969-1950","authenticated-orcid":false,"given":"Renny","family":"Lindberg","sequence":"additional","affiliation":[{"name":"Research group WISE, Department Computer Science, Vrije Universiteit Brussel, 1050 Brussel, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Breckx","sequence":"additional","affiliation":[{"name":"Research group WISE, Department Computer Science, Vrije Universiteit Brussel, 1050 Brussel, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,3,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1002\/ace.5","article-title":"Informal and Incidental Learning","volume":"89","author":"Marsick","year":"2001","journal-title":"New Dir. adult Contin. Educ."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1002\/tea.3660250205","article-title":"Scientific literacy and informal science teaching","volume":"25","author":"Maarschalk","year":"1998","journal-title":"J. Res. Sci. Teach."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1080\/00958964.1991.9943052","article-title":"Factors associated with the relationship between formal, informal, and nonformal science learning","volume":"22","author":"Tamir","year":"1991","journal-title":"J. Environ. Educ."},{"key":"ref_4","unstructured":"Reischmann, J. (1986, January 23). Learning \u2018en passant\u2019: The Forgotten Dimension Andragogy. Proceedings of the Conference of the American Association of Adult and Continuing Education, Hollywood, FL, USA."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1002\/tl.37219956304","article-title":"Understanding self-regulated learning","volume":"199","author":"Pintrich","year":"1995","journal-title":"New Dir. Teach. Learn."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Grant, M.M. (2015). Using mobile devices to support formal, informal & semi-formal. uses and implications for teaching & learning. Emerging Technologies for Steam Education, Springer.","DOI":"10.1007\/978-3-319-02573-5_9"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1007\/s10956-006-9027-1","article-title":"Bridging In-school and Out-of-school Learning: Formal, Non-Formal, and Informal Education","volume":"16","author":"Eshach","year":"2007","journal-title":"J. Sci. Educ. Technol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"837","DOI":"10.1016\/j.sbspro.2013.10.405","article-title":"Social Media as a Non-formal Learning Platform","volume":"103","author":"Lee","year":"2013","journal-title":"Procedia Soc. Behav. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1109\/TLT.2009.39","article-title":"Geolearners: Location-Based Informal Learning with Mobile and Social Technologies","volume":"3","author":"Clough","year":"2010","journal-title":"IEEE Trans. Learn. Technol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.iheduc.2011.06.002","article-title":"Internet and Higher Education Personal Learning Environments, social media, and self-regulated learning: A natural formula for connecting formal and informal learning","volume":"15","author":"Dabbagh","year":"2012","journal-title":"Internet High. Educ."},{"key":"ref_11","first-page":"3","article-title":"The add-on impact of mobile applications in learning strategies: A review study","volume":"13","author":"Jeng","year":"2010","journal-title":"Educ. Technol. Soc."},{"key":"ref_12","unstructured":"Clement, J. (2019, December 04). Social Media\u2014STATISTICS & Facts. Available online: https:\/\/www.statista.com\/topics\/1164\/social-networks\/."},{"key":"ref_13","unstructured":"McCord Museum (2019, December 16). MTL Urban Museum. Available online: https:\/\/www.musee-mccord.qc.ca\/en\/mtl-urban-museum\/."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1108\/00242531311328168","article-title":"Lowering the threshold to libraries with social media: The approach of \u2018Digital Literacy 2.0\u2019, a project funded in the EU Lifelong Learning Programme","volume":"62","author":"Bernsmann","year":"2013","journal-title":"Libr. Rev."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1016\/j.iheduc.2013.06.002","article-title":"Mobile computing devices in higher education: Student perspectives on learning with cellphones, smartphones & social media","volume":"19","author":"Gikas","year":"2013","journal-title":"Internet High. Educ."},{"key":"ref_16","unstructured":"Naismith, L., Lonsdale, P., Vavoula, G., and Sharples, M. (2018, August 20). Literature Review in Mobile Technologies and Learning. Available online: https:\/\/telearn.archives-ouvertes.fr\/hal-00190143."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.tsc.2009.11.001","article-title":"Creative and playful learning: Learning through game co-creation and games in a playful learning environment","volume":"5","author":"Kangas","year":"2010","journal-title":"Think. Ski. Creat."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Kangas, M., and Ruokamo, H. (2012). Playful Learning Environments: Effects on Children\u2019s Learning. Encyclopedia of the Sciences of Learning, Springer.","DOI":"10.1007\/978-1-4419-1428-6_756"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"45","DOI":"10.2753\/MIS0742-1222240302","article-title":"A Design Science Research Methodology for Information Systems Research","volume":"24","author":"Peffers","year":"2007","journal-title":"Source J. Manag. Inf. Syst."},{"key":"ref_20","unstructured":"Hug, T. (2007). Didactics of Microlearning, Waxmann Verlag."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1145\/764008.763957","article-title":"Persuasive technology: Using computers to change what we think and do","volume":"2002","author":"Fogg","year":"2002","journal-title":"Ubiquity"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Deterding, S., Dixon, D., Khaled, R., and Nacke, L. (2011, January 28\u201330). From Game Design Elements to Gamefulness. Proceedings of the 15th International Academic MindTrek Conference on Envisioning Future Media Environments\u2014MindTrek, Tampere, Finland.","DOI":"10.1145\/2181037.2181040"},{"key":"ref_23","first-page":"1","article-title":"PACARD: A New Interface to Increase Mobile Learning App Engagement, Distributed Through App Stores","volume":"57","author":"Pham","year":"2018","journal-title":"J. Educ. Comput. Res."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Edge, D., Whitney, M., and Charlotte, C. (2012, January 21\u201324). MemReflex: Adaptive Flashcards for Mobile Microlearning. Proceedings of the 14th international Conference on Human-Computer Interaction with Mobile Devices and services, San Francisco, CA, USA.","DOI":"10.1145\/2371574.2371641"},{"key":"ref_25","unstructured":"Epignosis (2019, December 06). Talentcards. Available online: https:\/\/www.talentcards.com\/."},{"key":"ref_26","unstructured":"TELMA (2019, December 16). S_U+G Serious Urban Game. Available online: http:\/\/sug-platform.be\/."},{"key":"ref_27","first-page":"2120","article-title":"A Review of Mobile Location-based Games for Learning across Physical and Virtual Spaces","volume":"18","author":"Avouris","year":"2012","journal-title":"J. Univers. Comput. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Toscos, T., and Faber, A. (2006, January 22\u201327). Chick Clique: Persuasive Technology to Motivate Teenage Girls to Exercise. Proceedings of the CHI\u201906 extended abstracts on Human factors in computing systems, Montr\u00e9al, QC, Cananda.","DOI":"10.1145\/1125451.1125805"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Kimura, H., Ebisui, J., Funabashi, Y., Yoshii, A., and Nakajima, T. (2011, January 21\u201325). iDetective: A Persuasive Application to Motivate Healthier Behavior Using Smart Phone. Proceedings of the Proceedings of the 2011 ACM Symposium on Applied Computing, TaiChung, Taiwan.","DOI":"10.1145\/1982185.1982273"},{"key":"ref_30","unstructured":"Tikka, P., Woldemicael, B., and Oinas-kukkonen, H. (2016, January 5). Building an App for Behavior Change: Case RightOnTime. Proceedings of the Fouth International Workshop on Behavior Change Support Systems (BCSS 2016), Salzburg, Austria."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"75","DOI":"10.2307\/25148625","article-title":"Design Science in Information Systems Research","volume":"28","author":"Hevner","year":"2004","journal-title":"MIS Q."},{"key":"ref_32","unstructured":"Offermann, P., Levina, O., Sch\u00f6nherr, M., and Bub, U. (, January May). Outline of a Design Science Research Process. Proceedings of the 4th International Conference on Design Science Research in Information Systems and Technology, Philadelphia, PA, USA."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1027\/1015-5759.25.1.48","article-title":"School Burnout Inventory (SBI) Reliability and Validity","volume":"25","author":"Kiuru","year":"2009","journal-title":"Eur. J. Psychol. Assess."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1007\/s10212-012-0126-5","article-title":"Burned Out to Drop Out: Exploring the Relationship Between School Burnout and School Dropout","volume":"28","author":"Bask","year":"2013","journal-title":"Eur. J. Psychol. Educ."},{"key":"ref_35","unstructured":"European Commission (2018, August 20). Reducing Early School Leaving: Key Messages and Policy Support. Available online: https:\/\/ec.europa.eu\/education\/content\/reducing-early-school-leaving-key-messages-and-policy-support_en."},{"key":"ref_36","unstructured":"European Commission (2018, August 20). Early School Leaving. Available online: http:\/\/ec.europa.eu\/education\/policy\/school\/early-school-leavers_en."},{"key":"ref_37","unstructured":"Vlieghe, J., and de Troyer, O. (2018, August 20). Tickle Report D1: State-of-the-art on Media Use in Belgium, Flanders & Belgium. Available online: https:\/\/wise.vub.ac.be\/tickle\/index.php\/reformation\/sota-mediause\/."},{"key":"ref_38","unstructured":"Vlieghe, J., and de Troyer, O. (2018, August 20). Tickle Report D2: State-of-the-Art on Early School Leaving and Dropouts. Available online: https:\/\/wise.vub.ac.be\/tickle\/index.php\/reformation\/report-d2-state-of-the-art-on-early-school-leaving-and-dropouts\/."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Fogg, B. (2009, January 26\u201329). A Behavior Model for Persuasive Design. Proceedings of the 4th International Conference on Persuasive Technology\u2014Persuasive, Claremont, CA, USA.","DOI":"10.1145\/1541948.1541999"},{"key":"ref_40","unstructured":"Lo, J.L. (2007, January 16\u201319). Playful Tray: Adopting Ubicomp and Persuasive Techniques into Play-Based Occupational Therapy for Reducing Poor Eating Behavior in Young Children. Proceedings of the International Conference on Ubiquitous Computing, Innsbruck, Austria."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Pham, X.-L., Nguyen, T.-H., Hwang, W.-Y., and Chen, G.-D. (2016, January 25\u201328). Effects of push notifications on learner engagement in a mobile learning app. Proceedings of the 2016 IEEE 16th International Conference on Advanced Learning Technologies (ICALT), Austin, TX, USA.","DOI":"10.1109\/ICALT.2016.50"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1173","DOI":"10.1007\/s00779-012-0585-3","article-title":"Adaptive persuasive messaging to increase service retention: Using persuasion profiles to increase the effectiveness of email reminders","volume":"17","author":"Kaptein","year":"2013","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_43","unstructured":"Eyal, N. (2014). Hooked: How to Build Habit-Forming Products, Penguin Books Ltd."},{"key":"ref_44","unstructured":"Simons, H.W., Jones, J.G., and Simons, H.W. (2017). Persuasion in Society, SAGE."},{"key":"ref_45","unstructured":"Vlieghe, J., and de Troyer, O. (2018, August 20). Tickle Reoprt D3: Literature Study on Persuasive Techniques and Technology. Available online: https:\/\/wise.vub.ac.be\/tickle\/wp-content\/uploads\/2015\/12\/Report-D3_final.pdf."},{"key":"ref_46","unstructured":"Goldstein, N.J., Steve, M.J., and Cialdini, R.B. (2008). Yes! 50 Scientifically Proven Ways to be Persuasive, Simon & Schuster Inc."},{"key":"ref_47","unstructured":"Lawrence, A.P., and John, O.P. (1999). The Big Five trait taxonomy: History, measurement, and theoretical perspectives. Handbook of Personality: Theory and Research, Elsevier."},{"key":"ref_48","unstructured":"Kidimedia (2020, January 23). BookWidgets Interactive Learning. Available online: https:\/\/www.bookwidgets.com\/."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1016\/j.ijhcs.2015.01.004","article-title":"Personalizing persuasive technologies: Explicit and implicit personalization using persuasion profiles","volume":"77","author":"Markopoulos","year":"2015","journal-title":"Int. J. Hum. Comput. Stud."},{"key":"ref_50","unstructured":"(2020, January 23). Progressive Web Apps. Available online: https:\/\/developers.google.com\/web\/progressive-web-apps\/."},{"key":"ref_51","unstructured":"(2020, January 23). Redux\u2014A Predictable State Container for JS Apps. Available online: https:\/\/redux.js.org\/."},{"key":"ref_52","unstructured":"Facebook (2020, January 23). React\u2014A Javascript Library for Building User Interfaces. Available online: https:\/\/reactjs.org\/."},{"key":"ref_53","unstructured":"(2020, January 23). Firebase Helps Mobile and Web App Teams Succeed. Available online: https:\/\/firebase.google.com\/."},{"key":"ref_54","unstructured":"(2020, January 23). Json-Rules-Engine. Available online: https:\/\/www.npmjs.com\/package\/json-rules-engine."},{"key":"ref_55","unstructured":"Anderson, J.G., and Aydin, C.E. (2005). Qualitative research methods for evaluating computer information systems. Evaluating the Organizational Impact of Heathcare Information Systems, Springer."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"27","DOI":"10.3316\/QRJ0902027","article-title":"Document Analysis as a Qualitative Research Method","volume":"9","author":"Bowen","year":"2009","journal-title":"Qual. Res. J."},{"key":"ref_57","unstructured":"(2019, December 19). Geocaching. Available online: https:\/\/www.geocaching.com\/."},{"key":"ref_58","unstructured":"VDS (2019, December 16). Vlaamse Dienst Speelpleinwerking. Available online: https:\/\/www.speelplein.net\/."},{"key":"ref_59","first-page":"39","article-title":"Efficient Measurement of the User Experience of Interactive Products. How to use the User Experience Questionnaire (UEQ). Example: Spanish Language Version","volume":"2","author":"Rauschenberger","year":"2013","journal-title":"Int. J. Artif. Intell. Interact. Multimed."},{"key":"ref_60","unstructured":"(2019, December 16). Team UEQ, User Experience Questionnaire. Available online: https:\/\/www.ueq-online.org\/."},{"key":"ref_61","unstructured":"Alba (2019, December 16). alba\u2014Try-Out Brussel. Available online: http:\/\/alba.be\/project\/try-out-brussel\/."},{"key":"ref_62","unstructured":"CADLimburg (2019, December 16). Centra Voor Alcohol-en Andere Drugproblemen Limburg. Available online: https:\/\/www.cadlimburg.be\/."},{"key":"ref_63","unstructured":"(2019, December 16). Reboot. Available online: https:\/\/www.rebootkamp.be\/."},{"key":"ref_64","unstructured":"Koerth-Baker, M., and Wolfe, J. (2019, December 16). Most Personality Quizzes Are Junk Science. Available online: https:\/\/projects.fivethirtyeight.com\/personality-quiz\/."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.intmar.2018.03.002","article-title":"Gameful Experience in Gamification: Construction and Validation of a Gameful Experience Scale","volume":"43","author":"Eppmann","year":"2018","journal-title":"J. Interact. Mark."},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Boberg, M., Karapanos, E., Holopainen, J., and Lucero, A. (2015, January 3\u20137). \u201cPLEXQ: Towards a Playful Experiences Questionnaire. Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY 2015), London, UK.","DOI":"10.1145\/2793107.2793124"},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Lindberg, R., Maushagen, J., and de Troyer, O. (2019, January 2\u20134). Combining a Gamified Civic Engagement Platform with a Digital Game in a Loosely Way to Increase Retention. Proceedings of the 21st International Conference on Information Integration and Web-based Applications & Services, Munich, Germany.","DOI":"10.1145\/3366030.3366117"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/11\/3\/157\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:07:04Z","timestamp":1760173624000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/11\/3\/157"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,15]]},"references-count":67,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2020,3]]}},"alternative-id":["info11030157"],"URL":"https:\/\/doi.org\/10.3390\/info11030157","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,3,15]]}}}