{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,14]],"date-time":"2025-11-14T15:13:30Z","timestamp":1763133210407,"version":"3.45.0"},"reference-count":44,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,11,14]],"date-time":"2025-11-14T00:00:00Z","timestamp":1763078400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Sci."],"abstract":"<jats:p>The Graduate Employability Skills app (GES-APP) is an innovative application that aims to assist students in higher education in thinking about and reflecting on their employability skills. This paper describes the iterative, 3 phase evaluation framework that was used in designing and evaluating the app and presents the key findings at each stage of the process. The iterative evaluation approach ensured that the GES-APP was modified at each phase by taking account of staff and students\u2019 suggestions for improvements. Participants in the evaluation were students and staff from the 4 partner institutions of the EU-funded GES-APP project. The initial piloting focused on self-reporting of employability skills and participants provided positive comments about this activity, the key idea, content organization and functionality. They considered that it was innovative, meaningful and important and motivated them in exploring their employability skills and attitudes. Participants also provided many useful suggestions that were used to improve the layout and the quality of graphics, enhance users\u2019 interactivity and feedback, and clarify the role of the employability coach. This revised prototype of the GES-APP was used in the quantitative and qualitative piloting of the extended app in phase 2. Further improvements were made and tested in phase 3. This involved a more rigorous, quasi-experimental design testing the final version of the GES-APP, using pre-and post-questionnaires to record students\u2019 understanding of their employability skills, employer needs and career preparation. Statistically significant changes were found following the GES-APP intervention along two key dimensions: (a) Understanding employer needs and the labor market and (b) preparing for a career. This evaluation suggests that students would welcome digital support of this kind in helping them make the transition from higher education into the world of work.<\/jats:p>","DOI":"10.3389\/fcomp.2025.1581143","type":"journal-article","created":{"date-parts":[[2025,11,14]],"date-time":"2025-11-14T15:10:42Z","timestamp":1763133042000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["The piloting and evaluation of the graduate employability skills app"],"prefix":"10.3389","volume":"7","author":[{"given":"Athanassios","family":"Jimoyiannis","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Elizabeth","family":"Boyle","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Graham G.","family":"Scott","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sobah Abbas","family":"Petersen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ewa","family":"Topolewska-Siedzik","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Panagiotis","family":"Tsiotakis","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aisha","family":"Abbas","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gavin","family":"Baxter","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maria","family":"Iqbal","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2025,11,14]]},"reference":[{"key":"ref1","doi-asserted-by":"crossref","first-page":"3934","DOI":"10.21125\/inted.2022.1076","article-title":"Graduate employability learning through self-determined learning model of instruction (SDLMI) driven digital app","volume-title":"INTED2022 proceedings","author":"Abbas","year":"2022"},{"key":"ref8001","volume-title":"Review of the Australian Qualifications Framework","year":"2019"},{"key":"ref2","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1111\/bjet.12113","article-title":"Mapping learning and game mechanics for serious games analysis","volume":"46","author":"Arnab","year":"2015","journal-title":"Br. J. Educ. Technol."},{"key":"ref3","first-page":"31","article-title":"Graduate employability and higher education: Past, present and future","volume":"5","author":"Bennett","year":"2019","journal-title":"HERDSA Rev. Higher Educ."},{"key":"ref4","volume-title":"Embedding employABILITY thinking across higher education","author":"Bennett","year":"2020"},{"key":"ref5","doi-asserted-by":"publisher","first-page":"1188","DOI":"10.1111\/bjet.12931","article-title":"The role of hybrid learning spaces in enhancing higher education students\u2019 employability","volume":"51","author":"Bennett","year":"2020","journal-title":"Br. J. Educ. Technol."},{"key":"ref6","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1111\/1467-985X.00203","article-title":"The transition from university to work: a multilevel approach to the analysis of the time to obtain the first job","volume":"164","author":"Biggeri","year":"2001","journal-title":"J. R. Stat. Soc. Ser. A Stat. Soc."},{"key":"ref1001","article-title":"Graduate employability skills (GES) App","volume-title":"Intellectual Output 1: Review of the GES literature","author":"Boyle","year":"2020"},{"key":"ref7","doi-asserted-by":"publisher","first-page":"202","DOI":"10.1080\/14780887.2014.955224","article-title":"The utility of template analysis in qualitative psychology research","volume":"12","author":"Brooks","year":"2015","journal-title":"Qual. Res. Psychol."},{"key":"ref8","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1108\/HEED-03-2021-0025","article-title":"Employability in higher education: a review of key stakeholders\u2019 perspectives","volume":"16","author":"Cheng","year":"2022","journal-title":"High. Educ. Eval. Dev."},{"key":"ref9","doi-asserted-by":"crossref","DOI":"10.4324\/9781315456539","volume-title":"Research methods in education","author":"Cohen","year":"2017"},{"key":"ref8002","article-title":"Employability Skills","volume-title":"U.S. Department of Education, Office of Career, Technical, and Adult Education","year":"2015"},{"key":"ref11","volume-title":"A concise introduction to mixed methods research","author":"Creswell","year":"2021"},{"key":"ref12","volume-title":"Design thinking: Get started with prototyping","author":"Dam","year":"2020"},{"key":"ref13","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1016\/j.compedu.2005.11.007","article-title":"How can exploratory learning with games and simulations within the curriculum be most effectively evaluated?","volume":"46","author":"De Freitas","year":"2006","journal-title":"Comput. Educ."},{"key":"ref14","volume-title":"Scale development: Theory and applications","author":"DeVellis","year":"2003"},{"key":"ref15","doi-asserted-by":"publisher","first-page":"20290","DOI":"10.3402\/rlt.v21i0.20290","article-title":"Forward-oriented design for learning: illustrating the approach","volume":"21","author":"Dimitriadis","year":"2013","journal-title":"Res. Learn. Technol."},{"key":"ref16","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1177\/0270467604264992","article-title":"The five-stage model of adult skill acquisition","volume":"24","author":"Dreyfus","year":"2004","journal-title":"Bull. Sci. Technol. Soc."},{"key":"ref17","article-title":"Embedding LinkedIn learning MOOCs to enhance students\u2019 educational experience and employability","author":"Du","year":"2021"},{"key":"ref18","volume-title":"Report to the European Commission on new modes of learning and teaching in higher education","year":"2014"},{"key":"ref19","volume-title":"Employability skills framework: Defining and integrating employability skills","year":"2019"},{"key":"ref20","doi-asserted-by":"crossref","first-page":"82","DOI":"10.14742\/ajet.1344","article-title":"Educational design and networked learning: patterns, pattern languages and design practice","volume":"21","author":"Goodyear","year":"2005","journal-title":"Australas. J. Educ. Technol."},{"key":"ref22","year":"2022"},{"key":"ref24","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1080\/00091383.2018.1540819","article-title":"Re-thinking soft skills and student employability: a new paradigm for undergraduate education","volume":"50","author":"Hora","year":"2018","journal-title":"Change Mag. High. Learn."},{"key":"ref25","doi-asserted-by":"publisher","first-page":"605","DOI":"10.1177\/0018726715591636","article-title":"Rethinking the soft skills deficit blame game: employers, skills withdrawal and the reporting of soft skills gaps","volume":"69","author":"Hurrell","year":"2016","journal-title":"Hum. Relat."},{"key":"ref26","doi-asserted-by":"publisher","first-page":"743","DOI":"10.1007\/s11423-014-9352-7","article-title":"A methodological framework for instructional design model development: critical dimensions and synthesized procedures","volume":"62","author":"Lee","year":"2014","journal-title":"Educ. Technol. Res. Dev."},{"key":"ref27","volume-title":"A literature review looking at graduate employability skills (GESs): GES app report 1: Review of the GES literature","author":"Maciejewski","year":"2020"},{"key":"ref28","volume-title":"Review of e-learning theories, frameworks and models","author":"Mayes","year":"2004"},{"key":"ref29","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1111\/1467-8535.00285","article-title":"A design framework for online learning environments","volume":"33","author":"Mishra","year":"2002","journal-title":"Br. J. Educ. Technol."},{"key":"ref3001","volume-title":"Job outlook 2016: The attributes employers want to see on new college graduates\u2019 resumes. National Association of College and Educators","year":"2016"},{"key":"ref30","volume-title":"The skills and competencies taxonomy","year":"2013"},{"key":"ref31","volume-title":"OECD employment outlook 2019: The future of work","year":"2019"},{"key":"ref32","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1108\/ET-10-2020-0329","article-title":"How to develop higher education curricula towards employability? A multi-stakeholder approach","volume":"64","author":"Olo","year":"2022","journal-title":"Educ. Train."},{"key":"ref33","first-page":"16","article-title":"GES app-Mobile application to support reflection and documentation of Global employability skills","volume":"21","author":"Petersen","year":"2023","journal-title":"IADIS Int. J. WWW\/internet"},{"key":"ref34","doi-asserted-by":"publisher","first-page":"118","DOI":"10.1080\/0144929X.2020.1795262","article-title":"Design and development of the online career counselling: a tool for better career decision-making","volume":"41","author":"Pordelan","year":"2022","journal-title":"Behav. Inf. Technol."},{"key":"ref36","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1037\/14439-005","article-title":"Using information and communication technology in delivering career interventions","volume-title":"APA handbook of career interventions","author":"Sampson","year":"2015"},{"key":"ref37","doi-asserted-by":"crossref","first-page":"351","DOI":"10.34190\/ejel.20.3.2181","article-title":"Acceptance of serious games to develop digital competencies in higher education","volume":"20","author":"Sand\u00ed-Delgado","year":"2022","journal-title":"Electron. J. e-Learn."},{"key":"ref38","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1007\/s10734-017-0207-0","article-title":"The employability skills of higher education graduates: insights into conceptual frameworks and methodological options","volume":"76","author":"Suleman","year":"2018","journal-title":"High. Educ."},{"key":"ref39","doi-asserted-by":"publisher","first-page":"588","DOI":"10.1108\/HESWBL-05-2021-0101","article-title":"The question of university graduates' employability: are the students aware of the employers' preferences","volume":"12","author":"Tandika","year":"2022","journal-title":"High. Educ. Skills Work-Based Learn."},{"key":"ref40","volume-title":"Essential frameworks for enhancing student success: Embedding employability","author":"Tibby","year":"2020"},{"key":"ref41","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1080\/01425690701737457","article-title":"\u2018The degree is not enough\u2019: students\u2019 perceptions of the role of higher education credentials for graduate work and employability","volume":"29","author":"Tomlinson","year":"2008","journal-title":"Br. J. Sociol. Educ."},{"key":"ref42","doi-asserted-by":"publisher","first-page":"841","DOI":"10.1080\/03075079.2011.604408","article-title":"The student perspective on employability","volume":"38","author":"Tymon","year":"2013","journal-title":"Stud. High. Educ."},{"key":"ref43","doi-asserted-by":"publisher","first-page":"103498","DOI":"10.1016\/j.brat.2019.103498","article-title":"A review of popular smartphone apps for depression and anxiety: assessing the inclusion of evidence-based content","volume":"123","author":"Wasil","year":"2019","journal-title":"Behav. Res. Ther."},{"key":"ref44","volume-title":"Embedding employability into the curriculum, Learning and employability series","author":"Yorke","year":"2006"}],"container-title":["Frontiers in Computer Science"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2025.1581143\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,14]],"date-time":"2025-11-14T15:10:47Z","timestamp":1763133047000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2025.1581143\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,14]]},"references-count":44,"alternative-id":["10.3389\/fcomp.2025.1581143"],"URL":"https:\/\/doi.org\/10.3389\/fcomp.2025.1581143","relation":{},"ISSN":["2624-9898"],"issn-type":[{"value":"2624-9898","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,14]]},"article-number":"1581143"}}