{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T18:33:31Z","timestamp":1780425211923,"version":"3.54.1"},"reference-count":51,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2025,7,20]],"date-time":"2025-07-20T00:00:00Z","timestamp":1752969600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>This research highlights the importance of Emotion Aware Technologies (EAT) and their implementation in serious games to assist children with Autism Spectrum Disorder (ASD) in developing social-emotional skills. As AI is gaining popularity, such tools can be used in mobile applications as invaluable teaching tools. In this paper, a new AI framework application is discussed that will help children with ASD develop efficient social-emotional skills. It uses the Jetpack Compose framework and Google Cloud Vision API as emotion-aware technology. The framework is developed with two main features designed to help children reflect on their emotions, internalise them, and train them how to express these emotions. Each activity is based on similar features from literature with enhanced functionalities. A diary feature allows children to take pictures of themselves, and the application categorises their facial expressions, saving the picture in the appropriate space. The three-level minigame consists of a series of prompts depicting a specific emotion that children have to match. The results of the framework offer a good starting point for similar applications to be developed further, especially by training custom models to be used with ML Kit.<\/jats:p>","DOI":"10.3390\/computers14070292","type":"journal-article","created":{"date-parts":[[2025,7,21]],"date-time":"2025-07-21T08:47:14Z","timestamp":1753087634000},"page":"292","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["A New AI Framework to Support Social-Emotional Skills and Emotion Awareness in Children with Autism Spectrum Disorder"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-8295-8242","authenticated-orcid":false,"given":"Andrea","family":"La Fauci De Leo","sequence":"first","affiliation":[{"name":"James Graham Building, Leeds Beckett University, Church Wood Ave, Leeds LS6 3QS, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2875-3253","authenticated-orcid":false,"given":"Pooneh","family":"Bagheri Zadeh","sequence":"additional","affiliation":[{"name":"James Graham Building, Leeds Beckett University, Church Wood Ave, Leeds LS6 3QS, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kiran","family":"Voderhobli","sequence":"additional","affiliation":[{"name":"James Graham Building, Leeds Beckett University, Church Wood Ave, Leeds LS6 3QS, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0677-7083","authenticated-orcid":false,"given":"Akbar","family":"Sheikh Akbari","sequence":"additional","affiliation":[{"name":"James Graham Building, Leeds Beckett University, Church Wood Ave, Leeds LS6 3QS, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,7,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Wu, X., Deng, H., Jian, S., Chen, H.C., Li, Q., Gong, R., and Wu, J. (2023). Global Trends and Hotspots in the Digital Therapeutics of Autism Spectrum Disorders: A Bibliometric Analysis from 2002 to 2022. Front. Psychiatry, 14.","DOI":"10.3389\/fpsyt.2023.1126404"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3509","DOI":"10.2147\/NDT.S282569","article-title":"Challenges Surrounding the Diagnosis of Autism in Children","volume":"17","author":"Hus","year":"2021","journal-title":"Neuropsychiatr. Dis. Treat."},{"key":"ref_3","first-page":"100626","article-title":"Autism in England: Assessing Underdiagnosis in a Population-Based Cohort Study of Prospectively Collected Primary Care Data","volume":"29","author":"Petersen","year":"2023","journal-title":"Lancet Reg. Health"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"American Psychiatric Association (2022). Diagnostic and Statistical Manual of Mental Disorders, Text Revision, DSM-5-TR, American Psychiatric Association. [5th ed.].","DOI":"10.1176\/appi.books.9780890425787"},{"key":"ref_5","first-page":"314","article-title":"Industrial Revolution 4.0 and Education","volume":"8","author":"Shahroom","year":"2018","journal-title":"Int. J. Acad. Res. Bus. Soc. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.4018\/JCIT.2021010101","article-title":"AI in Education","volume":"23","author":"Tahiru","year":"2021","journal-title":"J. Cases Inf. Technol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1669","DOI":"10.1007\/s11042-022-13248-6","article-title":"A Comprehensive Survey on Techniques to Handle Face Identity Threats: Challenges and Opportunities","volume":"82","author":"Rusia","year":"2022","journal-title":"Multimed. Tools Appl."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1080\/17439884.2020.1686014","article-title":"Facial Recognition Technology in Schools: Critical Questions and Concerns","volume":"45","author":"Andrejevic","year":"2019","journal-title":"Learn. Media Technol."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zakari, H.M., Ma, M., and Simmons, D. (2014). A Review of Serious Games for Children with Autism Spectrum Disorders (ASD). Serious Games Dev. Appl., 93\u2013106.","DOI":"10.1007\/978-3-319-11623-5_9"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/j.compedu.2017.05.002","article-title":"Serious Games to Teach Social Interactions and Emotions to Individuals with Autism Spectrum Disorders (ASD)","volume":"113","author":"Grossard","year":"2017","journal-title":"Comput. Educ."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1475","DOI":"10.1098\/rstb.2008.0324","article-title":"Stereotypes of Autism","volume":"364","author":"Draaisma","year":"2009","journal-title":"Philos. Trans. R. Soc. B Biol. Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"525","DOI":"10.1016\/j.pcl.2020.02.007","article-title":"Autism Spectrum Disorder","volume":"67","author":"Kodak","year":"2020","journal-title":"Pediatr. Clin. North Am."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/S0074-7750(00)80010-5","article-title":"Theory of Mind and Autism: A Review","volume":"23","year":"2000","journal-title":"Autism"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/0010-0277(85)90022-8","article-title":"Does the Autistic Child Have a \u201cTheory of Mind\u201d?","volume":"21","author":"Leslie","year":"1985","journal-title":"Cognition"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/0010-0277(83)90004-5","article-title":"Beliefs about Beliefs: Representation and Constraining Function of Wrong Beliefs in Young Children\u2019s Understanding of Deception","volume":"13","author":"Wimmer","year":"1983","journal-title":"Cognition"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"933","DOI":"10.1017\/S0954579414000479","article-title":"Impairments in Facial Affect Recognition Associated with Autism Spectrum Disorders: A Meta-Analysis","volume":"26","author":"Lozier","year":"2014","journal-title":"Dev. Psychopathol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/S0002-7138(09)62273-1","article-title":"The Infant\u2019s Response to Entrapment between Contradictory Messages in Face-To-Face Interaction","volume":"17","author":"Tronick","year":"1978","journal-title":"J. Am. Acad. Child Psychiatry"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3281","DOI":"10.1007\/s10803-016-2872-8","article-title":"The Experiences of Late-Diagnosed Women with Autism Spectrum Conditions: An Investigation of the Female Autism Phenotype","volume":"46","author":"Bargiela","year":"2016","journal-title":"J. Autism Dev. Disord."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"938","DOI":"10.1007\/s10803-009-0700-0","article-title":"Emotion Recognition in Children and Adolescents with Autism Spectrum Disorders","volume":"39","author":"Kuusikko","year":"2009","journal-title":"J. Autism Dev. Disord."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1007\/s10209-018-0627-3","article-title":"Let Me Play: Unfolding the Research Landscape on ICT as a Play-Based Tool for Children with Disabilities","volume":"19","author":"Nisiforou","year":"2018","journal-title":"Univers. Access Inf. Soc."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"963","DOI":"10.4236\/ce.2016.77100","article-title":"ICTs in the Classroom, Multiliteracy and Special Education: A Required Interface","volume":"7","author":"Manrique","year":"2016","journal-title":"Creat. Educ."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1007\/s40593-016-0126-8","article-title":"Developing Emotion-Aware, Advanced Learning Technologies: A Taxonomy of Approaches and Features","volume":"27","author":"Harley","year":"2016","journal-title":"Int. J. Artif. Intell. Educ."},{"key":"ref_23","unstructured":"Iosifidis, A., and Tefas, A. (2022). Chapter 3\u2014Convolutional Neural Networks. Deep Learning for Robot Perception and Cognition, Academic Press."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Di Luzio, F., Rosato, A., and Panella, M. (2023). A Randomized Deep Neural Network for Emotion Recognition with Landmarks Detection. Biomed. Signal Process. Control, 81.","DOI":"10.1016\/j.bspc.2022.104418"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1016\/j.procs.2019.05.038","article-title":"Deep Learning Approach for Emotion Recognition from Human Body Movements with Feedforward Deep Convolution Neural Networks","volume":"152","author":"Santhoshkumar","year":"2019","journal-title":"Procedia Comput. Sci."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Manewa, R.M.A.H., and Mayurathan, B. (2020, January 1\u20133). Emotion Recognition and Discrimination of Facial Expressions Using Convolutional Neural Networks. Proceedings of the 2020 IEEE 8th R10 Humanitarian Technology Conference (R10-HTC), Kuching, Malaysia.","DOI":"10.1109\/R10-HTC49770.2020.9357008"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Al-Omair, O.M., and Huang, S. (2018, January 28). A Comparative Study on Detection Accuracy of Cloud-Based Emotion Recognition Services. Proceedings of the SPML \u201918: Proceedings of the 2018 International Conference on Signal Processing and Machine Learning, Shanghai, China.","DOI":"10.1145\/3297067.3297079"},{"key":"ref_28","first-page":"419","article-title":"Teaching Children with Autism Spectrum Disorder to Recognize and Express Emotion: A Review of the Literature","volume":"9","author":"Daou","year":"2016","journal-title":"Int. Electron. J. Elem. Educ."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"100396","DOI":"10.1016\/j.entcom.2020.100396","article-title":"Serious Games for People with Mental Disorders: State of the Art of Practices to Maintain Engagement and Accessibility","volume":"37","author":"Francillette","year":"2020","journal-title":"Entertain. Comput."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"de Urturi, Z.S., Zorrilla, A.M., and Zapirain, B.G. (2011, January 25). Serious Game Based on First Aid Education for Individuals with Autism Spectrum Disorder (ASD) Using Android Mobile Devices. Proceedings of the 16th International Conference on Computer Games (CGAMES), Louisville, KY, USA.","DOI":"10.1109\/CGAMES.2011.6000343"},{"key":"ref_31","unstructured":"Alharbi, M., and Huang, S. (2022, March 21). An Augmentative System with Facial and Emotion Recognition for Improving Social Skills of Children with Autism Spectrum Disorders. Available online: https:\/\/ieeexplore.ieee.org\/abstract\/document\/9275659."},{"key":"ref_32","unstructured":"(2024, May 31). Emoface EMOFACE\u2014APPRENDRE LES EMOTIONS. Available online: https:\/\/www.emoface.fr\/en\/home\/."},{"key":"ref_33","first-page":"809","article-title":"Using Emotion Recognition Technologies to Teach Children with Autism Spectrum Disorder How to Identify and Express Emotions","volume":"21","author":"Penichet","year":"2021","journal-title":"Univers. Access Inf. Soc."},{"key":"ref_34","first-page":"30","article-title":"The Effectiveness of Floortime Play Therapy on Improving Executive Functions and Cognitive Emotion Regulation in Children with Attention Deficit\/Hyperactivity Disorder (ADHD)","volume":"2","author":"Roghani","year":"2022","journal-title":"Int. J. Educ. Cogn. Sci."},{"key":"ref_35","unstructured":"Ornaghi, V., Agliati, A., and Grazzani, I. (2014). THE STORIES of CIRO and BEBA How to Enhance Conversation with Toddlers on Emotions, Fronteretro: \u201cR. Massa\u201d Department of Educational Human Sciences University of Milano-Bicocca."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1007\/s11920-018-0949-0","article-title":"Psychosocial Treatments Targeting Anxiety and Depression in Adolescents and Adults on the Autism Spectrum: Review of the Latest Research and Recommended Future Directions","volume":"20","author":"White","year":"2018","journal-title":"Curr. Psychiatry Rep."},{"key":"ref_37","unstructured":"(2024, September 24). Statista Mobile OS Market Share|Statista. Available online: https:\/\/www.statista.com\/statistics\/272698\/global-market-share-held-by-mobile-operating-systems-since-2009\/."},{"key":"ref_38","unstructured":"(2024, September 25). Google Android API Reference. Available online: https:\/\/developer.android.com\/reference."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Prawira, G.S.A., Kaburuan, E.R., and Effendy, V. (2017, January 8\u201310). User Interface (UI) Design of Scheduling Activity Apps for Autistic Children. Proceedings of the 2017 International Conference on Orange Technologies (ICOT), Singapore.","DOI":"10.1109\/ICOT.2017.8336105"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Shabbir, N., Bhatti, Z., and Hakro, D.N. (2019, January 14\u201315). Serious Game User Interface Design Rules for Dyslexic Children. Proceedings of the 2019 13th International Conference on Mathematics, Actuarial Science, Computer Science and Statistics (MACS), Karachi, Pakistan.","DOI":"10.1109\/MACS48846.2019.9024786"},{"key":"ref_41","first-page":"167","article-title":"Analysis of Developing Native Android Applications Using XML and Jetpack Compose","volume":"6","author":"Milla","year":"2023","journal-title":"Balk. J. Appl. Math. Inform."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Paramadani, R.B., Aminul Akbar, M., and Pinandito, A. (2023, January 24\u201325). User Interface Rendering Time in Android Applications: Revealing the Effects of Design Patterns. Proceedings of the 8th International Conference on Sustainable Information Engineering and Technology, Bali, Indonesia.","DOI":"10.1145\/3626641.3626948"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1007\/978-1-4302-3501-9_13","article-title":"The Model-View-ViewModel (MVVM) Design Pattern","volume":"5","author":"Anderson","year":"2012","journal-title":"Pro Bus. Appl. Silverlight"},{"key":"ref_44","unstructured":"(2024, April 23). Dagger Documentation. Available online: https:\/\/dagger.dev\/."},{"key":"ref_45","unstructured":"(2024, April 27). Google CameraX Architecture. Available online: https:\/\/developer.android.com\/media\/camera\/camerax\/architecture."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Jelili, S., Halayem, S., Taamallah, A., Ennaifer, S., Rajhi, O., Moussa, M., Ghazzei, M., Nabli, A., Ouanes, S., and Abbes, Z. (2021). Impaired Recognition of Static and Dynamic Facial Emotions in Children with Autism Spectrum Disorder Using Stimuli of Varying Intensities, Different Genders, and Age Ranges Faces. Front. Psychiatry, 12.","DOI":"10.3389\/fpsyt.2021.693310"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"488","DOI":"10.1016\/j.neubiorev.2017.06.016","article-title":"Mechanisms of Facial Emotion Recognition in Autism Spectrum Disorders: Insights from Eye Tracking and Electroencephalography","volume":"80","author":"Black","year":"2017","journal-title":"Neurosci. Biobehav. Rev."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Ekman, P. (1999). Basic Emotions. Handb. Cogn. Emot., 45\u201360.","DOI":"10.1002\/0470013494.ch3"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1007\/s10803-009-0862-9","article-title":"Enhancing Emotion Recognition in Children with Autism Spectrum Conditions: An Intervention Using Animated Vehicles with Real Emotional Faces","volume":"40","author":"Golan","year":"2010","journal-title":"J. Autism Dev. Disord."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Bogush, D., Costello, C., Fong, E., Sharmin, M., and Ahmed, S. (2024, January 2\u20134). Emotion Recognition Technology for People with Autism: A Systematic Literature Review. Proceedings of the 48th IEEE International Conference on Computers, Software, and Applications (COMPSAC), Osaka, Japan.","DOI":"10.1109\/COMPSAC61105.2024.00118"},{"key":"ref_51","first-page":"495","article-title":"Advancing Autism Technology","volume":"60","author":"Li","year":"2022","journal-title":"Psychol. Sch."}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/7\/292\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T18:12:49Z","timestamp":1760033569000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/7\/292"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,20]]},"references-count":51,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2025,7]]}},"alternative-id":["computers14070292"],"URL":"https:\/\/doi.org\/10.3390\/computers14070292","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,20]]}}}