{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,16]],"date-time":"2025-11-16T21:26:47Z","timestamp":1763328407315,"version":"build-2065373602"},"reference-count":48,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2021,8,23]],"date-time":"2021-08-23T00:00:00Z","timestamp":1629676800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>Difficulty in understanding the feelings and behavior of other people is considered one of the main symptoms of autism. Computer technology has increasingly been used in interventions with Autism Spectrum Disorder (ASD), especially augmented reality, to either treat or alleviate ASD symptomatology. Augmented reality is an engaging type of technology that helps children interact easily and understand and remember information, and it is not limited to one age group or level of education. This study utilized AR to display faces with six different basic facial expressions\u2014happiness, sadness, surprise, fear, disgust, and anger\u2014to help children to recognize facial features and associate facial expressions with a simultaneous human condition. The most important point of this system is that children can interact with the system in a friendly and safe way. Additionally, our results showed the system enhanced social interactions, talking, and facial expressions for both autistic and typical children. Therefore, AR might have a significant upcoming role in talking about the therapeutic necessities of children with ASD. This paper presents evidence for the feasibility of one of the specialized AR systems.<\/jats:p>","DOI":"10.3390\/mti5080048","type":"journal-article","created":{"date-parts":[[2021,8,23]],"date-time":"2021-08-23T10:24:17Z","timestamp":1629714257000},"page":"48","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Augmented Reality for Autistic Children to Enhance Their Understanding of Facial Expressions"],"prefix":"10.3390","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6731-7246","authenticated-orcid":false,"given":"Mohammad","family":"Wedyan","sequence":"first","affiliation":[{"name":"Department of Autonomous Systems, Faculty of Artificial Intelligence, Al-Balqa Applied University, Al-Salt 19117, Jordan"}]},{"given":"Jannat","family":"Falah","sequence":"additional","affiliation":[{"name":"Department of Autonomous Systems, Faculty of Artificial Intelligence, Al-Balqa Applied University, Al-Salt 19117, Jordan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0967-1885","authenticated-orcid":false,"given":"Ryan","family":"Alturki","sequence":"additional","affiliation":[{"name":"Department of Information Science, College of Computer and Information Systems, Umm Al Qura University, P.O. Box 715, Makkah 21961, Saudi Arabia"}]},{"given":"Irini","family":"Giannopulu","sequence":"additional","affiliation":[{"name":"ICAM (Interdisciplinary Centre for the Artificial Mind), FSD, Bond University, Robina, QLD 4226, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5281-9796","authenticated-orcid":false,"given":"Salsabeel F. M.","family":"Alfalah","sequence":"additional","affiliation":[{"name":"Department of Computer Information Systems, King Abdullah II School of Information Technology, The University of Jordon, Amman 11942, Jordan"}]},{"given":"Omar","family":"Elshaweesh","sequence":"additional","affiliation":[{"name":"Department of Software Engineering, Information Technology Collage, AL-Hussein bin Talal University, Ma\u2019an 71111, Jordan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0297-2463","authenticated-orcid":false,"given":"Adel","family":"Al-Jumaily","sequence":"additional","affiliation":[{"name":"School of Computing and Mathematics, Charles Sturt University, Wagga Wagga, NSW 2650, Australia"},{"name":"College of Computing, Fahad Bin Sultan University, Tabuk 47721, Saudi Arabia"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1212\/CON.0000000000000578","article-title":"Evaluation and management of the child with autism spectrum disorder","volume":"24","author":"Baumer","year":"2018","journal-title":"Contin. Lifelong Learn. Neurol."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Wedyan, M., and Al-Jumaily, A. (2016, January 17\u201320). Early diagnosis autism based on upper limb motor coordination in high risk subjects for autism. Proceedings of the 2016 IEEE International Symposium on Robotics and Intelligent Sensors (IRIS), Tokyo, Japan.","DOI":"10.1109\/IRIS.2016.8066059"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1002\/aur.1508","article-title":"Can neurotypical individuals read autistic facial expressions? Atypical production of emotional facial expressions in autism spectrum disorders","volume":"9","author":"Brewer","year":"2016","journal-title":"Autism Res."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2768","DOI":"10.1007\/s10803-017-3091-7","article-title":"Impaired recognition of basic emotions from facial expressions in young people with autism spectrum disorder: Assessing the importance of expression intensity","volume":"49","author":"Griffiths","year":"2019","journal-title":"J. Autism Dev. Disord."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Wedyan, M., Al-Jumaily, A., and Crippa, A. (2018, January 13\u201315). Early Diagnose of Autism Spectrum Disorder Using Machine Learning Based on Simple Upper Limb Movements. Proceedings of the International Conference on Hybrid Intelligent Systems, Porto, Portugal.","DOI":"10.3233\/HIS-190278"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1109\/MC.2012.220","article-title":"Using technology in autism research: The promise and the perils","volume":"45","author":"Munson","year":"2012","journal-title":"Computer"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"18245","DOI":"10.1007\/s11042-020-08647-6","article-title":"The use of augmented reality in the diagnosis and treatment of autistic children: A review and a new system","volume":"79","author":"Wedyan","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_8","unstructured":"Wedyan, M. (2020). Augmented Reality and Novel Virtual Sample Generation Algorithm Based Autism Diagnosis System. [Ph.D. Thesis, University of Technology Sydney]."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"7767","DOI":"10.3390\/ijerph110807767","article-title":"Technologies as support tools for persons with autistic spectrum disorder: A systematic review","volume":"11","year":"2014","journal-title":"Int. J. Environ. Res. Public Health"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1109\/MPRV.2015.22","article-title":"A smart environment for children with autism","volume":"14","author":"Tentori","year":"2015","journal-title":"IEEE Pervasive Comput."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1007\/s10882-019-09684-2","article-title":"Covert Audio Coaching to Increase Question Asking by Female College Students with Autism: Proof of Concept","volume":"32","author":"Mason","year":"2020","journal-title":"J. Dev. Phys. Disabil."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/bs.irrdd.2017.07.002","article-title":"Video-based group instruction for adolescents with autism spectrum disorders: A case of intervention development","volume":"Volume 52","author":"Plavnick","year":"2017","journal-title":"International Review of Research in Developmental Disabilities"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"598","DOI":"10.1109\/TVCG.2014.2385092","article-title":"Using Augmented Reality to Elicit Pretend Play for Children with Autism","volume":"21","author":"Bai","year":"2015","journal-title":"Vis. Comput. Graph. IEEE Trans."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1146\/annurev-bioeng-071811-150036","article-title":"Robots for use in autism research","volume":"14","author":"Scassellati","year":"2012","journal-title":"Annu. Rev. Biomed. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1162\/pres.1997.6.4.355","article-title":"A survey of augmented reality","volume":"6","author":"Azuma","year":"1997","journal-title":"Presence Teleoperators Virtual Environ."},{"key":"ref_16","first-page":"7288","article-title":"A study on Autism spectrum disorders using classification techniques","volume":"5","author":"Mythili","year":"2014","journal-title":"Ijcsit"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2146","DOI":"10.1007\/s10803-015-2379-8","article-title":"Use of machine learning to identify children with autism and their motor abnormalities","volume":"45","author":"Crippa","year":"2015","journal-title":"J. Autism Dev. Disord."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Taffoni, F., Focaroli, V., Keller, F., and Iverson, J.M. (2014, January 26\u201330). A technological approach to studying motor planning ability in children at high risk for ASD. Proceedings of the 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Chicago, IL, USA.","DOI":"10.1109\/EMBC.2014.6944411"},{"key":"ref_19","first-page":"451","article-title":"The Effects of Applying Game-Based Learning to Webcam Motion Sensor Games for Autistic Students\u2019 Sensory Integration Training","volume":"11","author":"Li","year":"2012","journal-title":"Turk. Online J. Educ. Technol.-TOJET"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/j.compedu.2018.05.002","article-title":"Augmented reality for STEM learning: A systematic review","volume":"123","year":"2018","journal-title":"Comput. Educ."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"145","DOI":"10.3389\/fped.2017.00145","article-title":"Feasibility of an autism-focused augmented reality smartglasses system for social communication and behavioral coaching","volume":"5","author":"Liu","year":"2017","journal-title":"Front. Pediatr."},{"key":"ref_22","first-page":"74","article-title":"Theory of mind in normal development and autism","volume":"34","year":"2001","journal-title":"Prisme"},{"key":"ref_23","first-page":"55","article-title":"Including children with autism in social and imaginary play with typical peers: Integrated play groups model","volume":"5","author":"Wolfberg","year":"2012","journal-title":"Am. J. Play"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1177\/1362361303007004001","article-title":"Editorial: Aims and design of the special issue","volume":"7","author":"Boucher","year":"2003","journal-title":"Autism"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Pashler, H.E., and Sutherland, S. (1998). The Psychology of Attention, MIT Press.","DOI":"10.7551\/mitpress\/5677.001.0001"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.dr.2009.12.003","article-title":"A review of methods in the study of attention in autism","volume":"30","author":"Ames","year":"2010","journal-title":"Dev. Rev."},{"key":"ref_27","unstructured":"Michel, P. (2004). The use of technology in the study, diagnosis and treatment of autism. Final Term Paper for CSC350: Autism and Associated Developmental Disorders, Yale University. pp.1\u201326."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1177\/002246698702100115","article-title":"The relationship between adaptive behavior and social skills issues in definition and assessment","volume":"21","author":"Gresham","year":"1987","journal-title":"J. Spec. Educ."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"785","DOI":"10.1177\/0145445501255007","article-title":"Teaching social skills to people with autism","volume":"25","author":"Weiss","year":"2001","journal-title":"Behav. Modif."},{"key":"ref_30","first-page":"1","article-title":"Toward a dynamic theory of emotion","volume":"1","author":"Scherer","year":"1987","journal-title":"Geneva Stud. Emot."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1080\/17470910601040772","article-title":"Impaired recognition of negative basic emotions in autism: A test of the amygdala theory","volume":"1","author":"Ashwin","year":"2006","journal-title":"Soc. Neurosci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1017\/S0954579400007136","article-title":"Can we teach children with autism to understand emotions, belief, or pretence?","volume":"8","author":"Hadwin","year":"1996","journal-title":"Dev. Psychopathol."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Karimi, H.A. (2011). Introduction to Navigation, Springer Science & Business Media.","DOI":"10.1007\/978-1-4419-7741-0_1"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1177\/0162643415618927","article-title":"Effects of Digital Navigation Aids on Adults With Intellectual Disabilities Comparison of Paper Map, Google Maps, and Augmented Reality","volume":"30","author":"McMahon","year":"2015","journal-title":"J. Spec. Educ. Technol."},{"key":"ref_35","first-page":"519","article-title":"Effectiveness of Teaching Naming Facial Expression to Children with Autism via Video Modeling","volume":"15","author":"Akmanoglu","year":"2015","journal-title":"Educ. Sci. Theory Pract."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Cunha, P., Brand\u00e3o, J., Vasconcelos, J., Soares, F., and Carvalho, V. (2016, January 24\u201326). Augmented reality for cognitive and social skills improvement in children with ASD. Proceedings of the 2016 13th International Conference on Remote Engineering and Virtual Instrumentation (REV), Madrid, Spain.","DOI":"10.1109\/REV.2016.7444495"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Aung, Y.M., and Al-Jumaily, A. (2012, January 24\u201327). AR based upper limb rehabilitation system. Proceedings of the 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), Rome, Italy.","DOI":"10.1109\/BioRob.2012.6290680"},{"key":"ref_38","first-page":"519","article-title":"Augmented reality game therapy for children with autism spectrum disorder","volume":"7","author":"Bhatt","year":"2017","journal-title":"Int. J. Smart Sens. Intell. Syst."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1007\/s10639-018-9768-5","article-title":"Preliminary study of augmented reality as an instrument for improvement of social skills in children with autism spectrum disorder","volume":"24","author":"Lorenzo","year":"2019","journal-title":"Educ. Inf. Technol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1186\/s13229-021-00430-0","article-title":"Imitation and recognition of facial emotions in autism: A computer vision approach","volume":"12","author":"Drimalla","year":"2021","journal-title":"Mol. Autism"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"488","DOI":"10.1002\/aur.2391","article-title":"Digital behavioral phenotyping detects atypical pattern of facial expression in toddlers with autism","volume":"14","author":"Carpenter","year":"2021","journal-title":"Autism Res."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"2540","DOI":"10.3389\/fpsyg.2021.653112","article-title":"Posed vs. Genuine Facial Emotion Recognition and Expression in Autism and Implications for Intervention","volume":"12","author":"Webster","year":"2021","journal-title":"Front. Psychol."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1016\/j.ridd.2014.10.015","article-title":"Augmented reality-based self-facial modeling to promote the emotional expression and social skills of adolescents with autism spectrum disorders","volume":"36","author":"Chen","year":"2015","journal-title":"Res. Dev. Disabil."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Freire, M., Serrano-Laguna, \u00c1., Iglesias, B.M., Mart\u00ednez-Ortiz, I., Moreno-Ger, P., and Fern\u00e1ndez-Manj\u00f3n, B. (2016). Game learning analytics: Learning analytics for serious games. Learning, Design, and Technology: An International Compendium of Theory, Research, Practice, and Policy, Springer.","DOI":"10.1007\/978-3-319-17727-4_21-1"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"3911","DOI":"10.1109\/TIP.2017.2708506","article-title":"Feature interaction augmented sparse learning for fast kinect motion detection","volume":"26","author":"Chang","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_46","unstructured":"Sensum, B.A. (2021, August 06). A Primer on Emotion Science for Our Autonomous Future. Available online: https:\/\/medium.com\/@ben.bland\/a-primer-on-emotion-science-for-our-autonomous-future-5b0369babf2a."},{"key":"ref_47","unstructured":"Gudipati, V.K., Barman, O.R., Gaffoor, M., and Abuzneid, A. (2016, January 14\u201315). Efficient facial expression recognition using adaboost and haar cascade classifiers. Proceedings of the 2016 Annual Connecticut Conference on Industrial Electronics, Technology & Automation (CT-IETA), Bridgeport, CT, USA."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1007\/s00521-014-1569-1","article-title":"A new facial expression recognition based on curvelet transform and online sequential extreme learning machine initialized with spherical clustering","volume":"27","author":"Demir","year":"2016","journal-title":"Neural Comput. Appl."}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/5\/8\/48\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:49:55Z","timestamp":1760165395000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/5\/8\/48"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,23]]},"references-count":48,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["mti5080048"],"URL":"https:\/\/doi.org\/10.3390\/mti5080048","relation":{},"ISSN":["2414-4088"],"issn-type":[{"type":"electronic","value":"2414-4088"}],"subject":[],"published":{"date-parts":[[2021,8,23]]}}}