{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T07:59:04Z","timestamp":1773820744934,"version":"3.50.1"},"reference-count":44,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T00:00:00Z","timestamp":1773792000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Neurosci."],"abstract":"<jats:p>Autism Spectrum Disorder (ASD) is a neurodevelopmental disorder that is marked by a lack of communication skills in social situations and repetitive and stereotypical Behaviors. The most widespread form of diagnosing ASD among children is based on psychological screening test along with monitoring of the Behavioral pattern, especially repetitive Behaviors. Some of these Behaviors include hand-flapping, head banging and spinning which are common among ASD children. In our research, we examine abnormal Behavioral patterns that may reflect ASD through the videos of children engaged in the everyday activities in the unstructured settings. A publicly available multiclass Self-Stimulatory Behavior Dataset (SSBD) is use in classify autistic Behavior. Before training the model, the dataset is thoroughly pre-processed (region-of-interest (ROI) detection and image cropping to eliminate irrelevant background objects). Moreover, information-augmenting methods are used to reduce overfitting and increase training efficiency and generalization effectiveness. In order to obtain spatiotemporal details successfully, a number of deep learning models are tested, such as studied CNN-GRU model, 3D-CNN + LSTM, MobileNet, VGG16, and EfficientNet-B7. The findings of the experiment prove that the proposed CNN-GRU model is superior to all competing methods. The model with a k-fold cross-validation provides a steady accuracy of 0.9284 \u00b1 0.0039\u20130.9294 \u00b1 0.0038, which means that the model is robust and consistent across the folds. The effectiveness of the proposed approach is additionally justified by the comparisons with state-of-the-art methods. The results show that the systems based on the action recognition can help clinicians monitor the Behavioral trends and facilitate the quick, accurate, and effective screening of ASD. The proposed approach works effectively in predicting Behavior in real-life, uncontrolled videos and shows tremendous potential for real-world clinical implementation as a decision-support tool.<\/jats:p>","DOI":"10.3389\/fncom.2026.1626315","type":"journal-article","created":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T06:58:11Z","timestamp":1773817091000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Deep learning based approach for Behavior classification in diagnoses of Autism Spectrum Disorder using naturalistic videos"],"prefix":"10.3389","volume":"20","author":[{"given":"Usama","family":"Jabbar","sequence":"first","affiliation":[{"name":"Department of Computer Science, Superior University","place":["Lahore, Pakistan"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Muhammad","family":"Waseem Iqbal","sequence":"additional","affiliation":[{"name":"Department of Software Engineering, Superior University","place":["Lahore, Pakistan"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexandru","family":"Nechifor","sequence":"additional","affiliation":[{"name":"Department of Individual Sports and Physiotherapy, Faculty of Physical Education and Sport, Dunarea de Jos University","place":["Gala\u0163i, Romania"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mohammed","family":"Abaker","sequence":"additional","affiliation":[{"name":"Applied College, King Khalid University","place":["Muhayil, Saudi Arabia"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mohammed Ahmed","family":"Khairalseed","sequence":"additional","affiliation":[{"name":"Faculty of Education, University of Gadarif","place":["Gadarif, Sudan"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Valentin Marian","family":"Antohi","sequence":"additional","affiliation":[{"name":"Department of Business Administration, Dunarea de Jos University of Galati","place":["Gala\u0163i, Romania"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Costinela","family":"Fortea","sequence":"additional","affiliation":[{"name":"Department of Business Administration, Dunarea de Jos University of Galati","place":["Gala\u0163i, Romania"]},{"name":"Department of Finance, Accounting and Economic Theory, Transilvania University of Brasov","place":["Brasov, Romania"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Catalin Aurelian","family":"Stefanescu","sequence":"additional","affiliation":[{"name":"Department of Sports Games and Physical Education, Faculty of Physical Education and Sport, Dunarea de Jos University of Galati","place":["Gala\u0163i, Romania"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2026,3,18]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2022\/2247675","article-title":"An AI-enabled Internet of Things based autism care system for improving cognitive ability of children with autism spectrum disorders","volume":"2022","author":"Abdel Hameed","year":"2022","journal-title":"Comput. Intell. Neurosci."},{"key":"B2","first-page":"6050","article-title":"\u201cAutomated detection of facial expressions during computer-assisted instruction in individuals on the autism spectrum,\u201d","volume-title":"Proceedings of the CHI Conference on Human Factors in Computing Systems","author":"Ahmed","year":"2017"},{"key":"B3","doi-asserted-by":"crossref","first-page":"475","DOI":"10.5220\/0010839200003124","article-title":"\u201cVideo-based behavior understanding of children for objective diagnosis of autism,\u201d","volume-title":"Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications","author":"Ali","year":"2022"},{"key":"B4","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1109\/JTEHM.2023.3282104","article-title":"A hybrid convolutional neural network model for automatic diabetic retinopathy classification from fundus images","volume":"11","author":"Ali","year":"2023","journal-title":"IEEE J. Transl. Eng. Health Med."},{"key":"B5","doi-asserted-by":"crossref","first-page":"771","DOI":"10.1109\/ICMLA.2015.46","article-title":"A machine learning based WSN system for autism activity recognition","volume-title":"2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA)","author":"Alwakeel","year":"2015"},{"key":"B6","doi-asserted-by":"publisher","first-page":"3609","DOI":"10.1007\/s12652-021-03488-z","article-title":"Transfer learning for image classification using VGG19: Caltech-101 image data set","volume":"14","author":"Bansal","year":"2023","journal-title":"J. Ambient Intell. Human. Comput."},{"key":"B7","doi-asserted-by":"publisher","first-page":"107764","DOI":"10.1109\/ACCESS.2022.3198662","article-title":"Auto-Prep: efficient and robust automated data preprocessing pipeline","volume":"10","author":"Bilal","year":"2022","journal-title":"IEEE Access"},{"key":"B8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/EHB50910.2020.9280261","article-title":"\u201cApplication software analysis for children with autism spectrum disorder: a review of the scientific literature from 2005 \u2013 2020,\u201d","volume-title":"2020 International Conference on e-Health and Bioengineering (EHB)","author":"Cabanillas-Tello","year":"2020"},{"key":"B9","doi-asserted-by":"publisher","first-page":"488","DOI":"10.1002\/aur.2391","article-title":"Digital behavioral phenotyping detects atypical pattern of facial expression in toddlers with autism","volume":"14","author":"Carpenter","year":"2021","journal-title":"Autism Res."},{"key":"B10","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1177\/1362361313517762","article-title":"A systematic review of sensory processing interventions for children with autism spectrum disorders","volume":"19","author":"Case-Smith","year":"2015","journal-title":"Autism"},{"key":"B11","first-page":"6047","article-title":"\u201cAva: a video dataset of spatio-temporally localized atomic visual actions,\u201d","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Gu","year":"2018"},{"key":"B12","doi-asserted-by":"crossref","first-page":"845","DOI":"10.1109\/CCIS.2018.8691180","article-title":"\u201cAffective computing of childern with authism based on feature transfer,\u201d","volume-title":"2018 5th IEEE International Conference on Cloud Computing and Intelligence Systems (CCIS)","author":"Han","year":"2018"},{"key":"B13","unstructured":"MobileNets: efficient convolutional neural networks for mobile vision applications\n          \n          \n            \n              Howard\n              A. G.\n            \n            \n              Zhu\n              M.\n            \n            \n              Chen\n              B.\n            \n            \n              Kalenichenko\n              D.\n            \n            \n              Wang\n              W.\n            \n            \n              Weyand\n              T.\n            \n          \n          arXiv [Preprint].\n          \n          2017"},{"key":"B14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2022\/5817410","article-title":"Web simplification prototype for cognitive disabled users","volume":"2022","author":"Kamran","year":"2022","journal-title":"Hum. Behav. Emerg. Technol."},{"key":"B15","doi-asserted-by":"publisher","first-page":"3251","DOI":"10.32604\/cmc.2022.020561","article-title":"Multi-scale network for thoracic organs segmentation","volume":"70","author":"Khalil","year":"2022","journal-title":"Comput. Mater. Contin."},{"key":"B16","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1007\/978-1-4614-4788-7_129","article-title":"\u201cEarly and intensive behavioral intervention (EIBI) in autism,\u201d","volume-title":"Comprehensive Guide to Autism","author":"Klintwall","year":"2014"},{"key":"B17","doi-asserted-by":"publisher","first-page":"104887","DOI":"10.1109\/ACCESS.2022.3208587","article-title":"The role of intelligent technologies in early detection of autism spectrum disorder (ASD): a scoping review","volume":"10","author":"Kohli","year":"2022","journal-title":"IEEE Access"},{"key":"B18","doi-asserted-by":"publisher","first-page":"e33771","DOI":"10.2196\/33771","article-title":"The classification of abnormal hand movement to aid in autism detection: machine learning study","volume":"7","author":"Lakkapragada","year":"2022","journal-title":"JMIR Biomed. Eng."},{"key":"B19","doi-asserted-by":"publisher","first-page":"4542","DOI":"10.3390\/app9214542","article-title":"Computational analysis of deep visual data for quantifying facial expression production","volume":"9","author":"Leo","year":"2019","journal-title":"Appl. Sci."},{"key":"B20","first-page":"145","article-title":"\u201cAutomatic emotion recognition in robot-children interaction for ASD treatment,\u201d","author":"Leo","year":"2015","journal-title":"Proceedings of the IEEE International Conference on Computer Vision Workshops (Santiago)"},{"key":"B21","doi-asserted-by":"crossref","first-page":"4549","DOI":"10.1109\/ICIP.2019.8803604","article-title":"\u201cA facial affect analysis system for autism spectrum disorder,\u201d","volume-title":"2019 IEEE International Conference on Image Processing (ICIP)","author":"Li","year":"2019"},{"key":"B22","doi-asserted-by":"publisher","first-page":"15793","DOI":"10.1007\/s12652-019-01277-3","article-title":"An intelligent monitoring system for indoor safety of individuals suffering from autism spectrum disorder (ASD)","volume":"14","author":"Manocha","year":"2019","journal-title":"J. Ambient Intell. Human. Comput."},{"key":"B23","doi-asserted-by":"crossref","first-page":"2158","DOI":"10.1109\/CVPR.2018.00230","article-title":"\u201c3D human sensing, action and emotion recognition in robot assisted therapy of children with autism,\u201d","volume-title":"2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Marinoiu","year":"2018"},{"key":"B24","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1016\/j.neucom.2021.03.004","article-title":"Vision-assisted recognition of stereotype behaviors for early diagnosis of autism spectrum disorders","volume":"446","author":"Negin","year":"2021","journal-title":"Neurocomputing"},{"key":"B25","doi-asserted-by":"publisher","first-page":"148","DOI":"10.17703\/IJACT.2024.12.3.148","article-title":"Utilizing deep learning for early diagnosis of autism: detecting self-stimulatory behavior","volume":"12","author":"Park","year":"2024","journal-title":"Int. J. Adv. Cult. Technol."},{"key":"B26","doi-asserted-by":"publisher","first-page":"e13253","DOI":"10.1111\/exsy.13253","article-title":"Video-based real-time assessment and diagnosis of autism spectrum disorder using deep neural networks","volume":"42","author":"Prakash","year":"2025","journal-title":"Expert Syst."},{"key":"B27","doi-asserted-by":"crossref","first-page":"755","DOI":"10.1109\/ICCVW.2013.103","article-title":"\u201cSelf-stimulatory behaviors in the wild for autism diagnosis,\u201d","volume-title":"2013 IEEE International Conference on Computer Vision Workshops","author":"Rajagopalan","year":"2013"},{"key":"B28","doi-asserted-by":"crossref","first-page":"1470","DOI":"10.1109\/ICIP.2014.7025294","article-title":"\u201cDetecting self-stimulatory behaviors for autism diagnosis,\u201d","volume-title":"2014 IEEE International Conference on Image Processing (ICIP)","author":"Rajagopalan","year":"2014"},{"key":"B29","first-page":"3414","article-title":"\u201cDecoding children's social behavior,\u201d","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Rehg","year":"2013"},{"key":"B30","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1016\/j.jpeds.2016.04.023","article-title":"Applied behavior analysis as treatment for autism spectrum disorder","volume":"175","author":"Roane","year":"2016","journal-title":"J. Pediatr."},{"key":"B31","first-page":"1625","article-title":"Handling missing values when applying classification models","volume":"8","author":"Saar-Tsechansky","year":"2007","journal-title":"J. Mach. Learn. Res."},{"key":"B32","unstructured":"Very deep convolutional networks for large-scale image recognition\n          \n          \n            \n              Simonyan\n              K.\n            \n            \n              Zisserman\n              A.\n            \n          \n          arXiv [Preprint]\n          \n          2015"},{"key":"B33","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1016\/j.ijmedinf.2019.05.006","article-title":"Identification and analysis of behavioral phenotypes in autism spectrum disorder via unsupervised machine learning","volume":"129","author":"Stevens","year":"2019","journal-title":"Int. J. Med. Inform."},{"key":"B34","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1038\/s41398-020-0780-3","article-title":"Deep learning in mental health outcome research: a scoping review","volume":"10","author":"Su","year":"2020","journal-title":"Transl. Psychiatry"},{"key":"B35","unstructured":"Rethinking the Inception architecture for computer vision\n          \n          \n            \n              Szegedy\n              C.\n            \n            \n              Vanhoucke\n              V.\n            \n            \n              Ioffe\n              S.\n            \n            \n              Shlens\n              J.\n            \n            \n              Wojna\n              Z.\n            \n          \n          arXiv [Preprint]\n          \n          2015"},{"key":"B36","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1145\/3267935.3267951","author":"Tang","year":"2018"},{"key":"B37","doi-asserted-by":"publisher","first-page":"391","DOI":"10.35940\/ijitee.B6379.129219","article-title":"Human behavior analysis through facial expression recognition in images using deep learning","volume":"9","author":"Thacker","year":"2019","journal-title":"Int. J. Innov. Technol. Explor. Eng."},{"key":"B38","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1111\/j.1469-7610.2010.02295.x","article-title":"A population-based investigation of behavioral and emotional problems and maternal mental health: associations with autism spectrum disorder and intellectual disability: ASD and intellectual disability","volume":"52","author":"Totsika","year":"2011","journal-title":"J. Child Psychol. Psychiatry"},{"key":"B39","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3411763.3451701","article-title":"\u201cActivity recognition with moving cameras and few training examples: applications for detection of autism-related headbanging,\u201d","volume-title":"Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems","author":"Washington","year":"2021"},{"key":"B40","doi-asserted-by":"publisher","first-page":"e16763","DOI":"10.1016\/j.heliyon.2023.e16763","article-title":"Vision-based activity recognition in children with autism-related behaviors","volume":"9","author":"Wei","year":"2023","journal-title":"Heliyon"},{"key":"B41","doi-asserted-by":"publisher","first-page":"216","DOI":"10.1016\/j.cpr.2009.01.003","article-title":"Anxiety in children and adolescents with autism spectrum disorders","volume":"29","author":"White","year":"2009","journal-title":"Clin. Psychol. Rev."},{"key":"B42","doi-asserted-by":"publisher","first-page":"646","DOI":"10.1109\/ACCESS.2013.2282613","article-title":"Wireless video surveillance: a survey","volume":"1","author":"Ye","year":"2013","journal-title":"IEEE Access"},{"key":"B43","first-page":"317","article-title":"\u201cEstimating the uncertainty of average F1 scores,\u201d","volume-title":"Proceedings of the 2015 ACM SIGIR International Conference on Theory of Information Retrieval","author":"Zhang","year":"2015"},{"key":"B44","doi-asserted-by":"publisher","first-page":"3038","DOI":"10.1007\/s10803-021-05179-2","article-title":"Identifying autism with head movement features by implementing machine learning algorithms","volume":"52","author":"Zhao","year":"2022","journal-title":"J. Autism Dev. Disord."}],"container-title":["Frontiers in Computational Neuroscience"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fncom.2026.1626315\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T06:58:19Z","timestamp":1773817099000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fncom.2026.1626315\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,18]]},"references-count":44,"alternative-id":["10.3389\/fncom.2026.1626315"],"URL":"https:\/\/doi.org\/10.3389\/fncom.2026.1626315","relation":{},"ISSN":["1662-5188"],"issn-type":[{"value":"1662-5188","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,18]]},"article-number":"1626315"}}