{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T13:59:27Z","timestamp":1787320767436,"version":"build-2736575974"},"reference-count":36,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2022,10,7]],"date-time":"2022-10-07T00:00:00Z","timestamp":1665100800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Taipei University of Technology-Beijing Institute of Technology Joint Research Program","award":["NTUT-BIT-108-02"],"award-info":[{"award-number":["NTUT-BIT-108-02"]}]},{"name":"National Taipei University of Technology-Beijing Institute of Technology Joint Research Program","award":["NTUT-BIT-109-03"],"award-info":[{"award-number":["NTUT-BIT-109-03"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJERPH"],"abstract":"<jats:p>Autistic spectrum disorder (ASD) is one of the most complex groups of neurobehavioral and developmental conditions. The reason is the presence of three different impaired domains, such as social interaction, communication, and restricted repetitive behaviors. Some children with ASD may not be able to communicate using language or speech. Many experts propose that continued therapy in the form of software training in this area might help to bring improvement. In this work, we propose a design of software speech therapy system for ASD. We combined different devices, technologies, and features with techniques of home rehabilitation. We used TensorFlow for Image Classification, ArKit for Text-to-Speech, Cloud Database, Binary Search, Natural Language Processing, Dataset of Sentences, and Dataset of Images with two different Operating Systems designed for Smart Mobile devices in daily life. This software is a combination of different Deep Learning Technologies and makes Human\u2013Computer Interaction Therapy very easy to conduct. In addition, we explain the way these were connected and put to work together. Additionally, we explain in detail the architecture of software and how each component works together as an integrated Therapy System. Finally, it allows the patient with ASD to perform the therapy anytime and everywhere, as well as transmitting information to a medical specialist.<\/jats:p>","DOI":"10.3390\/ijerph191912857","type":"journal-article","created":{"date-parts":[[2022,10,8]],"date-time":"2022-10-08T22:19:27Z","timestamp":1665267567000},"page":"12857","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Deep Mobile Linguistic Therapy for Patients with ASD"],"prefix":"10.3390","volume":"19","author":[{"given":"Ari Ernesto","family":"Ortiz Castellanos","sequence":"first","affiliation":[{"name":"College of Electrical Engineering and Computer Science, National Taipei University of Technology, Taipei City 106, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9005-5715","authenticated-orcid":false,"given":"Chuan-Ming","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Engineering, National Taipei University of Technology, Taipei City 106, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chongyang","family":"Shi","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Beijing Institute of Technology, Beijing 102488, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,10,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Chojnicka, I., and Wawer, A. (2020). Social language in autism spectrum disorder: A computational analysis of sentiment and linguistic abstraction. PLoS ONE, 15.","DOI":"10.1371\/journal.pone.0229985"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1109\/TII.2019.2958106","article-title":"Screening Early Children With Autism Spectrum Disorder via Response-to-Name Protocol","volume":"17","author":"Wang","year":"2021","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1001\/jama.2017.17812","article-title":"Prevalence of autism spectrum disorder among us children and adolescents","volume":"319","author":"Xu","year":"2018","journal-title":"Am. Med. Assoc."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"27758","DOI":"10.1109\/ACCESS.2021.3058986","article-title":"Scene Semantic Recognition Based on Modified Fuzzy C-Mean and Maximum Entropy Using Object-to-Object Relations","volume":"9","author":"Jalal","year":"2021","journal-title":"IEEE Access"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"21777","DOI":"10.1109\/ACCESS.2021.3055243","article-title":"A Single Neural Network for Mixed Style License Plate Detection and Recognition","volume":"9","author":"Huang","year":"2021","journal-title":"IEEE Access"},{"key":"ref_6","first-page":"2873","article-title":"The economic cost of autism Spectrum Disorder: A Literature Review","volume":"49","author":"Rogge","year":"2019","journal-title":"Natl. Libr. Med."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2169","DOI":"10.1109\/ACCESS.2021.3079337","article-title":"SqueezeNet and Fusion Network-Based Accurate Fast Fully Convolutional Network for Hand Detection and Gesture Recognition","volume":"9","author":"Qiang","year":"2021","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1109\/MITS.2019.2898967","article-title":"An End to End Recognition for License Plates Using Convolutional Neural Networks","volume":"13","author":"Duan","year":"2021","journal-title":"IEEE Intell. Transp. Syst. Mag."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"37341","DOI":"10.1109\/ACCESS.2021.3063031","article-title":"Audio-Visual Biometric Recognition and Presentation Attack Detection: A Comprenhensive Survey","volume":"9","author":"Mandalapu","year":"2021","journal-title":"IEEE Access"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1109\/JSTARS.2020.3041859","article-title":"Object-Scale Adaptative Convolutional Neural Networks for High-Spartial Resolution Remote Sensing Image Classification","volume":"14","author":"Wang","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zhou, Q., Bao, W.X., Zhang, X.W., and Ma, X. (2021, January 24\u201326). A Joint Spartial-Spectral Representation Based Capsule Network for Hyperspectral Image Classificatrion. Proceedings of the WHISPERS, Amsterdam, The Netherlands.","DOI":"10.1109\/WHISPERS52202.2021.9484019"},{"key":"ref_12","first-page":"484","article-title":"Computer Interface for Real-Time Gait Biofeedback Using a Wearable Integrated Sensor System for Data Acquisition","volume":"5","author":"Blanco","year":"2021","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2164","DOI":"10.1109\/TNSRE.2021.3120756","article-title":"Research on the Specificity of Electrophysiological Signals of Human Acupoints Based on 90-Day Simulated Weightlessness Experiment on the Ground","volume":"29","author":"Wang","year":"2021","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_14","unstructured":"da Silva, M.L., and Goncalves, D. (2016, January 7\u201314). A survey of ICT toold for communication development in children with ASD. Proceedings of the International Conference on Physiological Computing Systems, Lisbon, Portugal."},{"key":"ref_15","first-page":"285","article-title":"Speech and lanuage theraphy to improve the communication skills of chilren with cerebral palsy","volume":"2","author":"Pennnington","year":"2004","journal-title":"Natl. Libr. Med."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Karim, S., Akter, N., Patwary, M.J., and Islam, M.R. (2021, January 18\u201320). A Review on Predicting Autism Spectrum Disorder(ASD) meltdown using Machine Learning Algorithms. Proceedings of the 2021 5th International Conference on Electrical Engineering and Information Communication Technology (ICEEICT), Dhaka, Bangladesh.","DOI":"10.1109\/ICEEICT53905.2021.9667827"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Lohar, M., and Chorage, S. (2021, January 29\u201330). Spectrum Disorder (ASD) from Brain MR Images Based on Feature Optimization and Machine Learning. Proceedings of the International Conference on Smart Generation Computing, Communication and Networking (SMART GENCON), Pune, India.","DOI":"10.1109\/SMARTGENCON51891.2021.9645785"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Mubin, S.A., Poh, M.W.A., Rohizan, R., Abidin, A.A.Z., and Wei, W.C. (2021, January 7\u201310). A Gamification Design Framework for Supporting ASD Children Social Skills. Proceedings of the International Conference on Developments in eSystems Engineering (DeSE), Sharjah, United Arab Emirates.","DOI":"10.1109\/DeSE54285.2021.9719331"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Sharmin, M., Hosssain, M., Saha, A., Das, M., Maxwell, M., and Ahmed, S. (2018, January 21\u201326). From research to practice: Informing the design of Autism support smart technology. Proceedings of the Conference on Human Factors in Computing Systems, Montreal, QC, Canada.","DOI":"10.1145\/3173574.3173676"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"3069","DOI":"10.1109\/JSYST.2020.3032609","article-title":"Contreras-Vidal JL, Concerns in the Blurred Divisions Between Medical and Consumer Neurotechnology","volume":"15","author":"Paek","year":"2021","journal-title":"IEEE Syst. J."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"852","DOI":"10.1109\/TNSRE.2021.3076778","article-title":"Speech Vision: An End-to-end Deep Learning-Based Dysarthric Automatic Speech Recognition System","volume":"29","author":"Shahamiri","year":"2021","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1023\/A:1010660502130","article-title":"Enhancing Social Problem Solving in Children with Autism and Normal Children through Computer-Assisted Instruction","volume":"31","author":"Sriram","year":"2001","journal-title":"J. Autism Dev. Disord."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Kreijns, K., and Kirschner, P.A. (2018, January 3\u20135). Extending the SIPS-Model: A Research Framework for Online Collaborative Learning. Proceedings of the European Conference on Technology Enhanced Learning, Leeds, UK.","DOI":"10.1007\/978-3-319-98572-5_21"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1177\/1362361306066599","article-title":"Read my lips: The importance of the face in a computer-animated tutor for vocabulary learning by children with autism","volume":"10","author":"Masarro","year":"2006","journal-title":"Autism"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"750","DOI":"10.1044\/2015_AJSLP-14-0166","article-title":"Examining the Echolalia Literature: Where Do Speech-Language Pathologists Stand?","volume":"24","author":"Stiegler","year":"2015","journal-title":"Am. J. Speech Lang. Pathol."},{"key":"ref_26","first-page":"n6","article-title":"Using Animated Language Software with Children Diagnosed with Autism Spectrum Disorders","volume":"4","author":"Mulholl","year":"2008","journal-title":"Teach. Except. Child. Plus"},{"key":"ref_27","unstructured":"Griffin, G., Holub, A., and Perona, P. (2007). Caltech-256 Object Category Dataset, California Institute of Technology."},{"key":"ref_28","first-page":"2313","article-title":"An open-source and wearable system for measuring 3D human motion in real-time","volume":"69","author":"Slade","year":"2021","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1550","DOI":"10.1109\/TASE.2020.3010415","article-title":"S-VIT: Stereo Visual-Inertial Tracking of Lower Limb for Physiotherapy Rehabilitation in Context of Comprehensive Evaluation of SLAM Systems","volume":"18","author":"Hussain","year":"2021","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2242","DOI":"10.1109\/TNSRE.2021.3121780","article-title":"The Assessment of Upper-Limp Spasticity Based on a Multi-Layer Using a Portable Measurement System","volume":"29","author":"Wang","year":"2021","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_31","first-page":"678","article-title":"A Portable Device for Hand Rehabilitation with Force Cognition: Design, Interaction and Experiment","volume":"69","author":"Yang","year":"2021","journal-title":"IEEE Trans. Cogn. Dev. Syst."},{"key":"ref_32","first-page":"2169","article-title":"A Review on Traditional Machine Learning and Deep Learning Models for WBCs Classification in Blood Smear Images","volume":"9","author":"Khan","year":"2021","journal-title":"IEEE Access"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2476","DOI":"10.1109\/TIP.2021.3052711","article-title":"Discriminative Feature Learning for Thorax Disease Classification in Chest X-ray Images","volume":"30","author":"Guan","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"134809","DOI":"10.1109\/ACCESS.2021.3116526","article-title":"Introducing Image Classification Efficacies","volume":"9","author":"Shao","year":"2021","journal-title":"IEEE Access"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"9254","DOI":"10.1109\/JSTARS.2021.3111508","article-title":"Adaptative Multisensor Acquisition via Spartial Contextual Information for Compressive Spectral Image Classification","volume":"14","author":"Diaz","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1109\/TMI.2020.3025087","article-title":"SpineParseNet: Spine Parsing for Volumetric MR Image by a Two-Stage Segmentation Framework With Semantic Image Representation","volume":"40","author":"Pang","year":"2021","journal-title":"IEEE Trans. Med. Imaging"}],"container-title":["International Journal of Environmental Research and Public Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1660-4601\/19\/19\/12857\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:47:54Z","timestamp":1760143674000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1660-4601\/19\/19\/12857"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,7]]},"references-count":36,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2022,10]]}},"alternative-id":["ijerph191912857"],"URL":"https:\/\/doi.org\/10.3390\/ijerph191912857","relation":{},"ISSN":["1660-4601"],"issn-type":[{"value":"1660-4601","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,7]]}}}