{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T12:38:57Z","timestamp":1777466337468,"version":"3.51.4"},"reference-count":41,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T00:00:00Z","timestamp":1760572800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"},{"start":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T00:00:00Z","timestamp":1760572800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/501100000024","name":"Canadian Institutes of Health Research","doi-asserted-by":"crossref","award":["# 136895"],"award-info":[{"award-number":["# 136895"]}],"id":[{"id":"10.13039\/501100000024","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Behav Modif"],"published-print":{"date-parts":[[2026,3]]},"abstract":"<jats:p>Direct observation is a process central to behavior science, but its implementation may be challenging in some contexts (e.g., classrooms, homes). One potential solution to improve the feasibility of conducting behavioral observation and measurement involves machine learning. Using previously published data, we developed and tested novel models to automatically measure the duration of vocal stereotypy in eight children with autism. In addition to accuracy and the kappa statistic, we examined session-by-session correlations between values measured by machine learning and those recorded by a human observer. Nearly all our models produced high correlations (i.e., .90 or more) and resulted in better metrics than those reported by the original study. The next step is for researchers to test the models on novel datasets to examine the generalizability of our findings.<\/jats:p>","DOI":"10.1177\/01454455251380510","type":"journal-article","created":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T06:52:31Z","timestamp":1760683951000},"page":"123-147","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":1,"title":["Machine Learning to Detect Vocal Stereotypy: Improving Duration-Based Measures"],"prefix":"10.1177","volume":"50","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6506-1830","authenticated-orcid":false,"given":"Ali Reza","family":"Omrani","sequence":"first","affiliation":[{"name":"National Research Council of Italy, Pisa, Italy"},{"name":"Universit\u00e0 Campus Bio-Medico di Roma, Rome, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9023-0314","authenticated-orcid":false,"given":"Marc J.","family":"Lanovaz","sequence":"additional","affiliation":[{"name":"Universit\u00e9 de Montr\u00e9al, QC, Canada"},{"name":"Institut Universitaire en D\u00e9ficience Intellectuelle et en Trouble du Spectre de l\u2019Autisme, Trois-Rivi\u00e8res, QC, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5175-5126","authenticated-orcid":false,"given":"Davide","family":"Moroni","sequence":"additional","affiliation":[{"name":"National Research Council of Italy, Pisa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2025,10,16]]},"reference":[{"key":"e_1_3_4_2_1","doi-asserted-by":"crossref","unstructured":"Ahrens E. N. Lerman D. C. Kodak T. Worsdell A. S. Keegan C. (2011). Further evaluation of response interruption and redirection as treatment for stereotypy. Journal of Applied Behavior Analysis 44(1) 95\u2013108. https:\/\/doi.org\/10.1901\/jaba.2011.44-95","DOI":"10.1901\/jaba.2011.44-95"},{"key":"e_1_3_4_3_1","doi-asserted-by":"crossref","unstructured":"Alca\u00f1iz Raya M. Mar\u00edn-Morales J. Minissi M. E. Teruel Garcia G. Abad L. Chicchi Giglioli I. A. (2020). Machine learning and virtual reality on body movements\u2019 behaviors to classify children with autism spectrum disorder. Journal of Clinical Medicine 9(5) 1260. https:\/\/doi.org\/10.3390\/jcm9051260","DOI":"10.3390\/jcm9051260"},{"key":"e_1_3_4_4_1","unstructured":"Ali A. Touvron H. Caron M. Bojanowski P. Douze M. Joulin A. Laptev I. Neverova N. Synnave G. Verbeek J. J\u00e9gou H. (2021). Xcit: Cross-covariance image transformers. In Ranzato M. Beygelzimer A. Dauphin Y. Liang P. S. Wortman Vaughan J. (Eds.) Advances in neural information processing systems 34 (pp. 20014\u201320027). NeurIPS. https:\/\/proceedings.neurips.cc\/paper\/2021\/hash\/a655fbe4b8d7439994aa37ddad80de56-Abstract.html"},{"key":"e_1_3_4_5_1","doi-asserted-by":"crossref","unstructured":"Bottini S. Gillis J. Romanczyk R. (2021). Impact of data collection format on training and treatment integrity during discrete-trial implementation. Behavior Analysis: Research and Practice 21(2) 140\u2013152. https:\/\/doi.org\/10.1037\/bar0000217","DOI":"10.1037\/bar0000217"},{"key":"e_1_3_4_6_1","unstructured":"Dosovitskiy A. Beyer L. Kolesnikov A. Weissenborn D. Zhai X. Unterthiner T. Dehghani M. Minderer M. Heigold G. Gelly S. Uszkoreit J. Houlsby N. (2021). An image is worth 16 \u00d7\u200916 words: Transformers for image recognition at scale. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2010.11929."},{"key":"e_1_3_4_7_1","doi-asserted-by":"crossref","unstructured":"Dufour M.-M. Lanovaz M. J. Cardinal P. (2020). Artificial intelligence for the measurement of stereotypy. Journal of the Experimental Analysis of Behavior 114(3) 368\u2013380. https:\/\/doi.org\/10.1002\/jeab.636","DOI":"10.1002\/jeab.636"},{"key":"e_1_3_4_8_1","doi-asserted-by":"crossref","unstructured":"Falligant J. M. Vetter J. A. (2020). Quantifying false positives in simulated events using partial interval recording and momentary time sampling with dual-criteria methods. Behavioral Interventions 35(2) 281\u2013294. https:\/\/doi.org\/10.1002\/bin.1707","DOI":"10.1002\/bin.1707"},{"key":"e_1_3_4_9_1","doi-asserted-by":"crossref","unstructured":"Fasching J. Walczak N. Morellas V. Papanikolopoulos N. (2015). Classification of motor stereotypies in video [Conference session]. 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (pp. 4894\u20134900). IEEE. https:\/\/doi.org\/10.1109\/IROS.2015.7354065","DOI":"10.1109\/IROS.2015.7354065"},{"key":"e_1_3_4_10_1","doi-asserted-by":"crossref","unstructured":"Geva M. Schuster R. Berant J. Levy O. (2020). Transformer feed-forward layers are key-value memories. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2012.14913","DOI":"10.18653\/v1\/2021.emnlp-main.446"},{"key":"e_1_3_4_11_1","doi-asserted-by":"crossref","unstructured":"Goodwin M. S. Intille S. S. Albinali F. Velicer W. F. (2011). Automated detection of stereotypical motor movements. Journal of Autism and Developmental Disorders 41(6) 770\u2013782. https:\/\/doi.org\/10.1007\/s10803-010-1102-z","DOI":"10.1007\/s10803-010-1102-z"},{"key":"e_1_3_4_12_1","doi-asserted-by":"crossref","unstructured":"Graber A. Graber J. (2023). Applied behavior analysis and the abolitionist neurodiversity critique: An ethical analysis. Behavior Analysis in Practice 16(4) 921\u2013937. https:\/\/doi.org\/10.1007\/s40617-023-00780-6","DOI":"10.1007\/s40617-023-00780-6"},{"key":"e_1_3_4_13_1","doi-asserted-by":"crossref","unstructured":"Hausman N. L. Javed N. Bednar M. K. Guell M. Schaller E. Nevill R. E. Kahng S. (2022). Interobserver agreement: A preliminary investigation into how much is enough? Journal of Applied Behavior Analysis 55(2) 357\u2013368. https:\/\/doi.org\/10.1002\/jaba.811","DOI":"10.1002\/jaba.811"},{"key":"e_1_3_4_14_1","doi-asserted-by":"crossref","unstructured":"He K. Girshick R. Doll\u00e1r P. (2019). Rethinking imagenet pre-training [Conference session]. Proceedings of the IEEE\/CVF International Conference on Computer Vision(pp. 4918\u20134927). IEEE. https:\/\/doi.org\/10.1109\/ICCV.2019.00502","DOI":"10.1109\/ICCV.2019.00502"},{"key":"e_1_3_4_15_1","first-page":"2712","volume-title":"Using pre-training can improve model robustness and uncertainty","author":"Hendrycks D.","year":"2019","unstructured":"Hendrycks D., Lee K., Mazeika M. (2019). Using pre-training can improve model robustness and uncertainty [Conference session]. International Conference on Machine Learning (pp. 2712\u20132721). PMLR."},{"key":"e_1_3_4_16_1","doi-asserted-by":"crossref","unstructured":"Hu K. Jin J. Zheng F. Weng L. Ding Y. (2023). Overview of behavior recognition based on deep learning. Artificial Intelligence Review 56(3) 1833\u20131865. https:\/\/doi.org\/10.1007\/s10462-022-10210-8","DOI":"10.1007\/s10462-022-10210-8"},{"key":"e_1_3_4_17_1","doi-asserted-by":"crossref","unstructured":"Isik S. Unal G. (2023). Open-source software for automated rodent behavioral analysis. Frontiers in Neuroscience 17 1149027. https:\/\/doi.org\/10.3389\/fnins.2023.1149027","DOI":"10.3389\/fnins.2023.1149027"},{"key":"e_1_3_4_18_1","doi-asserted-by":"crossref","unstructured":"Jiang K. Peng P. Lian Y. Xu W. (2022). The encoding method of position embeddings in vision transformer. Journal of Visual Communication and Image Representation 89 103664. https:\/\/doi.org\/10.1016\/j.jvcir.2022.103664","DOI":"10.1016\/j.jvcir.2022.103664"},{"key":"e_1_3_4_19_1","doi-asserted-by":"crossref","unstructured":"Kazdin A. E. (2019). Single-case experimental designs. Evaluating interventions in research and clinical practice. Behaviour Research and Therapy 117 3\u201317. https:\/\/doi.org\/10.1016\/j.brat.2018.11.015","DOI":"10.1016\/j.brat.2018.11.015"},{"key":"e_1_3_4_20_1","doi-asserted-by":"crossref","unstructured":"Khan S. Basu T. Basu J. Pal M. Roy R. (2023). System assisted vocal response analysis and assessment of autism in children: A machine learning based approach [Conference session]. International Conference on Speech and Computer (pp. 506\u2013519). Springer Nature. https:\/\/doi.org\/10.1007\/978-3-031-48309-7_41","DOI":"10.1007\/978-3-031-48309-7_41"},{"key":"e_1_3_4_21_1","doi-asserted-by":"crossref","unstructured":"Khan S. Naseer M. Hayat M. Zamir S. W. Khan F. S. Shah M. (2022). Transformers in vision: A survey. ACM Computing Surveys 54(10s) 200. https:\/\/doi.org\/10.1145\/3505244","DOI":"10.1145\/3505244"},{"key":"e_1_3_4_22_1","doi-asserted-by":"crossref","unstructured":"Lanovaz M. J. Sladeczek I. E. (2012). Vocal stereotypy in individuals with autism spectrum disorders: A review of behavioral interventions. Behavior Modification 36(2) 146\u2013164. https:\/\/doi.org\/10.1177\/0145445511427192","DOI":"10.1177\/0145445511427192"},{"key":"e_1_3_4_23_1","doi-asserted-by":"crossref","unstructured":"LeBlanc L. A. Lund C. Kooken C. Lund J. B. Fisher W. W. (2020). Procedures and accuracy of discontinuous measurement of problem behavior in common practice of applied behavior analysis. Behavior Analysis in Practice 13(2) 411\u2013420. https:\/\/doi.org\/10.1007\/s40617-019-00361-6","DOI":"10.1007\/s40617-019-00361-6"},{"key":"e_1_3_4_24_1","doi-asserted-by":"crossref","unstructured":"Le\u00f3n A. Hernandez V. Lopez J. Guzman I. Quintero V. Toledo P. Avenda\u00f1o-Garrido M. L. Hernandez-Linares C. A. Escamilla E. (2021). Beyond single discrete responses: An integrative and multidimensional analysis of behavioral dynamics assisted by machine learning. Frontiers in Behavioral Neuroscience 15 681771. https:\/\/doi.org\/10.3389\/fnbeh.2021.681771","DOI":"10.3389\/fnbeh.2021.681771"},{"key":"e_1_3_4_25_1","doi-asserted-by":"crossref","unstructured":"Martinez C. K. Betz A. M. Liddon C. J. Werle R. L. (2016). A progression to transfer RIRD to the natural environment. Behavioral Interventions 31(2) 144\u2013162. https:\/\/doi.org\/10.1002\/bin.1444","DOI":"10.1002\/bin.1444"},{"key":"e_1_3_4_26_1","doi-asserted-by":"crossref","unstructured":"Meghanani A. Anoop C. S. Ramakrishnan A. G. (2021 January). An exploration of Log-Mel spectrogram and MFCC features for Alzheimer\u2019s dementia recognition from spontaneous speech [Paper presentation]. 2021 IEEE Spoken Language Technology Workshop (SLT) (pp. 670\u2013677). IEEE. https:\/\/doi.org\/10.1109\/SLT48900.2021.9383491","DOI":"10.1109\/SLT48900.2021.9383491"},{"key":"e_1_3_4_27_1","doi-asserted-by":"crossref","unstructured":"Min C. H. Fetzner J. (2018) Vocal stereotypy detection: An initial step to understanding emotions of children with autism spectrum disorder [Conference session]. 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (pp. 3306\u20133309). IEEE. https:\/\/doi.org\/10.1109\/EMBC.2018.8513050","DOI":"10.1109\/EMBC.2018.8513050"},{"key":"e_1_3_4_28_1","doi-asserted-by":"crossref","unstructured":"Min C. H. Fetzner J. (2019) Training a neural network for vocal stereotypy detection [Conference session]. Annual International Conference of the IEEE Engineering in Medicine and Biology Society (pp. 5451\u20135455). IEEE. https:\/\/doi.org\/10.1109\/EMBC.2019.8856626","DOI":"10.1109\/EMBC.2019.8856626"},{"key":"e_1_3_4_29_1","doi-asserted-by":"crossref","unstructured":"Nath T. Mathis A. Chen A. C. Patel A. Bethge M. Mathis M. W. (2019). Using DeepLabCut for 3D markerless pose estimation across species and behaviors. Nature Protocols 14(7) 2152\u20132176. https:\/\/doi.org\/10.1038\/s41596-019-0176-0","DOI":"10.1038\/s41596-019-0176-0"},{"key":"e_1_3_4_30_1","unstructured":"Paszke A. Gross S. Chintala S. Chanan G. Yang E. DeVito Z. . . . Wilson M. (2019). PyTorch: An imperative style high-performance deep learning library. arXiv. https:\/\/doi.org\/10.48550\/arXiv.1912.01703"},{"key":"e_1_3_4_31_1","doi-asserted-by":"crossref","unstructured":"Pr\u00e9fontaine I. Lanovaz M. J. McDuff E. McHugh C. Cook J. L. (2019). Using mobile technology to reduce engagement in stereotypy: A validation of decision-making algorithms. Behavior Modification 43(2) 222\u2013245. https:\/\/doi.org\/10.1177\/0145445517748560","DOI":"10.1177\/0145445517748560"},{"key":"e_1_3_4_32_1","doi-asserted-by":"crossref","unstructured":"Rad N. M. Furlanello C. (2016). Applying deep learning to stereotypical motor movement detection in autism spectrum disorders [Conference session]. IEEE 16th International Conference on Data Mining Workshops (pp. 1235\u20131242). IEEE. https:\/\/doi.org\/10.1109\/ICDMW.2016.0178.","DOI":"10.1109\/ICDMW.2016.0178"},{"key":"e_1_3_4_33_1","doi-asserted-by":"crossref","unstructured":"Rapp J. T. Vollmer T. R. (2005). Stereotypy I: A review of behavioral assessment and treatment. Research in Developmental Disabilities 26(6) 527\u2013547. https:\/\/doi.org\/10.1016\/j.ridd.2004.11.005","DOI":"10.1016\/j.ridd.2004.11.005"},{"key":"e_1_3_4_34_1","doi-asserted-by":"crossref","unstructured":"Rawat P. Bajaj M. Vats S. Sharma V. (2023). A comprehensive study based on MFCC and spectrogram for audio classification. Journal of Information and Optimization Sciences 44(6) 1057\u20131074. https:\/\/doi.org\/10.47974\/JIOS-1431","DOI":"10.47974\/JIOS-1431"},{"key":"e_1_3_4_35_1","doi-asserted-by":"crossref","unstructured":"Shabaz M. Singla P. Jawarneh M. M. Qureshi H. M. (2021). A novel automated approach for deep learning on stereotypical autistic motor movements. In Kautish S. Dhiman G. (Eds.) Artificial intelligence for accurate analysis and detection of autism spectrum disorder (pp. 54\u201368). IGI Global. https:\/\/doi.org\/10.4018\/978-1-7998-7460-7.ch004","DOI":"10.4018\/978-1-7998-7460-7.ch004"},{"key":"e_1_3_4_36_1","doi-asserted-by":"crossref","unstructured":"Thakore A. Kelly A. Petursdottir A. I. Stockdale M. (2024). Evaluation of a treatment package for chronic stereotypic hand mouthing of a child diagnosed with autism. Behavior Analysis in Practice. Advance online publication. https:\/\/doi.org\/10.1007\/s40617-024-00956-8","DOI":"10.1007\/s40617-024-00956-8"},{"key":"e_1_3_4_37_1","doi-asserted-by":"crossref","unstructured":"Trudel L. Lanovaz M. J. Pr\u00e9fontaine I. (2021). Brief report: Mobile technology to support parents in reducing stereotypy. Journal of Autism and Developmental Disorders 51(7) 2550\u20132558. https:\/\/doi.org\/10.1007\/s10803-020-04735-6","DOI":"10.1007\/s10803-020-04735-6"},{"key":"e_1_3_4_38_1","doi-asserted-by":"crossref","unstructured":"Tse C. Y. A. Pang C. L. Lee P. H. (2018). Choosing an appropriate physical exercise to reduce stereotypic behavior in children with autism spectrum disorders: A non-randomized crossover study. Journal of Autism and Developmental Disorders 48(5) 1666\u20131672. https:\/\/doi.org\/10.1007\/s10803-017-3419-3","DOI":"10.1007\/s10803-017-3419-3"},{"key":"e_1_3_4_39_1","doi-asserted-by":"crossref","unstructured":"Turab M. Kumar T. Bendechache M. Saber T. (2022). Investigating multi-feature selection and ensembling for audio classification. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2206.07511","DOI":"10.5121\/ijaia.2022.13306"},{"key":"e_1_3_4_40_1","doi-asserted-by":"crossref","unstructured":"Voita E. Talbot D. Moiseev F. Sennrich R. Titov I. (2019). Analyzing multi-head self-attention: Specialized heads do the heavy lifting the rest can be pruned. arXiv. https:\/\/doi.org\/10.48550\/arXiv.1905.09418","DOI":"10.18653\/v1\/P19-1580"},{"key":"e_1_3_4_41_1","doi-asserted-by":"crossref","unstructured":"Wang D. Mason R. A. Lory C. Kim S. Y. David M. Guo X. (2020). Vocal stereotypy and autism spectrum disorder: A systematic review of interventions. Research in Autism Spectrum Disorders 78 101647. https:\/\/doi.org\/10.1016\/j.rasd.2020.101647","DOI":"10.1016\/j.rasd.2020.101647"},{"key":"e_1_3_4_42_1","doi-asserted-by":"crossref","unstructured":"Zhang Q. Zhang J. Xu Y. Tao D. (2024). Vision transformer with quadrangle attention. IEEE Transactions on Pattern Analysis and Machine Intelligence 46(5) 3608\u20133624. https:\/\/doi.org\/10.1109\/TPAMI.2023.3347693","DOI":"10.1109\/TPAMI.2023.3347693"}],"container-title":["Behavior Modification"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/01454455251380510","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/01454455251380510","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/01454455251380510","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T13:28:22Z","timestamp":1777382902000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/01454455251380510"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,16]]},"references-count":41,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2026,3]]}},"alternative-id":["10.1177\/01454455251380510"],"URL":"https:\/\/doi.org\/10.1177\/01454455251380510","relation":{"has-preprint":[{"id-type":"doi","id":"10.31234\/osf.io\/c4k98","asserted-by":"object"}]},"ISSN":["0145-4455","1552-4167"],"issn-type":[{"value":"0145-4455","type":"print"},{"value":"1552-4167","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,16]]}}}