{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T17:06:04Z","timestamp":1772039164311,"version":"3.50.1"},"reference-count":31,"publisher":"Association for Computing Machinery (ACM)","issue":"4","funder":[{"DOI":"10.13039\/501100003093","name":"Ministry of Higher Education, Malaysia","doi-asserted-by":"publisher","award":["FRGS\/1\/2023\/ICT10\/APU\/02\/1"],"award-info":[{"award-number":["FRGS\/1\/2023\/ICT10\/APU\/02\/1"]}],"id":[{"id":"10.13039\/501100003093","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2025,6,30]]},"abstract":"<jats:p>Full-body tracking (FBT) enhances embodiment and motion-based interaction in extended reality (XR), particularly for virtual reality (VR) applications such as those used for autism spectrum disorder (ASD) screening. While Meta Movement Software Development Kit (SDK) provides eye and hand tracking, its estimation-based FBT skeleton conflicts with Open Sound Control (OSC)-based body tracking data, leading to body proportion distortion and misalignment when external trackers like SlimeVR are used. To resolve this, we adopt the Virtual Motion Capture (VMC) protocol skeleton as the primary FBT framework, integrating OSC-based body tracking with OpenXR for head tracking and Meta\u2019s SDK for eye and hand tracking. Multiple custom OSC messages are created by retrieving positional and rotational data from custom input actions, allowing real-time player headspace detection and precise avatar alignment. This approach ensures accurate skeletal proportions and real-time avatar alignment, eliminating reliance on Meta\u2019s prediction-based body tracking. By leveraging custom OSC messages and SlimeVR\u2019s body proportion calibration, the proposed system offers a more stable and precise FBT solution for standalone VR applications.<\/jats:p>","DOI":"10.1145\/3734435","type":"journal-article","created":{"date-parts":[[2025,6,27]],"date-time":"2025-06-27T07:35:59Z","timestamp":1751009759000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["A Multimodal Framework for Integrating Motion Capture Monitoring into ASD Screening Utilizing XR Applications"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-5571-0239","authenticated-orcid":false,"given":"Chin Yee","family":"Khor","sequence":"first","affiliation":[{"name":"School of Computing","place":["Bukit Jalil, Malaysia"]},{"name":"Asia Pacific University of Technology and Innovation","place":["Bukit Jalil, Malaysia"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0121-5049","authenticated-orcid":false,"given":"Siti Azreena","family":"Mubin","sequence":"additional","affiliation":[{"name":"School of Computing","place":["Bukit Jalil, Malaysia"]},{"name":"Asia Pacific University of Technology and Innovation","place":["Bukit Jalil, Malaysia"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0237-4295","authenticated-orcid":false,"given":"Chin Ike","family":"Tan","sequence":"additional","affiliation":[{"name":"School of Computing","place":["Bukit Jalil, Malaysia"]},{"name":"Asia Pacific University of Technology and Innovation","place":["Bukit Jalil, Malaysia"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1908-0680","authenticated-orcid":false,"given":"Vinesh","family":"Thiruchelvam","sequence":"additional","affiliation":[{"name":"Innovation and Enterprise","place":["Bukit Jalil, Malaysia"]},{"name":"Asia Pacific University of Technology and Innovation","place":["Bukit Jalil, Malaysia"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5991-7409","authenticated-orcid":false,"given":"Tse Kian","family":"Neo","sequence":"additional","affiliation":[{"name":"Centre for Innovative and Immersive Technology, Centre for Immersive Experience","place":["Cyberjaya, Malaysia"]},{"name":"Multimedia University","place":["Cyberjaya, Malaysia"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4195-3548","authenticated-orcid":false,"given":"Gaik Kin","family":"Teoh","sequence":"additional","affiliation":[{"name":"Department of Psychology and Counselling, School of Psychology and Social Sciences","place":["Bukit Jalil, Malaysia"]},{"name":"International Medical University","place":["Bukit Jalil, Malaysia"]}]}],"member":"320","published-online":{"date-parts":[[2025,6,27]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","unstructured":"2000. Practice parameter: Screening and diagnosis of autism: Report of the Quality Standards Subcommittee of the American Academy of Neurology and the Child Neurology Society [RETIRED]. Neurology 55 4 (Aug. 2000) 468\u2013479. 10.1212\/WNL.55.4.468","DOI":"10.1212\/WNL.55.4.468"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","unstructured":"Mariano Alca\u00f1iz Irene\u00a0Alice Chicchi\u2010Giglioli Luc\u00eda\u00a0A. Carrasco\u2010Ribelles Javier Mar\u00edn\u2010Morales Maria\u00a0Eleonora Minissi Gonzalo Teruel\u2010Garc\u00eda Marian Sirera and Luis Abad. 2022. Eye gaze as a biomarker in the recognition of autism spectrum disorder using virtual reality and machine learning: A proof of concept for diagnosis. Autism Research 15 1 (Jan. 2022) 131\u2013145. 10.1002\/aur.2636","DOI":"10.1002\/aur.2636"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","unstructured":"Mariano Alca\u00f1iz\u00a0Raya Javier Mar\u00edn-Morales Maria\u00a0Eleonora Minissi Gonzalo Teruel\u00a0Garcia Luis Abad and Irene\u00a0Alice Chicchi\u00a0Giglioli. 2020. Machine Learning and Virtual Reality on Body Movements\u2019 Behaviors to Classify Children with Autism Spectrum Disorder. Journal of Clinical Medicine 9 5 (April 2020) 1260. 10.3390\/jcm9051260","DOI":"10.3390\/jcm9051260"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1176\/appi.books.9780890425596"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","unstructured":"R. Asmetha\u00a0Jeyarani and Radha Senthilkumar. 2023. Eye Tracking Biomarkers for Autism Spectrum Disorder Detection using Machine Learning and Deep Learning Techniques: Review. Research in Autism Spectrum Disorders 108 (Oct. 2023) 102228. 10.1016\/j.rasd.2023.102228","DOI":"10.1016\/j.rasd.2023.102228"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/3649902.3653347"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","unstructured":"Hugo Carneiro and Stefan Wermter. 2024. FabuLight-ASD: unveiling speech activity via body language. Neural Computing and Applications (Dec. 2024). 10.1007\/s00521-024-10792-0","DOI":"10.1007\/s00521-024-10792-0"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","unstructured":"Hanna Drimalla Irina Baskow Behnoush Behnia Stefan Roepke and Isabel Dziobek. 2021. Imitation and recognition of facial emotions in autism: a computer vision approach. Molecular Autism 12 1 (Dec. 2021) 27. 10.1186\/s13229-021-00430-0","DOI":"10.1186\/s13229-021-00430-0"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","unstructured":"Thomas\u00a0W. Frazier Eric\u00a0A. Youngstrom Leslie Speer Rebecca Embacher Paul Law John Constantino Robert\u00a0L. Findling Antonio\u00a0Y. Hardan and Charis Eng. 2012. Validation of Proposed DSM-5 Criteria for Autism Spectrum Disorder. Journal of the American Academy of Child & Adolescent Psychiatry 51 1 (Jan. 2012) 28\u201340.e3. 10.1016\/j.jaac.2011.09.021","DOI":"10.1016\/j.jaac.2011.09.021"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICARM54641.2022.9959634"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC.2014.6943977"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","unstructured":"Emily\u00a0J.H. Jones Geraldine Dawson Jean Kelly Annette Estes and Sara\u00a0Jane Webb. 2017. Parent\u2010delivered early intervention in infants at risk for ASD: Effects on electrophysiological and habituation measures of social attention. Autism Research 10 5 (May 2017) 961\u2013972. 10.1002\/aur.1754","DOI":"10.1002\/aur.1754"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.9734\/bpi\/cidhr\/v1\/19332D"},{"key":"e_1_3_3_15_2","unstructured":"Meta. 2025. Eye Tracking for Movement SDK for Unity | Meta Horizon OS Developers. https:\/\/developers.meta.com\/horizon\/documentation\/unity\/move-eye-tracking\/"},{"key":"e_1_3_3_16_2","doi-asserted-by":"crossref","unstructured":"Maria\u00a0Eleonora Minissi Alberto Altozano Javier Mar\u00edn-Morales Irene Alice\u00a0Chicchi Giglioli Fabrizia Mantovani and Mariano Alca\u00f1iz. 2024. Biosignal comparison for autism assessment using machine learning models and virtual reality. Computers in Biology and Medicine 171 (2024) 108194. ISBN: 0010-4825 Publisher: Elsevier.","DOI":"10.1016\/j.compbiomed.2024.108194"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRAIE47735.2019.9037765"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","unstructured":"Olatunji\u00a0Mumini Omisore Ifeanyi Odenigbo Joseph Orji Amelia Itzel\u00a0Hernandez Beltran Sandra Meier Nilufar Baghaei and Rita Orji. 2024. Extended Reality for Mental Health Evaluation: Scoping Review. JMIR Serious Games 12 (July 2024) e38413. 10.2196\/38413","DOI":"10.2196\/38413"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","unstructured":"Sally Ozonoff Gregory\u00a0S. Young Rebecca\u00a0J. Landa Jessica Brian Susan Bryson Tony Charman Katarzyna Chawarska Suzanne\u00a0L. Macari Daniel Messinger Wendy\u00a0L. Stone Lonnie Zwaigenbaum and Ana\u2010Maria Iosif. 2015. Diagnostic stability in young children at risk for autism spectrum disorder: a baby siblings research consortium study. Journal of Child Psychology and Psychiatry 56 9 (Sept. 2015) 988\u2013998. 10.1111\/jcpp.12421","DOI":"10.1111\/jcpp.12421"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDSNS62112.2024.10690847"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","unstructured":"Marta Robles Negar Namdarian Julia Otto Evelyn Wassiljew Nassir Navab Christine\u00a0M. Falter-Wagner and Daniel Roth. 2022. A Virtual Reality Based System for the Screening and Classification of Autism. IEEE Transactions on Visualization and Computer Graphics 28 5 (May 2022) 2168\u20132178. 10.1109\/TVCG.2022.3150489","DOI":"10.1109\/TVCG.2022.3150489"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/AIVR50618.2020.00029"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","unstructured":"Daniel Roth and Marc\u00a0Erich Latoschik. 2020. Construction of the Virtual Embodiment Questionnaire (VEQ). IEEE Transactions on Visualization and Computer Graphics 26 12 (Dec. 2020) 3546\u20133556. 10.1109\/TVCG.2020.3023603","DOI":"10.1109\/TVCG.2020.3023603"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","unstructured":"Noah\u00a0J. Sasson and Emily\u00a0W. Touchstone. 2014. Visual Attention to Competing Social and Object Images by Preschool Children with Autism Spectrum Disorder. Journal of Autism and Developmental Disorders 44 3 (March 2014) 584\u2013592. 10.1007\/s10803-013-1910-z","DOI":"10.1007\/s10803-013-1910-z"},{"key":"e_1_3_3_25_2","unstructured":"SlimeVR. 2025. Body Proportions Configuration - SlimeVR Docs. https:\/\/docs.slimevr.dev\/server\/body-config.html"},{"key":"e_1_3_3_26_2","unstructured":"SlimeVR. 2025. Introduction - SlimeVR Docs. https:\/\/docs.slimevr.dev\/"},{"key":"e_1_3_3_27_2","unstructured":"SlimeVR. 2025. Quick Setup - SlimeVR Docs. https:\/\/docs.slimevr.dev\/quick-setup.html"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","unstructured":"Kathryn\u00a0A. Smith Jean-G. Gehricke Suzannah Iadarola Audrey Wolfe and Karen\u00a0A. Kuhlthau. 2020. Disparities in Service Use Among Children With Autism: A Systematic Review. Pediatrics 145 Supplement_1 (April 2020) S35\u2013S46. 10.1542\/peds.2019-1895G","DOI":"10.1542\/peds.2019-1895G"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","unstructured":"Binbin Sun Bryan Wang Zhen Wei Zhe Feng Zhi-Liu Wu Walid Yassin William\u00a0S. Stone Yan Lin and Xue-Jun Kong. 2023. Identification of diagnostic markers for ASD: a restrictive interest analysis based on EEG combined with eye tracking. Frontiers in Neuroscience 17 (Oct. 2023) 1236637. 10.3389\/fnins.2023.1236637","DOI":"10.3389\/fnins.2023.1236637"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501975"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","unstructured":"University of the Philippines Diliman Quezon City Philippines James-Andrew\u00a0R. Sarmiento and Prospero Naval\u00a0Jr. 2020. Behavioral Phenotyping for Autism Spectrum Disorder Biomarkers Using Computer Vision. Journal of Image and Graphics (2020) 47\u201352. 10.18178\/joig.8.2.47-52","DOI":"10.18178\/joig.8.2.47-52"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3573381.3596467"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3734435","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,15]],"date-time":"2025-07-15T18:15:05Z","timestamp":1752603305000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3734435"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,27]]},"references-count":31,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,6,30]]}},"alternative-id":["10.1145\/3734435"],"URL":"https:\/\/doi.org\/10.1145\/3734435","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,27]]},"assertion":[{"value":"2025-06-27","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}