{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,2]],"date-time":"2026-10-02T19:31:26Z","timestamp":1790969486282,"version":"4.1.0"},"reference-count":52,"publisher":"American Speech Language Hearing Association","issue":"8S","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Speech Lang Hear Res"],"published-print":{"date-parts":[[2023,8,17]]},"abstract":"<jats:sec>\n            <jats:title>Purpose:<\/jats:title>\n            <jats:p>This study sought to determine whether clinically interpretable kinematic features extracted automatically from three-dimensional (3D) videos were correlated with corresponding perceptual clinical orofacial ratings in individuals with orofacial impairments due to neurological disorders.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Method:<\/jats:title>\n            <jats:p>\n              45 participants (19 diagnosed with motor neuron diseases [MNDs] and 26 poststroke) performed two nonspeech tasks (mouth opening and lip spreading) and one speech task (repetition of a sentence \u201cBuy Bobby a Puppy\u201d) while being video-recorded in a standardized lab setting. The color video recordings of participants were assessed by an expert clinician\u2014a speech language pathologist\u2014on the severity of three orofacial measures: symmetry, range of motion (ROM), and speed. Clinically interpretable 3D kinematic features, linked to symmetry, ROM, and speed, were automatically extracted from video recordings, using a deep facial landmark detection and tracking algorithm for each of the three tasks. Spearman correlations were used to identify features that were significantly correlated (\n              <jats:italic>p<\/jats:italic>\n              value &lt; .05) with their corresponding clinical scores. Clinically significant kinematic features were then used in the subsequent multivariate regression models to predict the overall orofacial impairment severity score.\n            <\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results:<\/jats:title>\n            <jats:p>Several kinematic features extracted from 3D video recordings were associated with their corresponding perceptual clinical scores, indicating clinical validity of these automatically derived measures. Different patterns of significant features were observed between MND and poststroke groups; these differences were aligned with clinical expectations in both cases.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusions:<\/jats:title>\n            <jats:p>The results show that kinematic features extracted automatically from simple clinical tasks can capture characteristics used by clinicians during assessments. These findings support the clinical validity of video-based automatic extraction of kinematic features.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1044\/2023_jslhr-22-00321","type":"journal-article","created":{"date-parts":[[2023,3,29]],"date-time":"2023-03-29T17:11:53Z","timestamp":1680109913000},"page":"3151-3165","source":"Crossref","is-referenced-by-count":6,"title":["3D Video Tracking Technology in the Assessment of Orofacial Impairments in Neurological Disease: Clinical Validation"],"prefix":"10.1044","volume":"66","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1050-159X","authenticated-orcid":false,"given":"Deniz","family":"Jafari","sequence":"first","affiliation":[{"name":"Department of Speech-Language Pathology, Rehabilitation Sciences Institute, University of Toronto, Ontario, Canada"},{"name":"KITE, Toronto Rehabilitation Institute, University Health Network, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Leif","family":"Simmatis","sequence":"additional","affiliation":[{"name":"Department of Speech-Language Pathology, Rehabilitation Sciences Institute, University of Toronto, Ontario, Canada"},{"name":"KITE, Toronto Rehabilitation Institute, University Health Network, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Diego","family":"Guarin","sequence":"additional","affiliation":[{"name":"University of Florida, Gainesville"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liziane","family":"Bouvier","sequence":"additional","affiliation":[{"name":"Department of Speech-Language Pathology, Rehabilitation Sciences Institute, University of Toronto, Ontario, Canada"},{"name":"Hurvitz Brain Sciences Program, Sunnybrook Research Institute, Toronto, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Babak","family":"Taati","sequence":"additional","affiliation":[{"name":"KITE, Toronto Rehabilitation Institute, University Health Network, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2353-2275","authenticated-orcid":false,"given":"Yana","family":"Yunusova","sequence":"additional","affiliation":[{"name":"Department of Speech-Language Pathology, Rehabilitation Sciences Institute, University of Toronto, Ontario, Canada"},{"name":"KITE, Toronto Rehabilitation Institute, University Health Network, Ontario, Canada"},{"name":"Hurvitz Brain Sciences Program, Sunnybrook Research Institute, Toronto, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1310","reference":[{"key":"e_1_3_2_2_1","doi-asserted-by":"publisher","DOI":"10.1080\/21678421.2017.1303515"},{"key":"e_1_3_2_3_1","first-page":"1711","volume-title":"Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, 2018-September","author":"Bandini A.","year":"2018","unstructured":"Bandini, A. , Green, J. R. , Richburg, B. D. , & Yunusova, Y. (2018). Automatic detection of orofacial impairment in stroke. Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, 2018-September (pp. 1711\u20131715). https:\/\/doi.org\/10.21437\/Interspeech.2018-2475"},{"key":"e_1_3_2_4_1","first-page":"150","volume-title":"Proceedings - 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018","author":"Bandini A.","year":"2018","unstructured":"Bandini, A. , Green, J. R. , Taati, B. , Orlandi, S. , Zinman, L. , & Yunusova, Y. (2018). Automatic detection of amyotrophic lateral sclerosis (ALS) from video-based analysis of facial movements: Speech and non-speech tasks. Proceedings - 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018 (pp. 150\u2013157). https:\/\/doi.org\/10.1109\/FG.2018.00031"},{"key":"e_1_3_2_5_1","doi-asserted-by":"publisher","DOI":"10.1044\/2018_JSLHR-S-17-0262"},{"key":"e_1_3_2_6_1","first-page":"1819","volume-title":"Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, 2017","author":"Bandini A.","year":"2017","unstructured":"Bandini, A. , Green, J. R. , Zinman, L. , & Yunusova, Y. (2017). Classification of bulbar ALS from kinematic features of the jaw and lips: Towards computer-mediated assessment. Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, 2017 (pp. 1819\u20131823). https:\/\/doi.org\/10.21437\/Interspeech.2017-478"},{"key":"e_1_3_2_7_1","first-page":"689","volume-title":"Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, 2017","author":"Bandini A.","year":"2017","unstructured":"Bandini, A. , Namasivayam, A. , & Yunusova, Y. (2017). Video-based tracking of jaw movements during speech: Preliminary results and future directions. Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, 2017 (pp. 689\u2013693). https:\/\/doi.org\/10.21437\/Interspeech.2017-1371"},{"key":"e_1_3_2_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jneumeth.2017.02.006"},{"key":"e_1_3_2_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvoice.2015.10.014"},{"key":"e_1_3_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2020.3019242"},{"key":"e_1_3_2_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2020.101954"},{"key":"e_1_3_2_12_1","doi-asserted-by":"publisher","DOI":"10.1044\/2021_JSLHR-21-00012"},{"key":"e_1_3_2_13_1","first-page":"1021","volume-title":"Proceedings of the IEEE International Conference on Computer Vision, 2017-October","author":"Bulat A.","year":"2017","unstructured":"Bulat, A. , & Tzimiropoulos, G. (2017). How far are we from solving the 2D & 3D face alignment problem? (and a dataset of 230,000 3D facial landmarks). Proceedings of the IEEE International Conference on Computer Vision, 2017-October (pp. 1021\u20131030). https:\/\/doi.org\/10.1109\/ICCV.2017.116"},{"key":"e_1_3_2_14_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2007\/102)"},{"key":"e_1_3_2_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0022-510X(99)00210-5"},{"key":"e_1_3_2_16_1","doi-asserted-by":"crossref","unstructured":"Chmieli\u0144ska J. Bia\u0142ek K. Potulska-Chromik A. Jakubowski J. Majda-Zdancewicz E. Nojszewska M. Kostera-Pruszczyk A. & \nDobrowolski A.\n (2020). Multimodal data acquisition set for objective assessment of Parkinson's disease. 11442 https:\/\/doi.org\/10.1117\/12.2565133","DOI":"10.1117\/12.2565133"},{"key":"e_1_3_2_17_1","doi-asserted-by":"publisher","DOI":"10.3390\/brainsci12030365"},{"key":"e_1_3_2_18_1","doi-asserted-by":"publisher","DOI":"10.1682\/JRRD.2013.07.0167"},{"key":"e_1_3_2_19_1","doi-asserted-by":"publisher","DOI":"10.1080\/03610918.2013.813037"},{"key":"e_1_3_2_20_1","volume-title":"Motor speech disorders: Substrates, differential diagnosis, and management","author":"Duffy J. R.","year":"2019","unstructured":"Duffy, J. R. (2019). Motor speech disorders: Substrates, differential diagnosis, and management (4th ed.). Elsevier.","edition":"4"},{"key":"e_1_3_2_21_1","unstructured":"FDA-NIH Biomarker Working Group. (2016). BEST (Biomarkers EndpointS and other Tools) Resource [Internet]. Food and Drug Administration (US). \nhttps:\/\/www.ncbi.nlm.nih.gov\/books\/NBK326791"},{"key":"e_1_3_2_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcomdis.2013.04.001"},{"key":"e_1_3_2_23_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-020-0260-4"},{"key":"e_1_3_2_24_1","doi-asserted-by":"publisher","DOI":"10.1159\/000514730"},{"key":"e_1_3_2_25_1","doi-asserted-by":"crossref","unstructured":"Guarin D. L. Bandini A. Dempster A. Wang H. Rezaei S. Yunusova Y. & \nTaati B.\n (2020). The effect of improving facial alignment accuracy on the video-based detection of neurological diseases. TechRxiv. https:\/\/doi.org\/10.36227\/techrxiv.12950279.v1","DOI":"10.36227\/techrxiv.12950279.v1"},{"key":"e_1_3_2_26_1","doi-asserted-by":"publisher","DOI":"10.1089\/fpsam.2019.29000.gua"},{"key":"e_1_3_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNSRE.2020.3007532"},{"key":"e_1_3_2_28_1","doi-asserted-by":"publisher","DOI":"10.3233\/NRE-141165"},{"key":"e_1_3_2_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-020-04720-1"},{"key":"e_1_3_2_30_1","doi-asserted-by":"crossref","unstructured":"Keselman L. Woodfill J. I. Grunnet-Jepsen A. & \nBhowmik A.\n (2017). Intel RealSense stereoscopic depth cameras. \nhttp:\/\/arxiv.org\/abs\/1705.05548","DOI":"10.1109\/CVPRW.2017.167"},{"key":"e_1_3_2_31_1","doi-asserted-by":"publisher","DOI":"10.2340\/16501977-0645"},{"key":"e_1_3_2_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcm.2016.02.012"},{"key":"e_1_3_2_33_1","doi-asserted-by":"publisher","DOI":"10.1044\/2017_AJSLP-16-0230"},{"key":"e_1_3_2_34_1","doi-asserted-by":"publisher","DOI":"10.1198\/016214502753479392"},{"key":"e_1_3_2_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcomdis.2016.04.002"},{"key":"e_1_3_2_36_1","doi-asserted-by":"publisher","DOI":"10.1177\/0013164418817803"},{"key":"e_1_3_2_37_1","doi-asserted-by":"publisher","DOI":"10.1037\/1082-989X.1.1.30"},{"key":"e_1_3_2_38_1","doi-asserted-by":"crossref","unstructured":"Nasreddine Z. S. Phillips N. A. B\u00e9dirian V. Charbonneau S. Whitehead V. Collin I. Cummings J. L. & \nChertkow H.\n (2005). The Montreal Cognitive Assessment MoCA: A brief screening tool for mild cognitive impairment. \nhttp:\/\/www.mocatest","DOI":"10.1037\/t27279-000"},{"key":"e_1_3_2_39_1","doi-asserted-by":"crossref","unstructured":"Neumann M. Roesler O. Liscombe J. Kothare H. Suendermann-Oeft D. Pautler D. Navar I. Anvar A. Kumm J. Norel R. Fraenkel E. Sherman A. v. Berry J. D. Pattee G. L. Wang J. Green J. R. & \nRamanarayanan V\n. (2021). Investigating the utility of multimodal conversational technology and audiovisual analytic measures for the assessment and monitoring of amyotrophic lateral sclerosis at scale. \nhttp:\/\/arxiv.org\/abs\/2104.07310","DOI":"10.21437\/Interspeech.2021-1801"},{"key":"e_1_3_2_40_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13690-021-00750-w"},{"key":"e_1_3_2_41_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.4954497"},{"key":"e_1_3_2_42_1","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1145\/3462244.3479933","volume-title":"ICMI 2021 - Proceedings of the 2021 International Conference on Multimodal Interaction","author":"Palliya Guruge C.","year":"2021","unstructured":"Palliya Guruge, C. , Oviatt, S. , Delir Haghighi, P. , & Pritchard, E. (2021). Advances in multimodal behavioral analytics for early dementia diagnosis: A review. ICMI 2021 - Proceedings of the 2021 International Conference on Multimodal Interaction (pp. 328\u2013340). https:\/\/doi.org\/10.1145\/3462244.3479933"},{"key":"e_1_3_2_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00138-020-01080-7"},{"key":"e_1_3_2_44_1","first-page":"38","volume-title":"ACM International Conference Proceeding Series","author":"Park E.","year":"2020","unstructured":"Park, E. , Han, T. , & Nam, H. S. (2020). MFAST: Automatic stoke evaluation system for time-critical treatment with multimodal feature collection and machine learning classification. ACM International Conference Proceeding Series (pp. 38\u201341). https:\/\/doi.org\/10.1145\/3384613.3384653"},{"key":"e_1_3_2_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ecns.2014.07.005"},{"key":"e_1_3_2_46_1","doi-asserted-by":"publisher","DOI":"10.3109\/02699206.2012.706686"},{"issue":"5","key":"e_1_3_2_47_1","first-page":"887","article-title":"Speech movement measures as markers of bulbar disease in amyotrophic lateral sclerosis","volume":"59","author":"Shellikeri S.","year":"2016","unstructured":"Shellikeri, S. , Green, J. R. , Kulkarni, M. , Rong, P. , Martino, R. , Zinman, L. , & Yunusova, Y. (2016). Speech movement measures as markers of bulbar disease in amyotrophic lateral sclerosis. American Journal of Speech-Language Pathology, 59(5), 887\u2013899. https:\/\/doi.org\/10.1044\/2016_JSLHR-S-15-0238","journal-title":"American Journal of Speech-Language Pathology"},{"key":"e_1_3_2_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-018-0905-x"},{"key":"e_1_3_2_49_1","doi-asserted-by":"crossref","unstructured":"Simmons K. C. & \nMayo R.\n (1997). The use of the Mayo Clinic system for differential diagnosis of dysarthria. \nhttps:\/\/doi.org\/10.1016\/S0021-9924(96)00058-5","DOI":"10.1016\/S0021-9924(96)00058-5"},{"key":"e_1_3_2_50_1","doi-asserted-by":"publisher","DOI":"10.1159\/000525514"},{"key":"e_1_3_2_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcomdis.2009.07.003"},{"key":"e_1_3_2_52_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2008\/043)"},{"key":"e_1_3_2_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2019.2915841"}],"container-title":["Journal of Speech, Language, and Hearing Research"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/pubs.asha.org\/doi\/pdf\/10.1044\/2023_JSLHR-22-00321","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,17]],"date-time":"2023-08-17T13:02:01Z","timestamp":1692277321000},"score":1,"resource":{"primary":{"URL":"http:\/\/pubs.asha.org\/doi\/10.1044\/2023_JSLHR-22-00321"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,17]]},"references-count":52,"journal-issue":{"issue":"8S","published-print":{"date-parts":[[2023,8,17]]}},"alternative-id":["10.1044\/2023_JSLHR-22-00321"],"URL":"https:\/\/doi.org\/10.1044\/2023_jslhr-22-00321","relation":{},"ISSN":["1092-4388","1558-9102"],"issn-type":[{"value":"1092-4388","type":"print"},{"value":"1558-9102","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,17]]}}}