{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T15:53:06Z","timestamp":1776095586832,"version":"3.50.1"},"reference-count":74,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2025,3,3]],"date-time":"2025-03-03T00:00:00Z","timestamp":1740960000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"NSF","award":["2113485"],"award-info":[{"award-number":["2113485"]}]},{"name":"NIH","award":["R01EY030085 and R01EY03568801"],"award-info":[{"award-number":["R01EY030085 and R01EY03568801"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2025,3,3]]},"abstract":"<jats:p>Mouse-based pointing and steering tasks are two primary interaction actions on computer devices. In this research, we created models for mouse-based pointing and steering tasks for people with Parkinson's Disease (PD); second, we detected PD via pointing and steering actions. The data collected from 24 participants (12 PD patients and 12 age-matched non-PD people) revealed that those with PD showed significant differences in their interaction patterns, characterized by slower movement times (MT), higher error rates, and lower information throughput compared to non-PD people. Leveraging this insight, we proposed a CNN-Transformer-based neural network model adept at PD detection, which demonstrated high accuracy in a leave-one-user-out validation. Combining pointing and steering datasets, it reached 0.96 for both AUC and F1-score. When only 10 pointing and steering actions of a user were observed, it reached an AUC of 0.99 and an F1-score of 0.96. Overall, our research contributes mouse-based pointing and steering models for PD users and provides CNN-Transformer models and computer interfaces for convenient PD detection.<\/jats:p>","DOI":"10.1145\/3712267","type":"journal-article","created":{"date-parts":[[2025,3,4]],"date-time":"2025-03-04T12:10:14Z","timestamp":1741090214000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Modeling Mouse-based Pointing and Steering Tasks for People with Parkinson's Disease"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-4836-8561","authenticated-orcid":false,"given":"Hang","family":"Zhao","sequence":"first","affiliation":[{"name":"Stony Brook University, Stony Brook, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-7689-719X","authenticated-orcid":false,"given":"Kaiyan","family":"Ling","sequence":"additional","affiliation":[{"name":"Cherry Hill High School East and Stony Brook University, Cherry Hill and Stony Brook, NJ and NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1768-7043","authenticated-orcid":false,"given":"IV","family":"Ramakrishnan","sequence":"additional","affiliation":[{"name":"Stony Brook University, Stony Brook, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8882-0534","authenticated-orcid":false,"given":"M.D. Guy","family":"Schwartz","sequence":"additional","affiliation":[{"name":"Stony Brook University Hospital, Stony Brook, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9716-7709","authenticated-orcid":false,"given":"Xiaojun","family":"Bi","sequence":"additional","affiliation":[{"name":"Stony Brook University, Stony Brook, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,3,4]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/258549.258760"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/302979.303133"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0188226"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jneumeth.2013.09.015"},{"key":"e_1_2_1_5_1","volume-title":"Detecting and monitoring the symptoms of Parkinson's disease using smartphones: A pilot study. Parkinsonism & related disorders 21, 6","author":"Arora Siddharth","year":"2015","unstructured":"Siddharth Arora, Vinayak Venkataraman, Andong Zhan, S Donohue, Kevin M Biglan, E Ray Dorsey, and Max A Little. 2015. Detecting and monitoring the symptoms of Parkinson's disease using smartphones: A pilot study. Parkinsonism & related disorders 21, 6 (2015), 650--653."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.9462"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2004.09.002"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-92034-4_1"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1080\/00140137808931762"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4939-2172-0_24"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v076.i01"},{"key":"e_1_2_1_12_1","volume-title":"Fitts' Law in the Wild: A Field Study of Aimed Movements.(Dec","author":"Chapuis Olivier","year":"2007","unstructured":"Olivier Chapuis, Renaud Blanch, and Michel Beaudouin-Lafon. 2007. Fitts' Law in the Wild: A Field Study of Aimed Movements.(Dec. 2007)."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijforecast.2015.12.005"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240723"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1177\/0956797613504966"},{"key":"e_1_2_1_16_1","volume-title":"Selected Works of Murray Rosenblatt","author":"Davis Richard A","unstructured":"Richard A Davis, Keh-Shin Lii, and Dimitris N Politis. 2011. Remarks on some nonparametric estimates of a density function. In Selected Works of Murray Rosenblatt. Springer, 95--100."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1212\/01.WNL.0000140706.52798.BE"},{"key":"e_1_2_1_18_1","unstructured":"Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai Thomas Unterthiner Mostafa Dehghani Matthias Minderer Georg Heigold Sylvain Gelly et al. 2020. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)."},{"key":"e_1_2_1_19_1","volume-title":"Hybrid monte carlo. Physics letters B 195, 2","author":"Duane Simon","year":"1987","unstructured":"Simon Duane, Anthony D Kennedy, Brian J Pendleton, and Duncan Roweth. 1987. Hybrid monte carlo. Physics letters B 195, 2 (1987), 216--222."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0141694"},{"key":"e_1_2_1_21_1","volume-title":"An introduction to ROC analysis. Pattern recognition letters 27, 8","author":"Fawcett Tom","year":"2006","unstructured":"Tom Fawcett. 2006. An introduction to ROC analysis. Pattern recognition letters 27, 8 (2006), 861--874."},{"key":"e_1_2_1_22_1","volume-title":"Movement speed-accuracy trade-off in Parkinson's disease. Frontiers in neurology 9","author":"Fernandez Laure","year":"2018","unstructured":"Laure Fernandez, Raoul Huys, Johann Issartel, Jean-Philippe Azulay, and Alexandre Eusebio. 2018. Movement speed-accuracy trade-off in Parkinson's disease. Frontiers in neurology 9 (2018), 897."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0055392"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0022970"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC.2012.6346340"},{"key":"e_1_2_1_26_1","volume-title":"Bayesian data analysis","author":"Gelman Andrew","unstructured":"Andrew Gelman, John B Carlin, Hal S Stern, and Donald B Rubin. 1995. Bayesian data analysis. Chapman and Hall\/CRC."},{"key":"e_1_2_1_27_1","volume-title":"Rubin","author":"Gelman Andrew","year":"2004","unstructured":"Andrew Gelman, John B. Carlin, Hal S. Stern, and Donald B. Rubin. 2004. Bayesian data analysis (second ed.). Chapman & Hall\/CRC, Boca Raton, FL, Boca Raton, FL. xxvi+668 pages."},{"key":"e_1_2_1_28_1","volume-title":"Understanding predictive information criteria for Bayesian models. Statistics and computing 24, 6","author":"Gelman Andrew","year":"2014","unstructured":"Andrew Gelman, Jessica Hwang, and Aki Vehtari. 2014. Understanding predictive information criteria for Bayesian models. Statistics and computing 24, 6 (2014), 997--1016."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/10.216411"},{"key":"e_1_2_1_30_1","volume-title":"Computer keyboard interaction as an indicator of early Parkinson's disease. Scientific reports 6, 1","author":"Giancardo Luca","year":"2016","unstructured":"Luca Giancardo, Alvaro Sanchez-Ferro, Teresa Arroyo-Gallego, Ian Butterworth, Carlos S Mendoza, Paloma Montero, Michele Matarazzo, Jos\u00e9 A Obeso, Martha L Gray, and R Est\u00e9par. 2016. Computer keyboard interaction as an indicator of early Parkinson's disease. Scientific reports 6, 1 (2016), 1--10."},{"key":"e_1_2_1_31_1","doi-asserted-by":"crossref","unstructured":"Christopher G Goetz Stanley Fahn Pablo Martinez-Martin Werner Poewe Cristina Sampaio Glenn T Stebbins Matthew B Stern Barbara C Tilley Richard Dodel Bruno Dubois et al. 2007. Movement Disorder Society-sponsored revision of the Unified Parkinson's Disease Rating Scale (MDS-UPDRS): process format and clinimetric testing plan. Movement disorders 22 1 (2007) 41--47.","DOI":"10.1002\/mds.21198"},{"key":"e_1_2_1_32_1","unstructured":"Julien Gori. 2018. Modeling the speed-accuracy tradeoff using the tools of information theory. Ph. D. Dissertation. Universit\u00e9 Paris-Saclay (ComUE)."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.23919\/EUSIPCO.2019.8902946"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.20380\/GI2022.21"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2004.09.003"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1212\/WNL.50.2.318"},{"key":"e_1_2_1_37_1","volume-title":"Screening of Parkinsonian subtle fine-motor impairment from touchscreen typing via deep learning. Scientific reports 10, 1","author":"Iakovakis Dimitrios","year":"2020","unstructured":"Dimitrios Iakovakis, K Ray Chaudhuri, Lisa Klingelhoefer, Sevasti Bostantjopoulou, Zoe Katsarou, Dhaval Trivedi, Heinz Reichmann, Stelios Hadjidimitriou, Vasileios Charisis, and Leontios J Hadjileontiadis. 2020. Screening of Parkinsonian subtle fine-motor impairment from touchscreen typing via deep learning. Scientific reports 10, 1 (2020), 12623."},{"key":"e_1_2_1_38_1","volume-title":"Touchscreen typing-pattern analysis for detecting fine motor skills decline in early-stage Parkinson's disease. Scientific reports 8, 1","author":"Iakovakis Dimitrios","year":"2018","unstructured":"Dimitrios Iakovakis, Stelios Hadjidimitriou, Vasileios Charisis, Sevasti Bostantzopoulou, Zoe Katsarou, and Leontios J Hadjileontiadis. 2018. Touchscreen typing-pattern analysis for detecting fine motor skills decline in early-stage Parkinson's disease. Scientific reports 8, 1 (2018), 7663."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2851581.2892364"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642084"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2015.2471093"},{"key":"e_1_2_1_42_1","volume-title":"What to believe: Bayesian methods for data analysis. Trends in cognitive sciences 14, 7","author":"Kruschke John K","year":"2010","unstructured":"John K Kruschke. 2010. What to believe: Bayesian methods for data analysis. Trends in cognitive sciences 14, 7 (2010), 293--300."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1056\/NEJM199810083391506"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0158852"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4939-2172-0_23"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3659627"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1080\/00222895.1989.10735486"},{"key":"e_1_2_1_48_1","volume-title":"Computer and internet use in the United States","author":"Mej\u00eda Daniela","year":"2021","unstructured":"Daniela Mej\u00eda. 2024. Computer and internet use in the United States: 2021. American Community Survey Reports (2024)."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3121431"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1006\/jcph.1994.1054"},{"key":"e_1_2_1_51_1","volume-title":"MCMC using Hamiltonian dynamics. arXiv preprint arXiv:1206.1901","author":"Neal Radford M","year":"2012","unstructured":"Radford M Neal. 2012. MCMC using Hamiltonian dynamics. arXiv preprint arXiv:1206.1901 (2012)."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2016.03.009"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.14236\/ewic\/HCI2012.17"},{"key":"e_1_2_1_54_1","first-page":"S176","article-title":"Improving outcomes through early diagnosis of Parkinson's disease","volume":"18","author":"Pagan Fernando L","year":"2012","unstructured":"Fernando L Pagan. 2012. Improving outcomes through early diagnosis of Parkinson's disease. American Journal of Managed Care 18, 7 (2012), S176.","journal-title":"American Journal of Managed Care"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/IEMBS.2011.6091814"},{"key":"e_1_2_1_56_1","doi-asserted-by":"crossref","unstructured":"Di Pan Rohit Dhall Abraham Lieberman Diana B Petitti et al. 2015. A mobile cloud-based Parkinson's disease assessment system for home-based monitoring. JMIR mHealth and uHealth 3 1 (2015) e3956.","DOI":"10.2196\/mhealth.3956"},{"key":"e_1_2_1_57_1","volume-title":"The inconsistency of \"optimal\" cutpoints obtained using two criteria based on the receiver operating characteristic curve. American journal of epidemiology 163, 7","author":"Perkins Neil J","year":"2006","unstructured":"Neil J Perkins and Enrique F Schisterman. 2006. The inconsistency of \"optimal\" cutpoints obtained using two criteria based on the receiver operating characteristic curve. American journal of epidemiology 163, 7 (2006), 670--675."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC.2014.6944176"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/1979742.1979636"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1002\/mds.26723"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-20916-6_23"},{"key":"e_1_2_1_62_1","volume-title":"International journal of human-computer studies 61, 6","author":"William Soukoreff R","year":"2004","unstructured":"R William Soukoreff and I Scott MacKenzie. 2004. Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI. International journal of human-computer studies 61, 6 (2004), 751--789."},{"key":"e_1_2_1_63_1","volume-title":"Mandy Koop, Bruce C Hill, Trevor Hastie, Gary Heit, and Helen M Bronte-Stewart.","author":"Taylor Tavares Ana Lisa","year":"2005","unstructured":"Ana Lisa Taylor Tavares, Gregory SXE Jefferis, Mandy Koop, Bruce C Hill, Trevor Hastie, Gary Heit, and Helen M Bronte-Stewart. 2005. Quantitative measurements of alternating finger tapping in Parkinson's disease correlate with UPDRS motor disability and reveal the improvement in fine motor control from medication and deep brain stimulation. Movement disorders: official journal of the Movement Disorder Society 20, 10 (2005), 1286--1298."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300313"},{"key":"e_1_2_1_65_1","volume-title":"Attention is all you need. Advances in neural information processing systems 30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems 30 (2017)."},{"key":"e_1_2_1_66_1","volume-title":"On the linear relation between the mean and the standard deviation of a response time distribution. Psychological review 114, 3","author":"Wagenmakers Eric-Jan","year":"2007","unstructured":"Eric-Jan Wagenmakers and Scott Brown. 2007. On the linear relation between the mean and the standard deviation of a response time distribution. Psychological review 114, 3 (2007), 830."},{"key":"e_1_2_1_67_1","volume-title":"Why psychologists must change the way they analyze their data: the case of psi: comment on Bem","author":"Wagenmakers Eric-Jan","year":"2011","unstructured":"Eric-Jan Wagenmakers, Ruud Wetzels, Denny Borsboom, and Han LJ Van Der Maas. 2011. Why psychologists must change the way they analyze their data: the case of psi: comment on Bem (2011). (2011)."},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3472749.3474811"},{"key":"e_1_2_1_69_1","volume-title":"Robust augmentation for multivariate time series classification. arXiv preprint arXiv:2201.11739","author":"Yang Hong","year":"2022","unstructured":"Hong Yang and Travis Desell. 2022. Robust augmentation for multivariate time series classification. arXiv preprint arXiv:2201.11739 (2022)."},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2004.09.006"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPSN48710.2020.00025"},{"key":"e_1_2_1_72_1","volume-title":"mixup: Beyond empirical risk minimization. arXiv preprint arXiv:1710.09412","author":"Zhang Hongyi","year":"2017","unstructured":"Hongyi Zhang, Moustapha Cisse, Yann N Dauphin, and David Lopez-Paz. 2017. mixup: Beyond empirical risk minimization. arXiv preprint arXiv:1710.09412 (2017)."},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/3526113.3545708"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1201\/b12207"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3712267","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3712267","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T19:30:50Z","timestamp":1755891050000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3712267"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,3]]},"references-count":74,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,3,3]]}},"alternative-id":["10.1145\/3712267"],"URL":"https:\/\/doi.org\/10.1145\/3712267","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,3]]},"assertion":[{"value":"2025-03-04","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}