{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,12]],"date-time":"2026-10-12T15:51:29Z","timestamp":1791820289678,"version":"4.3.4"},"reference-count":31,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,11,1]],"date-time":"2023-11-01T00:00:00Z","timestamp":1698796800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neurol."],"abstract":"<jats:p>People living with mobility-limiting conditions such as Parkinson\u2019s disease can struggle to physically complete intended tasks. Intent-sensing technology can measure and even predict these intended tasks, such that assistive technology could help a user to safely complete them. In prior research, algorithmic systems have been proposed, developed and tested for measuring user intent through a Probabilistic Sensor Network, allowing multiple sensors to be dynamically combined in a modular fashion. A time-segmented deep-learning system has also been presented to predict intent continuously. This study combines these principles, and so proposes, develops and tests a novel algorithm for multi-modal intent sensing, combining measurements from IMU sensors with those from a microphone and interpreting the outputs using time-segmented deep learning. It is tested on a new data set consisting of a mix of non-disabled control volunteers and participants with Parkinson\u2019s disease, and used to classify three activities of daily living as quickly and accurately as possible. Results showed intent could be determined with an accuracy of 97.4% within 0.5\u2009s of inception of the idea to act, which subsequently improved monotonically to a maximum of 99.9918% over the course of the activity. This evidence supports the conclusion that intent sensing is viable as a potential input for assistive medical devices.<\/jats:p>","DOI":"10.3389\/fneur.2023.1260445","type":"journal-article","created":{"date-parts":[[2023,11,1]],"date-time":"2023-11-01T16:18:44Z","timestamp":1698855524000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["A modular, deep learning-based holistic intent sensing system tested with Parkinson\u2019s disease patients and controls"],"prefix":"10.3389","volume":"14","author":[{"given":"Joseph","family":"Russell","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jemma","family":"Inches","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Camille B.","family":"Carroll","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeroen H. M.","family":"Bergmann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2023,11,1]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1111\/ene.14108","article-title":"Parkinson disease","volume":"27","author":"Balestrino","year":"2020","journal-title":"Eur J Neurol"},{"key":"ref2","doi-asserted-by":"publisher","first-page":"1182","DOI":"10.1136\/jnnp.2006.112367","article-title":"Cognitive impairment in Parkinson\u2019s disease","volume":"78","author":"Verbaan","year":"2007","journal-title":"J Neurol Neurosurg Psychiatry"},{"key":"ref3","doi-asserted-by":"publisher","first-page":"137","DOI":"10.3233\/JPD-202457","article-title":"A patient-centered conceptual model of symptoms and their impact in early Parkinson\u2019s disease: a qualitative study","volume":"12","author":"Staunton","year":"2022","journal-title":"J Parkinsons Dis"},{"key":"ref4","doi-asserted-by":"publisher","first-page":"700600","DOI":"10.3389\/fneur.2021.700600","article-title":"A review on wearable technologies for tremor suppression","volume":"12","author":"Lora-Millan","year":"2021","journal-title":"Front Neurol"},{"key":"ref5","doi-asserted-by":"publisher","first-page":"668","DOI":"10.1126\/science.aav7536","article-title":"Reducing the metabolic rate of walking and running with a versatile, portable exosuit","volume":"365","author":"Kim","year":"2019","journal-title":"Science"},{"key":"ref6","doi-asserted-by":"publisher","first-page":"118","DOI":"10.1109\/TMRB.2021.3135704","article-title":"A systematic literature review of intent sensing for control of medical devices","volume":"4","author":"Russell","year":"2022","journal-title":"IEEE Trans Med Robot Bionics"},{"key":"ref7","doi-asserted-by":"publisher","first-page":"815693","DOI":"10.3389\/fnbot.2022.815693","article-title":"Intention detection strategies for robotic upper-limb orthoses: a scoping review considering usability, daily life application, and user evaluation","volume":"16","author":"Gantenbein","year":"2022","journal-title":"Front Neurorobot"},{"key":"ref8","doi-asserted-by":"publisher","first-page":"1265","DOI":"10.3390\/mi14061265","article-title":"Research on intelligent wheelchair attitude-based adjustment method based on action intention recognition","volume":"14","author":"Cui","year":"2023","journal-title":"Micromachines"},{"key":"ref9","doi-asserted-by":"publisher","first-page":"453","DOI":"10.3390\/prosthesis5020031","article-title":"Real-time intent sensing for assistive devices with implications for minimising maintenance","volume":"5","author":"Russell","year":"2023","journal-title":"PRO"},{"key":"ref10","doi-asserted-by":"publisher","first-page":"16695","DOI":"10.3390\/s121216695","article-title":"Wearable and implantable sensors: the patient\u2019s perspective","volume":"12","author":"Bergmann","year":"2012","journal-title":"Sensors"},{"key":"ref11","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3390\/s22072603","article-title":"Towards dynamic multi-modal intent sensing using probabilistic sensor networks","volume":"22","author":"Russell","year":"2022","journal-title":"Sensors"},{"key":"ref12","doi-asserted-by":"publisher","first-page":"3893","DOI":"10.3390\/s22103893","article-title":"Opportunities for smartphone sensing in E-Health research: a narrative review","volume":"22","author":"Kulkarni","year":"2022","journal-title":"Sensors"},{"key":"ref13","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1038\/s41746-022-00568-y","article-title":"Co-evolution of machine learning and digital technologies to improve monitoring of Parkinson\u2019s disease motor symptoms","volume":"5","author":"Chandrabhatla","year":"2022","journal-title":"NPJ Digit Med"},{"key":"ref14","doi-asserted-by":"crossref","first-page":"0585","DOI":"10.1109\/UEMCON47517.2019.8993086","article-title":"Probabilistic sensor design for healthcare technology","volume-title":"2019 IEEE 10th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON)","author":"Russell","year":"2019"},{"key":"ref15","doi-asserted-by":"publisher","DOI":"10.5061\/dryad.fbg79cp1d","article-title":"A five-sensor IMU-based Parkinson\u2019s disease patient and control dataset including three activities of daily living [dataset]","author":"Russell","year":"2023","journal-title":"Dryad"},{"key":"ref16","first-page":"153","volume-title":"Recent developments in Parkinson\u2019s Disease","author":"Fahn","year":"1987"},{"key":"ref17","doi-asserted-by":"publisher","first-page":"427","DOI":"10.1212\/WNL.17.5.427","article-title":"Parkinsonism: onset, progression, and mortality","volume":"17","author":"Hoehn","year":"1967","journal-title":"Neurology"},{"key":"ref18","doi-asserted-by":"publisher","first-page":"2493","DOI":"10.1161\/01.STR.0000185928.90848.2e","article-title":"Reliability and validity of the upper-extremity motor activity Log-14 for measuring real-world arm use","volume":"36","author":"Uswatte","year":"2005","journal-title":"Stroke"},{"key":"ref19","doi-asserted-by":"publisher","first-page":"749","DOI":"10.1007\/s12559-017-9500-6","article-title":"A Bayesian assessment of real-world behavior during multitasking","volume":"9","author":"Bergmann","year":"2017","journal-title":"Cogn Comput"},{"key":"ref20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/ICICyTA53712.2021.9689160","article-title":"Comparison of windowing function on feature extraction using MFCC for speaker identification","volume-title":"2021 International Conference on Intelligent Cybernetics Technology & Applications (ICICyTA).","author":"Firmansyah","year":"2021"},{"key":"ref21","first-page":"19","article-title":"MFCC and its applications in speaker recognition","volume":"1","author":"Tiwari","year":"2010","journal-title":"Int J Emerg Technol"},{"key":"ref22","doi-asserted-by":"publisher","first-page":"817","DOI":"10.1049\/tje2.12082","article-title":"How many Mel-frequency cepstral coefficients to be utilized in speech recognition? A study with the Bengali language","volume":"2021","author":"Hasan","year":"2021","journal-title":"J Eng"},{"key":"ref23","doi-asserted-by":"publisher","first-page":"124","DOI":"10.4103\/2229-516X.157168","article-title":"A comparative study of visual and auditory reaction times on the basis of gender and physical activity levels of medical first year students","volume":"5","author":"Jain","year":"2015","journal-title":"Int J Appl Basic Med Res"},{"key":"ref24","doi-asserted-by":"publisher","first-page":"4811","DOI":"10.1109\/JSEN.2020.3028738","article-title":"Time series classification-based correlational neural network with bidirectional LSTM for automated detection of kidney disease","volume":"21","author":"Bhaskar","year":"2021","journal-title":"IEEE Sensors J"},{"key":"ref25","first-page":"358","article-title":"Spearman rank correlation coefficient","volume-title":"Applied nonparametric statistics","author":"Daniel","year":"1990"},{"key":"ref26","doi-asserted-by":"publisher","first-page":"16455","DOI":"10.1038\/s41598-021-95947-y","article-title":"Human activity recognition using wearable sensors, discriminant analysis, and long short-term memory-based neural structured learning","volume":"11","author":"Uddin","year":"2021","journal-title":"Sci Rep"},{"key":"ref27","doi-asserted-by":"publisher","first-page":"664","DOI":"10.3389\/fbioe.2020.00664","article-title":"Supervised machine learning applied to wearable sensor data can accurately classify functional fitness exercises within a continuous workout","volume":"8","author":"Preatoni","year":"2020","journal-title":"Front Bioeng Biotechnol"},{"key":"ref28","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1186\/s12883-021-02101-2","article-title":"Physical activity profiles in Parkinson\u2019s disease","volume":"21","author":"von Rosen","year":"2021","journal-title":"BMC Neurol"},{"key":"ref29","doi-asserted-by":"publisher","first-page":"297","DOI":"10.1016\/j.apergo.2013.03.012","article-title":"Making the case for inclusive design","volume":"46","author":"Waller","year":"2015","journal-title":"Appl Ergon"},{"key":"ref30","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1016\/j.neucom.2019.08.092","article-title":"Online active learning for human activity recognition from sensory data streams","volume":"390","author":"Mohamad","year":"2020","journal-title":"Neurocomputing"},{"key":"ref31","doi-asserted-by":"publisher","first-page":"e88080","DOI":"10.1371\/journal.pone.0088080","article-title":"Exploring the use of sensors to measure behavioral interactions: an experimental evaluation of using hand trajectories","volume":"9","author":"Bergmann","year":"2014","journal-title":"PLoS One"}],"updated-by":[{"DOI":"10.3389\/fneur.2026.1972445","type":"addendum","label":"Addendum","source":"publisher","updated":{"date-parts":[[2026,10,12]],"date-time":"2026-10-12T00:00:00Z","timestamp":1791763200000}}],"container-title":["Frontiers in Neurology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fneur.2023.1260445\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,1]],"date-time":"2023-11-01T16:18:53Z","timestamp":1698855533000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fneur.2023.1260445\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,1]]},"references-count":31,"alternative-id":["10.3389\/fneur.2023.1260445"],"URL":"https:\/\/doi.org\/10.3389\/fneur.2023.1260445","relation":{},"ISSN":["1664-2295"],"issn-type":[{"value":"1664-2295","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,1]]},"article-number":"1260445"}}