{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,28]],"date-time":"2026-09-28T18:28:49Z","timestamp":1790620129691,"version":"4.1.0"},"reference-count":38,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,9,29]],"date-time":"2022-09-29T00:00:00Z","timestamp":1664409600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neurosci."],"abstract":"<jats:p>Wheelchair-mounted robotic arms support people with upper extremity disabilities with various activities of daily living (ADL). However, the associated cost and the power consumption of responsive and adaptive assistive robotic arms contribute to the fact that such systems are in limited use. Neuromorphic spiking neural networks can be used for a real-time machine learning-driven control of robots, providing an energy efficient framework for adaptive control. In this work, we demonstrate a neuromorphic adaptive control of a wheelchair-mounted robotic arm deployed on Intel\u2019s Loihi chip. Our algorithm design uses neuromorphically represented and integrated velocity readings to derive the arm\u2019s current state. The proposed controller provides the robotic arm with adaptive signals, guiding its motion while accounting for kinematic changes in real-time. We pilot-tested the device with an able-bodied participant to evaluate its accuracy while performing ADL-related trajectories. We further demonstrated the capacity of the controller to compensate for unexpected inertia-generating payloads using online learning. Videotaped recordings of ADL tasks performed by the robot were viewed by caregivers; data summarizing their feedback on the user experience and the potential benefit of the system is reported.<\/jats:p>","DOI":"10.3389\/fnins.2022.1007736","type":"journal-article","created":{"date-parts":[[2022,9,29]],"date-time":"2022-09-29T17:16:25Z","timestamp":1664471785000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":28,"title":["Adaptive control of a wheelchair mounted robotic arm with neuromorphically integrated velocity readings and online-learning"],"prefix":"10.3389","volume":"16","author":[{"given":"Michael","family":"Ehrlich","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuval","family":"Zaidel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Patrice L.","family":"Weiss","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arie","family":"Melamed Yekel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Naomi","family":"Gefen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lazar","family":"Supic","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elishai","family":"Ezra Tsur","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2022,9,29]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"559","DOI":"10.1109\/TCST.2005.847331","article-title":"PID control system analysis, design, and technology.","volume":"13","author":"Ang","year":"2005","journal-title":"IEEE Trans. Control Syst. Technol."},{"key":"B2","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1146\/annurev-control-061417-041727","article-title":"Autonomy in rehabilitation robotics: An intersection.","volume":"1","author":"Argall","year":"2018","journal-title":"Annu. Rev. Control Robot. Auton. Syst."},{"key":"B3","doi-asserted-by":"publisher","first-page":"67","DOI":"10.3414\/ME09-02-0044","article-title":"Pervasive healthcare: Paving the way for a pervasive, user-centered and preventive healthcare model.","volume":"49","author":"Arnrich","year":"2010","journal-title":"Methods Inf. Med."},{"key":"B4","doi-asserted-by":"publisher","first-page":"397","DOI":"10.1177\/0008417418820878","article-title":"Impacts of robotic arm use on individuals with upper extremity disabilities: A scoping review.","volume":"85","author":"Beaudoin","year":"2018","journal-title":"Can. J. Occup. Ther."},{"key":"B5","doi-asserted-by":"publisher","first-page":"48","DOI":"10.3389\/fninf.2013.00048","article-title":"Nengo: A Python tool for building large-scale functional brain models.","volume":"7","author":"Bekolay","year":"2014","journal-title":"Front. Neuroinform."},{"key":"B6","first-page":"191","article-title":"Participatory research methods: A methodological approach in motion.","volume":"13","author":"Bergold","year":"2012","journal-title":"Hist. Soc. Res."},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1109\/AERO53065.2022.9843517","article-title":"Docking the Mars 2020 perseverance robotic arm","author":"Brooks","year":"2022","journal-title":"Procedings of the IEEE aerospace conference (AERO)"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2015.7354083","article-title":"Learning motor control parameters for motion strategy analysis of Parkinson\u2019s disease patients","author":"Burget","year":"2015","journal-title":"Proceedings of the IEEE\/RSJ international conference on intelligent robots and systems (IROS)"},{"key":"B9","doi-asserted-by":"publisher","first-page":"3872","DOI":"10.1109\/TIE.2009.2018433","article-title":"PID-like neural network nonlinear adaptive control for uncertain multivariable motion control systems.","volume":"56","author":"Cong","year":"2009","journal-title":"IEEE Trans. Industr. Electron."},{"key":"B10","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1109\/MM.2018.112130359","article-title":"Loihi: A neuromorphic manycore processor with on-chip learning.","volume":"38","author":"Davies","year":"2018","journal-title":"IEEE Micro"},{"key":"B11","doi-asserted-by":"publisher","first-page":"eabk3268","DOI":"10.1126\/scirobotics.abk3268","article-title":"Spiking neural networks take control.","volume":"6","author":"DeWolf","year":"2021","journal-title":"Sci. Robot."},{"key":"B12","doi-asserted-by":"publisher","first-page":"568359","DOI":"10.3389\/fnbot.2020.568359","article-title":"Nengo and low-power AI hardware for robust, embedded neurorobotics.","volume":"73","author":"DeWolf","year":"2020","journal-title":"Front. Neurorobot."},{"key":"B13","doi-asserted-by":"publisher","first-page":"20162134","DOI":"10.1098\/rspb.2016.2134","article-title":"A spiking neural model of adaptive arm control.","volume":"283","author":"DeWolf","year":"2016","journal-title":"Proc. R. Soc. Lond. B Biol. Sci."},{"key":"B14","author":"Eliasmith","year":"2003","journal-title":"Neural engineering: Computation, representation, and dynamics in neurobiological systems."},{"key":"B15","first-page":"22","article-title":"Nengo and the neural engineering framework: From spikes to cognition.","volume":"34","author":"Eliasmith","year":"2012","journal-title":"Proc. Annu. Meet. Cogn. Sci. Soc."},{"key":"B16","doi-asserted-by":"publisher","first-page":"875","DOI":"10.1007\/s10209-017-0569-1","article-title":"User preferences for adaptive user interfaces in health information systems.","volume":"17","author":"Eslami","year":"2018","journal-title":"Univ. Access Inf. Soc."},{"key":"B17","doi-asserted-by":"publisher","first-page":"11557","DOI":"10.3390\/s140711557","article-title":"A proposal for automatic fruit harvesting by combining a low cost stereovision camera and a robotic arm.","volume":"14","author":"Font","year":"2014","journal-title":"Sensors"},{"key":"B18","doi-asserted-by":"publisher","first-page":"741116","DOI":"10.3389\/fnins.2021.741116","article-title":"An Adaptive STDP learning rule for neuromorphic systems.","volume":"15","author":"Gautam","year":"2021","journal-title":"Front. Neurosci."},{"key":"B19","doi-asserted-by":"publisher","first-page":"1826","DOI":"10.1126\/science.8091209","article-title":"The basal ganglia and adaptive motor control.","volume":"265","author":"Graybiel","year":"1994","journal-title":"Science"},{"key":"B20","doi-asserted-by":"publisher","first-page":"627221","DOI":"10.3389\/fnins.2021.627221","article-title":"Neuromorphic analog implementation of neural engineering framework-inspired spiking neuron for high- dimensional representation.","volume":"15","author":"Hazan","year":"2021","journal-title":"Front. Neurosci."},{"key":"B21","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1109\/MC.2018.157113521","article-title":"Programming spiking neural networks on Intel\u2019s Loihi.","volume":"51","author":"Lin","year":"2018","journal-title":"Computer"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1109\/ICORR.2011.5975397","article-title":"Evaluation of the JACO robotic arm: Clinico-economic study for powered wheelchair users with upper-extremity disabilities","author":"Maheu","year":"2011","journal-title":"Proceedings of the IEEE international conference on rehabilitation robotics"},{"key":"B23","doi-asserted-by":"publisher","first-page":"364","DOI":"10.1016\/j.jor.2019.03.010","article-title":"Making the transition from traditional to robotic-arm assisted TKA: what to expect? A single-surgeon comparative-analysis of the first-40 consecutive cases.","volume":"16","author":"Naziri","year":"2019","journal-title":"J. Orthop."},{"key":"B24","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1016\/j.actaastro.2009.01.041","article-title":"Space debris removal system using a small satellite.","volume":"65","author":"Nishida","year":"2009","journal-title":"Acta Astronaut."},{"key":"B25","author":"Rasmus","year":"2020","journal-title":"Towards neuromorphic control: A spiking neural network based PID controller for UAV."},{"key":"B26","article-title":"Benefits of JACO robotic arm on independent living and social participation: an exploratory study","author":"Routhier","year":"2014","journal-title":"Proceedings of the RESNA annual conference"},{"key":"B27","doi-asserted-by":"publisher","first-page":"514","DOI":"10.1017\/S0266462309990328","article-title":"Developing medical device technologies from users\u2019 perspectives: A theoretical framework for involving users in the development process.","volume":"25","author":"Shah","year":"2009","journal-title":"Int. J. Technol. Assess. Health Care"},{"key":"B28","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1080\/10400435.2014.903315","article-title":"Investigating the international classification of functioning, disability, and health (ICF) framework to capture user needs in the concept stage of rehabilitation technology development.","volume":"26","author":"Sivan","year":"2014","journal-title":"Assist. Technol."},{"key":"B29","doi-asserted-by":"publisher","first-page":"544","DOI":"10.1038\/35000576","article-title":"Motor disorder in Huntington\u2019s disease begins as a dysfunction in error feedback control.","volume":"403","author":"Smith","year":"2000","journal-title":"Nature"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1201\/9781003143499","author":"Tsur","year":"2021","journal-title":"Neuromorphic engineering: The scientist\u2019s, algorithm designer\u2019s, and computer architect\u2019s perspectives on brain-inspired computing."},{"key":"B31","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1016\/j.neucom.2019.09.072","article-title":"Neuromorphic implementation of motion detection using oscillation interference.","volume":"374","author":"Tsur","year":"2020","journal-title":"Neurocomputing"},{"key":"B32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/17483107.2021.1928778","article-title":"Shared autonomy in assistive mobile robots: A review.","author":"Udupa","year":"2021","journal-title":"Disabil. Rehabil. Assist. Technol."},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA48506.2021.9560881","article-title":"Event-driven vision and control for UAVs on a neuromorphic chip","author":"Vitale","year":"2021","journal-title":"Proceedings of the IEEE international conference on robotics and automation (ICRA)"},{"key":"B34","author":"Voelker","year":"2015","journal-title":"A solution to the dynamics of the prescribed error sensitivity learning rule."},{"key":"B35","doi-asserted-by":"publisher","first-page":"100391","DOI":"10.1016\/j.patter.2021.100391","article-title":"Data-driven artificial and spiking neural networks for inverse kinematics in neurorobotics.","volume":"3","author":"Volinski","year":"2022","journal-title":"Patterns"},{"key":"B36","doi-asserted-by":"publisher","first-page":"574","DOI":"10.1109\/TBCAS.2017.2666883","article-title":"Neuromorphic hardware architecture using the neural engineering framework for pattern recognition.","volume":"11","author":"Wang","year":"2017","journal-title":"IEEE Trans. Biomed. Circuits Syst."},{"key":"B37","first-page":"40","article-title":"What can you see? Modeling the ability of V1 neurons to perform low-level image processing.","volume":"7","author":"Yun","year":"2021","journal-title":"J. Comput. Vision Imag. Syst."},{"key":"B38","doi-asserted-by":"publisher","first-page":"631159","DOI":"10.3389\/fnbot.2021.631159","article-title":"Neuromorphic NEF-based inverse kinematics and PID control.","volume":"15","author":"Zaidel","year":"2021","journal-title":"Front. Neurorobot."}],"container-title":["Frontiers in Neuroscience"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnins.2022.1007736\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,29]],"date-time":"2022-09-29T17:16:38Z","timestamp":1664471798000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnins.2022.1007736\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,29]]},"references-count":38,"alternative-id":["10.3389\/fnins.2022.1007736"],"URL":"https:\/\/doi.org\/10.3389\/fnins.2022.1007736","relation":{},"ISSN":["1662-453X"],"issn-type":[{"value":"1662-453X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,29]]},"article-number":"1007736"}}