{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,27]],"date-time":"2026-10-27T06:10:52Z","timestamp":1793081452692,"version":"4.5.0"},"reference-count":42,"publisher":"IOP Publishing","issue":"1","license":[{"start":{"date-parts":[[2025,2,14]],"date-time":"2025-02-14T00:00:00Z","timestamp":1739491200000},"content-version":"vor","delay-in-days":13,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2025,2,14]],"date-time":"2025-02-14T00:00:00Z","timestamp":1739491200000},"content-version":"tdm","delay-in-days":13,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"name":"Institut Carnot Leti - Inria"},{"DOI":"10.13039\/501100004571","name":"Minist\u00e8re des Affaires Sociales et de la Sant\u00e9","doi-asserted-by":"crossref","award":["Grant PHRC-15-15-0124"],"award-info":[{"award-number":["Grant PHRC-15-15-0124"]}],"id":[{"id":"10.13039\/501100004571","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Fonds de dotation Clinatec"}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["J. Neural Eng."],"published-print":{"date-parts":[[2025,2,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>\n                  <jats:italic>Objective.<\/jats:italic> Assistive robots can be developed to restore or provide more autonomy for individuals with motor impairments. In particular, power wheelchairs can compensate lower-limb impairments, while robotic manipulators can compensate upper-limbs impairments. Recent studies have shown that Brain-Computer Interfaces (BCI) can be used to operate this type of devices. However, activities of daily living and long-term use in real-life contexts such as home require robustness and adaptability to complex, changing and cluttered environments which can be problematic given the neural signals that do not always allow a safe and efficient use. This article describes assist-as-needed sensor-based shared control (SC) methods relying on the blending of BCI and depth-sensor-based control. <jats:italic>Approach.<\/jats:italic> The proposed assistance targets the BCI-teleoperation of effectors for tasks that answer mobility and manipulation needs in a at-home context. The assistance provided by the proposed methods was evaluated through a wheelchair mobility and reach-and-grasp laboratory-based experiments in a controlled environment, as part of a clinical trial with a quadriplegic patient implanted with a wireless 64-channel ElectroCorticoGram recording implant named WIMAGINE. <jats:italic>Main results.<\/jats:italic> Results showed that the proposed methods can assist BCI users in both tasks. Indeed, the time to perform the tasks and the number of changes of mental tasks were reduced. Moreover, unwanted actions, such as wheelchair collisions with the environment, and gripper opening that could result in the fall of the object were avoided. <jats:italic>Significance.<\/jats:italic> The proposed methods are steps toward at-home use of BCI-teleoperated assistive robots. Indeed, the proposed SC methods improved the performance of the two assistive devices.<\/jats:p>\n               <jats:p>Clinical trial, registration number: NCT02550522.<\/jats:p>","DOI":"10.1088\/1741-2552\/adae36","type":"journal-article","created":{"date-parts":[[2025,1,24]],"date-time":"2025-01-24T22:52:46Z","timestamp":1737759166000},"page":"016045","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Depth-sensor-based shared control assistance for mobility and object manipulation: toward long-term home-use of BCI-controlled assistive robotic devices"],"prefix":"10.1088","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6628-3002","authenticated-orcid":true,"given":"Ang\u00e9lina","family":"Bellicha","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3890-9100","authenticated-orcid":true,"given":"Lucas","family":"Struber","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fran\u00e7ois","family":"Pasteau","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Violaine","family":"Juillard","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9109-545X","authenticated-orcid":true,"given":"Louise","family":"Devigne","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Serpil","family":"Karakas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephan","family":"Chabardes","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6425-389X","authenticated-orcid":true,"given":"Marie","family":"Babel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4938-9419","authenticated-orcid":false,"given":"Guillaume","family":"Charvet","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"266","published-online":{"date-parts":[[2025,2,14]]},"reference":[{"key":"jneadae36bib1","doi-asserted-by":"publisher","first-page":"456","DOI":"10.1017\/S0317167100014530","article-title":"Global incidence and prevalence of traumatic spinal cord injury","volume":"40","author":"Furlan","year":"2013","journal-title":"Can. J. Neurol. Sci."},{"key":"jneadae36bib2","doi-asserted-by":"publisher","DOI":"10.1016\/j.bbr.2019.112240","article-title":"The effects of visual distractors on cognitive load in a motor imagery brain-computer interface","volume":"378","author":"Emami","year":"2020","journal-title":"Behav. Brain Res."},{"key":"jneadae36bib3","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065718500181","article-title":"Control of a 7-DOF robotic arm system with an SSVEP-based BCI","volume":"28","author":"Chen","year":"2018","journal-title":"Int. J. Neural Syst."},{"key":"jneadae36bib4","doi-asserted-by":"publisher","first-page":"3163","DOI":"10.1109\/TNSRE.2023.3299350","article-title":"Shared three-dimensional robotic arm control based on asynchronous BCI and computer vision","volume":"31","author":"Zhou","year":"2023","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"jneadae36bib5","doi-asserted-by":"publisher","first-page":"360","DOI":"10.1109\/TASE.2020.3034826","article-title":"A shared control strategy for reach and grasp of multiple objects using robot vision and noninvasive brain-computer interface","volume":"19","author":"Xu","year":"2022","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"jneadae36bib6","doi-asserted-by":"publisher","first-page":"360","DOI":"10.26599\/TST.2018.9010111","article-title":"Asynchronous brain-computer interface shared control of robotic grasping","volume":"24","author":"Zhang","year":"2019","journal-title":"Tsinghua Sci. Technol."},{"key":"jneadae36bib7","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1186\/s12984-016-0134-9","article-title":"Blending of brain-machine interface and vision-guided autonomous robotics improves neuroprosthetic arm performance during grasping","volume":"13","author":"Downey","year":"2016","journal-title":"J. NeuroEng. Rehabil."},{"key":"jneadae36bib8","doi-asserted-by":"publisher","first-page":"1401","DOI":"10.1007\/s10514-017-9622-4","article-title":"Autonomy infused teleoperation with application to brain computer interface controlled manipulation","volume":"41","author":"Muelling","year":"2017","journal-title":"Auton. Robots"},{"key":"jneadae36bib9","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/S0165-0270(98)00031-4","article-title":"Chronic recording capability of the utah intracortical electrode array in cat sensory cortex","volume":"82","author":"Rousche","year":"1998","journal-title":"J. Neurosci. Methods"},{"key":"jneadae36bib10","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/ac59a0","article-title":"An adaptive closed-loop ECoG decoder for long-term and stable bimanual control of an exoskeleton by a tetraplegic","volume":"19","author":"Moly","year":"2022","journal-title":"J. Neural Eng."},{"key":"jneadae36bib11","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1109\/THMS.2018.2791570","article-title":"A topology of shared control systems-finding common ground in diversity","volume":"48","author":"Abbink","year":"2018","journal-title":"IEEE Trans. Human-Mach. Syst."},{"key":"jneadae36bib12","doi-asserted-by":"crossref","DOI":"10.1146\/annurev-control-061417-041727","article-title":"Autonomy in rehabilitation robotics : an intersection","author":"Argall","year":"2018"},{"key":"jneadae36bib13","first-page":"pp 5434","article-title":"Low complex sensor-based shared control for power wheelchair navigation","volume":"vol 2016","author":"Devigne","year":"2016"},{"key":"jneadae36bib14","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1016\/j.robot.2019.02.014","article-title":"Shared control of a robotic arm using non-invasive brain-computer interface and computer vision guidance","volume":"115","author":"Xu","year":"2019","journal-title":"Robot. Auton. Syst."},{"key":"jneadae36bib15","author":"Jain","year":"2015"},{"key":"jneadae36bib16","first-page":"pp 4462","article-title":"Continuous shared control for robotic arm reaching driven by a hybrid gaze-brain machine interface","author":"Wang","year":"2018"},{"key":"jneadae36bib17","first-page":"pp 572","article-title":"Extending the discrete selection capabilities of the P300 speller to goal-oriented robotic arm control","author":"Johnson","year":"2010"},{"key":"jneadae36bib18","doi-asserted-by":"publisher","first-page":"4351","DOI":"10.3390\/s22124351","article-title":"Development of a vision-guided shared-control system for assistive robotic manipulators","volume":"22","author":"Ding","year":"2022","journal-title":"Sensors"},{"key":"jneadae36bib19","doi-asserted-by":"publisher","first-page":"1164","DOI":"10.1109\/TBME.2006.870235","article-title":"Continuous shared control for stabilizing reaching and grasping with brain-machine interfaces","volume":"53","author":"Kim","year":"2006","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"jneadae36bib20","doi-asserted-by":"publisher","first-page":"139","DOI":"10.18280\/jesa.5501154","article-title":"Shared control of a robot arm using BCI and computer vision","volume":"55","author":"Qasim","year":"2022","journal-title":"J. Eur. des Syst. Automat."},{"key":"jneadae36bib21","first-page":"pp 4132","article-title":"An assistive shared control architecture for a robotic arm using EEG-based BCI with motor imagery","author":"Gillini","year":"2021"},{"key":"jneadae36bib22","doi-asserted-by":"crossref","DOI":"10.15607\/RSS.2015.XI.039","article-title":"Autonomy infused teleoperation with application to BCI manipulation","author":"Muelling","year":"2015"},{"key":"jneadae36bib23","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/abf8cb","article-title":"A brain-actuated robotic arm system using non-invasive hybrid brain-computer interface and shared control strategy","volume":"18","author":"Cao","year":"2021","journal-title":"J. Neural Eng."},{"key":"jneadae36bib24","first-page":"pp 3905","article-title":"Recursive Bayesian human intent recognition in shared-control robotics","author":"Jain","year":"2018"},{"key":"jneadae36bib25","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/aaf594","article-title":"Combination of high-frequency SSVEP-based BCI and computer vision for controlling a robotic arm","volume":"16","author":"Chen","year":"2019","journal-title":"J. Neural Eng."},{"key":"jneadae36bib26","doi-asserted-by":"publisher","first-page":"3822","DOI":"10.1109\/TII.2017.2785415","article-title":"Mind control of a robotic arm with visual fusion technology","volume":"14","author":"Yang","year":"2018","journal-title":"IEEE Trans. Ind. Inf."},{"key":"jneadae36bib27","first-page":"pp 1","article-title":"A shared-control based BCI system: for a robotic arm control","volume":"vol 2018","author":"Tang","year":"2017"},{"key":"jneadae36bib28","first-page":"pp 3252","article-title":"Vision-based robotic manipulation of intelligent wheelchair with human-computer shared control","author":"Du","year":"2021"},{"key":"jneadae36bib29","doi-asserted-by":"publisher","first-page":"188","DOI":"10.1109\/TCDS.2018.2818173","article-title":"Fused fuzzy Petri nets: a shared control method for brain-computer interface systems","volume":"11","author":"Sun","year":"2019","journal-title":"IEEE Trans. Cog. Developmental Syst."},{"key":"jneadae36bib30","doi-asserted-by":"crossref","DOI":"10.1109\/SMC.2014.6974124","article-title":"A collaborative BCI approach to autonomous control of a prosthetic limb system","author":"Katyal","year":"2014"},{"key":"jneadae36bib31","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1109\/LRA.2016.2593928","article-title":"Human-in-the-loop optimization of shared autonomy in assistive robotics","volume":"2","author":"Gopinath","year":"2017","journal-title":"IEEE Robot. Autom. Lett."},{"key":"jneadae36bib32","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1109\/TNSRE.2014.2333541","article-title":"WIMAGINE: wireless 64-channel ECoG recording implant for long term clinical applications","volume":"23","author":"Mestais","year":"2015","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"jneadae36bib33","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/ac2003","article-title":"Long-term stability of the chronic epidural wireless recorder WIMAGINE in tetraplegic patients","volume":"18","author":"Larzabal","year":"2021","journal-title":"J. Neural Eng."},{"key":"jneadae36bib34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-017-16579-9","article-title":"Recursive exponentially weighted N-way partial least squares regression with recursive-validation of hyper-parameters in brain-computer interface applications","volume":"7","author":"Eliseyev","year":"2017","journal-title":"Sci. Rep."},{"key":"jneadae36bib35","doi-asserted-by":"publisher","first-page":"1907","DOI":"10.1080\/17483107.2023.2253339","article-title":"SWADAPT2: benefits of a collision avoidance assistance for powered wheelchair users in driving difficulty","volume":"19","author":"Fraudet","year":"2023","journal-title":"Disability Rehabil. Assist. Technol."},{"key":"jneadae36bib36","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1109\/MRA.2006.250573","article-title":"Visual servo control, part I: basic approaches","volume":"13","author":"Chaumette","year":"2006","journal-title":"IEEE Robot. Autom. Mag."},{"key":"jneadae36bib37","doi-asserted-by":"publisher","first-page":"1112","DOI":"10.1016\/S1474-4422(19)30321-7","article-title":"An exoskeleton controlled by an epidural wireless brain-machine interface in a tetraplegic patient: a proof-of-concept demonstration","volume":"18","author":"Benabid","year":"2019","journal-title":"Lancet Neurol."},{"key":"jneadae36bib38","doi-asserted-by":"publisher","DOI":"10.1016\/j.neulet.2022.136482","article-title":"Mini-review: robotic wheelchair taxonomy and readiness Sivashankar","volume":"772","author":"Sivakanthan","year":"2022","journal-title":"Neursci. Lett."},{"key":"jneadae36bib39","doi-asserted-by":"publisher","first-page":"588","DOI":"10.1109\/TOH.2019.2957801","article-title":"Pre-Calibrated visuo-haptic co-location improves execution in virtual environments","volume":"13","author":"Saint-Aubert","year":"2020","journal-title":"IEEE Trans. Haptics"},{"key":"jneadae36bib40","first-page":"pp 2015","article-title":"Grasp detection for assistive robotic manipulation","volume":"vol 2016","author":"Jain","year":"2016"},{"key":"jneadae36bib41","first-page":"pp 3278","article-title":"A hybrid EEG-based BCI for robot grasp controlling","author":"Zhang","year":"2017"},{"key":"jneadae36bib42","doi-asserted-by":"publisher","first-page":"194","DOI":"10.1007\/s10548-009-0121-6","article-title":"Towards a cure for BCI illiteracy","volume":"23","author":"Vidaurre","year":"2010","journal-title":"Brain Topography"}],"container-title":["Journal of Neural Engineering"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/adae36","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/adae36\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/adae36","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/adae36\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/adae36\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/adae36\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/adae36\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/adae36\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,14]],"date-time":"2025-02-14T13:14:53Z","timestamp":1739538893000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/adae36"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,1]]},"references-count":42,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,2,14]]},"published-print":{"date-parts":[[2025,2,1]]}},"URL":"https:\/\/doi.org\/10.1088\/1741-2552\/adae36","relation":{},"ISSN":["1741-2560","1741-2552"],"issn-type":[{"value":"1741-2560","type":"print"},{"value":"1741-2552","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,1]]},"assertion":[{"value":"Depth-sensor-based shared control assistance for mobility and object manipulation: toward long-term home-use of BCI-controlled assistive robotic devices","name":"article_title","label":"Article Title"},{"value":"Journal of Neural Engineering","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2025 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2024-08-08","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2025-01-24","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2025-02-14","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}