{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,17]],"date-time":"2026-10-17T00:10:26Z","timestamp":1792195826664,"version":"4.4.0"},"reference-count":34,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,12,19]],"date-time":"2023-12-19T00:00:00Z","timestamp":1702944000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neurorobot."],"abstract":"<jats:p>This paper presents a teleoperation system of robot grasping for undefined objects based on a real-time EEG (Electroencephalography) measurement and shared autonomy. When grasping an undefined object in an unstructured environment, real-time human decision is necessary since fully autonomous grasping may not handle uncertain situations. The proposed system allows involvement of a wide range of human decisions throughout the entire grasping procedure, including 3D movement of the gripper, selecting proper grasping posture, and adjusting the amount of grip force. These multiple decision-making procedures of the human operator have been implemented with six flickering blocks for steady-state visually evoked potentials (SSVEP) by dividing the grasping task into predefined substeps. Each substep consists of approaching the object, selecting posture and grip force, grasping, transporting to the desired position, and releasing. The graphical user interface (GUI) displays the current substep and simple symbols beside each flickering block for quick understanding. The tele-grasping of various objects by using real-time human decisions of selecting among four possible postures and three levels of grip force has been demonstrated. This system can be adapted to other sequential EEG-controlled teleoperation tasks that require complex human decisions.<\/jats:p>","DOI":"10.3389\/fnbot.2023.1293878","type":"journal-article","created":{"date-parts":[[2023,12,19]],"date-time":"2023-12-19T10:58:04Z","timestamp":1702983484000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["EEG-controlled tele-grasping for undefined objects"],"prefix":"10.3389","volume":"17","author":[{"given":"Minki","family":"Kim","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Myoung-Su","family":"Choi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ga-Ram","family":"Jang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ji-Hun","family":"Bae","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hyung-Soon","family":"Park","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2023,12,19]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"539","DOI":"10.1007\/s11370-020-00328-5","article-title":"Comprehensive review on brain-controlled mobile robots and robotic arms based on electroencephalography signals","volume":"13","author":"Aljalal","year":"2020","journal-title":"Intell. Serv. Robot"},{"key":"B2","first-page":"3798","article-title":"\u201cA grasp strategy with the geometric centroid of a groped object shape derived from contact spots,\u201d","volume-title":"Proceedings of the IEEE International Conference on Robotics and Automation","author":"Bae","year":"2012"},{"key":"B3","doi-asserted-by":"publisher","first-page":"6446","DOI":"10.1126\/science.aat8414","article-title":"Trends and challenges in robot manipulation","volume":"364","author":"Billard","year":"2019","journal-title":"Science"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/abf8cb","article-title":"A brain-actuated robotic arm system using non-invasive hybrid brain-computer interface and shared control strategy","author":"Cao","year":"2021","journal-title":"J. Neural Eng"},{"key":"B5","first-page":"6402","article-title":"Non invasive brain-machine interfaces","volume":"5","author":"Carpi","year":"2006","journal-title":"ESA Ariadna Study"},{"key":"B6","doi-asserted-by":"publisher","first-page":"026012","DOI":"10.1088\/1741-2552\/aaf594","article-title":"Combination of high-frequency SSVEP-based bci and computer vision for controlling a robotic arm","volume":"16","author":"Chen","year":"2019","journal-title":"J. Neural Eng"},{"key":"B7","doi-asserted-by":"publisher","first-page":"1850018","DOI":"10.1142\/S0129065718500181","article-title":"Control of a 7-dof robotic arm system with an SSVEP-based BCI","volume":"28","author":"Chen","year":"2018","journal-title":"Int. J. Neural Syst"},{"key":"B8","doi-asserted-by":"publisher","first-page":"328","DOI":"10.1109\/TNSRE.2019.2958076","article-title":"A Bayesian shared control approach for wheelchair robot with brain machine interface","volume":"28","author":"Deng","year":"2020","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng"},{"key":"B9","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1743-0003-8-39","article-title":"Asynchronous BCI control using high-frequency SSVEP","volume":"8","author":"Diez","year":"2011","journal-title":"J. Neuroeng. Rehabil"},{"key":"B10","doi-asserted-by":"publisher","first-page":"1146415","DOI":"10.3389\/fnbot.2023.1146415","article-title":"A robotic arm control system with simultaneous and sequential modes combining eye-tracking with steady-state visual evoked potential in virtual reality environment","volume":"17","author":"Guo","year":"2023","journal-title":"Front. Neurorobot"},{"key":"B11","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1016\/j.jneumeth.2018.06.003","article-title":"Periodic component analysis as a spatial filter for SSVEP-based brain-computer interface","volume":"307","author":"Kumar","year":"2018","journal-title":"J. Neurosci. Methods"},{"key":"B12","doi-asserted-by":"publisher","first-page":"95126","DOI":"10.1063\/1.4991996","article-title":"Fast grasping of unknown objects using principal component analysis","volume":"7","author":"Lei","year":"2017","journal-title":"AIP Adv."},{"key":"B13","doi-asserted-by":"publisher","first-page":"021001","DOI":"10.1115\/1.4051596","article-title":"SSVEP-based brain-computer interface for part-picking robotic co-worker","volume":"22","author":"Li","year":"2022","journal-title":"J. Comput. Inform. Sci. Eng"},{"key":"B14","doi-asserted-by":"publisher","first-page":"103523","DOI":"10.1016\/j.autcon.2020.103523","article-title":"Brain-computer interface for hands-free teleoperation of construction robots","volume":"123","author":"Liu","year":"2021","journal-title":"Autom. Construct"},{"key":"B15","doi-asserted-by":"publisher","first-page":"38565","DOI":"10.1038\/srep38565","article-title":"Noninvasive electroencephalogram based control of a robotic arm for reach and grasp tasks","volume":"6","author":"Meng","year":"2016","journal-title":"Sci. Rep"},{"key":"B16","doi-asserted-by":"publisher","first-page":"3994","DOI":"10.1109\/TRO.2023.3280597","article-title":"Deep learning approaches to grasp synthesis: a review","volume":"39","author":"Newbury","year":"2023","journal-title":"IEEE Trans. Robot"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-32552-1_43","article-title":"\u201cTelerobotics,\u201d","author":"Niemeyer","year":"2016"},{"key":"B18","doi-asserted-by":"publisher","first-page":"855825","DOI":"10.3389\/fnbot.2022.855825","article-title":"Control of a robotic arm with an optimized common template-based CCA method for SSVEP-based BCI","volume":"16","author":"Peng","year":"2022","journal-title":"Front. Neurorobot"},{"key":"B19","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1109\/TFUZZ.2016.2566676","article-title":"Brain-machine interface and visual compressive sensing-based teleoperation control of an exoskeleton robot","volume":"25","author":"Qiu","year":"2016","journal-title":"IEEE Trans. Fuzzy Syst"},{"key":"B20","doi-asserted-by":"publisher","first-page":"5000","DOI":"10.3390\/s22135000","article-title":"Cross-platform implementation of an SSVEP-based BCI for the control of a 6-dof robotic arm","volume":"22","author":"Quiles","year":"2022","journal-title":"Sensors"},{"key":"B21","doi-asserted-by":"publisher","first-page":"100354","DOI":"10.1016\/j.cobme.2021.100354","article-title":"Emerging trends in bci-robotics for motor control and rehabilitation","volume":"20","author":"Robinson","year":"2021","journal-title":"Curr. Opin. Biomed. Eng"},{"key":"B22","first-page":"440","article-title":"\u201cEEG based motor imagery study of time domain features for classification of power and precision hand grasps,\u201d","volume-title":"8th International IEEE EMBS Neural Engineering Conference","author":"Roy","year":"2017"},{"key":"B23","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1109\/SSCI44817.2019.9003022","article-title":"\u201cA method for SSVEP recognition based on weighted canonical correlation analysis,\u201d","volume-title":"2019 IEEE Symposium Series on Computational Intelligence (SSCI)","author":"Shi","year":"2019"},{"key":"B24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1049\/ccs2.12005","article-title":"A review on manipulation skill acquisition through teleoperation-based learning from demonstration","volume":"3","author":"Si","year":"2021","journal-title":"Cogn. Comput. Syst"},{"key":"B25","doi-asserted-by":"publisher","first-page":"5871","DOI":"10.3390\/s21175871","article-title":"A wearable IMU system for flexible teleoperation of a collaborative industrial robot","volume":"21","author":"\u0160kulj","year":"2021","journal-title":"Sensors"},{"key":"B26","doi-asserted-by":"publisher","first-page":"1097","DOI":"10.1109\/TNSRE.2013.2290870","article-title":"Spatial filtering based on canonical correlation analysis for classification of evoked or event-related potentials in EEG data","volume":"22","author":"Sp\u00fcler","year":"2013","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng"},{"key":"B27","doi-asserted-by":"publisher","first-page":"874","DOI":"10.1109\/LRA.2021.3129134","article-title":"Research challenges and progress in robotic grasping and manipulation competitions","volume":"7","author":"Sun","year":"2021","journal-title":"IEEE Robot. Autom. Lett"},{"key":"B28","doi-asserted-by":"publisher","first-page":"618","DOI":"10.3390\/math10040618","article-title":"Continuous hybrid bci control for robotic arm using noninvasive electroencephalogram, computer vision, and eye tracking","volume":"10","author":"Xu","year":"2022","journal-title":"Mathematics"},{"key":"B29","doi-asserted-by":"publisher","first-page":"360","DOI":"10.1109\/TASE.2020.3034826","article-title":"A shared control strategy for reach and grasp of multiple objects using robot vision and noninvasive brain-computer interface","volume":"19","author":"Xu","year":"2022","journal-title":"IEEE Trans. Autom. Sci. Eng"},{"key":"B30","doi-asserted-by":"publisher","first-page":"3822","DOI":"10.1109\/TII.2017.2785415","article-title":"Mind control of a robotic arm with visual fusion technology","volume":"14","author":"Yang","year":"2017","journal-title":"IEEE Trans. Indus. Inform"},{"key":"B31","doi-asserted-by":"publisher","first-page":"e0142168","DOI":"10.1371\/journal.pone.0142168","article-title":"Comparative study of SSVEP-and P300-based models for the telepresence control of humanoid robots","volume":"10","author":"Zhao","year":"2015","journal-title":"PLoS ONE"},{"key":"B32","doi-asserted-by":"publisher","first-page":"5161","DOI":"10.1109\/TIE.2016.2606089","article-title":"Brain-machine interfacing-based teleoperation of multiple coordinated mobile robots","volume":"64","author":"Zhao","year":"2017","journal-title":"IEEE Trans. Indus. Electron"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1109\/TNSRE.2023.3299350","article-title":"Shared three-dimensional robotic arm control based on asynchronous BCI and computer vision","author":"Zhou","year":"2023","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng"},{"key":"B34","doi-asserted-by":"publisher","first-page":"583641","DOI":"10.3389\/fnbot.2020.583641","article-title":"A hybrid BCI based on SSVEP and EOG for robotic arm control","volume":"14","author":"Zhu","year":"2020","journal-title":"Front. Neurorobot"}],"container-title":["Frontiers in Neurorobotics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2023.1293878\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,19]],"date-time":"2023-12-19T10:58:10Z","timestamp":1702983490000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2023.1293878\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,19]]},"references-count":34,"alternative-id":["10.3389\/fnbot.2023.1293878"],"URL":"https:\/\/doi.org\/10.3389\/fnbot.2023.1293878","relation":{},"ISSN":["1662-5218"],"issn-type":[{"value":"1662-5218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,19]]},"article-number":"1293878"}}