{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,14]],"date-time":"2026-10-14T02:22:48Z","timestamp":1791944568430,"version":"4.3.4"},"reference-count":59,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2025,2,18]],"date-time":"2025-02-18T00:00:00Z","timestamp":1739836800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Research Foundation of Korea (NRF)","award":["RS-2024-00340293"],"award-info":[{"award-number":["RS-2024-00340293"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Biomimetics"],"abstract":"<jats:p>Brain\u2013computer interface (BCI)-based assistive technologies enable intuitive and efficient user interaction, significantly enhancing the independence and quality of life of elderly and disabled individuals. Although existing wet EEG-based systems report high accuracy, they suffer from limited practicality. This study presents a hybrid BCI system combining dry-type EEG-based flash visual-evoked potentials (FVEP) and pupillary light reflex (PLR) designed to control an LED-based meal-assist robot. The hybrid system integrates dry-type EEG and eyewear-type infrared cameras, addressing the preparation challenges of wet electrodes, while maintaining practical usability and high classification performance. Offline experiments demonstrated an average accuracy of 88.59% and an information transfer rate (ITR) of 18.23 bit\/min across the four target classifications. Real-time implementation uses PLR triggers to initiate the meal cycle and EMG triggers to detect chewing, indicating the completion of the cycle. These features allow intuitive and efficient operation of the meal-assist robot. This study advances the BCI-based assistive technologies by introducing a hybrid system optimized for real-world applications. The successful integration of the FVEP and PLR in a meal-assisted robot demonstrates the potential for robust and user-friendly solutions that empower the users with autonomy and dignity in their daily activities.<\/jats:p>","DOI":"10.3390\/biomimetics10020118","type":"journal-article","created":{"date-parts":[[2025,2,18]],"date-time":"2025-02-18T06:41:12Z","timestamp":1739860872000},"page":"118","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Hybrid BCI for Meal-Assist Robot Using Dry-Type EEG and Pupillary Light Reflex"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7671-0162","authenticated-orcid":false,"given":"Jihyeon","family":"Ha","sequence":"first","affiliation":[{"name":"Bionics Research Center, Korea Institute of Science and Technology, Seoul 02792, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sangin","family":"Park","sequence":"additional","affiliation":[{"name":"Next-Generation Mechanical Design Laboratory, Korea University, Seoul 02841, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-6868-6443","authenticated-orcid":false,"given":"Yaeeun","family":"Han","sequence":"additional","affiliation":[{"name":"Bionics Research Center, Korea Institute of Science and Technology, Seoul 02792, Republic of Korea"},{"name":"Department of HY-KIST Bio-Convergence, Hanyang University, Seoul 04763, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5769-1039","authenticated-orcid":false,"given":"Laehyun","family":"Kim","sequence":"additional","affiliation":[{"name":"Bionics Research Center, Korea Institute of Science and Technology, Seoul 02792, Republic of Korea"},{"name":"Department of HY-KIST Bio-Convergence, Hanyang University, Seoul 04763, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,2,18]]},"reference":[{"key":"ref_1","unstructured":"World Health Organization (2024, December 22). Disability and Health. Available online: https:\/\/www.who.int\/health-topics\/disability#tab=tab_1."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1687","DOI":"10.1080\/10447318.2021.2009672","article-title":"Development of a comprehensive design guideline to evaluate the user experiences of meal-assistance robots considering human\u2013machine social interactions","volume":"38","author":"Kim","year":"2022","journal-title":"Int. J. Hum. Comput. Interact."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Rashid, M., Sulaiman, N., P P Abdul Majeed, A., Musa, R.M., Ab Nasir, A.F., Bari, B.S., and Khatun, S. (2020). Current status, challenges, and possible solutions of EEG-based brain\u2013computer interface: A comprehensive review. Front. Neurorobot., 14.","DOI":"10.3389\/fnbot.2020.00025"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1645","DOI":"10.1109\/TCBB.2021.3052811","article-title":"EEG-Based Brain-Computer Interfaces (BCIs): A Survey of Recent Studies on Signal Sensing Technologies and Computational Intelligence Approaches and Their Applications","volume":"18","author":"Gu","year":"2021","journal-title":"IEEE\/ACM Trans. Comput. Biol. Bioinf."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Tao, L., Cao, T., Wang, Q., Liu, D., Bai, O., and Sun, J. (2023). Application of self-adaptive multiple-kernel extreme learning machine to improve MI-BCI performance of subjects with BCI illiteracy. Biomed. Signal Process. Control, 79.","DOI":"10.1016\/j.bspc.2022.104183"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1064","DOI":"10.1109\/TNSRE.2023.3237583","article-title":"Improving performance of motor imagery-based brain\u2013computer interface in poorly performing subjects using a hybrid-imagery method utilizing combined motor and somatosensory activity","volume":"31","author":"Park","year":"2023","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Bai, X., Li, M., Qi, S., Ng, A.C.M., Ng, T., and Qian, W. (2023). A hybrid P300-SSVEP brain\u2013computer interface speller with a frequency enhanced row and column paradigm. Front. Neurosci., 17.","DOI":"10.3389\/fnins.2023.1133933"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"046046","DOI":"10.1088\/1741-2552\/ad658e","article-title":"RSVP-based BCI for inconspicuous targets: Detection, localization, and modulation of attention","volume":"21","author":"Zhou","year":"2024","journal-title":"J. Neural Eng."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Mai, X., Ai, J., Ji, M., Zhu, X., and Meng, J. (2024). A hybrid BCI combining SSVEP and EOG and its application for continuous wheelchair control. Biomed. Signal Process. Control, 88.","DOI":"10.1016\/j.bspc.2023.105530"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"544","DOI":"10.1109\/TNSRE.2022.3228124","article-title":"Brain-controlled, AR-based Home automation system using SSVEP-based brain\u2013computer interface and EOG-based eye tracker: A feasibility study for the elderly end User","volume":"31","author":"Park","year":"2022","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"605","DOI":"10.1016\/j.clinph.2007.11.013","article-title":"Brain computer interface using flash onset and offset visual evoked potentials","volume":"119","author":"Lee","year":"2008","journal-title":"Clin. Neurophysiol."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Ha, J., Park, S., Im, C.-H., and Kim, L. (2021). A hybrid brain\u2013computer interface for real-life meal-assist robot control. Sensors, 21.","DOI":"10.3390\/s21134578"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Mounesi Rad, S., and Danishvar, S. (2024). Emotion recognition using EEG signals through the design of a dry electrode based on the combination of Type 2 fuzzy sets and deep convolutional graph networks. Biomimetics, 9.","DOI":"10.3390\/biomimetics9090562"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"026017","DOI":"10.1088\/1741-2552\/acc098","article-title":"Polyvinyl alcohol\/polyacrylamide double-network hydrogel-based semi-dry electrodes for robust electroencephalography recording at hairy scalp for noninvasive brain\u2013computer interfaces","volume":"20","author":"Li","year":"2023","journal-title":"J. Neural Eng."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"235684","DOI":"10.1016\/j.jpowsour.2024.235684","article-title":"Dispersed carbon nanotube paper tape loaded poly (3,4-ethylenedioxythiophene) for flexible supercapacitors with significantly enhanced energy storage performance and deformation durability","volume":"625","author":"Zhou","year":"2025","journal-title":"J. Power Sources"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Mannan, M.M., Kamran, M.A., Kang, S., Choi, H.S., and Jeong, M.Y. (2020). A Hybrid Speller Design Using Eye Tracking and SSVEP Brain-Computer Interface. Sensors, 20.","DOI":"10.3390\/s20030891"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"100246","DOI":"10.1016\/j.ifacsc.2024.100246","article-title":"Designing light stimulation for a pupillary\u2013computer interface using binary code","volume":"27","author":"Nakatani","year":"2024","journal-title":"IFAC J. Syst. Control"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Muto, Y., Miyoshi, H., and Kaneko, H. (2020). Eye-gaze information input based on pupillary response to visual stimulus with luminance modulation. PLoS ONE, 15.","DOI":"10.1371\/journal.pone.0226991"},{"key":"ref_19","unstructured":"Kothe, C., Medine, D., and Grivich, M. (2024, December 23). Lab Streaming Layer 2014. Available online: https:\/\/github.com\/labstreaminglayer\/pylsl."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"226","DOI":"10.1016\/j.neucom.2017.03.082","article-title":"The extension of multivariate synchronization index method for SSVEP-based BCI","volume":"269","author":"Zhang","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Kassner, M., Patera, W., and Bulling, A. (2014, January 13\u201317). Pupil: An open source platform for pervasive eye tracking and mobile gaze-based interaction. Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Seattle, WA, USA.","DOI":"10.1145\/2638728.2641695"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Swirski, L., Bulling, A., and Dodgson, N. (2012, January 28\u201330). Robust real-time pupil tracking in highly off-axis images. Proceedings of the Symposium on Eye Tracking Research and Applications, ACM 2012, Santa Barbara, CA, USA.","DOI":"10.1145\/2168556.2168585"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"667","DOI":"10.1109\/ACCESS.2022.3232729","article-title":"Applications of the generalized Morse wavelets: A review","volume":"11","year":"2023","journal-title":"IEEE Access"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Ismail, A.R., Jovanovic, S., Ramzan, N., and Rabah, H. (2023). Ecg classification using an optimal temporal convolutional network for remote health monitoring. Sensors, 23.","DOI":"10.3390\/s23031697"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Abe, M., Miyao, J., and Kurita, T. (2020, January 19\u201324). Adaptive neuron-wise discriminant criterion and adaptive center loss at hidden layer for deep convolutional neural network. Proceedings of the International Joint Conference on Neural Networks (IJCNN), Glasgow, UK.","DOI":"10.1109\/IJCNN48605.2020.9206697"},{"key":"ref_26","first-page":"1502","article-title":"SVM parameter optimization using grid search and genetic algorithm to improve classification performance","volume":"14","author":"Syarif","year":"2016","journal-title":"Telecommun. Comput. Electron. Control"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2855","DOI":"10.1016\/j.mex.2019.11.008","article-title":"Repeated holdout validation for weighted quantile sum regression","volume":"6","author":"Tanner","year":"2019","journal-title":"MethodsX"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3735","DOI":"10.1016\/j.csda.2009.04.009","article-title":"Estimating classification error rate: Repeated cross-validation, repeated hold-out and bootstrap","volume":"53","author":"Kim","year":"2009","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1007\/s12021-020-09473-9","article-title":"Review of Riemannian distances and divergences, applied to SSVEP-based BCI","volume":"19","author":"Chevallier","year":"2021","journal-title":"Neuroinformatics"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/j.brainresbull.2005.11.003","article-title":"A direct demonstration of cortical LTP in humans: A combined TMS\/EEG study","volume":"69","author":"Esser","year":"2006","journal-title":"Brain Res. Bull."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13408-020-00100-0","article-title":"Noisy network attractor models for transitions between EEG microstates","volume":"11","author":"Creaser","year":"2021","journal-title":"J. Math. Neurosci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1109\/TNSRE.2019.2893113","article-title":"The Riemannian potato field: A tool for online signal quality index of EEG","volume":"27","author":"Mayaud","year":"2019","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"735","DOI":"10.1137\/S0895479803436937","article-title":"A differential geometric approach to the geometric mean of symmetric positive-definite matrices","volume":"26","author":"Moakher","year":"2005","journal-title":"SIAM J. Matrix Anal. Appl."},{"key":"ref_34","unstructured":"(2024, December 24). NT Robot. Available online: http:\/\/www.ntrobot.net\/shop_contents\/myboard_read.htm?load_type=&page_idx=0&tag_on=&h_search_c=0&h_search_v=&me_popup=&myboard_code=product&page_limit=12&idx=46206&page=1&category_idx=."},{"key":"ref_35","first-page":"32","article-title":"A new method for non-parametric multivariate analysis of variance","volume":"26","author":"Anderson","year":"2001","journal-title":"Austral Ecol."},{"key":"ref_36","unstructured":"Anderson, M.J. (2014). Permutational multivariate analysis of variance (PERMANOVA). Wiley Statsref: Statistics Reference Online, Wiley Online Library."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1080\/2326263X.2017.1297192","article-title":"Riemannian geometry for EEG-based brain\u2013computer interfaces; A primer and a review","volume":"4","author":"Congedo","year":"2017","journal-title":"Brain Comput. Interfaces"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"109751","DOI":"10.1016\/j.patcog.2023.109751","article-title":"A discriminative SPD feature learning approach on Riemannian manifolds for EEG classification","volume":"143","author":"Kim","year":"2023","journal-title":"Pattern Recognit."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1007\/s10548-020-00780-7","article-title":"EEG electric field topography is stable during moments of high field strength","volume":"33","author":"Zanesco","year":"2020","journal-title":"Brain Topogr."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"920","DOI":"10.1109\/TBME.2011.2172210","article-title":"Multiclass brain\u2013computer interface classification by Riemannian geometry","volume":"59","author":"Barachant","year":"2012","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Saifutdinova, E., Congedo, M., Dudysova, D., Lhotska, L., Koprivova, J., and Gerla, V. (2019). An unsupervised multichannel artifact detection method for sleep EEG based on Riemannian geometry. Sensors, 19.","DOI":"10.3390\/s19030602"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1016\/j.eswa.2017.11.007","article-title":"A multi-class EEG-based BCI classification using multivariate empirical mode decomposition based filtering and Riemannian geometry","volume":"95","author":"Gaur","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"34415","DOI":"10.1039\/D4RA05560H","article-title":"A flexible, stable, semi-dry electrode with low impedance for electroencephalography recording","volume":"14","author":"Zhu","year":"2024","journal-title":"RSC Adv."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"12862","DOI":"10.1039\/D4TC00574K","article-title":"Wearable gold\u2013graphene dry electrode-based headband for effective brain\u2013computer interface applications","volume":"12","author":"Zheng","year":"2024","journal-title":"J. Mater. Chem. C"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Sheeraz, M., Saadeh, W., and Altaf, M.A.B. (2023, January 21\u201325). A wearable EEG acquisition device with flexible silver ink screen printed dry sensors. Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS), Monterey, CA, USA.","DOI":"10.1109\/ISCAS46773.2023.10181812"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Hossain, K.M., Islam, M.A., Hossain, S., Nijholt, A., and Ahad, M.A.R. (2022). Status of deep learning for EEG-based brain\u2013computer interface applications. Front. Comput. Neurosci., 16.","DOI":"10.3389\/fncom.2022.1006763"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1016\/j.cnp.2023.04.002","article-title":"High performance clean versus artifact dry electrode EEG data classification using Convolutional Neural Network transfer learning","volume":"8","author":"Groenendijk","year":"2023","journal-title":"Clin. Neurophysiol. Pract."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1433","DOI":"10.1007\/s13534-024-00416-w","article-title":"Evaluation of consumer-grade wireless EEG systems for brain\u2013computer interface applications","volume":"14","author":"Lee","year":"2024","journal-title":"Biomed. Eng. Lett."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Perera, C.J., Naotunna, I., Sadaruwan, C., Gopura, R.A.R.C., and Lalitharatne, T.D. (2016, January 9\u201312). SSVEP based BMI for a meal assistance robot. Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics (SMC), Budapest, Hungary.","DOI":"10.1109\/SMC.2016.7844580"},{"key":"ref_50","unstructured":"Perera, C.J., Lalitharatne, T.D., and Kiguchi, K. (June, January 29). EEG-controlled meal assistance robot with camera-based automatic mouth position tracking and mouth open detection. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Singapore."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"056013","DOI":"10.1088\/1741-2552\/aace8c","article-title":"EEGNet: A compact convolutional neural network for EEG-based brain\u2013computer interfaces","volume":"15","author":"Lawhern","year":"2018","journal-title":"J. Neural Eng."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"5391","DOI":"10.1002\/hbm.23730","article-title":"Deep learning with convolutional neural networks for EEG decoding and visualization","volume":"38","author":"Schirrmeister","year":"2017","journal-title":"Hum. Brain Mapp."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"051001","DOI":"10.1088\/1741-2552\/ab260c","article-title":"Deep learning-based electroencephalography analysis: A systematic review","volume":"16","author":"Roy","year":"2019","journal-title":"J. Neural Eng."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Park, S., and Whang, M. (2018). Infrared camera-based non-contact measurement of brain activity from pupillary rhythms. Front. Physiol., 9.","DOI":"10.3389\/fphys.2018.01400"},{"key":"ref_55","unstructured":"Petersen, P. (2006). Riemannian Geometry, Springer."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Xu, J., Markham, A., Meunier, A., Raggam, P., and Grosse-Wentrup, M. (2021, January 17\u201320). Distance covariance: A nonlinear extension of Riemannian geometry for EEG-based brain-computer interfacing. Proceedings of the 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Melbourne, Australia.","DOI":"10.1109\/SMC52423.2021.9658876"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"2988","DOI":"10.3390\/e17052988","article-title":"Log-determinant divergences revisited: Alpha-beta and gamma log-det divergences","volume":"17","author":"Cichocki","year":"2015","journal-title":"Entropy"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"066030","DOI":"10.1088\/1741-2552\/aca4fc","article-title":"Revisiting Riemannian geome-try-based EEG decoding through approximate joint diagonalization","volume":"19","author":"Kalaganis","year":"2022","journal-title":"J. Neural Eng."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1006\/brln.1998.2024","article-title":"Wavelet analysis of neuroelectric waveforms: A conceptual tutorial","volume":"66","author":"Samar","year":"1999","journal-title":"Brain Lang."}],"container-title":["Biomimetics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-7673\/10\/2\/118\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:36:47Z","timestamp":1760027807000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-7673\/10\/2\/118"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,18]]},"references-count":59,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2025,2]]}},"alternative-id":["biomimetics10020118"],"URL":"https:\/\/doi.org\/10.3390\/biomimetics10020118","relation":{},"ISSN":["2313-7673"],"issn-type":[{"value":"2313-7673","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,18]]}}}