{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T01:41:01Z","timestamp":1784166061204,"version":"3.55.0"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2022,9,6]],"date-time":"2022-09-06T00:00:00Z","timestamp":1662422400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2019YFB1405703"],"award-info":[{"award-number":["2019YFB1405703"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61972145"],"award-info":[{"award-number":["61972145"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2022,9,6]]},"abstract":"<jats:p>With the recent advancements of electroencephalograph (EEG) techniques, some brain-computer interface (BCI) solutions have been explored to assist individuals performing various tasks with their minds. One promising application is to combine BCI with robotic systems so that the mobility-impaired people can control robots to take care of themselves. Towards this ultimate goal to design BCIs for mobility-impaired, we firstly conducted an online survey with 54 mobility-impaired participants who barely had previous experience with BCI to identify the challenges they face in life for the purpose of designing a personalized BCI system in need. The results revealed these challenges including small daily tasks (such as feeding and cleaning), which weigh on the financial burdens of hiring a caregiver. Meanwhile, the off-the-shelf high-fidelity BCIs are often expensive, whereas the cheaper devices only collect coarse-grained signals, preventing practical application in care aids due to lack of temporal resolution and accuracy. Based on the survey findings, we then designed DeepBrain, a human-centered learning augmented BCI system, that requires only coarse-grained brain signals with low-cost BCI equipment, but supports fine-grained brain-robot interaction and scalable multi-robot collaboration for domestic multi-task operations. A follow-up system comparison with other approaches show that the proposed human-centered solution is a promising step towards the ultimate goal, as it achieves satisfactory accuracy with less low computation resources. Also the practical brain to multi-robot interaction system validates the feasibility of our framework and model used in DeepBrain.<\/jats:p>","DOI":"10.1145\/3550334","type":"journal-article","created":{"date-parts":[[2022,9,7]],"date-time":"2022-09-07T14:54:27Z","timestamp":1662562467000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["DeepBrain"],"prefix":"10.1145","volume":"6","author":[{"given":"Di","family":"Wu","sequence":"first","affiliation":[{"name":"Key Laboratory for Embedded and Network Computing of Hunan Province, Hunan University, Changsha, Hunan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinhui","family":"Ouyang","sequence":"additional","affiliation":[{"name":"Key Laboratory for Embedded and Network Computing of Hunan Province, Hunan University, Changsha, Hunan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ningyi","family":"Dai","sequence":"additional","affiliation":[{"name":"Key Laboratory for Embedded and Network Computing of Hunan Province, Hunan University, Changsha, Hunan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mingzhu","family":"Wu","sequence":"additional","affiliation":[{"name":"Key Laboratory for Embedded and Network Computing of Hunan Province, Hunan University, Changsha, Hunan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haodan","family":"Tan","sequence":"additional","affiliation":[{"name":"Amazon, Toronto, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hanhui","family":"Deng","sequence":"additional","affiliation":[{"name":"School of Design, Hunan University, Changsha, Hunan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yongmei","family":"Fan","sequence":"additional","affiliation":[{"name":"People's Hospital of Hunan Province, Changsha, Hunan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dakuo","family":"Wang","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, Massachusetts, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhanpeng","family":"Jin","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, University at Buffalo, Buffalo, New York, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,9,7]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"2021. Brainlink. http:\/\/o.macrotellect.com\/index.html"},{"key":"e_1_2_2_2_1","unstructured":"2021. EMOTIV. https:\/\/www.emotiv.com\/"},{"key":"e_1_2_2_3_1","doi-asserted-by":"crossref","unstructured":"Ali Akbari and Roozbeh Jafari. 2019. Transferring activity recognition models for new wearable sensors with deep generative domain adaptation. In IPSN. 85--96.","DOI":"10.1145\/3302506.3310391"},{"key":"e_1_2_2_4_1","volume-title":"Seung Moo Han, and Tae-Seong Kim","author":"Akram Faraz","year":"2015","unstructured":"Faraz Akram, Seung Moo Han, and Tae-Seong Kim. 2015. An efficient word typing P300-BCI system using a modified T9 interface and random forest classifier. Computers in biology and medicine 56 (2015), 30--36."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.5626\/JCSE.2013.7.2.139"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12984-021-00820-8"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CBS46900.2019.9114484"},{"key":"e_1_2_2_8_1","volume-title":"Rhythms of the Brain","author":"Buzsaki Gyorgy","unstructured":"Gyorgy Buzsaki. 2006. Rhythms of the Brain. Oxford university press."},{"key":"e_1_2_2_9_1","volume-title":"Gregory P Hunter, Yvonne Tran, and Hung T Nguyen.","author":"Chai Rifai","year":"2013","unstructured":"Rifai Chai, Sai Ho Ling, Gregory P Hunter, Yvonne Tran, and Hung T Nguyen. 2013. Brain-computer interface classifier for wheelchair commands using neural network with fuzzy particle swarm optimization. IEEE journal of biomedical and health informatics 18, 5 (2013), 1614--1624."},{"key":"e_1_2_2_10_1","volume-title":"Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges, and Opportunities. ACM Computer Surveys 54, 4","author":"Chen Kaixuan","year":"2021","unstructured":"Kaixuan Chen, Dalin Zhang, Lina Yao, Bin Guo, Zhiwen Yu, and Yunhao Liu. 2021. Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges, and Opportunities. ACM Computer Surveys 54, 4 (2021), 77:1-77:40."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.3233\/JIN-170017"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.clinph.2015.04.098"},{"key":"e_1_2_2_13_1","volume-title":"AAAI (2007)","author":"Esmaeili Maryam","year":"2007","unstructured":"Maryam Esmaeili. 2007. Classifiers fusion for EEG signals processing in human-computer interface systems. AAAI (2007), 1856--1857."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998215"},{"key":"e_1_2_2_15_1","unstructured":"Chelsea Finn Pieter Abbeel and Sergey Levine. 2017. Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks. In ICML. 1126--1135."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.2014.2313317"},{"key":"e_1_2_2_17_1","first-page":"1","article-title":"Domain-Adversarial Training of Neural Networks","volume":"17","author":"Ganin Yaroslav","year":"2016","unstructured":"Yaroslav Ganin, Evgeniya Ustinova, Hana Ajakan, Pascal Germain, Hugo Larochelle, Fran\u00e7ois Laviolette, Mario March, and Victor Lempitsky. 2016. Domain-Adversarial Training of Neural Networks. Journal of Machine Learning Research 17, 59 (2016), 1--35.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2005.06.042"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2014.2347318"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/SMC42975.2020.9283028"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2014.2339834"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2560\/10\/4\/046003"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/aace8c"},{"key":"e_1_2_2_24_1","volume-title":"ACPR 2021 (Lecture Notes in Computer Science","volume":"334","author":"Lee Pilhyeon","year":"2021","unstructured":"Pilhyeon Lee, Sunhee Hwang, Seogkyu Jeon, and Hyeran Byun. 2021. Subject Adaptive EEG-Based Visual Recognition. In Pattern Recognition - 6th Asian Conference, ACPR 2021 (Lecture Notes in Computer Science, Vol. 13189). Springer, 322--334."},{"key":"e_1_2_2_25_1","doi-asserted-by":"crossref","unstructured":"Manman Li Yuhang Yang Ling Pang Maochun Wu Zequan Wang Yinan Fu and Kun Li. 2019. Gender-specific associations between activities of daily living disability and depressive symptoms among older adults in China: Evidence from the China Health and Retirement Longitudinal Study. Archives of psychiatric nursing 33 6 (2019) 160--166.","DOI":"10.1016\/j.apnu.2019.08.010"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCDS.2017.2766258"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-015-2717-z"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2016.7487227"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414117"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNSRE.2019.2897323"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.2340\/16501977-2229"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cobme.2017.11.004"},{"key":"e_1_2_2_33_1","volume-title":"Murahari and Thomas Pl\u00f6tz","author":"Vishvak","year":"2018","unstructured":"Vishvak S. Murahari and Thomas Pl\u00f6tz. 2018. On attention models for human activity recognition. In ACM ISWC. 100--103."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2018.2830647"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TISHW.2016.7847792"},{"key":"e_1_2_2_36_1","volume-title":"Towards Understanding the Effectiveness of MAML. In 8th International Conference on Learning Representations, ICLR. 1--21","author":"Raghu Aniruddh","year":"2020","unstructured":"Aniruddh Raghu, Maithra Raghu, Samy Bengio, and Oriol Vinyals. 2020. Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML. In 8th International Conference on Learning Representations, ICLR. 1--21."},{"key":"e_1_2_2_37_1","volume-title":"Comparison of Medical and Consumer Wireless EEG Systems for Use in Clinical Trials. Frontiers in Human Neuroscience 11","author":"Ratti Elena","year":"2017","unstructured":"Elena Ratti, Shani Waninger, Chris Berka, Giulio Ruffini, and Ajay Verma. 2017. Comparison of Medical and Consumer Wireless EEG Systems for Use in Clinical Trials. Frontiers in Human Neuroscience 11 (2017)."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neulet.2004.02.066"},{"key":"e_1_2_2_39_1","volume-title":"Lukas Dominique Josef Fiederer, Martin Glasstetter, Katharina Eggensperger, Michael Tangermann, Frank Hutter, Wolfram Burgard, and Tonio Ball.","author":"Schirrmeister Robin Tibor","year":"2017","unstructured":"Robin Tibor Schirrmeister, Jost Tobias Springenberg, Lukas Dominique Josef Fiederer, Martin Glasstetter, Katharina Eggensperger, Michael Tangermann, Frank Hutter, Wolfram Burgard, and Tonio Ball. 2017. Deep learning with convolutional neural networks for EEG decoding and visualization. Human brain mapping 38, 11 (2017), 5391--5420."},{"key":"e_1_2_2_40_1","volume-title":"Nipi Paul, Nabila Khan, Mohammad Saifur Rahman, Md Munirul Haque, and A. B. M. Alim Al Islam.","author":"Shahid Farhana","year":"2019","unstructured":"Farhana Shahid, Wasifur Rahman, Anika Binte Islam, Nipi Paul, Nabila Khan, Mohammad Saifur Rahman, Md Munirul Haque, and A. B. M. Alim Al Islam. 2019. Two Tell-Tale Perspectives of PTSD: Neurobiological Abnormalities and Bayesian Regulatory Network of the Underlying Disorder in a Refugee Context. ACM IMWUT (UbiComp) 3, 3 (2019), 101:1-101:45."},{"key":"e_1_2_2_41_1","volume-title":"Alex Wong Tat Hang, and Pan Hui","author":"Shatilov Kirill A.","year":"2019","unstructured":"Kirill A. Shatilov, Dimitris Chatzopoulos, Alex Wong Tat Hang, and Pan Hui. 2019. Using Deep Learning and Mobile Offloading to Control a 3D-Printed Prosthetic Hand. ACM IMWUT (UbiComp) 3, 3 (2019), 102:1-102:19."},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.mayocp.2011.12.008"},{"key":"e_1_2_2_43_1","volume-title":"Human-Machine Interaction in Intelligent and Connected Vehicles: A Review of Status Quo, Issues and Opportunities","author":"Tan Zhengyu","year":"2021","unstructured":"Zhengyu Tan, Ningyi Dai, Yating Su, Ruifo Zhang, Yijun Li, Di Wu, and Shutao Li. 2021. Human-Machine Interaction in Intelligent and Connected Vehicles: A Review of Status Quo, Issues and Opportunities. IEEE Transactions on Intelligent Transportation Systems (2021), 1--22."},{"key":"e_1_2_2_44_1","volume-title":"Qualitative research methods: Collecting evidence, crafting analysis, communicating impact","author":"Tracy Sarah J","unstructured":"Sarah J Tracy. 2019. Qualitative research methods: Collecting evidence, crafting analysis, communicating impact. John Wiley & Sons."},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1080\/2326263X.2017.1366237"},{"key":"e_1_2_2_46_1","volume-title":"Attention is all you need. Advances in neural information processing systems 30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems 30 (2017), 5998--6008."},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.promfg.2015.07.296"},{"key":"e_1_2_2_48_1","first-page":"1","article-title":"AutoDS: Towards Human-Centered Automation of Data Science","volume":"79","author":"Wang Dakuo","year":"2021","unstructured":"Dakuo Wang, Josh Andres, Justin D. Weisz, Erick Oduor, and Casey Dugan. 2021. AutoDS: Towards Human-Centered Automation of Data Science. In CHI. 79:1-79:12.","journal-title":"CHI."},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449083"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/aae5d8"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2019.2954872"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2019.2952917"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2021.3075468"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2021.3071210"},{"key":"e_1_2_2_55_1","volume-title":"Towards Real-time Cooperative Deep Inference over the Cloud and Edge End Devices. ACM IMWUT (UbiComp) 4, 2","author":"Zhang Shigeng","year":"2020","unstructured":"Shigeng Zhang, Yinggang Li, Xuan Liu, Song Guo, Weiping Wang, Jianxin Wang, Bo Ding, and Di Wu. 2020. Towards Real-time Cooperative Deep Inference over the Cloud and Edge End Devices. ACM IMWUT (UbiComp) 4, 2 (2020), 69:1-69:24."},{"key":"e_1_2_2_56_1","volume-title":"Plug-and-Play Domain Adaptation for Cross-Subject EEG-Based Emotion Recognition. AAAI","author":"Zhao Liming","year":"2021","unstructured":"Liming Zhao, Xu Yan, and Bao-Liang Lu. 2021. Plug-and-Play Domain Adaptation for Cross-Subject EEG-Based Emotion Recognition. AAAI (2021), 863--870."}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3550334","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3550334","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T04:40:52Z","timestamp":1752468052000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3550334"}},"subtitle":["Enabling Fine-Grained Brain-Robot Interaction through Human-Centered Learning of Coarse EEG Signals from Low-Cost Devices"],"short-title":[],"issued":{"date-parts":[[2022,9,6]]},"references-count":56,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,9,6]]}},"alternative-id":["10.1145\/3550334"],"URL":"https:\/\/doi.org\/10.1145\/3550334","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,6]]},"assertion":[{"value":"2022-09-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}