{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T10:12:55Z","timestamp":1781172775967,"version":"3.54.1"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,2,7]],"date-time":"2020-02-07T00:00:00Z","timestamp":1581033600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2020,2,7]],"date-time":"2020-02-07T00:00:00Z","timestamp":1581033600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/K004638\/1"],"award-info":[{"award-number":["EP\/K004638\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J NeuroEngineering Rehabil"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n<jats:title>Background<\/jats:title>\n<jats:p>Even though the BCI field has quickly grown in the last few years, it is still mainly investigated as a research area. Increased practicality and usability are required to move BCIs to the real-world. Self-paced (SP) systems would reduce the problem but there is still the big challenge of what is known as the \u2018onset detection problem\u2019.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Methods<\/jats:title>\n<jats:p>Our previous studies showed how a new sound-imagery (SI) task, <jats:italic>high-tone covert sound production<\/jats:italic>, is very effective for onset detection scenarios and we expect there are several advantages over most common asynchronous approaches used thus far, i.e., motor-imagery (MI): 1) Intuitiveness; 2) benefits to people with motor disabilities and, especially, those with lesions on cortical motor areas; and 3) no significant overlap with other common, spontaneous cognitive states, making it easier to use in daily-life situations. The approach was compared with MI tasks in online real-life scenarios, i.e., during activities such as watching videos and reading text. In our scenario, when a new message prompt from a messenger program appeared on the screen, participants watching a video (or reading text, browsing images) were asked to open the message by executing the SI or MI tasks, respectively, for each experimental condition.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Results<\/jats:title>\n<jats:p>The results showed the SI task performed statistically significantly better than the MI approach: 84.04% (SI) vs 66.79 (MI) True-False positive rate for the sliding image scenario, 80.84% vs 61.07% for watching video. The classification performance difference between SI and MI was found not to be significant in the text-reading scenario. Furthermore, the onset response speed showed SI (4.08\u2009s) being significantly faster than MI (5.46\u2009s). In terms of basic usability, 75% of subjects found SI easier to use.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Conclusions<\/jats:title>\n<jats:p>Our novel SI task outperforms typical MI for SP onset detection BCIs, therefore it would be more easily used in daily-life situations. This could be a significant step forward for the BCI field which has so far been mainly restricted to research-oriented indoor laboratory settings.<\/jats:p>\n<\/jats:sec>","DOI":"10.1186\/s12984-020-0651-4","type":"journal-article","created":{"date-parts":[[2020,2,7]],"date-time":"2020-02-07T00:06:38Z","timestamp":1581033998000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Comparison between covert sound-production task (sound-imagery) vs. motor-imagery for onset detection in real-life online self-paced BCIs"],"prefix":"10.1186","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5278-9715","authenticated-orcid":false,"given":"Youngjae","family":"Song","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Francisco","family":"Sepulveda","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,2,7]]},"reference":[{"issue":"3","key":"651_CR1","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1007\/s11517-009-0459-7","volume":"47","author":"CSL Tsui","year":"2009","unstructured":"Tsui CSL, Gan JQ, Roberts SJ. A self-paced brain\u2013computer interface for controlling a robot simulator: an online event labelling paradigm and an extended Kalman filter based algorithm for online training. Med Biol Eng Comput. 2009;47(3):257\u201365.","journal-title":"Med Biol Eng Comput"},{"key":"651_CR2","doi-asserted-by":"publisher","unstructured":"Y. Song and F. Sepulveda, \"Classifying speech related vs. idle state towards onset detection in brain-computer interfaces overt, inhibited overt, and covert speech sound production vs. idle state,\" in Biomed Circuits Syst Conf (BioCAS), IEEE, 2014: IEEE, pp. 568\u2013571. https:\/\/doi.org\/10.1109\/BioCAS.2014.6981789","DOI":"10.1109\/BioCAS.2014.6981789"},{"key":"651_CR3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2007\/79642","volume":"2007","author":"Robert Leeb","year":"2007","unstructured":"Leeb R, Friedman D, M\u00fcller-Putz GR, Scherer R, Slater M, Pfurtscheller G. Self-paced (asynchronous) BCI control of a wheelchair in virtual environments: a case study with a tetraplegic. Comput Intell Neurosci. 2007;2007. https:\/\/doi.org\/10.1155\/2007\/79642","journal-title":"Computational Intelligence and Neuroscience"},{"issue":"1","key":"651_CR4","doi-asserted-by":"publisher","first-page":"016019","DOI":"10.1088\/1741-2552\/14\/1\/016019","volume":"14","author":"Y Song","year":"2017","unstructured":"Song Y, Sepulveda F. A novel onset detection technique for brain\u2013computer interfaces using sound-production related cognitive tasks in simulated-online system. J Neural Eng. 2017;14(1):016019.","journal-title":"J Neural Eng"},{"key":"651_CR5","volume-title":"Advances in Robot Navigation","author":"Francisco Sepulveda","year":"2011","unstructured":"Sepulveda F. Brain-actuated control of robot navigation Advances in Robot Navigation ed A Barrea (Rijeka: InTech). 2011. p. 161\u201378."},{"key":"651_CR6","doi-asserted-by":"publisher","unstructured":"Y. J. Song and F. Sepulveda, \"Classifying siren-sound mental rehearsal and covert production vs. idle state towards onset detection in brain-computer interfaces,\" in Brain-Comput Interface (BCI), 2015 3rd Int Winter Conf, 2015: IEEE, pp. 1\u20134. https:\/\/doi.org\/10.1109\/IWW-BCI.2015.7073020","DOI":"10.1109\/IWW-BCI.2015.7073020"},{"issue":"3","key":"651_CR7","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1007\/s11517-009-0550-0","volume":"48","author":"BAS Hasan","year":"2010","unstructured":"Hasan BAS, Gan JQ. Unsupervised movement onset detection from EEG recorded during self-paced real hand movement. Med Biol Eng Comput. 2010;48(3):245\u201353.","journal-title":"Med Biol Eng Comput"},{"key":"651_CR8","doi-asserted-by":"publisher","unstructured":"Y. Song and F. Sepulveda, \"An online self-paced brain-computer interface onset detection based on sound-production imagery applied to real-life scenarios,\" in Brain-Comput Interface (BCI), 2017 5th Int Winter Conf, 2017: IEEE, pp. 46\u201349. https:\/\/doi.org\/10.1109\/IWW-BCI.2017.7858155","DOI":"10.1109\/IWW-BCI.2017.7858155"},{"key":"651_CR9","doi-asserted-by":"publisher","unstructured":"K. Brigham and B. Kumar, \"Imagined speech classification with EEG signals for silent communication: a preliminary investigation into synthetic telepathy,\" in Bioinform Biomed Eng (iCBBE), 2010 4th Int Conf, 2010: IEEE, pp. 1\u20134. https:\/\/doi.org\/10.1109\/ICBBE.2010.5515807","DOI":"10.1109\/ICBBE.2010.5515807"},{"key":"651_CR10","doi-asserted-by":"publisher","unstructured":"K. Brigham and B. Kumar, \"Subject identification from electroencephalogram (EEG) signals during imagined speech,\" in Biometrics: Theory Appl Syst (BTAS), 2010 Fourth IEEE Int Conf, 2010: IEEE, pp. 1\u20138. https:\/\/doi.org\/10.1109\/BTAS.2010.5634515","DOI":"10.1109\/BTAS.2010.5634515"},{"key":"651_CR11","doi-asserted-by":"crossref","unstructured":"D\u2019Zmura M, Deng S, Lappas T, Thorpe S, Srinivasan R. Toward EEG sensing of imagined speech. In: Human-computer interaction: New Trends: Springer; 2009. p. 40\u20138.","DOI":"10.1007\/978-3-642-02574-7_5"},{"issue":"2","key":"651_CR12","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1007\/s10916-018-1137-9","volume":"43","author":"A Jahangiri","year":"2019","unstructured":"Jahangiri A, Sepulveda F. The Relative Contribution of High-Gamma Linguistic Processing Stages of Word Production, and Motor Imagery of Articulation in Class Separability of Covert Speech Tasks in EEG Data. Journal of medical systems. 2019;43(2):20.","journal-title":"Journal of medical systems"},{"issue":"2","key":"651_CR13","doi-asserted-by":"publisher","first-page":"675","DOI":"10.1109\/TBME.2007.903709","volume":"55","author":"R Scherer","year":"2008","unstructured":"Scherer R, Lee F, Schlogl A, Leeb R, Bischof H, Pfurtscheller G. Toward self-paced brain\u2013computer communication: navigation through virtual worlds. Biomed Eng, IEEE Trans. 2008;55(2):675\u201382.","journal-title":"Biomed Eng, IEEE Trans"},{"issue":"1","key":"651_CR14","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1088\/1741-2560\/5\/1\/002","volume":"5","author":"M Fatourechi","year":"2008","unstructured":"Fatourechi M, Ward R, Birch G. A self-paced brain\u2013computer interface system with a low false positive rate. J Neural Eng. 2008;5(1):9.","journal-title":"J Neural Eng"},{"issue":"8","key":"651_CR15","doi-asserted-by":"publisher","first-page":"623","DOI":"10.1080\/10447318.2016.1267450","volume":"33","author":"Yang Yu","year":"2016","unstructured":"Y. Yu et al., \"Toward a hybrid BCI: self-paced operation of a P300-based speller by merging a motor imagery-based \u201cbrain switch\u201d into a P300 Spelling Approach,\" Int J Human\u2013Comput Interact, vol. 33, no. 8, pp. 623\u2013632, 2017.","journal-title":"International Journal of Human\u2013Computer Interaction"},{"key":"651_CR16","doi-asserted-by":"publisher","unstructured":"W. Zhang, F. Sun, J. Chen, C. Tan, H. Wu, and W. Su, \"An Asynchronous Mi-Based BCI for Brain-Actuated Robot Grasping Control,\" in 2017 Int Conf Comput Syst, Electron Control (ICCSEC), 2017: IEEE, pp. 893\u2013898. https:\/\/doi.org\/10.1109\/ICCSEC.2017.8446993","DOI":"10.1109\/ICCSEC.2017.8446993"},{"key":"651_CR17","doi-asserted-by":"publisher","unstructured":"P. Cheng, P. Autthasan, B. Pijarana, E. Chuangsuwanich, and T. Wilaiprasitporn, \"towards asynchronous motor imagery-based brain-computer interfaces: a joint training scheme using deep learning,\" TENCON 2018\u20132018 IEEE Region 10 Conf, 2018: IEEE, pp. 1994\u20131998. https:\/\/doi.org\/10.1109\/TENCON.2018.8650546","DOI":"10.1109\/TENCON.2018.8650546"},{"key":"651_CR18","doi-asserted-by":"publisher","unstructured":"Martin S, et al. Decoding spectrotemporal features of overt and covert speech from the human cortex. Front Neuroeng. 2014;7. https:\/\/doi.org\/10.3389\/fneng.2014.00014","DOI":"10.3389\/fneng.2014.00014"},{"key":"651_CR19","volume-title":"The blue planet","author":"A Fothergill","year":"2001","unstructured":"Fothergill A. The blue planet. \u00c1 London: BBC Worldwide Publishing (DVD); 2001."},{"issue":"11","key":"651_CR20","doi-asserted-by":"publisher","first-page":"1603","DOI":"10.1289\/ehp.10286","volume":"115","author":"Stacy Eltiti","year":"2007","unstructured":"Eltiti S, et al. Does short-term exposure to mobile phone base station signals increase symptoms in individuals who report sensitivity to electromagnetic fields? A double-blind randomized provocation study. Environ Health Perspect. 2007:1603\u20138.","journal-title":"Environmental Health Perspectives"},{"issue":"7","key":"651_CR21","doi-asserted-by":"publisher","first-page":"556","DOI":"10.1002\/bem.20504","volume":"30","author":"S Eltiti","year":"2009","unstructured":"Eltiti S, et al. Short-term exposure to mobile phone base station signals does not affect cognitive functioning or physiological measures in individuals who report sensitivity to electromagnetic fields and controls. Bioelectromagnetics. 2009;30(7):556\u201363.","journal-title":"Bioelectromagnetics"},{"key":"651_CR22","unstructured":"J. Jacobs, English fairy tales. 1st World Publishing, 2004."},{"issue":"6","key":"651_CR23","doi-asserted-by":"publisher","first-page":"e20409","DOI":"10.1371\/journal.pone.0020409","volume":"6","author":"G Tka\u010dik","year":"2011","unstructured":"Tka\u010dik G, et al. Natural images from the birthplace of the human eye. PLoS one. 2011;6(6):e20409.","journal-title":"PLoS one"},{"key":"651_CR24","unstructured":"Neuroelectrics. \"Enobio Neuroelectrics User Manual.\" http:\/\/www.neuroelectrics.com\/products\/enobio\/ Accessed 2019."},{"key":"651_CR25","unstructured":"Brunner C, Leeb R, M\u00fcller-Putz G, Schl\u00f6gl A, Pfurtscheller G. BCI Competition 2008\u2013Graz data set A. Inst Knowl Discov (Lab Brain-Comput Interf), Graz Univ Technol. 2008:16."},{"issue":"4","key":"651_CR26","doi-asserted-by":"publisher","first-page":"2960","DOI":"10.1016\/j.neuroimage.2010.10.029","volume":"54","author":"X Pei","year":"2011","unstructured":"Pei X, Leuthardt EC, Gaona CM, Brunner P, Wolpaw JR, Schalk G. Spatiotemporal dynamics of electrocorticographic high gamma activity during overt and covert word repetition. Neuroimage. 2011;54(4):2960\u201372.","journal-title":"Neuroimage"},{"issue":"8","key":"651_CR27","doi-asserted-by":"publisher","first-page":"2013","DOI":"10.1093\/brain\/awn147","volume":"131","author":"VL Towle","year":"2008","unstructured":"Towle VL, et al. ECoG gamma activity during a language task: differentiating expressive and receptive speech areas. Brain. 2008;131(8):2013\u201327.","journal-title":"Brain"},{"issue":"11","key":"651_CR28","doi-asserted-by":"publisher","first-page":"2045","DOI":"10.1212\/WNL.57.11.2045","volume":"57","author":"N Crone","year":"2001","unstructured":"Crone N, et al. Electrocorticographic gamma activity during word production in spoken and sign language. Neurology. 2001;57(11):2045\u201353.","journal-title":"Neurology"},{"issue":"4","key":"651_CR29","first-page":"45","volume":"6","author":"V Krishnaveni","year":"2006","unstructured":"Krishnaveni V, Jayaraman S, Aravind S, Hariharasudhan V, Ramadoss K. Automatic identification and removal of ocular artifacts from EEG using wavelet transform. Meas Sci Rev. 2006;6(4):45\u201357.","journal-title":"Meas Sci Rev"},{"issue":"1","key":"651_CR30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1687-6180-2012-127","volume":"2012","author":"D Safieddine","year":"2012","unstructured":"Safieddine D, et al. Removal of muscle artifact from EEG data: comparison between stochastic (ICA and CCA) and deterministic (EMD and wavelet-based) approaches. EURASIP J Adv Signal Process. 2012;2012(1):1\u201315.","journal-title":"EURASIP J Adv Signal Process"},{"issue":"12","key":"651_CR31","doi-asserted-by":"publisher","first-page":"2583","DOI":"10.1109\/TBME.2006.879459","volume":"53","author":"Wim De Clercq","year":"2006","unstructured":"De Clercq W, Vergult A, Vanrumste B, Van Paesschen W, Van Huffel S. Canonical correlation analysis applied to remove muscle artifacts from the electroencephalogram. Biomed Eng, IEEE Trans. 2006;53(12):2583\u20137. https:\/\/doi.org\/10.1109\/TBME.2006.879459","journal-title":"IEEE Transactions on Biomedical Engineering"},{"issue":"1","key":"651_CR32","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1177\/155005941004100111","volume":"41","author":"J Gao","year":"2010","unstructured":"Gao J, Zheng C, Wang P. Online removal of muscle artifact from electroencephalogram signals based on canonical correlation analysis. Clin EEG Neurosci. 2010;41(1):53\u20139.","journal-title":"Clin EEG Neurosci"},{"issue":"2","key":"651_CR33","doi-asserted-by":"publisher","first-page":"224","DOI":"10.1109\/TPAMI.1979.4766909","volume":"PAMI-1","author":"David L. Davies","year":"1979","unstructured":"Davies DL, Bouldin DW. A cluster separation measure. Pattern Anal Mach Intell, IEEE Trans. 1979;(2):224\u20137.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"2","key":"651_CR34","doi-asserted-by":"publisher","first-page":"R1","DOI":"10.1088\/1741-2560\/4\/2\/R01","volume":"4","author":"F Lotte","year":"2007","unstructured":"Lotte F, Congedo M, L\u00e9cuyer A, Lamarche F. A review of classification algorithms for EEG-based brain\u2013computer interfaces. J Neural Eng. 2007;4.","journal-title":"Journal of Neural Engineering"},{"issue":"7","key":"651_CR35","doi-asserted-by":"publisher","first-page":"1353","DOI":"10.1109\/TNSRE.2018.2847316","volume":"26","author":"Y Song","year":"2018","unstructured":"Song Y, Sepulveda F. A novel technique for selecting EMG-contaminated EEG channels in self-paced brain\u2013computer Interface task onset. IEEE Trans Neural Syst Rehab Eng. 2018;26(7):1353\u201362.","journal-title":"IEEE Trans Neural Syst Rehab Eng"},{"key":"651_CR36","unstructured":"Altenm\u00fcller EO, M\u00fcnte TF, Gerloff C. \"31. Neurocognitive Functions and the EEG.\" Electroencephalog-241 raphy Basic Principles, Clinical Applications, and Related Fields. Ed. by Ernst Niedermeyer and 242. 2005."},{"key":"651_CR37","doi-asserted-by":"publisher","unstructured":"M. Dyson, F. Sepulveda, J. Q. Gan, and S. J. Roberts, \"Sequential classification of mental tasks vs. idle state for EEG based BCIs,\" in Neural Eng, 2009. NER'09. 4th Int IEEE\/EMBS Conf, 2009: IEEE, pp. 351\u2013354. https:\/\/doi.org\/10.1109\/NER.2009.5109305","DOI":"10.1109\/NER.2009.5109305"},{"issue":"1","key":"651_CR38","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1002\/hbm.1060","volume":"15","author":"J Huang","year":"2002","unstructured":"Huang J, Carr TH, Cao Y. Comparing cortical activations for silent and overt speech using event-related fMRI. Hum Brain Mapp. 2002;15(1):39\u201353.","journal-title":"Hum Brain Mapp"},{"issue":"3","key":"651_CR39","doi-asserted-by":"publisher","first-page":"982","DOI":"10.1016\/j.cogbrainres.2005.09.022","volume":"25","author":"S Heim","year":"2005","unstructured":"Heim S, et al. The role of the left Brodmann's areas 44 and 45 in reading words and pseudowords. Cogn Brain Res. 2005;25(3):982\u201393.","journal-title":"Cogn Brain Res"},{"issue":"6","key":"651_CR40","doi-asserted-by":"publisher","first-page":"993","DOI":"10.1109\/TBME.2004.827088","volume":"51","author":"G Dornhege","year":"2004","unstructured":"Dornhege G, Blankertz B, Curio G, Muller K-R. Boosting bit rates in noninvasive EEG single-trial classifications by feature combination and multiclass paradigms. IEEE Trans Biomed Eng. 2004;51(6):993\u20131002.","journal-title":"IEEE Trans Biomed Eng"},{"issue":"2","key":"651_CR41","doi-asserted-by":"publisher","first-page":"194","DOI":"10.1007\/s10548-009-0121-6","volume":"23","author":"C Vidaurre","year":"2010","unstructured":"Vidaurre C, Blankertz B. Towards a cure for BCI illiteracy. Brain Topogr. 2010;23(2):194\u20138.","journal-title":"Brain Topogr"}],"container-title":["Journal of NeuroEngineering and Rehabilitation"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12984-020-0651-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12984-020-0651-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12984-020-0651-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,2,8]],"date-time":"2021-02-08T05:25:25Z","timestamp":1612761925000},"score":1,"resource":{"primary":{"URL":"https:\/\/jneuroengrehab.biomedcentral.com\/articles\/10.1186\/s12984-020-0651-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,7]]},"references-count":41,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["651"],"URL":"https:\/\/doi.org\/10.1186\/s12984-020-0651-4","relation":{},"ISSN":["1743-0003"],"issn-type":[{"value":"1743-0003","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,7]]},"assertion":[{"value":"11 October 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 January 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 February 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The experiments were conducted in accordance with the University of Essex Ethics Committee guidelines and all participants signed informed consent before study enrollment.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"14"}}