{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T16:09:37Z","timestamp":1753891777963,"version":"3.41.2"},"reference-count":60,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,11,26]],"date-time":"2024-11-26T00:00:00Z","timestamp":1732579200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Hum. Neurosci."],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>The ASME (stands for Auditory Stream segregation Multiclass ERP) paradigm is proposed and used for an auditory brain-computer interface (BCI). In this paradigm, a sequence of sounds that are perceived as multiple auditory streams are presented simultaneously, and each stream is an oddball sequence. The users are requested to focus selectively on deviant stimuli in one of the streams, and the target of the user attention is detected by decoding event-related potentials (ERPs). To achieve multiclass ASME BCI, the number of streams must be increased. However, increasing the number of streams is not easy because of a person's limited audible frequency range. One method to achieve multiclass ASME with a limited number of streams is to increase the target stimuli in a single stream.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>Two approaches for the ASME paradigm, ASME-4stream (four streams with a single target stimulus in each stream) and ASME-2stream (two streams with two target stimuli in each stream) were investigated. Fifteen healthy subjects with no neurological disorders participated in this study. An electroencephalogram was acquired, and ERPs were analyzed. The binary classification and BCI simulation (detecting the target class of the trial out of four) were conducted with the help of linear discriminant analysis, and its performance was evaluated offline. Its usability and workload were also evaluated using a questionnaire.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Discriminative ERPs were elicited in both paradigms. The average accuracies of the BCI simulations were 0.83 (ASME-4stream) and 0.86 (ASME-2stream). In the ASME-2stream paradigm, the latency and the amplitude of P300 were shorter and larger, the average binary classification accuracy was higher, and the average weighted workload was smaller.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>Both four-class ASME paradigms achieved a sufficiently high accuracy (over 80%). The shorter latency and larger amplitude of P300 and the smaller workload indicated that subjects could perform the task confidently and had high usability in ASME-2stream compared to ASME-4stream paradigm. A paradigm with multiple target stimuli in a single stream could create a multiclass ASME BCI with limited streams while maintaining task difficulty. These findings expand the potential for an ASME BCI multiclass extension, offering practical auditory BCI choices for users.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fnhum.2024.1461960","type":"journal-article","created":{"date-parts":[[2024,11,26]],"date-time":"2024-11-26T06:28:48Z","timestamp":1732602528000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Four-class ASME BCI: investigation of the feasibility and comparison of two strategies for multiclassing"],"prefix":"10.3389","volume":"18","author":[{"given":"Simon","family":"Kojima","sequence":"first","affiliation":[]},{"given":"Shin'ichiro","family":"Kanoh","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2024,11,26]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"025022","DOI":"10.1088\/1741-2560\/8\/2\/025022","article-title":"P300 audio-visual speller","volume":"8","author":"Belitski","year":"2011","journal-title":"J. Neural Eng"},{"key":"B2","doi-asserted-by":"publisher","first-page":"2044","DOI":"10.1016\/j.clinph.2010.05.008","article-title":"Transmodal comparison of auditory, motor, and visual post-processing with and without intentional short-term memory maintenance","volume":"121","author":"Bender","year":"2010","journal-title":"Clin. Neurophysiol"},{"key":"B3","doi-asserted-by":"publisher","first-page":"046002","DOI":"10.1088\/1741-2560\/6\/4\/046002","article-title":"An online multi-channel SSVEP-based brain-computer interface using a canonical correlation analysis method","volume":"6","author":"Bin","year":"2009","journal-title":"J. Neural Eng"},{"key":"B4","doi-asserted-by":"publisher","first-page":"814","DOI":"10.1016\/j.neuroimage.2010.06.048","article-title":"Single-trial analysis and classification of ERP components \u2014 A tutorial","volume":"56","author":"Blankertz","year":"2011","journal-title":"Neuroimage"},{"key":"B5","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/1486.001.0001","volume-title":"Auditory Scene Analysis: The Perceptual Organization of Sound. A Bradford Book","author":"Bregman","year":"1990"},{"key":"B6","doi-asserted-by":"publisher","first-page":"5230","DOI":"10.1016\/j.promfg.2015.07.594","article-title":"EEG\/ERP as a measure of mental workload in a simple piloting task","volume":"3","author":"Causse","year":"2015","journal-title":"Proc. Manuf"},{"key":"B7","doi-asserted-by":"publisher","first-page":"1181","DOI":"10.1109\/TBME.2002.803536","article-title":"Design and implementation of a brain-computer interface with high transfer rates","volume":"49","author":"Cheng","year":"2002","journal-title":"IEEE Trans. Biomed. Eng"},{"key":"B8","doi-asserted-by":"publisher","first-page":"1401","DOI":"10.1007\/s11571-022-09901-3","article-title":"Design of auditory P300-based brain-computer interfaces with a single auditory channel and no visual support","volume":"17","author":"Choi","year":"2023","journal-title":"Cogn. Neurodyn"},{"key":"B9","doi-asserted-by":"publisher","first-page":"126","DOI":"10.1016\/j.jneumeth.2015.01.010","article-title":"Exceeding chance level by chance: the caveat of theoretical chance levels in brain signal classification and statistical assessment of decoding accuracy","volume":"250","author":"Combrisson","year":"2015","journal-title":"J. Neurosci. Methods"},{"key":"B10","doi-asserted-by":"publisher","first-page":"1106","DOI":"10.1016\/j.clinph.2006.01.023","article-title":"P3a from auditory white noise stimuli","volume":"117","author":"Combs","year":"2006","journal-title":"Clin. Neurophysiol"},{"key":"B11","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1016\/j.ijpsycho.2014.12.008","article-title":"The efficacy of auditory probes in indexing cognitive workload is dependent on stimulus complexity","volume":"95","author":"Dyke","year":"2015","journal-title":"Int. J. Psychophysiol"},{"key":"B12","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1016\/j.ijpsycho.2012.04.005","article-title":"P3a from white noise","volume":"85","author":"Frank","year":"2012","journal-title":"Int. J. Psychophysiol"},{"key":"B13","doi-asserted-by":"publisher","first-page":"617","DOI":"10.1111\/j.1469-8986.2008.00783.x","article-title":"An auditory oddball (P300) spelling system for brain-computer interfaces","volume":"46","author":"Furdea","year":"2009","journal-title":"Psychophysiology"},{"key":"B14","doi-asserted-by":"publisher","first-page":"769","DOI":"10.3233\/THC-181292","article-title":"Controlling of smart home system based on brain-computer interface","volume":"26","author":"Gao","year":"2018","journal-title":"Technol. Health Care"},{"key":"B15","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1109\/TNSRE.2003.814449","article-title":"A BCI-based environmental controller for the motion-disabled","volume":"11","author":"Gao","year":"2003","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng"},{"key":"B16","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1016\/j.neubiorev.2020.07.020","article-title":"ERP based measures of cognitive workload: a review","volume":"118","author":"Ghani","year":"2020","journal-title":"Neurosci. Biobehav. Rev"},{"key":"B17","doi-asserted-by":"publisher","first-page":"267","DOI":"10.3389\/fnins.2013.00267","article-title":"MEG and EEG data analysis with MNE-Python","volume":"7","author":"Gramfort","year":"2013","journal-title":"Front. Neurosci"},{"key":"B18","first-page":"1","article-title":"\u201cNoninvasive and invasive BCIs and hardware and software components for BCIs,\u201d","volume-title":"Handbook of Neuroengineering","author":"Guger","year":"2020"},{"key":"B19","doi-asserted-by":"publisher","first-page":"251","DOI":"10.3389\/fnins.2017.00251","article-title":"Complete locked-in and locked-in patients: command following assessment and communication with vibro-tactile P300 and motor imagery brain-computer interface tools","volume":"11","author":"Guger","year":"2017","journal-title":"Front. Neurosci"},{"key":"B20","doi-asserted-by":"publisher","first-page":"71","DOI":"10.5100\/jje.32.71","article-title":"Japanese version of NASA task load index","volume":"32","author":"Haga","year":"1996","journal-title":"Japanese J. Ergon"},{"key":"B21","doi-asserted-by":"publisher","first-page":"516","DOI":"10.1016\/j.clinph.2009.11.087","article-title":"An auditory oddball brain-computer interface for binary choices","volume":"121","author":"Halder","year":"2010","journal-title":"Clin. Neurophysiol"},{"key":"B22","doi-asserted-by":"publisher","first-page":"904","DOI":"10.1177\/154193120605000909","article-title":"Nasa-Task Load Index (NASA-TLX); 20 Years Later","volume":"50","author":"Hart","year":"2006","journal-title":"Proc. Hum. Factors Ergon. Soc. Annual Meeting"},{"key":"B23","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1016\/S0166-4115(08)62386-9","article-title":"\u201cDevelopment of NASA-TLX (Task Load Index): results of empirical and theoretical research,\u201d","author":"Hart","year":"1988","journal-title":"Advances in Psychology"},{"key":"B24","article-title":"\u201cAn auditory paradigm for brain-computer interfaces,\u201d","volume-title":"Advances in Neural Information Processing Systems","author":"Hill","year":"2004"},{"key":"B25","doi-asserted-by":"publisher","first-page":"1357","DOI":"10.1126\/science.172.3990.1357","article-title":"Evoked potential correlates of auditory signal detection","volume":"172","author":"Hillyard","year":"1971","journal-title":"Science"},{"key":"B26","doi-asserted-by":"publisher","first-page":"99","DOI":"10.3389\/fnins.2011.00099","article-title":"A novel 9-class auditory erp paradigm driving a predictive text entry system","volume":"5","author":"H\u00f6hne","year":"2011","journal-title":"Front. Neurosci"},{"key":"B27","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1007\/978-3-642-03889-1_47","article-title":"\u201cUsing a P300 brain computer interface for smart home control,\u201d","author":"Holzner","year":"2009","journal-title":"World Congress on Medical Physics and Biomedical Engineering, September 7"},{"key":"B28","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1016\/j.neuropsychologia.2015.12.013","article-title":"Assessment of mental workload: a new electrophysiological method based on intra-block averaging of ERP amplitudes","volume":"82","author":"Horat","year":"2016","journal-title":"Neuropsychologia"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1002\/0471221317","author":"Hyvarinen","year":"2001","journal-title":"Independent Component Analysis"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1109\/IEMBS.2008.4649234","article-title":"\u201cA brain-computer interface (BCI) system based on auditory stream segregation,\u201d","author":"Kanoh","year":"2008","journal-title":"2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society"},{"key":"B31","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1299\/jbse.5.32","article-title":"A brain-computer interface (BCI) system based on auditory stream segregation","volume":"5","author":"Kanoh","year":"2010","journal-title":"J. Biomechan. Sci. Eng"},{"key":"B32","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1186\/1743-0003-10-77","article-title":"Operation of a brain-computer interface walking simulator for individuals with spinal cord injury","volume":"10","author":"King","year":"2013","journal-title":"J. Neuroeng. Rehabil"},{"key":"B33","doi-asserted-by":"publisher","first-page":"e0303565","DOI":"10.1371\/journal.pone.0303565","article-title":"An auditory brain-computer interface based on selective attention to multiple tone streams","volume":"19","author":"Kojima","year":"2024","journal-title":"PLoS ONE"},{"key":"B34","doi-asserted-by":"publisher","first-page":"416","DOI":"10.3389\/fnhum.2016.00416","article-title":"Feasibility of BCI control in a realistic smart home environment","volume":"10","author":"Kosmyna","year":"2016","journal-title":"Front. Hum. Neurosci"},{"key":"B35","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1111\/j.1749-6632.2008.04122.x","article-title":"A brain-computer interface controlled auditory event-related potential (P300) spelling system for locked-in patients","volume":"1157","author":"K\u00fcbler","year":"2009","journal-title":"Ann. New York Acad. Sci"},{"volume-title":"An Introduction to the Event-Related Potential Technique","year":"2014","author":"Luck","key":"B36"},{"key":"B37","doi-asserted-by":"publisher","first-page":"061002","DOI":"10.1088\/1741-2552\/ac38cf","article-title":"Brain-computer interfaces based on code-modulated visual evoked potentials (c-VEP): a literature review","volume":"18","author":"Mart\u00ednez-Cagigal","year":"2021","journal-title":"J. Neural Eng"},{"key":"B38","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1016\/j.brainres.2006.12.020","article-title":"Perceptual and cognitive task difficulty has differential effects on auditory distraction","volume":"1136","author":"Muller-Gass","year":"2007","journal-title":"Brain Res"},{"key":"B39","doi-asserted-by":"publisher","first-page":"fcac008","DOI":"10.1093\/braincomms\/fcac008","article-title":"Aphasia recovery by language training using a brain-computer interface: a proof-of-concept study","volume":"4","author":"Musso","year":"2022","journal-title":"Brain Commun"},{"key":"B40","doi-asserted-by":"publisher","first-page":"106618","DOI":"10.1109\/ACCESS.2019.2933049","article-title":"A new paradigm for region-based p300 speller in brain computer interface","volume":"7","author":"Oralhan","year":"2019","journal-title":"IEEE Access"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.1109\/ICEV.2019.8920409","article-title":"\u201cUsability evaluation of brain computer interfaces: analysis of methods and tools,\u201d","author":"Ortega-Gijon","year":"2019","journal-title":"2019 IEEE International Conference on Engineering Veracruz (ICEV)"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.23919\/ChiCC.2017.8029119","article-title":"\u201cEnjoy driving from thought in a virtual city,\u201d","author":"Pan","year":"2017","journal-title":"2017 36th Chinese Control Conference (CCC)"},{"key":"B43","doi-asserted-by":"publisher","first-page":"163604","DOI":"10.1109\/ACCESS.2019.2952613","article-title":"Development of an online home appliance control system using augmented reality and an SSVEP-based brain-computer interface","volume":"7","author":"Park","year":"2019","journal-title":"IEEE Access"},{"key":"B44","first-page":"2825","article-title":"Scikit-learn: machine learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Lear. Res"},{"key":"B45","doi-asserted-by":"publisher","first-page":"2128","DOI":"10.1016\/j.clinph.2007.04.019","article-title":"Updating P300: an integrative theory of P3a and P3b","volume":"118","author":"Polich","year":"2007","journal-title":"Clin. Neurophysiol"},{"volume-title":"Brain-Computer Interfacing: An Introduction","year":"2019","author":"Rao","key":"B46"},{"volume-title":"Signals and Systems for Speech and Hearing","year":"2011","author":"Rosen","key":"B47"},{"key":"B48","doi-asserted-by":"publisher","first-page":"e9813","DOI":"10.1371\/journal.pone.0009813","article-title":"A new auditory multi-class brain-computer interface paradigm: spatial hearing as an informative Cue","volume":"5","author":"Schreuder","year":"2010","journal-title":"PLoS ONE"},{"key":"B49","doi-asserted-by":"publisher","first-page":"036025","DOI":"10.1088\/1741-2560\/10\/3\/036025","article-title":"Optimizing event-related potential based brain-computer interfaces: a systematic evaluation of dynamic stopping methods","volume":"10","author":"Schreuder","year":"2013","journal-title":"J. Neural Eng"},{"key":"B50","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1016\/j.conb.2010.03.009","article-title":"Behind the scenes of auditory perception","volume":"20","author":"Shamma","year":"2010","journal-title":"Curr. Opin. Neurobiol"},{"key":"B51","doi-asserted-by":"publisher","first-page":"780","DOI":"10.1037\/0033-2909.133.5.780","article-title":"Toward a neurophysiological theory of auditory stream segregation","volume":"133","author":"Snyder","year":"2007","journal-title":"Psychol. Bull"},{"key":"B52","doi-asserted-by":"publisher","first-page":"066001","DOI":"10.1088\/1741-2552\/ac9c98","article-title":"Introducing block-Toeplitz covariance matrices to remaster linear discriminant analysis for event-related potential brain-computer interfaces","volume":"19","author":"Sosulski","year":"2022","journal-title":"J. Neural Eng"},{"key":"B53","doi-asserted-by":"publisher","first-page":"056007","DOI":"10.1088\/1741-2552\/abecef","article-title":"From full calibration to zero training for a code-modulated visual evoked potentials for brain-computer interface","volume":"18","author":"Thielen","year":"2021","journal-title":"J. Neural Eng"},{"key":"B54","doi-asserted-by":"publisher","first-page":"661","DOI":"10.1007\/978-3-642-33269-2_83","article-title":"\u201cDynamic stopping improves the speed and accuracy of a P300 speller,\u201d","author":"Verschore","year":"2012","journal-title":"Artificial Neural Networks and Machine Learning"},{"key":"B55","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1146\/annurev.bb.02.060173.001105","article-title":"Toward direct brain-computer communication","volume":"2","author":"Vidal","year":"1973","journal-title":"Ann. Rev. Biophys. Bioeng"},{"key":"B56","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC.2015.7319296","article-title":"\u201cOn the influence of high-pass filtering on ICA-based artifact reduction in EEG-ERP,\u201d","author":"Winkler","year":"2015","journal-title":"2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)"},{"key":"B57","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1109\/TRE.2000.847807","article-title":"Brain-computer interface technology: a review of the first international meeting","volume":"8","author":"Wolpaw","year":"2000","journal-title":"IEEE Trans. Rehab. Eng"},{"key":"B58","doi-asserted-by":"publisher","first-page":"767","DOI":"10.1016\/S1388-2457(02)00057-3","article-title":"Brain-computer interfaces for communication and control","volume":"113","author":"Wolpaw","year":"2002","journal-title":"Clin. Neurophysiol"},{"key":"B59","doi-asserted-by":"publisher","first-page":"148","DOI":"10.1016\/j.compbiomed.2016.08.010","article-title":"Toward brain-actuated car applications: self-paced control with a motor imagery-based brain-computer interface","volume":"77","author":"Yu","year":"2016","journal-title":"Comput. Biol. Med"},{"key":"B60","doi-asserted-by":"publisher","first-page":"1959","DOI":"10.1109\/TBME.2016.2628861","article-title":"A BCI-based environmental control system for patients with severe spinal cord injuries","volume":"64","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Biomed. Eng"}],"container-title":["Frontiers in Human Neuroscience"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnhum.2024.1461960\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,26]],"date-time":"2024-11-26T06:28:54Z","timestamp":1732602534000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnhum.2024.1461960\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,26]]},"references-count":60,"alternative-id":["10.3389\/fnhum.2024.1461960"],"URL":"https:\/\/doi.org\/10.3389\/fnhum.2024.1461960","relation":{},"ISSN":["1662-5161"],"issn-type":[{"type":"electronic","value":"1662-5161"}],"subject":[],"published":{"date-parts":[[2024,11,26]]},"article-number":"1461960"}}