{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,23]],"date-time":"2026-07-23T15:34:23Z","timestamp":1784820863535,"version":"3.55.0"},"reference-count":41,"publisher":"American Association for the Advancement of Science (AAAS)","funder":[{"name":"Beijing Natural Science Foundation of China","award":["IS23064"],"award-info":[{"award-number":["IS23064"]}]}],"content-domain":{"domain":["spj.science.org"],"crossmark-restriction":true},"short-container-title":["Cyborg Bionic Syst"],"published-print":{"date-parts":[[2025,1]]},"abstract":"<jats:p>Sound target detection (STD) plays a critical role in modern acoustic sensing systems. However, existing automated STD methods show poor robustness and limited generalization, especially under low signal-to-noise ratio (SNR) conditions or when processing previously unencountered sound categories. To overcome these limitations, we first propose a brain\u2013computer interface (BCI)-based STD method that utilizes neural responses to auditory stimuli. Our approach features the Triple-Region Spatiotemporal Dynamics Attention Network (Tri-SDANet), an electroencephalogram (EEG) decoding model incorporating neuroanatomical priors derived from EEG source analysis to enhance decoding accuracy and provide interpretability in complex auditory scenes. Recognizing the inherent limitations of stand-alone BCI systems (notably their high false alarm rates), we further develop an adaptive confidence-based brain\u2013machine fusion strategy that intelligently combines decisions from both the BCI and conventional acoustic detection models. This hybrid approach effectively merges the complementary strengths of neural perception and acoustic feature learning. We validate the proposed method through experiments with 16 participants. Experimental results demonstrate that the Tri-SDANet achieves state-of-the-art performance in neural decoding under complex acoustic conditions. Moreover, the hybrid system maintains reliable detection performance at low SNR levels while exhibiting remarkable generalization to unseen target classes. In addition, source-level EEG analysis reveals distinct brain activation patterns associated with target perception, offering neuroscientific validation for our model design. This work pioneers a neuro-acoustic fusion paradigm for robust STD, offering a generalizable solution for real-world applications through the integration of noninvasive neural signals with artificial intelligence.<\/jats:p>","DOI":"10.34133\/cbsystems.0438","type":"journal-article","created":{"date-parts":[[2025,9,24]],"date-time":"2025-09-24T13:16:03Z","timestamp":1758719763000},"update-policy":"https:\/\/doi.org\/10.34133\/aaas_crossmark_01","source":"Crossref","is-referenced-by-count":4,"title":["Neuroanatomy-Informed Brain\u2013Machine Hybrid Intelligence for Robust Acoustic Target Detection"],"prefix":"10.34133","volume":"6","author":[{"given":"Jianting","family":"Shi","sequence":"first","affiliation":[{"name":"School of Mechanical Engineering, \rBeijing Institute of Technology, Beijing 100081, China."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiaqi","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, \rBeijing Institute of Technology, Beijing 100081, China."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weijie","family":"Fei","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, \rBeijing Institute of Technology, Beijing 100081, China."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aberham Genetu","family":"Feleke","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, \rBeijing Institute of Technology, Beijing 100081, China."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8986-3379","authenticated-orcid":true,"given":"Luzheng","family":"Bi","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, \rBeijing Institute of Technology, Beijing 100081, China."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"221","published-online":{"date-parts":[[2025,10,17]]},"reference":[{"key":"e_1_3_4_2_2","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1016\/j.ins.2013.11.030","article-title":"Acceleration of decision making in sound event recognition employing supercomputing cluster","volume":"285","author":"Lopatka K","year":"2014","unstructured":"Lopatka K, Czyzewski A. Acceleration of decision making in sound event recognition employing supercomputing cluster. Inf Sci. 2014;285:223\u2013236.","journal-title":"Inf Sci"},{"issue":"11","key":"e_1_3_4_3_2","doi-asserted-by":"crossref","first-page":"7911","DOI":"10.1007\/s11042-019-08279-5","article-title":"Analysis and classification of acoustic scenes with wavelet transform-based mel-scaled features","volume":"79","author":"Waldekar S","year":"2020","unstructured":"Waldekar S, Saha G. Analysis and classification of acoustic scenes with wavelet transform-based mel-scaled features. Multimed Tools Appl. 2020;79(11\u201312):7911\u20137926.","journal-title":"Multimed Tools Appl"},{"key":"e_1_3_4_4_2","doi-asserted-by":"crossref","first-page":"2450","DOI":"10.1109\/TASLP.2020.3014737","article-title":"Sound event detection of weakly labelled data with CNN-transformer and automatic threshold optimization","volume":"28","author":"Kong QQ","year":"2020","unstructured":"Kong QQ, Xu Y, Wang WW, Plumbley MD. Sound event detection of weakly labelled data with CNN-transformer and automatic threshold optimization. IEEE ACM Trans Audio Speech Lan Process. 2020;28:2450\u20132460.","journal-title":"IEEE ACM Trans Audio Speech Lan Process"},{"key":"e_1_3_4_5_2","doi-asserted-by":"crossref","unstructured":"Clavel C Ehrette T Richard G. Events detection for an audio-based surveillance system. In: 2005 IEEE International Conference on Multimedia and Expo 2005. IEEE; 2005. p. 1306\u20131309.","DOI":"10.1109\/ICME.2005.1521669"},{"issue":"10","key":"e_1_3_4_6_2","doi-asserted-by":"crossref","first-page":"1593","DOI":"10.3390\/electronics9101593","article-title":"Audio-based event detection at different SNR settings using two-dimensional spectrogram magnitude representations","volume":"9","author":"Papadimitriou I","year":"2020","unstructured":"Papadimitriou I, Vafeiadis A, Lalas A, Votis K, Tzovaras D. Audio-based event detection at different SNR settings using two-dimensional spectrogram magnitude representations. Electronics. 2020;9(10):1593.","journal-title":"Electronics"},{"key":"e_1_3_4_7_2","doi-asserted-by":"crossref","first-page":"84490","DOI":"10.1109\/ACCESS.2021.3087713","article-title":"Learning target template for acoustic event detection from low-SNR training data","volume":"9","author":"Ren XD","year":"2021","unstructured":"Ren XD, Feng ZR, Lu HY, Zhou Q. Learning target template for acoustic event detection from low-SNR training data. IEEE Access. 2021;9:84490\u201384500.","journal-title":"IEEE Access"},{"issue":"12","key":"e_1_3_4_8_2","first-page":"2905","article-title":"Detection of sound event under low SNR using multi-band power distribution","volume":"40","author":"Li Y","year":"2018","unstructured":"Li Y, Wu L. Detection of sound event under low SNR using multi-band power distribution. J Electron Info Technol. 2018;40(12):2905\u20132912.","journal-title":"J Electron Info Technol"},{"issue":"11","key":"e_1_3_4_9_2","first-page":"2705","article-title":"Sound event detection at low SNR based on multi-random forests","volume":"46","author":"Li Y","year":"2018","unstructured":"Li Y, Yin J. Sound event detection at low SNR based on multi-random forests. Acta Electron Sin. 2018;46(11):2705\u20132713.","journal-title":"Acta Electron Sin"},{"key":"e_1_3_4_10_2","doi-asserted-by":"publisher","DOI":"10.34133\/cbsystems.0024"},{"key":"e_1_3_4_11_2","doi-asserted-by":"crossref","first-page":"0098","DOI":"10.34133\/cbsystems.0098","article-title":"A robotic teleoperation system enhanced by augmented reality for natural human\u2013robot interaction","volume":"5","author":"Wang X","year":"2023","unstructured":"Wang X, Guo S, Xu Z, Zhang Z, Sun Z, Xu Y. A robotic teleoperation system enhanced by augmented reality for natural human\u2013robot interaction. Cyborg Bionic Syst. 2023;5:0098.","journal-title":"Cyborg Bionic Syst"},{"key":"e_1_3_4_12_2","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2008.0262"},{"issue":"10","key":"e_1_3_4_13_2","doi-asserted-by":"crossref","first-page":"2064","DOI":"10.1016\/j.neubiorev.2011.04.009","article-title":"Intensity-invariant coding in the auditory system","volume":"35","author":"Barbour DL","year":"2011","unstructured":"Barbour DL. Intensity-invariant coding in the auditory system. Neurosci Biobehav Rev. 2011;35(10):2064\u20132072.","journal-title":"Neurosci Biobehav Rev"},{"key":"e_1_3_4_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.conb.2014.01.011"},{"key":"e_1_3_4_15_2","first-page":"0125","article-title":"Low-quality video target detection based on EEG signal using eye movement alignment","volume":"5","author":"Shi J","year":"2024","unstructured":"Shi J, Xu X, Bi L, Feleke AG, Fei W. Low-quality video target detection based on EEG signal using eye movement alignment. Cyborg Bionic Syst. 2024;5:0125.","journal-title":"Cyborg Bionic Syst"},{"issue":"4","key":"e_1_3_4_16_2","article-title":"Time-varying networks of ERPs in P300-speller paradigms based on spatially and semantically congruent audiovisual bimodality","volume":"17","author":"Lu ZH","year":"2020","unstructured":"Lu ZH, Li Q, Gao N, Yang JJ. Time-varying networks of ERPs in P300-speller paradigms based on spatially and semantically congruent audiovisual bimodality. J Neural Eng. 2020;17(4): Article 046015.","journal-title":"J Neural Eng"},{"key":"e_1_3_4_17_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1749-6632.2008.04122.x"},{"issue":"3","key":"e_1_3_4_18_2","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0009813","article-title":"A new auditory multi-class brain-computer interface paradigm: Spatial hearing as an informative Cue","volume":"5","author":"Schreuder M","year":"2010","unstructured":"Schreuder M, Blankertz B, Tangermann M. A new auditory multi-class brain-computer interface paradigm: Spatial hearing as an informative Cue. PLOS ONE. 2010;5(3): Article e9813.","journal-title":"PLOS ONE"},{"key":"e_1_3_4_19_2","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1109\/TNSRE.2022.3219595","article-title":"Sound target detection under noisy environment using brain-computer interface","volume":"31","author":"Wang RD","year":"2023","unstructured":"Wang RD, Liu Y, Shi JT, Peng BL, Fei WJ, Bi LZ. Sound target detection under noisy environment using brain-computer interface. IEEE Trans Neural Syst Rehabil Eng. 2023;31:229\u2013237.","journal-title":"IEEE Trans Neural Syst Rehabil Eng"},{"issue":"3","key":"e_1_3_4_20_2","doi-asserted-by":"crossref","DOI":"10.1088\/1741-2552\/ab0ab5","article-title":"Deep learning for electroencephalogram (EEG) classification tasks: A review","volume":"16","author":"Craik A","year":"2019","unstructured":"Craik A, He YT, Contreras-Vidal JL. Deep learning for electroencephalogram (EEG) classification tasks: A review. J Neural Eng. 2019;16(3): Article 031001.","journal-title":"J Neural Eng"},{"key":"e_1_3_4_21_2","doi-asserted-by":"crossref","first-page":"104696","DOI":"10.1016\/j.compbiomed.2021.104696","article-title":"Recognition of human emotions using EEG signals: A review","volume":"136","author":"Rahman MM","year":"2021","unstructured":"Rahman MM, Sarkar AK, Hossain MA, Hossain MS, Islam MR, Hossain MB, Quinn JMW, Moni MA. Recognition of human emotions using EEG signals: A review. Comput Biol Med. 2021;136:104696.","journal-title":"Comput Biol Med"},{"issue":"3","key":"e_1_3_4_22_2","doi-asserted-by":"crossref","DOI":"10.1088\/1741-2552\/abc902","article-title":"A survey on deep learning-based non-invasive brain signals: Recent advances and new frontiers","volume":"18","author":"Zhang X","year":"2021","unstructured":"Zhang X, Yao LN, Wang XZ, Monaghan J, McAlpine D, Zhang Y. A survey on deep learning-based non-invasive brain signals: Recent advances and new frontiers. J Neural Eng. 2021;18(3): Article 031002.","journal-title":"J Neural Eng"},{"key":"e_1_3_4_23_2","first-page":"109","volume-title":"The symmetric BEM: Bringing in more variables for better accuracy","author":"Clerc M","year":"2010","unstructured":"Clerc M, Gramfort A, Olivi E, Papadopoulo T. The symmetric BEM: Bringing in more variables for better accuracy. Berlin Heidelberg: Springer; 2010. p. 109\u2013112."},{"key":"e_1_3_4_24_2","first-page":"5","article-title":"Standardized low-resolution brain electromagnetic tomography (sLORETA): Technical details","volume":"24","author":"Pascual-Marqui RD","year":"2002","unstructured":"Pascual-Marqui RD. Standardized low-resolution brain electromagnetic tomography (sLORETA): Technical details. Methods Find Exp Clin Pharmacol. 2002;24:5\u201312.","journal-title":"Methods Find Exp Clin Pharmacol"},{"key":"e_1_3_4_25_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2019.00034"},{"key":"e_1_3_4_26_2","doi-asserted-by":"crossref","first-page":"2011879716","DOI":"10.1155\/2011\/879716","article-title":"Brainstorm: A user-friendly application for MEG\/EEG analysis","volume":"2011","author":"Tadel F","year":"2011","unstructured":"Tadel F, Baillet S, Mosher JC, Pantazis D, Leahy RM. Brainstorm: A user-friendly application for MEG\/EEG analysis. Comput Intell Neurosci. 2011;2011:2011879716.","journal-title":"Comput Intell Neurosci"},{"key":"e_1_3_4_27_2","doi-asserted-by":"crossref","first-page":"116998","DOI":"10.1016\/j.eswa.2022.116998","article-title":"Recognize the surrounding: Development and evaluation of convolutional deep networks using gammatone spectrograms and raw audio signals","volume":"200","author":"Sen Gupta S","year":"2022","unstructured":"Sen Gupta S, Hossain S, Kim KD. Recognize the surrounding: Development and evaluation of convolutional deep networks using gammatone spectrograms and raw audio signals. Expert Syst Appl. 2022;200:116998.","journal-title":"Expert Syst Appl"},{"key":"e_1_3_4_28_2","unstructured":"Primus P. Reframing unsupervised machine condition monitoring as a supervised classification task with outlier-exposed classifiers. techreport. 2020."},{"key":"e_1_3_4_29_2","unstructured":"Jiang A Zheng X Qiu Y Zhang W Chen B Fan P Zhang W-Q Lu C Liu J. THUEE system for first-shot unsupervised anomalous sound detection. techreport. 2024."},{"issue":"3","key":"e_1_3_4_30_2","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1016\/0167-6393(93)90095-3","article-title":"Assessment for automatic speech recognition: II. NOISEX-92: A database and an experiment to study the effect of additive noise on speech recognition systems","volume":"12","author":"Varga A","year":"1993","unstructured":"Varga A, Steeneken HJM. Assessment for automatic speech recognition: II. NOISEX-92: A database and an experiment to study the effect of additive noise on speech recognition systems. Speech Comm. 1993;12(3):247\u2013251.","journal-title":"Speech Comm"},{"key":"e_1_3_4_31_2","doi-asserted-by":"publisher","DOI":"10.1038\/nrn755"},{"key":"e_1_3_4_32_2","doi-asserted-by":"crossref","DOI":"10.1016\/j.neunet.2024.106313","article-title":"Multiband task related components enhance rapid cognition decoding for both small and similar objects","volume":"175","author":"Zhou Y","year":"2024","unstructured":"Zhou Y, Yang B, Wang C. Multiband task related components enhance rapid cognition decoding for both small and similar objects. Neural Netw. 2024;175: Article 106313.","journal-title":"Neural Netw"},{"key":"e_1_3_4_33_2","doi-asserted-by":"crossref","first-page":"4131","DOI":"10.1109\/TNSRE.2024.3499998","article-title":"FACT-net: A frequency adapter CNN with temporal-periodicity inception for fast and accurate MI-EEG decoding","volume":"32","author":"Ke S","year":"2024","unstructured":"Ke S, Yang B, Qin Y, Rong F, Zhang J, Zheng Y. FACT-net: A frequency adapter CNN with temporal-periodicity inception for fast and accurate MI-EEG decoding. IEEE Trans Neural Syst Rehabil Eng. 2024;32:4131\u20134142.","journal-title":"IEEE Trans Neural Syst Rehabil Eng"},{"issue":"15","key":"e_1_3_4_34_2","doi-asserted-by":"crossref","first-page":"4953","DOI":"10.3390\/s21154953","article-title":"Audio-based drone detection and identification using deep learning techniques with dataset enhancement through generative adversarial networks","volume":"21","author":"Al-Emadi S","year":"2021","unstructured":"Al-Emadi S, Al-Ali A, Al-Ali A. Audio-based drone detection and identification using deep learning techniques with dataset enhancement through generative adversarial networks. Sensors. 2021;21(15):4953.","journal-title":"Sensors"},{"key":"e_1_3_4_35_2","doi-asserted-by":"crossref","first-page":"710","DOI":"10.1109\/TNSRE.2022.3230250","article-title":"EEG conformer: Convolutional transformer for EEG decoding and visualization","volume":"31","author":"Song YH","year":"2023","unstructured":"Song YH, Zheng QQ, Liu BC, Gao XR. EEG conformer: Convolutional transformer for EEG decoding and visualization. IEEE Trans Neural Syst Rehabil Eng. 2023;31:710\u2013719.","journal-title":"IEEE Trans Neural Syst Rehabil Eng"},{"key":"e_1_3_4_36_2","doi-asserted-by":"crossref","unstructured":"Schirrmeister R Gemein L Eggensperger K Hutter F Ball T. Deep learning with convolutional neural networks for decoding and visualization of EEG pathology. In: 2017 IEEE Signal Processing in Medicine and Biology Symposium (SPMB). IEEE; 2017. p. 1\u20137.","DOI":"10.1109\/SPMB.2017.8257015"},{"key":"e_1_3_4_37_2","doi-asserted-by":"crossref","unstructured":"Li XJ Wei W Qiu S He HG. TFF-Former: Temporal-frequency fusion transformer for zero-training decoding of two BCI tasks. Paper presented at: Proceedings of the 30th ACM International Conference on Multimedia MM; 2022 Oct 10; Lisbon Portugal.","DOI":"10.1145\/3503161.3548269"},{"issue":"5","key":"e_1_3_4_38_2","doi-asserted-by":"crossref","DOI":"10.1088\/1741-2552\/aace8c","article-title":"EEGNet: A compact convolutional neural network for EEG-based brain-computer interfaces","volume":"15","author":"Lawhern VJ","year":"2018","unstructured":"Lawhern VJ, Solon AJ, Waytowich NR, Gordon SM, Hung CP, Lance BJ. EEGNet: A compact convolutional neural network for EEG-based brain-computer interfaces. J Neural Eng. 2018;15(5): Article 056013.","journal-title":"J Neural Eng"},{"key":"e_1_3_4_39_2","doi-asserted-by":"crossref","unstructured":"Cho K Merrienboer B Gulcehre C Bougares F Schwenk H Bengio Y. Learning phrase representations using RNN encoder-decoder for statistical machine translation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). Doha (Qatar): 2014. p. 1724\u20131734","DOI":"10.3115\/v1\/D14-1179"},{"issue":"8","key":"e_1_3_4_40_2","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter S","year":"1997","unstructured":"Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput. 1997;9(8):1735\u20131780.","journal-title":"Neural Comput"},{"key":"e_1_3_4_41_2","doi-asserted-by":"crossref","unstructured":"Islam MR Massicotte D Nougarou F Massicotte P Zhu WP. S-Convnet: A shallow convolutional neural network architecture for neuromuscular activity recognition using instantaneous high-density surface EMG images. In: 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). IEEE; 2020. p. 744\u2013749.","DOI":"10.1109\/EMBC44109.2020.9175266"},{"issue":"2","key":"e_1_3_4_42_2","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1023\/A:1009715923555","article-title":"A tutorial on support vector machines for pattern recognition","volume":"2","author":"Burges CJC","year":"1998","unstructured":"Burges CJC. A tutorial on support vector machines for pattern recognition. Data Min Knowl Disc. 1998;2(2):121\u2013167.","journal-title":"Data Min Knowl Disc"}],"container-title":["Cyborg and Bionic Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/spj.science.org\/doi\/pdf\/10.34133\/cbsystems.0438","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T09:09:58Z","timestamp":1760692198000},"score":1,"resource":{"primary":{"URL":"https:\/\/spj.science.org\/doi\/10.34133\/cbsystems.0438"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1]]},"references-count":41,"alternative-id":["10.34133\/cbsystems.0438"],"URL":"https:\/\/doi.org\/10.34133\/cbsystems.0438","relation":{},"ISSN":["2692-7632"],"issn-type":[{"value":"2692-7632","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1]]},"assertion":[{"value":"2025-06-20","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-08-25","order":1,"name":"revised","label":"Revised","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-09-24","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-10-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"0438"}}