{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T19:54:58Z","timestamp":1776887698284,"version":"3.51.2"},"publisher-location":"California","reference-count":0,"publisher":"International Joint Conferences on Artificial Intelligence Organization","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,9]]},"abstract":"<jats:p>The brain-assisted target speaker extraction (TSE) aims to extract the attended speech from mixed speech by utilizing the brain neural activities, for example Electroencephalography (EEG). However, existing models overlook the issue of temporal misalignment between speech and EEG modalities, which hampers TSE performance. In addition, the speech encoder in current models typically uses basic temporal operations (e.g., one-dimensional convolution), which are unable to effectively extract target speaker information. To address these issues, this paper proposes a multi-scale and multi-modal alignment network (M3ANet) for brain-assisted TSE. Specifically, to eliminate the temporal inconsistency between EEG and speech modalities, the modal alignment module that uses a contrastive learning strategy is applied to align the temporal features of both modalities. Additionally, to fully extract speech information, multi-scale convolutions with GroupMamba modules are used as the speech encoder, which scans speech features at each scale from different directions, enabling the model to capture deep sequence information. Experimental results on three publicly available datasets show that the proposed model outperforms current state-of-the-art methods across various evaluation metrics, highlighting the effectiveness of our proposed method. The source code is available at: https:\/\/github.com\/fchest\/M3ANet.<\/jats:p>","DOI":"10.24963\/ijcai.2025\/894","type":"proceedings-article","created":{"date-parts":[[2025,9,19]],"date-time":"2025-09-19T08:10:40Z","timestamp":1758269440000},"page":"8040-8048","source":"Crossref","is-referenced-by-count":3,"title":["M3ANet: Multi-scale and Multi-Modal Alignment Network for Brain-Assisted Target Speaker Extraction"],"prefix":"10.24963","author":[{"given":"Cunhang","family":"Fan","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, Anhui University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ying","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Anhui University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jian","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Anhui University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zexu","family":"Pan","sequence":"additional","affiliation":[{"name":"Alibaba group, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jingjing","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Anhui University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Youdian","family":"Gao","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Anhui University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaoke","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Anhui University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhengqi","family":"Wen","sequence":"additional","affiliation":[{"name":"Department of Automation, Tsinghua University Beijing National Research Center for lnformation Science and Technology, Tsinghua University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhao","family":"Lv","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Anhui University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"10584","event":{"name":"Thirty-Fourth International Joint Conference on Artificial Intelligence {IJCAI-25}","theme":"Artificial Intelligence","location":"Montreal, Canada","acronym":"IJCAI-2025","number":"34","sponsor":["International Joint Conferences on Artificial Intelligence Organization (IJCAI)"],"start":{"date-parts":[[2025,8,16]]},"end":{"date-parts":[[2025,8,22]]}},"container-title":["Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence"],"original-title":[],"deposited":{"date-parts":[[2025,9,23]],"date-time":"2025-09-23T11:35:25Z","timestamp":1758627325000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ijcai.org\/proceedings\/2025\/894"}},"subtitle":[],"proceedings-subject":"Artificial Intelligence Research Articles","short-title":[],"issued":{"date-parts":[[2025,9]]},"references-count":0,"URL":"https:\/\/doi.org\/10.24963\/ijcai.2025\/894","relation":{},"subject":[],"published":{"date-parts":[[2025,9]]}}}