{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T23:14:23Z","timestamp":1771024463798,"version":"3.50.1"},"reference-count":33,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,10,14]],"date-time":"2022-10-14T00:00:00Z","timestamp":1665705600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Neurosci."],"abstract":"<jats:sec><jats:title>Background<\/jats:title><jats:p>Rapid serial visual presentation (RSVP) has become a popular target detection method by decoding electroencephalography (EEG) signals, owing to its sensitivity and effectiveness. Most current research on EEG-based RSVP tasks focused on feature extraction algorithms developed to deal with the non-stationarity and low signal-to-noise ratio (SNR) of EEG signals. However, these algorithms cannot handle the problem of no event-related potentials (ERP) component or miniature ERP components caused by the attention lapses of human vision in abnormal conditions. The fusion of human-computer vision can obtain complementary information, making it a promising way to become an efficient and general way to detect objects, especially in attention lapses.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>Dynamic probability integration (DPI) was proposed in this study to fuse human vision and computer vision. A novel basic probability assignment (BPA) method was included, which can fully consider the classification capabilities of different heterogeneous information sources for targets and non-targets and constructs the detection performance model for the weight generation based on classification capabilities. Furthermore, a spatial-temporal hybrid common spatial pattern-principal component analysis (STHCP) algorithm was designed to decode EEG signals in the RSVP task. It is a simple and effective method of distinguishing target and non-target using spatial-temporal features.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>A nighttime vehicle detection based on the RSVP task was performed to evaluate the performance of DPI and STHCP, which is one of the conditions of attention lapses because of its decrease in visual information. The average AUC of DPI was 0.912 \u00b1 0.041 and increased by 11.5, 5.2, 3.4, and 1.7% compared with human vision, computer vision, naive Bayesian fusion, and dynamic belief fusion (DBF), respectively. A higher average balanced accuracy of 0.845 \u00b1 0.052 was also achieved using DPI, representing that DPI has the balanced detection capacity of target and non-target. Moreover, STHCP obtained the highest AUC of 0.818 \u00b1 0.06 compared with the other two baseline methods and increased by 15.4 and 23.4%.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>Experimental results indicated that the average AUC and balanced accuracy of the proposed fusion method were higher than individual detection methods used for fusion, as well as two excellent fusion methods. It is a promising way to improve detection performance in RSVP tasks, even in abnormal conditions.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fncom.2022.1006361","type":"journal-article","created":{"date-parts":[[2022,10,14]],"date-time":"2022-10-14T05:56:11Z","timestamp":1665726971000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Dynamic probability integration for electroencephalography-based rapid serial visual presentation performance enhancement: Application in nighttime vehicle detection"],"prefix":"10.3389","volume":"16","author":[{"given":"Yujie","family":"Cui","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Songyun","family":"Xie","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xinzhou","family":"Xie","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaowei","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xianghui","family":"Liu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2022,10,14]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"2290","DOI":"10.1109\/TBME.2013.2289898","article-title":"Spatiotemporal representations of rapid visual target detection: A single-trial EEG classification algorithm.","volume":"61","author":"Alpert","year":"2014","journal-title":"IEEE Trans. Bio. Med. Eng."},{"key":"B2","doi-asserted-by":"publisher","first-page":"814","DOI":"10.1016\/j.neuroimage.2010.06.048","article-title":"Single-trial analysis and classification of ERP components \u2013 A tutorial.","volume":"56","author":"Blankertz","year":"2011","journal-title":"Neuroimage"},{"key":"B3","doi-asserted-by":"publisher","first-page":"250","DOI":"10.1016\/j.ins.2016.01.033","article-title":"An improved method to construct basic probability assignment based on the confusion matrix for classification problem.","volume":"340","author":"Deng","year":"2016","journal-title":"Inf. Sci."},{"key":"B4","doi-asserted-by":"publisher","first-page":"342","DOI":"10.1016\/j.neuroimage.2005.06.026","article-title":"Cortical origins of response time variability during rapid discrimination of visual objects.","volume":"28","author":"Gerson","year":"2005","journal-title":"Neuroimage"},{"key":"B5","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1016\/j.cviu.2006.10.019","article-title":"Multimodal human-computer interaction: A survey.","volume":"108","author":"Jaimes","year":"2007","journal-title":"Comput. Vis. Image Underst."},{"key":"B6","doi-asserted-by":"publisher","first-page":"630","DOI":"10.1007\/s10489-016-0851-6","article-title":"A modified combination rule in generalized evidence theory.","volume":"46","author":"Jiang","year":"2017","journal-title":"Appl. Intell."},{"key":"B7","doi-asserted-by":"publisher","first-page":"871","DOI":"10.1109\/LSP.2005.859494","article-title":"Bayesian fusion of confidence measures for speech recognition.","volume":"12","author":"Kim","year":"2005","journal-title":"IEEE Signal Process. Lett."},{"key":"B8","doi-asserted-by":"publisher","first-page":"1499","DOI":"10.1109\/TPAMI.2019.2952847","article-title":"DBF: Dynamic belief fusion for combining multiple object detectors.","volume":"43","author":"Lee","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"B9","article-title":"Data from: An efficient fusion approach for combining human and machine decisions.","volume":"9836","author":"Lee","year":"2016","journal-title":"Proc. SPIE"},{"key":"B10","doi-asserted-by":"publisher","first-page":"736","DOI":"10.1002\/int.22318","article-title":"A novel dynamic weight allocation method for multisource information fusion.","volume":"36","author":"Li","year":"2021","journal-title":"Int. J. Intell. Syst."},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2017.00332","article-title":"Fuzzy decision-making fuser (FDMF) for integrating human-machine autonomous (HMA) systems with adaptive evidence sources.","volume":"11","author":"Liu","year":"2017","journal-title":"Front. Neurosci."},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.3389\/fncom.2016.00130","article-title":"Multimodal neural network for rapid serial visual presentation brain computer interface.","volume":"10","author":"Manor","year":"2016","journal-title":"Front. Comput. Neurosci."},{"key":"B13","doi-asserted-by":"publisher","first-page":"3125","DOI":"10.1007\/s10489-020-01704-5","article-title":"Finding every car: A traffic surveillance multi-scale vehicle object detection method.","volume":"50","author":"Mao","year":"2020","journal-title":"Appl. Intell."},{"key":"B14","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1109\/TNSRE.2015.2502323","article-title":"Improved neural signal classification in a rapid serial visual presentation task using active learning.","volume":"24","author":"Marathe","year":"2016","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"B15","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1109\/TNSRE.2014.2304884","article-title":"Sliding HDCA: Single-trial eeg classification to overcome and quantify temporal variability.","volume":"22","author":"Marathe","year":"2014","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"B16","doi-asserted-by":"publisher","first-page":"386","DOI":"10.7305\/automatika.2014.09.847","article-title":"Bayesian sensor fusion methods for dynamic object tracking \u2013 A comparative study.","volume":"55","author":"Markovic","year":"2014","journal-title":"Automatika"},{"key":"B17","doi-asserted-by":"publisher","first-page":"176","DOI":"10.1016\/j.inffus.2004.10.001","article-title":"Fusionplex: Resolution of data inconsistencies in the integration of heterogeneous information sources.","volume":"7","author":"Motro","year":"2006","journal-title":"Inf. Fusion"},{"key":"B18","doi-asserted-by":"publisher","first-page":"787","DOI":"10.1016\/S1388-2457(98)00038-8","article-title":"Designing optimal spatial filters for single-trial EEG classification in a movement task.","volume":"110","author":"M\u00fcller-Gerking","year":"1999","journal-title":"Clin. Neurophysiol."},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2560\/8\/3\/036025","article-title":"Closing the loop in cortically-coupled computer vision: A brain-computer interface for searching image databases.","volume":"8","author":"Pohlmeyer","year":"2011","journal-title":"J. Neural Eng."},{"key":"B20","doi-asserted-by":"publisher","first-page":"462","DOI":"10.1109\/JPROC.2009.2038406","article-title":"In a blink of an eye and a switch of a transistor: Cortically coupled computer vision.","volume":"98","author":"Sajda","year":"2010","journal-title":"Proc. IEEE"},{"key":"B21","doi-asserted-by":"crossref","DOI":"10.1145\/3448218.3448225","article-title":"Data from: An enhanced HDCA algorithm for single-trial EEG classification","author":"Song","year":"2021","journal-title":"Proceedings of the 5th international conference on control engineering and artificial intelligence"},{"key":"B22","doi-asserted-by":"publisher","first-page":"1766","DOI":"10.1109\/TITS.2017.2740427","article-title":"EEG-based detection of driver emergency braking intention for brain-controlled vehicles.","volume":"19","author":"Teng","year":"2018","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"B23","doi-asserted-by":"publisher","first-page":"1595","DOI":"10.1007\/s13369-021-06011-w","article-title":"An improved approach for generation of a basic probability assignment in the evidence theory based on gaussian distribution.","volume":"47","author":"Wang","year":"2022","journal-title":"Arab. J. Sci. Eng."},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/ac5eb7","article-title":"ERP prototypical matching net: A meta-learning method for zero-calibration RSVP-based image retrieval","volume":"19","author":"Wei","year":"2022","journal-title":"J. Neural Eng"},{"key":"B25","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1109\/TRE.2000.847807","article-title":"Brain-computer interface technology: A review of the first international meeting.","volume":"8","author":"Wolpaw","year":"2000","journal-title":"IEEE Trans. Rehabil. Eng."},{"key":"B26","doi-asserted-by":"crossref","DOI":"10.1109\/CIS.2007.196","article-title":"Data from: Audio-visual recognition system with intra-modal fusion","author":"Wong","year":"2007","journal-title":"Proceedings of the 2007 international conference on computational intelligence and security"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1186\/s12938-018-0483-7","article-title":"Anti-deception: Reliable EEG-based biometrics with real-time capability from the neural response of face rapid serial visual presentation.","volume":"17","author":"Wu","year":"2018","journal-title":"Biomed. Eng. Online"},{"key":"B28","doi-asserted-by":"publisher","first-page":"1631","DOI":"10.1007\/s00371-021-02093-7","article-title":"Quality assessment-based iris and face fusion recognition with dynamic weight.","volume":"38","author":"Xiao","year":"2022","journal-title":"Vis. Comput."},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/ac028b","article-title":"Enhancement for P300-speller classification using multi-window discriminative canonical pattern matching.","volume":"18","author":"Xiao","year":"2021","journal-title":"J. Neural Eng."},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065722500101","article-title":"A spatio-temporal method for extracting gamma-band features to enhance classification in a rapid serial visual presentation task.","volume":"32","author":"Xie","year":"2022","journal-title":"Int. J. Neural Syst."},{"key":"B31","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1109\/TSMCA.2002.802746","article-title":"On the evidential reasoning algorithm for multiple attribute decision analysis under uncertainty.","volume":"32","author":"Yang","year":"2002","journal-title":"IEEE Trans. Syst. Man Cybern. A Syst. Hum."},{"key":"B32","doi-asserted-by":"publisher","first-page":"2513","DOI":"10.1109\/TBME.2011.2158542","article-title":"Common spatio-temporal pattern for single-trial detection of event-related potential in rapid serial visual presentation triage.","volume":"58","author":"Yu","year":"2011","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"B33","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2022\/1815170","article-title":"Analysis of public big data management under text analysis.","volume":"2022","author":"Zhu","year":"2022","journal-title":"Math. Probl. Eng."}],"container-title":["Frontiers in Computational Neuroscience"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fncom.2022.1006361\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,14]],"date-time":"2022-10-14T05:56:18Z","timestamp":1665726978000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fncom.2022.1006361\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,14]]},"references-count":33,"alternative-id":["10.3389\/fncom.2022.1006361"],"URL":"https:\/\/doi.org\/10.3389\/fncom.2022.1006361","relation":{},"ISSN":["1662-5188"],"issn-type":[{"value":"1662-5188","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,14]]},"article-number":"1006361"}}