{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T16:37:23Z","timestamp":1775839043094,"version":"3.50.1"},"reference-count":32,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,3,9]],"date-time":"2022-03-09T00:00:00Z","timestamp":1646784000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002661","name":"Fund for Scientific Research","doi-asserted-by":"publisher","award":["5207920F"],"award-info":[{"award-number":["5207920F"]}],"id":[{"id":"10.13039\/501100002661","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Informatics"],"abstract":"<jats:p>Visual attention estimation is an active field of research at the crossroads of different disciplines: computer vision, deep learning, and medicine. One of the most common approaches to estimate a saliency map representing attention is based on the observed images. In this paper, we show that visual attention can be retrieved from EEG acquisition. The results are comparable to traditional predictions from observed images, which is of great interest. Image-based saliency estimation being participant independent, the estimation from EEG could take into account the subject specificity. For this purpose, a set of signals has been recorded, and different models have been developed to study the relationship between visual attention and brain activity. The results are encouraging and comparable with other approaches estimating attention with other modalities. Being able to predict a visual saliency map from EEG could help in research studying the relationship between brain activity and visual attention. It could also help in various applications: vigilance assessment during driving, neuromarketing, and also in the help for the diagnosis and treatment of visual attention-related diseases. For the sake of reproducibility, the codes and dataset considered in this paper have been made publicly available to promote research in the field.<\/jats:p>","DOI":"10.3390\/informatics9010026","type":"journal-article","created":{"date-parts":[[2022,3,9]],"date-time":"2022-03-09T11:30:38Z","timestamp":1646825438000},"page":"26","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Where Is My Mind (Looking at)? A Study of the EEG\u2013Visual Attention Relationship"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4281-0071","authenticated-orcid":false,"given":"Victor","family":"Delvigne","sequence":"first","affiliation":[{"name":"ISIA Lab, Faculty of Engineering, University of Mons, 7000 Mons, Belgium"},{"name":"IMT Nord Europe, CRIStAL UMR CNRS 9189, 59000 Lille, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1971-4412","authenticated-orcid":false,"given":"No\u00e9","family":"Tits","sequence":"additional","affiliation":[{"name":"Flowchase SRL, 1000 Bruxelles, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7614-8904","authenticated-orcid":false,"given":"Luca","family":"La Fisca","sequence":"additional","affiliation":[{"name":"ISIA Lab, Faculty of Engineering, University of Mons, 7000 Mons, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9653-1161","authenticated-orcid":false,"given":"Nathan","family":"Hubens","sequence":"additional","affiliation":[{"name":"ISIA Lab, Faculty of Engineering, University of Mons, 7000 Mons, Belgium"},{"name":"Artemis, T\u00e9l\u00e9com SudParis, 91000 Paris, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5729-700X","authenticated-orcid":false,"given":"Antoine","family":"Maiorca","sequence":"additional","affiliation":[{"name":"ISIA Lab, Faculty of Engineering, University of Mons, 7000 Mons, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hazem","family":"Wannous","sequence":"additional","affiliation":[{"name":"IMT Nord Europe, CRIStAL UMR CNRS 9189, 59000 Lille, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7024-2150","authenticated-orcid":false,"given":"Thierry","family":"Dutoit","sequence":"additional","affiliation":[{"name":"ISIA Lab, Faculty of Engineering, University of Mons, 7000 Mons, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2056-8675","authenticated-orcid":false,"given":"Jean-Philippe","family":"Vandeborre","sequence":"additional","affiliation":[{"name":"IMT Nord Europe, CRIStAL UMR CNRS 9189, 59000 Lille, France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,3,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Riche, N., Duvinage, M., Mancas, M., Gosselin, B., and Dutoit, T. (2013, January 1\u20138). Saliency and human fixations: State-of-the-art and study of comparison metrics. Proceedings of the IEEE International Conference on Computer Vision, Sydney, Australia.","DOI":"10.1109\/ICCV.2013.147"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Droste, R., Jiao, J., and Noble, J.A. (2020, January 23\u201328). Unified image and video saliency modeling. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58558-7_25"},{"key":"ref_3","unstructured":"Pan, J., Ferrer, C.C., McGuinness, K., O\u2019Connor, N.E., Torres, J., Sayrol, E., and Giro-i Nieto, X. (2017). Salgan: Visual saliency prediction with generative adversarial networks. arXiv."},{"key":"ref_4","first-page":"4","article-title":"Deep learning for health informatics","volume":"21","author":"Wong","year":"2016","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Seo, H.J., and Milanfar, P. (2009, January 20\u201325). Nonparametric bottom-up saliency detection by self-resemblance. Proceedings of the 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5204207"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1016\/S0959-4388(97)80014-1","article-title":"Competitive brain activity in visual attention","volume":"7","author":"Duncan","year":"1997","journal-title":"Curr. Opin. Neurobiol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"16048","DOI":"10.1073\/pnas.1004801107","article-title":"Spontaneous EEG oscillations reveal periodic sampling of visual attention","volume":"107","author":"Busch","year":"2010","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"031005","DOI":"10.1088\/1741-2552\/aab2f2","article-title":"A review of classification algorithms for EEG-based brain\u2013computer interfaces: A 10 year update","volume":"15","author":"Lotte","year":"2018","journal-title":"J. Neural Eng."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"056013","DOI":"10.1088\/1741-2552\/aace8c","article-title":"EEGNet: A compact convolutional neural network for EEG-based brain\u2013computer interfaces","volume":"15","author":"Lawhern","year":"2018","journal-title":"J. Neural Eng."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhong, P., Wang, D., and Miao, C. (2020). EEG-based emotion recognition using regularized graph neural networks. IEEE Trans. Affect. Comput.","DOI":"10.1109\/TAFFC.2018.2817622"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1109\/TCDS.2020.2999337","article-title":"A novel bi-hemispheric discrepancy model for eeg emotion recognition","volume":"13","author":"Li","year":"2020","journal-title":"IEEE Trans. Cogn. Dev. Syst."},{"key":"ref_12","unstructured":"Bashivan, P., Rish, I., Yeasin, M., and Codella, N. (2015). Learning representations from EEG with deep recurrent-convolutional neural networks. arXiv."},{"key":"ref_13","unstructured":"Goodfellow, I. (2016). Nips 2016 tutorial: Generative adversarial networks. arXiv."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Tirupattur, P., Rawat, Y.S., Spampinato, C., and Shah, M. (2018, January 22\u201326). Thoughtviz: Visualizing human thoughts using generative adversarial network. Proceedings of the 26th ACM International Conference on Multimedia, Seoul, Korea.","DOI":"10.1145\/3240508.3240641"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Palazzo, S., Spampinato, C., Kavasidis, I., Giordano, D., and Shah, M. (2017, January 22\u201329). Generative adversarial networks conditioned by brain signals. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.369"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.neunet.2018.04.013","article-title":"Characterization of electroencephalography signals for estimating saliency features in videos","volume":"105","author":"Liang","year":"2018","journal-title":"Neural Netw."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41597-019-0027-4","article-title":"Multi-channel EEG recordings during a sustained-attention driving task","volume":"6","author":"Cao","year":"2019","journal-title":"Sci. Data"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"026017","DOI":"10.1088\/1741-2552\/aa5a98","article-title":"A multimodal approach to estimating vigilance using EEG and forehead EOG","volume":"14","author":"Zheng","year":"2017","journal-title":"J. Neural Eng."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kummerer, M., Wallis, T.S., and Bethge, M. (2018, January 8\u201314). Saliency benchmarking made easy: Separating models, maps and metrics. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01270-0_47"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1016\/j.neunet.2020.05.004","article-title":"Contextual encoder\u2013decoder network for visual saliency prediction","volume":"129","author":"Kroner","year":"2020","journal-title":"Neural Netw."},{"key":"ref_21","unstructured":"Kingma, D.P., and Welling, M. (2013). Auto-encoding variational bayes. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"6572","DOI":"10.1523\/JNEUROSCI.0241-20.2020","article-title":"Temporal signatures of criticality in human cortical excitability as probed by early somatosensory responses","volume":"40","author":"Stephani","year":"2020","journal-title":"J. Neurosci."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Salvucci, D.D., and Goldberg, J.H. (2000, January 6\u20138). Identifying fixations and saccades in eye-tracking protocols. Proceedings of the 2000 Symposium on Eye Tracking Research & Applications, Gardens, FL, USA.","DOI":"10.1145\/355017.355028"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the 2016 IEEE 29th Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Delvigne, V., Ris, L., Dutoit, T., Wannous, H., and Vandeborre, J.P. (2020, January 12\u201314). VERA: Virtual Environments Recording Attention. Proceedings of the 2020 IEEE 8th International Conference on Serious Games and Applications for Health (SeGAH), Vancouver, BC, Canada.","DOI":"10.1109\/SeGAH49190.2020.9201699"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"713","DOI":"10.1016\/S1388-2457(00)00527-7","article-title":"The five percent electrode system for high-resolution EEG and ERP measurements","volume":"112","author":"Oostenveld","year":"2001","journal-title":"Clin. Neurophysiol."},{"key":"ref_27","unstructured":"Francis, N., Ante, J., and Helgason, D. (2022, January 26). Unity Real-Time Development Platform. Available online: https:\/\/unity.com\/."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2397","DOI":"10.1016\/j.visres.2005.03.019","article-title":"Components of bottom-up gaze allocation in natural images","volume":"45","author":"Peters","year":"2005","journal-title":"Vis. Res."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1111\/j.2517-6161.1958.tb00292.x","article-title":"The regression analysis of binary sequences","volume":"20","author":"Cox","year":"1958","journal-title":"J. R. Stat. Soc. Ser. B"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"740","DOI":"10.1109\/TPAMI.2018.2815601","article-title":"What do different evaluation metrics tell us about saliency models?","volume":"41","author":"Bylinskii","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","unstructured":"Judd, T., Durand, F., and Torralba, A. (2022, March 03). A Benchmark of Computational Models of Saliency to pRedict Human Fixations. Available online: https:\/\/saliency.tuebingen.ai\/results.html."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"102613","DOI":"10.1016\/j.bspc.2021.102613","article-title":"Responses of functional brain networks while watching 2D and 3D videos: An EEG study","volume":"68","author":"Yu","year":"2021","journal-title":"Biomed. Signal Process. Control"}],"container-title":["Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9709\/9\/1\/26\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:33:29Z","timestamp":1760135609000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9709\/9\/1\/26"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,9]]},"references-count":32,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["informatics9010026"],"URL":"https:\/\/doi.org\/10.3390\/informatics9010026","relation":{},"ISSN":["2227-9709"],"issn-type":[{"value":"2227-9709","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,9]]}}}