{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T13:12:50Z","timestamp":1767964370770,"version":"3.49.0"},"reference-count":34,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2020,5,9]],"date-time":"2020-05-09T00:00:00Z","timestamp":1588982400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002592","name":"Kumoh National Institute of Technology","doi-asserted-by":"publisher","award":["2018-104-116"],"award-info":[{"award-number":["2018-104-116"]}],"id":[{"id":"10.13039\/501100002592","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Visual memorability is a method to measure how easily media contents can be memorized. Predicting the visual memorability of media contents has recently become more important because it can affect the design principles of multimedia visualization, advertisement, etc. Previous studies on the prediction of the visual memorability of images generally exploited visual features (e.g., color intensity and contrast) or semantic information (e.g., class labels) that can be extracted from images. Some other works tried to exploit electroencephalography (EEG) signals of human subjects to predict the memorability of text (e.g., word pairs). Compared to previous works, we focus on predicting the visual memorability of images based on human biological feedback (i.e., EEG signals). For this, we design a visual memory task where each subject is asked to answer whether they correctly remember a particular image 30 min after glancing at a set of images sampled from the LaMemdataset. During the visual memory task, EEG signals are recorded from subjects as human biological feedback. The collected EEG signals are then used to train various classification models for prediction of image memorability. Finally, we evaluate and compare the performance of classification models, including deep convolutional neural networks and classical methods, such as support vector machines, decision trees, and k-nearest neighbors. The experimental results validate that the EEG-based prediction of memorability is still challenging, but a promising approach with various opportunities and potentials.<\/jats:p>","DOI":"10.3390\/s20092694","type":"journal-article","created":{"date-parts":[[2020,5,11]],"date-time":"2020-05-11T12:26:30Z","timestamp":1589199990000},"page":"2694","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Prediction of Visual Memorability with EEG Signals: A Comparative Study"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9659-9641","authenticated-orcid":false,"given":"Sang-Yeong","family":"Jo","sequence":"first","affiliation":[{"name":"Department of Computer Engineering, Kumoh National Institute of Technology, Gumi 39177, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9313-6860","authenticated-orcid":false,"given":"Jin-Woo","family":"Jeong","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Kumoh National Institute of Technology, Gumi 39177, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,5,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2306","DOI":"10.1109\/TVCG.2013.234","article-title":"What Makes a Visualization Memorable?","volume":"19","author":"Borkin","year":"2013","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_2","unstructured":"Lu, J., Xu, M., Yang, R., and Wang, Z. (2018). Understanding and Predicting the Memorability of Natural Scene Images. arXiv."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Squalli-Houssaini, H., Duong, N.Q.K., Gwenaelle, M., and Demarty, C. (2018, January 15\u201320). Deep Learning for Predicting Image Memorability. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.","DOI":"10.1109\/ICASSP.2018.8462292"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Khosla, A., Raju, A.S., Torralba, A., and Oliva, A. (2015, January 7\u201313). Understanding and Predicting Image Memorability at a Large Scale. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.275"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1469","DOI":"10.1109\/TPAMI.2013.200","article-title":"What Makes a Photograph Memorable?","volume":"36","author":"Isola","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"7523","DOI":"10.1523\/JNEUROSCI.1948-06.2006","article-title":"Theta and Gamma Oscillations Predict Encoding and Retrieval of Declarative Memory","volume":"26","author":"Osipova","year":"2006","journal-title":"J. Neurosci."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Kang, T., Chen, Y., Kim, D., and Fazli, S. (2016, January 22\u201324). EEG-based decoding of declarative memory formation. Proceedings of the 2016 4th International Winter Conference on Brain-Computer Interface (BCI), Yongpyong, Korea.","DOI":"10.1109\/IWW-BCI.2016.7457460"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Kang, T., Chen, Y., Fazli, S., and Wallraven, C. (2018, January 15\u201317). Decoding of human memory formation with EEG signals using convolutional networks. Proceedings of the 2018 6th International Conference on Brain-Computer Interface (BCI), GangWon, Korea.","DOI":"10.1109\/IWW-BCI.2018.8311487"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Sun, X., Qian, C., Chen, Z., Wu, Z., Luo, B., and Pan, G. (2016). Remembered or Forgotten?\u2014An EEG-Based Computational Prediction Approach. PLoS ONE, 11.","DOI":"10.1371\/journal.pone.0167497"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"5391","DOI":"10.1002\/hbm.23730","article-title":"Deep learning with convolutional neural networks for EEG decoding and visualization","volume":"38","author":"Schirrmeister","year":"2017","journal-title":"Hum. Brain Mapp."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Huiskes, M.J., and Lew, M.S. (2008, January 30\u201331). The MIR Flickr Retrieval Evaluation. Proceedings of the 1st ACM International Conference on Multimedia Information Retrieval, Vancouver, BC, Canada.","DOI":"10.1145\/1460096.1460104"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Machajdik, J., and Hanbury, A. (2010, January 25\u201329). Affective Image Classification Using Features Inspired by Psychology and Art Theory. Proceedings of the 18th ACM International Conference on Multimedia, Firenze, Italy.","DOI":"10.1145\/1873951.1873965"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Khosla, A., Das Sarma, A., and Hamid, R. (2014, January 7\u201311). What Makes an Image Popular?. Proceedings of the 23rd International Conference on World Wide Web, Seoul, Korea.","DOI":"10.1145\/2566486.2567996"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1600","DOI":"10.1016\/j.neuroimage.2006.09.024","article-title":"10\/20, 10\/10, and 10\/5 systems revisited: Their validity as relative head-surface-based positioning systems","volume":"34","author":"Jurcak","year":"2007","journal-title":"NeuroImage"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1016\/j.neunet.2019.12.006","article-title":"A novel multi-modal machine learning based approach for automatic classification of EEG recordings in dementia","volume":"123","author":"Ieracitano","year":"2020","journal-title":"Neural Netw."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.jneumeth.2003.10.009","article-title":"EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis","volume":"134","author":"Delorme","year":"2004","journal-title":"J. Neurosci. Methods"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"051001","DOI":"10.1088\/1741-2552\/ab260c","article-title":"Deep learning-based electroencephalography analysis: A systematic review","volume":"16","author":"Roy","year":"2019","journal-title":"J. Neural Eng."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Ang, K.K., Chin, Z.Y., Wang, C., Guan, C., and Zhang, H. (2012). Filter bank common spatial pattern algorithm on BCI competition IV datasets 2a and 2b. Front. Neurosci.","DOI":"10.3389\/fnins.2012.00039"},{"key":"ref_19","unstructured":"Pereira, F., Burges, C.J.C., Bottou, L., and Weinberger, K.Q. (2012). ImageNet Classification with Deep Convolutional Neural Networks. Advances in Neural Information Processing Systems 25, Curran Associates, Inc."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., v. d. Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely Connected Convolutional Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_22","unstructured":"Guyon, I., Luxburg, U.V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., and Garnett, R. (2017). Dynamic Routing Between Capsules. Advances in Neural Information Processing Systems 30, Curran Associates, Inc."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Nik Aznan, N.K., Bonner, S., Connolly, J., Al Moubayed, N., and Breckon, T. (2018, January 7\u201310). On the Classification of SSVEP-Based Dry-EEG Signals via Convolutional Neural Networks. Proceedings of the 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Miyazaki, Japan.","DOI":"10.1109\/SMC.2018.00631"},{"key":"ref_24","first-page":"10019","article-title":"Hierarchical Deep Feature Learning For Decoding Imagined Speech From EEG","volume":"33","author":"Saha","year":"2019","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhang, J., Yan, C., and Gong, X. (2017, January 22\u201325). Deep convolutional neural network for decoding motor imagery based brain computer interface. Proceedings of the 2017 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC), Xiamen, China.","DOI":"10.1109\/ICSPCC.2017.8242581"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Golmohammadi, M., Ziyabari, S., Shah, V., Obeid, I., and Picone, J. (2018, January 17\u201320). Deep Architectures for Spatio-Temporal Modeling: Automated Seizure Detection in Scalp EEGs. Proceedings of the 17th IEEE International Conference on Machine Learning and Applications, ICMLA 2018, Orlando, FL, USA.","DOI":"10.1109\/ICMLA.2018.00118"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ha, K.W., and Jeong, J.W. (2019). Motor Imagery EEG Classification Using Capsule Networks. Sensors, 19.","DOI":"10.3390\/s19132854"},{"key":"ref_28","unstructured":"Ang, K.K., Chin, Z.Y., Zhang, H., and Guan, C. (2008, January 1\u20136). Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface. Proceedings of the 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), Hong Kong, China."},{"key":"ref_29","unstructured":"Loshchilov, I., and Hutter, F. (2019, January 6\u20139). Decoupled Weight Decay Regularization. Proceedings of the 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA."},{"key":"ref_30","unstructured":"Clevert, D., Unterthiner, T., and Hochreiter, S. (2016, January 2\u20134). Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs). Proceedings of the 4th International Conference on Learning Representations, ICLR 2016, Conference Track Proceedings, San Juan, Puerto Rico."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Lin, T., Goyal, P., Girshick, R.B., He, K., and Doll\u00e1r, P. (2017). Focal Loss for Dense Object Detection. arXiv.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_32","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1228","DOI":"10.1049\/iet-ipr.2017.0631","article-title":"Rules of photography for image memorabilityanalysis","volume":"12","author":"Lahrache","year":"2018","journal-title":"IET Image Process."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Kwak, Y., Song, W., and Kim, S. (2019, January 18\u201320). Classification of Working Memory Performance from EEG with Deep Artificial Neural Networks. Proceedings of the 2019 7th International Winter Conference on Brain-Computer Interface (BCI), Gangwon, Korea.","DOI":"10.1109\/IWW-BCI.2019.8737343"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/9\/2694\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:27:01Z","timestamp":1760174821000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/9\/2694"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,9]]},"references-count":34,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2020,5]]}},"alternative-id":["s20092694"],"URL":"https:\/\/doi.org\/10.3390\/s20092694","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,5,9]]}}}