{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,28]],"date-time":"2025-03-28T04:34:00Z","timestamp":1743136440275,"version":"3.40.3"},"publisher-location":"Cham","reference-count":21,"publisher":"Springer International Publishing","isbn-type":[{"type":"print","value":"9783030824266"},{"type":"electronic","value":"9783030824273"}],"license":[{"start":{"date-parts":[[2021,1,1]],"date-time":"2021-01-01T00:00:00Z","timestamp":1609459200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,7,21]],"date-time":"2021-07-21T00:00:00Z","timestamp":1626825600000},"content-version":"vor","delay-in-days":201,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Recent research on face analysis has demonstrated the richness of information embedded in feature vectors extracted from a deep convolutional neural network. Even though deep learning achieved a very high performance on several challenging visual tasks, such as determining the identity, age, gender and race, it still lacks a well grounded theory which allows to properly understand the processes taking place inside the network layers. Therefore, most of the underlying processes are unknown and not easy to control. On the other hand, the human visual system follows a well understood process in analyzing a scene or an object, such as a face. The direction of the eye gaze is repeatedly directed, through purposively planned saccadic movements, towards salient regions to capture several details. In this paper we propose to capitalize on the knowledge of the saccadic human visual processes to design a system to predict facial attributes embedding a biologically-inspired network architecture, the HMAX. The architecture is tailored to predict attributes with different textural information and conveying different semantic meaning, such as attributes related and unrelated to the subject\u2019s identity. Salient points on the face are extracted from the outputs of the S2 layer of the HMAX architecture and fed to a local texture characterization module based on LBP (Local Binary Pattern). The resulting feature vector is used to perform a binary classification on a set of pre-defined visual attributes. The devised system allows to distill a very informative, yet robust, representation of the imaged faces, allowing to obtain high performance but with a much simpler architecture as compared to a deep convolutional neural network. Several experiments performed on publicly available, challenging, large datasets demonstrate the validity of the proposed approach.<\/jats:p>","DOI":"10.1007\/978-3-030-82427-3_9","type":"book-chapter","created":{"date-parts":[[2021,7,20]],"date-time":"2021-07-20T07:03:33Z","timestamp":1626764613000},"page":"116-127","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["An Hybrid Attention-Based System for\u00a0the\u00a0Prediction of Facial Attributes"],"prefix":"10.1007","author":[{"given":"Souad","family":"Khellat-Kihel","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhenan","family":"Sun","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Massimo","family":"Tistarelli","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,7,21]]},"reference":[{"key":"9_CR1","doi-asserted-by":"publisher","unstructured":"Liu, Z., Luo, P., Wang, X., Tang, X.: Deep learning face attributes in the wild. In: 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, pp. 3730\u20133738 (2015). https:\/\/doi.org\/10.1109\/ICCV.2015.425","DOI":"10.1109\/ICCV.2015.425"},{"key":"9_CR2","doi-asserted-by":"crossref","unstructured":"Samangouei, P., Chellappa, R.: Convolutional neural networks for attribute-based active authentication on mobile devices. In: 2016 IEEE 8th International Conference on Biometrics Theory, Applications and Systems (BTAS), Niagara Falls, NY, pp. 1\u20138 (2016)","DOI":"10.1109\/BTAS.2016.7791163"},{"key":"9_CR3","doi-asserted-by":"crossref","unstructured":"Samangouei, P., Patel, V.M., Chellappa, R.: Attribute-based continuous user authentication on mobile devices. In: 2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems (BTAS), Arlington, VA, pp. 1\u20138 (2015)","DOI":"10.1109\/BTAS.2015.7358748"},{"key":"9_CR4","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1016\/j.imavis.2016.05.004","volume":"58","author":"P Samangouei","year":"2017","unstructured":"Samangouei, P., Patel, V.M., Chellappa, R.: Facial attributes for active authentication on mobile devices. Image Vis. Comput. 58, 181\u2013192 (2017). ISSN 0262-8856","journal-title":"Image Vis. Comput."},{"key":"9_CR5","doi-asserted-by":"crossref","unstructured":"Dhar, P., Bansal, A., Castillo, C., Gleason, J., Phillips, P.J., Chellappa, R.: How are attributes expressed in face DCNNs?, arXiv preprint arXiv:1910.05657 (2019)","DOI":"10.1109\/FG47880.2020.00009"},{"key":"9_CR6","unstructured":"Izadi, M.R.: Feature Level Fusion from Facial Attributes for Face Recognition, arXiv preprint arXiv: 1909.13126, September 2019"},{"key":"9_CR7","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1007\/978-3-030-33904-3_3","volume-title":"Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications","author":"S Khellat-Kihel","year":"2019","unstructured":"Khellat-Kihel, S., Lagorio, A., Tistarelli, M.: Foveated vision for deepface recognition. In: Nystr\u00f6m, I., Hern\u00e1ndez Heredia, Y., Mili\u00e1n N\u00fa\u00f1ez, V. (eds.) CIARP 2019. LNCS, vol. 11896, pp. 31\u201341. Springer, Cham (2019). https:\/\/doi.org\/10.1007\/978-3-030-33904-3_3"},{"issue":"9","key":"9_CR8","doi-asserted-by":"publisher","first-page":"1364","DOI":"10.1016\/j.tics.2018.06.006","volume":"22","author":"AJ O\u2019Toole","year":"2018","unstructured":"O\u2019Toole, A.J., Castillo, C.D., Padre, C.J., Hill, M.Q., Chellappa, R.: Face space representations in deep convolutional neural networks. Trends Cogn. Sci. 22(9), 1364\u20136613 (2018)","journal-title":"Trends Cogn. Sci."},{"key":"9_CR9","unstructured":"Liao, Q., Leibo, J.Z., Poggio, T.: Learning invariant representations and applications to face verification. In: NIPS 2013 Proceedings of the 26th International Conference on Neural Information Processing Systems, Lake Tahoe, Nevada, vol. 2, pp. 3057\u20133065 (2013)"},{"key":"9_CR10","unstructured":"Esmaili, S., Maghooli, K., Motie Nasrabadi, A.: C3 effective features inspired from ventral and dorsal stream of visual cortex for view independent face recognition. Adv. Comput. Sci. 1\u20139 (2016). ISSN 2322-5157"},{"issue":"1","key":"9_CR11","doi-asserted-by":"publisher","first-page":"e81813","DOI":"10.1371\/journal.pone.0081813","volume":"9","author":"X Hu","year":"2014","unstructured":"Hu, X., Zhang, J., Li, J., Zhang, B.: Sparsity-regularized HMAX for visual recognition. PLoS ONE 9(1), e81813 (2014). https:\/\/doi.org\/10.1371\/journal.pone.0081813","journal-title":"PLoS ONE"},{"key":"9_CR12","doi-asserted-by":"publisher","first-page":"1019","DOI":"10.1038\/14819","volume":"2","author":"M Riesenhuber","year":"1999","unstructured":"Riesenhuber, M., Poggio, T.: Hierarchical models of object recognition in cortex. Nat. Neurosci. 2, 1019\u20131025 (1999). https:\/\/doi.org\/10.1038\/14819","journal-title":"Nat. Neurosci."},{"key":"9_CR13","unstructured":"HMAX toolbox. http:\/\/maxlab.neuro.georgetown.edu\/hmax.html"},{"key":"9_CR14","unstructured":"Ayat, N.: S\u00e9lection automatique de mod\u00e8le dans les machines \u00e0 vecteurs de support: application \u00e0 la reconnaissance d\u2019images de chiffres manuscrits. Th\u00e8se de doctorat \u00e9lectronique, Montr\u00e9al, \u00c9cole de technologie sup\u00e9rieure (2004)"},{"key":"9_CR15","unstructured":"Canu, S., Grandvalet, Y., Guigue, V., Rakotomamonjy, A.: SVM and Kernel Methods Matlab Toolbox. Perception Systemes et Information, INSA de Rouen, Rouen, France (2005)"},{"key":"9_CR16","doi-asserted-by":"publisher","unstructured":"Kumar, N., Berg, A.C., Belhumeur, P.N., Nayar, S.K.: Attribute and simile classifiers for face verification. In: 2009 IEEE 12th International Conference on Computer Vision, Kyoto, pp. 365\u2013372 (2009). https:\/\/doi.org\/10.1109\/ICCV.2009.5459250","DOI":"10.1109\/ICCV.2009.5459250"},{"key":"9_CR17","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"340","DOI":"10.1007\/978-3-540-88693-8_25","volume-title":"Computer Vision \u2013 ECCV 2008","author":"N Kumar","year":"2008","unstructured":"Kumar, N., Belhumeur, P., Nayar, S.: FaceTracer: a search engine for large collections of images with faces. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008. LNCS, vol. 5305, pp. 340\u2013353. Springer, Heidelberg (2008). https:\/\/doi.org\/10.1007\/978-3-540-88693-8_25"},{"key":"9_CR18","doi-asserted-by":"publisher","unstructured":"Zhang, N., Paluri, M., Ranzato, M., Darrell, T., Bourdev, L.: PANDA: pose aligned networks for deep attribute modeling. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, pp. 1637\u20131644 (2014). https:\/\/doi.org\/10.1109\/CVPR.2014.212","DOI":"10.1109\/CVPR.2014.212"},{"key":"9_CR19","unstructured":"http:\/\/www.cs.columbia.edu\/CAVE\/databases\/pubfig\/"},{"key":"9_CR20","unstructured":"ImageNet. http:\/\/www.image-net.org"},{"key":"9_CR21","unstructured":"Krizhevsky, A., Ilya, S., Geoffrey, E.H.: ImageNet classification with deep convolutional neural networks. In: NIPS 2012 Proceedings of the 25th International Conference on Neural Information Processing Systems, vol. 1, pp. 1097\u20131105 (2012)"}],"container-title":["Lecture Notes in Computer Science","Brain-Inspired Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-030-82427-3_9","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,20]],"date-time":"2021-07-20T07:15:54Z","timestamp":1626765354000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-030-82427-3_9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021]]},"ISBN":["9783030824266","9783030824273"],"references-count":21,"URL":"https:\/\/doi.org\/10.1007\/978-3-030-82427-3_9","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"type":"print","value":"0302-9743"},{"type":"electronic","value":"1611-3349"}],"subject":[],"published":{"date-parts":[[2021]]},"assertion":[{"value":"21 July 2021","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"BrainComp","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"International Workshop on Brain-Inspired Computing","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Cetraro","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Italy","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2019","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"15 July 2019","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"19 July 2019","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"4","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"braincomp2019","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"http:\/\/www.fz-juelich.de\/inm\/inm-1\/EN\/Aktuelles\/BrainComp2019\/_node.html","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}}]}}