{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T23:01:54Z","timestamp":1777935714566,"version":"3.51.4"},"reference-count":64,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,23]],"date-time":"2021-12-23T00:00:00Z","timestamp":1640217600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003069","name":"Instituto Polit\u00e9cnico Nacional","doi-asserted-by":"publisher","award":["20210169"],"award-info":[{"award-number":["20210169"]}],"id":[{"id":"10.13039\/501100003069","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003141","name":"Consejo Nacional de Ciencia y Tecnolog\u00eda","doi-asserted-by":"publisher","award":["APN2017 \u2013 5241"],"award-info":[{"award-number":["APN2017 \u2013 5241"]}],"id":[{"id":"10.13039\/501100003141","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this work we describe a system composed of deep neural networks that analyzes characteristics of customers based on their face (age, gender, and personality), as well as the ambient temperature, with the purpose of generating a personalized signal to potential buyers who pass in front of a beverage establishment; faces are automatically detected, displaying a recommendation using deep learning methods. In order to present suitable digital posters for each person, several technologies were used: Augmented reality, estimation of age, gender, and estimation of personality through the Big Five test applied to an image. The accuracy of each one of these deep neural networks is measured separately to ensure an appropriate precision over 80%. The system has been implemented into a portable solution, and is able to generate a recommendation to one or more people at the same time.<\/jats:p>","DOI":"10.3390\/s22010063","type":"journal-article","created":{"date-parts":[[2021,12,23]],"date-time":"2021-12-23T21:40:21Z","timestamp":1640295621000},"page":"63","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Deep-Learning-Based Adaptive Advertising with Augmented Reality"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1028-9197","authenticated-orcid":false,"given":"Marco A.","family":"Moreno-Armend\u00e1riz","sequence":"first","affiliation":[{"name":"Centro de Investigaci\u00f3n en Computaci\u00f3n, Instituto Polit\u00e9cnico Nacional, Ciudad de Mexico 07738, Mexico"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2836-2102","authenticated-orcid":false,"given":"Hiram","family":"Calvo","sequence":"additional","affiliation":[{"name":"Centro de Investigaci\u00f3n en Computaci\u00f3n, Instituto Polit\u00e9cnico Nacional, Ciudad de Mexico 07738, Mexico"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2734-7560","authenticated-orcid":false,"given":"Carlos A.","family":"Duchanoy","sequence":"additional","affiliation":[{"name":"Gus Chat, Ciudad de Mexico 06600, Mexico"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2216-8608","authenticated-orcid":false,"given":"Arturo","family":"Lara-C\u00e1zares","sequence":"additional","affiliation":[{"name":"Escuela Superior de C\u00f3mputo, Instituto Polit\u00e9cnico Nacional, Ciudad de Mexico 07738, Mexico"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9583-1311","authenticated-orcid":false,"given":"Enrique","family":"Ramos-Diaz","sequence":"additional","affiliation":[{"name":"Escuela Superior de C\u00f3mputo, Instituto Polit\u00e9cnico Nacional, Ciudad de Mexico 07738, Mexico"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2194-971X","authenticated-orcid":false,"given":"V\u00edctor L.","family":"Morales-Flores","sequence":"additional","affiliation":[{"name":"Escuela Superior de C\u00f3mputo, Instituto Polit\u00e9cnico Nacional, Ciudad de Mexico 07738, Mexico"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.elerap.2011.05.002","article-title":"How to Design Personalization in a Context of Customer Retention: Who Personalizes What and to What Extent?","volume":"11","author":"Kwon","year":"2012","journal-title":"Electron. Commer. Rec. Appl."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Bleier, A., De Keyser, A., and Verleye, K. (2018). Customer Engagement through Personalization and Customization, Palgrave Macmillan.","DOI":"10.1007\/978-3-319-61985-9_4"},{"key":"ref_3","first-page":"7","article-title":"A Survey on Recommendation System","volume":"160","author":"Das","year":"2017","journal-title":"Int. J. Comput. Appl."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Brusilovski, P., Kobsa, A., and Nejdl, W. (2007). The Adaptive Web: Methods and Strategies of Web Personalization, Springer Science & Business Media.","DOI":"10.1007\/978-3-540-72079-9"},{"key":"ref_5","unstructured":"AINIA (2020, December 19). M\u00e1s del 55 por Ciento de los Millennials Prefiere el Sabor Dulce. Available online: https:\/\/www.ainia.es\/noticias\/prensa\/mas-del-55-por-ciento-de-los-millennials-prefiere-el-sabor-dulce\/?fbclid=IwAR3Wm2DDvxBTjzFg2P9FBGush3EcyNdMfkMq3JwypAyLQSyezrzqXSZV9cg."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Barrag\u00e1n, R., Coltell, O., Portol\u00e9s, O., Asensio, E.M., Sorl\u00ed, J.V., Ortega-Azor\u00edn, C., Gonz\u00e1lez, J.I., S\u00e1iz, C., Fern\u00e1ndez-Carri\u00f3n, R., and Ordovas, J.M. (2018). Bitter, Sweet, Salty, Sour and Umami Taste Perception Decreases with Age: Sex-specific Analysis, Modulation by Genetic Variants and Taste-preference Associations in 18 to 80 year-old subjects. Nutrients, 10.","DOI":"10.3390\/nu10101539"},{"key":"ref_7","first-page":"83","article-title":"Gender Differences In Food Choice And Dietary Intake In Modern Western Societies","volume":"4","author":"Claudia","year":"2012","journal-title":"Public Health-Soc. Behav. Health"},{"key":"ref_8","unstructured":"Day, C.J. (2009). An Exploration of the Relationships Between Personality, Eating Behaviour and Taste Preference. [Ph.D. Thesis, Sheffield Hallam University]."},{"key":"ref_9","first-page":"1","article-title":"A Guide To Convolutional Neural Networks For Computer Vision","volume":"8","author":"Khan","year":"2018","journal-title":"Synth. Lect. Comput. Vis."},{"key":"ref_10","unstructured":"Intel, C. (2019, September 01). Digital Signage Solutions Including Intel AIM Suite. Available online: https:\/\/aimsuite.intel.com\/sites\/default\/files\/resources\/Presentation%20-%20Intel%20OSC%20Digital%20Signage%20Webinar%20-%20Oct%2013%2C%202011.pdf."},{"key":"ref_11","unstructured":"Intel, C. (2019, September 01). Inside AIM Suite: Pricing\/Licensing. Available online: https:\/\/aimsuite.intel.com\/inside-aim-suite\/pricinglicensing."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Wang, J., Xie, H., Au, O.T.S., Zou, D., and Wang, F.L. (2020, January 24\u201327). Attention-based CNN for personalized course recommendations for MOOC learners. Proceedings of the 2020 International Symposium on Educational Technology (ISET), Bangkok, Thailand.","DOI":"10.1109\/ISET49818.2020.00047"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Liu, D., Li, J., Du, B., Chang, J., and Gao, R. (2019). DAML: Dual Attention Mutual Learning between Ratings and Reviews for Item Recommendation. KDD \u201919, Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Association for Computing Machinery.","DOI":"10.1145\/3292500.3330906"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Yang, M., Zhu, S., Lv, F., and Yu, K. (2011, January 20\u201325). Correspondence Driven Adaptation for Human Profile Recognitional. Proceedings of the CVPR 2011, Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995481"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Orozco, C.I., Iglesias, F., Buemi, M.E., and Berlles, J.J. (2017, January 6\u20137). Real-time Gender Recognition From Face Images Using Deep Convolutional Neural Network. Proceedings of the 7th Latin American Conference on Networked and Electronic Media (LACNEM 2017), Valparaiso, Chile.","DOI":"10.1049\/ic.2017.0027"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Ranjan, R., Sankaranarayanan, S., Castillo, C.D., and Chellappa, R. (June, January 30). An All-in-one Convolutional Neural Network For Face Analysis. Proceedings of the 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017), Washington, DC, USA.","DOI":"10.1109\/FG.2017.137"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1016\/j.patcog.2017.01.005","article-title":"Diagnosing Deep Learning Models for High Accuracy Age Estimation from a Single Image","volume":"66","author":"Xing","year":"2017","journal-title":"Pattern Recognit."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Vasileiadis, M., Stavropoulos, G., and Tzovaras, D. (2019, January 16\u201317). Facial soft biometrics detection on low power devices. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, Long Beach, CA, USA.","DOI":"10.1109\/CVPRW.2019.00285"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zhang, X., Liu, C., and Su, Z. (2017, January 25\u201327). Face detection system based on video stream. Proceedings of the 2017 International Conference on Computer Systems, Electronics and Control (ICCSEC), Dalian, China.","DOI":"10.1109\/ICCSEC.2017.8446978"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2853","DOI":"10.1007\/s11277-018-5311-7","article-title":"Video face detection based on deep learning","volume":"102","author":"Liu","year":"2018","journal-title":"Wirel. Pers. Commun."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Ye, X., Ji, B., Chen, X., Qian, D., and Zhao, Z. (2020, January 17\u201319). Probability Boltzmann Machine Network for Face Detection on Video. Proceedings of the 2020 13th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), Chengdu, China.","DOI":"10.1109\/CISP-BMEI51763.2020.9263555"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zhou, Y., Ni, H., Ren, F., and Kang, X. (2019, January 4\u20137). Face and gender recognition system based on convolutional neural networks. Proceedings of the 2019 IEEE International Conference on Mechatronics and Automation (ICMA), Tianjin, China.","DOI":"10.1109\/ICMA.2019.8816192"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Greco, A., Saggese, A., and Vento, M. (2020, January 3\u20135). Digital signage by real-time gender recognition from face images. Proceedings of the 2020 IEEE International Workshop on Metrology for Industry 4.0 & IoT, Roma, Italy.","DOI":"10.1109\/MetroInd4.0IoT48571.2020.9138194"},{"key":"ref_24","unstructured":"Moreno Sotelo, M. (2019). Smart Prediction of Apparent Personality Traits through Big Five from Selfies. [Master\u2019s Thesis, CIC-IPN]."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Ponce-L\u00f3pez, V., Chen, B., Oliu, M., Corneanu, C., Clap\u00e9s, A., Guyon, I., Bar\u00f3, X., Escalante, H.J., and Escalera, S. (2016, January 8\u201316). ChaLearn LAP 2016: First Round Challenge on First Impressions-Dataset and Results. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-49409-8_32"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1109\/MMUL.2018.023121162","article-title":"Integrating Vision and Language for First-Impression Personality Analysis","volume":"25","author":"Gorbova","year":"2018","journal-title":"IEEE Multimed."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Kampman, O., J. Barezi, E., Bertero, D., and Fung, P. (2018). Investigating Audio, Video, and Text Fusion Methods for End-to-End Automatic Personality Prediction. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Association for Computational Linguistics.","DOI":"10.18653\/v1\/P18-2096"},{"key":"ref_28","unstructured":"Jacques J\u00fanior, J.C.S., G\u00fc\u00e7l\u00fct\u00fcrk, Y., P\u00e9rez, M., G\u00fc\u00e7l\u00fc, U., And\u00fajar, C., Bar\u00f3, X., Escalante, H.J., Guyon, I., van Gerven, M.A.J., and van Lier, R. (2018). First Impressions: A Survey on Computer Vision-Based Apparent Personality Trait Analysis. arXiv."},{"key":"ref_29","unstructured":"Moreno Sotelo, M. (2020, December 22). Personality. Available online: https:\/\/github.com\/miguelmore\/personality."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1007\/s11042-010-0660-6","article-title":"Augmented Reality Technologies, Systems and Applications","volume":"51","author":"Carmigniani","year":"2011","journal-title":"Multimed. Tools Appl."},{"key":"ref_31","unstructured":"Mirror, M. (2019, September 01). Magic Mirror Technologies and Latest Development. Available online: https:\/\/www.magicmirror.me\/Products\/Photobooth-Technologies."},{"key":"ref_32","unstructured":"Mirrors, T.W. (2019, September 01). Smart Mirror Product Information (For 2019). Available online: https:\/\/www.twowaymirrors.com\/smart-mirror\/."},{"key":"ref_33","unstructured":"Arcangel, A. (2019, September 01). Snapchat Filters: How Do They Work?. Available online: https:\/\/dev.to\/aubreyarcangel\/snapchat-filters-how-do-theywork-4c83."},{"key":"ref_34","unstructured":"Kohl\u2019s (2021, December 07). Kohl\u2019s\u2014Virtual Closet with Snapchat. Available online: https:\/\/wwd.com\/fashion-news\/fashion-features\/snapchat-kohls-virtual-closet-coronavirus-1203629594\/."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"621","DOI":"10.1016\/j.bushor.2021.02.027","article-title":"Strategies for the Successful Implementation of Augmented Reality","volume":"64","author":"Berman","year":"2021","journal-title":"Bus. Horizons"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Plotkina, D., Dinsmore, J., and Racat, M. (2021). Improving service brand personality with augmented reality marketing. J. Serv. Mark.","DOI":"10.1108\/JSM-12-2020-0519"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Kim, M., Choi, S.H., Park, K.B., and Lee, J.Y. (2021). A Hybrid Approach to Industrial Augmented Reality Using Deep Learning-Based Facility Segmentation and Depth Prediction. Sensors, 21.","DOI":"10.3390\/s21010307"},{"key":"ref_38","unstructured":"Wayfair (2021, December 07). Wayfair\u2014View in Room. Available online: https:\/\/www.aboutwayfair.com\/2020\/09\/augmented-reality-with-a-purpose\/."},{"key":"ref_39","unstructured":"Ikea (2021, December 07). Ikea Augmented Reality App. Available online: https:\/\/www.ikea.com\/au\/en\/customer-service\/mobile-apps\/say-hej-to-ikea-place-pub1f8af050."},{"key":"ref_40","unstructured":"Adidas (2021, December 07). Adidas AR Sneakers Try on App. Available online: https:\/\/www.virtualrealitymarketing.com\/case-studies\/adidas-ar-sneakers-try-on-app-2\/."},{"key":"ref_41","unstructured":"Gilliland, N. (2021, December 07). 14 Examples of Augmented Reality Brand Experiences. Available online: https:\/\/econsultancy.com\/14-examples-augmentedreality-brand-marketing-experiences\/."},{"key":"ref_42","unstructured":"Asos (2021, December 07). Asos Virtual Catwalk. Available online: https:\/\/www.youtube.com\/watch?v=Nr6OEU-9_Vs."},{"key":"ref_43","unstructured":"Hamid, N.F.I.A., Din, F.A.M., Izham, S., and Isa, S.N.M. (2016). An Interactive Mobile Augmented Reality for Advertising Industry. Proceedings of the SAI Intelligent Systems Conference, Springer."},{"key":"ref_44","unstructured":"Zara (2021, December 07). Zara Virtual Models. Available online: https:\/\/www.youtube.com\/watch?v=PTiT-Y4y7AI."},{"key":"ref_45","unstructured":"Sephora (2021, December 07). Sephora\u2014Virtual Artist. Available online: https:\/\/www.sephora.sg\/pages\/virtual-artist."},{"key":"ref_46","unstructured":"Lacoste (2021, December 07). Lacoste LCST App. Available online: https:\/\/vimeo.com\/89596935."},{"key":"ref_47","unstructured":"Parfumerie, H. (2021, December 07). Augmented Reality App. Available online: https:\/\/vimeo.com\/160245751."},{"key":"ref_48","unstructured":"Converse, C. (2021, December 07). Converse Sampler App. Available online: https:\/\/www.youtube.com\/watch?v=4NzB5Cb6HNk."},{"key":"ref_49","unstructured":"Buttazzo, G., Lipari, G., Abeni, L., and Caccamo, M. (2005). Soft Real-Time Systems, Springer."},{"key":"ref_50","unstructured":"Hikvision (2020, April 12). User Manual UD14456B Network Camera. Available online: https:\/\/www.hikvision.com\/mtsc\/uploads\/product\/accessory\/UD14456B_Baseline_User_Manual_of_Network_Camera_V5.6.0_20190430.pdf."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016). SSD: Single Shot Multibox Detector. European Conference On Computer Vision, Springer.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_52","unstructured":"Tsang, S.H. (2020, April 17). Review: MobileNetV1\u2014Depthwise Separable Convolution (Light Weight Model). Available online: https:\/\/towardsdatascience.com\/review-mobilenetv1-depthwise-separable-convolution-light-weight-model-a382df364b69."},{"key":"ref_53","unstructured":"Huang, J., Rathod, V., Chow, D., Sun, C., Zhu, M., Fathi, A., and Lu, Z. (2020, December 07). Tensorflow Object Detection Api. Available online: https:\/\/github.com\/tensorflow\/models\/tree\/master\/research\/object_detection."},{"key":"ref_54","unstructured":"Mishra, D., and DataTurks (2020, December 07). Face Detection in Images Dataset. Available online: https:\/\/www.kaggle.com\/dataturks\/face-detection-in-images."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Vemulapalli, R., and Agarwala, A. (2019, January 15\u201320). A Compact Embedding for Facial Expression Similarity. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00583"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"201649","DOI":"10.1109\/ACCESS.2020.3034639","article-title":"Estimation of Personality Traits From Portrait Pictures Using the Five-Factor Model","volume":"8","author":"Calvo","year":"2020","journal-title":"IEEE Access"},{"key":"ref_57","unstructured":"OpenWeather (2020, December 10). OpenWeather Mobile App. Available online: https:\/\/openweathermap.org\/."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"S2997","DOI":"10.1111\/1750-3841.13555","article-title":"Using Single Free Sorting and Multivariate Exploratory Methods to Design a New Coffee Taster\u2019s Flavor Wheel","volume":"81","author":"Spencer","year":"2016","journal-title":"J. Food Sci."},{"key":"ref_59","unstructured":"NVIDIA (2020, December 08). Jetson AGX Xavier Developer Kit. Available online: https:\/\/developer.nvidia.com\/embedded\/jetson-agx-xavier-developer-kit."},{"key":"ref_60","unstructured":"NVIDIA (2020, March 28). Jetson AGX Xavier and the New Era Of Autonomous Machines. Available online: http:\/\/info.nvidia.com\/rs\/156-OFN-742\/images\/Jetson_AGX_Xavier_New_Era_Autonomous_Machines.pdf."},{"key":"ref_61","unstructured":"NVIDIA (2020, March 29). Jetpack. Available online: https:\/\/developer.nvidia.com\/embedded\/jetpack."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Rezatofighi, H., Tsoi, N., Gwak, J., Sadeghian, A., Reid, I., and Savarese, S. (2019, January 15\u201320). Generalized intersection over union: A metric and a loss for bounding box regression. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00075"},{"key":"ref_63","unstructured":"Town, B. (2021, December 08). Bubble Town Website. Available online: https:\/\/3498523.wixsite.com\/bubbletown."},{"key":"ref_64","unstructured":"CIC (2021, December 08). CIC Website, Available online: https:\/\/www.cic.ipn.mx."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/1\/63\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:51:42Z","timestamp":1760169102000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/1\/63"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,23]]},"references-count":64,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["s22010063"],"URL":"https:\/\/doi.org\/10.3390\/s22010063","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,23]]}}}