{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,27]],"date-time":"2025-10-27T20:46:24Z","timestamp":1761597984444,"version":"build-2065373602"},"reference-count":25,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2018,9,7]],"date-time":"2018-09-07T00:00:00Z","timestamp":1536278400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010661","name":"Horizon 2020","doi-asserted-by":"publisher","award":["643924"],"award-info":[{"award-number":["643924"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Computer vision and deep learning are clearly demonstrating a capability to create engaging cognitive applications and services. However, these applications have been mostly confined to powerful Graphic Processing Units (GPUs) or the cloud due to their demanding computational requirements. Cloud processing has obvious bandwidth, energy consumption and privacy issues. The Eyes of Things (EoT) is a powerful and versatile embedded computer vision platform which allows the user to develop artificial vision and deep learning applications that analyse images locally. In this article, we use the deep learning capabilities of an EoT device for a real-life facial informatics application: a doll capable of recognizing emotions, using deep learning techniques, and acting accordingly. The main impact and significance of the presented application is in showing that a toy can now do advanced processing locally, without the need of further computation in the cloud, thus reducing latency and removing most of the ethical issues involved. Finally, the performance of the convolutional neural network developed for that purpose is studied and a pilot was conducted on a panel of 12 children aged between four and ten years old to test the doll.<\/jats:p>","DOI":"10.3390\/sym10090387","type":"journal-article","created":{"date-parts":[[2018,9,7]],"date-time":"2018-09-07T11:47:41Z","timestamp":1536320861000},"page":"387","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Smart Doll: Emotion Recognition Using Embedded Deep Learning"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5377-848X","authenticated-orcid":false,"given":"Jose Luis","family":"Espinosa-Aranda","sequence":"first","affiliation":[{"name":"VISILAB, University of Castilla-La Mancha, E.T.S.I. Industriales, Avda Camilo Jose Cela s\/n, 13071 Ciudad Real, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Noelia","family":"Vallez","sequence":"additional","affiliation":[{"name":"VISILAB, University of Castilla-La Mancha, E.T.S.I. Industriales, Avda Camilo Jose Cela s\/n, 13071 Ciudad Real, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jose Maria","family":"Rico-Saavedra","sequence":"additional","affiliation":[{"name":"VISILAB, University of Castilla-La Mancha, E.T.S.I. Industriales, Avda Camilo Jose Cela s\/n, 13071 Ciudad Real, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Javier","family":"Parra-Patino","sequence":"additional","affiliation":[{"name":"VISILAB, University of Castilla-La Mancha, E.T.S.I. Industriales, Avda Camilo Jose Cela s\/n, 13071 Ciudad Real, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7345-4869","authenticated-orcid":false,"given":"Gloria","family":"Bueno","sequence":"additional","affiliation":[{"name":"VISILAB, University of Castilla-La Mancha, E.T.S.I. Industriales, Avda Camilo Jose Cela s\/n, 13071 Ciudad Real, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matteo","family":"Sorci","sequence":"additional","affiliation":[{"name":"nViso SA, PSE-D, Site EPFL, CH-1015 Lausanne, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Moloney","sequence":"additional","affiliation":[{"name":"Intel R&amp;D Ireland Ltd., Collinstown Industrial Park, Leixlip, Co Kildare W23 CW68, Ireland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dexmont","family":"Pena","sequence":"additional","affiliation":[{"name":"Intel R&amp;D Ireland Ltd., Collinstown Industrial Park, Leixlip, Co Kildare W23 CW68, Ireland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0841-4131","authenticated-orcid":false,"given":"Oscar","family":"Deniz","sequence":"additional","affiliation":[{"name":"VISILAB, University of Castilla-La Mancha, E.T.S.I. Industriales, Avda Camilo Jose Cela s\/n, 13071 Ciudad Real, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,9,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Espinosa-Aranda, J.L., Vallez, N., Sanchez-Bueno, C., Aguado-Araujo, D., Bueno, G., and Deniz, O. (2015, January 30). Pulga, a tiny open-source MQTT broker for flexible and secure IoT deployments. Proceedings of the 1st Workshop on Security and Privacy in the Cloud (SPC 2015), Florence, Italy.","DOI":"10.1109\/CNS.2015.7346889"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/MPRV.2009.82","article-title":"The Case for VM-Based Cloudlets in Mobile Computing","volume":"8","author":"Satyanarayanan","year":"2009","journal-title":"Pervasive Comput. IEEE"},{"key":"ref_3","unstructured":"Sutaria, R., and Govindachari, R. (2013, January 8\u20139). Making sense of interoperability: Protocols and Standardization initiatives in IoT. Proceedings of the 2nd International Workshop on Computing and Networking for Internet of Things, Mumbai, India."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Deniz, O., Vallez, N., Espinosa-Aranda, J.L., Rico-Saavedra, J.M., Parra-Patino, J., Bueno, G., Moloney, D., Dehghani, A., Dunne, A., and Pagani, A. (2017). Eyes of Things. Sensors, 17.","DOI":"10.3390\/s17051173"},{"key":"ref_5","unstructured":"(2018, September 07). Intel\u00ae Movidius\u2122 Myriad\u2122 VPU 2: A Class-Defining Processor. Available online: https:\/\/www.movidius.com\/myriad2."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1109\/MM.2015.10","article-title":"Always-on Vision Processing Unit for Mobile Applications","volume":"35","author":"Barry","year":"2015","journal-title":"IEEE Micro"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1109\/MCE.2015.2392956","article-title":"A Vision for the Future [Soapbox]","volume":"4","author":"Moloney","year":"2015","journal-title":"Consum. Electron. Mag. IEEE"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1016\/j.eswa.2017.12.015","article-title":"Multi-kernel extreme learning machine for EEG classification in brain-computer interfaces","volume":"96","author":"Zhang","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1750039","DOI":"10.1142\/S0129065717500393","article-title":"A novel multilayer correlation maximization model for improving CCA-based frequency recognition in SSVEP brain\u2013computer interface","volume":"28","author":"Jiao","year":"2018","journal-title":"Int. J. Neural Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2256","DOI":"10.1109\/TNNLS.2015.2476656","article-title":"Sparse Bayesian classification of EEG for brain\u2013computer interface","volume":"27","author":"Zhang","year":"2016","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"11215","DOI":"10.1109\/ACCESS.2018.2798799","article-title":"Exploiting Convolutional Neural Networks with Deeply Local Description for Remote Sensing Image Classification","volume":"6","author":"Liu","year":"2018","journal-title":"IEEE Access"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"81","DOI":"10.3233\/ICA-150502","article-title":"An adaptive neural network approach for operator functional state prediction using psychophysiological data","volume":"23","author":"Wang","year":"2016","journal-title":"Integr. Comput. Aided Eng."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.neunet.2014.09.003","article-title":"Deep learning in neural networks: An overview","volume":"61","author":"Schmidhuber","year":"2015","journal-title":"Neural Netw."},{"key":"ref_14","unstructured":"(2018, September 07). Tiny-Dnn. Available online: https:\/\/github.com\/tiny-dnn\/tiny-dnn."},{"key":"ref_15","unstructured":"(2018, September 07). Intel\u00aeMovidius\u2122 Neural Compute Stick. Available online: https:\/\/developer.movidius.com\/."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1125","DOI":"10.1037\/h0077722","article-title":"Facial signs of emotional experience","volume":"39","author":"Ekman","year":"1980","journal-title":"J. Pers. Soc. Psychol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1080\/02699939208411068","article-title":"An argument for basic emotions","volume":"6","author":"Ekman","year":"1992","journal-title":"Cognit. Emot."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., and Matthews, I. (2010, January 13\u201318). The extended cohn-kanade dataset (ck+): A complete dataset for action unit and emotion-specified expression. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), San Francisco, CA, USA.","DOI":"10.1109\/CVPRW.2010.5543262"},{"key":"ref_19","unstructured":"(2018, September 07). Microsoft Project Oxford Emotion API. Available online: https:\/\/www.projectoxford.ai\/emotion."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ekman, P., and Rosenberg, E.L. (1997). What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS), Oxford University Press.","DOI":"10.1093\/oso\/9780195104462.001.0001"},{"key":"ref_21","unstructured":"Hjortsj\u00f6, C.H. (1969). Man\u2019s Face and Mimic Language, Studentlitteratur."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1253","DOI":"10.1016\/j.visres.2005.10.028","article-title":"Quantifying facial expression recognition across viewing conditions","volume":"46","author":"Goren","year":"2006","journal-title":"Vis. Res."},{"key":"ref_23","unstructured":"Viola, P., and Jones, M. (2001, January 8\u201314). Rapid object detection using a boosted cascade of simple features. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA."},{"key":"ref_24","first-page":"102","article-title":"Yet even faster (YEF) real-time object detection","volume":"2","author":"Abramson","year":"2007","journal-title":"Int. J. Intell. Syst. Technol. Appl."},{"key":"ref_25","unstructured":"(2018, September 07). EoT Project. Available online: http:\/\/eyesofthings.euv."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/10\/9\/387\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:19:25Z","timestamp":1760195965000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/10\/9\/387"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,9,7]]},"references-count":25,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2018,9]]}},"alternative-id":["sym10090387"],"URL":"https:\/\/doi.org\/10.3390\/sym10090387","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2018,9,7]]}}}