{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T20:35:04Z","timestamp":1779136504182,"version":"3.51.4"},"reference-count":85,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2021,9,9]],"date-time":"2021-09-09T00:00:00Z","timestamp":1631145600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2021,9,9]]},"abstract":"<jats:p>Continuous and unobtrusive monitoring of facial expressions holds tremendous potential to enable compelling applications in a multitude of domains ranging from healthcare and education to interactive systems. Traditional, vision-based facial expression recognition (FER) methods, however, are vulnerable to external factors like occlusion and lighting, while also raising privacy concerns coupled with the impractical requirement of positioning the camera in front of the user at all times. To bridge this gap, we propose ExpressEar, a novel FER system that repurposes commercial earables augmented with inertial sensors to capture fine-grained facial muscle movements. Following the Facial Action Coding System (FACS), which encodes every possible expression in terms of constituent facial movements called Action Units (AUs), ExpressEar identifies facial expressions at the atomic level. We conducted a user study (N=12) to evaluate the performance of our approach and found that ExpressEar can detect and distinguish between 32 Facial AUs (including 2 variants of asymmetric AUs), with an average accuracy of 89.9% for any given user. We further quantify the performance across different mobile scenarios in presence of additional face-related activities. Our results demonstrate ExpressEar's applicability in the real world and open up research opportunities to advance its practical adoption.<\/jats:p>","DOI":"10.1145\/3478085","type":"journal-article","created":{"date-parts":[[2021,9,14]],"date-time":"2021-09-14T22:48:23Z","timestamp":1631659703000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":58,"title":["ExpressEar"],"prefix":"10.1145","volume":"5","author":[{"given":"Dhruv","family":"Verma","sequence":"first","affiliation":[{"name":"Indraprastha Institute of Information Technology, Delhi, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sejal","family":"Bhalla","sequence":"additional","affiliation":[{"name":"Indraprastha Institute of Information Technology, Delhi, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dhruv","family":"Sahnan","sequence":"additional","affiliation":[{"name":"Indraprastha Institute of Information Technology, Delhi, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jainendra","family":"Shukla","sequence":"additional","affiliation":[{"name":"Indraprastha Institute of Information Technology, Delhi, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aman","family":"Parnami","sequence":"additional","affiliation":[{"name":"Indraprastha Institute of Information Technology, Delhi, India"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,9,14]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"2008. Emotiv: Mobile EEG Brainwear. https:\/\/www.emotiv.com\/ 2008. Emotiv: Mobile EEG Brainwear. https:\/\/www.emotiv.com\/"},{"key":"e_1_2_1_2_1","unstructured":"2014. MD2K: NIH Center of Excellence on Mobile Sensor Data-to-Knowledge. https:\/\/md2k.org\/ 2014. MD2K: NIH Center of Excellence on Mobile Sensor Data-to-Knowledge. https:\/\/md2k.org\/"},{"key":"e_1_2_1_3_1","unstructured":"2015. MUSE: The Brain Sensing Headband. http:\/\/www.choosemuse.com\/ 2015. MUSE: The Brain Sensing Headband. http:\/\/www.choosemuse.com\/"},{"key":"e_1_2_1_4_1","unstructured":"2016. PIP: The Stress Management Device. https:\/\/thepip.com\/ 2016. PIP: The Stress Management Device. https:\/\/thepip.com\/"},{"key":"e_1_2_1_5_1","volume-title":"2018 IEEE International Conference on Advanced Manufacturing (ICAM). IEEE. https:\/\/ieeexplore.ieee.org\/servlet\/opac?punumber=8606319 OCLC: 1125884622","unstructured":"2018. 2018 IEEE International Conference on Advanced Manufacturing (ICAM). IEEE. https:\/\/ieeexplore.ieee.org\/servlet\/opac?punumber=8606319 OCLC: 1125884622 . 2018. 2018 IEEE International Conference on Advanced Manufacturing (ICAM). IEEE. https:\/\/ieeexplore.ieee.org\/servlet\/opac?punumber=8606319 OCLC: 1125884622."},{"key":"e_1_2_1_6_1","unstructured":"2018. eSense: Open Earable Platform for Human Sensing. https:\/\/www.esense.io\/ 2018. eSense: Open Earable Platform for Human Sensing. https:\/\/www.esense.io\/"},{"key":"e_1_2_1_7_1","unstructured":"2020. AirPods Technical Description. https:\/\/www.apple.com\/airpods-2nd-generation\/specs\/ 2020. AirPods Technical Description. https:\/\/www.apple.com\/airpods-2nd-generation\/specs\/"},{"key":"e_1_2_1_8_1","unstructured":"2020. Bose SoundSport Firmware. https:\/\/github.com\/bosefirmware\/ced 2020. Bose SoundSport Firmware. https:\/\/github.com\/bosefirmware\/ced"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341163.3347747"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3126594.3126649"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.2105\/AJPH.2016.303270"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1038\/ncomms12408"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2020.2985374"},{"key":"e_1_2_1_15_1","unstructured":"Shaojie Bai J. Zico Kolter and Vladlen Koltun. 2018. An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling. arXiv:1803.01271 [cs.LG] Shaojie Bai J. Zico Kolter and Vladlen Koltun. 2018. An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling. arXiv:1803.01271 [cs.LG]"},{"key":"e_1_2_1_16_1","volume-title":"Intille","author":"Bao Ling","year":"2004","unstructured":"Ling Bao and Stephen S . Intille . 2004 . Activity Recognition from User-Annotated Acceleration Data. In Pervasive Computing, Takeo Kanade, Josef Kittler, Jon M. Kleinberg, Friedemann Mattern, John C. Mitchell, Oscar Nierstrasz, C. Pandu Rangan, Bernhard Steffen, Demetri Terzopoulos, Dough Tygar, Moshe Y. Vardi, Alois Ferscha, and Friedemann Mattern (Eds.). Vol. 3001 . Springer Berlin Heidelberg , Berlin, Heidelberg, 1--17. https:\/\/doi.org\/10.1007\/978-3-540-24646-6_1 Series Title : Lecture Notes in Computer Science. Ling Bao and Stephen S. Intille. 2004. Activity Recognition from User-Annotated Acceleration Data. In Pervasive Computing, Takeo Kanade, Josef Kittler, Jon M. Kleinberg, Friedemann Mattern, John C. Mitchell, Oscar Nierstrasz, C. Pandu Rangan, Bernhard Steffen, Demetri Terzopoulos, Dough Tygar, Moshe Y. Vardi, Alois Ferscha, and Friedemann Mattern (Eds.). Vol. 3001. Springer Berlin Heidelberg, Berlin, Heidelberg, 1--17. https:\/\/doi.org\/10.1007\/978-3-540-24646-6_1 Series Title: Lecture Notes in Computer Science."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2800835.2807933"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376869"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1177\/00220345680470041501"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02173412"},{"key":"e_1_2_1_21_1","volume-title":"Frequency of Public Smiling across the Life Span. Perceptual and Motor Skills 85, 3_suppl (Dec","author":"Chapell Mark S.","year":"1997","unstructured":"Mark S. Chapell . 1997. Frequency of Public Smiling across the Life Span. Perceptual and Motor Skills 85, 3_suppl (Dec . 1997 ), 1326--1326. https:\/\/doi.org\/10.2466\/pms.1997.85.3f.1326 Mark S. Chapell. 1997. Frequency of Public Smiling across the Life Span. Perceptual and Motor Skills 85, 3_suppl (Dec. 1997), 1326--1326. https:\/\/doi.org\/10.2466\/pms.1997.85.3f.1326"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379337.3415879"},{"key":"e_1_2_1_24_1","unstructured":"Francois Chollet et al. 2015. Keras. https:\/\/github.com\/fchollet\/keras Francois Chollet et al. 2015. Keras. https:\/\/github.com\/fchollet\/keras"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1177\/01461672962210004"},{"key":"e_1_2_1_26_1","volume-title":"The Expression of the Emotions in Man and Animals","author":"Darwin Charles","unstructured":"Charles Darwin . 2013. The Expression of the Emotions in Man and Animals . Cambridge University Press , Cambridge . https:\/\/doi.org\/10.1017\/CBO9781139833813 Charles Darwin. 2013. The Expression of the Emotions in Man and Animals. Cambridge University Press, Cambridge. https:\/\/doi.org\/10.1017\/CBO9781139833813"},{"key":"e_1_2_1_27_1","first-page":"6","article-title":"Noninvasive Brain-Actuated Control of a Mobile Robot by Human EEG","volume":"51","author":"Millan J.","year":"2004","unstructured":"J. del R. Millan , F. Renkens , J. Mourino , and W. Gerstner . 2004 . Noninvasive Brain-Actuated Control of a Mobile Robot by Human EEG . IEEE Transactions on Biomedical Engineering 51 , 6 (June 2004), 1026--1033. https:\/\/doi.org\/10.1109\/TBME.2004.827086 J. del R. Millan, F. Renkens, J. Mourino, and W. Gerstner. 2004. Noninvasive Brain-Actuated Control of a Mobile Robot by Human EEG. IEEE Transactions on Biomedical Engineering 51, 6 (June 2004), 1026--1033. https:\/\/doi.org\/10.1109\/TBME.2004.827086","journal-title":"IEEE Transactions on Biomedical Engineering"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1322355111"},{"key":"e_1_2_1_29_1","volume-title":"Manual for the facial action coding system","author":"Ekman Paul","unstructured":"Paul Ekman and Wallace V Friesen . 1978. Manual for the facial action coding system . Consulting Psychologists Press . Paul Ekman and Wallace V Friesen. 1978. Manual for the facial action coding system. Consulting Psychologists Press."},{"key":"e_1_2_1_30_1","first-page":"495","article-title":"What the face reveals: Basic and applied studies of spontaneous expression using the Facial Action Coding System (FACS). Oxford University Press, New York, NY","author":"Ekman Paul","year":"1997","unstructured":"Paul Ekman and Erika L. Rosenberg ( Eds .). 1997 . What the face reveals: Basic and applied studies of spontaneous expression using the Facial Action Coding System (FACS). Oxford University Press, New York, NY , US. Pages : xvi , 495 . Paul Ekman and Erika L. Rosenberg (Eds.). 1997. What the face reveals: Basic and applied studies of spontaneous expression using the Facial Action Coding System (FACS). Oxford University Press, New York, NY, US. Pages: xvi, 495.","journal-title":"US. Pages"},{"key":"e_1_2_1_31_1","volume-title":"Rosenberg","author":"Ekman Paul","year":"2005","unstructured":"Paul Ekman and Erika L . Rosenberg . 2005 . What the Face Reveals : Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS). Oxford University Press . https:\/\/doi.org\/10.1093\/acprof:oso\/9780195179644.001.0001 Paul Ekman and Erika L. Rosenberg. 2005. What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS). Oxford University Press. https:\/\/doi.org\/10.1093\/acprof:oso\/9780195179644.001.0001"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-3203(02)00052-3"},{"key":"e_1_2_1_33_1","volume-title":"The Psychology of Facial Expression (1 ed.), James A","author":"Fridlund Alan J.","unstructured":"Alan J. Fridlund . 1997. The new ethology of human facial expressions . In The Psychology of Facial Expression (1 ed.), James A . Russell and Jos\u00e9 Miguel Fern\u00e1ndez-Dols (Eds.). Cambridge University Press , 103--130. https:\/\/doi.org\/10.1017\/CBO9780511659911.007 Alan J. Fridlund. 1997. The new ethology of human facial expressions. In The Psychology of Facial Expression (1 ed.), James A. Russell and Jos\u00e9 Miguel Fern\u00e1ndez-Dols (Eds.). Cambridge University Press, 103--130. https:\/\/doi.org\/10.1017\/CBO9780511659911.007"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.4108\/icst.mobihealth.2014.257418"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1098-2353(1999)12:1<1::AID-CA1>3.0.CO;2-J"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2014.2313557"},{"key":"e_1_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Jinni A. Harrigan Robert Rosenthal and Klaus R. Scherer (Eds.). 2005. The new handbook of methods in nonverbal behavior research. Oxford University Press New York. Jinni A. Harrigan Robert Rosenthal and Klaus R. Scherer (Eds.). 2005. The new handbook of methods in nonverbal behavior research. Oxford University Press New York.","DOI":"10.1093\/oso\/9780198529613.001.0001"},{"key":"e_1_2_1_38_1","volume-title":"Eyemotion: Classifying facial expressions in VR using eye-tracking cameras. arXiv:1707.07204 [cs] (July","author":"Hickson Steven","year":"2017","unstructured":"Steven Hickson , Nick Dufour , Avneesh Sud , Vivek Kwatra , and Irfan Essa . 2017 . Eyemotion: Classifying facial expressions in VR using eye-tracking cameras. arXiv:1707.07204 [cs] (July 2017). http:\/\/arxiv.org\/abs\/1707.07204 arXiv: 1707.07204. Steven Hickson, Nick Dufour, Avneesh Sud, Vivek Kwatra, and Irfan Essa. 2017. Eyemotion: Classifying facial expressions in VR using eye-tracking cameras. arXiv:1707.07204 [cs] (July 2017). http:\/\/arxiv.org\/abs\/1707.07204 arXiv: 1707.07204."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.2307\/2670026"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341162.3343822"},{"key":"e_1_2_1_41_1","volume-title":"Real-time human activity recognition from accelerometer data using Convolutional Neural Networks. Applied Soft Computing 62 (Jan","author":"Ignatov Andrey","year":"2018","unstructured":"Andrey Ignatov . 2018. Real-time human activity recognition from accelerometer data using Convolutional Neural Networks. Applied Soft Computing 62 (Jan . 2018 ), 915--922. https:\/\/doi.org\/10.1016\/j.asoc.2017.09.027 Andrey Ignatov. 2018. Real-time human activity recognition from accelerometer data using Convolutional Neural Networks. Applied Soft Computing 62 (Jan. 2018), 915--922. https:\/\/doi.org\/10.1016\/j.asoc.2017.09.027"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300506"},{"key":"e_1_2_1_43_1","volume-title":"ExerSense: Real-Time Physical Exercise Segmentation, Classification, and Counting Algorithm Using an IMU Sensor. Smart Innovation (Aug","author":"Ishii Shun","year":"2020","unstructured":"Shun Ishii , Kizito Nkurikiyeyezu , Mika Luimula , Anna Yokokubo , and Guillaume Lopez . 2020. ExerSense: Real-Time Physical Exercise Segmentation, Classification, and Counting Algorithm Using an IMU Sensor. Smart Innovation (Aug . 2020 ). Shun Ishii, Kizito Nkurikiyeyezu, Mika Luimula, Anna Yokokubo, and Guillaume Lopez. 2020. ExerSense: Real-Time Physical Exercise Segmentation, Classification, and Counting Algorithm Using an IMU Sensor. Smart Innovation (Aug. 2020)."},{"key":"e_1_2_1_44_1","article-title":"Implementation of a Real-Time Human Movement Classifier Using a Triaxial Accelerometer for Ambulatory Monitoring. Information Technology in Biomedicine","author":"Karantonis Dean","year":"2006","unstructured":"Dean Karantonis , Michael Narayanan , Merryn Mathie , Nigel Lovell , and B.G. Celler . 2006 . Implementation of a Real-Time Human Movement Classifier Using a Triaxial Accelerometer for Ambulatory Monitoring. Information Technology in Biomedicine , IEEE Transactions on 10 ( Feb. 2006), 156--167. https:\/\/doi.org\/10.1109\/TITB.2005.856864 Dean Karantonis, Michael Narayanan, Merryn Mathie, Nigel Lovell, and B.G. Celler. 2006. Implementation of a Real-Time Human Movement Classifier Using a Triaxial Accelerometer for Ambulatory Monitoring. Information Technology in Biomedicine, IEEE Transactions on 10 (Feb. 2006), 156--167. https:\/\/doi.org\/10.1109\/TITB.2005.856864","journal-title":"IEEE Transactions on 10"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2018.03367740"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chc.2020.02.006"},{"key":"e_1_2_1_47_1","volume-title":"The social context of nonverbal behavior. Editions de la Maison des Sciences de l'Homme","author":"Kupperbusch Cinita","unstructured":"Cinita Kupperbusch , David Matsumoto , Kristie Kooken , Sherry Loewinger , Hideko Uchida , Carinda Wilson-Cohn , and Nathan Yrizarry . 1999. Cultural influences on nonverbal expressions of emotion . In The social context of nonverbal behavior. Editions de la Maison des Sciences de l'Homme , Paris, France , 17--44. Cinita Kupperbusch, David Matsumoto, Kristie Kooken, Sherry Loewinger, Hideko Uchida, Carinda Wilson-Cohn, and Nathan Yrizarry. 1999. Cultural influences on nonverbal expressions of emotion. In The social context of nonverbal behavior. Editions de la Maison des Sciences de l'Homme, Paris, France, 17--44."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1964897.1964918"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC.2016.7592037"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3311823.3311869"},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the 8th ACM Conference on Embedded Networked Sensor Systems - SenSys '10","author":"Lu Hong","year":"1869","unstructured":"Hong Lu , Jun Yang , Zhigang Liu , Nicholas D. Lane , Tanzeem Choudhury , and Andrew T. Campbell . 2010. The Jigsaw continuous sensing engine for mobile phone applications . In Proceedings of the 8th ACM Conference on Embedded Networked Sensor Systems - SenSys '10 . ACM Press, Z\u00fcrich, Switzerland, 71. https:\/\/doi.org\/10.1145\/ 1869 983.1869992 Hong Lu, Jun Yang, Zhigang Liu, Nicholas D. Lane, Tanzeem Choudhury, and Andrew T. Campbell. 2010. The Jigsaw continuous sensing engine for mobile phone applications. In Proceedings of the 8th ACM Conference on Embedded Networked Sensor Systems - SenSys '10. ACM Press, Z\u00fcrich, Switzerland, 71. https:\/\/doi.org\/10.1145\/1869983.1869992"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2856767.2856770"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025692"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1093\/ejo\/20.6.713"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3210240.3210810"},{"key":"e_1_2_1_56_1","volume-title":"Mask: Synchronizing facial expression across the physical and virtual worlds. https:\/\/www.mindmaze.com\/labs\/mask","year":"2017","unstructured":"MindMaze. 2017 . Mask: Synchronizing facial expression across the physical and virtual worlds. https:\/\/www.mindmaze.com\/labs\/mask MindMaze. 2017. Mask: Synchronizing facial expression across the physical and virtual worlds. https:\/\/www.mindmaze.com\/labs\/mask"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3266157.3266221"},{"key":"e_1_2_1_58_1","volume-title":"Inferring User Routes and Locations Using Zero-Permission Mobile Sensors. In 2016 IEEE Symposium on Security and Privacy (SP). IEEE","author":"Narain Sashank","year":"2016","unstructured":"Sashank Narain , Triet D. Vo-Huu , Kenneth Block , and Guevara Noubir . 2016 . Inferring User Routes and Locations Using Zero-Permission Mobile Sensors. In 2016 IEEE Symposium on Security and Privacy (SP). IEEE , San Jose, CA, 397--413. https:\/\/doi.org\/10.1109\/SP. 2016.31 Sashank Narain, Triet D. Vo-Huu, Kenneth Block, and Guevara Noubir. 2016. Inferring User Routes and Locations Using Zero-Permission Mobile Sensors. In 2016 IEEE Symposium on Security and Privacy (SP). IEEE, San Jose, CA, 397--413. https:\/\/doi.org\/10.1109\/SP.2016.31"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/PERCOM.2018.8444573"},{"key":"e_1_2_1_60_1","volume-title":"Proceedings of the 2012 ACM Conference on Ubiquitous Computing - UbiComp '12","author":"Patel Ami","year":"2012","unstructured":"Jun-geun Park, Ami Patel , Dorothy Curtis , Seth Teller , and Jonathan Ledlie . 2012 . Online pose classification and walking speed estimation using handheld devices . In Proceedings of the 2012 ACM Conference on Ubiquitous Computing - UbiComp '12 . ACM Press, Pittsburgh, Pennsylvania, 113. https:\/\/doi.org\/10.1145\/2370216.2370235 Jun-geun Park, Ami Patel, Dorothy Curtis, Seth Teller, and Jonathan Ledlie. 2012. Online pose classification and walking speed estimation using handheld devices. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing - UbiComp '12. ACM Press, Pittsburgh, Pennsylvania, 113. https:\/\/doi.org\/10.1145\/2370216.2370235"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1097\/00006534-199811000-00013"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1098-2353(1998)11:5<310::AID-CA3>3.0.CO;2-T"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2017.8172313"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3345615.3361133"},{"key":"e_1_2_1_66_1","volume-title":"Proceedings of the 6th International Conference on Networking, Systems and Security - NSysS '19","author":"Purabi Sharmin Akther","unstructured":"Sharmin Akther Purabi , Rayhan Rashed , Mirajul Islam , Nahiyan Uddin , Mahmuda Naznin , and A. B. M. Alim Al Islam. 2019. As you are, so shall you move your head: a system-level analysis between head movements and corresponding traits and emotions . In Proceedings of the 6th International Conference on Networking, Systems and Security - NSysS '19 . ACM Press, Dhaka, Bangladesh, 3--11. https:\/\/doi.org\/10.1145\/3362966.3362985 Sharmin Akther Purabi, Rayhan Rashed, Mirajul Islam, Nahiyan Uddin, Mahmuda Naznin, and A. B. M. Alim Al Islam. 2019. As you are, so shall you move your head: a system-level analysis between head movements and corresponding traits and emotions. In Proceedings of the 6th International Conference on Networking, Systems and Security - NSysS '19. ACM Press, Dhaka, Bangladesh, 3--11. https:\/\/doi.org\/10.1145\/3362966.3362985"},{"key":"e_1_2_1_67_1","unstructured":"Philippe Remy. 2020. Temporal Convolutional Networks for Keras. https:\/\/github.com\/philipperemy\/keras-tcn. Philippe Remy. 2020. Temporal Convolutional Networks for Keras. https:\/\/github.com\/philipperemy\/keras-tcn."},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3314410"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3345615.3361130"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2014.2366127"},{"key":"e_1_2_1_71_1","volume-title":"Picard","author":"Scheirer Jocelyn","year":"1999","unstructured":"Jocelyn Scheirer , Raul Fernandez , and Rosalind W . Picard . 1999 . Expression glasses: a wearable device for facial expression recognition. In CHI '99 extended abstracts on Human factors in computing systems - CHI '99. ACM Press , Pittsburgh, Pennsylvania, 262. https:\/\/doi.org\/10.1145\/632716.632878 Jocelyn Scheirer, Raul Fernandez, and Rosalind W. Picard. 1999. Expression glasses: a wearable device for facial expression recognition. In CHI '99 extended abstracts on Human factors in computing systems - CHI '99. ACM Press, Pittsburgh, Pennsylvania, 262. https:\/\/doi.org\/10.1145\/632716.632878"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1002\/ajpa.20001"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306212.3328132"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397309"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1080\/00221309.1978.9920859"},{"key":"e_1_2_1_76_1","volume-title":"UbiComp 2006: Ubiquitous Computing, David Hutchison, Takeo Kanade, Josef Kittler, Jon M","author":"Sohn Timothy","year":"1853","unstructured":"Timothy Sohn , Alex Varshavsky , Anthony LaMarca , Mike Y. Chen , Tanzeem Choudhury , Ian Smith , Sunny Consolvo , Jeffrey Hightower , William G. Griswold , and Eyal de Lara . 2006. Mobility Detection Using Everyday GSM Traces . In UbiComp 2006: Ubiquitous Computing, David Hutchison, Takeo Kanade, Josef Kittler, Jon M . Kleinberg, Friedemann Mattern, John C. Mitchell, Moni Naor, Oscar Nierstrasz, C. Pandu Rangan, Bernhard Steffen, Madhu Sudan, Demetri Terzopoulos, Dough Tygar, Moshe Y. Vardi, Gerhard Weikum, Paul Dourish, and Adrian Friday (Eds.). Vol. 4206 . Springer Berlin Heidelberg , Berlin, Heidelberg , 212--224. https:\/\/doi.org\/10.1007\/1 1853 565_13 Series Title : Lecture Notes in Computer Science. Timothy Sohn, Alex Varshavsky, Anthony LaMarca, Mike Y. Chen, Tanzeem Choudhury, Ian Smith, Sunny Consolvo, Jeffrey Hightower, William G. Griswold, and Eyal de Lara. 2006. Mobility Detection Using Everyday GSM Traces. In UbiComp 2006: Ubiquitous Computing, David Hutchison, Takeo Kanade, Josef Kittler, Jon M. Kleinberg, Friedemann Mattern, John C. Mitchell, Moni Naor, Oscar Nierstrasz, C. Pandu Rangan, Bernhard Steffen, Madhu Sudan, Demetri Terzopoulos, Dough Tygar, Moshe Y. Vardi, Gerhard Weikum, Paul Dourish, and Adrian Friday (Eds.). Vol. 4206. Springer Berlin Heidelberg, Berlin, Heidelberg, 212--224. https:\/\/doi.org\/10.1007\/11853565_13 Series Title: Lecture Notes in Computer Science."},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2015.7163081"},{"key":"e_1_2_1_78_1","first-page":"14","article-title":"Human Activity Recognition Using Inertial Sensors in a Smartphone","volume":"19","author":"Lima Wesllen Sousa","year":"2019","unstructured":"Wesllen Sousa Lima , Eduardo Souto , Khalil El-Khatib , Roozbeh Jalali , and Joao Gama . 2019 . Human Activity Recognition Using Inertial Sensors in a Smartphone : An Overview. Sensors 19 , 14 (July 2019), 3213. https:\/\/doi.org\/10.3390\/s19143213 Wesllen Sousa Lima, Eduardo Souto, Khalil El-Khatib, Roozbeh Jalali, and Joao Gama. 2019. Human Activity Recognition Using Inertial Sensors in a Smartphone: An Overview. Sensors 19, 14 (July 2019), 3213. https:\/\/doi.org\/10.3390\/s19143213","journal-title":"An Overview. Sensors"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.3390\/s18030733"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCAIS.2012.6466615"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.bjps.2004.10.014"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2008.4563182"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/1743666.1743699"},{"key":"e_1_2_1_84_1","volume-title":"Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1--14","author":"Xu Xuhai","unstructured":"Xuhai Xu , Haitian Shi , Xin Yi , WenJia Liu , Yukang Yan , Yuanchun Shi , Alex Mariakakis , Jennifer Mankoff , and Anind K. Dey . 2020. EarBuddy: Enabling On-Face Interaction via Wireless Earbuds . In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1--14 . https:\/\/doi.org\/10.1145\/3313831.3376836 Xuhai Xu, Haitian Shi, Xin Yi, WenJia Liu, Yukang Yan, Yuanchun Shi, Alex Mariakakis, Jennifer Mankoff, and Anind K. Dey. 2020. EarBuddy: Enabling On-Face Interaction via Wireless Earbuds. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1--14. https:\/\/doi.org\/10.1145\/3313831.3376836"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376810"},{"key":"e_1_2_1_86_1","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1109\/TPAMI.2008.293","article-title":"A Unified Probabilistic Framework for Spontaneous Facial Action Modeling and Understanding","volume":"32","author":"Tong Yan","year":"2010","unstructured":"Yan Tong , Jixu Chen , and Qiang Ji . 2010 . A Unified Probabilistic Framework for Spontaneous Facial Action Modeling and Understanding . IEEE Transactions on Pattern Analysis and Machine Intelligence 32 , 2 (Feb. 2010), 258--273. https:\/\/doi.org\/10.1109\/TPAMI.2008.293 Yan Tong, Jixu Chen, and Qiang Ji. 2010. A Unified Probabilistic Framework for Spontaneous Facial Action Modeling and Understanding. IEEE Transactions on Pattern Analysis and Machine Intelligence 32, 2 (Feb. 2010), 258--273. https:\/\/doi.org\/10.1109\/TPAMI.2008.293","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478085","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3478085","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:32Z","timestamp":1750188692000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478085"}},"subtitle":["Sensing Fine-Grained Facial Expressions with Earables"],"short-title":[],"issued":{"date-parts":[[2021,9,9]]},"references-count":85,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,9,9]]}},"alternative-id":["10.1145\/3478085"],"URL":"https:\/\/doi.org\/10.1145\/3478085","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,9]]},"assertion":[{"value":"2021-09-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}