{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,2]],"date-time":"2026-10-02T19:32:13Z","timestamp":1790969533341,"version":"4.1.0"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2019,3,29]],"date-time":"2019-03-29T00:00:00Z","timestamp":1553817600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000098","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["1U54EB020404-01"],"award-info":[{"award-number":["1U54EB020404-01"]}],"id":[{"id":"10.13039\/100000098","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1815347,1839999"],"award-info":[{"award-number":["1815347,1839999"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2019,3,29]]},"abstract":"<jats:p>The ability to unobtrusively and continuously monitor one's facial expressions has implications for a variety of application domains ranging from affective computing to health-care and the entertainment industry. The standard Facial Action Coding System (FACS) along with camera based methods have been shown to provide objective indicators of facial expressions; however, these approaches can also be fairly limited for mobile applications due to privacy concerns and awkward positioning of the camera. To bridge this gap, W!NCE re-purposes a commercially available Electrooculography-based eyeglass (J!NS MEME) for continuously and unobtrusively sensing of upper facial action units with high fidelity. W!NCE detects facial gestures using a two-stage processing pipeline involving motion artifact removal and facial action detection. We validate our system's applicability through extensive evaluation on data from 17 users under stationary and ambulatory settings, a pilot study for continuous pain monitoring and several performance benchmarks. Our results are very encouraging, showing that we can detect five distinct facial action units with a mean F1 score of 0.88 in stationary and 0.82 in ambulatory settings, and that we can accurately detect facial gestures that due to pain.<\/jats:p>","DOI":"10.1145\/3314410","type":"journal-article","created":{"date-parts":[[2019,4,2]],"date-time":"2019-04-02T11:57:40Z","timestamp":1554206260000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":49,"title":["W!NCE"],"prefix":"10.1145","volume":"3","author":[{"given":"Soha","family":"Rostaminia","sequence":"first","affiliation":[{"name":"University of Massachusetts Amherst, Amherst, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Lamson","sequence":"additional","affiliation":[{"name":"University of Massachusetts Amherst, Amherst, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Subhransu","family":"Maji","sequence":"additional","affiliation":[{"name":"University of Massachusetts Amherst, Amherst, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tauhidur","family":"Rahman","sequence":"additional","affiliation":[{"name":"University of Massachusetts Amherst, Amherst, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Deepak","family":"Ganesan","sequence":"additional","affiliation":[{"name":"University of Massachusetts Amherst, Amherst, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,3,29]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"2018. GAP8 Developer Boards. (14 Nov. 2018). https:\/\/greenwaves-technologies.com\/en\/developer-kits\/.  2018. GAP8 Developer Boards. (14 Nov. 2018). https:\/\/greenwaves-technologies.com\/en\/developer-kits\/."},{"key":"e_1_2_1_2_1","unstructured":"2018. JINS MEME Eyewear. (14 Oct. 2018). https:\/\/jins-meme.com\/en\/.  2018. JINS MEME Eyewear. (14 Oct. 2018). https:\/\/jins-meme.com\/en\/."},{"key":"e_1_2_1_3_1","unstructured":"Mart\u00edn Abadi Ashish Agarwal Paul Barham Eugene Brevdo Zhifeng Chen Craig Citro Gregory S. Corrado Andy Davis Jeffrey Dean Matthieu Devin Sanjay Ghemawat Ian J. Goodfellow Andrew Harp Geoffrey Irving Michael Isard Yangqing Jia Rafal J\u00f3zefowicz Lukasz Kaiser Manjunath Kudlur Josh Levenberg Dan Man\u00e9 Rajat Monga Sherry Moore Derek Gordon Murray Chris Olah Mike Schuster Jonathon Shlens Benoit Steiner Ilya Sutskever Kunal Talwar Paul A. Tucker Vincent Vanhoucke Vijay Vasudevan Fernanda B. Vi\u00e9gas Oriol Vinyals Pete Warden Martin Wattenberg Martin Wicke Yuan Yu and Xiaoqiang Zheng. 2016. TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. CoRR abs\/1603.04467 (2016). arXiv:1603.04467 http:\/\/arxiv.org\/abs\/1603.04467  Mart\u00edn Abadi Ashish Agarwal Paul Barham Eugene Brevdo Zhifeng Chen Craig Citro Gregory S. Corrado Andy Davis Jeffrey Dean Matthieu Devin Sanjay Ghemawat Ian J. Goodfellow Andrew Harp Geoffrey Irving Michael Isard Yangqing Jia Rafal J\u00f3zefowicz Lukasz Kaiser Manjunath Kudlur Josh Levenberg Dan Man\u00e9 Rajat Monga Sherry Moore Derek Gordon Murray Chris Olah Mike Schuster Jonathon Shlens Benoit Steiner Ilya Sutskever Kunal Talwar Paul A. Tucker Vincent Vanhoucke Vijay Vasudevan Fernanda B. Vi\u00e9gas Oriol Vinyals Pete Warden Martin Wattenberg Martin Wicke Yuan Yu and Xiaoqiang Zheng. 2016. TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. CoRR abs\/1603.04467 (2016). arXiv:1603.04467 http:\/\/arxiv.org\/abs\/1603.04467"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2016.7477553"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130902"},{"key":"e_1_2_1_6_1","unstructured":"Vinay Bettadapura. 2012. Face Expression Recognition and Analysis: The State of the Art. CoRR abs\/1203.6722 (2012). arXiv:1203.6722 http:\/\/arxiv.org\/abs\/1203.6722  Vinay Bettadapura. 2012. Face Expression Recognition and Analysis: The State of the Art. CoRR abs\/1203.6722 (2012). arXiv:1203.6722 http:\/\/arxiv.org\/abs\/1203.6722"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1006\/nimg.2002.1125"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/1735835.1735842"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.86"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.icte.2016.11.003"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijpsycho.2008.03.004"},{"key":"e_1_2_1_12_1","volume-title":"Emotiv: Mobile EEG Brainwear.","year":"2018"},{"key":"e_1_2_1_13_1","unstructured":"FACS. 2018. Facial Action Coding System (FACS). (2018). https:\/\/imotions.com\/blog\/facial-action-coding-system\/  FACS. 2018. Facial Action Coding System (FACS). (2018). https:\/\/imotions.com\/blog\/facial-action-coding-system\/"},{"key":"e_1_2_1_14_1","volume-title":"Adaptive Filters: Theory and Applications","author":"Farhang-Boroujeny B.","year":"1998","edition":"1"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-3203(02)00052-3"},{"key":"e_1_2_1_16_1","volume-title":"2014 4th International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare Through Innovations in Mobile and Wireless Technologies (MOBIHEALTH). 39--42","author":"Garbarino M."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpain.2012.03.009"},{"key":"e_1_2_1_18_1","unstructured":"Michael J. Grimble and Michael A. Johnson (Eds.). 2005. Adaptive Filtering. Springer London London 3--23.  Michael J. Grimble and Michael A. Johnson (Eds.). 2005. Adaptive Filtering. Springer London London 3--23."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2014.2313557"},{"key":"e_1_2_1_20_1","doi-asserted-by":"crossref","unstructured":"M. Hamedi S. h. H. Salleh M. Astaraki and A. M. Noor. 2013. EMG-based facial gesture recognition through versatile elliptic basis function neural network. Biomed Eng Online 12 (Jul 2013) 73.  M. Hamedi S. h. H. Salleh M. Astaraki and A. M. Noor. 2013. EMG-based facial gesture recognition through versatile elliptic basis function neural network. Biomed Eng Online 12 (Jul 2013) 73.","DOI":"10.1186\/1475-925X-12-73"},{"key":"e_1_2_1_21_1","unstructured":"P. S. Hamilton and M. G. Curley. 1997. Adaptive Removal of Motion Artifact. In Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 'Magnificent Milestones and Emerging Opportunities in Medical Engineering' (Cat. No.97CH36136) Vol. 1. 297--299.  P. S. Hamilton and M. G. Curley. 1997. Adaptive Removal of Motion Artifact. In Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 'Magnificent Milestones and Emerging Opportunities in Medical Engineering' (Cat. No.97CH36136) Vol. 1. 297--299."},{"key":"e_1_2_1_22_1","volume-title":"Eyemotion: Classifying facial expressions in VR using eye-tracking cameras. ArXiv e-prints (July","author":"Hickson S.","year":"2017"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2638728.2638795"},{"key":"e_1_2_1_24_1","volume-title":"2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). 3155--2158","author":"Jarchi D."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1093\/brain\/106.3.643"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1519\/JSC.0b013e31818f051c"},{"key":"e_1_2_1_27_1","volume-title":"2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). 5765--5768","author":"Kwon J."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1088\/0967-3334\/31\/12\/003"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCB.2010.2082525"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2856767.2856770"},{"key":"e_1_2_1_31_1","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1109\/LSP.2015.2509868","article-title":"Heart Rate Tracking using Wrist-Type Photoplethysmographic (PPG) Signals during Physical Exercise with Simultaneous Accelerometry","volume":"23","author":"Mashhadi M. Boloursaz","year":"2016","journal-title":"IEEE Signal Processing Letters"},{"key":"e_1_2_1_32_1","unstructured":"MD2K. 2014. MD2K: NIH Center of Excellence on Mobile Sensor Data-to-Knowledge. (2014). https:\/\/md2k.org\/  MD2K. 2014. MD2K: NIH Center of Excellence on Mobile Sensor Data-to-Knowledge. (2014). https:\/\/md2k.org\/"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1088\/0967-3334\/34\/9\/R47"},{"key":"e_1_2_1_34_1","volume-title":"MUSE: The Brain Sensing Headband.","author":"MUSE.","year":"2015"},{"key":"e_1_2_1_35_1","volume-title":"NIH: Development of a Device to Objectively Measure Pain.","author":"NIH.","year":"2017"},{"key":"e_1_2_1_36_1","unstructured":"Daniele Palossi Antonio Loquercio Francesco Conti Eric Flamand Davide Scaramuzza and Luca Benini. 2018. Ultra Low Power Deep-Learning-powered Autonomous Nano Drones. CoRR abs\/1805.01831 (2018). arXiv:1805.01831 http:\/\/arxiv.org\/abs\/1805.01831  Daniele Palossi Antonio Loquercio Francesco Conti Eric Flamand Davide Scaramuzza and Luca Benini. 2018. Ultra Low Power Deep-Learning-powered Autonomous Nano Drones. CoRR abs\/1805.01831 (2018). arXiv:1805.01831 http:\/\/arxiv.org\/abs\/1805.01831"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.895976"},{"key":"e_1_2_1_38_1","volume-title":"PIP: The Stress Management Device.","author":"PIP.","year":"2016"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.2501\/S0021849906060041"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2013.02.010"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pain.2008.04.010"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIM.2011.2175832"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2013.2269864"},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society} {Engineering in Medicine and Biology","volume":"2","author":"Raya M. A. D."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2009.2038667"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3090088"},{"key":"e_1_2_1_47_1","volume-title":"2015 9th International Conference on Sensing Technology (ICST). 596--599","author":"Sakai T."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2014.2366127"},{"key":"e_1_2_1_49_1","doi-asserted-by":"crossref","unstructured":"Jocelyn Scheirer Raul Fernandez and Rosalind W. Picard. 1999. Expression Glasses: A Wearable Device for Facial Expression Recognition. (1999).  Jocelyn Scheirer Raul Fernandez and Rosalind W. Picard. 1999. Expression Glasses: A Wearable Device for Facial Expression Recognition. (1999).","DOI":"10.1145\/632716.632878"},{"key":"e_1_2_1_50_1","volume-title":"2015 23rd European Signal Processing Conference (EUSIPCO). 2666--2670","author":"Sch\u00e4ck T."},{"key":"e_1_2_1_51_1","doi-asserted-by":"crossref","unstructured":"K. L. Shapiro J. E. Raymond and K. M. Arnell. 1994. Attention to visual pattern information produces the attentional blink in rapid serial visual presentation. In Journal of Experimental Psychology: Human Perception and Performance. 357--371.  K. L. Shapiro J. E. Raymond and K. M. Arnell. 1994. Attention to visual pattern information produces the attentional blink in rapid serial visual presentation. In Journal of Experimental Psychology: Human Perception and Performance. 357--371.","DOI":"10.1037\/0096-1523.20.2.357"},{"key":"e_1_2_1_52_1","doi-asserted-by":"crossref","unstructured":"K. Suzuki F. Nakamura J. Otsuka K. Masai Y. Itoh Y. Sugiura and M. Sugimoto. 2017. Recognition and mapping of facial expressions to avatar by embedded photo reflective sensors in head mounted display. In 2017 IEEE Virtual Reality (VR). 177--185.  K. Suzuki F. Nakamura J. Otsuka K. Masai Y. Itoh Y. Sugiura and M. Sugimoto. 2017. Recognition and mapping of facial expressions to avatar by embedded photo reflective sensors in head mounted display. In 2017 IEEE Virtual Reality (VR). 177--185.","DOI":"10.1109\/VR.2017.7892245"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIM.2013.2289072"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.3390\/electronics3020282"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/10.83591"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/10.126604"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3314410","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3314410","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3314410","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:53:30Z","timestamp":1750204410000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3314410"}},"subtitle":["Unobtrusive Sensing of Upper Facial Action Units with EOG-based Eyewear"],"short-title":[],"issued":{"date-parts":[[2019,3,29]]},"references-count":56,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,3,29]]}},"alternative-id":["10.1145\/3314410"],"URL":"https:\/\/doi.org\/10.1145\/3314410","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,3,29]]},"assertion":[{"value":"2018-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-03-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}