{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T21:05:15Z","timestamp":1778274315706,"version":"3.51.4"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2019,1,9]],"date-time":"2019-01-09T00:00:00Z","timestamp":1546992000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Tier 1","award":["2017-T1-002-047"],"award-info":[{"award-number":["2017-T1-002-047"]}]},{"name":"ECS grant from Research Grants Council of Hong Kong","award":["CityU 21203516"],"award-info":[{"award-number":["CityU 21203516"]}]},{"name":"GRF grant from Research Grants Council of Hong Kong","award":["CityU 11217817"],"award-info":[{"award-number":["CityU 11217817"]}]},{"name":"NTU CoE","award":["M4081879"],"award-info":[{"award-number":["M4081879"]}]},{"name":"Singapore MOE Tier 2","award":["MOE2016-T2-2-023"],"award-info":[{"award-number":["MOE2016-T2-2-023"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Sen. Netw."],"published-print":{"date-parts":[[2019,2,28]]},"abstract":"<jats:p>Due to the increasing popularity of mobile devices, the usage of lifelogging has dramatically expanded. People collect their daily memorial moments and share with friends on the social network, which is an emerging lifestyle. We see great potential of lifelogging applications along with rapid recent growth of the wearables market, where more sensors are introduced to wearables, i.e., electroencephalogram (EEG) sensors, that can further sense the user\u2019s mental activities, e.g., emotions. In this article, we present the design and implementation of Memento, an emotion-driven lifelogging system on wearables. Memento integrates EEG sensors with smart glasses. Since memorable moments usually coincides with the user\u2019s emotional changes, Memento leverages the knowledge from the brain-computer-interface domain to analyze the EEG signals to infer emotions and automatically launch lifelogging based on that. Towards building Memento on Commercial off-the-shelf wearable devices, we study EEG signals in mobility cases and propose a multiple sensor fusion based approach to estimate signal quality. We present a customized two-phase emotion recognition architecture, considering both the affordability and efficiency of wearable-class devices. We also discuss the optimization framework to automatically choose and configure the suitable lifelogging method (video, audio, or image) by analyzing the environment and system context. Finally, our experimental evaluation shows that Memento is responsive, efficient, and user-friendly on wearables.<\/jats:p>","DOI":"10.1145\/3281630","type":"journal-article","created":{"date-parts":[[2019,1,9]],"date-time":"2019-01-09T18:36:36Z","timestamp":1547058996000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":48,"title":["Memento"],"prefix":"10.1145","volume":"15","author":[{"given":"Shiqi","family":"Jiang","sequence":"first","affiliation":[{"name":"Nanyang Technological University, Nanyang Avenue, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhenjiang","family":"Li","sequence":"additional","affiliation":[{"name":"City University of Hong Kong, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pengfei","family":"Zhou","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Nanyang Avenue, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mo","family":"Li","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Nanyang Avenue, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,1,9]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"GoPro. 2015. Retrieved from https:\/\/gopro.com\/.  GoPro. 2015. Retrieved from https:\/\/gopro.com\/."},{"key":"e_1_2_1_2_1","unstructured":"Vicon. 2015. Retrieved from https:\/\/www.vicon.com\/.  Vicon. 2015. Retrieved from https:\/\/www.vicon.com\/."},{"key":"e_1_2_1_3_1","unstructured":"Everyday. 2016. Retrieved from http:\/\/everyday-app.com\/.  Everyday. 2016. Retrieved from http:\/\/everyday-app.com\/."},{"key":"e_1_2_1_4_1","unstructured":"Instant. 2016. Retrieved from http:\/\/instantapp.today\/.  Instant. 2016. Retrieved from http:\/\/instantapp.today\/."},{"key":"e_1_2_1_5_1","unstructured":"Narrative Clip. 2016. Retrieved from http:\/\/getnarrative.com\/.  Narrative Clip. 2016. Retrieved from http:\/\/getnarrative.com\/."},{"key":"e_1_2_1_6_1","unstructured":"10-20 system. 2017. Retrieved from https:\/\/goo.gl\/8Yzwv5.  10-20 system. 2017. Retrieved from https:\/\/goo.gl\/8Yzwv5."},{"key":"e_1_2_1_7_1","unstructured":"Electroencephalography. 2017 Retrieved from https:\/\/goo.gl\/okX9pC.  Electroencephalography. 2017 Retrieved from https:\/\/goo.gl\/okX9pC."},{"key":"e_1_2_1_8_1","unstructured":"Muse EEG headband. 2017. Retrieved from http:\/\/www.choosemuse.com\/.  Muse EEG headband. 2017. Retrieved from http:\/\/www.choosemuse.com\/."},{"key":"e_1_2_1_9_1","unstructured":"Microsoft Cognitive Services. 2018. Retrieved from https:\/\/www.microsoft.com\/cognitive-services\/en-us\/emotion-api.  Microsoft Cognitive Services. 2018. Retrieved from https:\/\/www.microsoft.com\/cognitive-services\/en-us\/emotion-api."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/NGMAST.2009.49"},{"key":"e_1_2_1_11_1","unstructured":"Christopher M. Bishop. 2006. Pattern Recognition and Machine Learning. Springer.   Christopher M. Bishop. 2006. Pattern Recognition and Machine Learning. Springer."},{"key":"e_1_2_1_12_1","unstructured":"Danny Oude Bos. 2007. EEG-based emotion recognition the influence of visual and auditory stimuli.  Danny Oude Bos. 2007. EEG-based emotion recognition the influence of visual and auditory stimuli."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/0005-7916(94)90063-9"},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the International Conference on Mobile Computing, Applications, and Services. Springer, 263--281","author":"Chennuru Snehal","year":"2010"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2011.29"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1180995.1181043"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357335"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1080\/02699939208411068"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1107458.1107460"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the 2Nd European Conference on Smart Sensing and Context (EuroSSC\u201907)","author":"Gluhak A."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2481405"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/11853565_11"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1500879.1500888"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-012-0514-5"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1093\/mind\/os-IX.34.188"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2014.2339834"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753638"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/0010-4825(88)90041-8"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2011.15"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2517351.2517372"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2742647.2742672"},{"key":"e_1_2_1_32_1","first-page":"2","article-title":"Toward detecting emotions in spoken dialogs","volume":"13","author":"Lee Chul Min","year":"2005","journal-title":"IEEE Trans. Speech Audio Process."},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the 2012 IEEE Consumer Communications and Networking Conference (CCNC\u201912)","author":"Lee H."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409635.1409643"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/1642293.1642416"},{"key":"e_1_2_1_36_1","doi-asserted-by":"crossref","unstructured":"Yandong Li Zhongwei Ma Wenkai Lu and Yanda Li. {n. d.}. Automatic removal of the eye blink artifact from EEG using an ICA-based template matching approach. Physiol. Measure. 27 4 ({n. d.}) 425.  Yandong Li Zhongwei Ma Wenkai Lu and Yanda Li. {n. d.}. Automatic removal of the eye blink artifact from EEG using an ICA-based template matching approach. Physiol. Measure. 27 4 ({n. d.}) 425.","DOI":"10.1088\/0967-3334\/27\/4\/008"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2462456.2483967"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2462456.2464448"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2637166.2637230"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.camwa.2007.04.035"},{"key":"e_1_2_1_41_1","doi-asserted-by":"crossref","unstructured":"Yisi Liu Olga Sourina and Minh Khoa Nguyen. 2011. Real-time EEG-based emotion recognition and its applications. In Transactions on Computational Science XII. 256--277.   Yisi Liu Olga Sourina and Minh Khoa Nguyen. 2011. Real-time EEG-based emotion recognition and its applications. In Transactions on Computational Science XII. 256--277.","DOI":"10.1007\/978-3-642-22336-5_13"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1869983.1869992"},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the 2008 International Symposium on Information Technology","volume":"2","author":"Murugappan M."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1620545.1620571"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.895976"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TITB.2009.2034649"},{"key":"e_1_2_1_47_1","volume-title":"Emotion, Psychopathology, and Psychotherapy","author":"Plutchik Robert"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1864349.1864393"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-012-0511-8"},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the 27th IEEE Conference on Decision and Control","volume":"1","author":"Ross K. W."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0077714"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2016.2590996"},{"key":"e_1_2_1_53_1","unstructured":"Olga Sourina and Yisi Liu. 2011. A fractal-based algorithm of emotion recognition from EEG using arousal-valence model. In Biosignals. 209--214.  Olga Sourina and Yisi Liu. 2011. A fractal-based algorithm of emotion recognition from EEG using arousal-valence model. In Biosignals. 209--214."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/1322192.1322216"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2973750.2973762"}],"container-title":["ACM Transactions on Sensor Networks"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3281630","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3281630","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:02:10Z","timestamp":1750208530000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3281630"}},"subtitle":["An Emotion-driven Lifelogging System with Wearables"],"short-title":[],"issued":{"date-parts":[[2019,1,9]]},"references-count":55,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,2,28]]}},"alternative-id":["10.1145\/3281630"],"URL":"https:\/\/doi.org\/10.1145\/3281630","relation":{},"ISSN":["1550-4859","1550-4867"],"issn-type":[{"value":"1550-4859","type":"print"},{"value":"1550-4867","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1,9]]},"assertion":[{"value":"2018-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-01-09","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}