{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,20]],"date-time":"2025-07-20T04:35:04Z","timestamp":1752986104042,"version":"3.41.0"},"reference-count":38,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2021,3,19]],"date-time":"2021-03-19T00:00:00Z","timestamp":1616112000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2021,3,19]]},"abstract":"<jats:p>Enabling smartphones to understand our emotional well-being provides the potential to create personalised applications and highly responsive interfaces. However, this is by no means a trivial task - subjectivity in reporting emotions impacts the reliability of ground-truth information whereas smartphones, unlike specialised wearables, have limited sensing capabilities. In this paper, we propose a new approach that advances emotional state prediction by extracting outlier-based features and by mitigating the subjectivity in capturing ground-truth information. We utilised this approach in a distinctive and challenging use case - happiness detection - and we demonstrated prediction performance improvements of up to 13% in AUC and 27% in F-score compared to the traditional modelling approaches. The results indicate that extreme values (i.e. outliers) of sensor readings mirror extreme values in the reported happiness levels. Furthermore, we showed that this approach is more robust in replicating the prediction model in completely new experimental settings.<\/jats:p>","DOI":"10.1145\/3448095","type":"journal-article","created":{"date-parts":[[2021,3,30]],"date-time":"2021-03-30T18:56:41Z","timestamp":1617130601000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Outliers in Smartphone Sensor Data Reveal Outliers in Daily Happiness"],"prefix":"10.1145","volume":"5","author":[{"given":"Teodora Sandra","family":"Buda","sequence":"first","affiliation":[{"name":"Koa Health, Spain"}]},{"given":"Mohammed","family":"Khwaja","sequence":"additional","affiliation":[{"name":"Imperial College London, UK, Koa Health, Spain"}]},{"given":"Aleksandar","family":"Matic","sequence":"additional","affiliation":[{"name":"Koa Health, Spain"}]}],"member":"320","published-online":{"date-parts":[[2021,3,30]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Measuring happiness with a single-item scale. Social Behavior and Personality: an international journal 34, 2","author":"Abdel-Khalek Ahmed M","year":"2006","unstructured":"Ahmed M Abdel-Khalek . 2006. Measuring happiness with a single-item scale. Social Behavior and Personality: an international journal 34, 2 ( 2006 ), 139--150. Ahmed M Abdel-Khalek. 2006. Measuring happiness with a single-item scale. Social Behavior and Personality: an international journal 34, 2 (2006), 139--150."},{"volume-title":"Data mining","author":"Aggarwal Charu C","key":"e_1_2_1_2_1","unstructured":"Charu C Aggarwal . 2015. Outlier analysis . In Data mining . Springer , 237--263. Charu C Aggarwal. 2015. Outlier analysis. In Data mining. Springer, 237--263."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1057\/palgrave.elmr.1410157"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.5505"},{"key":"e_1_2_1_5_1","volume-title":"Challenges to the Reproducibility of Machine Learning Models in Health Care. JAMA","author":"Beam Andrew L","year":"2020","unstructured":"Andrew L Beam , Arjun K Manrai , and Marzyeh Ghassemi . 2020. Challenges to the Reproducibility of Machine Learning Models in Health Care. JAMA ( 2020 ). Andrew L Beam, Arjun K Manrai, and Marzyeh Ghassemi. 2020. Challenges to the Reproducibility of Machine Learning Models in Health Care. JAMA (2020)."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2647868.2654933"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/SocialCom.2013.118"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-93034-3_46"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1541880.1541882"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2011.29"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267305.3267536"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2017.12.008"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-37210-0_6"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.95.3.542"},{"key":"e_1_2_1_15_1","unstructured":"Ed Diener Pelin Kesebir and William Tov. 2009. Happiness. (2009). Ed Diener Pelin Kesebir and William Tov. 2009. Happiness. (2009)."},{"key":"e_1_2_1_16_1","doi-asserted-by":"crossref","unstructured":"Edward Diener Richard E Lucas Shigehiro Oishi etal 2002. Subjective well-being: The science of happiness and life satisfaction. Handbook of positive psychology 2 (2002) 63--73. Edward Diener Richard E Lucas Shigehiro Oishi et al. 2002. Subjective well-being: The science of happiness and life satisfaction. Handbook of positive psychology 2 (2002) 63--73.","DOI":"10.1093\/oso\/9780195135336.003.0005"},{"volume-title":"Happiness by design: Finding pleasure and purpose in everyday life","author":"Dolan Paul","key":"e_1_2_1_17_1","unstructured":"Paul Dolan . 2014. Happiness by design: Finding pleasure and purpose in everyday life . Penguin UK. Paul Dolan. 2014. Happiness by design: Finding pleasure and purpose in everyday life. Penguin UK."},{"key":"e_1_2_1_18_1","unstructured":"Paul Dolan Richard Layard and Robert Metcalfe. 2011. Measuring subjective well-being for public policy. (2011). Paul Dolan Richard Layard and Robert Metcalfe. 2011. Measuring subjective well-being for public policy. (2011)."},{"key":"e_1_2_1_19_1","volume-title":"Extraction of Behavioral Features from Smartphone and Wearable Data. arXiv preprint arXiv:1812.10394","author":"Doryab Afsaneh","year":"2018","unstructured":"Afsaneh Doryab , Prerna Chikarsel , Xinwen Liu , and Anind K Dey . 2018. Extraction of Behavioral Features from Smartphone and Wearable Data. arXiv preprint arXiv:1812.10394 ( 2018 ). Afsaneh Doryab, Prerna Chikarsel, Xinwen Liu, and Anind K Dey. 2018. Extraction of Behavioral Features from Smartphone and Wearable Data. arXiv preprint arXiv:1812.10394 (2018)."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.80.6.1011"},{"volume-title":"Identification of outliers","author":"Hawkins Douglas M","key":"e_1_2_1_21_1","unstructured":"Douglas M Hawkins . 1980. Identification of outliers . Vol. 11 . Springer . Douglas M Hawkins. 1980. Identification of outliers. Vol. 11. Springer."},{"key":"e_1_2_1_22_1","volume-title":"Predicting negative emotions based on mobile phone usage patterns: an exploratory study. JMIR research protocols 5, 3","author":"Chin-Lun Hung Galen","year":"2016","unstructured":"Galen Chin-Lun Hung , Pei-Ching Yang , Chia-Chi Chang , Jung-Hsien Chiang , and Ying-Yeh Chen . 2016. Predicting negative emotions based on mobile phone usage patterns: an exploratory study. JMIR research protocols 5, 3 ( 2016 ), e160. Galen Chin-Lun Hung, Pei-Ching Yang, Chia-Chi Chang, Jung-Hsien Chiang, and Ying-Yeh Chen. 2016. Predicting negative emotions based on mobile phone usage patterns: an exploratory study. JMIR research protocols 5, 3 (2016), e160."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACII.2015.7344575"},{"key":"e_1_2_1_24_1","volume-title":"NIPS Workshop on Machine Learning for Healthcare.","author":"Jaques Natasha","year":"2016","unstructured":"Natasha Jaques , Sara Taylor , Ehimwenma Nosakhare , Akane Sano , and Rosalind Picard . 2016 . Multi-task learning for predicting health, stress, and happiness . In NIPS Workshop on Machine Learning for Healthcare. Natasha Jaques, Sara Taylor, Ehimwenma Nosakhare, Akane Sano, and Rosalind Picard. 2016. Multi-task learning for predicting health, stress, and happiness. In NIPS Workshop on Machine Learning for Healthcare."},{"key":"e_1_2_1_25_1","volume-title":"Proc. NIPS Workshop on Multimodal Machine Learning","volume":"898","author":"Jaques Natasha","year":"2015","unstructured":"Natasha Jaques , Sara Taylor , Akane Sano , and Rosalind Picard . 2015 . Multi-task, multi-kernel learning for estimating individual wellbeing . In Proc. NIPS Workshop on Multimodal Machine Learning , Montreal, Quebec , Vol. 898 . Natasha Jaques, Sara Taylor, Akane Sano, and Rosalind Picard. 2015. Multi-task, multi-kernel learning for estimating individual wellbeing. In Proc. NIPS Workshop on Multimodal Machine Learning, Montreal, Quebec, Vol. 898."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1257\/089533006776526030"},{"key":"e_1_2_1_27_1","volume-title":"Diener","author":"Kesebir Pelin","year":"2009","unstructured":"Pelin Kesebir and Ed Diener . 2009 . In pursuit of happiness: Empirical answers to philosophical questions. In The science of well-being. Springer , 59--74. Pelin Kesebir and Ed Diener. 2009. In pursuit of happiness: Empirical answers to philosophical questions. In The science of well-being. Springer, 59--74."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351246"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpsychores.2004.09.006"},{"volume-title":"Daily mood assessment based on mobile phone sensing. In 2012 ninth international conference on wearable and implantable body sensor networks","author":"Ma Yuanchao","key":"e_1_2_1_30_1","unstructured":"Yuanchao Ma , Bin Xu , Yin Bai , Guodong Sun , and Run Zhu . 2012. Daily mood assessment based on mobile phone sensing. In 2012 ninth international conference on wearable and implantable body sensor networks . IEEE , 142--147. Yuanchao Ma, Bin Xu, Yin Bai, Guodong Sun, and Run Zhu. 2012. Daily mood assessment based on mobile phone sensing. In 2012 ninth international conference on wearable and implantable body sensor networks. IEEE, 142--147."},{"key":"e_1_2_1_31_1","first-page":"9","article-title":"When Simpler Data Does Not Imply Less Information: A Study of User Profiling Scenarios With Constrained View of Mobile HTTP (S) Traffic","volume":"12","author":"Park Souneil","year":"2018","unstructured":"Souneil Park , Aleksandar Matic , Kamini Garg , and Nuria Oliver . 2018 . When Simpler Data Does Not Imply Less Information: A Study of User Profiling Scenarios With Constrained View of Mobile HTTP (S) Traffic . ACM Transactions on the Web (TWEB) 12 , 2 (2018), 9 . Souneil Park, Aleksandar Matic, Kamini Garg, and Nuria Oliver. 2018. When Simpler Data Does Not Imply Less Information: A Study of User Profiling Scenarios With Constrained View of Mobile HTTP (S) Traffic. ACM Transactions on the Web (TWEB) 12, 2 (2018), 9.","journal-title":"ACM Transactions on the Web (TWEB)"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cosrev.2017.07.002"},{"key":"e_1_2_1_33_1","volume-title":"The accuracy of passive phone sensors in predicting daily mood. Depression and anxiety 36, 1","author":"Pratap Abhishek","year":"2019","unstructured":"Abhishek Pratap , David C Atkins , Brenna N Renn , Michael J Tanana , Sean D Mooney , Joaquin A Anguera , and Patricia A Are\u00e1n . 2019. The accuracy of passive phone sensors in predicting daily mood. Depression and anxiety 36, 1 ( 2019 ), 72--81. Abhishek Pratap, David C Atkins, Brenna N Renn, Michael J Tanana, Sean D Mooney, Joaquin A Anguera, and Patricia A Are\u00e1n. 2019. The accuracy of passive phone sensors in predicting daily mood. Depression and anxiety 36, 1 (2019), 72--81."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACII.2013.117"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/0146-6402(83)90013-9"},{"key":"e_1_2_1_36_1","volume-title":"Passive sensing of health outcomes through smartphones: systematic review of current solutions and possible limitations. JMIR mHealth and uHealth 7, 8","author":"Trifan Alina","year":"2019","unstructured":"Alina Trifan , Maryse Oliveira , and Jos\u00e9 Lu\u00eds Oliveira . 2019. Passive sensing of health outcomes through smartphones: systematic review of current solutions and possible limitations. JMIR mHealth and uHealth 7, 8 ( 2019 ), e12649. Alina Trifan, Maryse Oliveira, and Jos\u00e9 Lu\u00eds Oliveira. 2019. Passive sensing of health outcomes through smartphones: systematic review of current solutions and possible limitations. JMIR mHealth and uHealth 7, 8 (2019), e12649."},{"key":"e_1_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Timothy J Trull and Ulrich W Ebner-Priemer. 2009. Using experience sampling methods\/ecological momentary assessment (ESM\/EMA) in clinical assessment and clinical research: introduction to the special section. (2009). Timothy J Trull and Ulrich W Ebner-Priemer. 2009. Using experience sampling methods\/ecological momentary assessment (ESM\/EMA) in clinical assessment and clinical research: introduction to the special section. (2009).","DOI":"10.1037\/a0017653"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2014.2330816"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3448095","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3448095","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:59Z","timestamp":1750195499000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3448095"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,19]]},"references-count":38,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,3,19]]}},"alternative-id":["10.1145\/3448095"],"URL":"https:\/\/doi.org\/10.1145\/3448095","relation":{},"ISSN":["2474-9567"],"issn-type":[{"type":"electronic","value":"2474-9567"}],"subject":[],"published":{"date-parts":[[2021,3,19]]},"assertion":[{"value":"2021-03-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}