{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T12:35:14Z","timestamp":1776083714372,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":35,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,9,21]],"date-time":"2021-09-21T00:00:00Z","timestamp":1632182400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000923","name":"Australian Research Council","doi-asserted-by":"publisher","award":["LP150100246"],"award-info":[{"award-number":["LP150100246"]}],"id":[{"id":"10.13039\/501100000923","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,9,21]]},"DOI":"10.1145\/3460418.3479338","type":"proceedings-article","created":{"date-parts":[[2021,9,24]],"date-time":"2021-09-24T17:56:03Z","timestamp":1632506163000},"page":"237-242","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":21,"title":["Investigating the Reliability of Self-report Data in the Wild: The Quest for Ground Truth"],"prefix":"10.1145","author":[{"given":"Nan","family":"Gao","sequence":"first","affiliation":[{"name":"RMIT University, Australia"}]},{"given":"Mohammad","family":"Saiedur Rahaman","sequence":"additional","affiliation":[{"name":"RMIT University, Australia"}]},{"given":"Wei","family":"Shao","sequence":"additional","affiliation":[{"name":"RMIT University, Australia"}]},{"given":"Flora D","family":"Salim","sequence":"additional","affiliation":[{"name":"RMIT University, Australia"}]}],"member":"320","published-online":{"date-parts":[[2021,9,24]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDMW.2011.178"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1093\/fampra\/19.1.105"},{"key":"e_1_3_2_1_3_1","volume-title":"Constructing validity: New developments in creating objective measuring instruments.Psychological Assessment 31, 12","author":"Clark Lee\u00a0Anna","year":"2019","unstructured":"Lee\u00a0Anna Clark and David Watson . 2019. Constructing validity: New developments in creating objective measuring instruments.Psychological Assessment 31, 12 ( 2019 ), 1412\u20131427. Lee\u00a0Anna Clark and David Watson. 2019. Constructing validity: New developments in creating objective measuring instruments.Psychological Assessment 31, 12 (2019), 1412\u20131427."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3264913"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.3102\/00346543074001059"},{"key":"e_1_3_2_1_6_1","volume-title":"Handbook of Research on Student Engagement","author":"Fredricks A","unstructured":"Jennifer\u00a0 A Fredricks and Wendy McColskey . 2012. The Measurement of Student Engagement: A Comparative Analysis of Various Methods and Student Self-report Instruments . In Handbook of Research on Student Engagement . Springer , 763\u2013782. Jennifer\u00a0A Fredricks and Wendy McColskey. 2012. The Measurement of Student Engagement: A Comparative Analysis of Various Methods and Student Self-report Instruments. In Handbook of Research on Student Engagement. Springer, 763\u2013782."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0205828"},{"key":"#cr-split#-e_1_3_2_1_8_1.1","unstructured":"Nan Gao Max Marschall Jane Burry Simon Watkins and Flora Salim. 2021. In-Gauge and En-Gage Datasets. Figshare. https:\/\/doi.org\/10.25439\/rmt.14578908. https:\/\/doi.org\/10.25439\/rmt.14578908 10.25439\/rmt.14578908"},{"key":"#cr-split#-e_1_3_2_1_8_1.2","unstructured":"Nan Gao Max Marschall Jane Burry Simon Watkins and Flora Salim. 2021. In-Gauge and En-Gage Datasets. Figshare. https:\/\/doi.org\/10.25439\/rmt.14578908. https:\/\/doi.org\/10.25439\/rmt.14578908"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"crossref","unstructured":"Nan Gao Max Marschall Jane Burry Simon Watkins and Flora\u00a0D. Salim. 2021. Understanding Occupants\u2019 Behaviour Engagement Emotion and Comfort Indoors with Heterogeneous Sensors and Wearables. arxiv:2105.06637\u00a0[cs.HC]  Nan Gao Max Marschall Jane Burry Simon Watkins and Flora\u00a0D. Salim. 2021. Understanding Occupants\u2019 Behaviour Engagement Emotion and Comfort Indoors with Heterogeneous Sensors and Wearables. arxiv:2105.06637\u00a0[cs.HC]","DOI":"10.1038\/s41597-022-01347-w"},{"key":"e_1_3_2_1_10_1","first-page":"1","article-title":"n-Gage: Predicting in-class Emotional, Behavioural and Cognitive Engagement in the Wild","volume":"4","author":"Gao Nan","year":"2020","unstructured":"Nan Gao , Wei Shao , Mohammad\u00a0Saiedur Rahaman , and Flora\u00a0 D Salim . 2020 . n-Gage: Predicting in-class Emotional, Behavioural and Cognitive Engagement in the Wild . Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4 , 3 (2020), 1 \u2013 26 . Nan Gao, Wei Shao, Mohammad\u00a0Saiedur Rahaman, and Flora\u00a0D Salim. 2020. n-Gage: Predicting in-class Emotional, Behavioural and Cognitive Engagement in the Wild. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 3 (2020), 1\u201326.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2019.2913751"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267305.3267693"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3314400"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1177\/1073191117744660"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3191745"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1111\/psyp.12243"},{"key":"e_1_3_2_1_17_1","first-page":"2043","article-title":"Stepovers and Signal Detection","volume":"9","author":"Jackson C.","year":"2018","unstructured":"Robin\u00a0 C. Jackson , Hayley Barton , Kelly\u00a0 J. Ashford , and Bruce Abernethy . 2018 . Stepovers and Signal Detection : Response Sensitivity and Bias in the Differentiation of Genuine and Deceptive Football Actions.Frontiers in Psychology 9 (2018), 2043 . Robin\u00a0C. Jackson, Hayley Barton, Kelly\u00a0J. Ashford, and Bruce Abernethy. 2018. Stepovers and Signal Detection: Response Sensitivity and Bias in the Differentiation of Genuine and Deceptive Football Actions.Frontiers in Psychology 9 (2018), 2043.","journal-title":"Response Sensitivity and Bias in the Differentiation of Genuine and Deceptive Football Actions.Frontiers in Psychology"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359260"},{"key":"e_1_3_2_1_19_1","first-page":"613","article-title":"An Ultra-brief Screening Scale for Anxiety and Depression: The PHQ-4","volume":"50","author":"Kroenke Kurt","year":"2009","unstructured":"Kurt Kroenke , Robert\u00a0 L. Spitzer , Janet\u00a0 B.W. Williams , and Bernd L\u00f6we . 2009 . An Ultra-brief Screening Scale for Anxiety and Depression: The PHQ-4 . Psychosomatics 50 , 6 (2009), 613 \u2013 621 . Kurt Kroenke, Robert\u00a0L. Spitzer, Janet\u00a0B.W. Williams, and Bernd L\u00f6we. 2009. An Ultra-brief Screening Scale for Anxiety and Depression: The PHQ-4. Psychosomatics 50, 6 (2009), 613\u2013621.","journal-title":"Psychosomatics"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2008.06.026"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1093\/poq\/nfn050"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2481406"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351233"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1177\/1088868316628405"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2020.2996219"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-020-68253-2"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1177\/0013164408323233"},{"key":"e_1_3_2_1_28_1","volume-title":"Ineffectiveness of Reverse Wording of Questionnaire Items: Let\u2019s Learn from Cows in the Rain. PLoS ONE 8, 7","author":"van Sonderen Eric","year":"2013","unstructured":"Eric van Sonderen , Robbert Sanderman , and James\u00a0 C. Coyne . 2013. Ineffectiveness of Reverse Wording of Questionnaire Items: Let\u2019s Learn from Cows in the Rain. PLoS ONE 8, 7 ( 2013 ). Eric van Sonderen, Robbert Sanderman, and James\u00a0C. Coyne. 2013. Ineffectiveness of Reverse Wording of Questionnaire Items: Let\u2019s Learn from Cows in the Rain. PLoS ONE 8, 7 (2013)."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632048.2632054"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3191775","article-title":"Tracking Depression Dynamics in College Students using Mobile Phone and Wearable Sensing","volume":"2","author":"Wang Rui","year":"2018","unstructured":"Rui Wang , Weichen Wang , Alex DaSilva , Jeremy\u00a0 F Huckins , William\u00a0 M Kelley , Todd\u00a0 F Heatherton , and Andrew\u00a0 T Campbell . 2018 . Tracking Depression Dynamics in College Students using Mobile Phone and Wearable Sensing . Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2 , 1 (2018), 1 \u2013 26 . Rui Wang, Weichen Wang, Alex DaSilva, Jeremy\u00a0F Huckins, William\u00a0M Kelley, Todd\u00a0F Heatherton, and Andrew\u00a0T Campbell. 2018. Tracking Depression Dynamics in College Students using Mobile Phone and Wearable Sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 1 (2018), 1\u201326.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3264951","article-title":"Sensing Behavioral Change over Time: Using Within-person Variability Features from Mobile Sensing to Predict Personality Traits","volume":"2","author":"Wang Weichen","year":"2018","unstructured":"Weichen Wang , Gabriella\u00a0 M Harari , Rui Wang , Sandrine\u00a0 R M\u00fcller , Shayan Mirjafari , Kizito Masaba , and Andrew\u00a0 T Campbell . 2018 . Sensing Behavioral Change over Time: Using Within-person Variability Features from Mobile Sensing to Predict Personality Traits . Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2 , 3 (2018), 1 \u2013 21 . Weichen Wang, Gabriella\u00a0M Harari, Rui Wang, Sandrine\u00a0R M\u00fcller, Shayan Mirjafari, Kizito Masaba, and Andrew\u00a0T Campbell. 2018. Sensing Behavioral Change over Time: Using Within-person Variability Features from Mobile Sensing to Predict Personality Traits. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 3 (2018), 1\u201321.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025911"},{"key":"e_1_3_2_1_33_1","first-page":"1","article-title":"Leveraging Routine Behavior and Contextually-filtered Features for Depression Detection among College Students","volume":"3","author":"Xu Xuhai","year":"2019","unstructured":"Xuhai Xu , Prerna Chikersal , Afsaneh Doryab , Daniella\u00a0 K Villalba , Janine\u00a0 M Dutcher , Michael\u00a0 J Tumminia , Tim Althoff , Sheldon Cohen , Kasey\u00a0 G Creswell , J\u00a0David Creswell , 2019 . Leveraging Routine Behavior and Contextually-filtered Features for Depression Detection among College Students . Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3 , 3 (2019), 1 \u2013 33 . Xuhai Xu, Prerna Chikersal, Afsaneh Doryab, Daniella\u00a0K Villalba, Janine\u00a0M Dutcher, Michael\u00a0J Tumminia, Tim Althoff, Sheldon Cohen, Kasey\u00a0G Creswell, J\u00a0David Creswell, 2019. Leveraging Routine Behavior and Contextually-filtered Features for Depression Detection among College Students. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (2019), 1\u201333.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3161414","article-title":"Moodexplorer: Towards Compound Emotion Detection via Smartphone Sensing","volume":"1","author":"Zhang Xiao","year":"2018","unstructured":"Xiao Zhang , Wenzhong Li , Xu Chen , and Sanglu Lu . 2018 . Moodexplorer: Towards Compound Emotion Detection via Smartphone Sensing . Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1 , 4 (2018), 1 \u2013 30 . Xiao Zhang, Wenzhong Li, Xu Chen, and Sanglu Lu. 2018. Moodexplorer: Towards Compound Emotion Detection via Smartphone Sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 4 (2018), 1\u201330.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"}],"event":{"name":"UbiComp '21: The 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing","location":"Virtual USA","acronym":"UbiComp '21","sponsor":["SIGMOBILE ACM Special Interest Group on Mobility of Systems, Users, Data and Computing","SIGCHI ACM Special Interest Group on Computer-Human Interaction","SIGSPATIAL ACM Special Interest Group on Spatial Information"]},"container-title":["Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3460418.3479338","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3460418.3479338","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:56Z","timestamp":1750191536000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3460418.3479338"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,21]]},"references-count":35,"alternative-id":["10.1145\/3460418.3479338","10.1145\/3460418"],"URL":"https:\/\/doi.org\/10.1145\/3460418.3479338","relation":{},"subject":[],"published":{"date-parts":[[2021,9,21]]},"assertion":[{"value":"2021-09-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}