{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T19:56:42Z","timestamp":1776110202275,"version":"3.50.1"},"reference-count":69,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2020,9,4]],"date-time":"2020-09-04T00:00:00Z","timestamp":1599177600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2020,9,4]]},"abstract":"<jats:p>Personal informatics systems for the work environment can help improving workers' well-being and productivity. Using both self-reported data logged manually by the users and information automatically inferred from sensor measurements, such systems may track users' activities at work and help them reflect on their work habits through insightful data visualizations. They can further support interventions like, e.g., blocking distractions during work activities or suggest the user to take a break. The ability to automatically recognize when the user is engaged in a work activity or taking a break is thus a fundamental primitive such systems need to implement. In this paper, we explore the use of data collected from personal devices -- smartwatches, laptops, and smartphones -- to automatically recognize when users are working or taking breaks. We collect a data set of of continuous streams of sensor data captured from personal devices along with labels indicating whether a user is working or taking a break. We use multiple instruments to facilitate the collection of users' self-reported labels and discuss our experience with this approach. We analyse the available data -- 449 labelled activities of nine knowledge workers collected during a typical work week -- using machine learning techniques and show that user-independent models can achieve a (F1 score) of 94% for the identification of work activities and of 69% for breaks, outperforming baseline methods by 5-10 and 12-54 percentage points, respectively.<\/jats:p>","DOI":"10.1145\/3411821","type":"journal-article","created":{"date-parts":[[2020,9,4]],"date-time":"2020-09-04T21:39:45Z","timestamp":1599255585000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":20,"title":["A Multi-Sensor Approach to Automatically Recognize Breaks and Work Activities of Knowledge Workers in Academia"],"prefix":"10.1145","volume":"4","author":[{"given":"Elena","family":"Di Lascio","sequence":"first","affiliation":[{"name":"Universit\u00e0 della Svizzera italiana (USI), Lugano, Switzerland"}]},{"given":"Shkurta","family":"Gashi","sequence":"additional","affiliation":[{"name":"Universit\u00e0 della Svizzera italiana (USI), Lugano, Switzerland"}]},{"given":"Juan Sebastian","family":"Hidalgo","sequence":"additional","affiliation":[{"name":"ABB, Zurich, Switzerland and Universit\u00e0 della Svizzera italiana (USI)"}]},{"given":"Beatrice","family":"Nale","sequence":"additional","affiliation":[{"name":"Deloitte, Milan, Italy and Universit\u00e0 della Svizzera italiana (USI)"}]},{"given":"Maike E.","family":"Debus","sequence":"additional","affiliation":[{"name":"Friedrich-Alexander University Erlangen-N\u00fcrnberg (FAU), N\u00fcrnberg, Germany"}]},{"given":"Silvia","family":"Santini","sequence":"additional","affiliation":[{"name":"Universit\u00e0 della Svizzera italiana (USI), Lugano, Switzerland"}]}],"member":"320","published-online":{"date-parts":[[2020,9,4]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Below the Surface: Unobtrusive Activity Recognition for Work Surfaces Using RF-radar Sensing. In International Conference on Intelligent User Interfaces. 439--451","author":"Avrahami Daniel","year":"2018","unstructured":"Daniel Avrahami , Mitesh Patel , Yusuke Yamaura , and Sven Kratz . 2018 . Below the Surface: Unobtrusive Activity Recognition for Work Surfaces Using RF-radar Sensing. In International Conference on Intelligent User Interfaces. 439--451 . Daniel Avrahami, Mitesh Patel, Yusuke Yamaura, and Sven Kratz. 2018. Below the Surface: Unobtrusive Activity Recognition for Work Surfaces Using RF-radar Sensing. In International Conference on Intelligent User Interfaces. 439--451."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDMW.2011.178"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.energy.2014.10.025"},{"key":"e_1_2_1_4_1","unstructured":"Christopher M Bishop. 2006. Pattern Recognition and Machine Learning. springer.  Christopher M Bishop. 2006. Pattern Recognition and Machine Learning. springer."},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","unstructured":"Wolfram Boucsein. 2012. Electrodermal Activity. Springer Science & Business Media.  Wolfram Boucsein. 2012. Electrodermal Activity. Springer Science & Business Media.","DOI":"10.1007\/978-1-4614-1126-0"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2499621"},{"key":"e_1_2_1_7_1","unstructured":"Andriy Burkov. 2019. The Hundred-page Machine Learning Book. Andriy Burkov Quebec City Can.  Andriy Burkov. 2019. The Hundred-page Machine Learning Book. Andriy Burkov Quebec City Can."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3026021"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1613\/jair.953"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.3390\/s17102435"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2017.18"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3369828"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3264913"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3329189.3329216"},{"key":"e_1_2_1_16_1","volume-title":"April","author":"EMELC-WG - Engineering Methodologies for Ethical Life-Cycle Concerns Working Group","year":"2020","unstructured":"EMELC-WG - Engineering Methodologies for Ethical Life-Cycle Concerns Working Group . 2020. IEEE Draft Model Process for Addressing Ethical Concerns During System Design. 'Standard (Draft)' IEEE P7000\/D3 , April 2020 . 'IEEE'. 83 pages. EMELC-WG - Engineering Methodologies for Ethical Life-Cycle Concerns Working Group. 2020. IEEE Draft Model Process for Addressing Ethical Concerns During System Design. 'Standard (Draft)' IEEE P7000\/D3, April 2020. 'IEEE'. 83 pages."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858066"},{"key":"e_1_2_1_18_1","volume-title":"Unsupervised Emotional State Classification Through Physiological Parameters for Social Robotics Applications. Knowledge-Based Systems 190","author":"Fiorini Laura","year":"2020","unstructured":"Laura Fiorini , Gianmaria Mancioppi , Francesco Semeraro , Hamido Fujita , and Filippo Cavallo . 2020. Unsupervised Emotional State Classification Through Physiological Parameters for Social Robotics Applications. Knowledge-Based Systems 190 ( 2020 ). Laura Fiorini, Gianmaria Mancioppi, Francesco Semeraro, Hamido Fujita, and Filippo Cavallo. 2020. Unsupervised Emotional State Classification Through Physiological Parameters for Social Robotics Applications. Knowledge-Based Systems 190 (2020)."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.4108\/icst.mobihealth.2014.257418"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3314400"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858352"},{"key":"e_1_2_1_22_1","first-page":"797","article-title":"cvxEDA: A Convex Optimization Approach to Electrodermal Activity Processing","volume":"63","author":"Greco Alberto","year":"2015","unstructured":"Alberto Greco , Gaetano Valenza , Antonio Lanata , Enzo Pasquale Scilingo , and Luca Citi . 2015 . cvxEDA: A Convex Optimization Approach to Electrodermal Activity Processing . IEEE Transactions on Biomedical Engineering 63 , 4 (2015), 797 -- 804 . Alberto Greco, Gaetano Valenza, Antonio Lanata, Enzo Pasquale Scilingo, and Luca Citi. 2015. cvxEDA: A Convex Optimization Approach to Electrodermal Activity Processing. IEEE Transactions on Biomedical Engineering 63, 4 (2015), 797--804.","journal-title":"IEEE Transactions on Biomedical Engineering"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377325.3377507"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13678-016-0007-y"},{"key":"e_1_2_1_25_1","volume-title":"Measurement, Control Journal, Modelling, Measurement, Control (2B)","author":"Handouzi Wahida","year":"2014","unstructured":"Wahida Handouzi , Choubeila Maaoui , Alain Pruski , and Abdelhak Moussaoui . 2014. Anxiety Recognition Using Relevant Features from BVP Signal: Application on Phobic Individuals. Modelling , Measurement, Control Journal, Modelling, Measurement, Control (2B) ( 2014 ). Wahida Handouzi, Choubeila Maaoui, Alain Pruski, and Abdelhak Moussaoui. 2014. Anxiety Recognition Using Relevant Features from BVP Signal: Application on Phobic Individuals. Modelling, Measurement, Control Journal, Modelling, Measurement, Control (2B) (2014)."},{"key":"e_1_2_1_26_1","volume-title":"Call Center Stress Recognition with Person-specific Models. In International Conference on Affective Computing and Intelligent Interaction. Springer, 125--134","author":"Hernandez Javier","year":"2011","unstructured":"Javier Hernandez , Rob R Morris , and Rosalind W Picard . 2011 . Call Center Stress Recognition with Person-specific Models. In International Conference on Affective Computing and Intelligent Interaction. Springer, 125--134 . Javier Hernandez, Rob R Morris, and Rosalind W Picard. 2011. Call Center Stress Recognition with Person-specific Models. In International Conference on Affective Computing and Intelligent Interaction. Springer, 125--134."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632048.2636065"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2012.6289074"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2993148.2993159"},{"key":"e_1_2_1_30_1","unstructured":"Harmanpreet Kaur Alex C Williams Daniel McDuff Mary Czerwinski Jaime Teevan and Shamsi Iqbal. 2020. Optimizing for Happiness and Productivity: Modeling Opportune Moments for Transitions and Breaks at Work. (2020).  Harmanpreet Kaur Alex C Williams Daniel McDuff Mary Czerwinski Jaime Teevan and Shamsi Iqbal. 2020. Optimizing for Happiness and Productivity: Modeling Opportune Moments for Transitions and Breaks at Work. (2020)."},{"key":"e_1_2_1_31_1","first-page":"1","article-title":"Technology Supported Behavior Restriction for Mitigating Self-interruptions in Multi-device Environments","volume":"1","author":"Kim Jaejeung","year":"2017","unstructured":"Jaejeung Kim , Chiwoo Cho , and Uichin Lee . 2017 . Technology Supported Behavior Restriction for Mitigating Self-interruptions in Multi-device Environments . Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1 , 3 (2017), 1 -- 21 . Jaejeung Kim, Chiwoo Cho, and Uichin Lee. 2017. Technology Supported Behavior Restriction for Mitigating Self-interruptions in Multi-device Environments. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 1--21.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300845"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858428"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACII.2019.8925488"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2013.06.003"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2448136.2448170"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2493432.2493452"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753409"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173701"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173666"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1054972.1055017"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557204"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2016.08.023"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC.2014.6944243"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208525"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2017.2656886"},{"key":"e_1_2_1_47_1","volume-title":"Rethinking Productivity in Software Engineering","author":"Meyer Andr\u00e9 N","unstructured":"Andr\u00e9 N Meyer , Thomas Fritz , and Thomas Zimmermann . 2019. Fitbit for Developers: Self-Monitoring at Work . In Rethinking Productivity in Software Engineering . Springer , 261--270. Andr\u00e9 N Meyer, Thomas Fritz, and Thomas Zimmermann. 2019. Fitbit for Developers: Self-Monitoring at Work. In Rethinking Productivity in Software Engineering. Springer, 261--270."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3328908"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2004.02.004"},{"key":"e_1_2_1_50_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3264942","article-title":"Heed: Exploring the Design of Situated Self-Reporting Devices","volume":"2","author":"Paruthi Gaurav","year":"2018","unstructured":"Gaurav Paruthi , Shriti Raj , Seungjoo Baek , Chuyao Wang , Chuan-che Huang, Yung-Ju Chang , and Mark W Newman . 2018 . Heed: Exploring the Design of Situated Self-Reporting Devices . Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2 , 3 (2018), 1 -- 21 . Gaurav Paruthi, Shriti Raj, Seungjoo Baek, Chuyao Wang, Chuan-che Huang, Yung-Ju Chang, and Mark W Newman. 2018. Heed: Exploring the Design of Situated Self-Reporting Devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 3 (2018), 1--21.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_51_1","volume-title":"Is There More to Blood","author":"Peper Erik","year":"2007","unstructured":"Erik Peper , Rick Harvey , I- Mei Lin , Hana Tylova , and Donald Moss . 2007. Is There More to Blood Volume Pulse than Heart Rate Variability, Respiratory Sinus Arrhythmia, and Cardiorespiratory Synchrony? Biofeedback 35 , 2 ( 2007 ). Erik Peper, Rick Harvey, I-Mei Lin, Hana Tylova, and Donald Moss. 2007. Is There More to Blood Volume Pulse than Heart Rate Variability, Respiratory Sinus Arrhythmia, and Cardiorespiratory Synchrony? Biofeedback 35, 2 (2007)."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.5298\/1081-5937-38.1.19"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2804252"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3191764"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.3390\/s19194079"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/TITB.2009.2036164"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2019.2901673"},{"key":"e_1_2_1_58_1","volume-title":"Ethical it innovation: A value-based system design approach","author":"Spiekermann Sarah","unstructured":"Sarah Spiekermann . 2015. Ethical it innovation: A value-based system design approach . Auerbach Publications . 248 pages. Sarah Spiekermann. 2015. Ethical it innovation: A value-based system design approach. Auerbach Publications. 248 pages."},{"key":"e_1_2_1_59_1","volume-title":"Automatic Identification of Artifacts in Electrodermal Activity Data. In Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE.","author":"Taylor Sara","year":"2015","unstructured":"Sara Taylor , Natasha Jaques , Weixuan Chen , Szymon Fedor , Akane Sano , and Rosalind Picard . 2015 . Automatic Identification of Artifacts in Electrodermal Activity Data. In Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE. Sara Taylor, Natasha Jaques, Weixuan Chen, Szymon Fedor, Akane Sano, and Rosalind Picard. 2015. Automatic Identification of Artifacts in Electrodermal Activity Data. In Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE."},{"key":"e_1_2_1_60_1","volume-title":"Personalized Multitask Learning for Predicting Tomorrow's Mood, Stress, and Health","author":"Taylor Sara Ann","year":"2017","unstructured":"Sara Ann Taylor , Natasha Jaques , Ehimwenma Nosakhare , Akane Sano , and Rosalind Picard . 2017. Personalized Multitask Learning for Predicting Tomorrow's Mood, Stress, and Health . IEEE Transactions on Affective Computing ( 2017 ). Sara Ann Taylor, Natasha Jaques, Ehimwenma Nosakhare, Akane Sano, and Rosalind Picard. 2017. Personalized Multitask Learning for Predicting Tomorrow's Mood, Stress, and Health. IEEE Transactions on Affective Computing (2017)."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300697"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2017.3971131"},{"key":"e_1_2_1_63_1","volume-title":"Segmenting Accelerometer Data from Daily Life with Unsupervised Machine Learning. PloS one 14, 1","author":"van Kuppevelt Dafne","year":"2019","unstructured":"Dafne van Kuppevelt , Joe Heywood , Mark Hamer , S\u00e9verine Sabia , Emla Fitzsimons , and Vincent van Hees . 2019. Segmenting Accelerometer Data from Daily Life with Unsupervised Machine Learning. PloS one 14, 1 ( 2019 ). Dafne van Kuppevelt, Joe Heywood, Mark Hamer, S\u00e9verine Sabia, Emla Fitzsimons, and Vincent van Hees. 2019. Segmenting Accelerometer Data from Daily Life with Unsupervised Machine Learning. PloS one 14, 1 (2019)."},{"key":"e_1_2_1_64_1","volume-title":"Proceedings of the CHI Conference on Human Factors in Computing Systems.","author":"Whittaker Steve","year":"2016","unstructured":"Steve Whittaker , Vaiva Kalnikaite , Victoria Hollis , and Andrew Guydish . 2016 . ' Don't Waste My Time' Use of Time Information Improves Focus . In Proceedings of the CHI Conference on Human Factors in Computing Systems. Steve Whittaker, Vaiva Kalnikaite, Victoria Hollis, and Andrew Guydish. 2016. 'Don't Waste My Time' Use of Time Information Improves Focus. In Proceedings of the CHI Conference on Human Factors in Computing Systems."},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.3390\/s17102324"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/PERCOMW.2016.7457166"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287079"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.5555\/1717872"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2009.32"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411821","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3411821","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:48Z","timestamp":1750195488000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411821"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,4]]},"references-count":69,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,9,4]]}},"alternative-id":["10.1145\/3411821"],"URL":"https:\/\/doi.org\/10.1145\/3411821","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,4]]},"assertion":[{"value":"2020-09-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}