{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T10:36:46Z","timestamp":1768991806121,"version":"3.49.0"},"reference-count":82,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T00:00:00Z","timestamp":1695772800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100004332","name":"JPMorgan Chase and Company","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100004332","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["SaTC-1801472"],"award-info":[{"award-number":["SaTC-1801472"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2023,9,27]]},"abstract":"<jats:p>Translating fine-grained activity detection (e.g., phone ring, talking interspersed with silence and walking) into semantically meaningful and richer contextual information (e.g., on a phone call for 20 minutes while exercising) is essential towards enabling a range of healthcare and human-computer interaction applications. Prior work has proposed building ontologies or temporal analysis of activity patterns with limited success in capturing complex real-world context patterns. We present TAO, a hybrid system that leverages OWL-based ontologies and temporal clustering approaches to detect high-level contexts from human activities. TAO can characterize sequential activities that happen one after the other and activities that are interleaved or occur in parallel to detect a richer set of contexts more accurately than prior work. We evaluate TAO on real-world activity datasets (Casas and Extrasensory) and show that our system achieves, on average, 87% and 80% accuracy for context detection, respectively. We deploy and evaluate TAO in a real-world setting with eight participants using our system for three hours each, demonstrating TAO's ability to capture semantically meaningful contexts in the real world. Finally, to showcase the usefulness of contexts, we prototype wellness applications that assess productivity and stress and show that the wellness metrics calculated using contexts provided by TAO are much closer to the ground truth (on average within 1.1%), as compared to the baseline approach (on average within 30%).<\/jats:p>","DOI":"10.1145\/3610896","type":"journal-article","created":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T15:45:03Z","timestamp":1695829503000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["TAO"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3743-1384","authenticated-orcid":false,"given":"Sudershan","family":"Boovaraghavan","sequence":"first","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0034-2767","authenticated-orcid":false,"given":"Prasoon","family":"Patidar","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9304-6080","authenticated-orcid":false,"given":"Yuvraj","family":"Agarwal","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,9,27]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Alireza Abdoli. 2021. Time Series Data Mining Algorithms Towards Scalable and Real-Time Behavior Monitoring. https:\/\/doi.org\/10. 48550\/ARXIV.2112.14630"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1504\/IJWET.2009.025011"},{"key":"e_1_2_2_3_1","volume-title":"CAMeOnto: Context awareness meta ontology modeling. Applied computing and informatics 14, 2","author":"Aguilar Jose","year":"2018","unstructured":"Jose Aguilar, Marxjhony Jerez, and Taniana Rodr\u00edguez. 2018. CAMeOnto: Context awareness meta ontology modeling. Applied computing and informatics 14, 2 (2018), 202--213."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2015.11.007"},{"key":"e_1_2_2_5_1","volume-title":"The use of pervasive sensing for behaviour profiling---a survey. Pervasive and mobile computing 5, 5","author":"Atallah Louis","year":"2009","unstructured":"Louis Atallah and Guang-Zhong Yang. 2009. The use of pervasive sensing for behaviour profiling---a survey. Pervasive and mobile computing 5, 5 (2009), 447--464."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-013-0312-3"},{"key":"e_1_2_2_7_1","volume-title":"A survey of context modelling and reasoning techniques. Pervasive and mobile computing 6, 2","author":"Bettini Claudio","year":"2010","unstructured":"Claudio Bettini, Oliver Brdiczka, Karen Henricksen, Jadwiga Indulska, Daniela Nicklas, Anand Ranganathan, and Daniele Riboni. 2010. A survey of context modelling and reasoning techniques. Pervasive and mobile computing 6, 2 (2010), 161--180."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3494994"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3580865"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450268.3453522"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-019-0758-4"},{"key":"e_1_2_2_12_1","unstructured":"Business News Daily. 2023. Biggest Workplace Distractions That Kill Productivity - businessnewsdaily.com. https:\/\/www.businessnewsdaily.com\/8098-distractions-kiling-productivity.html."},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.11114\/jets.v7i1.3907"},{"key":"e_1_2_2_14_1","volume-title":"Are physical activities associated with perceived stress? The evidence from the China Health and Nutrition Survey. Frontiers in public health 9","author":"Cao Bing","year":"2021","unstructured":"Bing Cao, Yuxiao Zhao, Zhongyu Ren, Roger S McIntyre, Kayla M Teopiz, Xiao Gao, and Ling Ding. 2021. Are physical activities associated with perceived stress? The evidence from the China Health and Nutrition Survey. Frontiers in public health 9 (2021), 1104."},{"key":"e_1_2_2_15_1","volume-title":"Ontologies for Agents: Theory and Experiences","author":"Chen Harry","unstructured":"Harry Chen, Tim Finin, and Anupam Joshi. 2005. The SOUPA Ontology for Pervasive Computing. In Ontologies for Agents: Theory and Experiences. Birkh\u00e4user Basel, Basel, 233--258."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1108\/17440080911006199"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3422821"},{"key":"e_1_2_2_18_1","unstructured":"Cirillo Consulting GmbH. 2023. The Pomodoro\u00ae Technique | Cirillo Consulting GmbH. https:\/\/pomodorotechnique.com\/."},{"key":"e_1_2_2_19_1","volume-title":"Proceedings of the 37th International Conference on Machine Learning (Proceedings of Machine Learning Research","volume":"2056","author":"Cobbe Karl","year":"2020","unstructured":"Karl Cobbe, Chris Hesse, Jacob Hilton, and John Schulman. 2020. Leveraging Procedural Generation to Benchmark Reinforcement Learning. In Proceedings of the 37th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 119). PMLR, online, 2048--2056. https:\/\/proceedings.mlr.press\/v119\/cobbe20a.html"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmcj.2009.04.001"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2012.328"},{"key":"e_1_2_2_22_1","volume-title":"Bharath","author":"Creswell Antonia","year":"2017","unstructured":"Antonia Creswell, Kai Arulkumaran, and Anil A. Bharath. 2017. On denoising autoencoders trained to minimise binary cross-entropy. arXiv:1708.08487 [cs.CV]"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58520-4_33"},{"key":"e_1_2_2_24_1","volume-title":"Learning Procedural Abstractions and Evaluating Discrete Latent Temporal Structure. In 7th International Conference on Learning Representations, ICLR 2019","author":"Goel Karan","year":"2019","unstructured":"Karan Goel and Emma Brunskill. 2019. Learning Procedural Abstractions and Evaluating Discrete Latent Temporal Structure. In 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019. OpenReview.net, US, 10. https:\/\/openreview.net\/forum?id=ByleB2CcKm"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2008.05.001"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1057\/978-1-137-53551-1_3"},{"key":"e_1_2_2_27_1","doi-asserted-by":"crossref","unstructured":"Barry P Haynes. 2007. Office productivity: a shift from cost reduction to human contribution.","DOI":"10.1108\/02632770710822562"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2493432.2493501"},{"key":"e_1_2_2_29_1","volume-title":"A fast learning algorithm for deep belief nets. Neural computation 18, 7","author":"Hinton Geoffrey E","year":"2006","unstructured":"Geoffrey E Hinton, Simon Osindero, and Yee-Whye Teh. 2006. A fast learning algorithm for deep belief nets. Neural computation 18, 7 (2006), 1527--1554."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2015.2489688"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2904122"},{"key":"e_1_2_2_33_1","volume-title":"Dubes","author":"Jain Anil K.","year":"1988","unstructured":"Anil K. Jain and Richard C. Dubes. 1988. Algorithms for Clustering Data. Prentice-Hall, Inc., USA."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","unstructured":"Rohan Kabra Divya Saxena Dhaval Patel and Jiannong Cao. 2021. Time Series Clustering for Human Behavior Pattern Mining. https:\/\/doi.org\/10.48550\/ARXIV.2110.07549","DOI":"10.48550\/ARXIV.2110.07549"},{"key":"e_1_2_2_35_1","volume-title":"A Heterogeneous Clustering Approach for Human Activity Recognition","author":"Kafle Sabin","unstructured":"Sabin Kafle and Dejing Dou. 2016. A Heterogeneous Clustering Approach for Human Activity Recognition. In Big Data Analytics and Knowledge Discovery, Sanjay Madria and Takahiro Hara (Eds.). Springer International Publishing, Cham, 68--81."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376817"},{"key":"e_1_2_2_37_1","volume-title":"Multi-sensor Activity Context Detection for Wearable Computing","author":"Kern Nicky","unstructured":"Nicky Kern, Bernt Schiele, and Albrecht Schmidt. 2003. Multi-sensor Activity Context Detection for Wearable Computing. In Ambient Intelligence, Emile Aarts, Ren\u00e9 W. Collier, Evert van Loenen, and Boris de Ruyter (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 220--232."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2018.09.003"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.105"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242587.3242609"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.2297321"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2015.09.024"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501902"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1389586.1389621"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2044-8295.1956.tb00559.x"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","unstructured":"Naveen Sai Madiraju Seid M. Sadat Dimitry Fisher and Homa Karimabadi. 2018. Deep Temporal Clustering: Fully Unsupervised Learning of Time-Domain Features. https:\/\/doi.org\/10.48550\/ARXIV.1802.01059","DOI":"10.48550\/ARXIV.1802.01059"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmcj.2015.01.007"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmcj.2017.05.003"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351233"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2757001"},{"key":"e_1_2_2_51_1","volume-title":"Activity recognition in pervasive intelligent environments","author":"Okeyo George","unstructured":"George Okeyo, Liming Chen, Hui Wang, and Roy Sterritt. 2011. Ontology-based learning framework for activity assistance in an adaptive smart home. In Activity recognition in pervasive intelligent environments. Springer, US, 237--263."},{"key":"e_1_2_2_52_1","unstructured":"Adam Paszke et al. 2019. PyTorch: An Imperative Style High-Performance Deep Learning Library. In Advances in Neural Information Processing Systems 32 H. Wallach H. Larochelle A. Beygelzimer F. d'Alch\u00e9-Buc E. Fox and R. Garnett (Eds.). Curran Associates Inc. US 8024--8035. https:\/\/arxiv.org\/abs\/1912.01703"},{"key":"e_1_2_2_53_1","volume-title":"Context aware computing for the internet of things: A survey","author":"Perera Charith","year":"2013","unstructured":"Charith Perera, Arkady Zaslavsky, Peter Christen, and Dimitrios Georgakopoulos. 2013. Context aware computing for the internet of things: A survey. IEEE communications surveys & tutorials 16, 1 (2013), 414--454."},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.comcom.2019.02.002"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2016.2592527"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-010-0331-7"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmcj.2011.02.001"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/PERCOM.2015.7146521"},{"key":"e_1_2_2_59_1","volume-title":"Zaffar Haider Janjua, and Rim Helaoui","author":"Riboni Daniele","year":"2016","unstructured":"Daniele Riboni, Claudio Bettini, Gabriele Civitarese, Zaffar Haider Janjua, and Rim Helaoui. 2016. SmartFABER: Recognizing fine-grained abnormal behaviors for early detection of mild cognitive impairment. Artificial intelligence in medicine 67 (2016), 57--74."},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971648.2971691"},{"key":"e_1_2_2_61_1","unstructured":"S. Harris A. Seaborne. 2023. SPARQL 1.1 query language W3C recommendation. http:\/\/www.w3.org\/TR\/sparql11-query\/."},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.socscimed.2019.112774"},{"key":"e_1_2_2_63_1","unstructured":"Scientific American. 2023. Happiness Is a Walk in the Park - Scientific American. https:\/\/www.scientificamerican.com\/podcast\/episode\/happiness-is-a-walk-in-the-park-10-05-05\/."},{"key":"e_1_2_2_64_1","volume-title":"TAO: Open-source repository for the TAO system. https:\/\/github. com\/synergylabs\/tao.","author":"Boovaraghavan Sudershan","year":"2023","unstructured":"Sudershan Boovaraghavan, Prasoon Patidar, Yuvraj Agarwal. 2023. TAO: Open-source repository for the TAO system. https:\/\/github. com\/synergylabs\/tao."},{"key":"e_1_2_2_65_1","volume-title":"RAPIDS: Collection of Libraries for End to End GPU Data Science. https:\/\/rapids.ai","author":"Development Team RAPIDS","year":"2018","unstructured":"RAPIDS Development Team. 2018. RAPIDS: Collection of Libraries for End to End GPU Data Science. https:\/\/rapids.ai"},{"key":"e_1_2_2_66_1","volume-title":"Toggl: Time Tracking, Project Planning and Hiring Tools to Help Teams Work BetterToggl: Time Tracking, Project Planning and Hiring Tools to Help Teams Work Better. https:\/\/toggl.com\/.","year":"2023","unstructured":"Toggl. 2023. Toggl: Time Tracking, Project Planning and Hiring Tools to Help Teams Work BetterToggl: Time Tracking, Project Planning and Hiring Tools to Help Teams Work Better. https:\/\/toggl.com\/."},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2017.3971131"},{"key":"e_1_2_2_68_1","first-page":"2579","article-title":"Visualizing Data using t-SNE","volume":"9","author":"van der Maaten Laurens","year":"2008","unstructured":"Laurens van der Maaten and Geoffrey Hinton. 2008. Visualizing Data using t-SNE. Journal of Machine Learning Research 9, 86 (2008), 2579--2605. http:\/\/jmlr.org\/papers\/v9\/vandermaaten08a.html","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.2991\/978-94-91216-05-3_8"},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.3390\/s16101617"},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390294"},{"key":"e_1_2_2_72_1","unstructured":"W3C. 2023. SPIN - SPARQL Inferencing Notation. https:\/\/spinrdf.org\/."},{"key":"e_1_2_2_73_1","volume-title":"Alan HS Chan, and SC Ngan","author":"Wong Kapo","year":"2019","unstructured":"Kapo Wong, Alan HS Chan, and SC Ngan. 2019. The effect of long working hours and overtime on occupational health: a meta-analysis of evidence from 1998 to 2018. International journal of environmental research and public health 16, 12 (2019), 2102."},{"key":"e_1_2_2_74_1","volume-title":"Proceedings of the 33rd International Conference on International Conference on Machine Learning -","volume":"48","author":"Xie Junyuan","year":"2016","unstructured":"Junyuan Xie, Ross Girshick, and Ali Farhadi. 2016. Unsupervised Deep Embedding for Clustering Analysis. In Proceedings of the 33rd International Conference on International Conference on Machine Learning - Volume 48 (ICML'16). JMLR.org, New York, NY, USA, 478--487."},{"key":"e_1_2_2_75_1","doi-asserted-by":"publisher","unstructured":"Frank F. Xu Lei Ji Botian Shi Junyi Du Graham Neubig Yonatan Bisk and Nan Duan. 2020. A Benchmark for Structured Procedural Knowledge Extraction from Cooking Videos. https:\/\/doi.org\/10.48550\/ARXIV.2005.00706","DOI":"10.48550\/ARXIV.2005.00706"},{"key":"e_1_2_2_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/2662870"},{"key":"e_1_2_2_77_1","doi-asserted-by":"publisher","DOI":"10.3390\/s19030646"},{"key":"e_1_2_2_78_1","doi-asserted-by":"publisher","DOI":"10.3390\/j2020016"},{"key":"e_1_2_2_79_1","doi-asserted-by":"publisher","DOI":"10.1109\/SMC.2018.00080"},{"key":"e_1_2_2_80_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00672"},{"key":"e_1_2_2_81_1","doi-asserted-by":"publisher","DOI":"10.1145\/2370216.2370241"},{"key":"e_1_2_2_82_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.12342"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610896","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3610896","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3610896","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,28]],"date-time":"2025-07-28T16:30:44Z","timestamp":1753720244000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610896"}},"subtitle":["Context Detection from Daily Activity Patterns Using Temporal Analysis and Ontology"],"short-title":[],"issued":{"date-parts":[[2023,9,27]]},"references-count":82,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,9,27]]}},"alternative-id":["10.1145\/3610896"],"URL":"https:\/\/doi.org\/10.1145\/3610896","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,27]]},"assertion":[{"value":"2023-09-27","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}