{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,14]],"date-time":"2026-04-14T16:00:21Z","timestamp":1776182421222,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":31,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,10,8]],"date-time":"2023-10-08T00:00:00Z","timestamp":1696723200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,10,8]]},"DOI":"10.1145\/3594739.3610745","type":"proceedings-article","created":{"date-parts":[[2023,10,7]],"date-time":"2023-10-07T22:49:38Z","timestamp":1696718978000},"page":"499-504","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Towards LLMs for Sensor Data: Multi-Task Self-Supervised Learning"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1286-5496","authenticated-orcid":false,"given":"Tsuyoshi","family":"Okita","sequence":"first","affiliation":[{"name":"Kyushu Institute of Technology, Japan"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-3325-1363","authenticated-orcid":false,"given":"Kosuke","family":"Ukita","sequence":"additional","affiliation":[{"name":"Kyushu Institute of Technology, Japan"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-0726-554X","authenticated-orcid":false,"given":"Koki","family":"Matsuishi","sequence":"additional","affiliation":[{"name":"Kyushu Institute of Technology, Japan"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-2426-1188","authenticated-orcid":false,"given":"Masaharu","family":"Kagiyama","sequence":"additional","affiliation":[{"name":"Kyushu Institute of Technology, Japan"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-5323-448X","authenticated-orcid":false,"given":"Kodai","family":"Hirata","sequence":"additional","affiliation":[{"name":"Kyushu Institute of Technology, Japan"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-3233-5080","authenticated-orcid":false,"given":"Asahi","family":"Miyazaki","sequence":"additional","affiliation":[{"name":"Kyushu Institute of Technology, Japan"}]}],"member":"320","published-online":{"date-parts":[[2023,10,8]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"NeurIPS","author":"Bachman Philip","year":"2019","unstructured":"[1] Philip Bachman, R. Devon Hjelm, and William Buchwalter, Learning representations by maximizing mutual information across views, NeurIPS, 2019."},{"key":"e_1_3_2_1_2_1","volume-title":"On the Opportunities and Risks of Foundation Models arXiv, 2108.07258","author":"Bommasani Rishi","year":"2022","unstructured":"[2] Rishi Bommasani, et.al., On the Opportunities and Risks of Foundation Models arXiv, 2108.07258, 2022."},{"key":"e_1_3_2_1_3_1","first-page":"1607","volume-title":"2013 IEEE International Conference on Robotics and Automation","author":"Bruno Barbara","unstructured":"[3] Barbara Bruno, Fulvio Mastrogiovanni, Antonio Sgorbissa, Tullio Vernazza, and Renato Zaccaria, Analysis of human behavior recognition algorithms based on acceleration data. In 2013 IEEE International Conference on Robotics and Automation, pages 1602\u20131607. IEEE, 2013"},{"key":"e_1_3_2_1_4_1","volume-title":"Emerging Properties in Self-Supervised Vision Transformers, arXiv, 2104.14294","author":"Caron Mathilde","year":"2021","unstructured":"[4] Mathilde Caron, Hugo Touvron, Ishan Misra, Herv\u00e9 J\u00e9gou, Julien Mairal, Piotr Bojanowski, Armand Joulin, Emerging Properties in Self-Supervised Vision Transformers, arXiv, 2104.14294, 2021."},{"key":"e_1_3_2_1_5_1","volume-title":"ArXiv, 1810","author":"Devlin Jacob","year":"2018","unstructured":"[5] Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding, ArXiv, 1810.04805, 2018"},{"key":"e_1_3_2_1_6_1","volume-title":"SigRep: Towards Robust Wearable Emotion Recognition with Contrastive Representation Learning","author":"Dissanayake Vipula","year":"2023","unstructured":"[6] Vipula Dissanayake, Sachith Seneviratne, Rajib Rana, Elliott Wen, Tharindu Kaluarachchi, Suranga Nanayakkara, SigRep: Towards Robust Wearable Emotion Recognition with Contrastive Representation Learning, IEEE Access, Volume 10, 2023."},{"key":"e_1_3_2_1_7_1","volume-title":"proceedings of 2015 IEEE International Conference on Computer Vision (ICCV). IEEE: 1422\u20131430","author":"Doersch Carl","year":"2015","unstructured":"[7] Carl Doersch, Abhinav Gupta, Alexei A. Efros, Unsupervised Visual Representation Learning by Context Prediction, In proceedings of 2015 IEEE International Conference on Computer Vision (ICCV). IEEE: 1422\u20131430. 2015."},{"key":"e_1_3_2_1_8_1","volume-title":"Proceedings of 2017 IEEE International Conference on Computer Vision (ICCV). IEEE: 2070\u20132079","author":"Doersch Carl","year":"2017","unstructured":"[8] Carl Doersch, and Andrew Zisserman, Multi-task Self-Supervised Visual Learning, In Proceedings of 2017 IEEE International Conference on Computer Vision (ICCV). IEEE: 2070\u20132079. arXiv:1708.07860, 2017."},{"key":"e_1_3_2_1_9_1","volume-title":"An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale, arXiv","author":"Dosovitskiy Alexey","year":"2010","unstructured":"[9] Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, Neil Houlsby, An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale, arXiv, 2010.11929, 2020."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1177\/0081175019884591"},{"key":"e_1_3_2_1_11_1","volume-title":"Zhaohan Daniel Guo, Mohammad Gheshlaghi Azar, Bilal Piot, Koray Kavukcuoglu, R\u00e9mi Munos, Michal Valko, Bootstrap your own latent: A new approach to self-supervised Learning, arXiv","author":"Grill Jean-Bastien","year":"2006","unstructured":"[11] Jean-Bastien Grill, Florian Strub, Florent Altch\u00e9, Corentin Tallec, Pierre H. Richemond, Elena Buchatskaya, Carl Doersch, Bernardo Avila Pires, Zhaohan Daniel Guo, Mohammad Gheshlaghi Azar, Bilal Piot, Koray Kavukcuoglu, R\u00e9mi Munos, Michal Valko, Bootstrap your own latent: A new approach to self-supervised Learning, arXiv, 2006.07733, 2020."},{"key":"e_1_3_2_1_12_1","volume-title":"Masked Autoencoders Are Scalable Vision Learners, arXiv, 2111.06377","author":"He Kaiming","year":"2021","unstructured":"[12] Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Doll\u00e1r, Ross Girshick, Masked Autoencoders Are Scalable Vision Learners, arXiv, 2111.06377, 2021."},{"key":"e_1_3_2_1_13_1","volume-title":"ICPR","author":"Iwana Brian Kenji","year":"2020","unstructured":"[13] Brian Kenji Iwana, Seiichi Uchida, Time Series Data Augmentation for Neural Networks by Time Warping with a Discriminative Teacher, ICPR 2020."},{"key":"e_1_3_2_1_14_1","volume-title":"On the Variance of the Adaptive Learning Rate and Beyond, arXiv","author":"Liu Liyuan","year":"1908","unstructured":"[14] Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han, On the Variance of the Adaptive Learning Rate and Beyond, arXiv, 1908.03265, 2019."},{"key":"e_1_3_2_1_15_1","volume-title":"Towards Robust Vision Transformer, arXiv, 2105.07926","author":"Mao Xiaofeng","year":"2021","unstructured":"[15] Xiaofeng Mao, Gege Qi, Yuefeng Chen, Xiaodan Li, Ranjie Duan, Shaokai Ye, Yuan He, Hui Xue, Towards Robust Vision Transformer, arXiv, 2105.07926, 2021."},{"key":"e_1_3_2_1_16_1","volume-title":"A Holistic Approach to Undesired Content Detection in the Real World, arXiv, 2208.03274","author":"Markov Todor","year":"2023","unstructured":"[16] Todor Markov, Chong Zhang, Sandhini Agarwal, Tyna Eloundou, Teddy Lee, Steven Adler, Angela Jiang, Lilian Weng, A Holistic Approach to Undesired Content Detection in the Real World, arXiv, 2208.03274, 2023."},{"key":"e_1_3_2_1_17_1","volume-title":"Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles arXiv, 1603.09246","author":"Noroozi Mehdi","year":"2016","unstructured":"[17] Mehdi Noroozi, Paolo Favaro, Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles arXiv, 1603.09246, 2016."},{"key":"e_1_3_2_1_18_1","volume-title":"Transformers for 1D signals in Parkinson\u2019s disease detection from gait, arXiv, 2204.00423","author":"Dimitri Nguyen Duc Minh","year":"2022","unstructured":"[18] Duc Minh Dimitri Nguyen, Mehdi Miah, Guillaume-Alexandre Bilodeau Wassim Bouachir, Transformers for 1D signals in Parkinson\u2019s disease detection from gait, arXiv, 2204.00423, 2022."},{"key":"e_1_3_2_1_19_1","volume-title":"Representation Learning with Contrastive Predictive Coding, arXiv","author":"van den Oord Aaron","year":"1807","unstructured":"[19] Aaron van den Oord, Yazhe Li, and Oriol Vinyals. Representation Learning with Contrastive Predictive Coding, arXiv 1807.03748, 2018."},{"key":"e_1_3_2_1_21_1","first-page":"109","volume-title":"Proceedings of 2012 16th International Symposium on Wearable Computers","author":"Reiss Attila","unstructured":"[21] Attila Reiss and Didier Stricker, Introducing a new benchmarked dataset for activity monitoring. In Proceedings of 2012 16th International Symposium on Wearable Computers, pages 108\u2013109. IEEE. 2012."},{"key":"e_1_3_2_1_22_1","unstructured":"[22] Daniel Roggen Alberto Calatroni Mirco Rossi Thomas Holleczek Kilian Forster Gerhard Troster Paul Lukowicz David Bannach Gerald Pirkl Florian Wagner Alois Ferscha Jakob Doppler Clemens Holzmann+ Marc Kurz+ Gerald Holl Walk-through the OPPORTUNITY dataset for activity recognition in sensor rich environments 2010."},{"key":"e_1_3_2_1_23_1","volume-title":"Brown Encoding Cardiopulmonary Exercise Testing Time Series as Images for Classification using Convolutional Neural Network, arXiv, 2204.12432","author":"Sharma Yash","year":"2022","unstructured":"[23] Yash Sharma, Nick Coronato, Donald E. Brown Encoding Cardiopulmonary Exercise Testing Time Series as Images for Classification using Convolutional Neural Network, arXiv, 2204.12432, 2022."},{"key":"e_1_3_2_1_24_1","first-page":"9","volume-title":"2016 IEEE International Conference on Pervasive Computing and Communications (PerCom)","author":"Sztyler Timo","unstructured":"[24] Timo Sztyler, and Heiner Stuckenschmidt, On-body localization of wearable devices: An investigation of position-aware activity recognition. In 2016 IEEE International Conference on Pervasive Computing and Communications (PerCom), pages 1\u20139. IEEE. 2016."},{"key":"e_1_3_2_1_25_1","volume-title":"Contrastive multiview coding, arXiv","author":"Tian Yonglong","year":"1906","unstructured":"[25] Yonglong Tian, Dilip Krishnan, and Phillip Isola, Contrastive multiview coding, arXiv 1906.05849, 2019."},{"key":"e_1_3_2_1_26_1","volume-title":"Training data-ef\ufb01cient image transformers and distillation through attention, arXiv","author":"Touvron Hugo","year":"2012","unstructured":"[26] Hugo Touvron, Matthieu Cord, Matthijs Douze, Francisco Massa, Alexandre Sablayrolles, Herve Jegou, Training data-ef\ufb01cient image transformers and distillation through attention, arXiv, 2012.12877v2, 2021."},{"key":"e_1_3_2_1_27_1","volume-title":"Attention Is All You Need, arXiv, 1706.03762","author":"Vaswani Ashish","year":"2017","unstructured":"[27] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin, Attention Is All You Need, arXiv, 1706.03762, 2017"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2940729"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-018-26174-1"},{"key":"e_1_3_2_1_30_1","volume-title":"Self-supervised Learning for Human Activity Recognition Using 700,000 Person-days of Wearable Data, arXiv, 2206.02909","author":"Yuan Hang","year":"2022","unstructured":"[30] Hang Yuan, Shing Chan, Andrew P. Creagh, Catherine Tong, David A. Clifton, and Aiden Doherty, Self-supervised Learning for Human Activity Recognition Using 700,000 Person-days of Wearable Data, arXiv, 2206.02909, 2022."},{"key":"e_1_3_2_1_31_1","volume-title":"Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD \u201921)","author":"Zerveas George","year":"2021","unstructured":"[31] George Zerveas, Srideepika Jayaraman, Dhaval Patel, Anuradha Bhamidipaty, and Carsten Eickhoff, A Transformer-based Framework for Multivariate Time Series Representation Learning, in Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD \u201921), 2021."},{"key":"e_1_3_2_1_32_1","volume-title":"BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs, arXiv, 2307.08581","author":"Zhao Yang","year":"2023","unstructured":"[32] Yang Zhao, Zhijie Lin, Daquan Zhou, Zilong Huang, Jiashi Feng, Bingyi Kang, BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs, arXiv, 2307.08581, 2023."}],"event":{"name":"UbiComp\/ISWC '23: The 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing","location":"Cancun, Quintana Roo Mexico","acronym":"UbiComp\/ISWC '23","sponsor":["SIGMOBILE ACM Special Interest Group on Mobility of Systems, Users, Data and Computing","SIGCHI ACM Special Interest Group on Computer-Human Interaction","SIGSPATIAL ACM Special Interest Group on Spatial Information"]},"container-title":["Adjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing & the 2023 ACM International Symposium on Wearable Computing"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3594739.3610745","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3594739.3610745","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:37:03Z","timestamp":1750178223000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3594739.3610745"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,8]]},"references-count":31,"alternative-id":["10.1145\/3594739.3610745","10.1145\/3594739"],"URL":"https:\/\/doi.org\/10.1145\/3594739.3610745","relation":{},"subject":[],"published":{"date-parts":[[2023,10,8]]},"assertion":[{"value":"2023-10-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}