{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,30]],"date-time":"2026-01-30T06:34:58Z","timestamp":1769754898750,"version":"3.49.0"},"reference-count":81,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2022,9,6]],"date-time":"2022-09-06T00:00:00Z","timestamp":1662422400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Tsinghua University Guoqiang Research Institute"},{"DOI":"10.13039\/501100001809","name":"the Natural Science Foundation of China","doi-asserted-by":"crossref","award":["U21B2026"],"award-info":[{"award-number":["U21B2026"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2022,9,6]]},"abstract":"<jats:p>Nowadays, recommender systems play an increasingly important role in the music scenario. Generally, music preferences are related to internal and external conditions. For example, mood state and ongoing activity will affect users' music preferences. However, conventional music recommenders cannot capture these conditions since they only utilize the online data but ignore the impact of physical-world information. In this paper, we leverage the contexts from low-cost smart bracelets for ubiquitous personalized recommendation to meet users' music preference. We first conduct a large-scale questionnaire survey, which illustrates moods, activities, and environments will affect music preferences. Then we perform a one-week field study among 30 participants, where they receive personalized music recommendation and record preferences and mood. Meanwhile, participants' context information is collected with bracelets. Analyses on the data demonstrate significant relationships between music preference, mood, and bracelet contexts. Furthermore, we propose a novel Multi-task Ubiquitous Music Recommendation model (MUMR) to predict personalized music preference with bracelet contexts as input and mood prediction as an auxiliary task. Experiments show significant improvement in music recommendation performances with MUMR. Our work demonstrates the possibility of ubiquitous personalized music recommendations with smart bracelets data, which is an encouraging step towards building recommender systems aware of physical-world contexts.<\/jats:p>","DOI":"10.1145\/3550333","type":"journal-article","created":{"date-parts":[[2022,9,7]],"date-time":"2022-09-07T14:54:27Z","timestamp":1662562467000},"page":"1-34","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Towards Ubiquitous Personalized Music Recommendation with Smart Bracelets"],"prefix":"10.1145","volume":"6","author":[{"given":"Jiayu","family":"Li","sequence":"first","affiliation":[{"name":"DCST, Tsinghua University, Haidian Qu, Beijing Shi, China"}]},{"given":"Zhiyu","family":"He","sequence":"additional","affiliation":[{"name":"DCST, Tsinghua University, Haidian Qu, Beijing Shi, China"}]},{"given":"Yumeng","family":"Cui","sequence":"additional","affiliation":[{"name":"DCST, Tsinghua University, Haidian Qu, Beijing Shi, China"}]},{"given":"Chenyang","family":"Wang","sequence":"additional","affiliation":[{"name":"DCST, Tsinghua University, Haidian Qu, Beijing Shi, China"}]},{"given":"Chong","family":"Chen","sequence":"additional","affiliation":[{"name":"DCST, Tsinghua University, Haidian Qu, Beijing Shi, China"}]},{"given":"Chun","family":"Yu","sequence":"additional","affiliation":[{"name":"DCST, Tsinghua University, Haidian Qu, Beijing Shi, China"}]},{"given":"Min","family":"Zhang","sequence":"additional","affiliation":[{"name":"DCST, Tsinghua University, Haidian Qu, Beijing Shi, China"}]},{"given":"Yiqun","family":"Liu","sequence":"additional","affiliation":[{"name":"DCST, Tsinghua University, Haidian Qu, Beijing Shi, China"}]},{"given":"Shaoping","family":"Ma","sequence":"additional","affiliation":[{"name":"DCST, Tsinghua University, Haidian Qu, Beijing Shi, China"}]}],"member":"320","published-online":{"date-parts":[[2022,9,7]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Incorporating contextual information in recommender systems using a multidimensional approach. ACM Transactions on Information systems (TOIS) 23, 1","author":"Adomavicius Gediminas","year":"2005","unstructured":"Gediminas Adomavicius, Ramesh Sankaranarayanan, Shahana Sen, and Alexander Tuzhilin. 2005. Incorporating contextual information in recommender systems using a multidimensional approach. ACM Transactions on Information systems (TOIS) 23, 1 (2005), 103--145."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmcj.2020.101242"},{"key":"e_1_2_1_3_1","volume-title":"Heart rate variability as an index of regulated emotional responding. Review of general psychology 10, 3","author":"Appelhans Bradley M","year":"2006","unstructured":"Bradley M Appelhans and Linda J Luecken. 2006. Heart rate variability as an index of regulated emotional responding. Review of general psychology 10, 3 (2006), 229--240."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-022-12110-z"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3478109"},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the 12th International Conference on Music Information Retrieval (ISMIR 2011)","author":"Bertin-Mahieux Thierry","year":"2011","unstructured":"Thierry Bertin-Mahieux, Daniel P. W. Ellis, Brian Whitman, and Paul Lamere. [n. d.]. The Million Song Dataset. In Proceedings of the 12th International Conference on Music Information Retrieval (ISMIR 2011) (2011)."},{"key":"e_1_2_1_7_1","volume-title":"International Conference on Smart Homes and Health Telematics. Springer, 73--84","author":"Muhammad Bilal Hafiz Syed","year":"2017","unstructured":"Hafiz Syed Muhammad Bilal, Wajahat Ali Khan, and Sungyoung Lee. 2017. Unhealthy dietary behavior based user life-log monitoring for wellness services. In International Conference on Smart Homes and Health Telematics. Springer, 73--84."},{"key":"e_1_2_1_8_1","unstructured":"Ian Brace. 2018. Questionnaire design: How to plan structure and write survey material for effective market research. Kogan Page Publishers."},{"key":"e_1_2_1_9_1","volume-title":"International journal of biosensors & bioelectronics 4, 4","author":"Castaneda Denisse","year":"2018","unstructured":"Denisse Castaneda, Aibhlin Esparza, Mohammad Ghamari, Cinna Soltanpur, and Homer Nazeran. 2018. A review on wearable photoplethysmography sensors and their potential future applications in health care. International journal of biosensors & bioelectronics 4, 4 (2018), 195."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3264908"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-018-5745-7"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12652-015-0335-2"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2988450.2988454"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2846092"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-016-3860-x"},{"key":"e_1_2_1_16_1","volume-title":"Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio.","author":"Cho Kyunghyun","year":"2014","unstructured":"Kyunghyun Cho, Bart Van Merri\u00ebnboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 (2014)."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1749-6632.2001.tb05723.x"},{"key":"e_1_2_1_18_1","volume-title":"Asem Kasem, et al.","author":"Dao Minh Son","year":"2018","unstructured":"Minh Son Dao, Duc Tien Dang Nguyen, Asem Kasem, et al. 2018. HealthyClassroom-a proof-of-concept study for discovering students' daily moods and classroom emotions to enhance a learning-teaching process using heterogeneous sensors. (2018)."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-013-1582-x"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1125451.1125599"},{"key":"e_1_2_1_21_1","volume-title":"Multi-task feature learning. Advances in neural information processing systems 19","author":"Evgeniou An","year":"2007","unstructured":"An Evgeniou and Massimiliano Pontil. 2007. Multi-task feature learning. Advances in neural information processing systems 19 (2007), 41."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313488"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1080\/15213269.2012.693812"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-011-0389-x"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3090076"},{"key":"e_1_2_1_26_1","unstructured":"Huifeng Guo Ruiming Tang Yunming Ye Zhenguo Li and Xiuqiang He. 2017. DeepFM: a factorization-machine based neural network for CTR prediction. arXiv preprint arXiv:1703.04247 (2017)."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3383313.3412248"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401063"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-12654-3_10"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2837126.2837128"},{"key":"e_1_2_1_31_1","volume-title":"A simple sequentially rejective multiple test procedure. Scandinavian journal of statistics","author":"Holm Sture","year":"1979","unstructured":"Sture Holm. 1979. A simple sequentially rejective multiple test procedure. Scandinavian journal of statistics (1979), 65--70."},{"key":"e_1_2_1_32_1","volume-title":"NIPS Workshop on Machine Learning for Healthcare.","author":"Jaques Natasha","year":"2016","unstructured":"Natasha Jaques, Sara Taylor, Ehimwenma Nosakhare, Akane Sano, and Rosalind Picard. 2016. Multi-task learning for predicting health, stress, and happiness. In NIPS Workshop on Machine Learning for Healthcare."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2018.09.001"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2634317.2634327"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCE.2019.2924177"},{"key":"e_1_2_1_36_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_2_1_37_1","volume-title":"Ananda Theertha Suresh, and Dave Bacon","author":"Kone\u010dny Jakub","year":"2016","unstructured":"Jakub Kone\u010dny, H Brendan McMahan, Felix X Yu, Peter Richt\u00e1rik, Ananda Theertha Suresh, and Dave Bacon. 2016. Federated learning: Strategies for improving communication efficiency. arXiv preprint arXiv:1610.05492 (2016)."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1037\/aca0000104"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1352793.1352837"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC44109.2020.9175221"},{"key":"e_1_2_1_41_1","volume-title":"Know Yourself: Physical and Psychological Self-Awareness With Lifelog. Frontiers in Digital Health","author":"Li Jiayu","year":"2021","unstructured":"Jiayu Li, Weizhi Ma, Min Zhang, Pengyu Wang, Yiqun Liu, and Shaoping Ma. 2021. Know Yourself: Physical and Psychological Self-Awareness With Lifelog. Frontiers in Digital Health (2021), 96."},{"key":"e_1_2_1_42_1","volume-title":"LifeRec: A Mobile App for Lifelog Recording and Ubiquitous Recommendation. In ACM SIGIR Conference on Human Information Interaction and Retrieval. 342--346","author":"Li Jiayu","year":"2022","unstructured":"Jiayu Li, Hantian Zhang, Zhiyu He, Rongwu Xu, Pingfei Wu, Min Zhang, Yiqun Liu, and Shaoping Ma. 2022. LifeRec: A Mobile App for Lifelog Recording and Ubiquitous Recommendation. In ACM SIGIR Conference on Human Information Interaction and Retrieval. 342--346."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.4108\/icst.pervasivehealth.2011.246030"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCTD.2009.246"},{"key":"e_1_2_1_45_1","unstructured":"Hongyu Lu Weizhi Ma Min Zhang Maarten de Rijke Yiqun Liu and Shaoping Ma. 2021. Standing in Your Shoes: External Assessments for Personalized Recommender Systems. (2021)."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403278"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2003.1236478"},{"key":"e_1_2_1_48_1","volume-title":"Workshop on Music Recommendation and Discovery. Association for Computing Machinery New York, 1--6.","author":"Mesnage C\u00e9dric S","year":"2011","unstructured":"C\u00e9dric S Mesnage, Asma Rafiq, Simon Dixon, and Romain P Brixtel. 2011. Music discovery with social networks. In Workshop on Music Recommendation and Discovery. Association for Computing Machinery New York, 1--6."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00607-013-0351-z"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351233"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2020.3026000"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3177849"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2426656.2426662"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIC.2020.3017867"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/1377999.1378024"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3240323.3240397"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3191764"},{"key":"e_1_2_1_58_1","volume-title":"Listener Modeling and Context-Aware Music Recommendation Based on Country Archetypes. Frontiers in Artificial Intelligence 3","author":"Schedl Markus","year":"2020","unstructured":"Markus Schedl, Christine Bauer, Wolfgang Reisinger, Dominik Kowald, and Elisabeth Lex. 2020. Listener Modeling and Context-Aware Music Recommendation Based on Country Archetypes. Frontiers in Artificial Intelligence 3 (2020)."},{"key":"e_1_2_1_59_1","volume-title":"Recommender Systems Handbook","author":"Schedl Markus","unstructured":"Markus Schedl, Peter Knees, Brian McFee, and Dmitry Bogdanov. 2022. Music recommendation systems: Techniques, use cases, and challenges. In Recommender Systems Handbook. Springer, 927--971."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i01.5352"},{"key":"e_1_2_1_61_1","unstructured":"Yading Song. 2016. The Role of Emotion and Context in Musical Preference. Ph.D. Dissertation. Queen Mary University of London."},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3240323.3240361"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-007-0192-x"},{"key":"e_1_2_1_64_1","volume-title":"The biopsychology of mood and arousal","author":"Thayer Robert E","unstructured":"Robert E Thayer. 1990. The biopsychology of mood and arousal. Oxford University Press."},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2019.08.004"},{"key":"e_1_2_1_66_1","volume-title":"Neural Information Processing Systems Conference (NIPS","volume":"26","author":"Den Oord A\u00e4ron Van","year":"2013","unstructured":"A\u00e4ron Van Den Oord, Sander Dieleman, and Benjamin Schrauwen. 2013. Deep content-based music recommendation. In Neural Information Processing Systems Conference (NIPS 2013), Vol. 26. Neural Information Processing Systems Foundation (NIPS)."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/PERCOM.2009.4912751"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401131"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2019.11.028"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330989"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/2393347.2393368"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","unstructured":"Felix Weninger Florian Eyben Bj\u00f6rn W. Schuller Marcello Mortillaro and Klaus R. Scherer. [n. d.]. On the Acoustics of Emotion in Audio: What Speech Music and Sound have in Common. 0 ([n. d.]). https:\/\/doi.org\/10.3389\/fpsyg.2013.00292 Publisher: Frontiers.","DOI":"10.3389\/fpsyg.2013.00292"},{"key":"e_1_2_1_73_1","first-page":"1","article-title":"Leveraging Collaborative-Filtering for Personalized Behavior Modeling: A Case Study of Depression Detection among College Students","volume":"5","author":"Xu Xuhai","year":"2021","unstructured":"Xuhai Xu, Prerna Chikersal, Janine M Dutcher, Yasaman S Sefidgar, Woosuk Seo, Michael J Tumminia, Daniella K Villalba, Sheldon Cohen, Kasey G Creswell, J David Creswell, et al. 2021. Leveraging Collaborative-Filtering for Personalized Behavior Modeling: A Case Study of Depression Detection among College Students. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 1 (2021), 1--27.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2877137"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1037\/emo0000573"},{"key":"e_1_2_1_76_1","first-page":"296","article-title":"Hybrid Collaborative and Content-based Music Recommendation Using Probabilistic Model with Latent User Preferences","volume":"6","author":"Yoshii Kazuyoshi","year":"2006","unstructured":"Kazuyoshi Yoshii, Masataka Goto, Kazunori Komatani, Tetsuya Ogata, and Hiroshi G Okuno. 2006. Hybrid Collaborative and Content-based Music Recommendation Using Probabilistic Model with Latent User Preferences.. In ISMIR, Vol. 6. 296--301.","journal-title":"ISMIR"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209219.3209258"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3412119"},{"key":"e_1_2_1_79_1","volume-title":"Location-aware deep collaborative filtering for service recommendation","author":"Zhang Yiwen","year":"2019","unstructured":"Yiwen Zhang, Chunhui Yin, Qilin Wu, Qiang He, and Haibin Zhu. 2019. Location-aware deep collaborative filtering for service recommendation. IEEE Transactions on Systems, Man, and Cybernetics: Systems (2019)."},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219823"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2015.2491927"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3550333","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3550333","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T04:40:30Z","timestamp":1752468030000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3550333"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,6]]},"references-count":81,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,9,6]]}},"alternative-id":["10.1145\/3550333"],"URL":"https:\/\/doi.org\/10.1145\/3550333","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,6]]},"assertion":[{"value":"2022-09-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}