{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T10:27:43Z","timestamp":1769509663424,"version":"3.49.0"},"reference-count":43,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2024,1,30]],"date-time":"2024-01-30T00:00:00Z","timestamp":1706572800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Recovery and Resilience Plan (NRRP)","award":["ECS0000038"],"award-info":[{"award-number":["ECS0000038"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>As several studies demonstrate, good sleep quality is essential for individuals\u2019 well-being, as a lack of restoring sleep may disrupt different physical, mental, and social dimensions of health. For this reason, there is increasing interest in tools for the monitoring of sleep based on personal sensors. However, there are currently few context-aware methods to help individuals to improve their sleep quality through behavior change tips. In order to tackle this challenge, in this paper, we propose a system that couples machine learning algorithms and large language models to forecast the next night\u2019s sleep quality, and to provide context-aware behavior change tips to improve sleep. In order to encourage adherence and to increase trust, our system includes the use of large language models to describe the conditions that the machine learning algorithm finds harmful to sleep health, and to explain why the behavior change tips are generated as a consequence. We develop a prototype of our system, including a smartphone application, and perform experiments with a set of users. Results show that our system\u2019s forecast is correlated to the actual sleep quality. Moreover, a preliminary user study suggests that the use of large language models in our system is useful in increasing trust and engagement.<\/jats:p>","DOI":"10.3390\/fi16020046","type":"journal-article","created":{"date-parts":[[2024,1,30]],"date-time":"2024-01-30T05:14:32Z","timestamp":1706591672000},"page":"46","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Context-Aware Behavioral Tips to Improve Sleep Quality via Machine Learning and Large Language Models"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-0836-8113","authenticated-orcid":false,"given":"Erica","family":"Corda","sequence":"first","affiliation":[{"name":"Department of Mathematics and Computer Science, University of Cagliari, Via Ospedale 72, 09124 Cagliari, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3285-8971","authenticated-orcid":false,"given":"Silvia M.","family":"Massa","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Computer Science, University of Cagliari, Via Ospedale 72, 09124 Cagliari, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0695-2040","authenticated-orcid":false,"given":"Daniele","family":"Riboni","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Computer Science, University of Cagliari, Via Ospedale 72, 09124 Cagliari, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2024,1,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"S3","DOI":"10.1016\/j.sleep.2009.07.005","article-title":"Sleep and society: An epidemiological perspective","volume":"10","author":"Bixler","year":"2009","journal-title":"Sleep Med."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"727","DOI":"10.5665\/sleep.1846","article-title":"Sleep: A health imperative","volume":"35","author":"Luyster","year":"2012","journal-title":"Sleep"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jsmc.2016.10.012","article-title":"Sleep, health, and society","volume":"12","author":"Grandner","year":"2017","journal-title":"Sleep Med. Clin."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"46","DOI":"10.3389\/fnsys.2014.00046","article-title":"Sleep for cognitive enhancement","volume":"8","author":"Diekelmann","year":"2014","journal-title":"Front. Syst. Neurosci."},{"key":"ref_5","first-page":"229","article-title":"Sleep disorders and mood, anxiety, and post-traumatic stress disorders: Overview of clinical treatments in the context of sleep disturbances","volume":"56","author":"Nicholson","year":"2021","journal-title":"Nurs. Clin."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1007\/s00424-011-1044-0","article-title":"Sleep and immune function","volume":"463","author":"Besedovsky","year":"2012","journal-title":"Pfl\u00fcgers-Arch.-Eur. J. Physiol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"591729","DOI":"10.1155\/2015\/591729","article-title":"The impact of sleep and circadian disturbance on hormones and metabolism","volume":"2015","author":"Kim","year":"2015","journal-title":"Int. J. Endocrinol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1016\/j.sleep.2020.07.048","article-title":"Sleep deprivation and its association with diseases-a review","volume":"77","author":"Liew","year":"2021","journal-title":"Sleep Med."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"912","DOI":"10.1007\/s12160-015-9711-6","article-title":"Social relationships and sleep quality","volume":"49","author":"Kent","year":"2015","journal-title":"Ann. Behav. Med."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"101428","DOI":"10.1016\/j.smrv.2021.101428","article-title":"Sleep and social relationships in healthy populations: A systematic review","volume":"57","author":"Gordon","year":"2021","journal-title":"Sleep Med. Rev."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Pan, Q., Brulin, D., and Campo, E. (2020). Current status and future challenges of sleep monitoring systems: Systematic review. JMIR Biomed. Eng., 5.","DOI":"10.2196\/preprints.20921"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"19","DOI":"10.2147\/NSS.S18891","article-title":"Impact of lifestyle and technology developments on sleep","volume":"4","author":"Shochat","year":"2012","journal-title":"Nat. Sci. Sleep"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2930","DOI":"10.1016\/j.procs.2022.09.351","article-title":"Explainable machine learning for sleep apnea prediction","volume":"207","author":"Troncoso","year":"2022","journal-title":"Procedia Comput. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.sleep.2023.12.013","article-title":"Sleep, physical activity and panic attacks: A two-year prospective cohort study using smartwatches, deep learning and an explainable artificial intelligence model","volume":"114","author":"Tsai","year":"2023","journal-title":"Sleep Med."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Jany, R., Ashmafee, M.H., Hussain, I., and Hossain, M.A. (2022, January 17\u201319). SleepExplain: Explainable Non-Rapid Eye Movement and Rapid Eye Movement Sleep Stage Classification from EEG Signal. Proceedings of the 2022 25th International Conference on Computer and Information Technology (ICCIT), Cox\u2019s Bazar, Bangladesh.","DOI":"10.1109\/ICCIT57492.2022.10055956"},{"key":"ref_16","unstructured":"Mira, F.A., Favier, V., dos Santos Sobreira Nunes, H., de Castro, J.V., Carsuzaa, F., Meccariello, G., Vicini, C., De Vito, A., Lechien, J.R., and Estomba, C.C. (2023). European Archives of Oto-Rhino-Laryngology, Springer."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"807","DOI":"10.1016\/j.gie.2020.06.040","article-title":"History of artificial intelligence in medicine","volume":"92","author":"Kaul","year":"2020","journal-title":"Gastrointest. Endosc."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3603495","article-title":"Sensor-based Locomotion Data Mining for Supporting the Diagnosis of Neurodegenerative Disorders: A Survey","volume":"56","author":"Zolfaghari","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1549","DOI":"10.1007\/s12559-020-09816-3","article-title":"TraMiner: Vision-based analysis of locomotion traces for cognitive assessment in smart-homes","volume":"14","author":"Zolfaghari","year":"2022","journal-title":"Cogn. Comput."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12911-021-01488-9","article-title":"The role of artificial intelligence in healthcare: A structured literature review","volume":"21","author":"Secinaro","year":"2021","journal-title":"BMC Med. Inform. Decis. Mak."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3398069","article-title":"Machine learning in mental health: A systematic review of the HCI literature to support the development of effective and implementable ML systems","volume":"27","author":"Thieme","year":"2020","journal-title":"ACM Trans. Comput. Hum. Interact. (TOCHI)"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"101556","DOI":"10.1016\/j.smrv.2021.101556","article-title":"Improving sleep quality leads to better mental health: A meta-analysis of randomised controlled trials","volume":"60","author":"Scott","year":"2021","journal-title":"Sleep Med. Rev."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"24527","DOI":"10.1109\/ACCESS.2019.2900345","article-title":"A review of approaches for sleep quality analysis","volume":"7","author":"Mostafa","year":"2019","journal-title":"IEEE Access"},{"key":"ref_24","first-page":"e6562","article-title":"Sleep quality prediction from wearable data using deep learning","volume":"4","author":"Sathyanarayana","year":"2016","journal-title":"JMIR mHealth uHealth"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"10793","DOI":"10.1007\/s13369-020-04877-w","article-title":"Analysis of data from wearable sensors for sleep quality estimation and prediction using deep learning","volume":"45","author":"Arora","year":"2020","journal-title":"Arab. J. Sci. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1016\/j.compbiomed.2019.05.010","article-title":"Sleep quality prediction in caregivers using physiological signals","volume":"110","author":"Sadeghi","year":"2019","journal-title":"Comput. Biol. Med."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3392049","article-title":"Isleep: A smartphone system for unobtrusive sleep quality monitoring","volume":"16","author":"Chang","year":"2020","journal-title":"ACM Trans. Sens. Netw. (TOSN)"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"e44123","DOI":"10.2196\/44123","article-title":"The feasibility of using smartphone sensors to track insomnia, depression, and anxiety in adults and young adults: Narrative review","volume":"11","author":"Alamoudi","year":"2023","journal-title":"JMIR mHealth uHealth"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"81","DOI":"10.54097\/fcis.v2i2.4465","article-title":"The benefits and challenges of ChatGPT: An overview","volume":"2","author":"Deng","year":"2022","journal-title":"Front. Comput. Intell. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Susnjak, T. (2023). Beyond Predictive Learning Analytics Modelling and onto Explainable Artificial Intelligence with Prescriptive Analytics and ChatGPT. Int. J. Artif. Intell. Educ., 1\u201331.","DOI":"10.1007\/s40593-023-00336-3"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Bachechi, C., Rollo, F., and Po, L. (2020, January 2\u20135). Real-time data cleaning in traffic sensor networks. Proceedings of the 2020 IEEE\/ACS 17th International Conference on Computer Systems and Applications (AICCSA), Antalya, Turkey.","DOI":"10.1109\/AICCSA50499.2020.9316534"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Wang, R., Chen, F., Chen, Z., Li, T., Harari, G., Tignor, S., Zhou, X., Ben-Zeev, D., and Campbell, A.T. (2014, January 13\u201317). StudentLife: Assessing mental health, academic performance and behavioral trends of college students using smartphones. Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Seattle, WA, USA.","DOI":"10.1145\/2632048.2632054"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1016\/j.future.2020.10.030","article-title":"HealthXAI: Collaborative and explainable AI for supporting early diagnosis of cognitive decline","volume":"116","author":"Khodabandehloo","year":"2021","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_34","first-page":"59","article-title":"Thirteen ways to look at the correlation coefficient","volume":"42","author":"Nicewander","year":"1988","journal-title":"Am. Stat."},{"key":"ref_35","unstructured":"Conitzer, V., Hadfield, G.K., and Vallor, S. (2019, January 27\u201328). Toward Design and Evaluation Framework for Interpretable Machine Learning Systems. Proceedings of the 2019 AAAI\/ACM Conference on AI, Ethics, and Society, Honolulu, HI, USA."},{"key":"ref_36","first-page":"396","article-title":"Likert scale: Explored and explained","volume":"7","author":"Joshi","year":"2015","journal-title":"Curr. J. Appl. Sci. Technol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1016\/j.pmcj.2011.01.004","article-title":"Situation identification techniques in pervasive computing: A review","volume":"8","author":"Ye","year":"2012","journal-title":"Pervasive Mob. Comput."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Boussard, J., Kochenderfer, M.J., and Zeitzer, J.M. (2019, January 7). Predicting Subjective Sleep Quality Using Recurrent Neural Networks. Proceedings of the 2019 IEEE Signal Processing in Medicine and Biology Symposium (SPMB), Philadelphia, PA, USA.","DOI":"10.1109\/SPMB47826.2019.9037854"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1763","DOI":"10.1213\/ANE.0000000000002864","article-title":"Correlation coefficients: Appropriate use and interpretation","volume":"126","author":"Schober","year":"2018","journal-title":"Anesth. Analg."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Park, S., Li, C.T., Han, S., Hsu, C., Lee, S.W., and Cha, M. (2019, January 4\u20138). Learning sleep quality from daily logs. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Anchorage, AK, USA.","DOI":"10.1145\/3292500.3330792"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1007\/s42979-021-00815-1","article-title":"Deep learning: A comprehensive overview on techniques, taxonomy, applications and research directions","volume":"2","author":"Sarker","year":"2021","journal-title":"SN Comput. Sci."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.inffus.2019.12.012","article-title":"Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI","volume":"58","author":"Arrieta","year":"2020","journal-title":"Inf. Fusion"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/16\/2\/46\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T13:51:40Z","timestamp":1760104300000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/16\/2\/46"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,30]]},"references-count":43,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2024,2]]}},"alternative-id":["fi16020046"],"URL":"https:\/\/doi.org\/10.3390\/fi16020046","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,30]]}}}