{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T04:00:51Z","timestamp":1780632051564,"version":"3.54.1"},"reference-count":19,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2019,9,25]],"date-time":"2019-09-25T00:00:00Z","timestamp":1569369600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Commercial sleep devices and mobile-phone applications for scoring sleep are gaining ground. In order to provide reliable information about the quantity and\/or quality of sleep, their performance needs to be assessed against the current gold standard, i.e., polysomnography (PSG; measuring brain, eye, and muscle activity). Here, we assessed some commercially available sleep trackers, namely an activity tracker; Mi band (Xiaomi, Beijing, China), a scientific actigraph: Motionwatch 8 (CamNTech, Cambridge, UK), and a much-used mobile phone application: Sleep Cycle (Northcube, Gothenburg, Sweden). We recorded 27 nights in healthy sleepers using PSG and these devices and compared the results. Surprisingly, all devices had poor agreement with the PSG gold standard. Sleep parameter comparisons revealed that, specifically, the Mi band and the Sleep Cycle application had difficulties in detecting wake periods which negatively affected their total sleep time and sleep-efficiency estimations. However, all 3 devices were good in detecting the most basic parameter, the actual time in bed. In summary, our results suggest that, to date, the available sleep trackers do not provide meaningful sleep analysis but may be interesting for simply tracking time in bed. A much closer interaction with the scientific field seems necessary if reliable information shall be derived from such devices in the future.<\/jats:p>","DOI":"10.3390\/s19194160","type":"journal-article","created":{"date-parts":[[2019,9,26]],"date-time":"2019-09-26T03:06:51Z","timestamp":1569467211000},"page":"4160","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":43,"title":["About the Accuracy and Problems of Consumer Devices in the Assessment of Sleep"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4147-490X","authenticated-orcid":false,"given":"Mohamed S.","family":"Ameen","sequence":"first","affiliation":[{"name":"Laboratory for Sleep, Cognition and Consciousness Research, Department of Psychology, University of Salzburg, Hellbrunner Strasse 34, 5020 Salzburg, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lok Man","family":"Cheung","sequence":"additional","affiliation":[{"name":"Laboratory for Sleep, Cognition and Consciousness Research, Department of Psychology, University of Salzburg, Hellbrunner Strasse 34, 5020 Salzburg, Austria"},{"name":"School of Psychology, University of Surrey, Stag Hill, Guildford GU2 7XH, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4544-7765","authenticated-orcid":false,"given":"Theresa","family":"Hauser","sequence":"additional","affiliation":[{"name":"Laboratory for Sleep, Cognition and Consciousness Research, Department of Psychology, University of Salzburg, Hellbrunner Strasse 34, 5020 Salzburg, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael A.","family":"Hahn","sequence":"additional","affiliation":[{"name":"Laboratory for Sleep, Cognition and Consciousness Research, Department of Psychology, University of Salzburg, Hellbrunner Strasse 34, 5020 Salzburg, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5899-8772","authenticated-orcid":false,"given":"Manuel","family":"Schabus","sequence":"additional","affiliation":[{"name":"Laboratory for Sleep, Cognition and Consciousness Research, Department of Psychology, University of Salzburg, Hellbrunner Strasse 34, 5020 Salzburg, Austria"},{"name":"Center for Cognitive Neuroscience Salzburg (CCNS), Hellbrunner Strasse 34, 5020 Salzburg, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,9,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"814","DOI":"10.1164\/ajrccm.162.3.9908002","article-title":"Evaluation of home versus laboratory polysomnography in the diagnosis of sleep apnea syndrome","volume":"162","author":"Portier","year":"2000","journal-title":"Am. J. Respir. Crit. Care Med."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1111\/j.1365-2869.2010.00859.x","article-title":"Sleep efficiency during sleep studies: Results of a prospective study comparing home-based and in-hospital polysomnography","volume":"20","author":"Bruyneel","year":"2011","journal-title":"J. Sleep Res."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1111\/j.1469-8986.1966.tb02650.x","article-title":"The first night effect: An eeg study of sleep","volume":"2","author":"Agnew","year":"1966","journal-title":"Psychophysiology"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1119","DOI":"10.1093\/sleep\/20.12.1119","article-title":"Sleep in the laboratory and sleep at home: Comparisons of older insomniacs and normal sleepers","volume":"20","author":"Edinger","year":"1997","journal-title":"Sleep"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"351","DOI":"10.5664\/jcsm.6472","article-title":"Orthosomnia: Are some patients taking the quantified self too far?","volume":"13","author":"Baron","year":"2017","journal-title":"J. Clin. Sleep Med."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Lee, J.-M., Byun, W., Keill, A., Dinkel, D., and Seo, Y. (2018). Comparison of wearable trackers\u2019 ability to estimate sleep. Int. J. Environ. Res. Pub. Health, 15.","DOI":"10.3390\/ijerph15061265"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"709","DOI":"10.5664\/jcsm.4840","article-title":"Is there a clinical role for smartphone sleep apps? Comparison of sleep cycle detection by a smartphone application to polysomnography","volume":"11","author":"Bhat","year":"2015","journal-title":"J. Clin. Sleep Med."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1024","DOI":"10.3109\/07420528.2015.1054395","article-title":"Evaluation of a consumer fitness-tracking device to assess sleep in adults","volume":"32","author":"Claudatos","year":"2015","journal-title":"Chronobiol. Int."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1159\/000085205","article-title":"An E-Health solution for automatic sleep classification according to Rechtschaffen and Kales: Validation study of the Somnolyzer 24 \u00d7 7 utilizing the Siesta database","volume":"51","author":"Anderer","year":"2005","journal-title":"Neuropsychobiology"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1159\/000320864","article-title":"Computer-assisted sleep classification according to the standard of the American Academy of Sleep Medicine: Validation study of the AASM version of the Somnolyzer 24 \u00d7 7","volume":"62","author":"Anderer","year":"2010","journal-title":"Neuropsychobiology"},{"key":"ref_11","unstructured":"American Academy of Sleep Medicine (2007). The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications, American Academy of Sleep Medicine."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","volume":"33","author":"Landis","year":"1977","journal-title":"Biometrics"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1016\/S1389-9457(00)00098-8","article-title":"Comparison of actigraphic, polysomnographic, and subjective assessment of sleep parameters in sleep-disordered patients","volume":"2","author":"Kushida","year":"2001","journal-title":"Sleep Med."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/j.smrv.2010.10.001","article-title":"The role and validity of actigraphy in sleep medicine: An update","volume":"15","author":"Sadeh","year":"2011","journal-title":"Sleep Med. Rev."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"543","DOI":"10.1016\/0895-4356(90)90158-L","article-title":"High agreement but low kappa: I. The problems of two paradoxes","volume":"43","author":"Feinstein","year":"1990","journal-title":"J. Clin. Epidemiol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1002\/pst.1659","article-title":"The disagreeable behaviour of the kappa statistic","volume":"14","author":"Flight","year":"2015","journal-title":"Pharm. Stat."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"487","DOI":"10.5664\/jcsm.27286","article-title":"Clinical guideline for the evaluation and management of chronic insomnia in adults","volume":"4","author":"Broch","year":"2008","journal-title":"J. Clin. Sleep Med. JCSM"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1538","DOI":"10.1249\/MSS.0000000000001947","article-title":"Wearable sleep technology in clinical and research settings","volume":"51","author":"Cellini","year":"2019","journal-title":"Med. Sci. Sports Exerc."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"732","DOI":"10.1016\/j.chest.2016.04.016","article-title":"Sleep tracking, wearable technology, and opportunities for research and clinical care","volume":"150","author":"Shelgikar","year":"2016","journal-title":"Chest"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/19\/4160\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:24:16Z","timestamp":1760189056000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/19\/4160"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,9,25]]},"references-count":19,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2019,10]]}},"alternative-id":["s19194160"],"URL":"https:\/\/doi.org\/10.3390\/s19194160","relation":{"has-preprint":[{"id-type":"doi","id":"10.20944\/preprints201907.0303.v1","asserted-by":"object"}]},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,9,25]]}}}