{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,27]],"date-time":"2026-07-27T14:15:11Z","timestamp":1785161711805,"version":"3.55.0"},"reference-count":59,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Form Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n For decades, the measurement of sleep and wake has relied upon watch-based actigraphy as an alternative to expensive, obtrusive clinical monitoring. At the time of this publication, we have relied upon a handful of algorithms to score actigraphy data as sleep or wake. However, these algorithms have largely been tested and validated with only small samples of young, healthy individuals.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aimed to establish the accuracy and agreement of conventional and traditional actigraphy algorithms against polysomnography, the clinical standard, using the diverse Multi-Ethnic Study of Atherosclerosis (MESA) sleep dataset. As a secondary objective, we examined algorithm and polysomnography agreement for key sleep metrics including total sleep time (TST), sleep efficiency (SE), and wake after sleep onset (WASO).<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n \n We assessed 5 well-established algorithms, including Cole-Kripke, University of California San Diego (UCSD) scoring, Kripke 2010, Philips-Respironics, and Sadeh, with and without rescoring across 1440 individuals (M\n age<\/jats:sub>\n =mean 69.36, SD 8.97) from the MESA sleep dataset. We conducted epoch-by-epoch comparisons assessing accuracy, confusion matrix analyses, receiver operator characteristic curves (ROC), area under the curve (AUC), and Bland-Altman analyses for agreement.\n <\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Primary results indicated all algorithms demonstrated accuracy between 78%\u201080% with the highest accuracy by the Kripke 2010 (80%) algorithm followed closely by the Cole-Kripke (80%) and Philips-Respironics (80%\u201079%) algorithms. In addition, moderate Cohen \u03ba agreement and moderate positive Matthews correlations were demonstrated by all algorithms. Further, all algorithms demonstrated significant mean difference across sleep metrics.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n The findings of this study establish that these traditional actigraphy algorithms can, with high accuracy, detect sleep and wake in large, diverse population samples, including older adults or populations at risk of health conditions. However, these algorithms may carry difficulty for precise assessment of sleep metrics, especially in cases of sleep disorders or irregular sleep.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/70778","type":"journal-article","created":{"date-parts":[[2025,12,11]],"date-time":"2025-12-11T19:56:58Z","timestamp":1765483018000},"page":"e70778-e70778","source":"Crossref","is-referenced-by-count":3,"title":["Comparison and Validation of Actigraphy Algorithms Using a Large Community Dataset: Algorithm Validation Study"],"prefix":"10.2196","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1174-4438","authenticated-orcid":false,"given":"Darshan","family":"Panesar","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-1058-5985","authenticated-orcid":false,"given":"Aashish","family":"Vichare","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-5778-2295","authenticated-orcid":false,"given":"Jason","family":"Goncalves","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8800-2857","authenticated-orcid":false,"given":"Robyn","family":"Stremler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2025,12,11]]},"reference":[{"issue":"1","key":"R1","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1016\/j.rcc.2005.11.010","article-title":"Actigraphy","volume":"12","author":"Acebo","journal-title":"Respir Care Clin N Am"},{"key":"R2","doi-asserted-by":"crossref","unstructured":"Sadeh A . Actigraphy. In: Handbook of Clinical Neurophysiology. Vol 6. Elsevier; 2005:67-72. [doi: 10.1016\/S1567-4231(09)70031-0] ISBN: 9780444515179","DOI":"10.1016\/S1567-4231(09)70031-0"},{"issue":"4","key":"R3","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1016\/j.smrv.2010.10.001","article-title":"The role and validity of actigraphy in sleep medicine: an update","volume":"15","author":"Sadeh","journal-title":"Sleep Med Rev"},{"issue":"3","key":"R4","doi-asserted-by":"publisher","first-page":"342","DOI":"10.1093\/sleep\/26.3.342","article-title":"The role of actigraphy in the study of sleep and circadian rhythms","volume":"26","author":"Ancoli-Israel","journal-title":"Sleep"},{"issue":"1","key":"R5","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-020-79294-y","article-title":"Efficient embedded sleep wake classification for open-source actigraphy","volume":"11","author":"Banfi","journal-title":"Sci Rep"},{"issue":"5","key":"R6","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1093\/sleep\/15.5.461","article-title":"Automatic sleep\/wake identification from wrist activity","volume":"15","author":"Cole","journal-title":"Sleep"},{"issue":"12","key":"R7","doi-asserted-by":"publisher","first-page":"1752","DOI":"10.1080\/07420528.2019.1679826","article-title":"Performance comparison of different interpretative algorithms utilized to derive sleep parameters from wrist actigraphy data","volume":"36","author":"Haghayegh","journal-title":"Chronobiol Int"},{"issue":"1-2","key":"R8","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1016\/s0031-9384(00)00355-3","article-title":"Sleep detection with an accelerometer actigraph: comparisons with polysomnography","volume":"72","author":"Jean-Louis","journal-title":"Physiol Behav"},{"issue":"2","key":"R9","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1016\/s0165-0270(00)00364-2","article-title":"Sleep estimation from wrist movement quantified by different actigraphic modalities","volume":"105","author":"Jean-Louis","journal-title":"J Neurosci Methods"},{"issue":"4","key":"R10","doi-asserted-by":"publisher","first-page":"612","DOI":"10.1111\/j.1365-2869.2010.00835.x","article-title":"Wrist actigraphic scoring for sleep laboratory patients: algorithm development","volume":"19","author":"Kripke","journal-title":"J Sleep Res"},{"issue":"3","key":"R11","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1093\/sleep\/17.3.201","article-title":"Activity-based sleep-wake identification: an empirical test of methodological issues","volume":"17","author":"Sadeh","journal-title":"Sleep"},{"issue":"2","key":"R12","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1093\/sleep\/31.2.283","article-title":"Comparison of sleep parameters from actigraphy and polysomnography in older women: the SOF study","volume":"31","author":"Blackwell","journal-title":"Sleep"},{"issue":"1","key":"R13","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1093\/sleep\/26.1.81","article-title":"Further validation of actigraphy for sleep studies","volume":"26","author":"de Souza","journal-title":"Sleep"},{"issue":"3","key":"R14","doi-asserted-by":"publisher","first-page":"591","DOI":"10.1016\/j.cger.2014.04.007","article-title":"Sleep in older adults: normative changes, sleep disorders, and treatment options","volume":"30","author":"Gooneratne","journal-title":"Clin Geriatr Med"},{"issue":"4","key":"R15","doi-asserted-by":"publisher","first-page":"519","DOI":"10.1093\/sleep\/30.4.519","article-title":"Practice parameters for the use of actigraphy in the assessment of sleep and sleep disorders: an update for 2007","volume":"30","author":"Morgenthaler","journal-title":"Sleep"},{"issue":"8","key":"R16","doi-asserted-by":"publisher","first-page":"520","DOI":"10.1056\/NEJM199008233230805","article-title":"Sleep disorders and aging","volume":"323","author":"Desforges","journal-title":"N Engl J Med"},{"issue":"10","key":"R17","doi-asserted-by":"publisher","first-page":"1353","DOI":"10.1093\/sleep\/29.10.1353","article-title":"A comparison of actigraphy and polysomnography in older adults treated for chronic primary insomnia","volume":"29","author":"Sivertsen","journal-title":"Sleep"},{"issue":"11","key":"R18","doi-asserted-by":"publisher","first-page":"1747","DOI":"10.5665\/sleep.3142","article-title":"Measuring sleep: accuracy, sensitivity, and specificity of wrist actigraphy compared to polysomnography","volume":"36","author":"Marino","journal-title":"Sleep"},{"issue":"2","key":"R19","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1053\/smrv.2001.0182","article-title":"The role of actigraphy in sleep medicine","volume":"6","author":"Sadeh","journal-title":"Sleep Med Rev"},{"issue":"6","key":"R20","doi-asserted-by":"publisher","first-page":"877","DOI":"10.5665\/sleep.4732","article-title":"Racial\/ethnic differences in sleep disturbances: the multi-ethnic study of atherosclerosis (MESA)","volume":"38","author":"Chen","journal-title":"Sleep"},{"issue":"10","key":"R21","doi-asserted-by":"publisher","first-page":"1351","DOI":"10.1093\/jamia\/ocy064","article-title":"The national sleep research resource: towards a sleep data commons","volume":"25","author":"Zhang","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"R22","doi-asserted-by":"publisher","first-page":"350","DOI":"10.1093\/annweh\/wxaa007","article-title":"Actigraphy-based assessment of sleep parameters","volume":"64","author":"Fekedulegn","journal-title":"Ann Work Expo Health"},{"key":"R23","doi-asserted-by":"publisher","DOI":"10.1016\/j.neurobiolaging.2022.04.006","article-title":"Actigraphy-estimated physical activity is associated with functional and structural brain connectivity among older adults","volume":"116","author":"Soldan","journal-title":"Neurobiol Aging"},{"issue":"1","key":"R24","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1186\/s12966-024-01590-x","article-title":"Validation of actigraphy sleep metrics in children aged 8 to 16 years: considerations for device type, placement and algorithms","volume":"21","author":"Meredith-Jones","journal-title":"Int J Behav Nutr Phys Act"},{"issue":"11","key":"R25","doi-asserted-by":"publisher","first-page":"1301","DOI":"10.5664\/jcsm.6802","article-title":"Improving sleep quality assessment using wearable sensors by including information from postural\/sleep position changes and body acceleration: a comparison of chest-worn sensors, wrist actigraphy, and polysomnography","volume":"13","author":"Razjouyan","journal-title":"J Clin Sleep Med"},{"issue":"1","key":"R26","doi-asserted-by":"publisher","DOI":"10.1111\/jsr.13444","article-title":"Actigraphy: metrics reveal it is not a valid tool for determining sleep in neonates","volume":"31","author":"Derbin","journal-title":"J Sleep Res"},{"issue":"6","key":"R27","doi-asserted-by":"publisher","first-page":"1219","DOI":"10.5665\/sleep.5836","article-title":"Validation of actigraphy in middle childhood","volume":"39","author":"Meltzer","journal-title":"Sleep"},{"key":"R28","unstructured":"ChatGPT. OpenAI. URL: https:\/\/www.openai.com\/chatgpt [Accessed 20-11-2025]"},{"issue":"7","key":"R29","doi-asserted-by":"publisher","first-page":"1209","DOI":"10.5664\/jcsm.7228","article-title":"Use of actigraphy for the evaluation of sleep disorders and circadian rhythm sleep-wake disorders: an American academy of sleep medicine systematic review, meta-analysis, and GRADE assessment","volume":"14","author":"Smith","journal-title":"J Clin Sleep Med"},{"issue":"2","key":"R30","doi-asserted-by":"publisher","DOI":"10.1093\/sleep\/zsad155","article-title":"Comparison of sleep parameters from wrist-worn ActiGraph and Actiwatch devices","volume":"47","author":"Liu","journal-title":"Sleep"},{"issue":"12","key":"R31","doi-asserted-by":"publisher","DOI":"10.1093\/sleep\/zsx168","article-title":"Actigraphy-derived daily rest-activity patterns and body mass index in community-dwelling adults","volume":"40","author":"Cespedes Feliciano","journal-title":"Sleep"},{"issue":"3","key":"R32","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1111\/j.1365-2869.2008.00638.x","article-title":"Disagreement between subjective and actigraphic measures of sleep duration in a population-based study of elderly persons","volume":"17","author":"Van Den Berg","journal-title":"J Sleep Res"},{"key":"R33","doi-asserted-by":"publisher","DOI":"10.2147\/NSS.S151085","article-title":"Actigraphy-based sleep estimation in adolescents and adults: a comparison with polysomnography using two scoring algorithms","volume":"10","author":"Quante","journal-title":"Nat Sci Sleep"},{"issue":"1","key":"R34","doi-asserted-by":"publisher","first-page":"297","DOI":"10.1007\/s11325-012-0689-z","article-title":"Comparison of three actigraphic algorithms used to evaluate sleep in patients with obstructive sleep apnea","volume":"17","author":"Kim","journal-title":"Sleep Breath"},{"key":"R35","volume":"87","author":"Sadeh","journal-title":"J Ambul Monit"},{"issue":"4","key":"R36","doi-asserted-by":"publisher","first-page":"288","DOI":"10.1093\/sleep\/18.4.288","article-title":"The role of actigraphy in the evaluation of sleep disorders","volume":"18","author":"Sadeh","journal-title":"Sleep"},{"issue":"10","key":"R37","doi-asserted-by":"publisher","first-page":"1362","DOI":"10.1093\/sleep\/30.10.1362","article-title":"Wake detection capacity of actigraphy during sleep","volume":"30","author":"Paquet","journal-title":"Sleep"},{"key":"R38","author":"Oakley","journal-title":"Mini Mitter Co"},{"key":"R39","doi-asserted-by":"publisher","DOI":"10.2147\/NSS.S373107","article-title":"Actigraphy-based sleep detection: validation with polysomnography and comparison of performance for nighttime and daytime sleep during simulated shift work","volume":"14","author":"Gao","journal-title":"Nat Sci Sleep"},{"issue":"4","key":"R40","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1093\/sleep\/5.4.389","article-title":"An activity-based sleep monitor system for ambulatory use","volume":"5","author":"Webster","journal-title":"Sleep"},{"issue":"1","key":"R41","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1177\/001316446002000104","article-title":"A coefficient of agreement for nominal scales","volume":"20","author":"Cohen","journal-title":"Educ Psychol Meas"},{"issue":"3","key":"R42","doi-asserted-by":"publisher","first-page":"276","DOI":"10.11613\/bm.2012.031","article-title":"Interrater reliability: the kappa statistic","volume":"22","author":"McHugh","journal-title":"Biochem Med (Zagreb)"},{"issue":"2","key":"R43","doi-asserted-by":"publisher","first-page":"442","DOI":"10.1016\/0005-2795(75)90109-9","article-title":"Comparison of the predicted and observed secondary structure of T4 phage lysozyme","volume":"405","author":"Matthews","journal-title":"Biochim Biophys Acta"},{"issue":"1","key":"R44","doi-asserted-by":"publisher","DOI":"10.1186\/s13040-021-00244-z","article-title":"The Matthews correlation coefficient (MCC) is more reliable than balanced accuracy, bookmaker informedness, and markedness in two-class confusion matrix evaluation","volume":"14","author":"Chicco","journal-title":"BioData Min"},{"issue":"1","key":"R45","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1037\/a0024338","article-title":"Effect size estimates: current use, calculations, and interpretation","volume":"141","author":"Fritz","journal-title":"J Exp Psychol Gen"},{"issue":"4","key":"R46","doi-asserted-by":"publisher","DOI":"10.1093\/geroni\/igz036","article-title":"Effect size guidelines, sample size calculations, and statistical power in gerontology","volume":"3","author":"Brydges","journal-title":"Innov Aging"},{"issue":"8476","key":"R47","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1016\/s0140-6736(86)90837-8","article-title":"Statistical methods for assessing agreement between two methods of clinical measurement","volume":"1","author":"Bland","journal-title":"Lancet"},{"issue":"1","key":"R48","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1161\/HYPERTENSIONAHA.114.04193","article-title":"Periodic limb movements during sleep and prevalent hypertension in the multi-ethnic study of atherosclerosis","volume":"65","author":"Koo","journal-title":"Hypertension"},{"issue":"2","key":"R49","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1016\/j.atherosclerosis.2005.08.010","article-title":"Smoking, diabetes, and blood cholesterol differ in their associations with subclinical atherosclerosis: the Multiethnic Study of Atherosclerosis (MESA)","volume":"186","author":"Sharrett","journal-title":"Atherosclerosis"},{"issue":"12","key":"R50","doi-asserted-by":"publisher","first-page":"1752","DOI":"10.1080\/07420528.2019.1679826","article-title":"Performance comparison of different interpretative algorithms utilized to derive sleep parameters from wrist actigraphy data","volume":"36","author":"Haghayegh","journal-title":"Chronobiol Int"},{"key":"R51","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-019-0126-9","article-title":"Benchmark on a large cohort for sleep-wake classification with machine learning techniques","volume":"2","author":"Palotti","journal-title":"NPJ Digit Med"},{"key":"R52","doi-asserted-by":"crossref","unstructured":"Jokar F Azzopardi G Palotti J . Towards accurate and efficient sleep period detection using wearable devices. Presented at: International Conference on Computer Analysis of Images and Patterns; Sep 25-28, 2023:43-54; Limassol, Cyprus. [doi: 10.1007\/978-3-031-44240-7_5]","DOI":"10.1007\/978-3-031-44240-7_5"},{"issue":"9","key":"R53","doi-asserted-by":"publisher","first-page":"3270","DOI":"10.1109\/JBHI.2020.3006145","article-title":"An attention based CNN-LSTM approach for sleep-wake detection with heterogeneous sensors","volume":"25","author":"Chen","journal-title":"IEEE J Biomed Health Inform"},{"issue":"10","key":"R54","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1009514","article-title":"pyActigraphy: open-source python package for actigraphy data visualization and analysis","volume":"17","author":"Hammad","journal-title":"PLoS Comput Biol"},{"issue":"24","key":"R55","doi-asserted-by":"publisher","DOI":"10.3390\/s24247982","article-title":"Domain adversarial convolutional neural network improves the accuracy and generalizability of wearable sleep assessment technology","volume":"24","author":"Nunes","journal-title":"Sensors (Basel)"},{"issue":"7","key":"R56","doi-asserted-by":"publisher","first-page":"1002","DOI":"10.1080\/07420528.2020.1754848","article-title":"A novel machine learning unsupervised algorithm for sleep\/wake identification using actigraphy","volume":"37","author":"Li","journal-title":"Chronobiol Int"},{"issue":"4","key":"R57","doi-asserted-by":"publisher","first-page":"1607","DOI":"10.1109\/JBHI.2018.2867619","article-title":"Multimodal ambulatory sleep detection using LSTM recurrent neural networks","volume":"23","author":"Sano","journal-title":"IEEE J Biomed Health Inform"},{"issue":"2","key":"R58","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1007\/s10462-023-10662-6","article-title":"Autoencoders and their applications in machine learning: a survey","volume":"57","author":"Berahmand","journal-title":"Artif Intell Rev"},{"key":"R59","unstructured":"Multi-ethnic study of atherosclerosis (MESA). National Heart, Lung, and Blood Institute (NHLBI). URL: https:\/\/clinicaltrials.gov\/ct2\/show\/NCT00005487 [Accessed 21-11-2025]"}],"container-title":["JMIR Formative Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/formative.jmir.org\/2025\/1\/e70778","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:59:42Z","timestamp":1782842382000},"score":1,"resource":{"primary":{"URL":"https:\/\/formative.jmir.org\/2025\/1\/e70778"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,11]]},"references-count":59,"URL":"https:\/\/doi.org\/10.2196\/70778","relation":{},"ISSN":["2561-326X"],"issn-type":[{"value":"2561-326X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,11]]},"article-number":"v9i1e70778"}}