{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T05:48:56Z","timestamp":1784180936271,"version":"3.55.0"},"reference-count":46,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Hum Factors"],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Mobility is a meaningful aspect of an individual\u2019s health whose quantification can provide clinical insights. Wearable sensor technology can quantify walking behaviors (a key aspect of mobility) through continuous passive monitoring.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>Our objective was to characterize the analytical performance (accuracy and reliability) of a suite of digital measures of walking behaviors as critical aspects in the practical implementation of digital measures into clinical studies.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We collected data from a wrist-worn device (the Verily Study Watch) worn for multiple days by a cohort of volunteer participants without a history of gait or walking impairment in a real-world setting. On the basis of step measurements computed in 10-second epochs from sensor data, we generated individual daily aggregates (participant-days) to derive a suite of measures of walking: step count, walking bout duration, number of total walking bouts, number of long walking bouts, number of short walking bouts, peak 30-minute walking cadence, and peak 30-minute walking pace. To characterize the accuracy of the measures, we examined agreement with truth labels generated by a concurrent, ankle-worn, reference device (Modus StepWatch 4) with known low error, calculating the following metrics: intraclass correlation coefficient (ICC), Pearson r coefficient, mean error, and mean absolute error. To characterize the reliability, we developed a novel approach to identify the time to reach a reliable readout (time to reliability) for each measure. This was accomplished by computing mean values over aggregation scopes ranging from 1 to 30 days and analyzing test-retest reliability based on ICCs between adjacent (nonoverlapping) time windows for each measure.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>In the accuracy characterization, we collected data for a total of 162 participant-days from a testing cohort (n=35 participants; median observation time 5 days). Agreement with the reference device\u2013based readouts in the testing subcohort (n=35) for the 8 measurements under evaluation, as reflected by ICCs, ranged between 0.7 and 0.9; Pearson r values were all greater than 0.75, and all reached statistical significance (P&lt;.001). For the time-to-reliability characterization, we collected data for a total of 15,120 participant-days (overall cohort N=234; median observation time 119 days). All digital measures achieved an ICC between adjacent readouts of &gt;0.75 by 16 days of wear time.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>We characterized the accuracy and reliability of a suite of digital measures that provides comprehensive information about walking behaviors in real-world settings. These results, which report the level of agreement with high-accuracy reference labels and the time duration required to establish reliable measure readouts, can guide the practical implementation of these measures into clinical studies. Well-characterized tools to quantify walking behaviors in research contexts can provide valuable clinical information about general population cohorts and patients with specific conditions.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2196\/48270","type":"journal-article","created":{"date-parts":[[2023,6,21]],"date-time":"2023-06-21T19:12:13Z","timestamp":1687374733000},"page":"e48270","source":"Crossref","is-referenced-by-count":14,"title":["Accuracy and Reliability of a Suite of Digital Measures of Walking Generated Using a Wrist-Worn Sensor in Healthy Individuals: Performance Characterization Study"],"prefix":"10.2196","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7049-4793","authenticated-orcid":false,"given":"Nathan","family":"Kowahl","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0339-4856","authenticated-orcid":false,"given":"Sooyoon","family":"Shin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4604-9868","authenticated-orcid":false,"given":"Poulami","family":"Barman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1082-7055","authenticated-orcid":false,"given":"Erin","family":"Rainaldi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1203-5724","authenticated-orcid":false,"given":"Sara","family":"Popham","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3488-9963","authenticated-orcid":false,"given":"Ritu","family":"Kapur","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2023,8,3]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","DOI":"10.1186\/s11556-022-00310-3"},{"key":"ref2","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2018.14854"},{"key":"ref3","doi-asserted-by":"publisher","DOI":"10.1186\/s12890-022-02099-4"},{"key":"ref4","doi-asserted-by":"publisher","DOI":"10.1186\/s12889-016-3172-0"},{"key":"ref5","doi-asserted-by":"publisher","DOI":"10.3390\/s21082672"},{"key":"ref6","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.9341"},{"key":"ref7","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-023-01930-9"},{"key":"ref8","unstructured":"Library of digital endpointsDigital Medicine Society (DiMe)2023-06-27https:\/\/dimesociety.org\/communication-education\/library-of-digital-endpoints\/"},{"key":"ref9","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-020-0260-4"},{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.1002\/pmrj.12725"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.1186\/s12966-022-01350-9"},{"key":"ref12","doi-asserted-by":"publisher","DOI":"10.1016\/j.gaitpost.2022.08.002"},{"key":"ref13","doi-asserted-by":"publisher","DOI":"10.1123\/jmpb.2021-0011"},{"key":"ref14","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-97299-z"},{"key":"ref15","doi-asserted-by":"publisher","DOI":"10.2196\/24806"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.1186\/s12966-021-01167-y"},{"key":"ref17","unstructured":"U.S. Department of Health and Human Services, Food and Drug AdministrationGuidance for industryPatient-reported outcome measures: use in medical product development to support labeling claims20092023-06-27https:\/\/www.fda.gov\/media\/77832\/download"},{"key":"ref18","doi-asserted-by":"publisher","DOI":"10.1001\/jamainternmed.2022.4000"},{"key":"ref19","doi-asserted-by":"publisher","DOI":"10.1001\/jamaneurol.2022.2672"},{"key":"ref20","doi-asserted-by":"publisher","DOI":"10.1007\/s10072-016-2609-7"},{"key":"ref21","doi-asserted-by":"publisher","DOI":"10.1123\/japa.2018-0316"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.2196\/37683"},{"key":"ref23","doi-asserted-by":"publisher","DOI":"10.1249\/tjx.0000000000000172"},{"key":"ref24","doi-asserted-by":"publisher","DOI":"10.1249\/MSS.0000000000001569"},{"key":"ref25","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0251975"},{"key":"ref26","doi-asserted-by":"publisher","DOI":"10.1159\/000369095"},{"key":"ref27","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2020.1382"},{"key":"ref28","doi-asserted-by":"publisher","DOI":"10.1097\/NPT.0b013e318254ba7a"},{"key":"ref29","doi-asserted-by":"publisher","DOI":"10.3389\/fnagi.2019.00022"},{"key":"ref30","doi-asserted-by":"publisher","DOI":"10.2196\/43726"},{"key":"ref31","doi-asserted-by":"publisher","DOI":"10.1016\/j.parkreldis.2023.105355"},{"key":"ref32","doi-asserted-by":"publisher","DOI":"10.1093\/ptj\/pzx010"},{"key":"ref33","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0154335"},{"key":"ref34","doi-asserted-by":"publisher","DOI":"10.1002\/mds.10010"},{"key":"ref35","doi-asserted-by":"publisher","DOI":"10.1249\/MSS.0b013e31817c65d0"},{"key":"ref36","doi-asserted-by":"publisher","DOI":"10.2196\/23681"},{"key":"ref37","doi-asserted-by":"publisher","DOI":"10.1109\/sensors43011.2019.8956668"},{"key":"ref38","doi-asserted-by":"publisher","DOI":"10.3390\/s22197482"},{"key":"ref39","doi-asserted-by":"publisher","DOI":"10.3390\/s19092095"},{"key":"ref40","doi-asserted-by":"publisher","DOI":"10.1088\/1361-6579\/38\/1\/N1"},{"key":"ref41","doi-asserted-by":"publisher","DOI":"10.1016\/j.gaitpost.2017.09.030"},{"key":"ref42","doi-asserted-by":"publisher","DOI":"10.1016\/j.gaitpost.2016.07.269"},{"key":"ref43","doi-asserted-by":"publisher","DOI":"10.1136\/bjsports-2020-103147"},{"key":"ref44","doi-asserted-by":"publisher","DOI":"10.1249\/JES.0000000000000206"},{"key":"ref45","doi-asserted-by":"publisher","DOI":"10.1016\/j.gaitpost.2008.11.003"},{"key":"ref46","doi-asserted-by":"publisher","DOI":"10.1016\/j.jchf.2015.10.015"}],"container-title":["JMIR Human Factors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/humanfactors.jmir.org\/2023\/1\/e48270","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:28:50Z","timestamp":1782840530000},"score":1,"resource":{"primary":{"URL":"https:\/\/humanfactors.jmir.org\/2023\/1\/e48270"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,3]]},"references-count":46,"URL":"https:\/\/doi.org\/10.2196\/48270","relation":{"has-preprint":[{"id-type":"doi","id":"10.2196\/preprints.48270","asserted-by":"object"}]},"ISSN":["2292-9495"],"issn-type":[{"value":"2292-9495","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,3]]}}}