{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T01:03:49Z","timestamp":1773709429546,"version":"3.50.1"},"reference-count":41,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2019,4,10]],"date-time":"2019-04-10T00:00:00Z","timestamp":1554854400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper addresses the significant need for improvements in device version reporting and practice across the academic and technical activity monitoring literature, and it recommends assessments for new and updated consumer sensing devices. Reproducibility and data veracity are central to good scholarship, and particularly significant in clinical and health applications. Across the literature there is an absence of device version reporting and a failure to recognize that device validity is not maintained when firmware and software updates can, and do, change device performance and parameter estimation. In this paper, we propose the use of tractable methods to assess devices at their current version and provide an example empirical approach. Experimental results for heart rate and step count acquisitions during walking and everyday living activities from Garmin Vivosmart 3 (v4.10) wristband monitors are presented and analyzed, and the reliability issues of optically-acquired heart rates, especially during periods of activity, are demonstrated and discussed. In conclusion, the paper recommends the empirical assessment of new and updated activity monitors and improvements in device version reporting across the academic and technical literature.<\/jats:p>","DOI":"10.3390\/s19071705","type":"journal-article","created":{"date-parts":[[2019,4,10]],"date-time":"2019-04-10T11:25:08Z","timestamp":1554895508000},"page":"1705","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":33,"title":["Version Reporting and Assessment Approaches for New and Updated Activity and Heart Rate Monitors"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2841-1947","authenticated-orcid":false,"given":"Tim","family":"Collins","sequence":"first","affiliation":[{"name":"School of Engineering, Manchester Metropolitan University, Manchester M15 6BH, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7623-2866","authenticated-orcid":false,"given":"Sandra I.","family":"Woolley","sequence":"additional","affiliation":[{"name":"School of Computing and Mathematics, Keele University, Staffordshire ST5 5BG, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8311-5764","authenticated-orcid":false,"given":"Salome","family":"Oniani","sequence":"additional","affiliation":[{"name":"Faculty of Informatics and Control Systems, Georgian Technical University, Tbilisi 380075, Georgia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3394-6762","authenticated-orcid":false,"given":"Ivan Miguel","family":"Pires","sequence":"additional","affiliation":[{"name":"Instituto de Telecomunica\u00e7\u00f5es, Universidade da Beira Interior, 6201-001 Covilh\u00e3, Portugal"},{"name":"Altranportugal, S.A., 1990-096 Lisbon, Portugal"},{"name":"ALLab\u2014Assisted Living Computing and Telecommunications Laboratory, Computing Science Department, Universidade da Beira Interior, 6201-001 Covilh\u00e3, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3195-3168","authenticated-orcid":false,"given":"Nuno M.","family":"Garcia","sequence":"additional","affiliation":[{"name":"Instituto de Telecomunica\u00e7\u00f5es, Universidade da Beira Interior, 6201-001 Covilh\u00e3, Portugal"},{"name":"ALLab\u2014Assisted Living Computing and Telecommunications Laboratory, Computing Science Department, Universidade da Beira Interior, 6201-001 Covilh\u00e3, Portugal"},{"name":"ECATI, Universidade Lus\u00f3fona de Humanidades e Tecnologias, 1749-024 Lisbon, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7364-8535","authenticated-orcid":false,"given":"Sean J.","family":"Ledger","sequence":"additional","affiliation":[{"name":"School of Health and Rehabilitation, Keele University, Staffordshire ST5 5BG, UK"}]},{"given":"Anand","family":"Pandyan","sequence":"additional","affiliation":[{"name":"School of Health and Rehabilitation, Keele University, Staffordshire ST5 5BG, UK"}]}],"member":"1968","published-online":{"date-parts":[[2019,4,10]]},"reference":[{"key":"ref_1","unstructured":"Garmin (2016). Important Safety and Product Information, Garmin Ltd.. Instruction Leaflet Supplied with Vivosmart 3 (v4.10), l90-02068-0l_0D."},{"key":"ref_2","unstructured":"Fitbit (2017, March 20). Important Safety and Product Information. Available online: https:\/\/www.fitbit.com\/uk\/legal\/safety-instructions."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1007\/s10916-017-0760-1","article-title":"A systematic review of wearable patient monitoring systems\u2013current challenges and opportunities for clinical adoption","volume":"41","author":"Baig","year":"2017","journal-title":"J. Med. Syst."},{"key":"ref_4","unstructured":"Business Wire (2018, November 01). Federal Court Denies Fitbit\u2019s Motion to Dismiss Class Action Lawsuit Alleging Gross Inaccuracies and Recording Failures in PurePulse\u2122 Heart Rate Monitors. Available online: https:\/\/www.businesswire.com\/news\/home\/20180605006652\/en\/Federal-Court-Denies-Fitbits-Motion-Dismiss-Class."},{"key":"ref_5","unstructured":"Lieff Cabraser (2018, November 01). Federal Court Denies Fitbit\u2019s Motion to Dismiss Class Action Lawsuit Alleging Gross Inaccuracies and Recording Failures in PurePulse\u2122 Heart Rate Monitors. Available online: https:\/\/www.lieffcabraser.com\/2018\/06\/federal-court-denies-fitbit-motion-to-dismiss-class-action-lawsuit-inaccuracies-purepulse-heart-rate-monitors\/."},{"key":"ref_6","unstructured":"Oniani, S., Woolley, S.I., Pires, I.M., Garcia, N.M., Collins, T., Ledger, S., and Pandyan, A. (2019, April 08). Reliability Assessment of New and Updated Consumer-Grade Activity and Heart Rate Monitors. IARIA SensorDevices. Available online: https:\/\/www.researchgate.net\/publication\/327731601_Reliability_Assessment_of_New_and_Updated_Consumer-Grade_Activity_and_Heart_Rate_Monitors."},{"key":"ref_7","first-page":"39","article-title":"Beyond Fitbit: A critical appraisal of optical heart rate monitoring wearables and apps, their current limitations and legal implications","volume":"28","author":"Lang","year":"2017","journal-title":"Alb. Law J. Sci. Tech."},{"key":"ref_8","unstructured":"Collins, T., Pires, I., Oniani, S., and Woolley, S. (2019, April 08). How Reliable is Your Wearable Heart Rate Monitor? The Conversation, Health+Medicine. Available online: https:\/\/theconversation.com\/how-reliable-is-your-wearable-heart-rate-monitor-98095."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"10494","DOI":"10.1038\/srep10494","article-title":"A new look at the essence of the imaging photoplethysmography","volume":"5","author":"Kamshilin","year":"2015","journal-title":"Sci. Rep."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhang, Z. (2014, January 3\u20135). Heart rate monitoring from wrist-type photoplethysmographic (PPG) signals during intensive physical exercise. Proceedings of the IEEE Global Conference on Signal and Information Processing (GlobalSIP), Atlanta, GA, USA.","DOI":"10.1109\/GlobalSIP.2014.7032208"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"522","DOI":"10.1109\/TBME.2014.2359372","article-title":"TROIKA: A general framework for heart rate monitoring using wrist-type photoplethysmographic signals during intensive physical exercise","volume":"62","author":"Zhang","year":"2015","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"e000106","DOI":"10.1136\/bmjsem-2015-000106","article-title":"How accurate are the wrist-based heart rate monitors during walking and running activities? Are they accurate enough?","volume":"2","author":"Stahl","year":"2016","journal-title":"BMJ Open Sport Exerc. Med."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"e157","DOI":"10.2196\/mhealth.8233","article-title":"Fitbit Charge HR wireless heart rate monitor: Validation study conducted under free-living conditions","volume":"5","author":"Gorny","year":"2017","journal-title":"JMIR mHealth uHealth"},{"key":"ref_14","first-page":"503","article-title":"Current state of commercial wearable technology in physical activity monitoring 2015\u20132017","volume":"11","author":"Bunn","year":"2018","journal-title":"Int. J. Exerc. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"264","DOI":"10.3109\/03091902.2015.1047536","article-title":"Validation of photoplethysmography as a method to detect heart rate during rest and exercise","volume":"39","author":"Spierer","year":"2015","journal-title":"J. Med. Eng. Technol."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Parak, J., and Korhonen, I. (2014, January 26\u201330). Evaluation of wearable consumer heart rate monitors based on photopletysmography. Proceedings of the 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Chicago, IL, USA.","DOI":"10.1109\/EMBC.2014.6944419"},{"key":"ref_17","unstructured":"Sanchez, D.I., Woolley, S., Collins, T., Pemberton, P., Veenith, T., Hume, D., Laver, K., and Small, C. (2019, April 08). The Quantified Outpatient-Challenges and Opportunities in 24 hr Patient Monitoring. Informatics for Health. Available online: https:\/\/www.researchgate.net\/publication\/313861434_The_Quantified_Outpatient_-_Challenges_and_Opportunities_in_24hr_Patient_Monitoring."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1007\/BF01618105","article-title":"A clinical evaluation of the accuracy of the Nellcor N-100 and Ohmeda 3700 pulse oximeters","volume":"4","author":"Cecil","year":"1988","journal-title":"J. Clin. Monit."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"30","DOI":"10.4258\/hir.2015.21.1.30","article-title":"Aging index using photoplethysmography for a healthcare device: comparison with brachial-ankle pulse wave velocity","volume":"21","author":"Hong","year":"2015","journal-title":"Healthc. Inform. Res."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1942","DOI":"10.1249\/MSS.0000000000000984","article-title":"Accuracy of Wristband Activity Monitors during Ambulation and Activities","volume":"48","author":"Chen","year":"2016","journal-title":"Med. Sci. Sport Exerc."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1303","DOI":"10.1007\/s40279-016-0663-1","article-title":"Step counting: A review of measurement considerations and health-related applications","volume":"47","author":"Bassett","year":"2017","journal-title":"Sports Med."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1186\/1479-5868-9-84","article-title":"Validity of activity monitors in health and chronic disease: A systematic review","volume":"9","author":"Giavedoni","year":"2012","journal-title":"Int. J. Behav. Nutr. Phys. Act."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1089\/tmj.2015.0120","article-title":"An evaluation of commercial pedometers for monitoring slow walking speed populations","volume":"22","author":"Beevi","year":"2016","journal-title":"Telemed. E-Health"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Collins, T., Aldred, S., Woolley, S., and Rai, S. (2015, January 14\u201316). Addressing the Deployment Challenges of Health Monitoring Devices for a Dementia Study. Proceedings of the 5th EAI International Conference on Wireless Mobile Communication and Healthcare, London, UK.","DOI":"10.4108\/eai.14-10-2015.2261638"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"S32","DOI":"10.1249\/MSS.0b013e3182399cf7","article-title":"Calibration and validation of wearable monitors","volume":"44","author":"Bassett","year":"2012","journal-title":"Med. Sci. Sport Exerc."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"S1","DOI":"10.1249\/MSS.0b013e3182399b7e","article-title":"Assessment of physical activity using wearable monitors: recommendations for monitor calibration and use in the field","volume":"44","author":"Freedson","year":"2012","journal-title":"Med. Sci. Sport Exerc."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"793","DOI":"10.1249\/MSS.0000000000001146","article-title":"Reliability and Validity of Ten Consumer Activity Trackers Depend on Walking Speed","volume":"49","author":"Fokkema","year":"2017","journal-title":"Med. Sci. Sport Exerc."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"725","DOI":"10.3389\/fphys.2017.00725","article-title":"Criterion-validity of commercially available physical activity tracker to estimate step count, covered distance and energy expenditure during sports conditions","volume":"8","author":"Wahl","year":"2017","journal-title":"Front. Physiol."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Leth, S., Hansen, J., Nielsen, O.W., and Dinesen, B. (2017). Evaluation of commercial self-monitoring devices for clinical purposes: Results from the future patient trial, phase I. Sensors, 17.","DOI":"10.3390\/s17010211"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1186\/s12966-015-0314-1","article-title":"Systematic review of the validity and reliability of consumer-wearable activity trackers","volume":"12","author":"Evenson","year":"2015","journal-title":"Int. J. Behav. Nutr. Phys. Act."},{"key":"ref_31","unstructured":"Garmin (2018, March 07). Updates & Downloads: Vivosmart HR Software\u2014Version 4.3. Available online: https:\/\/www8.garmin.com\/support\/download_details.jsp?id=9527."},{"key":"ref_32","unstructured":"U.S. Food and Drug Administration (2018, June 13). Digital Health Software Precertification (Pre-Cert) Program, Available online: https:\/\/www.fda.gov\/MedicalDevices\/DigitalHealth\/DigitalHealthPreCertProgram\/ucm567265.htm."},{"key":"ref_33","unstructured":"CTA (2018, June 01). CTA Announces Standard to Improve Heart Rate Monitoring in Wearables. Available online: https:\/\/www.cta.tech\/News\/Press-Releases\/2018\/May\/CTA-Announces-Standard-to-Improve-Heart-Rate-Monit.aspx."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1123\/japa.16.2.201","article-title":"Activity-monitor accuracy in measuring step number and cadence in community-dwelling older adults","volume":"16","author":"Grant","year":"2008","journal-title":"J. Aging Phys. Act."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"496","DOI":"10.1016\/j.jsams.2013.10.241","article-title":"Validation of the Fitbit One activity monitor device during treadmill walking","volume":"17","author":"Takacs","year":"2014","journal-title":"J. Sci. Med. Sport"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1145\/2658987","article-title":"The real software crisis: Repeatability as a core value","volume":"58","author":"Krishnamurthi","year":"2015","journal-title":"Commun. ACM"},{"key":"ref_37","unstructured":"Garmin (2018, June 02). FIT Software Development Kit (Version 20.56.00). Available online: https:\/\/www.thisisant.com\/resources\/fit."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Kooiman, T.J., Dontje, M.L., Sprenger, S.R., Krijnen, W.P., van der Schans, C.P., and de Groot, M. (2015). Reliability and validity of ten consumer activity trackers. BMC Sport Sci. Med. Rehabil., 7.","DOI":"10.1186\/s13102-015-0018-5"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1037\/1082-989X.1.1.30","article-title":"Forming inferences about some intraclass correlation coefficients","volume":"1","author":"McGraw","year":"1996","journal-title":"Psychol. Methods"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Gonz\u00e1lez-Landero, F., Garc\u00eda-Magari\u00f1o, I., Lacuesta, R., and Lloret, J. (2018). Green communication for tracking heart rate with smartbands. Sensors, 18.","DOI":"10.3390\/s18082652"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"10594","DOI":"10.1109\/ACCESS.2017.2702107","article-title":"System to recommend the best place to live based on wellness state of the user employing the heart rate variability","volume":"5","author":"Lacuesta","year":"2017","journal-title":"IEEE Access"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/7\/1705\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:44:11Z","timestamp":1760186651000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/7\/1705"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,4,10]]},"references-count":41,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2019,4]]}},"alternative-id":["s19071705"],"URL":"https:\/\/doi.org\/10.3390\/s19071705","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,4,10]]}}}