{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,15]],"date-time":"2026-04-15T16:51:09Z","timestamp":1776271869519,"version":"3.50.1"},"reference-count":82,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,6,26]],"date-time":"2020-06-26T00:00:00Z","timestamp":1593129600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,6,26]],"date-time":"2020-06-26T00:00:00Z","timestamp":1593129600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Researchers have increasingly begun to use consumer wearables or wrist-worn smartwatches and fitness monitors for measurement of cardiovascular psychophysiological processes related to mental and physical health outcomes. These devices have strong appeal because they allow for continuous, scalable, unobtrusive, and ecologically valid data collection of cardiac activity in \u201cbig data\u201d studies. However, replicability and reproducibility may be hampered moving forward due to the lack of standardization of data collection and processing procedures, and inconsistent reporting of technological factors (e.g., device type, firmware versions, and sampling rate), biobehavioral variables (e.g., body mass index, wrist dominance and circumference), and participant demographic characteristics, such as skin tone, that may influence heart rate measurement. These limitations introduce unnecessary noise into measurement, which can cloud interpretation and generalizability of findings. This paper provides a brief overview of research using commercial wearable devices to measure heart rate, reviews literature on device accuracy, and outlines the challenges that non-standardized reporting pose for the field. We also discuss study design, technological, biobehavioral, and demographic factors that can impact the accuracy of the passive sensing of heart rate measurements, and provide guidelines and corresponding checklist handouts for future study data collection and design, data cleaning and processing, analysis, and reporting that may help ameliorate some of these barriers and inconsistencies in the literature.<\/jats:p>","DOI":"10.1038\/s41746-020-0297-4","type":"journal-article","created":{"date-parts":[[2020,6,26]],"date-time":"2020-06-26T10:19:43Z","timestamp":1593166783000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":207,"title":["Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research"],"prefix":"10.1038","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5474-7674","authenticated-orcid":false,"given":"Benjamin W.","family":"Nelson","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3318-7495","authenticated-orcid":false,"given":"Carissa A.","family":"Low","sequence":"additional","affiliation":[]},{"given":"Nicholas","family":"Jacobson","sequence":"additional","affiliation":[]},{"given":"Patricia","family":"Are\u00e1n","sequence":"additional","affiliation":[]},{"given":"John","family":"Torous","sequence":"additional","affiliation":[]},{"given":"Nicholas B.","family":"Allen","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,6,26]]},"reference":[{"key":"297_CR1","doi-asserted-by":"crossref","unstructured":"Cacioppo J. T., Tassinary L. G., & Berntson G. G. (eds) Handbook of Psychophysiology 4th edn. (Cambridge University Press, 2017).","DOI":"10.1017\/9781107415782"},{"key":"297_CR2","doi-asserted-by":"publisher","DOI":"10.1161\/JAHA.114.001364","volume":"4","author":"H Khan","year":"2015","unstructured":"Khan, H. et al. Resting heart rate and risk of incident heart failure: three prospective cohort studies and a systematic meta\u2010analysis.J. Am. Heart Assoc. 4, e001364 (2015).","journal-title":"J. Am. Heart Assoc."},{"key":"297_CR3","doi-asserted-by":"publisher","first-page":"E53","DOI":"10.1503\/cmaj.150535","volume":"188","author":"D Zhang","year":"2015","unstructured":"Zhang, D., Shen, X. & Qi, X. Resting heart rate and all-cause and cardiovascular mortality in the general population: a meta-analysis. CMAJ 188, E53\u2013E63 (2015).","journal-title":"CMAJ"},{"key":"297_CR4","volume":"6","author":"S Qiu","year":"2017","unstructured":"Qiu, S. et al. Heart rate recovery and risk of cardiovascular events and all\u2010cause mortality: a meta-analysis of prospective cohort studies. J. Am. Heart Assoc. 6, e005505 (2017).","journal-title":"J. Am. Heart Assoc."},{"key":"297_CR5","doi-asserted-by":"publisher","first-page":"927","DOI":"10.1097\/PSY.0b013e3181ba18ed","volume":"71","author":"CA Low","year":"2009","unstructured":"Low, C. A., Salomon, K. & Matthews, K. A. Chronic life stress, cardiovascular reactivity, and subclinical cardiovascular disease in adolescents. Psychosom. Med. 71, 927\u2013931 (2009).","journal-title":"Psychosom. Med."},{"key":"297_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1503\/jpn.130289","volume":"40","author":"GA Alvares","year":"2015","unstructured":"Alvares, G. A., Quintana, D. S., Hickie, I. B. & Guastella, Am. J. Autonomic nervous system dysfunction in psychiatric disorders and the impact of psychotropic medications: a systematic review and meta-analysis. J. Psychiatry Neurosci. 40, 1\u201316 (2015).","journal-title":"J. Psychiatry Neurosci."},{"key":"297_CR7","doi-asserted-by":"publisher","first-page":"748","DOI":"10.1016\/j.jad.2019.07.088","volume":"257","author":"A Kandola","year":"2019","unstructured":"Kandola, A., Ashdown-Franks, G., Stubbs, B., Osborn, D. P. J. & Hayes, J. F. The association between cardiorespiratory fitness and the incidence of common mental health disorders: a systematic review and meta-analysis. J. Affect. Disord. 257, 748\u2013757 (2019).","journal-title":"J. Affect. Disord."},{"key":"297_CR8","doi-asserted-by":"publisher","first-page":"1328","DOI":"10.1176\/appi.ajp.2014.13121605","volume":"171","author":"AH Kemp","year":"2014","unstructured":"Kemp, A. H. et al. Effects of depression, anxiety, comorbidity, and antidepressants on resting-state heart rate and its variability: an ELSA-Brasil cohort baseline study. Am. J. Psychiatry 171, 1328\u20131334 (2014).","journal-title":"Am. J. Psychiatry"},{"key":"297_CR9","first-page":"1","volume":"5","author":"AH Kemp","year":"2014","unstructured":"Kemp, A. H. et al. Major depressive disorder with melancholia displays robust alterations in resting state heart rate and its variability: implications for future morbidity and mortality. Front. Psychol. 5, 1\u20139 (2014).","journal-title":"Front. Psychol."},{"key":"297_CR10","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1002\/jts.21785","volume":"26","author":"EJ Paulus","year":"2013","unstructured":"Paulus, E. J., Argo, T. R. & Egge, J. A. The impact of posttraumatic stress disorder on blood pressure and heart rate in a veteran population. J. Trauma. Stress 26, 169\u2013172 (2013).","journal-title":"J. Trauma. Stress"},{"key":"297_CR11","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1016\/j.schres.2014.02.006","volume":"154","author":"A Clamor","year":"2014","unstructured":"Clamor, A. et al. Altered autonomic arousal in psychosis: an analysis of vulnerability and specificity. Schizophrenia Res. 154, 73\u201378 (2014).","journal-title":"Schizophrenia Res."},{"key":"297_CR12","first-page":"89","volume":"41","author":"A Latvala","year":"2016","unstructured":"Latvala, A. et al. Association of resting heart rate and blood pressure in late adolescence with subsequent mental disorders. JAMA Psychiatry 41, 89\u2013104 (2016).","journal-title":"JAMA Psychiatry"},{"key":"297_CR13","doi-asserted-by":"publisher","first-page":"334","DOI":"10.1001\/jamapsychiatry.2014.2502","volume":"72","author":"ER Walker","year":"2015","unstructured":"Walker, E. R., McGee, R. E. & Druss, B. G. Mortality in mental disorders and global disease burden implications. JAMA Psychiatry 72, 334\u2013341 (2015).","journal-title":"JAMA Psychiatry"},{"key":"297_CR14","doi-asserted-by":"publisher","first-page":"772","DOI":"10.1097\/PSY.0000000000000373","volume":"78","author":"JK Kiecolt-Glaser","year":"2016","unstructured":"Kiecolt-Glaser, J. K. & Wilson, S. J. Psychiatric disorders, morbidity, and mortality: tracing mechanistic pathways to accelerated aging. Psychosom. Med. 78, 772\u2013775 (2016).","journal-title":"Psychosom. Med."},{"key":"297_CR15","doi-asserted-by":"publisher","first-page":"526","DOI":"10.1038\/nrcardio.2012.91","volume":"9","author":"CB Nemeroff","year":"2012","unstructured":"Nemeroff, C. B. & Goldschmidt-Clermont, P. J. Heartache and heartbreak\u2013the link between depression and cardiovascular disease. Nat. Rev. Cardiol. 9, 526\u2013539 (2012).","journal-title":"Nat. Rev. Cardiol."},{"key":"297_CR16","doi-asserted-by":"publisher","unstructured":"Avram, R. et al. Real-world heart rate norms in the Health eHeart study. npjDigital Med. 2, https:\/\/doi.org\/10.1038\/s41746-019-0134-9 (2019).","DOI":"10.1038\/s41746-019-0134-9"},{"key":"297_CR17","doi-asserted-by":"publisher","first-page":"695","DOI":"10.1016\/S0140-6736(83)92244-4","volume":"322","author":"G Mancia","year":"1983","unstructured":"Mancia, G. Effects of blood pressure measurement by the doctor on patient\u2019s blood pressure and heart rate. Lancet 322, 695\u2013698 (1983).","journal-title":"Lancet"},{"key":"297_CR18","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1097\/00126097-200110000-00003","volume":"6","author":"SD Pierdomenico","year":"2001","unstructured":"Pierdomenico, S. D., Bucci, A., Lapenna, D., Cuccurullo, F. & Mezzetti, A. Clinic and ambulatory heart rate in sustained and white-coat hypertension. Blood Press. Monit. 6, 239\u2013244 (2001).","journal-title":"Blood Press. Monit."},{"key":"297_CR19","doi-asserted-by":"publisher","first-page":"525","DOI":"10.1111\/j.1469-8986.1993.tb02076.x","volume":"30","author":"R Geenen","year":"1993","unstructured":"Geenen, R. & Vijver, F. J. R. A simple test of the law of initial values. Psychophysiology 30, 525\u2013530 (1993).","journal-title":"Psychophysiology"},{"key":"297_CR20","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1016\/j.physbeh.2010.04.037","volume":"101","author":"N Pattyn","year":"2010","unstructured":"Pattyn, N., Migeotte, P.-F., Neyt, X., den Nest, A. & van, Cluydts, R. Comparing real-life and laboratory-induced stress reactivity on cardio-respiratory parameters: differentiation of a tonic and a phasic component. Physiol. Behav. 101, 218\u2013223 (2010).","journal-title":"Physiol. Behav."},{"key":"297_CR21","doi-asserted-by":"publisher","first-page":"1211","DOI":"10.1111\/j.1749-6632.1962.tb30629.x","volume":"98","author":"J Wilder","year":"1962","unstructured":"Wilder, J. Basimetric approach (law of initial value) to biological rhythms. Ann. N. Y. Acad. Sci. 98, 1211\u20131220 (1962).","journal-title":"Ann. N. Y. Acad. Sci."},{"key":"297_CR22","doi-asserted-by":"publisher","DOI":"10.1016\/j.psyneuen.2019.02.021","author":"N Rohleder","year":"2019","unstructured":"Rohleder, N. Stress and inflammation\u2014the need to address the gap in the transition between acute and chronic stress effects. Psychoneuroendocrinology https:\/\/doi.org\/10.1016\/j.psyneuen.2019.02.021 (2019).","journal-title":"Psychoneuroendocrinology"},{"key":"297_CR23","doi-asserted-by":"crossref","unstructured":"Mahloko, L. & Adebesin, F. in Responsible Design, Implementation and Use of Information and Communication Technology. Lecture Notes in Computer Science (eds Hattingh, M., et al.) Vol. 12067, 96\u2013107 (Springer International Publishing, Cham, 2020).","DOI":"10.1007\/978-3-030-45002-1_9"},{"key":"297_CR24","doi-asserted-by":"publisher","first-page":"14","DOI":"10.2174\/157340312801215782","volume":"8","author":"M Elgendi","year":"2012","unstructured":"Elgendi, M. On the analysis of fingertip photoplethysmogram signals. Curr. Cardiol. Rev. 8, 14\u201325 (2012).","journal-title":"Curr. Cardiol. Rev."},{"key":"297_CR25","unstructured":"Bradshaw, B. et al. Influenza surveillance using wearable mobile health devices. In International Society for Disease Surveillance Conference 2019 (2019)."},{"key":"297_CR26","doi-asserted-by":"crossref","unstructured":"Natarajan, A., Pantelopoulos, A., Emir-Farinas, H. & Natarajan, P. Heart rate variability with photoplethysmography in 8 million individuals: results and scaling relations with age, gender, and time of day. Preprint at https:\/\/www.biorxiv.org\/content\/10.1101\/772285v1 (2019).","DOI":"10.1101\/772285"},{"key":"297_CR27","doi-asserted-by":"publisher","first-page":"1909","DOI":"10.1056\/NEJMoa1901183","volume":"381","author":"MV Perez","year":"2019","unstructured":"Perez, M. V. et al. Large-scale assessment of a smartwatch to identify atrial fibrillation. N. Engl. J. Med. 381, 1909\u20131917 (2019).","journal-title":"N. Engl. J. Med."},{"key":"297_CR28","doi-asserted-by":"publisher","first-page":"956","DOI":"10.1056\/NEJMra1806949","volume":"381","author":"I Sim","year":"2019","unstructured":"Sim, I. Mobile devices and health. N. Engl. J. Med. 381, 956\u2013968 (2019).","journal-title":"N. Engl. J. Med."},{"key":"297_CR29","doi-asserted-by":"publisher","first-page":"409","DOI":"10.1001\/jamacardio.2018.0136","volume":"3","author":"GH Tison","year":"2018","unstructured":"Tison, G. H. et al. Passive detection of atrial fibrillation using a commercially available smartwatch. JAMA Cardiol. 3, 409 (2018).","journal-title":"JAMA Cardiol."},{"key":"297_CR30","doi-asserted-by":"crossref","unstructured":"Tison, G. H. et al. Cardiovascular Risk Stratification Using Off-the-Shelf Wearables and a Multi-Task Deep Learning Algorithm. In:; 2018.","DOI":"10.1161\/circ.136.suppl_1.21042"},{"key":"297_CR31","doi-asserted-by":"publisher","unstructured":"Stupple, A., Singerman, D., & Celi, L. A. The reproducibility crisis in the age of digital medicine. npjDigital Med. 2, https:\/\/doi.org\/10.1038\/s41746-019-0079-z (2019).","DOI":"10.1038\/s41746-019-0079-z"},{"key":"297_CR32","doi-asserted-by":"publisher","first-page":"718","DOI":"10.1177\/1745691618776008","volume":"13","author":"BW Nelson","year":"2018","unstructured":"Nelson, B. W. & Allen, N. B. Extending the passive-sensing toolbox: using smart-home technology in psychological science. Perspect. Psychol. Sci. 13, 718\u2013733 (2018).","journal-title":"Perspect. Psychol. Sci."},{"key":"297_CR33","doi-asserted-by":"publisher","unstructured":"Hunkin, H., King, D. L., & Zajac, I. T. Wearable devices as adjuncts in the treatment of anxiety-related symptoms: a narrative review of five device modalities and implications for clinical practice. Clin. Psychol. Sci. Pract. 26, https:\/\/doi.org\/10.1111\/cpsp.12290 (2019).","DOI":"10.1111\/cpsp.12290"},{"key":"297_CR34","doi-asserted-by":"publisher","DOI":"10.1016\/S2589-7500(19)30222-5","author":"JM Radin","year":"2020","unstructured":"Radin, J. M., Wineinger, N. E., Topol, E. J. & Steinhubl, S. R. Harnessing wearable device data to improve state-level real-time surveillance of influenza-like illness in the USA: a population-based study. Lancet Digital Health https:\/\/doi.org\/10.1016\/S2589-7500(19)30222-5 (2020).","journal-title":"Lancet Digital Health"},{"key":"297_CR35","doi-asserted-by":"publisher","unstructured":"Evenson, K. R., Goto, M. M., & Furberg, R. D. Systematic review of the validity and reliability of consumer-wearable activity trackers. Int. J. Behav. Nutr. Phys. Activity. 12, https:\/\/doi.org\/10.1186\/s12966-015-0314-1 (2015).","DOI":"10.1186\/s12966-015-0314-1"},{"key":"297_CR36","doi-asserted-by":"publisher","unstructured":"Peake, J. M., Kerr, G., & Sullivan, J. P. A critical review of consumer wearables, mobile applications, and equipment for providing biofeedback, monitoring stress, and sleep in physically active populations. Front. Physiol. 9, https:\/\/doi.org\/10.3389\/fphys.2018.00743 (2018).","DOI":"10.3389\/fphys.2018.00743"},{"key":"297_CR37","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1177\/096228029900800204","volume":"8","author":"JM Bland","year":"1999","unstructured":"Bland, J. M. & Altman, D. G. Measuring agreement in method comparison studies. Stat. Meth. Med. Res 8, 135\u2013160 (1999).","journal-title":"Stat. Meth. Med. Res"},{"key":"297_CR38","doi-asserted-by":"publisher","DOI":"10.2196\/10828","volume":"7","author":"BW Nelson","year":"2019","unstructured":"Nelson, B. W. & Allen, N. B. Accuracy of consumer wearable heart rate measurement during an ecologically valid 24-hour period: intraindividual validation study. JMIR mHealth uHealth 7, e10828 (2019).","journal-title":"JMIR mHealth uHealth"},{"key":"297_CR39","doi-asserted-by":"publisher","first-page":"624","DOI":"10.1249\/MSS.0000000000001471","volume":"50","author":"BD Boudreaux","year":"2018","unstructured":"Boudreaux, B. D. et al. Validity of wearable activity monitors during cycling and resistance exercise. Med. Sci. Sports Exerc. 50, 624\u2013633 (2018).","journal-title":"Med. Sci. Sports Exerc."},{"key":"297_CR40","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1016\/j.physbeh.2016.03.006","volume":"158","author":"M de Zambotti","year":"2016","unstructured":"de Zambotti, M. et al. Measures of sleep and cardiac functioning during sleep using a multi-sensory commercially-available wristband in adolescents. Physiol. Behav. 158, 143\u2013149 (2016).","journal-title":"Physiol. Behav."},{"key":"297_CR41","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.6025","volume":"18","author":"RR Kroll","year":"2016","unstructured":"Kroll, R. R., Boyd, J. G. & Maslove, D. M. Accuracy of a wrist-worn wearable device for monitoring heart rates in hospital inpatients: a prospective observational study. J. Med. Internet Res. 18, e253 (2016).","journal-title":"J. Med. Internet Res."},{"key":"297_CR42","doi-asserted-by":"publisher","first-page":"3","DOI":"10.3390\/jpm7020003","volume":"7","author":"A Shcherbina","year":"2017","unstructured":"Shcherbina, A. et al. Accuracy in wrist-worn, sensor-based measurements of heart rate and energy expenditure in a diverse cohort. J. Personalized Med. 7, 3 (2017).","journal-title":"J. Personalized Med."},{"key":"297_CR43","doi-asserted-by":"publisher","unstructured":"Wallen, M. P., Gomersall, S. R., Keating, S. E., Wisl\u00f8ff, U., & Coombes, J. S. Accuracy of heart rate watches: implications for weight management. PLoS ONE 11, https:\/\/doi.org\/10.1371\/journal.pone.0154420 (2016).","DOI":"10.1371\/journal.pone.0154420"},{"key":"297_CR44","doi-asserted-by":"publisher","first-page":"104","DOI":"10.1001\/jamacardio.2016.3340","volume":"2","author":"R Wang","year":"2017","unstructured":"Wang, R. et al. Accuracy of wrist-worn heart rate monitors. JAMA Cardiol. 2, 104\u2013106 (2017).","journal-title":"JAMA Cardiol."},{"key":"297_CR45","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.7043","volume":"5","author":"EE Dooley","year":"2017","unstructured":"Dooley, E. E., Golaszewski, N. M. & Bartholomew, J. B. Estimating accuracy at exercise intensities: a comparative study of self-monitoring heart rate and physical activity wearable devices. JMIR mHealth uHealth 5, e34 (2017).","journal-title":"JMIR mHealth uHealth"},{"key":"297_CR46","doi-asserted-by":"publisher","first-page":"1697","DOI":"10.1249\/MSS.0000000000001284","volume":"49","author":"S Gillinov","year":"2017","unstructured":"Gillinov, S. et al. Variable accuracy of wearable heart rate monitors during aerobic exercise. Med. Sci. Sports Exerc. 49, 1697\u20131703 (2017).","journal-title":"Med. Sci. Sports Exerc."},{"key":"297_CR47","doi-asserted-by":"publisher","DOI":"10.1136\/bmjsem-2015-000106","volume":"2","author":"SE Stahl","year":"2016","unstructured":"Stahl, S. E., An, H.-S., Dinkel, D. M., Noble, J. M. & Lee, J.-M. How accurate are the wrist-based heart rate monitors during walking and running activities? Are they accurate enough? BMJ Open Sport Exerc. Med. 2, e000106 (2016).","journal-title":"BMJ Open Sport Exerc. Med."},{"key":"297_CR48","doi-asserted-by":"publisher","first-page":"315","DOI":"10.4258\/hir.2015.21.4.315","volume":"21","author":"F El-Amrawy","year":"2015","unstructured":"El-Amrawy, F. & Nounou, M. I. Are currently available wearable devices for activity tracking and heart rate monitoring accurate, precise, and medically beneficial? Healthc. Inform. Res. 21, 315\u2013320 (2015).","journal-title":"Healthc. Inform. Res."},{"key":"297_CR49","unstructured":"FDA. Electrocardiographsoftware for Over-the-Counter Use. https:\/\/www.accessdata.fda.gov\/cdrh_docs\/pdf18\/DEN180044.pdf (FDA, 2018)."},{"key":"297_CR50","doi-asserted-by":"publisher","unstructured":"Bent, B., Goldstein, B. A., Kibbe, W. A., & Dunn, J. P. Investigating sources of inaccuracy in wearable optical heart rate sensors. npj Digital Med. 3, https:\/\/doi.org\/10.1038\/s41746-020-0226-6 (2020).","DOI":"10.1038\/s41746-020-0226-6"},{"key":"297_CR51","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.9754","volume":"6","author":"J Xie","year":"2018","unstructured":"Xie, J. et al. Evaluating the validity of current mainstream wearable devices in fitness tracking under various physical activities: comparative study. JMIR Mhealth Uhealth 6, e94 (2018).","journal-title":"JMIR Mhealth Uhealth"},{"key":"297_CR52","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0192691","author":"S Benedetto","year":"2018","unstructured":"Benedetto, S. et al. Assessment of the fitbit charge 2 for monitoring heart rate. PLoS ONE. https:\/\/doi.org\/10.1371\/journal.pone.0192691 (2018).","journal-title":"PLoS ONE."},{"key":"297_CR53","doi-asserted-by":"publisher","first-page":"6454","DOI":"10.1073\/pnas.1521897113","volume":"113","author":"JJV Bavel","year":"2016","unstructured":"Bavel, J. J. V., Mende-siedlecki, P., Brady, W. J. & Reinero, D. A. Contextual sensitivity in scientific reproducibility. Proc. Natl Acad. Sci. USA 113, 6454\u20136459 (2016).","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"297_CR54","doi-asserted-by":"publisher","unstructured":"Munaf\u00f2, M. R. et al. A manifesto for reproducible science. Nat. Hum. Behav. 1, https:\/\/doi.org\/10.1038\/s41562-016-0021 (2017).","DOI":"10.1038\/s41562-016-0021"},{"key":"297_CR55","doi-asserted-by":"publisher","first-page":"579","DOI":"10.1146\/annurev-clinpsy-050718-095710","volume":"15","author":"JL Tackett","year":"2019","unstructured":"Tackett, J. L., Brandes, C. M., King, K. M. & Markon, K. E. Psychology\u2019s replication crisis and clinical psychological science. Annu. Rev. Clin. Psychol. 15, 579\u2013604 (2019).","journal-title":"Annu. Rev. Clin. Psychol."},{"key":"297_CR56","doi-asserted-by":"publisher","first-page":"413","DOI":"10.1214\/aoms\/1177730388","volume":"18","author":"C Hastings Jr.","year":"1947","unstructured":"Hastings, C. Jr., Mosteller, F., Tukey, J. W. & Winsor, C. P. Low moments for small samples: a comparative study of order statistics. Ann. Math. Stat. 18, 413\u2013426 (1947).","journal-title":"Ann. Math. Stat."},{"key":"297_CR57","doi-asserted-by":"publisher","unstructured":"Yang, Z., Zhou, Q., Lei, L., Zheng, K., & Xiang, W. An IoT-cloud based wearable ECG monitoring system for smart healthcare. J. Med. Syst. 40, https:\/\/doi.org\/10.1007\/s10916-016-0644-9 (2016).","DOI":"10.1007\/s10916-016-0644-9"},{"key":"297_CR58","doi-asserted-by":"publisher","first-page":"549","DOI":"10.1146\/annurev.psych.58.110405.085530","volume":"60","author":"JW Graham","year":"2009","unstructured":"Graham, J. W. Missing data analysis: making it work in the real world. Annu. Rev. Psychol. 60, 549\u2013576 (2009).","journal-title":"Annu. Rev. Psychol."},{"key":"297_CR59","doi-asserted-by":"publisher","first-page":"715","DOI":"10.1080\/10705511.2017.1417046","volume":"25","author":"L Ji","year":"2018","unstructured":"Ji, L., Chow, S.-M., Schermerhorn, A. C., Jacobson, N. C. & Cummings, E. M. Handling missing data in the modeling of intensive longitudinal. Data. Struct. Equ. Model. Multidiscip. J. 25, 715\u2013736 (2018).","journal-title":"Data. Struct. Equ. Model. Multidiscip. J."},{"key":"297_CR60","doi-asserted-by":"publisher","first-page":"295","DOI":"10.3758\/s13428-018-1101-0","volume":"51","author":"NC Jacobson","year":"2019","unstructured":"Jacobson, N. C., Chow, S.-M. & Newman, M. G. The differential time-varying effect model (DTVEM): a tool for diagnosing and modeling time lags in intensive longitudinal data. Behav. Res. Methods 51, 295\u2013315 (2019).","journal-title":"Behav. Res. Methods"},{"key":"297_CR61","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.8233","author":"AW Gorny","year":"2017","unstructured":"Gorny, A. W., Liew, S. J., Tan, C. S., M\u00fcller-Riemenschneider, F. & Fitbit Charge, H. R. Wireless heart rate monitor: validation study conducted under free-living conditions. JMIR mHealth uHealth. https:\/\/doi.org\/10.2196\/mhealth.8233 (2017).","journal-title":"JMIR mHealth uHealth."},{"key":"297_CR62","doi-asserted-by":"publisher","unstructured":"Menghini, L. et al. Stressing the accuracy: wrist-worn wearable sensor validation over different conditions. Psychophysiology. 56, https:\/\/doi.org\/10.1111\/psyp.13441 (2019).","DOI":"10.1111\/psyp.13441"},{"key":"297_CR63","doi-asserted-by":"publisher","first-page":"1502","DOI":"10.1126\/science.1255484","volume":"345","author":"A Franco","year":"2014","unstructured":"Franco, A., Malhotra, N. & Simonovits, G. Publication bias in the social sciences: unlocking the file drawer. Science 345, 1502\u20131505 (2014).","journal-title":"Science"},{"key":"297_CR64","doi-asserted-by":"publisher","first-page":"585","DOI":"10.1038\/nrn3475-c4","volume":"14","author":"KS Button","year":"2013","unstructured":"Button, K. S. et al. Confidence and precision increase with high statistical power. Nat. Rev. Neurosci. 14, 585\u2013585 (2013).","journal-title":"Nat. Rev. Neurosci."},{"key":"297_CR65","unstructured":"Nowok, B., Raab, G., & Dibben, C. Synthpop: generating synthetic versions of sensitive microdata for statistical disclosure control. https:\/\/cran.r-project.org\/web\/packages\/synthpop\/index.html (2016)."},{"key":"297_CR66","doi-asserted-by":"crossref","unstructured":"[No authors listed]. Tell it like it is. Nat. Hum. Behav. 4, 1 (2020).","DOI":"10.1038\/s41562-020-0818-9"},{"key":"297_CR67","doi-asserted-by":"publisher","first-page":"1292","DOI":"10.1177\/1541931213601804","volume":"61","author":"DT Weiler","year":"2017","unstructured":"Weiler, D. T., Villajuan, S. O., Edkins, L., Cleary, S. & Saleem, J. J. Wearable heart rate monitor technology accuracy in research: a comparative study between PPG and ECG technology. Proc. Hum. Factors Ergonomics Soc. Annu. Meet. 61, 1292\u20131296 (2017).","journal-title":"Proc. Hum. Factors Ergonomics Soc. Annu. Meet."},{"key":"297_CR68","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1037\/a0039734","volume":"71","author":"GCN Hall","year":"2016","unstructured":"Hall, G. C. N., Yip, T. & Z\u00e1rate, M. A. On becoming multicultural in a monocultural research world: a conceptual approach to studying ethnocultural diversity. Am. Psychol. 71, 40\u201351 (2016).","journal-title":"Am. Psychol."},{"key":"297_CR69","doi-asserted-by":"publisher","first-page":"107789","DOI":"10.1016\/j.measurement.2020.107789","volume":"159","author":"G Cosoli","year":"2020","unstructured":"Cosoli, G., Spinsante, S. & Scalise, L. Wrist-worn and chest-strap wearable devices: systematic review on accuracy and metrological characteristics. Measurement 159, 107789 (2020).","journal-title":"Measurement"},{"key":"297_CR70","doi-asserted-by":"publisher","DOI":"10.1080\/02640414.2017.1412235","author":"Y Bai","year":"2018","unstructured":"Bai, Y., Hibbing, P., Mantis, C. & Welk, G. J. Comparative evaluation of heart rate-based monitors: Apple watch vs Fitbit charge HR. J. Sports Sci. https:\/\/doi.org\/10.1080\/02640414.2017.1412235 (2018).","journal-title":"J. Sports Sci."},{"key":"297_CR71","doi-asserted-by":"publisher","first-page":"610","DOI":"10.7326\/L16-0353","volume":"166","author":"L Cadmus-Bertram","year":"2017","unstructured":"Cadmus-Bertram, L., Gangnon, R., Wirkus, E. J., Thraen-Borowski, K. M. & Gorzelitz-Liebhauser, J. The accuracy of heart rate monitoring by some wrist-worn activity trackers. Ann. Intern. Med. 166, 610\u2013612 (2017).","journal-title":"Ann. Intern. Med."},{"key":"297_CR72","first-page":"540","volume":"15","author":"E Jo","year":"2016","unstructured":"Jo, E., Lewis, K., Directo, D., Kim, M. J. Y. & Dolezal, B. A. Validation of biofeedback wearables for photoplethysmographic heart rate tracking. J. Sports Sci. Med. 15, 540\u2013547 (2016).","journal-title":"J. Sports Sci. Med."},{"key":"297_CR73","doi-asserted-by":"publisher","DOI":"10.3109\/03091902.2015.1047536","author":"DK Spierer","year":"2015","unstructured":"Spierer, D. K., Rosen, Z., Litman, L. L. & Fujii, K. Validation of photoplethysmography as a method to detect heart rate during rest and exercise. J. Med. Eng. Technol. https:\/\/doi.org\/10.3109\/03091902.2015.1047536 (2015).","journal-title":"J. Med. Eng. Technol."},{"key":"297_CR74","first-page":"3670","volume":"2014","author":"J Parak","year":"2014","unstructured":"Parak, J. & Korhonen, I. Evaluation of wearable consumer heart rate monitors based on photopletysmography. Conf. Proc. IEEE Eng. Med. Biol. Soc. 3670-3673 2014, 3670\u20133673 (2014).","journal-title":"Conf. Proc. IEEE Eng. Med. Biol. Soc. 3670-3673"},{"key":"297_CR75","unstructured":"Valencell, T. Optical heart rate monitoring: what you need to know. Valencell. https:\/\/valencell.com\/blog\/2015\/10\/optical-heart-rate-monitoring-what-you-need-to-know\/. Accessed 13 April, 2020 (2015)."},{"key":"297_CR76","doi-asserted-by":"publisher","first-page":"887","DOI":"10.1016\/j.bbi.2009.04.005","volume":"23","author":"MF O\u2019Connor","year":"2009","unstructured":"O\u2019Connor, M. F. et al. To assess, to control, to exclude: effects of biobehavioral factors on circulating inflammatory markers. Brain Behav. Immun. 23, 887\u2013897 (2009).","journal-title":"Brain Behav. Immun."},{"key":"297_CR77","doi-asserted-by":"publisher","DOI":"10.1038\/tp.2016.73","volume":"6","author":"DS Quintana","year":"2016","unstructured":"Quintana, D. S., Alvares, G. A. & Heathers, J. A. J. Guidelines for reporting articles on psychiatry and heart rate variability (GRAPH): recommendations to advance research communication. Transl. Psychiatry 6, e803 (2016).","journal-title":"Transl. Psychiatry"},{"key":"297_CR78","unstructured":"IDC. Shipments of wearable devices reach 118.9 million units in the fourth quarter and 336.5 million for 2019, According to IDC. IDC: the premier global market intelligence company. https:\/\/www.idc.com\/getdoc.jsp?containerId=prUS46122120. Accessed 31 March, 2020 (2020)."},{"key":"297_CR79","unstructured":"Apple. Your heart rate. What it means, and where on Apple Watch you\u2019ll find it. Apple Support. https:\/\/support.apple.com\/en-gb\/HT204666. Accessed 31 March, 2020 (2020)."},{"key":"297_CR80","unstructured":"Fitbit. Fitbit PurePulse\u00ae continuous wrist-based heart rate. https:\/\/www.fitbit.com\/eu\/purepulse. Accessed 31 March, 2020 (2020)."},{"key":"297_CR81","unstructured":"Garmin. Garmin elevate optical heart rate | Garmin. https:\/\/www.garmin.com.sg\/garmin-technology\/heart-rate. Accessed 31 March, 2020 (2020)."},{"key":"297_CR82","unstructured":"Huawei. Measuring heart rate. https:\/\/consumer.huawei.com\/en\/support\/content\/en-us00756088\/. Accessed 16 April, 2020 (2020)."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0297-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0297-4","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0297-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,7]],"date-time":"2022-12-07T02:21:47Z","timestamp":1670379707000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0297-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,26]]},"references-count":82,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["297"],"URL":"https:\/\/doi.org\/10.1038\/s41746-020-0297-4","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,6,26]]},"assertion":[{"value":"30 January 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 June 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 June 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Dr. Jacobson is the owner of a free application published on the Google Play Store entitled \u201cMood Triggers\u201d. He does not receive any direct or indirect revenue from his ownership of the application (i.e. the application is free, there are no advertisements, and data are only being used for research purposes). Dr. Jacobson has no other disclosures to report. All other authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"90"}}