{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,16]],"date-time":"2026-11-16T23:05:29Z","timestamp":1794870329504,"version":"4.9.1"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"11","license":[{"start":{"date-parts":[[2020,9,23]],"date-time":"2020-09-23T00:00:00Z","timestamp":1600819200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,9,23]],"date-time":"2020-09-23T00:00:00Z","timestamp":1600819200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Dr. Couvee Fonds","award":["NA"],"award-info":[{"award-number":["NA"]}]},{"DOI":"10.13039\/501100009248","name":"Innovatiefonds Zorgverzekeraars","doi-asserted-by":"publisher","award":["NA"],"award-info":[{"award-number":["NA"]}],"id":[{"id":"10.13039\/501100009248","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Med Syst"],"published-print":{"date-parts":[[2020,11]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Wearable monitoring devices are an innovative way to measure heart rate (HR) and heart rate variability (HRV), however, there is still debate about the validity of these wearables. This study aimed to validate the accuracy and predictive value of the Empatica E4 wristband against the VU University Ambulatory Monitoring System (VU-AMS) in a clinical population of traumatized adolescents in residential care. A sample of 345 recordings of both the Empatica E4 wristband and the VU-AMS was derived from a feasibility study that included fifteen participants. They wore both devices during two experimental testing and twelve intervention sessions. We used correlations, cross-correlations, Mann-Whitney tests, difference factors, Bland-Altman plots, and Limits of Agreement to evaluate differences in outcomes between devices. Significant correlations were found between Empatica E4 and VU-AMS recordings for HR, SDNN, RMSSD, and HF recordings. There was a significant difference between the devices for all parameters but HR, although effect sizes were small for SDNN, LF, and HF. For all parameters but RMSSD, testing outcomes of the two devices led to the same conclusions regarding significance. The Empatica E4 wristband provides a new opportunity to measure HRV in an unobtrusive way. Results of this study indicate the potential of the Empatica E4 as a practical and valid tool for research on HR and HRV under non-movement conditions. While more research needs to be conducted, this study could be considered as a first step to support the use of HRV recordings provided by wearables.<\/jats:p>","DOI":"10.1007\/s10916-020-01648-w","type":"journal-article","created":{"date-parts":[[2020,9,23]],"date-time":"2020-09-23T01:02:36Z","timestamp":1600822956000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":218,"title":["Validity of the Empatica E4 Wristband to Measure Heart Rate Variability (HRV) Parameters: a Comparison to Electrocardiography (ECG)"],"prefix":"10.1007","volume":"44","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9810-0442","authenticated-orcid":false,"given":"Angela A. T.","family":"Schuurmans","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"de Looff","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Karin S.","family":"Nijhof","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Catarina","family":"Rosada","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ron H. J.","family":"Scholte","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arne","family":"Popma","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Roy","family":"Otten","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,9,23]]},"reference":[{"key":"1648_CR1","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1007\/s10741-010-9174-6","volume":"16","author":"MW Chapleau","year":"2011","unstructured":"Chapleau, M. W., & Sabharwal, R. (2011). Methods of assessing vagus nerve activity and reflexes. Heart Failure Reviews, 16, 109-127.","journal-title":"Heart Failure Reviews"},{"issue":"10","key":"1648_CR2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0205741","volume":"13","author":"PC De Looff","year":"2018","unstructured":"De Looff, P. C., Cornet, L. J. M., Embregts, P. J. C. M., Nijman, H. L. I., & Didden, H. C. M. (2018). Associations of sympathetic and parasympathetic activity in job stress and burnout: A systematic review. PLoS ONE, 13(10): e0205741.","journal-title":"PLoS ONE"},{"key":"1648_CR3","doi-asserted-by":"publisher","first-page":"46","DOI":"10.7453\/gahmj.2014.073","volume":"4","author":"R McCrathy","year":"2015","unstructured":"McCrathy, R., & Shaffer, F. (2015). Heart rate variability: new perspectives on physiological mechanisms, assessment of self-regulatory capacity, and health risk. Global Advances in Health and Medicine, 4, 46-61.","journal-title":"Global Advances in Health and Medicine"},{"key":"1648_CR4","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1016\/0301-0511(95)05137-6","volume":"41","author":"EJC De Geus","year":"1995","unstructured":"De Geus, E. J. C., Willemsen, G. H. M., Klaver, C. H. A. M., & Van Doornen, L. J. P. (1995). Ambulatory measurement of respiratory sinus arrhytmia and respiration rate. Biological Psychology, 41, 205-227.","journal-title":"Biological Psychology"},{"key":"1648_CR5","doi-asserted-by":"publisher","first-page":"184","DOI":"10.1111\/j.1469-8986.1996.tb02122.x","volume":"33","author":"GHM Willemsen","year":"1996","unstructured":"Willemsen, G. H. M., De Geus, E. J. C., Klaver, C. H. A. M., Van Doornen, L. J. P., & Carroll, D. (1996). Ambulatory monitoring of the impedance cardiogram. Psychophysiology, 33, 184-193.","journal-title":"Psychophysiology"},{"key":"1648_CR6","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1088\/0967-3334\/37\/1\/128","volume":"37","author":"MA Garc\u00eda-Gonzalez","year":"2016","unstructured":"Garc\u00eda-Gonzalez, M. A., Fern\u00e1ndez-Chimeno, M., Guede-Fern\u00e1ndez, F., Ferrer-Mileo, V., Argelag\u00f3s-Palau, A., \u2026, Ramos-Castro, J. (2016). A methodology to quantify the differences between alternative methods of heart rate variability measurement. Physiological Measurement, 37, 128-144.","journal-title":"Physiological Measurement"},{"key":"1648_CR7","doi-asserted-by":"crossref","unstructured":"Garbarino, M., Lai, M., Bender, D., Picard, R. W., & Tognetti, S.. Empatica E3 \u2013 A wearable wireless multi-sensor device for real-time computerized biofeedback and data acquisition. In EAI 4th International Conference on Wireless Mobile Communication and Healthcare \u2013 \u201cTransforming healthcare through innovations in mobile and wireless technologies\u201d, 39-42. (2014)","DOI":"10.4108\/icst.mobihealth.2014.257418"},{"key":"1648_CR8","doi-asserted-by":"crossref","unstructured":"McCarthy, C., Pradhan, N., Redpath, C., & Adler, A.. Validation of the Empatica E4 wristband. Proceedings of the 2016 IEEE EMBS International Student Conference (ICS), Ottawa, ON, Canada, 29-31 May 2016, 1-4. (2016)","DOI":"10.1109\/EMBSISC.2016.7508621"},{"key":"1648_CR9","doi-asserted-by":"crossref","unstructured":"Ollander, S., Godin, C., Campagne, A., & Charbonnier, S.. A comparison of wearable and stationary sensors for stress detection. Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Budapest, Hungary, 9-12 October 2016, 1-5 (2016).","DOI":"10.1109\/SMC.2016.7844917"},{"key":"1648_CR10","doi-asserted-by":"publisher","first-page":"669","DOI":"10.1007\/s00421-018-3808-0","volume":"118","author":"P Caminal","year":"2018","unstructured":"Caminal, P., Sola, F., Gomis, P., Guasch, E., Perera, A., Soriano, N., & Mont, L. (2018). Validity of the Polar V800 for measuring heart rate variability in mountain running route conditions. European Journal of Applied Physiology, 118, 669-677.","journal-title":"European Journal of Applied Physiology"},{"key":"1648_CR11","doi-asserted-by":"publisher","first-page":"563","DOI":"10.1007\/s00421-015-3303-9","volume":"116","author":"D Giles","year":"2016","unstructured":"Giles, D., Draper, N., & Neil, W. (2016). Validity of the Polar V800 heart rate monitor to measure RR intervals at rest. European Journal of Applied Physiology, 116, 563-571.","journal-title":"European Journal of Applied Physiology"},{"key":"1648_CR12","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1016\/j.physbeh.2016.03.006","volume":"158","author":"M De Zambotti","year":"2016","unstructured":"De Zambotti, M., Baker, F. C., Willoughby, A. R., Godino, J. G., Wing, D., Patrick, K., & Colrain, I. M. (2016). Measures of sleep and cardiac functioning during sleep using a multi-sensory commercially-available wristband in adolescents. Physiology and Behavior, 158, 143-149.","journal-title":"Physiology and Behavior"},{"key":"1648_CR13","doi-asserted-by":"publisher","first-page":"138","DOI":"10.1016\/j.ijcard.2015.03.038","volume":"185","author":"KM Diaz","year":"2015","unstructured":"Diaz, K. M., Krupka, D. J., Chang, M. J., Peacock, J., Ma, J., Goldsmith, J., Schwartz, J. E., & Davidson, K. W. (2015). Fitbit\u00ae: An accurate and reliable device for wireless physical activity tracking. International Journal of Cardiology, 185, 138-140.","journal-title":"International Journal of Cardiology"},{"key":"1648_CR14","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1016\/j.jpsychores.2017.03.009","volume":"97","author":"S Kang","year":"2017","unstructured":"Kang, S., Kang, J. M., Ko, K., Park, S., & Mariani, S. (2017). Validity of a commercial wearable sleep tracker in adult insomnia disorder patients and good sleepers. Journal of Psychosomatic Research, 97, 38-44.","journal-title":"Journal of Psychosomatic Research"},{"issue":"8","key":"1648_CR15","doi-asserted-by":"publisher","first-page":"1810","DOI":"10.1016\/j.neubiorev.2013.07.004","volume":"37","author":"MN Jarczok","year":"2013","unstructured":"Jarczok, M. N., Jarczok, M., Mauss, D., Koenig, J., Li, J., Herr, R. M., & Thayer, J. F. (2013). Autonomic nervous system activity and workplace stressors\u2014A systematic review. Neuroscience & Biobehavioral Reviews, 37(8), 1810\u20131823","journal-title":"Neuroscience & Biobehavioral Reviews"},{"key":"1648_CR16","doi-asserted-by":"crossref","unstructured":"Kamath, M. V., Watanabe, M., & Upton, A.. Heart Rate Variability (HRV) Signal Analysis: Clinical Applications. CRC Press (2016).","DOI":"10.1201\/b12756"},{"key":"1648_CR17","doi-asserted-by":"crossref","unstructured":"Trimmel, K., Sacha, J., & Huikuri, H. V.. Heart Rate Variability: Clinical Applications and Interaction between HRV and Heart Rate. Frontiers Media SA (2015).","DOI":"10.3389\/978-2-88919-652-4"},{"key":"1648_CR18","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1016\/j.ijpsycho.2018.02.004","volume":"126","author":"GP Trotman","year":"2018","unstructured":"Trotman, G. P., Williams, S. E., Quinton, M. L., & Veldhuijzen van Zanten, J. J. C. S. (2018). Challenge and threat states: Examining cardiovascular, cognitieve and affective responses to two distinct laboratory stress tasks. International Journal of Psychophysiology, 126, 42-51.","journal-title":"International Journal of Psychophysiology"},{"key":"1648_CR19","doi-asserted-by":"publisher","unstructured":"Van Lier, H. G., Pieterse, M E., Garde, A., Postel, M. G., De Haan, H. A., \u2026 & Noordzij, M. L. (2019). A standardized assessment protocol for physiological signals from wearable technology: Methodological underpinnings and an application to the E4 biosensor. Behaviour Research Methods. https:\/\/doi.org\/10.3758\/s13428-019-01263-9","DOI":"10.3758\/s13428-019-01263-9"},{"key":"1648_CR20","first-page":"659","volume-title":"2016 IEEE 20thInternational Conference on Computer Supported Cooperative Work in Design (CSCWD)","author":"Y Zheng","year":"2016","unstructured":"Zheng, Y., & Poon, C. C. Y. (2016). Wearable devices and their applications in surgical robot control and p-medicine. In 2016 IEEE 20th International Conference on Computer Supported Cooperative Work in Design (CSCWD) (659-663). Piscataway: IEEE Press."},{"key":"1648_CR21","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1177\/1754073914565517","volume":"8","author":"RW Picard","year":"2015","unstructured":"Picard, R. W., Fedor, S., & Ayzenberg, Y. (2015). Multiple arousal theory and daily-life electrodermal activity asymmetry. Emotion Review, 8, 62-75.","journal-title":"Emotion Review"},{"key":"1648_CR22","doi-asserted-by":"publisher","first-page":"258","DOI":"10.3389\/fpubh.2017.00258","volume":"5","author":"F Shaffer","year":"2017","unstructured":"Shaffer, F., & Ginsberg, J. P. (2017). An overview of heart rate variability metrics and norms. Frontiers in Public Health, 5:258.","journal-title":"Frontiers in Public Health"},{"key":"1648_CR23","doi-asserted-by":"crossref","unstructured":"Steckler, A., & McLeroy, K. (2008). The importance of external validity. American Journal of Public Health, 98(1), 9\u201310.","DOI":"10.2105\/AJPH.2007.126847"},{"key":"1648_CR24","doi-asserted-by":"crossref","unstructured":"Schuurmans, A. A. T., Nijhof, K. S., Scholte, R., Popma, A., & Otten, R. (2020). A novel approach to improve stress regulation among traumatized youth in residential care: feasibility study testing three game-based meditation interventions. Early Intervention in Psychiatry, 14(4), 476\u2013485.","DOI":"10.1111\/eip.12874"},{"key":"1648_CR25","doi-asserted-by":"publisher","unstructured":"Schuurmans, A. A. T., Nijhof, K. S., Scholte, R., Popma, A., & Otten, R. (2020). Effectiveness of game-based meditation therapy on posttraumatic stress and neurobiological stress reactivity in traumatized adolescents: study protocol for a randomized controlled trial. JMIR Reseearch Protocols. https:\/\/doi.org\/10.2196\/preprints.19881.","DOI":"10.2196\/preprints.19881"},{"key":"1648_CR26","volume-title":"Statistical Power Analyses for the Behavioral Sciences","author":"JW Cohen","year":"1988","unstructured":"Cohen, J. W. (1988). Statistical Power Analyses for the Behavioral Sciences (2nd ed.). Hillsdale: Lawrence Erlbaum Associate.","edition":"2"},{"key":"1648_CR27","doi-asserted-by":"publisher","first-page":"1331","DOI":"10.1002\/sim.1108","volume":"21","author":"DG Bonett","year":"2002","unstructured":"Bonett, D. G. (2002). Sample size requirements for estimating intraclass correlations with desired precision. Statistics in Medicine, 21, 1331-1335.","journal-title":"Statistics in Medicine"},{"key":"1648_CR28","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1016\/S0167-8760(00)00102-1","volume":"37","author":"RL Piferi","year":"2000","unstructured":"Piferi, R. L., Kline, K. A., Younger, J., & Lawler, K. A. (2000). An alternative approach for achieving cardiovascular baseline: viewing an aquatic video. International Journal of Psychophysiology, 37, 207-217.","journal-title":"International Journal of Psychophysiology"},{"key":"1648_CR29","unstructured":"Empatica. E4 wristband User\u2019s manual. Retrieved at 11.04.2018 from https:\/\/empatica.app.box.com\/v\/E4-User-Manual (2018a)"},{"key":"1648_CR30","doi-asserted-by":"publisher","first-page":"210","DOI":"10.1016\/j.cmpb.2013.07.024","volume":"113","author":"MP Tarvainen","year":"2014","unstructured":"Tarvainen, M. P., Niskanen, J. P., Lipponen, J. A., Ranta-Aho, P. O., & Karjalainen, P. A. (2014). Kubios HRV \u2013 heart rate variability analysis software. Compyter Methods and Programs in Biomedicine, 113, 210-220.","journal-title":"Compyter Methods and Programs in Biomedicine"},{"key":"1648_CR31","unstructured":"Empatica. How is IBI.csv obtained? Retrieved at 11.02.2019 at https:\/\/support.empatica.com\/hc\/en-us\/articles\/201912319-How-is-IBI-csv-obtained- (2018b)"},{"key":"1648_CR32","unstructured":"Vrije Universiteit. Data analysis and management software (DAMS) for the Vrije Universiteit Ambulatory Monitoring System (VU-AMS). Manual version 1.3. Retrieved on 04.08.2019 at http:\/\/www.vu-ams.nl\/fileadmin\/user_upload\/manuals\/VU-DAMS_manual_v1.3.pdf (2015)"},{"key":"1648_CR33","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1016\/S0140-6736(86)90837-8","volume":"1","author":"JM Bland","year":"1986","unstructured":"Bland, J. M., & Altman, D. G. (1986). Statistical methods for assessing agreement between two methods of clinical measurement. Lancet, 1, 307-310.","journal-title":"Lancet"},{"key":"1648_CR34","unstructured":"Empatica. What should I know to use the PPG\/IBI data in my experiment? Retrieved at 11.02.2019 at https:\/\/support.empatica.com\/hc\/en-us\/articles\/203621335-What-should-I-know-to-use-the-PPG-IBI-data-in-my-experiment- (2019)"},{"key":"1648_CR35","doi-asserted-by":"publisher","first-page":"R1","DOI":"10.1088\/0967-3334\/28\/3\/R01","volume":"28","author":"J Allen","year":"2007","unstructured":"Allen, J. (2007). Photoplethysmography and its application in clinical physiological measurement. Physiological Measurement, 28, R1-R39.","journal-title":"Physiological Measurement"},{"key":"1648_CR36","doi-asserted-by":"publisher","first-page":"1538","DOI":"10.1109\/TBME.2014.2309951","volume":"61","author":"Y Zheng","year":"2014","unstructured":"Zheng, Y., Ding, X., Poon, C. C., Zhang, H., Zhou, X. \u2026, Sang, Y. (2014). Unobtrusive sensing and wearable devices for health informatics. IEEE Transactions on Biomedical Engineering, 61, 1538-1554.","journal-title":"IEEE Transactions on Biomedical Engineering"},{"key":"1648_CR37","unstructured":"Empatica. What should I know to use the PPG\/IBI data in my experiment? Retrieved at 07.08.2018 at https:\/\/support.empatica.com\/hc\/en-us\/articles\/203621335-What-should-I-know-to-use-the-PPG-IBI-data-in-my-experiment- (2018c)"},{"key":"1648_CR38","doi-asserted-by":"crossref","unstructured":"Boucsein, W.. Electrodermal activity (2nd eds.). New York: Springer. (2012)","DOI":"10.1007\/978-1-4614-1126-0"},{"key":"1648_CR39","unstructured":"Empatica. Recommended tools for signal processing and data analysis. Retrieved at 09.08.2018 at https:\/\/support.empatica.com\/hc\/en-us\/articles\/202872739-Recommended-tools-for-signal-processing-and-data-analysis (2018d)"},{"key":"1648_CR40","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1007\/s10286-003-0085-7","volume":"13","author":"M Radespiel-Tr\u00f6ger","year":"2003","unstructured":"Radespiel-Tr\u00f6ger, M., & Rauh, R. (2003). Agreement of two different methods for measurement of heart rate variability. Clinical Autonomic Research, 13, 99-102.","journal-title":"Clinical Autonomic Research"}],"container-title":["Journal of Medical Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10916-020-01648-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10916-020-01648-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10916-020-01648-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,22]],"date-time":"2021-09-22T19:35:39Z","timestamp":1632339339000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10916-020-01648-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,23]]},"references-count":40,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2020,11]]}},"alternative-id":["1648"],"URL":"https:\/\/doi.org\/10.1007\/s10916-020-01648-w","relation":{},"ISSN":["0148-5598","1573-689X"],"issn-type":[{"value":"0148-5598","type":"print"},{"value":"1573-689X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,23]]},"assertion":[{"value":"25 February 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 August 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 September 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with Ethical Standards"}},{"value":"The authors declare that they have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}},{"value":"The ethics committee of the CMO Arnhem-Nijmegen approved this study.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval"}},{"value":"We have obtained verbal and written assent from all participants and written consent from their legal guardians.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to Participate"}},{"value":"Informed consent for publication of anonymous data was obtained from participants and their legal guardians.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for Publication"}}],"article-number":"190"}}