{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,14]],"date-time":"2026-04-14T16:24:13Z","timestamp":1776183853991,"version":"3.50.1"},"reference-count":51,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2020,11,27]],"date-time":"2020-11-27T00:00:00Z","timestamp":1606435200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministero dell'Istruzione, dell'Universit\u00e0 e della Ricerca","award":["Dipartimenti di Eccellenza"],"award-info":[{"award-number":["Dipartimenti di Eccellenza"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>A key access point to the functioning of the autonomic nervous system is the investigation of peripheral signals. Wearable devices (WDs) enable the acquisition and quantification of peripheral signals in a wide range of contexts, from personal uses to scientific research. WDs have lower costs and higher portability than medical-grade devices. However, the achievable data quality can be lower, and data are subject to artifacts due to body movements and data losses. It is therefore crucial to evaluate the reliability and validity of WDs before their use in research. In this study, we introduce a data analysis procedure for the assessment of WDs for multivariate physiological signals. The quality of cardiac and electrodermal activity signals is validated with a standard set of signal quality indicators. The pipeline is available as a collection of open source Python scripts based on the pyphysio package. We apply the indicators for the analysis of signal quality on data simultaneously recorded from a clinical-grade device and two WDs. The dataset provides signals of six different physiological measures collected from 18 subjects with WDs. This study indicates the need to validate the use of WDs in experimental settings for research and the importance of both technological and signal processing aspects to obtain reliable signals and reproducible results.<\/jats:p>","DOI":"10.3390\/s20236778","type":"journal-article","created":{"date-parts":[[2020,11,27]],"date-time":"2020-11-27T09:16:49Z","timestamp":1606468609000},"page":"6778","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Comparison of Wearable and Clinical Devices for Acquisition of Peripheral Nervous System Signals"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1586-8350","authenticated-orcid":false,"given":"Andrea","family":"Bizzego","sequence":"first","affiliation":[{"name":"Department of Psychology and Cognitive Science, University of Trento, 38122 Trento, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9846-5767","authenticated-orcid":false,"given":"Giulio","family":"Gabrieli","sequence":"additional","affiliation":[{"name":"Psychology Program, School of Social Sciences, Nanyang Technological University, Singapore 639798, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5384-3605","authenticated-orcid":false,"given":"Cesare","family":"Furlanello","sequence":"additional","affiliation":[{"name":"HK3 Lab, Rovereto, 38068 Trento, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9442-0254","authenticated-orcid":false,"given":"Gianluca","family":"Esposito","sequence":"additional","affiliation":[{"name":"Department of Psychology and Cognitive Science, University of Trento, 38122 Trento, Italy"},{"name":"Psychology Program, School of Social Sciences, Nanyang Technological University, Singapore 639798, Singapore"},{"name":"Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore 639798, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1016\/j.biopsycho.2010.03.010","article-title":"Autonomic nervous system activity in emotion: A review","volume":"84","author":"Kreibig","year":"2010","journal-title":"Biol. Psychol."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Fletcher, R.R., Poh, M.Z., and Eydgahi, H. (September, January 31). Wearable sensors: Opportunities and challenges for low-cost health care. Proceedings of the 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, Buenos Aires, Argentina.","DOI":"10.1109\/IEMBS.2010.5626734"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1476","DOI":"10.1002\/aur.2374","article-title":"Atypical Emotional Electrodermal Activity in Toddlers with Autism Spectrum Disorder","volume":"13","author":"Vernetti","year":"2020","journal-title":"Autism Res."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1016\/j.artmed.2012.09.003","article-title":"Smart wearable systems: Current status and future challenges","volume":"56","author":"Chan","year":"2012","journal-title":"Artif. Intell. Med."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TSMCC.2009.2032660","article-title":"A survey on wearable sensor-based systems for health monitoring and prognosis","volume":"40","author":"Pantelopoulos","year":"2010","journal-title":"IEEE Trans. Syst. Man Cybern. Part C Appl. Rev."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1769","DOI":"10.1088\/0967-3334\/33\/11\/1769","article-title":"Device-based monitoring in physical activity and public health research","volume":"33","author":"Bassett","year":"2012","journal-title":"Physiol. Meas."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/ncomms6028","article-title":"Continuous wireless pressure monitoring and mapping with ultra-small passive sensors for health monitoring and critical care","volume":"5","author":"Chen","year":"2014","journal-title":"Nat. Commun."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1904765","DOI":"10.1002\/adma.201904765","article-title":"Electronic Skin: Recent Progress and Future Prospects for Skin-Attachable Devices for Health Monitoring, Robotics, and Prosthetics","volume":"31","author":"Yang","year":"2019","journal-title":"Adv. Mater."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1901924","DOI":"10.1002\/adma.201901924","article-title":"Advanced soft materials, sensor integrations, and applications of wearable flexible hybrid electronics in healthcare, energy, and environment","volume":"32","author":"Lim","year":"2020","journal-title":"Adv. Mater."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1038\/s41551-018-0336-5","article-title":"Biodegradable and flexible arterial-pulse sensor for the wireless monitoring of blood flow","volume":"3","author":"Boutry","year":"2019","journal-title":"Nat. Biomed. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1016\/j.bios.2013.11.039","article-title":"Epidermal tattoo potentiometric sodium sensors with wireless signal transduction for continuous non-invasive sweat monitoring","volume":"54","author":"Bandodkar","year":"2014","journal-title":"Biosens. Bioelectron."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"17586","DOI":"10.3390\/s140917586","article-title":"Novel wearable and wireless ring-type pulse oximeter with multi-detectors","volume":"14","author":"Huang","year":"2014","journal-title":"Sensors"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"112460","DOI":"10.1016\/j.bios.2020.112460","article-title":"Stretchable respiration sensors: Advanced designs and multifunctional platforms for wearable physiological monitoring","volume":"166","author":"Dinh","year":"2020","journal-title":"Biosens. Bioelectron."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"5510","DOI":"10.1109\/JSEN.2020.2969635","article-title":"Reliable Breathing Tracking With Wearable Mask Device","volume":"20","author":"Tipparaju","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"217","DOI":"10.3390\/jsan1030217","article-title":"Sensor mania! the internet of things, wearable computing, objective metrics, and the quantified self 2.0","volume":"1","author":"Swan","year":"2012","journal-title":"J. Sens. Actuator Netw."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1177\/1754073913512003","article-title":"The autonomic nervous system and emotion","volume":"6","author":"Levenson","year":"2014","journal-title":"Emot. Rev."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Schmidt, P., Reiss, A., D\u00fcrichen, R., and Laerhoven, K.V. (2019). Wearable-Based Affect Recognition\u2014A Review. Sensors, 19.","DOI":"10.3390\/s19194079"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1175","DOI":"10.1109\/34.954607","article-title":"Toward machine emotional intelligence: Analysis of affective physiological state","volume":"23","author":"Picard","year":"2001","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"101405","DOI":"10.1016\/j.rasd.2019.05.005","article-title":"Wearables and mobile technologies in Autism Spectrum Disorder interventions: A systematic literature review","volume":"66","author":"Koumpouros","year":"2019","journal-title":"Res. Autism Spectr. Disord."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-020-63596-2","article-title":"Physical presence of spouse enhances brain-to-brain synchrony in co-parenting couples","volume":"10","author":"Azhari","year":"2020","journal-title":"Sci. Rep."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Bizzego, A., Azhari, A., Campostrini, N., Truzzi, A., Ng, L.Y., Gabrieli, G., Bornstein, M.H., Setoh, P., and Esposito, G. (2020). Strangers, Friends, and Lovers Show Different Physiological Synchrony in Different Emotional States. Behav. Sci., 10.","DOI":"10.20944\/preprints201911.0174.v1"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"S78","DOI":"10.1213\/01.ane.0000278134.47777.a5","article-title":"The effect of motion on pulse oximetry and its clinical significance","volume":"105","author":"Petterson","year":"2007","journal-title":"Anesth. Analg."},{"key":"ref_23","first-page":"626","article-title":"Motion Artifact Reduction in Photoplethysmographic Signals: A Review","volume":"2","author":"Yadhuraj","year":"2013","journal-title":"Int. J. Innov. Res. Dev."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Warren, K.M., Harvey, J.R., Chon, K.H., and Mendelson, Y. (2016). Improving Pulse Rate Measurements during Random Motion Using a Wearable Multichannel Reflectance Photoplethysmograph. Sensors, 16.","DOI":"10.3390\/s16030342"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1460","DOI":"10.1109\/TBME.2017.2758643","article-title":"Simple, Transparent, and Flexible Automated Quality Assessment Procedures for Ambulatory Electrodermal Activity Data","volume":"65","author":"Kleckner","year":"2017","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Thammasan, N., Stuldreher, I.V., Schreuders, E., Giletta, M., and Brouwer, A.M. (2020). A Usability Study of Physiological Measurement in School Using Wearable Sensors. Sensors, 20.","DOI":"10.3390\/s20185380"},{"key":"ref_27","first-page":"e13725","article-title":"Using wearable physiological monitors with suicidal adolescent inpatients: Feasibility and acceptability study","volume":"7","author":"Kleiman","year":"2019","journal-title":"JMIR mHealth uHealth"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"van Beers, J.J., Stuldreher, I.V., Thammasan, N., and Brouwer, A.M. (2020, January 25\u201329). A Comparison between Laboratory and Wearable Sensors in the Context of Physiological Synchrony. Proceedings of the 2020 International Conference on Multimodal Interaction, Utrecht, The Netherlands.","DOI":"10.1145\/3382507.3418837"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1538","DOI":"10.1249\/MSS.0000000000001947","article-title":"Wearable sleep technology in clinical and research settings","volume":"51","author":"Cellini","year":"2019","journal-title":"Med. Sci. Sport. Exerc."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"e12926","DOI":"10.1111\/jsr.12926","article-title":"The wrist is not the brain: Estimation of sleep by clinical and consumer wearable actigraphy devices is impacted by multiple patient-and device-specific factors","volume":"29","author":"Danzig","year":"2020","journal-title":"J. Sleep Res."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1097\/ALN.0000000000003029","article-title":"Vital signs monitoring with wearable sensors in high-risk surgical patients: A clinical validation study","volume":"132","author":"Breteler","year":"2020","journal-title":"Anesthesiology"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1007\/s10916-017-0760-1","article-title":"A systematic review of wearable patient monitoring systems\u2013current challenges and opportunities for clinical adoption","volume":"41","author":"Baig","year":"2017","journal-title":"J. Med. Syst."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1089","DOI":"10.1016\/j.jocn.2013.12.003","article-title":"The promise of wearable activity sensors to define patient recovery","volume":"21","author":"Appelboom","year":"2014","journal-title":"J. Clin. Neurosci."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/T-AFFC.2011.15","article-title":"Deap: A database for emotion analysis using physiological signals","volume":"3","author":"Koelstra","year":"2012","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1109\/T-AFFC.2011.25","article-title":"A multimodal database for affect recognition and implicit tagging","volume":"3","author":"Soleymani","year":"2012","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1109\/T-AFFC.2011.20","article-title":"The SEMAINE database: Annotated multimodal records of emotionally coloured conversations between a person and a limited agent","volume":"3","author":"McKeown","year":"2012","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"e215","DOI":"10.1161\/01.CIR.101.23.e215","article-title":"Physiobank, physiotoolkit, and physionet components of a new research resource for complex physiologic signals","volume":"101","author":"Goldberger","year":"2000","journal-title":"Circulation"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Garbarino, M., Lai, M., Bender, D., Picard, R.W., and Tognetti, S. (2014, January 3\u20135). Empatica E3-A wearable wireless multi-sensor device for real-time computerized biofeedback and data acquisition. Proceedings of the 2014 EAI 4th International Conference on Wireless Mobile Communication and Healthcare, Athens, Greece.","DOI":"10.4108\/icst.mobihealth.2014.257418"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"100287","DOI":"10.1016\/j.softx.2019.100287","article-title":"pyphysio: A physiological signal processing library for data science approaches in physiology","volume":"10","author":"Bizzego","year":"2019","journal-title":"SoftwareX"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1088\/0967-3334\/29\/1\/002","article-title":"Robust heart rate estimation from multiple asynchronous noisy sources using signal quality indices and a Kalman filter","volume":"29","author":"Li","year":"2007","journal-title":"Physiol. Meas."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1660","DOI":"10.1109\/TBME.2013.2240452","article-title":"ECG signal quality during arrhythmia and its application to false alarm reduction","volume":"60","author":"Behar","year":"2013","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Elgendi, M. (2016). Optimal Signal Quality Index for Photoplethysmogram Signals. Bioengineering, 3.","DOI":"10.3390\/bioengineering3040021"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"2543","DOI":"10.1088\/0967-3334\/35\/12\/2543","article-title":"A combined segmenting and non-segmenting approach to signal quality estimation for ambulatory photoplethysmography","volume":"35","author":"Wander","year":"2014","journal-title":"Physiol. Meas."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Selvaraj, N., Mendelson, Y., Shelley, K.H., Silverman, D.G., and Chon, K.H. (September, January 30). Statistical approach for the detection of motion\/noise artifacts in Photoplethysmogram. Proceedings of the Engineering in Medicine and\nBiology Society, EMBC, 2011 Annual International Conference of the IEEE, Boston, MA, USA.","DOI":"10.1109\/IEMBS.2011.6091232"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Bizzego, A., and Furlanello, C. (2017). DBD-RCO: Derivative Based Detection And Reverse Combinatorial Optimization To Improve Heart Beat Detection For Wearable Devices. bioRxiv, 118943.","DOI":"10.1101\/118943"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1111\/j.1542-474X.1996.tb00275.x","article-title":"Heart rate variability","volume":"1","author":"Malik","year":"1996","journal-title":"Ann. Noninvasive Electrocardiol."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Taylor, S., Jaques, N., Chen, W., Fedor, S., Sano, A., and Picard, R. (2015, January 25\u201329). Automatic identification of artifacts in electrodermal activity data. Proceedings of the Engineering in Medicine and Biology Society (EMBC), 2015 37th Annual International Conference of the IEEE, Milan, Italy.","DOI":"10.1109\/EMBC.2015.7318762"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Xia, V., Jaques, N., Taylor, S., Fedor, S., and Picard, R. (2015, January 12). Active learning for electrodermal activity classification. Proceedings of the Signal Processing in Medicine and Biology Symposium (SPMB), Philadelphia, PA, USA.","DOI":"10.1109\/SPMB.2015.7405467"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/j.jneumeth.2005.02.001","article-title":"Separating individual skin conductance responses in a short interstimulus-interval paradigm","volume":"146","author":"Alexander","year":"2005","journal-title":"J. Neurosci. Methods"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.ijcard.2012.03.119","article-title":"How accurate is pulse rate variability as an estimate of heart rate variability? A review on studies comparing photoplethysmographic technology with an electrocardiogram","volume":"166","author":"Vagedes","year":"2013","journal-title":"Int. J. Cardiol."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1016\/j.physbeh.2012.01.020","article-title":"Emotional sweating across the body: Comparing 16 different skin conductance measurement locations","volume":"106","author":"Janssen","year":"2012","journal-title":"Physiol. Behav."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/23\/6778\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:38:10Z","timestamp":1760179090000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/23\/6778"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,27]]},"references-count":51,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["s20236778"],"URL":"https:\/\/doi.org\/10.3390\/s20236778","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2020.10.27.356980","asserted-by":"object"}]},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,27]]}}}