{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,24]],"date-time":"2025-12-24T12:35:57Z","timestamp":1766579757967,"version":"3.37.3"},"reference-count":46,"publisher":"Public Library of Science (PLoS)","issue":"6","license":[{"start":{"date-parts":[[2024,6,17]],"date-time":"2024-06-17T00:00:00Z","timestamp":1718582400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006590","name":"Ministerium f\u00fcr Wissenschaft und Wirtschaft, Land Sachsen-Anhalt","doi-asserted-by":"publisher","award":["MK-CARLA-MLU-2011"],"award-info":[{"award-number":["MK-CARLA-MLU-2011"]}],"id":[{"id":"10.13039\/501100006590","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["Collobarative Research Centre 598 \u2018Heart failure in the elderly \u2013 cellular mechanisms and therapy\u2019"],"award-info":[{"award-number":["Collobarative Research Centre 598 \u2018Heart failure in the elderly \u2013 cellular mechanisms and therapy\u2019"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Martin-Luther-Universit\u00e4t Halle-Wittenberg Wilhelm-Roux-Program","award":["FKZ 14\/41, 16\/19, 28\/21"],"award-info":[{"award-number":["FKZ 14\/41, 16\/19, 28\/21"]}]},{"DOI":"10.13039\/501100008530","name":"European Regional Development Fund","doi-asserted-by":"publisher","award":["ZS\/2019\/07\/99752"],"award-info":[{"award-number":["ZS\/2019\/07\/99752"]}],"id":[{"id":"10.13039\/501100008530","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:sec id=\"sec001\">\n<jats:title>Background<\/jats:title>\n<jats:p>Heart rate variability (HRV), an important marker of autonomic nervous system activity, is usually determined from electrocardiogram (ECG) recordings corrected for extrasystoles and artifacts. Especially in large population-based studies, computer-based algorithms are used to determine RR intervals. The Modular ECG Analysis System MEANS is a widely used tool, especially in large studies. The aim of this study was therefore to evaluate MEANS for its ability to detect non-sinus ECG beats and artifacts and to compare HRV parameters in relation to ECG processing. Additionally, we analyzed how ECG processing affects the statistical association of HRV with cardiovascular disease (CVD) risk factors.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"sec002\">\n<jats:title>Methods<\/jats:title>\n<jats:p>20-min ECGs from 1,674 subjects of the population-based CARLA study were available for HRV analysis. All ECGs were processed with the ECG computer program MEANS. A reference standard was established by experienced clinicians who visually inspected the MEANS-processed ECGs and reclassified beats if necessary. HRV parameters were calculated for 5-minute segments selected from the original 20-minute ECG. The effects of misclassified typified normal beats on i) HRV calculation and ii) the associations of CVD risk factors (sex, age, diabetes, myocardial infarction) with HRV were modeled using linear regression.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"sec003\">\n<jats:title>Results<\/jats:title>\n<jats:p>Compared to the reference standard, MEANS correctly classified 99% of all beats. The averaged sensitivity of MEANS across all ECGs to detect non-sinus beats was 76% [95% CI: 74.1;78.5], but for supraventricular extrasystoles detection sensitivity dropped to 38% [95% CI: 36.8;38.5]. Time-domain parameters were less affected by false sinus beats than frequency parameters. Compared to the reference standard, MEANS resulted in a higher SDNN on average (mean absolute difference 1.4ms [95% CI: 1.0;1.7], relative 4.9%). Other HRV parameters were also overestimated as well (between 6.5 and 29%). The effect estimates for the association of CVD risk factors with HRV did not differ between the editing methods.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"sec004\">\n<jats:title>Conclusion<\/jats:title>\n<jats:p>We have shown that the use of the automated MEANS algorithm may lead to an overestimation of HRV due to the misclassification of non-sinus beats, especially in frequency domain parameters. However, in population-based studies, this has no effect on the observed associations of HRV with risk factors, and therefore an automated ECG analyzing algorithm as MEANS can be recommended here for the determination of HRV parameters.<\/jats:p>\n<\/jats:sec>","DOI":"10.1371\/journal.pone.0304893","type":"journal-article","created":{"date-parts":[[2024,6,17]],"date-time":"2024-06-17T18:02:52Z","timestamp":1718647372000},"page":"e0304893","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":1,"title":["Impact of QRS misclassifications on heart-rate-variability parameters (results from the CARLA cohort study)"],"prefix":"10.1371","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3731-2924","authenticated-orcid":true,"given":"Frank","family":"Sauerbier","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Johannes","family":"Haerting","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel","family":"Sedding","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rafael","family":"Mikolajczyk","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Karl","family":"Werdan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8638-9031","authenticated-orcid":true,"given":"Sebastian","family":"Nuding","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Karin H.","family":"Greiser","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cees A.","family":"Swenne","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4929-026X","authenticated-orcid":true,"given":"Jan A.","family":"Kors","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4446-9938","authenticated-orcid":true,"given":"Alexander","family":"Kluttig","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2024,6,17]]},"reference":[{"key":"pone.0304893.ref001","unstructured":"Apple Inc. Apple stellt drei wegweisende Gesundheitsstudien vor: @Apple; 2019 [6.1.2020]. Available from: https:\/\/www.apple.com\/de\/newsroom\/2019\/09\/apple-announces-three-groundbreaking-health-studies\/."},{"issue":"1","key":"pone.0304893.ref002","doi-asserted-by":"crossref","first-page":"9971","DOI":"10.1038\/s41598-020-66709-z","article-title":"Signatures of the autonomic nervous system and the heart\u2019s pacemaker cells in canine electrocardiograms and their applications to humans","volume":"10","author":"AA Rosenberg","year":"2020","journal-title":"Sci Rep"},{"issue":"3","key":"pone.0304893.ref003","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1016\/j.pcad.2012.09.001","article-title":"Heart rate variability today","volume":"55","author":"B Xhyheri","year":"2012","journal-title":"Prog Cardiovasc Dis"},{"issue":"5","key":"pone.0304893.ref004","doi-asserted-by":"crossref","first-page":"e0251863","DOI":"10.1371\/journal.pone.0251863","article-title":"Effect of exercise training on heart rate variability in type 2 diabetes mellitus patients: A systematic review and meta-analysis","volume":"16","author":"M Picard","year":"2021","journal-title":"PLoS One"},{"key":"pone.0304893.ref005","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.jelectrocard.2023.12.002","article-title":"Applicability of heart rate variability for cardiac autonomic assessment in long-term COVID patients: A systematic review","volume":"82","author":"AA Ferreira","year":"2024","journal-title":"J Electrocardiol"},{"issue":"3","key":"pone.0304893.ref006","doi-asserted-by":"crossref","first-page":"715","DOI":"10.1007\/s10840-022-01138-8","article-title":"Heart rate variability and cardiac autonomic functions in post-COVID period","volume":"63","author":"LD Asarcikli","year":"2022","journal-title":"J Interv Card Electrophysiol"},{"key":"pone.0304893.ref007","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1016\/j.cmpb.2015.12.008","article-title":"ECG-based heartbeat classification for arrhythmia detection: A survey","volume":"127","author":"EJ Luz","year":"2016","journal-title":"Comput Methods Programs Biomed"},{"key":"pone.0304893.ref008","unstructured":"Testing and reporting performance results of cardiac rhythm and ST segment measurement algorithms, (2013)."},{"issue":"0","key":"pone.0304893.ref009","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1016\/j.bspc.2015.01.008","article-title":"Ectopic beats detection and correction methods: A review","volume":"18","author":"D Nabil","year":"2015","journal-title":"Biomed Signal Process Control"},{"key":"pone.0304893.ref010","doi-asserted-by":"crossref","first-page":"148","DOI":"10.3389\/fphys.2012.00148","article-title":"Role of editing of R-R intervals in the analysis of heart rate variability","volume":"3","author":"MA Peltola","year":"2012","journal-title":"Front Physiol"},{"issue":"4","key":"pone.0304893.ref011","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1055\/s-0038-1634805","article-title":"Methodology of the modular ECG analysis system MEANS","volume":"29","author":"JH van Bemmel","year":"1990","journal-title":"Methods Inf Med"},{"issue":"9","key":"pone.0304893.ref012","doi-asserted-by":"crossref","first-page":"807","DOI":"10.1007\/s10654-017-0321-4","article-title":"The Rotterdam Study: 2018 update on objectives, design and main results","volume":"32","author":"MA Ikram","year":"2017","journal-title":"Eur J Epidemiol"},{"issue":"13","key":"pone.0304893.ref013","doi-asserted-by":"crossref","first-page":"e015477","DOI":"10.1161\/JAHA.119.015477","article-title":"Prevalence of ECGs Exceeding Thresholds for ST-Segment-Elevation Myocardial Infarction in Apparently Healthy Individuals: The Role of Ethnicity","volume":"9","author":"Kors JA Haar CCt","year":"2020","journal-title":"Journal of the American Heart Association"},{"issue":"2","key":"pone.0304893.ref014","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1093\/ije\/dyp394","article-title":"Cohort Profile: The Study of Health in Pomerania","volume":"40","author":"H V\u00f6lzke","year":"2010","journal-title":"Int J Epidemiol"},{"issue":"10","key":"pone.0304893.ref015","doi-asserted-by":"crossref","first-page":"1107","DOI":"10.1007\/s10654-022-00890-5","article-title":"Framework and baseline examination of the German National Cohort (NAKO)","volume":"37","author":"A Peters","year":"2022","journal-title":"Eur J Epidemiol"},{"issue":"25","key":"pone.0304893.ref016","doi-asserted-by":"crossref","first-page":"1767","DOI":"10.1056\/NEJM199112193252503","article-title":"The Diagnostic Performance of Computer Programs for the Interpretation of Electrocardiograms","volume":"325","author":"JL Willems","year":"1991","journal-title":"N Engl J Med"},{"key":"pone.0304893.ref017","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1186\/1471-2261-5-33","article-title":"Cardiovascular disease, risk factors and heart rate variability in the elderly general population: design and objectives of the CARdiovascular disease, Living and Ageing in Halle (CARLA) Study","volume":"5","author":"KH Greiser","year":"2005","journal-title":"BMC Cardiovasc Disord"},{"issue":"3","key":"pone.0304893.ref018","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/s10654-009-9317-z","article-title":"Cardiovascular diseases, risk factors and short-term heart rate variability in an elderly general population: the CARLA study 2002\u20132006","volume":"24","author":"KH Greiser","year":"2009","journal-title":"Eur J Epidemiol"},{"key":"pone.0304893.ref019","article-title":"Cardiovascular risk factors, living and ageing in Halle: the CARLA study","author":"L Hassan","year":"2022","journal-title":"Eur J Epidemiol"},{"key":"pone.0304893.ref020","first-page":"1161","article-title":"The coming of age of computerized ECG processing: can it replace the cardiologist in epidemiological studies and clinical trials?","volume":"84","author":"JA Kors","year":"2001","journal-title":"Stud Health Technol Inform"},{"issue":"11","key":"pone.0304893.ref021","doi-asserted-by":"crossref","first-page":"889","DOI":"10.1007\/s10654-013-9866-z","article-title":"The Rotterdam Study: 2014 objectives and design update","volume":"28","author":"A Hofman","year":"2013","journal-title":"Eur J Epidemiol"},{"issue":"1","key":"pone.0304893.ref022","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/0010-4809(86)90004-2","article-title":"Multilead ECG analysis","volume":"19","author":"JA Kors","year":"1986","journal-title":"Comput Biomed Res"},{"key":"pone.0304893.ref023","article-title":"Methodology of QT-Interval Measurement in the Modular ECG Analysis System (MEANS)","author":"JA Kors","year":"2009","journal-title":"Ann Noninvasive Electrocardiol"},{"key":"pone.0304893.ref024","doi-asserted-by":"crossref","DOI":"10.1002\/9781118445112.stat05529","article-title":"Reverse Arrangement Test","author":"P. Castiglioni","year":"2014","journal-title":"Wiley StatsRef: Statistics Reference Online"},{"issue":"6","key":"pone.0304893.ref025","first-page":"250","article-title":"Heart rate variability and sympathovagal balance: pharmacological validation","volume":"11","author":"M Bootsma","year":"2003","journal-title":"Neth Heart J"},{"issue":"4","key":"pone.0304893.ref026","doi-asserted-by":"crossref","first-page":"H1565","DOI":"10.1152\/ajpheart.1994.266.4.H1565","article-title":"Heart rate and heart rate variability as indexes of sympathovagal balance","volume":"266","author":"M Bootsma","year":"1994","journal-title":"Am J Physiol Heart Circ Physiol"},{"issue":"3","key":"pone.0304893.ref027","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1111\/j.1542-474X.1996.tb00281.x","article-title":"Reproducibility and Comparability of Short- and Long-Term Heart Rate Variability Measures in Healthy Young Men","volume":"1","author":"JM Dekker","year":"1996","journal-title":"Ann Noninvasive Electrocardiol"},{"issue":"6","key":"pone.0304893.ref028","doi-asserted-by":"crossref","first-page":"612","DOI":"10.1136\/hrt.81.6.612","article-title":"Correlation of heart rate variability with cardiac functional and metabolic variables in cyclists with training induced left ventricular hypertrophy","volume":"81","author":"BM Pluim","year":"1999","journal-title":"Heart"},{"issue":"3","key":"pone.0304893.ref029","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1093\/oxfordjournals.eurheartj.a014868","article-title":"Heart rate variability. Standards of measurement, physiological interpretation, and clinical use. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology","volume":"17","author":"ESC\/NASPE Task Force","year":"1996","journal-title":"Eur Heart J"},{"issue":"2","key":"pone.0304893.ref030","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1177\/096228029900800204","article-title":"Measuring agreement in method comparison studies","volume":"8","author":"JM Bland","year":"1999","journal-title":"Stat Methods Med Res"},{"key":"pone.0304893.ref031","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1007\/978-1-4899-4541-9","volume-title":"An introduction to the bootstrap","author":"B Efron","year":"1993"},{"key":"pone.0304893.ref032","unstructured":"SAS Inc. SAS University Edition 2016 [cited 2016 19.6.2016]. Available from: http:\/\/support.sas.com\/learn\/ap\/student\/index.html."},{"issue":"1","key":"pone.0304893.ref033","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1186\/1475-925X-13-90","article-title":"A new hierarchical method for inter-patient heartbeat classification using random projections and RR intervals","volume":"13","author":"H Huang","year":"2014","journal-title":"Biomed Eng Online"},{"issue":"12","key":"pone.0304893.ref034","doi-asserted-by":"crossref","first-page":"2535","DOI":"10.1109\/TBME.2006.883802","article-title":"A Patient-Adapting Heartbeat Classifier Using ECG Morphology and Heartbeat Interval Features","volume":"53","author":"Chazal Pd","year":"2006","journal-title":"IEEE Trans Biomed Eng"},{"key":"pone.0304893.ref035","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1186\/1475-925X-11-2","article-title":"Automatic filtering of outliers in RR intervals before analysis of heart rate variability in Holter recordings: a comparison with carefully edited data","volume":"11","author":"M Karlsson","year":"2012","journal-title":"Biomed Eng Online"},{"issue":"3","key":"pone.0304893.ref036","doi-asserted-by":"crossref","first-page":"646","DOI":"10.1152\/japplphysiol.00927.2016","article-title":"The impact of artifact correction methods of RR series on heart rate variability parameters","volume":"124","author":"AI Rincon Soler","year":"2018","journal-title":"J Appl Physiol (1985)"},{"issue":"6","key":"pone.0304893.ref037","doi-asserted-by":"crossref","DOI":"10.3390\/e23060648","article-title":"Influence of Ectopic Beats on Heart Rate Variability Analysis","volume":"23","author":"L Zhao","year":"2021","journal-title":"Entropy (Basel)"},{"issue":"1","key":"pone.0304893.ref038","doi-asserted-by":"crossref","first-page":"e12483","DOI":"10.1111\/anec.12483","article-title":"The sensitivity of 38 heart rate variability measures to the addition of artifact in human and artificial 24-hr cardiac recordings","volume":"23","author":"NJ Stapelberg","year":"2018","journal-title":"Ann Noninvasive Electrocardiol"},{"issue":"9","key":"pone.0304893.ref039","doi-asserted-by":"crossref","first-page":"960","DOI":"10.30773\/pi.2020.0168","article-title":"Heart Rate Variability Analysis: How Much Artifact Can We Remove?","volume":"17","author":"DC Sheridan","year":"2020","journal-title":"Psychiatry Investig"},{"issue":"2","key":"pone.0304893.ref040","doi-asserted-by":"crossref","first-page":"260","DOI":"10.52082\/jssm.2022.260","article-title":"RMSSD Is More Sensitive to Artifacts Than Frequency-Domain Parameters: Implication in Athletes\u2019 Monitoring","volume":"21","author":"N Bourdillon","year":"2022","journal-title":"Journal of Sports Science and Medicine"},{"issue":"2","key":"pone.0304893.ref041","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1161\/01.RES.59.2.178","article-title":"Power spectral analysis of heart rate and arterial pressure variabilities as a marker of sympatho-vagal interaction in man and conscious dog","volume":"59","author":"M Pagani","year":"1986","journal-title":"Circ Res"},{"key":"pone.0304893.ref042","doi-asserted-by":"crossref","first-page":"26","DOI":"10.3389\/fphys.2013.00026","article-title":"The LF\/HF ratio does not accurately measure cardiac sympatho-vagal balance","volume":"4","author":"GE Billman","year":"2013","journal-title":"Front Physiol"},{"key":"pone.0304893.ref043","doi-asserted-by":"crossref","first-page":"177","DOI":"10.3389\/fphys.2014.00177","article-title":"Everything Hertz: methodological issues in short-term frequency-domain HRV","volume":"5","author":"JA Heathers","year":"2014","journal-title":"Front Physiol"},{"issue":"360","key":"pone.0304893.ref044","article-title":"Resolving Ambiguities in the LF\/HF Ratio: LF-HF Scatter Plots for the Categorization of Mental and Physical Stress from HRV","volume":"8","author":"W von Rosenberg","year":"2017","journal-title":"Front Physiol"},{"issue":"2","key":"pone.0304893.ref045","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1177\/0272989X9501500202","article-title":"The Effects of Computer-assisted Electrocardiographic Interpretation on Physicians\u2019 Diagnostic Decisions","volume":"15","author":"SD Hillson","year":"1995","journal-title":"Med Decis Making"},{"issue":"3","key":"pone.0304893.ref046","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1016\/j.ijcard.2004.09.013","article-title":"The reliability of short-term measurements of heart rate variability","volume":"103","author":"GR Sandercock","year":"2005","journal-title":"Int J Cardiol"}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0304893","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,17]],"date-time":"2024-06-17T18:03:34Z","timestamp":1718647414000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0304893"}},"subtitle":[],"editor":[{"given":"Agnese","family":"Sbrollini","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2024,6,17]]},"references-count":46,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,6,17]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0304893","relation":{},"ISSN":["1932-6203"],"issn-type":[{"type":"electronic","value":"1932-6203"}],"subject":[],"published":{"date-parts":[[2024,6,17]]}}}