{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,10]],"date-time":"2025-12-10T08:57:24Z","timestamp":1765357044765,"version":"build-2065373602"},"reference-count":44,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,31]],"date-time":"2021-12-31T00:00:00Z","timestamp":1640908800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004564","name":"Ministry of Education, Science and Technological Development of the Republic of Serbia","doi-asserted-by":"publisher","award":["451-03-68\/2021-14\/200156","451-03-68\/2021-14\/200110"],"award-info":[{"award-number":["451-03-68\/2021-14\/200156","451-03-68\/2021-14\/200110"]}],"id":[{"id":"10.13039\/501100004564","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Science Fund of Republic of Serbia","award":["COVANSA"],"award-info":[{"award-number":["COVANSA"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Approximate and sample entropies are acclaimed tools for quantifying the regularity and unpredictability of time series. This paper analyses the causes of their inconsistencies. It is shown that the major problem is a coarse quantization of matching probabilities, causing a large error between their estimated and true values. Error distribution is symmetric, so in sample entropy, where matching probabilities are directly summed, errors cancel each other. In approximate entropy, errors are accumulating, as sums involve logarithms of matching probabilities. Increasing the time series length increases the number of quantization levels, and errors in entropy disappear both in approximate and in sample entropies. The distribution of time series also affects the errors. If it is asymmetric, the matching probabilities are asymmetric as well, so the matching probability errors cease to be mutually canceled and cause a persistent entropy error. Despite the accepted opinion, the influence of self-matching is marginal as it just shifts the error distribution along the error axis by the matching probability quant. Artificial lengthening the time series by interpolation, on the other hand, induces large error as interpolated samples are statistically dependent and destroy the level of unpredictability that is inherent to the original signal.<\/jats:p>","DOI":"10.3390\/e24010073","type":"journal-article","created":{"date-parts":[[2022,1,3]],"date-time":"2022-01-03T20:49:38Z","timestamp":1641242978000},"page":"73","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["On Quantization Errors in Approximate and Sample Entropy"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4662-7939","authenticated-orcid":false,"given":"Dragana","family":"Baji\u0107","sequence":"first","affiliation":[{"name":"Faculty of Technical Sciences, Department of Communications and Signal Processing, University of Novi Sad, Trg Dositeja Obradovica 6, 21000 Novi Sad, Serbia"}]},{"given":"Nina","family":"Japund\u017ei\u0107-\u017digon","sequence":"additional","affiliation":[{"name":"Faculty of Medicine, University of Belgrade, dr Suboti\u0107a 8, 11000 Belgrade, Serbia"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1109\/JRPROC.1949.232969","article-title":"Communications in the presence of noise","volume":"37","author":"Shannon","year":"1949","journal-title":"Proc. IRE"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"656","DOI":"10.1002\/j.1538-7305.1949.tb00928.x","article-title":"Communication theory of secrecy systems","volume":"28","author":"Shannon","year":"1949","journal-title":"Bell Syst. Tech. J."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1109\/TIT.1953.1188559","article-title":"General treatment of the problem of coding","volume":"1","author":"Shannon","year":"1953","journal-title":"Trans. IRE Prof. Group Inf. Theory"},{"key":"ref_5","unstructured":"Sloane, N.J.A., and Wyner, A.D. (1993). Some Topics on Information Theory. Shannon: Collected Papers, Wiley."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1038\/scientificamerican0971-179","article-title":"Energy and information","volume":"225","author":"Tribus","year":"1971","journal-title":"Sci. Am."},{"key":"ref_7","unstructured":"Ivanov, N., Kolmogorov\u2019s, A.N., and Sinai, Y.G. (2020, September 19). Papers Introducing Entropy of Dynamical Systems. Available online: https:\/\/nikolaivivanov.files.wordpress.com\/2015\/05\/definitionentropy2014-20151.pdf."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2297","DOI":"10.1073\/pnas.88.6.2297","article-title":"Approximate entropy as a measure of system complexity","volume":"88","author":"Pincus","year":"1991","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"H2039","DOI":"10.1152\/ajpheart.2000.278.6.H2039","article-title":"Physiological time\u2212series analysis using approximate entropy and sample entropy","volume":"278","author":"Richman","year":"2000","journal-title":"Am. J. Physiol. Heart Circ. Physiol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1007\/s10439-012-0668-3","article-title":"The appropriate use of approximate entropy and sample entropy with short data sets","volume":"41","author":"Yentes","year":"2013","journal-title":"Ann. Biomed. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Li, A., Li, Y., Wang, T., and Niu, W. (2015, January 14\u201316). Medical image segmentation based on maximum entropy multi-threshold segmentation optimized by improved cuckoo search algorithm. Proceedings of the 2015 8th International Congress on Image and Signal. Processing (CISP), Shenyang, China.","DOI":"10.1109\/CISP.2015.7407926"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"997","DOI":"10.1016\/j.bbe.2021.05.010","article-title":"An automated skin melanoma detection system with melanoma-index based on entropy features","volume":"41","author":"Cheong","year":"2021","journal-title":"Biocybern. Biomed. Eng."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"55","DOI":"10.3389\/fncom.2018.00055","article-title":"Epileptic Seizure Prediction Based on Permutation Entropy","volume":"12","author":"Yanli","year":"2018","journal-title":"Front. Comput. Neurosci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1007\/BF02688699","article-title":"Approximate entropy and point correlation dimension of heart rate variability in healthy subjects","volume":"33","author":"Storella","year":"1998","journal-title":"Integr. Physiol. Behav. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"H244","DOI":"10.1152\/ajpheart.1996.271.1.H244","article-title":"Quantitative beat-to-beat analysis of heart rate dynamics during exercise","volume":"271","author":"Tulppo","year":"1996","journal-title":"Am. J. Physiol. Heart Circ. Physiol."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Krstacic, G., Gamberger, D., Krstacic, A., Smuc, T., and Milicic, D. (2008, January 14\u201317). The Chaos Theory and Non-linear Dynamics in Heart Rate Variability in Patients with Heart Failure. Proceedings of the Computers in Cardiology, Bologna, Italy.","DOI":"10.1109\/CIC.2008.4749202"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1111\/jdi.12270","article-title":"Cardiovascular autonomic function analysis using approximate entropy from 24-h heart rate variability and its frequency components in patients with type 2 diabetes","volume":"6","author":"Li","year":"2015","journal-title":"J. Diabetes Investig."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"667","DOI":"10.1016\/j.compbiomed.2012.03.003","article-title":"Unbiased entropy estimates in stress: A parameter study","volume":"42","author":"Boskovic","year":"2012","journal-title":"Comput. Biol. Med."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"8365685","DOI":"10.1155\/2017\/8365685","article-title":"On Consistency of Cross-Approximate Entropy in Cardiovascular and Artificial Environments","volume":"2017","author":"Skoric","year":"2017","journal-title":"Complexity"},{"key":"ref_20","first-page":"H1643","article-title":"Physiological time-series analysis: What does regularity quantify?","volume":"266","author":"Pincus","year":"1994","journal-title":"Am. J. Physiol."},{"key":"ref_21","unstructured":"Chen, X., Solomon, I.C., and Chon, K.H. (2005, January 17\u201318). Comparison of the use of approximate entropy and sample entropy: Application to neural respiratory signal. Proceedings of the 27th IEEE EMBS Annual Conference, Shanghai, China."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1966","DOI":"10.1109\/TBME.2008.919870","article-title":"Automatic selection of the threshold value r for approximate entropy","volume":"55","author":"Lu","year":"2008","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/MEMB.2009.934629","article-title":"Approximate entropy for all signals","volume":"28","author":"Chon","year":"2009","journal-title":"IEEE Eng. Med. Biol."},{"key":"ref_24","first-page":"561","article-title":"How the threshold \u201cR\u201d influences approximate entropy analysis of heart-rate variability","volume":"35","author":"Castiglioni","year":"2008","journal-title":"Comput. Cardiol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/j.physa.2014.04.041","article-title":"Maximum approximate entropy and r threshold: A new approach for regularity changes detection","volume":"409","author":"Restrepo","year":"2014","journal-title":"Physica A"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1016\/j.physa.2004.07.040","article-title":"Approximate entropy analysis of short-term HFECG based on wave mode","volume":"346","author":"Ninga","year":"2005","journal-title":"Physica A"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1186\/s12984-018-0465-9","article-title":"On the use of approximate entropy and sample entropy with center of pressure time-series","volume":"15","author":"Montesinos","year":"2018","journal-title":"J. NeuroEng. Rehabil."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1016\/j.physa.2006.10.077","article-title":"Revisiting sample entropy analysis","volume":"376","author":"Govindan","year":"2007","journal-title":"Physica A"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"3069","DOI":"10.1016\/j.physd.2008.06.005","article-title":"The effect of time delay on approximate and sample entropy calculations","volume":"237","author":"Kaffashi","year":"2008","journal-title":"Phys. D"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"710","DOI":"10.3389\/fphys.2018.00710","article-title":"Estimation of Complexity of Sampled Biomedical Continuous Time Signals Using Approximate Entropy","volume":"9","author":"Mesin","year":"2018","journal-title":"Front. Physiol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"759","DOI":"10.1007\/s11517-018-1920-2","article-title":"Sampling frequency influences sample entropy of kinematics during walking","volume":"57","author":"Raffalt","year":"2019","journal-title":"Med. Biol. Eng. Comput."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Espinosa, R., Talero, J., and Weinstein, A. (2020). Effects of Tau and Sampling Frequency on the Regularity Analysis of ECG and EEG Signals Using ApEn and SampEn Entropy Estimators. Entropy, 22.","DOI":"10.3390\/e22111298"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1016\/j.cmpb.2010.02.009","article-title":"Optimal parameters study for sample entropy-based atrial fibrillation organization analysis","volume":"99","author":"Alcaraz","year":"2010","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Knight, S.P., Newman, L., Scarlett, S., O\u2019Connor, J.D., Davis, J., De Looze, C., Kenny, R.A., and Romero-Ortuno, R. (2021). Associations between Cardiovascular Signal Entropy and Cognitive Performance over Eight Years. Entropy, 23.","DOI":"10.3390\/e23101337"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1109\/JSAC.1984.1146031","article-title":"Techniques for Estimating the Bit Error Rate in the Simulation of Digital Communication Systems","volume":"2","author":"Jeruchim","year":"1984","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_36","unstructured":"Dodge, Y. (2008). Kolmogorov\u2013Smirnov Test. The Concise Encyclopedia of Statistics, Springer."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Baji\u0107, D., Mi\u0161i\u0107, N., \u0160kori\u0107, T., Japund\u017ei\u0107-\u017digon, N., and Milovanovi\u0107, M. (2020). On Entropy of Probability Integral Transformed Time Series. Entropy, 22.","DOI":"10.3390\/e22101146"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"r1579","DOI":"10.1152\/ajpregu.00764.2005","article-title":"The role of central vasopressin receptors in the modulation of autonomic cardiovascular controls: A spectral analysis study","volume":"291","author":"Milutinovic","year":"2006","journal-title":"Am. J. Physiol. Regul. Integr."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1007\/s003990070035","article-title":"Nonlinear analysis of complex phenomena in cardiological data","volume":"11","author":"Wessel","year":"2000","journal-title":"Herzschr. Elektrophys."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1109\/10.979357","article-title":"An advanced detrending approach with application to HRV analysis","volume":"42","author":"Tarvainen","year":"2002","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_41","unstructured":"Bendat, J.S. (1986). Piersol, A.G. Random Data Analysis and Measurement Procedures, Wiley Series in Probability and Statistics."},{"key":"ref_42","unstructured":"Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology (1996). Heart rate variability: Standards of measurement, physiological interpretation and clinical use. Circulation, 93, 1043\u20131106."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Balaban, P., Jeruchim, M.C., and Shanmugan, K.S. (1992). Simulation of Communication Systems, Springer.","DOI":"10.1007\/978-1-4615-3298-9"},{"key":"ref_44","unstructured":"Proakis, J.G., and Manolakis, D.G. (1988). Introduction to Digital Signal Processing, Macmillan Publishing."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/1\/73\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:56:47Z","timestamp":1760169407000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/1\/73"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,31]]},"references-count":44,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["e24010073"],"URL":"https:\/\/doi.org\/10.3390\/e24010073","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2021,12,31]]}}}