{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T03:20:37Z","timestamp":1776309637025,"version":"3.50.1"},"reference-count":59,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2020,10,12]],"date-time":"2020-10-12T00:00:00Z","timestamp":1602460800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The goal of this paper is to investigate the changes of entropy estimates when the amplitude distribution of the time series is equalized using the probability integral transformation. The data we analyzed were with known properties\u2014pseudo-random signals with known distributions, mutually coupled using statistical or deterministic methods that include generators of statistically dependent distributions, linear and non-linear transforms, and deterministic chaos. The signal pairs were coupled using a correlation coefficient ranging from zero to one. The dependence of the signal samples is achieved by moving average filter and non-linear equations. The applied coupling methods are checked using statistical tests for correlation. The changes in signal regularity are checked by a multifractal spectrum. The probability integral transformation is then applied to cardiovascular time series\u2014systolic blood pressure and pulse interval\u2014acquired from the laboratory animals and represented the results of entropy estimations. We derived an expression for the reference value of entropy in the probability integral transformed signals. We also experimentally evaluated the reliability of entropy estimates concerning the matching probabilities.<\/jats:p>","DOI":"10.3390\/e22101146","type":"journal-article","created":{"date-parts":[[2020,10,12]],"date-time":"2020-10-12T10:18:00Z","timestamp":1602497880000},"page":"1146","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["On Entropy of Probability Integral Transformed Time Series"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4662-7939","authenticated-orcid":false,"given":"Dragana","family":"Baji\u0107","sequence":"first","affiliation":[{"name":"Faculty of Technical Sciences, University of Novi Sad, 21000 Novi Sad, Serbia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8177-5734","authenticated-orcid":false,"given":"Nata\u0161a","family":"Mi\u0161i\u0107","sequence":"additional","affiliation":[{"name":"Research and Development Institute Lola Ltd., 11000 Belgrade, Serbia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9325-1869","authenticated-orcid":false,"given":"Tamara","family":"\u0160kori\u0107","sequence":"additional","affiliation":[{"name":"Faculty of Technical Sciences, University of Novi Sad, 21000 Novi Sad, Serbia"}]},{"given":"Nina","family":"Japund\u017ei\u0107-\u017digon","sequence":"additional","affiliation":[{"name":"Faculty of Medicine, University of Belgrade, 11000 Belgrade, Serbia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2909-451X","authenticated-orcid":false,"given":"Milo\u0161","family":"Milovanovi\u0107","sequence":"additional","affiliation":[{"name":"Mathematical Institute of the Serbian Academy of Sciences and Arts, 11000 Beograd, Serbia"}]}],"member":"1968","published-online":{"date-parts":[[2020,10,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1002\/j.1538-7305.1948.tb00917.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1109\/JRPROC.1949.232969","article-title":"Communications in the presence of noise","volume":"37","author":"Shannon","year":"1949","journal-title":"Proc. IRE"},{"key":"ref_3","unstructured":"Gustavo, D., and Bernd, S. (2012). Information Dynamics: Foundations and Applications, Springer. [1st ed.]."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2591","DOI":"10.1103\/PhysRevA.28.2591","article-title":"Estimation of the Kolmogorov entropy from a chaotic signal","volume":"28","author":"Grassberger","year":"1983","journal-title":"Phys. Rev. A"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1103\/RevModPhys.57.617","article-title":"Ergodic theory of chaos and strange attractors","volume":"57","author":"Eckmann","year":"1985","journal-title":"Rev. Mod. Phys."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2297","DOI":"10.1073\/pnas.88.6.2297","article-title":"Approximate entropy as a measure of system complexity","volume":"88","author":"Pincus","year":"1991","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"H2039","DOI":"10.1152\/ajpheart.2000.278.6.H2039","article-title":"Physiological time\u2212series analysis using approximate entropy and sample entropy","volume":"278","author":"Richman","year":"2000","journal-title":"Am. J. Physiol. Heart Circ. Physiol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1007\/s10439-012-0668-3","article-title":"The appropriate use of approximate entropy and sample entropy with short data sets","volume":"41","author":"Yentes","year":"2013","journal-title":"Ann. Biomed. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Jelinek, H.F., Cornforth, D.J., and Khandoker, A.H. (2017). ECG Time Series Variability Analysis: Engineering and Medicine, CRC Press, Taylor & Francis Group. [1st ed.].","DOI":"10.4324\/9781315372921"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1111\/jdi.12270","article-title":"Cardiovascular autonomic function analysis using approximate entropy from 24-h heart rate variability and its frequency components in patients with type 2 diabetes","volume":"6","author":"Li","year":"2015","journal-title":"J. Diabetes Investig."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Krstacic, G., Gamberger, D., Krstacic, A., Smuc, T., and Milicic, D. (2008, January 14\u201317). The chaos theory and non-linear dynamics in heart rate variability in patients with heart failure. Proceedings of the Computers in Cardiology, Bologna, Italy.","DOI":"10.1109\/CIC.2008.4749202"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1007\/BF02688699","article-title":"Approximate entropy and point correlation dimension of heart rate variability in healthy subjects","volume":"33","author":"Storella","year":"1998","journal-title":"Integr. Psychol. Behav. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"H244","DOI":"10.1152\/ajpheart.1996.271.1.H244","article-title":"Quantitative beat-to-beat analysis of heart rate dynamics during exercise","volume":"271","author":"Tulppo","year":"1996","journal-title":"Am. J. Physiol. Heart Circ. Physiol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"667","DOI":"10.1016\/j.compbiomed.2012.03.003","article-title":"Unbiased entropy estimates in stress: A parameter study","volume":"42","author":"Boskovic","year":"2012","journal-title":"Comput. Biol. Med."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1700","DOI":"10.1016\/0735-1097(94)90177-5","article-title":"Gender- and age-related differences in heart rate dynamics: Are women more complex than men?","volume":"24","author":"Ryan","year":"1994","journal-title":"J. Am. Coll. Cardiol."},{"key":"ref_16","first-page":"145","article-title":"Age dependency and correlation of heart rate variability, blood pressure variability and baroreflex sensitivity","volume":"7","author":"Wang","year":"2000","journal-title":"J. Gravit. Physiol."},{"key":"ref_17","first-page":"39","article-title":"The deterministic chaos in heart rate variability signal and analysis techniques","volume":"35","author":"Sunkaria","year":"2011","journal-title":"Int. J. Comput. Appl."},{"key":"ref_18","first-page":"1","article-title":"Cardiac variability time-series analysis by sample entropy and multiscale entropy","volume":"7","author":"Marwaha","year":"2015","journal-title":"Int. J. Med. Eng. Inform."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1320","DOI":"10.7150\/ijbs.19462","article-title":"Complexity change in cardiovascular disease","volume":"13","author":"Chen","year":"2017","journal-title":"Int. J. Biol. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"380","DOI":"10.1016\/j.jcrc.2007.04.006","article-title":"Investigation of heart rate and blood pressure variability, baroreflex sensitivity, and approximate entropy in acute brain injury patients","volume":"23","author":"Papaioannou","year":"2008","journal-title":"J. Crit. Care"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"14100","DOI":"10.1073\/pnas.93.24.14100","article-title":"Older males secrete lutenizing hormone and testosterone more irregularly, and jointly more asynchronously than younger males","volume":"93","author":"Pincus","year":"1996","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Skoric, T., Sarenac, O., Milovanovic, B., Japundzic-Zigon, N., and Bajic, D. (2017). On consistency of cross-approximate entropy in cardiovascular and artificial environments. Complexity, 1\u201315.","DOI":"10.1155\/2017\/8365685"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Lin, T.-K., and Chien, Y.-H. (2019). Performance evaluation of an entropy-based structural health monitoring system utilizing composite multiscale cross-sample entropy. Entropy, 21.","DOI":"10.3390\/e21010041"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Castiglioni, P., Parati, G., and Faini, A. (2019). Information-domain analysis of cardiovascular complexity: Night and day modulations of entropy and the effects of hypertension. Entropy, 21.","DOI":"10.3390\/e21060550"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/MEMB.2009.934629","article-title":"Approximate entropy for all signals","volume":"28","author":"Chon","year":"2009","journal-title":"IEEE Eng. Med. Biol. Mag."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1966","DOI":"10.1109\/TBME.2008.919870","article-title":"Automatic selection of the threshold value r for approximate entropy","volume":"55","author":"Lu","year":"2008","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3069","DOI":"10.1016\/j.physd.2008.06.005","article-title":"The effect of time delay on approximate and sample entropy calculations","volume":"237","author":"Kaffashi","year":"2008","journal-title":"Physica D"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1007\/s004220050414","article-title":"Measuring regularity by means of a correctesconditional entropy in sympathetic outflow","volume":"78","author":"Porta","year":"1998","journal-title":"Biol. Cybern."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1103\/PhysRevE.71.021906","article-title":"Multiscale entropy analysis of biological signals","volume":"71","author":"Costa","year":"2005","journal-title":"Phys. Rev. E"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1109\/TNSRE.2007.897025","article-title":"Characterization of surface EMG signal based on fuzzy entropy","volume":"15","author":"Chen","year":"2007","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Szczesna, A. (2019). Quaternion entropy for analysis of gait data. Entropy, 21.","DOI":"10.3390\/e21010079"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"100265","DOI":"10.1016\/j.softx.2019.100265","article-title":"RTransferEntropy\u2014Quantifying information flow between different time series using effective transfer entropy","volume":"10","author":"Behrendt","year":"2019","journal-title":"SoftwareX"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Delgado-Bonal, A., and Marshak, A. (2019). Approximate entropy and sample entropy: A comprehensive tutorial. Entropy, 21.","DOI":"10.3390\/e21060541"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1016\/j.bspc.2018.03.007","article-title":"Copula as a dynamic measure of cardiovascular signal interactions","volume":"43","author":"Jovanovic","year":"2018","journal-title":"Biomed. Signal Process Control"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1007\/s00186-013-0436-7","article-title":"A note on generalized inverses","volume":"77","author":"Embrechts","year":"2013","journal-title":"Math. Methods Oper. Res."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1038\/261459a0","article-title":"Simple mathematical models with very complicated dynamics","volume":"261","author":"May","year":"1976","journal-title":"Nature"},{"key":"ref_37","unstructured":"Pappoulis, A., and Pillai, U. (2002). Probability, Random Variables and Stochastic Processes, McGraw-Hill. [4th ed.]."},{"key":"ref_38","first-page":"229","article-title":"Fonctions de r\u00e9partition \u00e0 n dimensions et leurs marges","volume":"8","author":"Sklar","year":"1959","journal-title":"Publ. del\u2019Inst. Stat. Univ. Paris"},{"key":"ref_39","unstructured":"Nelsen, R.B. (2007). An Introduction to Copulas, Springer Science & Business Media. [2nd ed.]."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1016\/j.insmatheco.2007.02.001","article-title":"Pair-copula constructions of multiple dependence","volume":"44","author":"Aas","year":"2009","journal-title":"Insur. Math. Econ."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Zheng, C., Egan, M., Clavier, L., Peters, G., and Gorce, J.-M. (2019, January 20\u201324). Copula-based interference models for IoT wireless networks. Proceedings of the ICC 2019\u201453rd IEEE International Conference on Communications, Shanghai, China.","DOI":"10.1109\/ICC.2019.8761783"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"04017137","DOI":"10.1061\/(ASCE)ST.1943-541X.0001835","article-title":"Reliability of tower and tower-line systems under spatiotemporally varying wind or earthquake loads","volume":"143","author":"Yang","year":"2017","journal-title":"J. Struct. Eng."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s00190-020-01354-y","article-title":"A new hybrid method to improve the ultra-short-term prediction of LOD","volume":"94","author":"Modiri","year":"2020","journal-title":"J. Geod."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1399","DOI":"10.1007\/s00704-018-2447-z","article-title":"Joint distribution of temperature and precipitation in the Mediterranean, using the Copula method","volume":"135","author":"Lazoglou","year":"2019","journal-title":"Theor. Appl. Climatol."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Iyengar, S.G., Dauwels, J., Varshney, P.K., and Cichocki, A. (2010). Quantifying EEG synchrony using copulas. Proc. IEEE Int. Conf. Acoust. Speech Signal Process., 505\u2013508.","DOI":"10.1109\/ICASSP.2010.5495664"},{"key":"ref_46","first-page":"231762","article-title":"Multiscale Cross-Approximate Entropy Analysis as a Measurement of Complexity between ECG R-R Interval and PPG Pulse Amplitude Series among the Normal and Diabetic Subjects","volume":"2013","author":"Wu","year":"2013","journal-title":"Comput. Math. Methods Med."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1109\/10.979357","article-title":"An advanced detrending approach with application to HRV analysis","volume":"42","author":"Tarvainen","year":"2002","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1029\/2011WR011419","article-title":"Entropy-copula method for single-site monthly streamflow simulation","volume":"48","author":"Hao","year":"2012","journal-title":"Water Resour. Res."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/S1007-0214(11)70008-6","article-title":"Mutual information is copula entropy","volume":"16","author":"Ma","year":"2011","journal-title":"Tsinghua Sci. Technol."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1541","DOI":"10.1002\/hbm.23471","article-title":"A statistical framework for neuroimaging data analysis based on mutual information estimated via a gaussian copula","volume":"38","author":"Ince","year":"2017","journal-title":"Hum. Brain Mapp."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"H1682","DOI":"10.1152\/ajpheart.1995.268.4.H1682","article-title":"Methodology of spontaneous baroreflex relationship assessed by surrogate data analysis","volume":"268","author":"Blaber","year":"1995","journal-title":"Am. J. Physiol. Heart Circ. Physiol."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1016\/j.compbiomed.2016.11.019","article-title":"Binarized cross-approximate entropy in crowdsensing environment","volume":"80","author":"Skoric","year":"2017","journal-title":"Comput. Biol. Med."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Agresti, A. (2010). Analysis of Ordinal Categorical Data, John Wiley & Sons. [2nd ed.].","DOI":"10.1002\/9780470594001"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"053114","DOI":"10.1103\/PhysRevE.99.053114","article-title":"Local estimates of H\u00f6lder exponents in turbulent vector fields","volume":"99","author":"Nguyen","year":"2019","journal-title":"Phys. Rev. E"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1113\/expphysiol.2010.055970","article-title":"Autonomic mechanisms underpinning the stress response in borderline hypertensive rats","volume":"96","author":"Sarenac","year":"2011","journal-title":"Exp. Physiol."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"3325","DOI":"10.1142\/S0218127407019093","article-title":"Nonlinear methods of cardiovascular physics and their clinical applicability","volume":"17","author":"Wessel","year":"2007","journal-title":"Int. J. Bifurc. Chaos"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1109\/MEMB.2002.1032644","article-title":"Dimensional analysis of HRV in hypertrophic cardiomyopathy patients","volume":"21","author":"Carvajal","year":"2002","journal-title":"IEEE Eng. Med. Biol. Mag."},{"key":"ref_58","unstructured":"Bendat, J.S., and Piersol, A.G. (1986). Random Data Analysis and Measurement Procedures, John Wiley & Sons."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1109\/JSAC.1984.1146031","article-title":"Techniques for estimating the bit error rate in the simulation of digital communication systems","volume":"2","author":"Jeruchim","year":"1984","journal-title":"IEEE J. Sel. Areas Commun."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/10\/1146\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:19:45Z","timestamp":1760177985000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/10\/1146"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,12]]},"references-count":59,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2020,10]]}},"alternative-id":["e22101146"],"URL":"https:\/\/doi.org\/10.3390\/e22101146","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10,12]]}}}