{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T15:19:20Z","timestamp":1770736760851,"version":"3.49.0"},"reference-count":33,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2017,10,18]],"date-time":"2017-10-18T00:00:00Z","timestamp":1508284800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Healthy systems exhibit complex dynamics on the changing of information embedded in physiologic signals on multiple time scales that can be quantified by employing multiscale entropy (MSE) analysis. Here, we propose a measure of complexity, called entropy of entropy (EoE) analysis. The analysis combines the features of MSE and an alternate measure of information, called superinformation, useful for DNA sequences. In this work, we apply the hybrid analysis to the cardiac interbeat interval time series. We find that the EoE value is significantly higher for the healthy than the pathologic groups. Particularly, short time series of 70 heart beats is sufficient for EoE analysis with an accuracy of 81% and longer series of 500 beats results in an accuracy of 90%. In addition, the EoE versus Shannon entropy plot of heart rate time series exhibits an inverted U relationship with the maximal EoE value appearing in the middle of extreme order and disorder.<\/jats:p>","DOI":"10.3390\/e19100550","type":"journal-article","created":{"date-parts":[[2017,10,18]],"date-time":"2017-10-18T11:10:00Z","timestamp":1508325000000},"page":"550","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":41,"title":["Entropy of Entropy: Measurement of Dynamical Complexity for Biological Systems"],"prefix":"10.3390","volume":"19","author":[{"given":"Chang","family":"Hsu","sequence":"first","affiliation":[{"name":"Department of Electrophyics, National Chiao Tung University, Hsinchu 30010, Taiwan"}]},{"given":"Sung-Yang","family":"Wei","sequence":"additional","affiliation":[{"name":"Department of Electrophyics, National Chiao Tung University, Hsinchu 30010, Taiwan"}]},{"given":"Han-Ping","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Electrophyics, National Chiao Tung University, Hsinchu 30010, Taiwan"}]},{"given":"Long","family":"Hsu","sequence":"additional","affiliation":[{"name":"Department of Electrophyics, National Chiao Tung University, Hsinchu 30010, Taiwan"}]},{"given":"Sien","family":"Chi","sequence":"additional","affiliation":[{"name":"Department of Photonics, National Chiao Tung University, Hsinchu 30010, Taiwan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3666-9833","authenticated-orcid":false,"given":"Chung-Kang","family":"Peng","sequence":"additional","affiliation":[{"name":"Division of Interdisciplinary Medicine and Biotechnology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA 02215, USA"}]}],"member":"1968","published-online":{"date-parts":[[2017,10,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Mitchell, M. (2009). Complexity A Guided Tour, Oxford University Press.","DOI":"10.1093\/oso\/9780195124415.001.0001"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"68102","DOI":"10.1103\/PhysRevLett.89.068102","article-title":"Multiscale entropy analysis of complex physiologic time series","volume":"89","author":"Costa","year":"2002","journal-title":"Phys. Rev. Lett."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1103\/PhysRevE.71.021906","article-title":"Multiscale entropy analysis of biological signals","volume":"71","author":"Costa","year":"2005","journal-title":"Phys. Rev. E"},{"key":"ref_4","first-page":"61","article-title":"Adaptive data analysis of complex fluctuations in physiologic time series","volume":"1","author":"Peng","year":"2009","journal-title":"World Sci."},{"key":"ref_5","first-page":"16","article-title":"What is complexity","volume":"1","year":"1995","journal-title":"Complexity"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"376","DOI":"10.1016\/0167-2789(86)90308-1","article-title":"Complexity and Adaptation","volume":"22","author":"Huberman","year":"1986","journal-title":"Physica D"},{"key":"ref_7","first-page":"971","article-title":"Complexity and 1\/f noise. A phase space approach","volume":"1","author":"Zhang","year":"1991","journal-title":"J. Phys. I EDP Sci."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/j.physa.2014.12.011","article-title":"Multiscale entropy-based methods for heart rate variability complexity analysis","volume":"422","author":"Silva","year":"2015","journal-title":"Physica A"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Beisbart, C., and Hartmann, S. (2011). Probabilities in Physics, Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780199577439.001.0001"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1002\/j.1538-7305.1951.tb01366.x","article-title":"Prediction and ntropy of printed english","volume":"30","author":"Shannon","year":"1951","journal-title":"Bell Syst. Tech. J."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A Mathematical Theory of Communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_12","first-page":"2297","article-title":"Approximate entropy as a measure of system complexity","volume":"88","author":"Pincus","year":"1991","journal-title":"Mathematics"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"H2039","DOI":"10.1152\/ajpheart.2000.278.6.H2039","article-title":"Physiological time-series analysis using approximate entropy and sample entropy","volume":"278","author":"Richman","year":"2000","journal-title":"Am. J. Physiol. Hear. Circ. Physiol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1016\/j.medengphy.2008.04.005","article-title":"Measuring complexity using FuzzyEn, ApEn, and SampEn","volume":"31","author":"Chen","year":"2009","journal-title":"Med. Eng. Phys."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"174102","DOI":"10.1103\/PhysRevLett.88.174102","article-title":"Permutation Entropy: A Natural Complexity Measure for Time Series","volume":"88","author":"Bandt","year":"2002","journal-title":"Phys. Rev. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1088\/0967-3334\/34\/1\/17","article-title":"K-nearest-neighbor conditional entropy approach for the assessment of the short-term complexity of cardiovascular control","volume":"34","author":"Porta","year":"2013","journal-title":"Physiol. Meas."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"58001","DOI":"10.1209\/0295-5075\/107\/58001","article-title":"A dynamic marker of very short-term heartbeat under pathological states via network analysis","volume":"107","author":"Hou","year":"2014","journal-title":"Europhys. Lett."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1103\/PhysRevE.83.051918","article-title":"Alternate measure of information useful for DNA sequences","volume":"83","author":"Bose","year":"2011","journal-title":"Phys. Rev. E"},{"key":"ref_19","unstructured":"(2016, December 05). BIDMC Congestive Heart Failure Database, MIT-BIH Normal Sinus Rhythm Database, and Long Term AF Database. Available online: http:\/\/www.physionet.org\/physiobank\/database\/#ecg."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1016\/j.bspc.2016.08.014","article-title":"Multi-scale transitions of fuzzy sample entropy of RR-intervals and their phase-randomized surrogates: A possibility to diagnose congestive heart failure","volume":"31","author":"VonTscharner","year":"2017","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Liu, C., and Gao, R. (2017). Multiscale entropy analysis of the differential RR interval time series signal and its application in detecting congestive heart failure. Entropy, 19.","DOI":"10.3390\/e19060251"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1016\/S0735-1097(00)01156-6","article-title":"Utility of b-type natriuretic peptide in the diagnosis of congestive heart failure in an urgent-care setting","volume":"37","author":"Dao","year":"2001","journal-title":"J. Am. Coll. Cardiol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"548","DOI":"10.1186\/s13054-014-0548-3","article-title":"Multi-scale symbolic entropy analysis provides prognostic prediction in patients receiving extracorporeal life support","volume":"18","author":"Lin","year":"2014","journal-title":"Crit. Care"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Costa, M., Goldberger, A.L., and Peng, C.-K. (2005). Broken asymmetry of the human heartbeat: Loss of time irreversibility in aging and disease. Phys. Rev. Lett., 95.","DOI":"10.1103\/PhysRevLett.95.198102"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1016\/j.neuroimage.2010.02.009","article-title":"Antipsychotics reverse abnormal EEG complexity in drug-naive schizophrenia: A multiscale entropy analysis","volume":"51","author":"Takahashi","year":"2010","journal-title":"Neuroimage"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1016\/j.neubiorev.2013.02.015","article-title":"Moment-to-moment brain signal variability: A next frontier in human brain mapping?","volume":"37","author":"Garrett","year":"2013","journal-title":"Neurosci. Biobehav. Rev."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1016\/j.neuroimage.2013.12.048","article-title":"NeuroImage Revealing the brains adaptability and the transcranial direct current stimulation facilitating effect in inhibitory control by multiscale entropy","volume":"90","author":"Liang","year":"2014","journal-title":"Neuroimage"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"428","DOI":"10.1016\/j.neurobiolaging.2012.05.004","article-title":"Complexity of spontaneous BOLD activity in default mode network is correlated with cognitive function in normal male elderly: A multiscale entropy analysis","volume":"34","author":"Yang","year":"2013","journal-title":"Neurobiol. Aging"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1016\/j.neuroimage.2013.04.055","article-title":"Bottom up modeling of the connectome: Linking structure and function in the resting brain and their changes in aging","volume":"80","author":"Nakagawa","year":"2013","journal-title":"Neuroimage"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1016\/j.neuroscience.2004.11.013","article-title":"Long-range temporal correlations in the spontaneous spiking of neurons in the hippocampal-amygdala complex of humans","volume":"131","author":"Bhattacharya","year":"2005","journal-title":"Neuroscience"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2157","DOI":"10.3390\/e14112157","article-title":"Multivariate multiscale entropy applied to center of pressure signals analysis: An effect of vibration stimulation of shoes","volume":"14","author":"Wei","year":"2012","journal-title":"Entropy"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1304","DOI":"10.1093\/gerona\/glp113","article-title":"Frailty and the degradation of complex balance dynamics during a dual-task protocol","volume":"64","author":"Kang","year":"2009","journal-title":"J. Gerontol.-Ser. A Biol. Sci. Med. Sci."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Lu, C.-W., Czosnyka, M., Shieh, J.-S., Smielewska, A., Pickard, J.D., and Smielewski, P. (2012). Complexity of intracranial pressure correlates with outcome after traumatic brain injury. Brain, aws155.","DOI":"10.1093\/brain\/aws155"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/19\/10\/550\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:47:47Z","timestamp":1760208467000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/19\/10\/550"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,10,18]]},"references-count":33,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2017,10]]}},"alternative-id":["e19100550"],"URL":"https:\/\/doi.org\/10.3390\/e19100550","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,10,18]]}}}