{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,30]],"date-time":"2025-10-30T07:14:44Z","timestamp":1761808484807,"version":"build-2065373602"},"reference-count":43,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,24]],"date-time":"2021-12-24T00:00:00Z","timestamp":1640304000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Entropy-based methods have received considerable attention in the quantification of structural complexity of real-world systems. Among numerous empirical entropy algorithms, conditional entropy-based methods such as sample entropy, which are associated with amplitude distance calculation, are quite intuitive to interpret but require excessive data lengths for meaningful evaluation at large scales. To address this issue, we propose the variational embedding multiscale sample entropy (veMSE) method and conclusively demonstrate its ability to operate robustly, even with several times shorter data than the existing conditional entropy-based methods. The analysis reveals that veMSE also exhibits other desirable properties, such as the robustness to the variation in embedding dimension and noise resilience. For rigor, unlike the existing multivariate methods, the proposed veMSE assigns a different embedding dimension to every data channel, which makes its operation independent of channel permutation. The veMSE is tested on both stimulated and real world signals, and its performance is evaluated against the existing multivariate multiscale sample entropy methods. The proposed veMSE is also shown to exhibit computational advantages over the existing amplitude distance-based entropy methods.<\/jats:p>","DOI":"10.3390\/e24010026","type":"journal-article","created":{"date-parts":[[2021,12,24]],"date-time":"2021-12-24T08:38:46Z","timestamp":1640335126000},"page":"26","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Variational Embedding Multiscale Sample Entropy: A Tool for Complexity Analysis of Multichannel Systems"],"prefix":"10.3390","volume":"24","author":[{"given":"Hongjian","family":"Xiao","sequence":"first","affiliation":[{"name":"Department of Electrical and Electronic Engineering, Imperial College London, London SW7 2AZ, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8432-3963","authenticated-orcid":false,"given":"Danilo P.","family":"Mandic","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronic Engineering, Imperial College London, London SW7 2AZ, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Nakamura, T., Adjei, T., Alqurashi, Y., Looney, D., Morrell, M.J., and Mandic, D.P. (2017, January 14\u201319). Complexity science for sleep stage classification from EEG. Proceedings of the 2017 International Joint Conference on Neural Networks (IJCNN), Anchorage, AK, USA.","DOI":"10.1109\/IJCNN.2017.7966411"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"5419","DOI":"10.1109\/TII.2020.3022369","article-title":"Multiscale diversity entropy: A novel dynamical measure for fault diagnosis of rotating machinery","volume":"17","author":"Wang","year":"2020","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Lv, Y., Yuan, R., Wang, T., Li, H., and Song, G. (2018). Health degradation monitoring and early fault diagnosis of a rolling bearing based on CEEMDAN and improved MMSE. Materials, 11.","DOI":"10.3390\/ma11061009"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"754","DOI":"10.1109\/TR.2019.2896240","article-title":"Entropy based fault classification using the Case Western Reserve University data: A benchmark study","volume":"69","author":"Li","year":"2019","journal-title":"IEEE Trans. Reliab."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1007\/s10548-013-0278-x","article-title":"Age-related task sensitivity of frontal EEG entropy during encoding predicts retrieval","volume":"26","author":"Schinkel","year":"2013","journal-title":"Brain Topogr."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1186","DOI":"10.3390\/e14071186","article-title":"Multivariate multi-scale permutation entropy for complexity analysis of Alzheimer\u2019s disease EEG","volume":"14","author":"Morabito","year":"2012","journal-title":"Entropy"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Xiao, M.X., Wei, H.C., Xu, Y.J., Wu, H.T., and Sun, C.K. (2018). Combination of RR interval and crest time in assessing complexity using multiscale cross-approximate entropy in normal and diabetic subjects. Entropy, 20.","DOI":"10.3390\/e20070497"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2466","DOI":"10.1073\/pnas.012579499","article-title":"Fractal dynamics in physiology: Alterations with disease and aging","volume":"99","author":"Goldberger","year":"2002","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1016\/0167-2789(88)90081-4","article-title":"Approach to an irregular time series on the basis of the fractal theory","volume":"31","author":"Higuchi","year":"1988","journal-title":"Phys. D Nonlinear Phenom."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"965","DOI":"10.1152\/jappl.1994.76.2.965","article-title":"Dynamical assessment of physiological systems and states using recurrence plot strategies","volume":"76","author":"Zbilut","year":"1994","journal-title":"J. Appl. Physiol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"618743","DOI":"10.1155\/2013\/618743","article-title":"Analyzing EEG of quasi-brain-death based on dynamic sample entropy measures","volume":"2013","author":"Ni","year":"2013","journal-title":"Comput. Math. Methods Med."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Chanwimalueang, T., and Mandic, D.P. (2017). Cosine similarity entropy: Self-correlation-based complexity analysis of dynamical systems. Entropy, 19.","DOI":"10.3390\/e19120652"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1007\/s10558-007-9049-1","article-title":"Multiscale analysis of heart rate dynamics: Entropy and time irreversibility measures","volume":"8","author":"Costa","year":"2008","journal-title":"Cardiovasc. Eng."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.physa.2016.11.073","article-title":"Exploring stability of entropy analysis for signal with different trends","volume":"470","author":"Zhang","year":"2017","journal-title":"Phys. A Stat. Mech. Its Appl."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1016\/j.physa.2015.09.067","article-title":"Weighted permutation entropy based on different symbolic approaches for financial time series","volume":"443","author":"Yin","year":"2016","journal-title":"Phys. A Stat. Mech. Its Appl."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Azami, H., and Escudero, J. (2018). Amplitude-and fluctuation-based dispersion entropy. Entropy, 20.","DOI":"10.3390\/e20030210"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"174102","DOI":"10.1103\/PhysRevLett.88.174102","article-title":"Permutation entropy: A natural complexity measure for time series","volume":"88","author":"Bandt","year":"2002","journal-title":"Phys. Rev. Lett."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1109\/LSP.2016.2542881","article-title":"Dispersion entropy: A measure for time-series analysis","volume":"23","author":"Rostaghi","year":"2016","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2297","DOI":"10.1073\/pnas.88.6.2297","article-title":"Approximate entropy as a measure of system complexity","volume":"88","author":"Pincus","year":"1991","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"H2039","DOI":"10.1152\/ajpheart.2000.278.6.H2039","article-title":"Physiological time-series analysis using approximate entropy and sample entropy","volume":"278","author":"Richman","year":"2000","journal-title":"Am. J. Physiol. Heart Circ. Physiol."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"068102","DOI":"10.1103\/PhysRevLett.89.068102","article-title":"Multiscale entropy analysis of complex physiologic time series","volume":"89","author":"Costa","year":"2002","journal-title":"Phys. Rev. Lett."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2202","DOI":"10.1109\/TBME.2009.2021986","article-title":"Refined multiscale entropy: Application to 24-h holter recordings of heart period variability in healthy and aortic stenosis subjects","volume":"56","author":"Valencia","year":"2009","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1069","DOI":"10.3390\/e15031069","article-title":"Time series analysis using composite multiscale entropy","volume":"15","author":"Wu","year":"2013","journal-title":"Entropy"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1369","DOI":"10.1016\/j.physleta.2014.03.034","article-title":"Analysis of complex time series using refined composite multiscale entropy","volume":"378","author":"Wu","year":"2014","journal-title":"Phys. Lett. A"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"061918","DOI":"10.1103\/PhysRevE.84.061918","article-title":"Multivariate multiscale entropy: A tool for complexity analysis of multichannel data","volume":"84","author":"Ahmed","year":"2011","journal-title":"Phys. Rev. E"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Ahmed, M.U., Chanwimalueang, T., Thayyil, S., and Mandic, D.P. (2017). A multivariate multiscale fuzzy entropy algorithm with application to uterine EMG complexity analysis. Entropy, 19.","DOI":"10.3390\/e19010002"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1109\/TNSRE.2007.897025","article-title":"Characterization of surface EMG signal based on fuzzy entropy","volume":"15","author":"Chen","year":"2007","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"e744","DOI":"10.7717\/peerj-cs.744","article-title":"Prediction of epileptic seizures based on multivariate multiscale modified-distribution entropy","volume":"7","author":"Aung","year":"2021","journal-title":"PeerJ Comput. Sci."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Azami, H., Fern\u00e1ndez, A., and Escudero, J. (2019). Multivariate multiscale dispersion entropy of biomedical times series. Entropy, 21.","DOI":"10.3390\/e21090913"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"3109","DOI":"10.1109\/TIE.2021.3063979","article-title":"Variational embedding multiscale diversity entropy for fault diagnosis of large-scale machinery","volume":"69","author":"Wang","year":"2021","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_31","unstructured":"Alcaraz, R., Ab\u00e1solo, D., Hornero, R., and Rieta, J. (2010, January 16\u201320). Study of Sample Entropy ideal computational parameters in the estimation of atrial fibrillation organization from the ECG. Proceedings of the IEEE Conference on Computing in Cardiology, Granada, Spain."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1016\/j.compbiomed.2011.02.007","article-title":"Non-uniform multivariate embedding to assess the information transfer in cardiovascular and cardiorespiratory variability series","volume":"42","author":"Faes","year":"2012","journal-title":"Comput. Biol. Med."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"051112","DOI":"10.1103\/PhysRevE.83.051112","article-title":"Information-based detection of nonlinear Granger causality in multivariate processes via a nonuniform embedding technique","volume":"83","author":"Faes","year":"2011","journal-title":"Phys. Rev. E"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Porta, A., Faes, L., Bari, V., Marchi, A., Bassani, T., Nollo, G., Perseguini, N.M., Milan, J., Minatel, V., and Borghi-Silva, A. (2014). Effect of age on complexity and causality of the cardiovascular control: Comparison between model-based and model-free approaches. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0089463"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"016207","DOI":"10.1103\/PhysRevE.82.016207","article-title":"Nonuniform state-space reconstruction and coupling detection","volume":"82","author":"Vlachos","year":"2010","journal-title":"Phys. Rev. E"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"258701","DOI":"10.1103\/PhysRevLett.108.258701","article-title":"Escaping the curse of dimensionality in estimating multivariate transfer entropy","volume":"108","author":"Runge","year":"2012","journal-title":"Phys. Rev. Lett."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1063\/1.166141","article-title":"Quantification of scaling exponents and crossover phenomena in nonstationary heartbeat time series","volume":"5","author":"Peng","year":"1995","journal-title":"Chaos"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"3110","DOI":"10.3390\/e17053110","article-title":"The multiscale entropy algorithm and its variants: A review","volume":"17","year":"2015","journal-title":"Entropy"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1567","DOI":"10.1109\/JPROC.2012.2185009","article-title":"Evolving signal processing for brain\u2013computer interfaces","volume":"100","author":"Makeig","year":"2012","journal-title":"Proc. IEEE"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1209\/epl\/i2004-10188-3","article-title":"Long-term correlations and multifractality in surface wind speed","volume":"68","author":"Govindan","year":"2004","journal-title":"EPL"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"e215","DOI":"10.1161\/01.CIR.101.23.e215","article-title":"PhysioBank, PhysioToolkit, and PhysioNet: Components of a new research resource for complex physiologic signals","volume":"101","author":"Goldberger","year":"2000","journal-title":"Circulation"},{"key":"ref_42","first-page":"R1078","article-title":"Age-related alterations in the fractal scaling of cardiac interbeat interval dynamics","volume":"271","author":"Iyengar","year":"1996","journal-title":"Am. J. Physiol."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1806","DOI":"10.1001\/jama.1992.03480130122036","article-title":"Loss of \u2018complexity\u2019 and aging: Potential applications of fractals and chaos theory to senescence","volume":"267","author":"Lipsitz","year":"1992","journal-title":"J. Am. Med. Assoc."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/1\/26\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:52:44Z","timestamp":1760169164000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/1\/26"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,24]]},"references-count":43,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["e24010026"],"URL":"https:\/\/doi.org\/10.3390\/e24010026","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2021,12,24]]}}}