{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,20]],"date-time":"2025-10-20T10:29:37Z","timestamp":1760956177236,"version":"build-2065373602"},"reference-count":36,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2022,9,13]],"date-time":"2022-09-13T00:00:00Z","timestamp":1663027200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The extension of sample entropy methodologies to multivariate signals has received considerable attention, with traditional univariate entropy methods, such as sample entropy (SampEn) and fuzzy entropy (FuzzyEn), introduced to measure the complexity of chaotic systems in terms of irregularity and randomness. The corresponding multivariate methods, multivariate multiscale sample entropy (MMSE) and multivariate multiscale fuzzy entropy (MMFE), were developed to explore the structural richness within signals at high scales. However, the requirement of high scale limits the selection of embedding dimension and thus, the performance is unavoidably restricted by the trade-off between the data size and the required high scale. More importantly, the scale of interest in different situations is varying, yet little is known about the optimal setting of the scale range in MMSE and MMFE. To this end, we extend the univariate cosine similarity entropy (CSE) method to the multivariate case, and show that the resulting multivariate multiscale cosine similarity entropy (MMCSE) is capable of quantifying structural complexity through the degree of self-correlation within signals. The proposed approach relaxes the prohibitive constraints between the embedding dimension and data length, and aims to quantify the structural complexity based on the degree of self-correlation at low scales. The proposed MMCSE is applied to the examination of the complex and quaternion circularity properties of signals with varying correlation behaviors, and simulations show the MMCSE outperforming the standard methods, MMSE and MMFE.<\/jats:p>","DOI":"10.3390\/e24091287","type":"journal-article","created":{"date-parts":[[2022,9,13]],"date-time":"2022-09-13T21:06:52Z","timestamp":1663103212000},"page":"1287","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Multivariate Multiscale Cosine Similarity Entropy and Its Application to Examine Circularity Properties in Division Algebras"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1615-8174","authenticated-orcid":false,"given":"Hongjian","family":"Xiao","sequence":"first","affiliation":[{"name":"Department of Electrical and Electronic Engineering, Imperial College London, London SW7 2AZ, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4270-7683","authenticated-orcid":false,"given":"Theerasak","family":"Chanwimalueang","sequence":"additional","affiliation":[{"name":"Faculty of Engineering, Srinakharinwirot University, Nakhon Nayok 26120, Thailand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8432-3963","authenticated-orcid":false,"given":"Danilo P.","family":"Mandic","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronic Engineering, Imperial College London, London SW7 2AZ, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,9,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"66723","DOI":"10.1109\/ACCESS.2018.2873782","article-title":"The entropy algorithm and its variants in the fault diagnosis of rotating machinery: A review","volume":"6","author":"Li","year":"2018","journal-title":"IEEE Access"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1186","DOI":"10.3390\/e14071186","article-title":"Multivariate multi-scale permutation entropy for complexity analysis of Alzheimer\u2019s disease EEG","volume":"14","author":"Morabito","year":"2012","journal-title":"Entropy"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Marinescu, D.C. (2011). Classical and Quantum Information, Academic Press.","DOI":"10.1016\/B978-0-12-383874-2.00003-5"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_5","unstructured":"Blahut, R.E. (1987). Principles and Practice of Information Theory, Addison-Wesley Longman Publishing Co., Inc."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2297","DOI":"10.1073\/pnas.88.6.2297","article-title":"Approximate entropy as a measure of system complexity","volume":"88","author":"Pincus","year":"1991","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"H2039","DOI":"10.1152\/ajpheart.2000.278.6.H2039","article-title":"Physiological time-series analysis using approximate entropy and sample entropy","volume":"278","author":"Richman","year":"2000","journal-title":"Am. J. Physiol.-Heart Circ. Physiol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2364","DOI":"10.1109\/LSP.2015.2482603","article-title":"Refined composite multiscale permutation entropy to overcome multiscale permutation entropy length dependence","volume":"22","author":"Wu","year":"2015","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"618743","DOI":"10.1155\/2013\/618743","article-title":"Analyzing EEG of quasi-brain-death based on dynamic sample entropy measures","volume":"2013","author":"Ni","year":"2013","journal-title":"Comput. Math. Methods Med."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1016\/j.physa.2006.10.077","article-title":"Revisiting sample entropy analysis","volume":"376","author":"Govindan","year":"2007","journal-title":"Phys. A Stat. Mech. Its Appl."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Looney, D., Adjei, T., and Mandic, D.P. (2018). A novel multivariate sample entropy algorithm for modeling time series synchronization. Entropy, 20.","DOI":"10.3390\/e20020082"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Xiao, H., and Mandic, D.P. (2021). Variational embedding multiscale sample entropy: A tool for complexity analysis of multichannel systems. Entropy, 24.","DOI":"10.3390\/e24010026"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"20150199","DOI":"10.1098\/rsta.2015.0199","article-title":"Adaptive-projection intrinsically transformed multivariate empirical mode decomposition in cooperative brain\u2013computer interface applications","volume":"374","author":"Hemakom","year":"2016","journal-title":"Philos. Trans. R. Soc. A Math. Phys. Eng. Sci."},{"key":"ref_14","unstructured":"Alcaraz, R., Ab\u00e1solo, D., Hornero, R., and Rieta, J. (2010, January 26\u201329). Study of Sample Entropy ideal computational parameters in the estimation of atrial fibrillation organization from the ECG. Proceedings of the IEEE Conference on Computing in Cardiology, Belfast, UK."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Chanwimalueang, T., Aufegger, L., von Rosenberg, W., and Mandic, D.P. (2016, January 20\u201325). Modelling stress in public speaking: Evolution of stress levels during conference presentations. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Shanghai, China.","DOI":"10.1109\/ICASSP.2016.7471788"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1109\/TNSRE.2007.897025","article-title":"Characterization of surface EMG signal based on fuzzy entropy","volume":"15","author":"Chen","year":"2007","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"602","DOI":"10.1111\/j.1469-8986.2008.00654.x","article-title":"The pupil as a measure of emotional arousal and autonomic activation","volume":"45","author":"Bradley","year":"2008","journal-title":"Psychophysiology"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Chanwimalueang, T., and Mandic, D.P. (2017). Cosine Similarity Entropy: Self-Correlation-Based Complexity Analysis of Dynamical Systems. Entropy, 19.","DOI":"10.3390\/e19120652"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"061918","DOI":"10.1103\/PhysRevE.84.061918","article-title":"Multivariate multiscale entropy: A tool for complexity analysis of multichannel data","volume":"84","author":"Ahmed","year":"2011","journal-title":"Phys. Rev. E"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"068102","DOI":"10.1103\/PhysRevLett.89.068102","article-title":"Multiscale entropy analysis of complex physiologic time series","volume":"89","author":"Costa","year":"2002","journal-title":"Phys. Rev. Lett."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2202","DOI":"10.1109\/TBME.2009.2021986","article-title":"Refined multiscale entropy: Application to 24-h holter recordings of heart period variability in healthy and aortic stenosis subjects","volume":"56","author":"Valencia","year":"2009","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_22","first-page":"433","article-title":"Dynamical complexity of human responses: A multivariate data-adaptive framework","volume":"60","author":"Ahmed","year":"2012","journal-title":"Bull. Pol. Acad. Sci. Tech. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1069","DOI":"10.3390\/e15031069","article-title":"Time series analysis using composite multiscale entropy","volume":"15","author":"Wu","year":"2013","journal-title":"Entropy"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1197","DOI":"10.3390\/e17031197","article-title":"Generalized multiscale entropy analysis: Application to quantifying the complex volatility of human heartbeat time series","volume":"17","author":"Costa","year":"2015","journal-title":"Entropy"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1109\/LSP.2006.888089","article-title":"Intrinsic mode entropy for nonlinear discriminant analysis","volume":"14","author":"Amoud","year":"2007","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Ahmed, M.U., Chanwimalueang, T., Thayyil, S., and Mandic, D.P. (2017). A multivariate multiscale fuzzy entropy algorithm with application to uterine EMG complexity analysis. Entropy, 19.","DOI":"10.3390\/e19010002"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1007\/s10558-007-9049-1","article-title":"Multiscale analysis of heart rate dynamics: Entropy and time irreversibility measures","volume":"8","author":"Costa","year":"2008","journal-title":"Cardiovasc. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Takens, F. (1981). Detecting strange attractors in turbulence. Dynamical Systems and Turbulence, Warwick 1980, Springer.","DOI":"10.1007\/BFb0091924"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"026113","DOI":"10.1063\/1.3147408","article-title":"Gait dynamics in Parkinson\u2019s disease: Common and distinct behavior among stride length, gait variability, and fractal-like scaling","volume":"19","author":"Hausdorff","year":"2009","journal-title":"Chaos Interdiscip. J. Nonlinear Sci."},{"key":"ref_30","unstructured":"Gautama, T., Mandic, D.P., and Van Hulle, M.M. (2003, January 6\u201310). A differential entropy based method for determining the optimal embedding parameters of a signal. Proceedings of the 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP\u201903), Hong Kong, China."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Menayo, R., Manzanares, A., and Segado, F. (2018). Complexity, Regularity and Non-Linear Behavior in Human Eye Movements: Analyzing the Dynamics of Gaze in Virtual Sailing Programs. Symmetry, 10.","DOI":"10.20944\/preprints201803.0162.v1"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1080\/07474930801959750","article-title":"Approximate entropy as an irregularity measure for financial data","volume":"27","author":"Pincus","year":"2008","journal-title":"Econom. Rev."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1016\/0167-2789(95)90079-9","article-title":"Testing for nonlinearity using redundancies: Quantitative and qualitative aspects","volume":"80","year":"1995","journal-title":"Phys. D Nonlinear Phenom."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1093\/oxfordjournals.eurheartj.a014868","article-title":"Heart rate variability: Standards of measurement, physiological interpretation, and clinical use","volume":"17","author":"Malik","year":"1996","journal-title":"Eur. Heart J."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"360","DOI":"10.3389\/fphys.2017.00360","article-title":"Resolving ambiguities in the LF\/HF ratio: LF-HF scatter plots for the categorization of mental and physical stress from HRV","volume":"8","author":"Chanwimalueang","year":"2017","journal-title":"Front. Physiol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v031.i10","article-title":"CircStat: A MATLAB toolbox for circular statistics","volume":"31","author":"Berens","year":"2009","journal-title":"J. Stat. Softw."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/9\/1287\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:30:17Z","timestamp":1760142617000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/9\/1287"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,13]]},"references-count":36,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["e24091287"],"URL":"https:\/\/doi.org\/10.3390\/e24091287","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2022,9,13]]}}}