{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,4]],"date-time":"2026-04-04T01:17:48Z","timestamp":1775265468833,"version":"3.50.1"},"reference-count":51,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2018,11,6]],"date-time":"2018-11-06T00:00:00Z","timestamp":1541462400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Many entropy-related methods for signal classification have been proposed and exploited successfully in the last several decades. However, it is sometimes difficult to find the optimal measure and the optimal parameter configuration for a specific purpose or context. Suboptimal settings may therefore produce subpar results and not even reach the desired level of significance. In order to increase the signal classification accuracy in these suboptimal situations, this paper proposes statistical models created with uncorrelated measures that exploit the possible synergies between them. The methods employed are permutation entropy (PE), approximate entropy (ApEn), and sample entropy (SampEn). Since PE is based on subpattern ordinal differences, whereas ApEn and SampEn are based on subpattern amplitude differences, we hypothesized that a combination of PE with another method would enhance the individual performance of any of them. The dataset was composed of body temperature records, for which we did not obtain a classification accuracy above 80% with a single measure, in this study or even in previous studies. The results confirmed that the classification accuracy rose up to 90% when combining PE and ApEn with a logistic model.<\/jats:p>","DOI":"10.3390\/e20110853","type":"journal-article","created":{"date-parts":[[2018,11,7]],"date-time":"2018-11-07T03:45:22Z","timestamp":1541562322000},"page":"853","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Model Selection for Body Temperature Signal Classification Using Both Amplitude and Ordinality-Based Entropy Measures"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0076-0515","authenticated-orcid":false,"given":"David","family":"Cuesta-Frau","sequence":"first","affiliation":[{"name":"Technological Institute of Informatics, Universitat Polit\u00e8cnica de Val\u00e8ncia, 03801 Alcoi Campus, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pau","family":"Mir\u00f3-Mart\u00ednez","sequence":"additional","affiliation":[{"name":"Department of Statistics, Universitat Polit\u00e8cnica de Val\u00e8ncia, 03801 Alcoi Campus, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1995-2557","authenticated-orcid":false,"given":"Sandra","family":"Oltra-Crespo","sequence":"additional","affiliation":[{"name":"Technological Institute of Informatics, Universitat Polit\u00e8cnica de Val\u00e8ncia, 03801 Alcoi Campus, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8178-9987","authenticated-orcid":false,"given":"Jorge","family":"Jord\u00e1n-N\u00fa\u00f1ez","sequence":"additional","affiliation":[{"name":"Department of Statistics, Universitat Polit\u00e8cnica de Val\u00e8ncia, 03801 Alcoi Campus, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5553-8372","authenticated-orcid":false,"given":"Borja","family":"Vargas","sequence":"additional","affiliation":[{"name":"Internal Medicine Department, Teaching Hospital of M\u00f3stoles, 28935 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paula","family":"Gonz\u00e1lez","sequence":"additional","affiliation":[{"name":"Internal Medicine Department, Teaching Hospital of M\u00f3stoles, 28935 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Manuel","family":"Varela-Entrecanales","sequence":"additional","affiliation":[{"name":"Internal Medicine Department, Teaching Hospital of M\u00f3stoles, 28935 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,11,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/0169-2607(96)01762-2","article-title":"Non-linear algorithms for processing biological signals","volume":"51","author":"Cerutti","year":"1996","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"S1","DOI":"10.1002\/jae.3950070502","article-title":"Nonlinear dynamics and econometrics: An introduction","volume":"7","author":"Hashem","year":"1992","journal-title":"J. Appl. Econom."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Kian, R., Horrillo, J., Zaytsev, A., and Yalciner, A.C. (2018). Capturing Physical Dispersion Using a Nonlinear Shallow Water Model. J. Mar. Sci. Eng., 6.","DOI":"10.3390\/jmse6030084"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"20590","DOI":"10.1109\/ACCESS.2017.2756872","article-title":"Data Mining and Analytics in the Process Industry: The Role of Machine Learning","volume":"5","author":"Ge","year":"2017","journal-title":"IEEE Access"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1007\/s11517-007-0200-3","article-title":"Predicting survival in critical patients by use of body temperature regularity measurement based on approximate entropy","volume":"45","author":"Cuesta","year":"2007","journal-title":"Med. Biol. Eng. Comput."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1449","DOI":"10.1088\/0967-3334\/34\/11\/1449","article-title":"Temperature multiscale entropy analysis: A promising marker for early prediction of mortality in septic patients","volume":"34","author":"Papaioannou","year":"2013","journal-title":"Physiol. Meas."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1016\/j.compbiomed.2017.05.028","article-title":"Noisy EEG signals classification based on entropy metrics. Performance assessment using first and second generation statistics","volume":"87","year":"2017","journal-title":"Comput. Biol. Med."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"136","DOI":"10.3389\/fphys.2016.00136","article-title":"Classification of 5-S Epileptic EEG Recordings Using Distribution Entropy and Sample Entropy","volume":"7","author":"Li","year":"2016","journal-title":"Front. Physiol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1088\/0967-3334\/27\/3\/003","article-title":"Entropy analysis of the EEG background activity in Alzheimer\u2019s disease patients","volume":"27","author":"Hornero","year":"2006","journal-title":"Physiol. Meas."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"6270","DOI":"10.3390\/e17096270","article-title":"Determination of Sample Entropy and Fuzzy Measure Entropy Parameters for Distinguishing Congestive Heart Failure from Normal Sinus Rhythm Subjects","volume":"17","author":"Zhao","year":"2015","journal-title":"Entropy"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"R789","DOI":"10.1152\/ajpregu.00069.2002","article-title":"Sample entropy analysis of neonatal heart rate variability","volume":"283","author":"Lake","year":"2002","journal-title":"Am. J. Physiol. Regul. Integr. Comp. Physiol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1016\/j.compbiomed.2017.05.003","article-title":"Permutation entropy analysis of heart rate variability for the assessment of cardiovascular autonomic neuropathy in type 1 diabetes mellitus","volume":"86","author":"Naranjo","year":"2017","journal-title":"Comput. Biol. Med."},{"key":"ref_13","first-page":"e2831","article-title":"Glucose time series complexity as a predictor of type 2 Diabetes","volume":"30","author":"Vigil","year":"2017","journal-title":"Diabetes Metab. Res. Rev."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1016\/j.jcrc.2016.09.013","article-title":"Statistical models for fever forecasting based on advanced body temperature monitoring","volume":"37","author":"Jordan","year":"2017","journal-title":"J. Crit. Care"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"H319","DOI":"10.1152\/ajpheart.00561.2010","article-title":"Accurate estimation of entropy in very short physiological time series: The problem of atrial fibrillation detection in implanted ventricular devices","volume":"300","author":"Lake","year":"2011","journal-title":"Am. J. Physiol. Heart Circ. Physiol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"6212","DOI":"10.3390\/e16126212","article-title":"Ordinal Patterns, Entropy, and EEG","volume":"16","author":"Keller","year":"2014","journal-title":"Entropy"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Keller, K., Mangold, T., Stolz, I., and Werner, J. (2017). Permutation Entropy: New Ideas and Challenges. Entropy, 19.","DOI":"10.20944\/preprints201702.0071.v1"},{"key":"ref_18","first-page":"OC43","article-title":"Comparison of Conventional Mercury Thermometer and Continuous TherCom(\u00c2?) Temperature Recording in Hospitalized Patients","volume":"10","author":"Dakappa","year":"2016","journal-title":"J. Clin. Diagn. Res."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1283","DOI":"10.1111\/j.1742-1241.2011.02794.x","article-title":"Catching the spike and tracking the flow: Holter\u2013temperature monitoring in patients admitted in a general internal medicine ward","volume":"65","author":"Varela","year":"2011","journal-title":"Int. J. Clin. Pract."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1007\/s10877-009-9184-x","article-title":"Holter monitoring of central and peripheral temperature: possible uses and feasibility study in outpatient settings","volume":"23","author":"Varela","year":"2009","journal-title":"J. Clin. Monit. Comput."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"5707162","DOI":"10.1155\/2017\/5707162","article-title":"A Predictive Model to Classify Undifferentiated Fever Cases Based on Twenty-Four-Hour Continuous Tympanic Temperature Recording","volume":"2017","author":"Dakappa","year":"2017","journal-title":"J. Healthc. Eng."},{"key":"ref_22","first-page":"419","article-title":"What Can Biosignal Entropy Tell Us About Health and Disease? Applications in Some Clinical Fields","volume":"19","author":"Vargas","year":"2015","journal-title":"Nonlinear Dyn. Psychol. Life Sci."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1007\/BF01619355","article-title":"A regularity statistic for medical data analysis","volume":"7","author":"Pincus","year":"1991","journal-title":"J. Clin. Monit. Comput."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"H2039","DOI":"10.1152\/ajpheart.2000.278.6.H2039","article-title":"Physiological time-series analysis using approximate entropy and sample entropy","volume":"278","author":"Richman","year":"2000","journal-title":"Am. J. Physiol. Heart Circ. Physiol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"174102","DOI":"10.1103\/PhysRevLett.88.174102","article-title":"Permutation Entropy: A Natural Complexity Measure for Time Series","volume":"88","author":"Bandt","year":"2002","journal-title":"Phys. Rev. Lett."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1016\/j.cmpb.2016.02.008","article-title":"Amplitude-aware permutation entropy: Illustration in spike detection and signal segmentation","volume":"128","author":"Azami","year":"2016","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1186\/cc3045","article-title":"Statistics review 14: Logistic regression","volume":"9","author":"Bewick","year":"2005","journal-title":"Crit. Care"},{"key":"ref_28","first-page":"9","article-title":"Effect of Testing Logistic Regression Assumptions on the Improvement of the Propensity Scores","volume":"8","author":"Josephat","year":"2018","journal-title":"Int. J. Stat. Appl."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Van der Ploeg, T., Austin, P.C., and Steyerberg, E.W. (2014). Modern modelling techniques are data hungry: A simulation study for predicting dichotomous endpoints. BMC Med. Res. Methodol., 14.","DOI":"10.1186\/1471-2288-14-137"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Berry, M.W., Mohamed, A., and Yap, B.W. (2015). Comparisons of ADABOOST, KNN, SVM and Logistic Regression in Classification of Imbalanced Dataset. Soft Computing in Data Science, Springer.","DOI":"10.1007\/978-981-287-936-3"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.cmpb.2004.10.009","article-title":"Classification of EEG signals using neural network and logistic regression","volume":"78","author":"Subasi","year":"2005","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_32","first-page":"1377","article-title":"Logistic regression for single trial EEG classification","volume":"Volume 19","author":"Tomioka","year":"2007","journal-title":"Advances in Neural Information Processing Systems"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"23617","DOI":"10.1038\/srep23617","article-title":"Deceleration and acceleration capacities of heart rate associated with heart failure with high discriminating performance","volume":"6","author":"Hu","year":"2016","journal-title":"Sci. Rep."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Igasaki, T., Nagasawa, K., Murayama, N., and Hu, Z. (2015, January 14\u201316). Drowsiness estimation under driving environment by heart rate variability and\/or breathing rate variability with logistic regression analysis. Proceedings of the 2015 8th International Conference on Biomedical Engineering and Informatics (BMEI), Shenyang, China.","DOI":"10.1109\/BMEI.2015.7401498"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"012024","DOI":"10.1088\/1757-899X\/185\/1\/012024","article-title":"Sugarcane Land Classification with Satellite Imagery using Logistic Regression Model","volume":"185","author":"Henry","year":"2017","journal-title":"IOP Conf. Ser. Mater. Sci. Eng."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"8212","DOI":"10.1021\/es3014024","article-title":"Event Detection in Water Distribution Systems from Multivariate Water Quality Time Series","volume":"46","author":"Perelman","year":"2012","journal-title":"Environ. Sci. Technol."},{"key":"ref_37","first-page":"4","article-title":"Forecasting Stock Market Trends by Logistic Regression and Neural Networks Evidence from Ksa Stock Market","volume":"4","author":"Zaidi","year":"2016","journal-title":"Int. J. Econ. Commer. Manag."},{"key":"ref_38","unstructured":"R Core Team (2013). R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"514","DOI":"10.22237\/jmasm\/1130804100","article-title":"Comparison of statistical tests in logistic regression: The case of hypernatreamia","volume":"4","author":"Katsaragakis","year":"2005","journal-title":"J. Mod. Appl. Stat. Methods"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"716","DOI":"10.1109\/TAC.1974.1100705","article-title":"A new look at the statistical model identification","volume":"19","author":"Akaike","year":"1974","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1413","DOI":"10.1007\/s11222-016-9696-4","article-title":"Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC","volume":"27","author":"Vehtari","year":"2016","journal-title":"Stat. Comput."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Davison, A.C., and Hinkley, D.V. (1997). Bootstrap Methods and Their Applications, Cambridge University Press.","DOI":"10.1017\/CBO9780511802843"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"7881","DOI":"10.1093\/bioinformatics\/bti623","article-title":"ROCR: Visualizing classifier performance in R","volume":"21","author":"Sing","year":"2005","journal-title":"Bioinformatics"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"691","DOI":"10.1093\/biomet\/78.3.691","article-title":"A note on a general definition of the coefficient of determination","volume":"78","author":"Nagelkerke","year":"1991","journal-title":"Biometrika"},{"key":"ref_45","first-page":"126","article-title":"Evaluating Methods of Assessing Optimism in Regression Models","volume":"6","author":"Thoya","year":"2018","journal-title":"Am. J. Appl. Math. Stat."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1177\/0049124116638107","article-title":"Log-likelihood-based Pseudo-R2 in Logistic Regression: Deriving Sample-sensitive Benchmarks","volume":"47","author":"Hemmert","year":"2018","journal-title":"Sociol. Methods Res."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"2297","DOI":"10.1073\/pnas.88.6.2297","article-title":"Approximate entropy as a measure of system complexity","volume":"88","author":"Pincus","year":"1991","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1324696","DOI":"10.1155\/2018\/1324696","article-title":"Patterns with Equal Values in Permutation Entropy: Do They Really Matter for Biosignal Classification?","volume":"2018","author":"Vargas","year":"2018","journal-title":"Complexity"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"061907","DOI":"10.1103\/PhysRevE.64.061907","article-title":"Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: Dependence on recording region and brain state","volume":"64","author":"Andrzejak","year":"2001","journal-title":"Phys. Rev. E"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"5901","DOI":"10.3390\/e16115901","article-title":"Comparative Study of Entropy Sensitivity to Missing Biosignal Data","volume":"16","year":"2014","journal-title":"Entropy"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"864","DOI":"10.1093\/aje\/kwx299","article-title":"Separation in Logistic Regression: Causes, Consequences, and Control","volume":"187","author":"Mansournia","year":"2018","journal-title":"Am. J. Epidemiol."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/20\/11\/853\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,4]],"date-time":"2026-04-04T00:12:52Z","timestamp":1775261572000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/20\/11\/853"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,11,6]]},"references-count":51,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2018,11]]}},"alternative-id":["e20110853"],"URL":"https:\/\/doi.org\/10.3390\/e20110853","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,11,6]]}}}