{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:54:36Z","timestamp":1760241276298,"version":"build-2065373602"},"reference-count":32,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2019,12,30]],"date-time":"2019-12-30T00:00:00Z","timestamp":1577664000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["PTDC\/CCI-CIF\/29877\/2017"],"award-info":[{"award-number":["PTDC\/CCI-CIF\/29877\/2017"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Biomedical signals constitute time-series that sustain machine learning techniques to achieve classification. These signals are complex with measurements of several features over, eventually, an extended period. Characterizing whether the data can anticipate prediction is an essential task in time-series mining. The ability to obtain information in advance by having early knowledge about a specific event may be of great utility in many areas. Early classification arises as an extension of the time-series classification problem, given the need to obtain a reliable prediction as soon as possible. In this work, we propose an information-theoretic method, named Multivariate Correlations for Early Classification (MCEC), to characterize the early classification opportunity of a time-series. Experimental validation is performed on synthetic and benchmark data, confirming the ability of the MCEC algorithm to perform a trade-off between accuracy and earliness in a wide-spectrum of time-series data, such as those collected from sensors, images, spectrographs, and electrocardiograms.<\/jats:p>","DOI":"10.3390\/e22010049","type":"journal-article","created":{"date-parts":[[2020,1,3]],"date-time":"2020-01-03T03:28:53Z","timestamp":1578022133000},"page":"49","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Information-Theoretical Criteria for Characterizing the Earliness of Time-Series Data"],"prefix":"10.3390","volume":"22","author":[{"given":"Mariano","family":"Lemus","sequence":"first","affiliation":[{"name":"Instituto de Telecomunica\u00e7\u00f5es, 1049-001 Lisboa, Portugal"},{"name":"Instituto Superior T\u00e9cnico, Universidade de Lisboa, 1049-001 Lisboa, Portugal"}]},{"given":"Jo\u00e3o P.","family":"Beir\u00e3o","sequence":"additional","affiliation":[{"name":"Instituto de Telecomunica\u00e7\u00f5es, 1049-001 Lisboa, Portugal"},{"name":"Instituto Superior T\u00e9cnico, Universidade de Lisboa, 1049-001 Lisboa, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9345-4321","authenticated-orcid":false,"given":"Nikola","family":"Paunkovi\u0107","sequence":"additional","affiliation":[{"name":"Instituto de Telecomunica\u00e7\u00f5es, 1049-001 Lisboa, Portugal"},{"name":"Instituto Superior T\u00e9cnico, Universidade de Lisboa, 1049-001 Lisboa, Portugal"}]},{"given":"Alexandra M.","family":"Carvalho","sequence":"additional","affiliation":[{"name":"Instituto de Telecomunica\u00e7\u00f5es, 1049-001 Lisboa, Portugal"},{"name":"Instituto Superior T\u00e9cnico, Universidade de Lisboa, 1049-001 Lisboa, Portugal"}]},{"given":"Paulo","family":"Mateus","sequence":"additional","affiliation":[{"name":"Instituto de Telecomunica\u00e7\u00f5es, 1049-001 Lisboa, Portugal"},{"name":"Instituto Superior T\u00e9cnico, Universidade de Lisboa, 1049-001 Lisboa, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2019,12,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1542\/peds.107.1.97","article-title":"Toward the Early Diagnosis of Neonatal Sepsis and Sepsis-Like Illness Using Novel Heart Rate Analysis","volume":"107","author":"Griffin","year":"2001","journal-title":"Pediatrics"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1007\/s10115-011-0400-x","article-title":"Early classification on time series","volume":"31","author":"Xing","year":"2012","journal-title":"Knowl. Inf. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Xing, Z., Pei, J., Yu, P.S., and Wang, K. (2011, January 28\u201330). Extracting Interpretable Features for Early Classification on Time Series. Proceedings of the 2011 SIAM International Conference on Data Mining, Mesa, AZ, USA.","DOI":"10.1137\/1.9781611972818.22"},{"key":"ref_4","unstructured":"Ye, L., and Keogh, E.J. (July, January 28). Time series shapelets: A new primitive for data mining. Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Paris, France."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Mueen, A., Keogh, E.J., and Young, N.E. (2011, January 21\u201324). Logical-shapelets: An expressive primitive for time series classification. Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Diego, CA, USA.","DOI":"10.1145\/2020408.2020587"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Ghalwash, M.F., Radosavljevic, V., and Obradovic, Z. (2013, January 7\u201310). Extraction of Interpretable Multivariate Patterns for Early Diagnostics. Proceedings of the 2013 IEEE 13th International Conference on Data Mining, Dallas, TX, USA.","DOI":"10.1109\/ICDM.2013.19"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"777","DOI":"10.1016\/j.neucom.2014.07.056","article-title":"Early classification on multivariate time series","volume":"149","author":"He","year":"2015","journal-title":"Neurocomputing"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1007\/s10618-016-0462-1","article-title":"Reliable early classification of time series based on discriminating the classes over time","volume":"31","author":"Mori","year":"2017","journal-title":"Data Min. Knowl. Discov."},{"key":"ref_9","unstructured":"Koller, D., and Friedman, N. (2009). Probabilistic Graphical Models: Principles and Techniques, MIT Press."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3438","DOI":"10.1016\/j.patcog.2014.03.019","article-title":"Hybrid learning of Bayesian multinets for binary classification","volume":"47","author":"Carvalho","year":"2014","journal-title":"Pattern Recognit."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2716","DOI":"10.3390\/e15072716","article-title":"Efficient Approximation of the Conditional Relative Entropy with Applications to Discriminative Learning of Bayesian Network Classifiers","volume":"15","author":"Carvalho","year":"2013","journal-title":"Entropy"},{"key":"ref_12","first-page":"2181","article-title":"Discriminative Learning of Bayesian Networks via Factorized Conditional Log-Likelihood","volume":"12","author":"Carvalho","year":"2011","journal-title":"J. Mach. Learning Res."},{"key":"ref_13","unstructured":"Carvalho, A.M. (2019, October 15). Scoring Functions for Learning Bayesian Networks. Available online: http:\/\/www.lx.it.pt\/~asmc\/pub\/talks\/09-TA\/ta_pres.pdf."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2743","DOI":"10.1109\/18.720554","article-title":"The Minimum Description Length Principle in Coding and Modeling","volume":"44","author":"Barron","year":"1998","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.cmpb.2018.05.002","article-title":"Model selection for clustering of pharmacokinetic responses","volume":"162","author":"Guerra","year":"2018","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Sousa, M., and Carvalho, A.M. (2018). Polynomial-Time Algorithm for Learning Optimal BFS-Consistent Dynamic Bayesian Networks. Entropy, 20.","DOI":"10.3390\/e20040274"},{"key":"ref_17","unstructured":"Monteiro, J.L., Vinga, S., and Carvalho, A.M. (2015, January 12\u201316). Polynomial-time algorithm for learning optimal tree-augmented dynamic Bayesian networks. Proceedings of the Thirty-First Conference on Uncertainty in Artificial Intelligence, Amsterdam, The Netherlands."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"716","DOI":"10.1109\/TAC.1974.1100705","article-title":"A new look at the statistical model identification","volume":"19","author":"Akaike","year":"1974","journal-title":"IEEE Trans. Auto. Control"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1177\/0049124104268644","article-title":"Multimodel inference: Understanding AIC and BIC in model selection","volume":"33","author":"Burnham","year":"2004","journal-title":"Sociol. Methods Res."},{"key":"ref_20","first-page":"2003","article-title":"Can the Strengths of AIC and BIC Be Shared?","volume":"92","author":"Yang","year":"2003","journal-title":"Biometrica"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1037\/a0027127","article-title":"Model selection and psychological theory: A discussion of the differences between the Akaike Information Criterion (AIC) and the Bayesian Information Criterion (BIC)","volume":"17","author":"Vrieze","year":"2012","journal-title":"Psychol. Methods"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1109\/TIM.2004.838132","article-title":"Modified AIC and MDL model selection criteria for short data records","volume":"54","author":"Ridder","year":"2005","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Cover, T.M., and Thomas, J.A. (2006). Elements of Information Theory, Wiley. [2nd ed.].","DOI":"10.1002\/047174882X"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1701","DOI":"10.1109\/18.930911","article-title":"Information geometry on hierarchy of probability distributions","volume":"47","author":"Amari","year":"2001","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1145\/1656274.1656278","article-title":"The WEKA Data Mining Software: An Update","volume":"11","author":"Hall","year":"2009","journal-title":"SIGKDD Explor. Newsl."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Bagnall, A., Lines, J., Bostrom, A., Large, J., and Keogh, E. (2016). The Great Time Series Classification Bake Off: A Review and Experimental Evaluation of Recent Algorithmic Advances. Data Min. Knowl. Discov., Available online: http:\/\/timeseriesclassification.com\/.","DOI":"10.1007\/s10618-016-0483-9"},{"key":"ref_27","unstructured":"Mustafa., B. (2019, October 15). Multivariate Time Series Classification Data Sets. Available online: http:\/\/www.mustafabaydogan.com\/files\/viewcategory\/20-data-sets.htmll."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1007\/s10618-007-0064-z","article-title":"Experiencing SAX: A novel symbolic representation of time series","volume":"15","author":"Lin","year":"2007","journal-title":"Data Min. Knowl. Discov."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1007\/s10618-014-0345-2","article-title":"Using the minimum description length to discover the intrinsic cardinality and dimensionality of time series","volume":"29","author":"Hu","year":"2015","journal-title":"Data Min. Knowl. Discov."},{"key":"ref_30","unstructured":"Olszewski, R. (2001). Generalized Feature Extraction for Structural Pattern Recognition in Time-Series Data. [Ph.D Thesis, Carnegie Mellon University]."},{"key":"ref_31","first-page":"1","article-title":"Statistical Comparisons of Classifiers over Multiple Data Sets","volume":"7","author":"Demsar","year":"2006","journal-title":"J. Mach. Learn. Res."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Buza, K., Nanopoulos, A., Schmidt-Thieme, L., and Koller, J. (2011, January 26\u201329). Fast Classification of Electrocardiograph Signals via Instance Selection. Proceedings of the 2011 IEEE International Conference on Healthcare Informatics, Imaging and Systems Biology, HISB 2011, San Jose, CA, USA.","DOI":"10.1109\/HISB.2011.26"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/1\/49\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:46:49Z","timestamp":1760190409000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/1\/49"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,30]]},"references-count":32,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,1]]}},"alternative-id":["e22010049"],"URL":"https:\/\/doi.org\/10.3390\/e22010049","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2019,12,30]]}}}