{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,15]],"date-time":"2025-12-15T04:26:43Z","timestamp":1765772803229,"version":"build-2065373602"},"reference-count":42,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2020,10,17]],"date-time":"2020-10-17T00:00:00Z","timestamp":1602892800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>This paper presents a new and novel hybrid modeling method for the segmentation of high dimensional time-series data using the mixture of the sparse principal components regression (MIX-SPCR) model with information complexity (ICOMP) criterion as the fitness function. Our approach encompasses dimension reduction in high dimensional time-series data and, at the same time, determines the number of component clusters (i.e., number of segments across time-series data) and selects the best subset of predictors. A large-scale Monte Carlo simulation is performed to show the capability of the MIX-SPCR model to identify the correct structure of the time-series data successfully. MIX-SPCR model is also applied to a high dimensional Standard &amp; Poor\u2019s 500 (S&amp;P 500) index data to uncover the time-series\u2019s hidden structure and identify the structure change points. The approach presented in this paper determines both the relationships among the predictor variables and how various predictor variables contribute to the explanatory power of the response variable through the sparsity settings cluster wise.<\/jats:p>","DOI":"10.3390\/e22101170","type":"journal-article","created":{"date-parts":[[2020,10,18]],"date-time":"2020-10-18T21:26:06Z","timestamp":1603056366000},"page":"1170","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Segmentation of High Dimensional Time-Series Data Using Mixture of Sparse Principal Component Regression Model with Information Complexity"],"prefix":"10.3390","volume":"22","author":[{"given":"Yaojin","family":"Sun","sequence":"first","affiliation":[{"name":"Department of Business Analytics and Statistics, University of Tennessee, Knoxville, TN 37996, USA"}]},{"given":"Hamparsum","family":"Bozdogan","sequence":"additional","affiliation":[{"name":"Department of Business Analytics and Statistics, University of Tennessee, Knoxville, TN 37996, USA"}]}],"member":"1968","published-online":{"date-parts":[[2020,10,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Barber, D., Cemgil, A.T., and Chiappa, S. (2011). Bayesian Time Series Models, Cambridge University Press.","DOI":"10.1017\/CBO9780511984679"},{"key":"ref_2","unstructured":"Abonyi, J., and Feil, B. (2007). Cluster Analysis for Data Mining and System Identification, Springer Science & Business Media."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2775","DOI":"10.1142\/S0218127408022007","article-title":"Volatility effects on the escape time in financial market models","volume":"18","author":"Spagnolo","year":"2008","journal-title":"Int. J. Bifurc. Chaos"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"062307","DOI":"10.1103\/PhysRevE.97.062307","article-title":"Stabilizing effect of volatility in financial markets","volume":"97","author":"Valenti","year":"2018","journal-title":"Phys. Rev. E"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"S Lima, L. (2019). Nonlinear Stochastic Equation within an It\u00f4 Prescription for Modelling of Financial Market. Entropy, 21.","DOI":"10.3390\/e21050530"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1950375","DOI":"10.1142\/S0217984919503755","article-title":"Correlation noise and delay time enhanced stability of electricity futures market","volume":"33","author":"Ding","year":"2019","journal-title":"Mod. Phys. Lett. B"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1007\/BF00999208","article-title":"Issues in the estimation and application of latent structure models of choice","volume":"5","author":"Dillon","year":"1994","journal-title":"Mark. Lett."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"730","DOI":"10.1080\/01621459.1978.10480085","article-title":"Estimating Mixtures of Normal Distributions and Switching Regressions","volume":"73","author":"Quandt","year":"1978","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"427","DOI":"10.2307\/1913910","article-title":"Discrete parameter variation: Efficient estimation of a switching regression model","volume":"46","author":"Kiefer","year":"1978","journal-title":"Econometrica"},{"key":"ref_10","unstructured":"De Veaux, R.D. (1986). Parameter Estimation for a Mixture of Linear Regressions. [Ph.D. Thesis, Department of Statistics, Stanford University]. Tech. Rept. No. 247."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1007\/BF01897167","article-title":"A maximum likelihood methodology for clusterwise linear regression","volume":"5","author":"DeSarbo","year":"1988","journal-title":"J. Classif."},{"key":"ref_12","unstructured":"Bagozzi, R. (1994). A Review of Recent Developments in Latent Class Regression Models. Advanced Methods of Marketing Research, Blackwell Pub."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1016\/0020-0255(83)90007-5","article-title":"Time-series segmentation: A model and a method","volume":"29","author":"Sclove","year":"1983","journal-title":"Inf. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1198\/106186006X113430","article-title":"Sparse principal component analysis","volume":"15","author":"Zou","year":"2006","journal-title":"J. Comput. Graph. Stat."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3950","DOI":"10.1016\/j.patcog.2012.04.031","article-title":"A robust EM clustering algorithm for Gaussian mixture models","volume":"45","author":"Yang","year":"2012","journal-title":"Pattern Recognit."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1080\/03610929008830199","article-title":"On the information-based measure of covariance complexity and its application to the evaluation of multivariate linear models","volume":"19","author":"Bozdogan","year":"1990","journal-title":"Commun. Stat. Theory Methods"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Bozdogan, H. (1993). Choosing the number of component clusters in the mixture-model using a new informational complexity criterion of the inverse-Fisher information matrix. Information and Classification, Springer.","DOI":"10.1007\/978-3-642-50974-2_5"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Bozdogan, H. (1994). Choosing the number of clusters, subset selection of variables, and outlier detection in the standard mixture-model cluster analysis. New approaches in Classification and Data Analysis, Springer.","DOI":"10.1007\/978-3-642-51175-2_19"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Bozdogan, H. (1994). Mixture-model cluster analysis using model selection criteria and a new informational measure of complexity. Proceedings of the First US\/Japan Conference on the Frontiers of Statistical Modeling: An Informational Approach, Springer.","DOI":"10.1007\/978-94-011-0800-3_3"},{"key":"ref_20","first-page":"370","article-title":"A new class of information complexity (ICOMP) criteria with an application to customer profiling and segmentation","volume":"39","author":"Bozdogan","year":"2010","journal-title":"\u0130stanbul \u00dcniversitesi \u0130\u015fletme Fak\u00fcltesi Derg."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1015","DOI":"10.1016\/j.jmva.2007.06.007","article-title":"Sparse principal component analysis via regularized low rank matrix approximation","volume":"99","author":"Shen","year":"2008","journal-title":"J. Multivar. Anal."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Mairal, J., Bach, F., Ponce, J., and Sapiro, G. (2009, January 14\u201318). Online dictionary learning for sparse coding. Proceedings of the 26th Annual International Conference on Machine Learning, Montreal, QC, Canada.","DOI":"10.1145\/1553374.1553463"},{"key":"ref_23","unstructured":"Guan, Y., and Dy, J. (2009, January 16\u201319). Sparse probabilistic principal component analysis. Proceedings of the Twelth International Conference on Artificial Intelligence and Statistics, Clearwater, FL, USA."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1162\/neco.1995.7.1.117","article-title":"Bayesian regularization and pruning using a Laplace prior","volume":"7","author":"Williams","year":"1995","journal-title":"Neural Comput."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"044078","DOI":"10.1103\/PhysRevApplied.11.044078","article-title":"Josephson-based threshold detector for L\u00e9vy-distributed current fluctuations","volume":"11","author":"Guarcello","year":"2019","journal-title":"Phys. Rev. Appl."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Gaffney, S., and Smyth, P. (1999, January 15\u201318). Trajectory clustering with mixtures of regression models. Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Diego, CA, USA.","DOI":"10.1145\/312129.312198"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2379776.2379788","article-title":"Time-series data mining","volume":"45","author":"Esling","year":"2012","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_28","unstructured":"Gaffney, S. (2004). Probabilistic Curve-Aligned Clustering and Prediction with Regression Mixture Models. [Ph.D. Thesis, University of California]."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1214\/aoms\/1177729694","article-title":"On Information and Sufficiency","volume":"22","author":"Kullback","year":"1951","journal-title":"Ann. Math. Stat."},{"key":"ref_30","unstructured":"Petrox, B., and Csaki, F. (1973). Information Theory and an Extension of the Maximum Likelihood Principle. Second International Symposium on Information Theory, Academiai Kiado."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1006\/jmps.1999.1277","article-title":"Akaike\u2019s Information Criterion and Recent Developments in Information Complexity","volume":"44","author":"Bozdogan","year":"2000","journal-title":"J. Math. Psychol."},{"key":"ref_32","unstructured":"Van Emden, H.M. (1971). An analysis of complexity. Mathematical Centre Tracts, Mathematisch Centrum."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1007\/BF02294361","article-title":"Model Selection and Akaike\u2019s Information Criteria (AIC): The General Theory and its Analytical Extensions","volume":"52","author":"Bozdogan","year":"1987","journal-title":"Psychometrica"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/MCSE.2011.37","article-title":"The NumPy array: A structure for efficient numerical computation","volume":"13","author":"Colbert","year":"2011","journal-title":"Comput. Sci. Eng."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1080\/01621459.2017.1401542","article-title":"Principal component analysis of high-frequency data","volume":"114","author":"Xiu","year":"2019","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"412","DOI":"10.1016\/j.chaos.2015.07.023","article-title":"Noise-induced effects in nonlinear relaxation of condensed matter systems","volume":"81","author":"Spagnolo","year":"2015","journal-title":"Chaos Solitons Fractals"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"235412","DOI":"10.1103\/PhysRevB.91.235412","article-title":"Stabilization of quantum metastable states by dissipation","volume":"91","author":"Valenti","year":"2015","journal-title":"Phys. Rev. B"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Spagnolo, B., Guarcello, C., Magazz\u00f9, L., Carollo, A., Persano Adorno, D., and Valenti, D. (2017). Nonlinear relaxation phenomena in metastable condensed matter systems. Entropy, 19.","DOI":"10.3390\/e19010020"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"073117","DOI":"10.1063\/1.4959146","article-title":"Stochastic basins of attraction for metastable states","volume":"26","author":"Serdukova","year":"2016","journal-title":"Chaos Interdiscip. J. Nonlinear Sci."},{"key":"ref_40","first-page":"762989","article-title":"The positive role of noise for information acquisition in biological signaling pathways","volume":"2019","author":"Azpeitia","year":"2019","journal-title":"bioRxiv"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"016708","DOI":"10.1103\/PhysRevE.85.016708","article-title":"Characterization of escape times of Josephson junctions for signal detection","volume":"85","author":"Addesso","year":"2012","journal-title":"Phys. Rev. E"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"041104","DOI":"10.1103\/PhysRevE.82.041104","article-title":"Thermal-inertial ratchet effects: Negative mobility, resonant activation, noise-enhanced stability, and noise-weakened stability","volume":"82","author":"Li","year":"2010","journal-title":"Phys. Rev. E"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/10\/1170\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:23:17Z","timestamp":1760178197000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/10\/1170"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,17]]},"references-count":42,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2020,10]]}},"alternative-id":["e22101170"],"URL":"https:\/\/doi.org\/10.3390\/e22101170","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2020,10,17]]}}}