{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:21:30Z","timestamp":1760145690759,"version":"build-2065373602"},"reference-count":36,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2024,8,16]],"date-time":"2024-08-16T00:00:00Z","timestamp":1723766400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>We consider situations in which the clustering of some multivariate data is desired, which establishes an ordering of the clusters with respect to an underlying latent variable. As our motivating example for a situation where such a technique is desirable, we consider scatterplots of traffic flow and speed, where a pattern of consecutive clusters can be thought to be linked by a latent variable, which is interpretable as traffic density. We focus on latent structures of linear or quadratic shapes, and present an estimation methodology based on expectation\u2013maximization, which estimates both the latent subspace and the clusters along it. The directed clustering approach is summarized in two algorithms and applied to the traffic example outlined. Connections to related methodology, including principal curves, are briefly drawn.<\/jats:p>","DOI":"10.3390\/a17080358","type":"journal-article","created":{"date-parts":[[2024,8,16]],"date-time":"2024-08-16T06:23:20Z","timestamp":1723789400000},"page":"358","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Directed Clustering of Multivariate Data Based on Linear or Quadratic Latent Variable Models"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1849-7353","authenticated-orcid":false,"given":"Yingjuan","family":"Zhang","sequence":"first","affiliation":[{"name":"Department of Mathematical Sciences, Durham University, Durham DH1 3LE, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9457-2020","authenticated-orcid":false,"given":"Jochen","family":"Einbeck","sequence":"additional","affiliation":[{"name":"Department of Mathematical Sciences, Durham University, Durham DH1 3LE, UK"},{"name":"Durham Research Methods Centre, Durham University, Durham DH1 3LE, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,8,16]]},"reference":[{"key":"ref_1","unstructured":"MacQueen, J.B. (1967). Some Methods for Classification and Analysis of Multivariate Observations. Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability. Volume 1: Statistics, University of California Press."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1016\/j.ins.2022.11.139","article-title":"K-means clustering algorithms: A comprehensive review, variants analysis, and advances in the era of big data","volume":"622","author":"Ikotun","year":"2023","journal-title":"Inf. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1198\/016214502760047131","article-title":"Model-based clustering, discriminant analysis, and density estimation","volume":"97","author":"Fraley","year":"2002","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1007\/s00357-016-9211-9","article-title":"Model-based clustering","volume":"33","author":"McNicholas","year":"2016","journal-title":"J. Classif."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"790","DOI":"10.1109\/34.400568","article-title":"Mean shift, mode seeking, and clustering","volume":"17","author":"Cheng","year":"1995","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1111\/insr.12109","article-title":"A review on modal clustering","volume":"84","author":"Menardi","year":"2016","journal-title":"Int. Stat. Rev."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Scrucca, L., Fraley, C., Murphy, T.B., and Raftery, A.E. (2023). Model-Based Clustering, Classification, and Density Estimation Using Mclust in R, Chapman and Hall\/CRC. Available online: https:\/\/mclust-org.github.io\/book.","DOI":"10.1201\/9781003277965"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Hennig, C., Meila, M., Murtagh, F., and Rocci, R. (2015). Handbook of Cluster Analysis, CRC Press.","DOI":"10.1201\/b19706"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1007\/s11634-018-0322-5","article-title":"Variable selection in model-based clustering and discriminant analysis with a regularization approach","volume":"13","author":"Celeux","year":"2019","journal-title":"Adv. Data Anal. Classif."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"940","DOI":"10.1111\/biom.13665","article-title":"Clustering high-dimensional data via feature selection","volume":"79","author":"Liu","year":"2023","journal-title":"Biometrics"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1101","DOI":"10.1007\/s00180-020-00958-4","article-title":"Clustering multivariate functional data in group-specific functional subspaces","volume":"35","author":"Schmutz","year":"2020","journal-title":"Comput. Stat."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"e150","DOI":"10.1002\/wics.1510","article-title":"Clustering of multivariate geostatistical data","volume":"12","author":"Fouedjio","year":"2020","journal-title":"WIREs Comput. Stat."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Deng, C.-H., and Zhao, W.-L. (2018, January 16\u201319). Fast k-Means Based on k-NN Graph. Proceedings of the IEEE 34th International Conference on Data Engineering (ICDE), Paris, France.","DOI":"10.1109\/ICDE.2018.00115"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"102048","DOI":"10.1016\/j.media.2021.102048","article-title":"Faster Mean-shift: GPU-accelerated clustering for cosine embedding-based cell segmentation and tracking","volume":"71","author":"Zhao","year":"2021","journal-title":"Med. Image Anal."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.eij.2015.01.003","article-title":"Brain tumor segmentation based on a hybrid clustering technique","volume":"16","author":"Elmogy","year":"2015","journal-title":"Egypt. Inform. J."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1007\/s42519-023-00357-0","article-title":"A Versatile Model for Clustered and Highly Correlated Multivariate Data","volume":"18","author":"Zhang","year":"2024","journal-title":"J. Stat. Theory Pract."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1111\/j.0006-341X.1999.00117.x","article-title":"A general maximum likelihood analysis of variance components in generalized linear models","volume":"55","author":"Aitkin","year":"1999","journal-title":"Biometrics"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2307\/2981882","article-title":"Statistical modelling issues in school effectiveness studies","volume":"149","author":"Aitkin","year":"1986","journal-title":"J. R. Stat. Soc. Ser. A (Gen.)"},{"key":"ref_19","unstructured":"Zayed, M., and Einbeck, J. (2010, January 22\u201327). Constructing Economic Summary Indexes via Principal Curves. Proceedings of the COMPSTAT 2010, Paris, France."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Campbell, K., Ponting, C.P., and Webber, C. (2015). Laplacian eigenmaps and principal curves for high resolution pseudotemporal ordering of single-cell RNA-seq profiles. bioRxiv.","DOI":"10.1101\/027219"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"7286","DOI":"10.1038\/s41467-023-42841-y","article-title":"A statistical framework for differential pseudotime analysis with multiple single-cell RNA-seq samples","volume":"14","author":"Hou","year":"2023","journal-title":"Nat. Commun."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"502","DOI":"10.1080\/01621459.1989.10478797","article-title":"Principal curves","volume":"84","author":"Hastie","year":"1989","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_23","unstructured":"Einbeck, J., and Evers, L. (2024, March 05). LPCM: Local Principal Curve Methods. Available online: https:\/\/CRAN.R-project.org\/package=LPCM."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1080\/18128600903500110","article-title":"Using principal curves to analyse traffic patterns on freeways","volume":"7","author":"Einbeck","year":"2011","journal-title":"Transportmetrica"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1111\/j.1467-8667.2007.00498.x","article-title":"A nested clustering technique for freeway operating condition classification","volume":"22","author":"Xia","year":"2007","journal-title":"Comput.-Aided Civ. Infrastruct. Eng."},{"key":"ref_26","unstructured":"Riente, G.U., and Setti, A.J. (2014). Speed-Flow Relationship and Capacity for Expressways in Brazil. Innovative Applications of the Highway Capacity Manual 2010, Transportation Research Board. Transportation Research Circular, E-C190."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Aitkin, M., Francis, B., Hinde, J., and Darnell, R. (2009). Statistical Modelling in R, Oxford University Press.","DOI":"10.1093\/oso\/9780199219148.001.0001"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"805","DOI":"10.1080\/01621459.1978.10480103","article-title":"Nonparametric Maximum Likelihood Estimation of a Mixing Distribution","volume":"73","author":"Laird","year":"1978","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.2517-6161.1977.tb01600.x","article-title":"Maximum likelihood from incomplete data via the EM algorithm","volume":"39","author":"Dempster","year":"1977","journal-title":"J. R. Stat. Soc. Ser. B Methodol."},{"key":"ref_30","unstructured":"Zhang, Y., and Einbeck, J. (2024, March 22). mult.latent.reg: Regression and Clustering in Multivariate Response Scenarios. R Package Version 0.1.7. Available online: https:\/\/CRAN.R-project.org\/package=mult.latent.reg."},{"key":"ref_31","unstructured":"R Core Team (2024, June 24). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. Available online: https:\/\/www.R-project.org\/."},{"key":"ref_32","unstructured":"DiTraglia, F. (2024, July 24). fmscr. R Package Version 0.1. Available online: https:\/\/github.com\/fditraglia\/fmscr\/."},{"key":"ref_33","unstructured":"Aitkin, M. (1996, January 15\u201319). Empirical Bayes shrinkage using posterior random effect means from nonparametric maximum likelihood estimation in general random effect models. Proceedings of the 11th International Workshop on Statistical Modelling, Orvieto, Italy."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1007\/BF01889678","article-title":"Principal curves revisited","volume":"2","author":"Tibshirani","year":"1992","journal-title":"Stat. Comput."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1007\/s11222-005-4073-8","article-title":"Local Principal Curves","volume":"15","author":"Einbeck","year":"2005","journal-title":"Stat. Comput."},{"key":"ref_36","unstructured":"Cannoodt, R. (2024, March 05). Princurve 2.0: Fit a Principal Curve in Arbitrary Dimension (June 2018). Available online: https:\/\/zenodo.org\/records\/3351282."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/17\/8\/358\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:37:41Z","timestamp":1760110661000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/17\/8\/358"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,16]]},"references-count":36,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2024,8]]}},"alternative-id":["a17080358"],"URL":"https:\/\/doi.org\/10.3390\/a17080358","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2024,8,16]]}}}