{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,18]],"date-time":"2026-01-18T05:14:08Z","timestamp":1768713248690,"version":"3.49.0"},"reference-count":44,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2019,3,6]],"date-time":"2019-03-06T00:00:00Z","timestamp":1551830400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"U.S. Department of Energy, Office of Science","award":["DE-AC02-05CH11231"],"award-info":[{"award-number":["DE-AC02-05CH11231"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Data and Information Quality"],"published-print":{"date-parts":[[2019,6,30]]},"abstract":"<jats:p>The goal of this work is to investigate the impact of missing values in clustering joint categorical social sequences. Identifying patterns in sociodemographic longitudinal data is important in a number of social science settings. However, performing analytical operations, such as clustering on life course trajectories, is challenging due to the categorical and multidimensional nature of the data, their mixed data types, and corruption by missing and inconsistent values. Data quality issues were investigated previously on single variable sequences. To understand their effects on multivariate sequence analysis, we employ a dataset of mixed data types and missing values, a dissimilarity measure designed for joint categorical sequence data, together with dimensionality reduction methodologies in a systematic design of sequence clustering experiments. Given the categorical nature of our data, we employ an \u201cedit\u201d distance using optimal matching. Because each data record has multiple variables of different types, we investigate the impact of mixing these variables in a single dissimilarity measure. Between variables with binary values and those with multiple nominal values, we find that the ability to overcome missing data problems is more difficult in the nominal domain than in the binary domain. Additionally, alignment of leading missing values can result in systematic biases in dissimilarity matrices and subsequently introduce both artificial clusters and unrealistic interpretations of associated data domains. We demonstrate the usage of t-distributed stochastic neighborhood embedding to visually guide mitigation of such biases by tuning the missing value substitution cost parameter or determining an optimal sequence span.<\/jats:p>","DOI":"10.1145\/3301294","type":"journal-article","created":{"date-parts":[[2019,3,7]],"date-time":"2019-03-07T13:37:06Z","timestamp":1551965826000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Evaluating the Effects of Missing Values and Mixed Data Types on Social Sequence Clustering Using t-SNE Visualization"],"prefix":"10.1145","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2096-1541","authenticated-orcid":false,"given":"Alina","family":"Lazar","sequence":"first","affiliation":[{"name":"Youngstown State University, Youngstown, OH"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4381-195X","authenticated-orcid":false,"given":"Ling","family":"Jin","sequence":"additional","affiliation":[{"name":"Lawrence Berkeley National Laboratory, Berkeley, CA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"C. Anna","family":"Spurlock","sequence":"additional","affiliation":[{"name":"Lawrence Berkeley National Laboratory, Berkeley, CA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kesheng","family":"Wu","sequence":"additional","affiliation":[{"name":"Lawrence Berkeley National Laboratory, Berkeley, CA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alex","family":"Sim","sequence":"additional","affiliation":[{"name":"Lawrence Berkeley National Laboratory, Berkeley, CA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Annika","family":"Todd","sequence":"additional","affiliation":[{"name":"Lawrence Berkeley National Laboratory, Berkeley, CA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,3,6]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.2307\/204500"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1086\/229495"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1177\/0049124109357532"},{"key":"e_1_2_2_4_1","doi-asserted-by":"crossref","unstructured":"Mikhail Belkin and Partha Niyogi. 2002. Laplacian eigenmaps and spectral techniques for embedding and clustering. In Advances in Neural Information Processing Systems. 585--591. Mikhail Belkin and Partha Niyogi. 2002. Laplacian eigenmaps and spectral techniques for embedding and clustering. In Advances in Neural Information Processing Systems. 585--591.","DOI":"10.7551\/mitpress\/1120.003.0080"},{"key":"e_1_2_2_5_1","volume-title":"Jean-Fran\u00e7ois Paiement, Pascal Vincent, and Marie Ouimet.","author":"Bengio Yoshua","year":"2006"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF03213737"},{"key":"e_1_2_2_7_1","volume-title":"Sequence Analysis: Metric Representations of Categorical Time Series. Technical Report. Department of Social Science Research Methods, Vrije Universiteit","author":"Elzinga Cees H.","year":"2007"},{"key":"e_1_2_2_8_1","volume-title":"Advances in Sequence Analysis: Theory, Method, Applications","author":"Elzinga Cees H."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2010.09.007"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v040.i04"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1177\/0049124109342065"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9531.2010.01227.x"},{"key":"e_1_2_2_14_1","volume-title":"Advances in Sequence Analysis: Theory, Method, Applications","author":"Halpin Brendan"},{"key":"e_1_2_2_16_1","volume-title":"Analysis of a complex of statistical variables into principal components.Journal of Educational Psychology 24, 6","author":"Hotelling Harold","year":"1933"},{"key":"e_1_2_2_17_1","volume-title":"Proceedings of the AI for Smart Grids and Buildings Workshop.","author":"Jin Ling"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.3102\/0013189X033007014"},{"key":"e_1_2_2_19_1","volume-title":"Rousseeuw","author":"Kaufman Leonard","year":"1990"},{"key":"e_1_2_2_20_1","volume-title":"Aggarwal","author":"Kotsakos Dimitrios","year":"2013"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02289565"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02289694"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-4446.2004.00002.x"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2005.01.025"},{"key":"e_1_2_2_25_1","article-title":"Visualizing data using t-SNE","author":"van der Maaten Laurens","year":"2008","journal-title":"Journal of Machine Learning Research 9"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/0022-2836(70)90057-4"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1177\/0049124115591013"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-985X.2007.00495.x"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-985X.2009.00606.x"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-985X.2006.00450.x"},{"key":"e_1_2_2_31_1","volume-title":"Panel Study of Income Dynamics Public Use Dataset. Retrieved","author":"PSID.","year":"2019"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.5120\/8282-1278"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1177\/1536867X0400400301"},{"key":"e_1_2_2_34_1","volume-title":"Smola","author":"Sch\u0151lkopf Bernhard","year":"1999"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/646257.685385"},{"key":"e_1_2_2_36_1","volume-title":"Migration and Reproduction in an Urbanizing Context. A Sequence Analysis of Family Life Courses in 19th Century Antwerp and Geneva.","author":"Schumacher Reto"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1177\/0049124103262683"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1086\/230950"},{"key":"e_1_2_2_39_1","unstructured":"Matthias Studer. 2013. WeightedCluster Library Manual: A Practical Guide to Creating Typologies of Trajectories in the Social Sciences With R. Available at https:\/\/archive-ouverte.unige.ch\/unige:78576. Matthias Studer. 2013. WeightedCluster Library Manual: A Practical Guide to Creating Typologies of Trajectories in the Social Sciences With R. Available at https:\/\/archive-ouverte.unige.ch\/unige:78576."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1111\/rssa.12125"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1177\/0049124111415372"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1177\/0081175017747122"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02288916"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/321796.321811"},{"key":"e_1_2_2_45_1","volume-title":"Widmer and Gilbert Ritschard","author":"Eric","year":"2009"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-4446.2004.00004.x"}],"container-title":["Journal of Data and Information Quality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3301294","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3301294","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:02:04Z","timestamp":1750208524000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3301294"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,6]]},"references-count":44,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,6,30]]}},"alternative-id":["10.1145\/3301294"],"URL":"https:\/\/doi.org\/10.1145\/3301294","relation":{},"ISSN":["1936-1955","1936-1963"],"issn-type":[{"value":"1936-1955","type":"print"},{"value":"1936-1963","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,3,6]]},"assertion":[{"value":"2018-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-12-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-03-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}