{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,27]],"date-time":"2025-03-27T22:05:53Z","timestamp":1743113153556,"version":"3.40.3"},"publisher-location":"Cham","reference-count":21,"publisher":"Springer International Publishing","isbn-type":[{"type":"print","value":"9783031263866"},{"type":"electronic","value":"9783031263873"}],"license":[{"start":{"date-parts":[[2023,1,1]],"date-time":"2023-01-01T00:00:00Z","timestamp":1672531200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,3,17]],"date-time":"2023-03-17T00:00:00Z","timestamp":1679011200000},"content-version":"vor","delay-in-days":75,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Scientific datasets often have hierarchical structure: for example, in surveys, individual participants (samples) might be grouped at a higher level (units) such as their geographical region. In these settings, the interest is often in exploring the structure on the unit level rather than on the sample level. Units can be compared based on the distance between their means, however this ignores the within-unit distribution of samples. Here we develop an approach for exploratory analysis of hierarchical datasets using the Wasserstein distance metric that takes into account the shapes of within-unit distributions. We use <jats:italic>t<\/jats:italic>-SNE to construct 2D embeddings of the units, based on the matrix of pairwise Wasserstein distances between them. The distance matrix can be efficiently computed by approximating each unit with a Gaussian distribution, but we also provide a scalable method to compute exact Wasserstein distances. We use synthetic data to demonstrate the effectiveness of our <jats:italic>Wasserstein<\/jats:italic><jats:italic>t<\/jats:italic><jats:italic>-SNE<\/jats:italic>, and apply it to data from the 2017 German parliamentary election, considering polling stations as samples and voting districts as units. The resulting embedding uncovers meaningful structure in the data.<\/jats:p>","DOI":"10.1007\/978-3-031-26387-3_7","type":"book-chapter","created":{"date-parts":[[2023,3,16]],"date-time":"2023-03-16T15:03:10Z","timestamp":1678978990000},"page":"104-120","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Wasserstein t-SNE"],"prefix":"10.1007","author":[{"given":"Fynn","family":"Bachmann","sequence":"first","affiliation":[]},{"given":"Philipp","family":"Hennig","sequence":"additional","affiliation":[]},{"given":"Dmitry","family":"Kobak","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,3,17]]},"reference":[{"key":"7_CR1","unstructured":"Arjovsky, M., Chintala, S., Bottou, L.: Wasserstein generative adversarial networks. In: International Conference on Machine Learning, pp. 214\u2013223. PMLR (2017)"},{"issue":"3","key":"7_CR2","doi-asserted-by":"publisher","first-page":"450","DOI":"10.1016\/0047-259X(82)90077-X","volume":"12","author":"D Dowson","year":"1982","unstructured":"Dowson, D., Landau, B.: The Fr\u00e9chet distance between multivariate normal distributions. J. Multivar. Anal. 12(3), 450\u2013455 (1982)","journal-title":"J. Multivar. Anal."},{"key":"7_CR3","unstructured":"European Values Study: Integrated Dataset (EVS 2017). GESIS Data Archive, Cologne. ZA7500 Data file Version 4.0.0 (2020)"},{"issue":"12","key":"7_CR4","doi-asserted-by":"publisher","first-page":"1923","DOI":"10.1007\/s10994-018-5717-1","volume":"107","author":"R Flamary","year":"2018","unstructured":"Flamary, R., Cuturi, M., Courty, N., Rakotomamonjy, A.: Wasserstein discriminant analysis. Mach. Learn. 107(12), 1923\u20131945 (2018). https:\/\/doi.org\/10.1007\/s10994-018-5717-1","journal-title":"Mach. Learn."},{"key":"7_CR5","unstructured":"Goldberger, J., Hinton, G.E., Roweis, S., Salakhutdinov, R.R.: Neighbourhood components analysis. In: Advances in Neural Information Processing Systems 17 (2004)"},{"key":"7_CR6","unstructured":"G\u00f6rtz, A.: Sozialstrukturelle Ursachen f\u00fcr Wechselwahl: Warum wechseln W\u00e4hlerInnen von der SPD zur AfD? Social Science Open Access Repository (2020)"},{"issue":"1","key":"7_CR7","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1007\/s12532-017-0130-5","volume":"10","author":"Q Huangfu","year":"2018","unstructured":"Huangfu, Q., Hall, J.J.: Parallelizing the dual revised simplex method. Math. Program. Comput. 10(1), 119\u2013142 (2018)","journal-title":"Math. Program. Comput."},{"key":"7_CR8","unstructured":"Jung, S., Keuper, M.: Internalized Biases in Fr\u00e9chet inception distance. In: NeurIPS 2021 Workshop on Distribution Shifts: Connecting Methods and Applications (2021)"},{"issue":"4","key":"7_CR9","first-page":"363","volume":"6","author":"LV Kantorovich","year":"1939","unstructured":"Kantorovich, L.V.: The mathematical method of production planning and organization. Manage. Sci. 6(4), 363\u2013422 (1939)","journal-title":"Manage. Sci."},{"key":"7_CR10","doi-asserted-by":"publisher","unstructured":"Karp, R.M.: Reducibility among combinatorial problems. In: Miller, R.E., Thatcher, J.W., Bohlinger, J.D. (eds.) Complexity of Computer Computations. The IBM Research Symposia Series, pp. 85\u2013103. Springer, Boston (1972). https:\/\/doi.org\/10.1007\/978-1-4684-2001-2_9","DOI":"10.1007\/978-1-4684-2001-2_9"},{"issue":"2","key":"7_CR11","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1038\/s41587-020-00809-z","volume":"39","author":"D Kobak","year":"2021","unstructured":"Kobak, D., Linderman, G.C.: Initialization is critical for preserving global data structure in both t-SNE and UMAP. Nat. Biotechnol. 39(2), 156\u2013157 (2021)","journal-title":"Nat. Biotechnol."},{"issue":"1","key":"7_CR12","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1214\/16-AOAS904","volume":"10","author":"D Kobak","year":"2016","unstructured":"Kobak, D., Shpilkin, S., Pshenichnikov, M.S.: Integer percentages as electoral falsification fingerprints. Ann. Appl. Stat. 10(1), 54\u201373 (2016)","journal-title":"Ann. Appl. Stat."},{"issue":"4","key":"7_CR13","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1111\/j.1740-9713.2016.00936.x","volume":"13","author":"D Kobak","year":"2016","unstructured":"Kobak, D., Shpilkin, S., Pshenichnikov, M.S.: Statistical fingerprints of electoral fraud? Significance 13(4), 20\u201323 (2016)","journal-title":"Significance"},{"key":"7_CR14","unstructured":"Van der Maaten, L., Hinton, G.: Visualizing data using t-SNE. J. Mach. Learn. Res. 9(11), 2579\u20132605 (2008)"},{"key":"7_CR15","unstructured":"McInnes, L., John Healy, J.M.: UMAP: uniform manifold approximation and projection for dimension reduction. arXiv (2020)"},{"issue":"4","key":"7_CR16","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1007\/s10208-011-9093-5","volume":"11","author":"F M\u00e9moli","year":"2011","unstructured":"M\u00e9moli, F.: Gromov-Wasserstein distances and the metric approach to object matching. Found. Comput. Math. 11(4), 417\u2013487 (2011)","journal-title":"Found. Comput. Math."},{"key":"7_CR17","doi-asserted-by":"crossref","unstructured":"Poli\u010dar, P.G., Stra\u017ear, M., Zupan, B.: openTSNE: a modular Python library for t-SNE dimensionality reduction and embedding. BioRxiv (2019)","DOI":"10.1101\/731877"},{"issue":"336","key":"7_CR18","doi-asserted-by":"publisher","first-page":"846","DOI":"10.1080\/01621459.1971.10482356","volume":"66","author":"WM Rand","year":"1971","unstructured":"Rand, W.M.: Objective criteria for the evaluation of clustering methods. J. Am. Stat. Assoc. 66(336), 846\u2013850 (1971)","journal-title":"J. Am. Stat. Assoc."},{"issue":"1","key":"7_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-019-41695-z","volume":"9","author":"VA Traag","year":"2019","unstructured":"Traag, V.A., Waltman, L., Van Eck, N.J.: From Louvain to Leiden: guaranteeing well-connected communities. Sci. Rep. 9(1), 1\u201312 (2019)","journal-title":"Sci. Rep."},{"key":"7_CR20","doi-asserted-by":"publisher","unstructured":"Villani, C.: The Wasserstein distances. In: Optimal Transport. Grundlehren der mathematischen Wissenschaften, vol. 338, pp. 93\u2013111. Springer, Heidelberg (2009). https:\/\/doi.org\/10.1007\/978-3-540-71050-9_6","DOI":"10.1007\/978-3-540-71050-9_6"},{"key":"7_CR21","unstructured":"Wolberg, W.: Breast cancer Wisconsin (Original). UCI Machine Learning Repository (1992)"}],"container-title":["Lecture Notes in Computer Science","Machine Learning and Knowledge Discovery in Databases"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-031-26387-3_7","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,16]],"date-time":"2023-03-16T15:14:40Z","timestamp":1678979680000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-031-26387-3_7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023]]},"ISBN":["9783031263866","9783031263873"],"references-count":21,"URL":"https:\/\/doi.org\/10.1007\/978-3-031-26387-3_7","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"type":"print","value":"0302-9743"},{"type":"electronic","value":"1611-3349"}],"subject":[],"published":{"date-parts":[[2023]]},"assertion":[{"value":"17 March 2023","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"ECML PKDD","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Joint European Conference on Machine Learning and Knowledge Discovery in Databases","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Grenoble","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"France","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2022","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"19 September 2022","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"23 September 2022","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"22","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"ecml2022","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/2022.ecmlpkdd.org\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Double-blind","order":1,"name":"type","label":"Type","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"CMT","order":2,"name":"conference_management_system","label":"Conference Management System","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"1060","order":3,"name":"number_of_submissions_sent_for_review","label":"Number of Submissions Sent for Review","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"236","order":4,"name":"number_of_full_papers_accepted","label":"Number of Full Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"0","order":5,"name":"number_of_short_papers_accepted","label":"Number of Short Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"22% - The value is computed by the equation \"Number of Full Papers Accepted \/ Number of Submissions Sent for Review * 100\" and then rounded to a whole number.","order":6,"name":"acceptance_rate_of_full_papers","label":"Acceptance Rate of Full Papers","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"3-4","order":7,"name":"average_number_of_reviews_per_paper","label":"Average Number of Reviews per Paper","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"3-4","order":8,"name":"average_number_of_papers_per_reviewer","label":"Average Number of Papers per Reviewer","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"No","order":9,"name":"external_reviewers_involved","label":"External Reviewers Involved","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"17 demo track papers have been accepted from 28 submissions","order":10,"name":"additional_info_on_review_process","label":"Additional Info on Review Process","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}}]}}