{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T03:51:27Z","timestamp":1772164287951,"version":"3.50.1"},"reference-count":44,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2021,7,1]],"date-time":"2021-07-01T00:00:00Z","timestamp":1625097600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Digital"],"abstract":"<jats:p>This article presents a systematic literature review on quantifying the proximity between independently trained monolingual word embedding spaces. A search was carried out in the broader context of inducing bilingual lexicons from cross-lingual word embeddings, especially for low-resource languages. The returned articles were then classified. Cross-lingual word embeddings have drawn the attention of researchers in the field of natural language processing (NLP). Although existing methods have yielded satisfactory results for resource-rich languages and languages related to them, some researchers have pointed out that the same is not true for low-resource and distant languages. In this paper, we report the research on methods proposed to provide better representation for low-resource and distant languages in the cross-lingual word embedding space.<\/jats:p>","DOI":"10.3390\/digital1030011","type":"journal-article","created":{"date-parts":[[2021,7,1]],"date-time":"2021-07-01T05:00:10Z","timestamp":1625115610000},"page":"145-161","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Leveraging Vector Space Similarity for Learning Cross-Lingual Word Embeddings: A Systematic Review"],"prefix":"10.3390","volume":"1","author":[{"given":"Kowshik","family":"Bhowmik","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering and Computer Science, University of Cincinnati, Cincinnati, OH 45221, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anca","family":"Ralescu","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Computer Science, University of Cincinnati, Cincinnati, OH 45221, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1613\/jair.1.11640","article-title":"A survey of cross-lingual word embedding models","volume":"65","author":"Ruder","year":"2019","journal-title":"J. Artif. Intell. Res."},{"key":"ref_2","unstructured":"Mikolov, T., Quoc, V.L., and Sutskever, I. (2013). Exploiting similarities among languages for machine translation. arXiv."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Xing, C., Wang, D., Liu, C., and Lin, Y. (June, January 31). Normalized word embedding and orthogonal transform for bilingual word translation. Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Denver, CO, USA.","DOI":"10.3115\/v1\/N15-1104"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Artetxe, M., Labaka, G., and Agirre, E. (2016, January 1\u20135). Learning principled bilingual mappings of word embeddings while preserving monolingual invariance. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, TX, USA.","DOI":"10.18653\/v1\/D16-1250"},{"key":"ref_5","unstructured":"Artetxe, M., Labaka, G., and Agirre, E. (August, January 30). Learning bilingual word embeddings with (almost) no bilingual data. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, Volume 1: Long Papers, Vancouver, BC, Canada."},{"key":"ref_6","unstructured":"Smith, S.L., Turban, D.H.P., Hamblin, S., and Hammerla, N.Y. (2017). Offline bilingual word vectors, orthogonal transformations and the inverted softmax. arXiv."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"S\u00f8gaard, A., Ruder, S., and Vuli\u0107, I. (2018). On the limitations of unsupervised bilingual dictionary induction. arXiv.","DOI":"10.18653\/v1\/P18-1072"},{"key":"ref_8","unstructured":"Conneau, A., Lample, G., Ranzato, M., Denoyer, L., and J\u00e9gou, H. (2017). Word Translation without Parallel Data. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Artetxe, M., Labaka, G., and Agirre, E. (2018). A robust self-learning method for fully unsupervised cross-lingual mappings of word embeddings. arXiv.","DOI":"10.18653\/v1\/P18-1073"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhang, M., Liu, Y., Luan, H., and Sun, M. (2017, January 7\u201311). Earth mover\u2019s distance minimization for unsupervised bilingual lexicon induction. Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, Copenhagen, Denmark.","DOI":"10.18653\/v1\/D17-1207"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Vuli\u0107, I., Glava\u0161, G., Reichart, R., and Korhonen, A. (2019). Do we really need fully unsupervised cross-lingual embeddings?. arXiv.","DOI":"10.18653\/v1\/D19-1449"},{"key":"ref_12","unstructured":"(2021, January 27). Advanced Search on Scopus.com. Available online: https:\/\/www.scopus.com\/search\/form.uri?display=advanced."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"264","DOI":"10.7326\/0003-4819-151-4-200908180-00135","article-title":"Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement","volume":"151","author":"Moher","year":"2009","journal-title":"Ann. Int. Med."},{"key":"ref_14","unstructured":"Sharoff, S. (2018, January 7\u201312). Language adaptation experiments via cross-lingual embeddings for related languages. Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki, Japan."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Alvarez-Melis, D., and Jaakkola, T. (2018). Gromov-Wasserstein alignment of word embedding spaces. arXiv.","DOI":"10.18653\/v1\/D18-1214"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1007\/s10208-011-9093-5","article-title":"Gromov\u2013Wasserstein distances and the metric approach to object matching","volume":"11","year":"2011","journal-title":"Found. Comput. Math."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Xu, R., Yang, Y., Otani, N., and Wu, Y. (2018). Unsupervised cross-lingual transfer of word embedding spaces. arXiv.","DOI":"10.18653\/v1\/D18-1268"},{"key":"ref_18","unstructured":"Cuturi, M. (2013, January 5\u201310). Sinkhorn distances: Lightspeed computation of optimal transport. Proceedings of the Advances in Neural Information Processing Systems 26 (NIPS 2013), Lake Tahoe, NV, USA."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Chen, X., and Cardie, C. (2018). Unsupervised multilingual word embeddings. arXiv.","DOI":"10.18653\/v1\/D18-1024"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhang, M., Xu, K., Kawarabayashi, K., Jegelka, S., and Boyd-Graber, J. (2019). Are Girls Neko or Sh\u014djo? Cross-Lingual Alignment of Non-Isomorphic Embeddings with Iterative Normalization. arXiv.","DOI":"10.18653\/v1\/P19-1307"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Patra, B., Ruben, J., Moniz, A., Garg, S., Gormley, M.R., and Neubig, G. (2019). Bilingual lexicon induction with semi-supervision in non-isometric embedding spaces. arXiv.","DOI":"10.18653\/v1\/P19-1018"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zhou, C., Ma, X., Wang, D., and Neubig, G. (2019). Density matching for bilingual word embedding. arXiv.","DOI":"10.18653\/v1\/N19-1161"},{"key":"ref_23","unstructured":"Grave, E., Joulin, A., and Berthet, Q. (2019, January 16\u201318). Unsupervised alignment of embeddings with wasserstein procrustes. Proceedings of the 22nd International Conference on Artificial Intelligence and Statistics, PMLR, Okinawa, Japan."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"571","DOI":"10.1162\/coli_a_00382","article-title":"Semantic drift in multilingual representations","volume":"46","author":"Beinborn","year":"2020","journal-title":"Comput. Linguist."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1016\/j.patrec.2019.11.033","article-title":"Wasserstein GAN based on Autoencoder with back-translation for cross-lingual embedding mappings","volume":"129","author":"Zhang","year":"2020","journal-title":"Pattern Recognit. Lett."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Nakashole, N., and Flauger, R. (2017, January 7\u201311). Knowledge distillation for bilingual dictionary induction. Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, Copenhagen, Denmark.","DOI":"10.18653\/v1\/D17-1264"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Doval, Y., Camacho-Collados, J., Espinosa-Anke, L., and Schockaert, S. (2018). Improving cross-lingual word embeddings by meeting in the middle. arXiv.","DOI":"10.18653\/v1\/D18-1027"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Kementchedjhieva, Y., Ruder, S., Cotterell, R., and S\u00f8gaard, A. (2018). Generalizing procrustes analysis for better bilingual dictionary induction. arXiv.","DOI":"10.18653\/v1\/K18-1021"},{"key":"ref_29","unstructured":"Alaux, J., Grave, E., Cuturi, M., and Joulin, A. (2018). Unsupervised hyperalignment for multilingual word embeddings. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Heyman, G., Verreet, B., Vuli\u0107, I., and Moens, M. (2019, January 2\u20137). Learning unsupervised multilingual word embeddings with incremental multilingual hubs. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Minneapolis, MN, USA.","DOI":"10.18653\/v1\/N19-1188"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1639","DOI":"10.1109\/TASLP.2019.2925973","article-title":"A bilingual adversarial autoencoder for unsupervised bilingual lexicon induction","volume":"27","author":"Bai","year":"2019","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Lian, X., Jain, K., Truszkowski, J., Poupart, P., and Yu, Y. (2020). Unsupervised Multilingual Alignment using Wasserstein Barycenter. arXiv.","DOI":"10.24963\/ijcai.2020\/512"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3197566","article-title":"Improving vector space word representations via kernel canonical correlation analysis","volume":"17","author":"Bai","year":"2018","journal-title":"ACM Trans. Asian Low Resour. Lang. Inf. Process."},{"key":"ref_34","unstructured":"Ammar, W., Mulcaire, G., Tsvetkov, Y., Lample, G., Dyer, C., and Smith, N.A. (2016). Massively multilingual word embeddings. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Huang, L., Cho, K., Zhang, B., Ji, H., and Knight, K. (2018). Multi-lingual common semantic space construction via cluster-consistent word embedding. arXiv.","DOI":"10.18653\/v1\/D18-1023"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1162\/NECO_a_00801","article-title":"Correlational neural networks","volume":"28","author":"Chandar","year":"2016","journal-title":"Neural Comput."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Nakashole, N. (November, January 31). NORMA: Neighborhood sensitive maps for multilingual word embeddings. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1047"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Nakashole, N., and Flauger, R. (2018). Characterizing departures from linearity in word translation. arXiv.","DOI":"10.18653\/v1\/P18-2036"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Moshtaghi, M. (2019, January 3\u20137). Supervised and Nonlinear Alignment of Two Embedding Spaces for Dictionary Induction in Low Resourced Languages. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.","DOI":"10.18653\/v1\/D19-1076"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Fan, Y., Wang, C., Chen, B., Hu, Z., and He, X. (2019, January 2\u20134). SPMM: A Soft Piecewise Mapping Model for Bilingual Lexicon Induction. Proceedings of the 2019 SIAM International Conference on Data Mining, Calgary, AB, Canada.","DOI":"10.1137\/1.9781611975673.28"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Gu, J., Wang, Y., Chen, Y., Cho, K., and Li, V.O.K. (2018). Meta-learning for low-resource neural machine translation. arXiv.","DOI":"10.18653\/v1\/D18-1398"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Anastasopoulos, A., and Neubig, G. (2019). Should All Cross-Lingual Embeddings Speak English?. arXiv.","DOI":"10.18653\/v1\/2020.acl-main.766"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1162\/tacl_a_00051","article-title":"Enriching word vectors with subword information","volume":"5","author":"Bojanowski","year":"2017","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Glavas, G., Litschko, R., Ruder, S., and Vulic, I. (2019). How to (properly) evaluate cross-lingual word embeddings: On strong baselines, comparative analyses, and some misconceptions. arXiv.","DOI":"10.18653\/v1\/P19-1070"}],"container-title":["Digital"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2673-6470\/1\/3\/11\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:24:33Z","timestamp":1760163873000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2673-6470\/1\/3\/11"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,1]]},"references-count":44,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2021,9]]}},"alternative-id":["digital1030011"],"URL":"https:\/\/doi.org\/10.3390\/digital1030011","relation":{},"ISSN":["2673-6470"],"issn-type":[{"value":"2673-6470","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,1]]}}}