{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,11]],"date-time":"2025-12-11T07:37:17Z","timestamp":1765438637102},"reference-count":72,"publisher":"MIT Press - Journals","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Transactions of the Association for Computational Linguistics"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:p> In this paper, we propose LexSub, a novel approach towards unifying lexical and distributional semantics. We inject knowledge about lexical-semantic relations into distributional word embeddings by defining subspaces of the distributional vector space in which a lexical relation should hold. Our framework can handle symmetric attract and repel relations (e.g., synonymy and antonymy, respectively), as well as asymmetric relations (e.g., hypernymy and meronomy). In a suite of intrinsic benchmarks, we show that our model outperforms previous approaches on relatedness tasks and on hypernymy classification and detection, while being competitive on word similarity tasks. It also outperforms previous systems on extrinsic classification tasks that benefit from exploiting lexical relational cues. We perform a series of analyses to understand the behaviors of our model. <jats:sup>1<\/jats:sup> <\/jats:p><jats:p> Code available at https:\/\/github.com\/aishikchakraborty\/LexSub . <\/jats:p>","DOI":"10.1162\/tacl_a_00316","type":"journal-article","created":{"date-parts":[[2020,6,17]],"date-time":"2020-06-17T18:25:54Z","timestamp":1592418354000},"page":"311-329","source":"Crossref","is-referenced-by-count":6,"title":["Learning Lexical Subspaces in a Distributional Vector Space"],"prefix":"10.1162","volume":"8","author":[{"given":"Kushal","family":"Arora","sequence":"first","affiliation":[{"name":"School of Computer Science, McGill University Qu\u00e9bec AI Instuite (Mila)."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aishik","family":"Chakraborty","sequence":"additional","affiliation":[{"name":"School of Computer Science, McGill University Qu\u00e9bec AI Instuite (Mila)."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jackie C. K.","family":"Cheung","sequence":"additional","affiliation":[{"name":"School of Computer Science, McGill University Qu\u00e9bec AI Instuite (Mila)."}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"key":"bib1","first-page":"19","volume-title":"Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics on - NAACL \u201909","author":"Agirre Eneko","year":"2009"},{"key":"bib2","doi-asserted-by":"crossref","first-page":"1645","DOI":"10.18653\/v1\/P17-1151","volume-title":"Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Athiwaratkun Ben","year":"2017"},{"key":"bib3","first-page":"5360","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Baevski Alexei","year":"2019"},{"issue":"98","key":"bib4","first-page":"86","volume-title":"Proceedings of the 17th International Conference on Computational Linguistics - Volume 1","author":"Baker Collin F.","year":"1998"},{"key":"bib5","first-page":"23","volume-title":"Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics","author":"Baroni Marco","year":"2012"},{"issue":"11","key":"bib6","first-page":"1","volume-title":"Proceedings of the GEMS 2011 Workshop on GEometrical Models of Natural Language Semantics","author":"Baroni Marco","year":"2011"},{"issue":"14","key":"bib7","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1007\/978-3-662-44848-9_9","volume-title":"Proceedings of the 2014th European Conference on Machine Learning and Knowledge Discovery in Databases - Volume Part I","author":"Bian Jiang","year":"2014"},{"key":"bib8","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00051"},{"key":"bib9","first-page":"2690","volume-title":"Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence","author":"Bollegala Danushka","year":"2016"},{"key":"bib10","doi-asserted-by":"crossref","first-page":"632","DOI":"10.18653\/v1\/D15-1075","volume-title":"Conference Proceedings - EMNLP 2015: Conference on Empirical Methods in Natural Language Processing","author":"Bowman Samuel","year":"2015"},{"key":"bib11","author":"Bradbury James","year":"2016","journal-title":"arXiv:1611.01576 [cs]"},{"issue":"1","key":"bib12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1613\/jair.4135","volume":"49","author":"Bruni Elia","year":"2014","journal-title":"Journal of Artificial Intelligence Research"},{"key":"bib13","first-page":"485","volume-title":"Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers)","author":"Chang Haw-Shiuan","year":"2018"},{"key":"bib14","first-page":"2121","volume":"12","author":"Duchi John","year":"2011","journal-title":"Journal of Machine Learning Research"},{"key":"bib15","first-page":"1606","volume-title":"Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Faruqui Manaal","year":"2015"},{"key":"bib16","author":"Firth J. R.","year":"1957","journal-title":"Studies in Linguistic Analysis"},{"key":"bib17","author":"Fried Daniel","year":"2014","journal-title":"arXiv:1412.4369 [cs]"},{"key":"bib18","first-page":"758","volume-title":"Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Ganitkevitch Juri","year":"2013"},{"key":"bib19","author":"Gardner Matt","year":"2018","journal-title":"arXiv:1803. 07640 [cs]"},{"key":"bib20","doi-asserted-by":"crossref","first-page":"2173","DOI":"10.18653\/v1\/D16-1235","volume-title":"Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing","author":"Gerz Daniela","year":"2016"},{"key":"bib21","doi-asserted-by":"crossref","first-page":"34","DOI":"10.18653\/v1\/P18-1004","volume-title":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Glava\u0161 Goran","year":"2018"},{"issue":"2","key":"bib22","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1080\/00437956.1954.11659520","volume":"10","author":"Harris Zellig S.","year":"1954","journal-title":"WORD"},{"key":"bib23","doi-asserted-by":"publisher","DOI":"10.1162\/COLI_a_00237"},{"key":"bib24","first-page":"683","volume-title":"Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Jauhar Sujay Kumar","year":"2015"},{"key":"bib25","author":"Jo Hwiyeol","year":"2018","journal-title":"arXiv:1808. 07337 [cs]"},{"key":"bib26","first-page":"24","volume-title":"Proceedings of The Third Workshop on Representation Learning for NLP","author":"Jo Hwiyeol","year":"2018"},{"key":"bib27","doi-asserted-by":"crossref","first-page":"2044","DOI":"10.18653\/v1\/D15-1242","volume-title":"Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing","author":"Kiela Douwe","year":"2015"},{"key":"bib28","first-page":"119","volume-title":"Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers)","author":"Kiela Douwe","year":"2015"},{"key":"bib29","author":"Kingma Diederik P.","year":"2014","journal-title":"arXiv:1412.6980 [cs]"},{"issue":"03","key":"bib30","first-page":"1492","volume-title":"Proceedings of the 18th International Joint Conference on Artificial Intelligence","author":"Lin Dekang","year":"2003"},{"key":"bib31","first-page":"1501","volume-title":"Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)","author":"Liu Quan","year":"2015"},{"key":"bib32","first-page":"4487","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Liu Xiaodong","year":"2019"},{"key":"bib33","first-page":"6294","volume-title":"Advances in Neural Information Processing Systems 30","author":"McCann Bryan","year":"2017"},{"key":"bib34","author":"Merity Stephen","year":"2016","journal-title":"arXiv:1609.07843 [cs]"},{"key":"bib35","author":"Mikolov Tomas","year":"2013","journal-title":"arXiv:1301.3781 [cs]"},{"key":"bib36","volume-title":"Eleventh Annual Conference of the International Speech Communication Association","author":"Mikolov Tomas","year":"2010"},{"issue":"11","key":"bib37","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1145\/219717.219748","volume":"38","author":"Miller George A.","year":"1995","journal-title":"Communications of ACM"},{"key":"bib38","first-page":"142","volume-title":"Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Mrk\u0161i\u0107 Nikola","year":"2016"},{"issue":"0","key":"bib39","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1162\/tacl_a_00063","volume":"5","author":"Mrk\u0161i\u0107 Nikola","year":"2017","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"bib40","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/j.artint.2012.07.001","volume":"193","author":"Navigli Roberto","year":"2012","journal-title":"Artificial Intelligence"},{"key":"bib41","first-page":"233","volume-title":"Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing","author":"Nguyen Kim Anh","year":"2017"},{"key":"bib42","doi-asserted-by":"crossref","first-page":"454","DOI":"10.18653\/v1\/P16-2074","volume-title":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)","author":"Nguyen Kim Anh","year":"2016"},{"key":"bib43","first-page":"6338","volume-title":"Advances in Neural Information Processing Systems 30","author":"Nickel Maximillian","year":"2017"},{"key":"bib44","first-page":"984","volume-title":"Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Ono Masataka","year":"2015"},{"key":"bib45","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00108"},{"key":"bib46","doi-asserted-by":"crossref","first-page":"2249","DOI":"10.18653\/v1\/D16-1244","volume-title":"Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing","author":"Parikh Ankur","year":"2016"},{"key":"bib47","first-page":"425","volume-title":"Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers)","author":"Pavlick Ellie","year":"2015"},{"key":"bib48","doi-asserted-by":"crossref","first-page":"1532","DOI":"10.3115\/v1\/D14-1162","volume-title":"Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Pennington Jeffrey","year":"2014"},{"key":"bib49","first-page":"2227","volume-title":"Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers)","author":"Peters Matthew","year":"2018"},{"key":"bib50","doi-asserted-by":"crossref","first-page":"2383","DOI":"10.18653\/v1\/D16-1264","volume-title":"Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing","author":"Rajpurkar Pranav","year":"2016"},{"key":"bib51","doi-asserted-by":"crossref","first-page":"358","DOI":"10.18653\/v1\/P18-2057","volume-title":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)","author":"Roller Stephen","year":"2018"},{"key":"bib52","author":"Rothe Sascha","year":"2016","journal-title":"arXiv:1602. 07572 [cs]"},{"key":"bib53","first-page":"1793","volume-title":"Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)","author":"Rothe Sascha","year":"2015"},{"key":"bib54","first-page":"38","volume-title":"Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, Volume 2: Short Papers","author":"Santus Enrico","year":"2014"},{"key":"bib55","author":"Seo Minjoon","year":"2016","journal-title":"arXiv:1611.01603 [cs]"},{"key":"bib56","doi-asserted-by":"crossref","first-page":"2389","DOI":"10.18653\/v1\/P16-1226","volume-title":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Shwartz Vered","year":"2016"},{"key":"bib57","first-page":"65","volume-title":"Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers","author":"Shwartz Vered","year":"2017"},{"key":"bib58","first-page":"1631","volume-title":"Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing","author":"Socher Richard","year":"2013"},{"key":"bib59","author":"Sun Yu","year":"2019","journal-title":"arXiv:1907. 12412 [cs]"},{"key":"bib60","volume-title":"Thirteenth Annual Conference of the International Speech Communication Association","author":"Sundermeyer Martin","year":"2012"},{"key":"bib61","author":"Tifrea Alexandru","year":"2018","journal-title":"arXiv:1810.06546 [cs]"},{"issue":"03","key":"bib62","doi-asserted-by":"crossref","first-page":"142","DOI":"10.3115\/1119176.1119195","volume-title":"Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003 - Volume 4","author":"Sang Erik F. Tjong Kim","year":"2003"},{"key":"bib63","author":"Vendrov Ivan","year":"2015","journal-title":"arXiv:1511.06361 [cs]"},{"key":"bib64","author":"Vilnis Luke","year":"2014","journal-title":"arXiv:1412.6623 [cs]"},{"key":"bib65","doi-asserted-by":"publisher","DOI":"10.1162\/COLI_a_00301"},{"key":"bib66","author":"Vuli\u0107 Ivan","year":"2017","journal-title":"arXiv: 1710.06371 [cs]"},{"issue":"17","key":"bib67","first-page":"4144","volume-title":"Proceedings of the 26th International Joint Conference on Artificial Intelligence","author":"Wang Zhiguo","year":"2017"},{"key":"bib68","first-page":"2249","volume-title":"Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers","author":"Weeds Julie","year":"2014"},{"key":"bib69","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00143"},{"key":"bib70","first-page":"1219","volume-title":"Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management - CIKM \u201914","author":"Chang Xu","year":"2014"},{"key":"bib71","first-page":"5753","volume-title":"Advances in Neural Information Processing Systems 32","author":"Yang Zhilin","year":"2019"},{"key":"bib72","first-page":"545","volume-title":"Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)","author":"Mo Yu","year":"2014"}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/tacl_a_00316","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:39:38Z","timestamp":1615585178000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/96456"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12]]},"references-count":72,"alternative-id":["10.1162\/tacl_a_00316"],"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00316","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12]]}}}