{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T16:32:45Z","timestamp":1783441965050,"version":"3.54.6"},"reference-count":64,"publisher":"MIT Press","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Transactions of the Association for Computational Linguistics"],"published-print":{"date-parts":[[2019,11]]},"abstract":"<jats:p>Building meaningful phrase representations is challenging because phrase meanings are not simply the sum of their constituent meanings. Lexical composition can shift the meanings of the constituent words and introduce implicit information. We tested a broad range of textual representations for their capacity to address these issues. We found that, as expected, contextualized word representations perform better than static word embeddings, more so on detecting meaning shift than in recovering implicit information, in which their performance is still far from that of humans. Our evaluation suite, consisting of six tasks related to lexical composition effects, can serve future research aiming to improve representations.<\/jats:p>","DOI":"10.1162\/tacl_a_00277","type":"journal-article","created":{"date-parts":[[2019,7,26]],"date-time":"2019-07-26T20:55:26Z","timestamp":1564174526000},"page":"403-419","source":"Crossref","is-referenced-by-count":21,"title":["Still a Pain in the Neck: Evaluating Text Representations on Lexical Composition"],"prefix":"10.1162","volume":"7","author":[{"given":"Vered","family":"Shwartz","sequence":"first","affiliation":[{"name":"Computer Science Department, Bar-Ilan University, Ramat-Gan, Israel."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ido","family":"Dagan","sequence":"additional","affiliation":[{"name":"Computer Science Department, Bar-Ilan University, Ramat-Gan, Israel."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","reference":[{"key":"bib1","volume-title":"International Conference on Learning Representations (ICLR)","author":"Adi Yossi","year":"2017"},{"key":"bib2","doi-asserted-by":"crossref","first-page":"4860","DOI":"10.18653\/v1\/D18-1523","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Amrami Asaf","year":"2018"},{"issue":"1","key":"bib3","first-page":"2","volume":"37","author":"Asl Fatemeh Mohamadi","year":"2013","journal-title":"TESOL Journal"},{"key":"bib4","doi-asserted-by":"crossref","first-page":"334","DOI":"10.18653\/v1\/W18-5440","volume-title":"Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP","author":"Bacon Geoff","year":"2018"},{"issue":"4","key":"bib5","doi-asserted-by":"crossref","first-page":"398","DOI":"10.1016\/j.csl.2005.02.004","volume":"19","author":"Baldwin Timothy","year":"2005","journal-title":"Computer Speech & Language"},{"key":"bib6","first-page":"1183","volume-title":"Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing","author":"Baroni Marco","year":"2010"},{"key":"bib7","doi-asserted-by":"crossref","first-page":"861","DOI":"10.18653\/v1\/P17-1080","volume-title":"Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Belinkov Yonatan","year":"2017"},{"key":"bib8","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00051"},{"key":"bib9","first-page":"35","volume-title":"Proceedings of the 10th International Conference on Computational Semantics (IWCS 2013) \u2013 Long Papers","author":"Boleda Gemma","year":"2013"},{"key":"bib10","volume-title":"Twenty-Ninth AAAI Conference on Artificial Intelligence","author":"Chen Wei-Te","year":"2015"},{"key":"bib11","doi-asserted-by":"crossref","first-page":"2126","DOI":"10.18653\/v1\/P18-1198","volume-title":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Conneau Alexis","year":"2018"},{"issue":"2","key":"bib12","doi-asserted-by":"crossref","first-page":"233","DOI":"10.2307\/3587719","volume":"33","author":"Cooper Thomas C","year":"1999","journal-title":"TESOL Quarterly"},{"key":"bib13","doi-asserted-by":"crossref","first-page":"1986","DOI":"10.18653\/v1\/P16-1187","volume-title":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Cordeiro Silvio","year":"2016"},{"key":"bib14","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-031-02151-0","volume-title":"Recognizing Textual Entailment","author":"Dagan Ido","year":"2013"},{"key":"bib15","first-page":"142","volume-title":"Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 1: Long Papers)","author":"Dalvi Fahim","year":"2017"},{"key":"bib16","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Devlin Jacob","year":"2019"},{"key":"bib17","doi-asserted-by":"crossref","first-page":"27","DOI":"10.18653\/v1\/W16-1604","volume-title":"Proceedings of the 1st Workshop on Representation Learning for NLP","author":"Dima Corina","year":"2016"},{"key":"bib18","first-page":"50","volume-title":"Proceedings of the Workshop on Continuous Vector Space Models and their Compositionality","author":"Dinu Georgiana","year":"2013"},{"key":"bib19","first-page":"1","volume-title":"Proceedings of Workshop for NLP Open Source Software (NLP-OSS)","author":"Gardner Matt","year":"2018"},{"key":"bib20","doi-asserted-by":"crossref","first-page":"240","DOI":"10.18653\/v1\/W18-5426","volume-title":"Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP","author":"Giulianelli Mario","year":"2018"},{"issue":"5","key":"bib21","doi-asserted-by":"crossref","first-page":"602","DOI":"10.1016\/j.neunet.2005.06.042","volume":"18","author":"Graves Alex","year":"2005","journal-title":"Neural Networks"},{"issue":"23","key":"bib22","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1080\/00437956.1954.11659520","volume":"10","author":"Harris Z","year":"1954","journal-title":"Word"},{"key":"bib23","unstructured":"Matthias Hartung. 2015. Distributional Semantic Models of Attribute Meaning in Adjectives and Nouns, Ph.D. thesis, Heidelberg University."},{"key":"bib24","first-page":"54","volume-title":"Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers","author":"Hartung Matthias","year":"2017"},{"key":"bib25","first-page":"138","volume-title":"Second Joint Conference on Lexical and Computational Semantics (*SEM), Volume 2: Proceedings of the Seventh International Workshop on Semantic Evaluation (SemEval 2013)","author":"Hendrickx Iris","year":"2013"},{"key":"bib26","volume-title":"A Modern English Grammar: On Historical Principles","author":"Jespersen Otto","year":"1965"},{"key":"bib27","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Liu Nelson F.","year":"2019"},{"key":"bib28","first-page":"2579","volume":"9","author":"van der Maaten Laurens","year":"2008","journal-title":"Journal of Machine Learning Research"},{"key":"bib29","doi-asserted-by":"crossref","first-page":"327","DOI":"10.18653\/v1\/K15-1035","volume-title":"Proceedings of the Nineteenth Conference on Computational Natural Language Learning","author":"Maillard Jean","year":"2015"},{"key":"bib30","volume-title":"International Conference on Learning Representations (ICLR)","author":"Mikolov Tomas","year":"2013"},{"issue":"8","key":"bib31","doi-asserted-by":"crossref","first-page":"1388","DOI":"10.1111\/j.1551-6709.2010.01106.x","volume":"34","author":"Mitchell Jeff","year":"2010","journal-title":"Cognitive Science"},{"issue":"3","key":"bib32","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1017\/S1351324913000065","volume":"19","author":"Nakov Preslav","year":"2013","journal-title":"Natural Language Engineering"},{"issue":"1","key":"bib33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2200\/S00489ED1V01Y201303HLT019","volume":"6","author":"Nastase Vivi","year":"2013","journal-title":"Synthesis Lectures on Human Language Technologies"},{"issue":"3","key":"bib34","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1353\/lan.1994.0007","volume":"70","author":"Nunberg Geoffrey","year":"1994","journal-title":"Language"},{"key":"bib35","first-page":"621","volume-title":"Proceedings of the 12th Conference of the European Chapter of the ACL (EACL 2009)","author":"S\u00e9aghdha Diarmuid \u00d3","year":"2009"},{"key":"bib36","volume-title":"Autodiff Workshop, NIPS 2017","author":"Paszke Adam","year":"2017"},{"key":"bib37","doi-asserted-by":"crossref","first-page":"2164","DOI":"10.18653\/v1\/P16-1204","volume-title":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Pavlick Ellie","year":"2016"},{"key":"bib38","first-page":"1532","volume-title":"Empirical Methods in Natural Language Processing (EMNLP)","author":"Pennington Jeffrey","year":"2014"},{"key":"bib39","first-page":"2227","volume-title":"Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers)","author":"Peters Matthew","year":"2018"},{"key":"bib40","first-page":"636","volume-title":"Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing","author":"Pichotta Karl","year":"2013"},{"key":"bib41","first-page":"503","volume-title":"Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers","author":"Poliak Adam","year":"2017"},{"key":"bib43","first-page":"210","volume-title":"Proceedings of 5th International Joint Conference on Natural Language Processing","author":"Reddy Siva","year":"2011"},{"key":"bib44","first-page":"1","volume-title":"International Conference on Intelligent Text Processing and Computational Linguistics","author":"Sag Ivan A.","year":"2002"},{"key":"bib45","first-page":"977","volume-title":"Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Salehi Bahar","year":"2015"},{"key":"bib46","first-page":"1537","volume-title":"Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Schneider Nathan","year":"2015"},{"issue":"1","key":"bib47","first-page":"310","volume":"2","author":"Senaldi Marco Silvio Giuseppe","year":"2019","journal-title":"Proceedings of the Society for Computation in Linguistics"},{"key":"bib48","first-page":"376","volume-title":"Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers","author":"Sennrich Rico","year":"2017"},{"key":"bib49","first-page":"1526","volume-title":"Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing","author":"Shi Xing","year":"2016"},{"key":"bib50","doi-asserted-by":"crossref","first-page":"1200","DOI":"10.18653\/v1\/P18-1111","volume-title":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Shwartz Vered","year":"2018"},{"key":"bib51","first-page":"218","volume-title":"Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers)","author":"Shwartz Vered","year":"2018"},{"key":"bib52","first-page":"1201","volume-title":"Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning","author":"Socher Richard","year":"2012"},{"key":"bib53","doi-asserted-by":"crossref","first-page":"1533","DOI":"10.18653\/v1\/D18-1182","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Stanovsky Gabriel","year":"2018"},{"key":"bib54","first-page":"636","volume-title":"Proceedings of the International Conference Recent Advances in Natural Language Processing","author":"Surtani Nitesh","year":"2015"},{"key":"bib55","volume-title":"International Conference on Learning Representations","author":"Tenney Ian","year":"2019"},{"key":"bib56","volume-title":"Semantically-enriched Parsing for Natural Language Understanding","author":"Tratz Stephen","year":"2011"},{"key":"bib57","first-page":"31","volume-title":"Proceedings of the Workshop on Multiword Expressions: from Parsing and Generation to the Real World","author":"Yuancheng Tu","year":"2011"},{"key":"bib58","first-page":"65","volume-title":"*SEM 2012: The First Joint Conference on Lexical and Computational Semantics \u2013 Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation (SemEval 2012)","author":"Yuancheng Tu","year":"2012"},{"key":"bib59","first-page":"5998","volume-title":"Advances in Neural Information Processing Systems","author":"Vaswani Ashish","year":"2017"},{"key":"bib60","first-page":"289","volume-title":"Proceedings of the International Conference Recent Advances in Natural Language Processing 2011","author":"Vincze Veronika","year":"2011"},{"key":"bib61","volume-title":"International Conference on Learning Representations (ICLR)","author":"Wieting John","year":"2016"},{"key":"bib62","first-page":"274","volume-title":"Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing","author":"Wieting John","year":"2017"},{"key":"bib63","first-page":"133","volume-title":"Proceedings of the 32nd annual meeting on Association for Computational Linguistics","author":"Zhibiao Wu","year":"1994"},{"key":"bib64","first-page":"1263","volume-title":"Proceedings of the 23rd International Conference on Computational Linguistics","author":"Zanzotto Fabio Massimo","year":"2010"},{"key":"bib65","doi-asserted-by":"crossref","first-page":"93","DOI":"10.18653\/v1\/D18-1009","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Zellers Rowan","year":"2018"}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/tacl_a_00277","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,24]],"date-time":"2022-09-24T18:29:27Z","timestamp":1664044167000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/43521"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11]]},"references-count":64,"alternative-id":["10.1162\/tacl_a_00277"],"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00277","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11]]}}}