{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T14:47:27Z","timestamp":1780411647497,"version":"3.54.1"},"reference-count":51,"publisher":"MIT Press","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Transactions of the Association for Computational Linguistics"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:p>We study the influence of context on sentence acceptability. First we compare the acceptability ratings of sentences judged in isolation, with a relevant context, and with an irrelevant context. Our results show that context induces a cognitive load for humans, which compresses the distribution of ratings. Moreover, in relevant contexts we observe a discourse coherence effect that uniformly raises acceptability. Next, we test unidirectional and bidirectional language models in their ability to predict acceptability ratings. The bidirectional models show very promising results, with the best model achieving a new state-of-the-art for unsupervised acceptability prediction. The two sets of experiments provide insights into the cognitive aspects of sentence processing and central issues in the computational modeling of text and discourse.<\/jats:p>","DOI":"10.1162\/tacl_a_00315","type":"journal-article","created":{"date-parts":[[2020,6,17]],"date-time":"2020-06-17T18:25:54Z","timestamp":1592418354000},"page":"296-310","source":"Crossref","is-referenced-by-count":10,"title":["How Furiously Can Colorless Green Ideas Sleep? Sentence Acceptability in Context"],"prefix":"10.1162","volume":"8","author":[{"given":"Jey Han","family":"Lau","sequence":"first","affiliation":[{"name":"The University of Melbourne"},{"name":"DeepBrain."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carlos","family":"Armendariz","sequence":"additional","affiliation":[{"name":"Queen Mary University of London."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shalom","family":"Lappin","sequence":"additional","affiliation":[{"name":"Queen Mary University of London"},{"name":"University of Gothenburg"},{"name":"King\u2019s College London."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew","family":"Purver","sequence":"additional","affiliation":[{"name":"Queen Mary University of London"},{"name":"Jo\u017eef Stefan Institute."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chang","family":"Shu","sequence":"additional","affiliation":[{"name":"University of Nottingham Ningbo China"},{"name":"DeepBrain."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","reference":[{"key":"bib1","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780199243709.001.0001","volume-title":"Core Syntax: A Minimalist Approach","author":"Adger David","year":"2003"},{"key":"bib2","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1037\/0003-066X.51.4.355","volume":"51","author":"Anderson John R.","year":"1996","journal-title":"American Psychologist"},{"key":"bib3","volume-title":"Logics of Conversation","author":"Asher Nicholas","year":"2003"},{"key":"bib4","first-page":"1137","volume":"3","author":"Bengio Yoshua","year":"2003","journal-title":"The Journal of Machine Learning Research"},{"key":"bib5","first-page":"456","volume-title":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (ACL 2018)","author":"Bernardy Jean-Philippe","year":"2018"},{"key":"bib6","first-page":"279","volume-title":"Cognition and the Development of Language","author":"Bever Thomas G.","year":"1970"},{"key":"bib7","doi-asserted-by":"crossref","first-page":"165","DOI":"10.18653\/v1\/W19-0414","volume-title":"Proceedings of the 13th International Conference on Computational Semantics - Long Papers","author":"Bizzoni Yuri","year":"2019"},{"key":"bib8","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/0024-3841(68)90036-3","volume":"21","author":"Bolinger Dwight","year":"1968","journal-title":"Lingua"},{"issue":"3","key":"bib9","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1007\/s11168-007-9033-3","volume":"5","author":"Cann Ronnie","year":"2007","journal-title":"Research on Language and Computation"},{"key":"bib10","first-page":"240","volume":"10","author":"Causse Micka\u00ebl","year":"2016","journal-title":"Frontiers in Human Neuroscience"},{"issue":"3","key":"bib11","doi-asserted-by":"crossref","first-page":"1171","DOI":"10.2466\/pms.1994.79.3.1171","volume":"79","author":"Cowart Wayne","year":"1994","journal-title":"Perceptual and Motor Skills"},{"key":"bib12","author":"Dai Zihang","year":"2019","journal-title":"CoRR"},{"key":"bib13","volume-title":"Fuzzy Grammar: A Reader","author":"Denison David","year":"2004"},{"key":"bib14","first-page":"4171","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)","author":"Devlin Jacob","year":"2019"},{"key":"bib15","first-page":"2121","volume":"12","author":"Duchi John","year":"2011","journal-title":"Journal of Machine Learning Research"},{"issue":"4","key":"bib16","doi-asserted-by":"crossref","first-page":"e0194959","DOI":"10.1371\/journal.pone.0194959","volume":"13","author":"Giavazzi Maria","year":"2018","journal-title":"PLoS ONE"},{"key":"bib17","doi-asserted-by":"crossref","DOI":"10.1093\/acprof:oso\/9780199697922.001.0001","volume-title":"The Interactive Stance: Meaning for Conversation","author":"Ginzburg Jonathan","year":"2012"},{"key":"bib18","author":"Graham Yvette","year":"2019","journal-title":"CoRR"},{"issue":"187","key":"bib19","first-page":"5","volume":"15","author":"Greenbaum Sidney","year":"1976","journal-title":"Linguistics"},{"key":"bib20","first-page":"3","volume-title":"Proceedings of the 2nd Symposium on Logic and Language","author":"Groenendijk Jeroen","year":"1990"},{"key":"bib21","unstructured":"Irene Heim. 1982. The Semantics of Definite and Indefinite Noun Phrases. Ph.D. thesis, University of Massachusetts at Amherst."},{"key":"bib22","doi-asserted-by":"publisher","DOI":"10.1162\/COLI_a_00237"},{"key":"bib23","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"issue":"2","key":"bib24","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1017\/S1366728917000050","volume":"21","author":"Ito Aine","year":"2018","journal-title":"Bilingualism: Language and Cognition"},{"key":"bib25","volume-title":"From Discourse To Logic","author":"Kamp Hans","year":"1993"},{"key":"bib26","doi-asserted-by":"crossref","first-page":"284","DOI":"10.18653\/v1\/P18-1027","volume-title":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Khandelwal Urvashi","year":"2018"},{"key":"bib27","author":"Kingma Diederik P.","year":"2014","journal-title":"CoRR"},{"key":"bib28","doi-asserted-by":"crossref","first-page":"66","DOI":"10.18653\/v1\/D18-2012","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing: System Demonstrations","author":"Kudo Taku","year":"2018"},{"key":"bib29","first-page":"355","volume-title":"Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Lau Jey Han","year":"2017"},{"key":"bib30","first-page":"1618","volume-title":"Proceedings of the Joint conference of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing (ACL-IJCNLP 2015)","author":"Lau Jey Han","year":"2015"},{"key":"bib31","first-page":"1202","volume":"41","author":"Lau Jey Han","year":"2017","journal-title":"Cognitive Science"},{"issue":"3","key":"bib32","first-page":"243","volume":"8","author":"Mann William","year":"1988","journal-title":"Text"},{"key":"bib33","first-page":"55","volume-title":"Association for Computational Linguistics (ACL) System Demonstrations","author":"Manning Christopher D.","year":"2014"},{"key":"bib34","unstructured":"Andrew Kachites McCallum. 2002. Mallet: A machine learning for language toolkit.http:\/\/mallet.cs.umass.edu."},{"key":"bib35","first-page":"1045","volume-title":"INTERSPEECH 2010, 11th Annual Conference of the International Speech Communication Association","author":"Mikolov Tom\u00e1\u0161","year":"2010"},{"key":"bib36","doi-asserted-by":"crossref","first-page":"561","DOI":"10.1007\/978-3-642-42054-2_70","volume-title":"Neural Information Processing","author":"Park Hyangsook","year":"2013"},{"key":"bib37","first-page":"959","volume-title":"Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Pauls Adam","year":"2012"},{"key":"bib38","unstructured":"Alec Radford, Jeff Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners."},{"issue":"4","key":"bib39","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1111\/j.1551-6709.2010.01165.x","volume":"35","author":"Reitter Daivd","year":"2011","journal-title":"Cognitive Science"},{"key":"bib40","doi-asserted-by":"crossref","first-page":"1715","DOI":"10.18653\/v1\/P16-1162","volume-title":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Sennrich Rico","year":"2016"},{"key":"bib41","doi-asserted-by":"crossref","first-page":"1497","DOI":"10.1016\/j.lingua.2004.07.002","volume":"115","author":"Sorace Antonella","year":"2005","journal-title":"Lingua"},{"key":"bib42","doi-asserted-by":"crossref","first-page":"123","DOI":"10.5964\/bioling.8597","volume":"1","author":"Sprouse Jon","year":"2007","journal-title":"Biolinguistics"},{"issue":"2","key":"bib43","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1207\/s15516709cog1202_4","volume":"12","author":"Sweller John","year":"1988","journal-title":"Cognitive Science"},{"key":"bib44","first-page":"5998","volume-title":"Advances in Neural Information Processing Systems 30","author":"Vaswani Ashish","year":"2017"},{"key":"bib45","doi-asserted-by":"crossref","first-page":"30","DOI":"10.18653\/v1\/W19-2304","volume-title":"Proceedings of the Workshop on Methods for Optimizing and Evaluating Neural Language Generation","author":"Wang Alex","year":"2019"},{"issue":"6","key":"bib46","doi-asserted-by":"crossref","first-page":"714","DOI":"10.1016\/0749-596X(87)90111-2","volume":"26","author":"Warner John","year":"1987","journal-title":"Journal of Memory and Language"},{"key":"bib47","author":"Warstadt Alex","year":"2018","journal-title":"CoRR"},{"key":"bib48","author":"Yonghui Wu","year":"2016","journal-title":"CoRR"},{"key":"bib49","author":"Yang Zhilin","year":"2019","journal-title":"CoRR"},{"key":"bib50","first-page":"19","volume-title":"Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV)","author":"Zhu Yukun","year":"2015"},{"issue":"1","key":"bib51","doi-asserted-by":"crossref","first-page":"73","DOI":"10.5334\/gjgl.438","volume":"3","author":"Zlogar Christina","year":"2018","journal-title":"Glossa"}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/tacl_a_00315","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,7]],"date-time":"2024-08-07T21:05:59Z","timestamp":1723064759000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/96455"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12]]},"references-count":51,"alternative-id":["10.1162\/tacl_a_00315"],"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00315","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12]]}}}