{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T13:02:10Z","timestamp":1760101330892},"reference-count":62,"publisher":"MIT Press - Journals","license":[{"start":{"date-parts":[[2021,8,6]],"date-time":"2021-08-06T00:00:00Z","timestamp":1628208000000},"content-version":"vor","delay-in-days":217,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,8,2]]},"abstract":"<jats:p>While numerous attempts have been made to jointly parse syntax and semantics, high performance in one domain typically comes at the price of performance in the other. This trade-off contradicts the large body of research focusing on the rich interactions at the syntax\u2013semantics interface. We explore multiple model architectures that allow us to exploit the rich syntactic and semantic annotations contained in the Universal Decompositional Semantics (UDS) dataset, jointly parsing Universal Dependencies and UDS to obtain state-of-the-art results in both formalisms. We analyze the behavior of a joint model of syntax and semantics, finding patterns supported by linguistic theory at the syntax\u2013semantics interface. We then investigate to what degree joint modeling generalizes to a multilingual setting, where we find similar trends across 8 languages.<\/jats:p>","DOI":"10.1162\/tacl_a_00396","type":"journal-article","created":{"date-parts":[[2021,9,20]],"date-time":"2021-09-20T19:29:28Z","timestamp":1632166168000},"page":"756-773","update-policy":"http:\/\/dx.doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":3,"title":["Joint Universal Syntactic and Semantic Parsing"],"prefix":"10.1162","volume":"9","author":[{"given":"Elias","family":"Stengel-Eskin","sequence":"first","affiliation":[{"name":"Johns Hopkins University, United States"}]},{"given":"Kenton","family":"Murray","sequence":"additional","affiliation":[{"name":"Johns Hopkins University, United States"}]},{"given":"Sheng","family":"Zhang","sequence":"additional","affiliation":[{"name":"Microsoft Research, United States"}]},{"given":"Aaron Steven","family":"White","sequence":"additional","affiliation":[{"name":"University of Rochester, United States"}]},{"given":"Benjamin","family":"Van Durme","sequence":"additional","affiliation":[{"name":"Johns Hopkins University, United States"}]}],"member":"281","published-online":{"date-parts":[[2021,8,2]]},"reference":[{"key":"2021080620254001800_bib1","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1016\/j.cognition.2017.02.009","article-title":"Bootstrapping language acquisition","volume":"164","author":"Abend","year":"2017","journal-title":"Cognition"},{"key":"2021080620254001800_bib2","first-page":"228","article-title":"Universal Conceptual Cognitive Annotation (UCCA)","volume-title":"Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Abend","year":"2013"},{"key":"2021080620254001800_bib3","doi-asserted-by":"crossref","first-page":"1699","DOI":"10.18653\/v1\/D15-1198","article-title":"Broad-coverage CCG semantic parsing with AMR","volume-title":"Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing","author":"Artzi","year":"2015"},{"key":"2021080620254001800_bib4","first-page":"178","article-title":"Abstract Meaning Representation for sembanking","volume-title":"Proceedings of the 7th Linguistic Annotation Workshop and Interoperability with Discourse","author":"Banarescu","year":"2013"},{"issue":"1","key":"2021080620254001800_bib5","first-page":"281","article-title":"Random search for hyper-parameter optimization","volume":"13","author":"Bergstra","year":"2012","journal-title":"The Journal of Machine Learning Research"},{"key":"2021080620254001800_bib6","doi-asserted-by":"publisher","first-page":"112","DOI":"10.26615\/978-954-452-056-4_014","article-title":"Exploring graph-algebraic CCG combinators for syntactic- semantic AMR parsing","volume-title":"Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2019)","author":"Beschke","year":"2019"},{"key":"2021080620254001800_bib7","article-title":"English Web Treebank","author":"Bies","year":"2012","journal-title":"Linguistic Data Consortium, Philadelphia, PA"},{"key":"2021080620254001800_bib8","first-page":"748","article-title":"Smatch: An evaluation metric for semantic feature structures","volume-title":"Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)","author":"Cai","year":"2013"},{"issue":"1","key":"2021080620254001800_bib9","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1023\/A:1007379606734","article-title":"Multitask learning","volume":"28","author":"Caruana","year":"1997","journal-title":"Machine Learning"},{"key":"2021080620254001800_bib10","doi-asserted-by":"publisher","first-page":"740","DOI":"10.3115\/v1\/D14-1082","article-title":"A fast and accurate dependency parser using neural networks","volume-title":"Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Chen","year":"2014"},{"key":"2021080620254001800_bib11","article-title":"The Acquisition of Syntax in Children from 5 to 10","author":"Chomsky","year":"1969"},{"key":"2021080620254001800_bib12","first-page":"1396","article-title":"On the shortest arborescence of a directed graph","volume":"14","author":"Chu","year":"1965","journal-title":"Scientia Sinica"},{"key":"2021080620254001800_bib13","doi-asserted-by":"publisher","first-page":"8440","DOI":"10.18653\/v1\/2020.acl-main.747","article-title":"Unsupervised cross-lingual representation learning at scale","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Conneau","year":"2020"},{"issue":"3","key":"2021080620254001800_bib14","doi-asserted-by":"publisher","first-page":"397","DOI":"10.1111\/j.2044-8295.1970.tb01259.x","article-title":"Children are nice to understand: Surface structure clues for the recovery of a deep structure","volume":"61","author":"Cromer","year":"1970","journal-title":"British Journal of Psychology"},{"key":"2021080620254001800_bib15","article-title":"Multilingual BERT README document","author":"Devlin","year":"2018"},{"key":"2021080620254001800_bib16","first-page":"4171","article-title":"BERT: Pre-training of deep bidirectional transformers for language understanding","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)","author":"Devlin","year":"2019"},{"issue":"3","key":"2021080620254001800_bib17","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1353\/lan.1991.0021","article-title":"Thematic proto-roles and argument selection","volume":"67","author":"Dowty","year":"1991","journal-title":"Language"},{"key":"2021080620254001800_bib18","doi-asserted-by":"publisher","DOI":"10.1353\/lan.1991.0021","article-title":"Deep biaffine attention for neural dependency parsing","volume-title":"5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24\u201326, 2017, Conference Track Proceedings","author":"Dozat","year":"2017"},{"issue":"4","key":"2021080620254001800_bib19","doi-asserted-by":"publisher","first-page":"233","DOI":"10.6028\/jres.071B.032","article-title":"Optimum branchings","volume":"71","author":"Edmonds","year":"1967","journal-title":"Journal of Research of the National Bureau of Standards B"},{"key":"2021080620254001800_bib20","doi-asserted-by":"publisher","first-page":"1307","DOI":"10.18653\/v1\/2020.findings-emnlp.117","article-title":"Evaluating models\u2019 local decision boundaries via contrast sets","volume-title":"Findings of the Association for Computational Linguistics: EMNLP 2020","author":"Gardner","year":"2020"},{"key":"2021080620254001800_bib21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18653\/v1\/W18-2501","article-title":"AllenNLP: A deep semantic natural language processing platform","volume-title":"Proceedings of Workshop for NLP Open Source Software (NLP-OSS)","author":"Gardner","year":"2018"},{"key":"2021080620254001800_bib22","article-title":"Is supervised syntactic parsing beneficial for language understanding? an empirical investigation","author":"Glava\u0161","year":"2020","journal-title":"arXiv preprint arXiv:2008.06788"},{"issue":"1","key":"2021080620254001800_bib23","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1207\/s15327817la0101_2","article-title":"The structural sources of verb meanings","volume":"1","author":"Gleitman","year":"1990","journal-title":"Language Acquisition"},{"key":"2021080620254001800_bib24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3115\/1596409.1596411","article-title":"The CoNLL-2009 shared task: Syntactic and semantic dependencies in multiple languages","volume-title":"Proceedings of the Thirteenth Conference on Computational Natural Language Learning (CoNLL 2009): Shared Task","author":"Haji\u010d","year":"2009"},{"key":"2021080620254001800_bib25","doi-asserted-by":"publisher","first-page":"2733","DOI":"10.18653\/v1\/D19-1275","article-title":"Designing and interpreting probes with control tasks","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Hewitt","year":"2019"},{"key":"2021080620254001800_bib26","doi-asserted-by":"publisher","first-page":"3651","DOI":"10.18653\/v1\/P19-1356","article-title":"What does BERT learn about the structure of language?","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Jawahar","year":"2019"},{"key":"2021080620254001800_bib27","doi-asserted-by":"publisher","first-page":"183","DOI":"10.3115\/1596324.1596355","article-title":"Dependency-based syntactic\u2013semantic analysis with PropBank and NomBank","volume-title":"CoNLL 2008: Proceedings of the Twelfth Conference on Computational Natural Language Learning","author":"Johansson","year":"2008"},{"key":"2021080620254001800_bib28","doi-asserted-by":"publisher","first-page":"2779","DOI":"10.18653\/v1\/D19-1279","article-title":"75 languages, 1 model: Parsing Universal Dependencies universally","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Kondratyuk","year":"2019"},{"key":"2021080620254001800_bib29","doi-asserted-by":"publisher","first-page":"1188","DOI":"10.3115\/v1\/P14-1112","article-title":"Joint syntactic and semantic parsing with Combinatory Categorial Grammar","volume-title":"Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Krishnamurthy","year":"2014"},{"key":"2021080620254001800_bib30","volume-title":"Language and Experience: Evidence from the Blind Child","author":"Landau","year":"1985"},{"key":"2021080620254001800_bib31","doi-asserted-by":"crossref","first-page":"1444","DOI":"10.18653\/v1\/D15-1169","article-title":"Joint A* CCG parsing and semantic role labelling","volume-title":"Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing","author":"Lewis","year":"2015"},{"key":"2021080620254001800_bib32","doi-asserted-by":"crossref","first-page":"1775","DOI":"10.18653\/v1\/D16-1183","article-title":"Neural shift-reduce CCG semantic parsing","volume-title":"Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing","author":"Misra","year":"2016"},{"issue":"3","key":"2021080620254001800_bib33","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1111\/j.1755-2567.1970.tb00434.x","article-title":"Universal grammar","volume":"36","author":"Montague","year":"1970","journal-title":"Theoria"},{"issue":"2","key":"2021080620254001800_bib34","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1017\/S0305000900013817","article-title":"Children use syntax to learn verb meanings","volume":"17","author":"Naigles","year":"1990","journal-title":"Journal of Child Language"},{"key":"2021080620254001800_bib35","article-title":"Transformers without tears: Improving the normalization of self-attention","author":"Nguyen","year":"2019","journal-title":"arXiv preprint arXiv:1910.05895"},{"key":"2021080620254001800_bib36","first-page":"3991","article-title":"Towards comparability of linguistic graph Banks for semantic parsing","volume-title":"Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC\u201916)","author":"Oepen","year":"2016"},{"key":"2021080620254001800_bib37","doi-asserted-by":"publisher","first-page":"63","DOI":"10.3115\/v1\/S14-2008","article-title":"SemEval 2014 task 8: Broad-coverage semantic dependency parsing","volume-title":"Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014)","author":"Oepen","year":"2014"},{"key":"2021080620254001800_bib38","volume-title":"Language Learnability and Language Development","author":"Pinker","year":"1984"},{"issue":"3","key":"2021080620254001800_bib39","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1016\/0010-0277(79)90001-5","article-title":"Formal models of language learning","volume":"7","author":"Pinker","year":"1979","journal-title":"Cognition"},{"key":"2021080620254001800_bib40","volume-title":"Head-driven Phrase Structure Grammar","author":"Pollard","year":"1994"},{"key":"2021080620254001800_bib41","doi-asserted-by":"publisher","first-page":"1599","DOI":"10.18653\/v1\/N19-1162","article-title":"Cross-lingual alignment of contextual word embeddings, with applications to zero-shot dependency parsing","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)","author":"Schuster","year":"2019"},{"key":"2021080620254001800_bib42","doi-asserted-by":"crossref","first-page":"1073","DOI":"10.18653\/v1\/P17-1099","article-title":"Get to the point: Summarization with pointer-generator networks","volume-title":"Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"See","year":"2017"},{"key":"2021080620254001800_bib43","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/6591.001.0001","volume-title":"The Syntactic Process","author":"Steedman","year":"2000"},{"key":"2021080620254001800_bib44","doi-asserted-by":"publisher","first-page":"8427","DOI":"10.18653\/v1\/2020.acl-main.746","article-title":"Universal decompositional semantic parsing","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Stengel-Eskin","year":"2020"},{"key":"2021080620254001800_bib45","doi-asserted-by":"publisher","first-page":"5027","DOI":"10.18653\/v1\/D18-1548","article-title":"Linguistically-informed self-attention for semantic role labeling","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Strubell","year":"2018"},{"key":"2021080620254001800_bib46","doi-asserted-by":"publisher","first-page":"159","DOI":"10.3115\/1596324.1596352","article-title":"The CoNLL 2008 shared task on joint parsing of syntactic and semantic dependencies","volume-title":"CoNLL 2008: Proceedings of the Twelfth Conference on Computational Natural Language Learning","author":"Surdeanu","year":"2008"},{"key":"2021080620254001800_bib47","doi-asserted-by":"publisher","first-page":"187","DOI":"10.18653\/v1\/K16-1019","article-title":"Greedy, joint syntactic-semantic parsing with stack LSTMs","volume-title":"Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning","author":"Swayamdipta","year":"2016"},{"key":"2021080620254001800_bib48","article-title":"Shallow syntax in deep water","author":"Swayamdipta","year":"2019","journal-title":"arXiv preprint arXiv:1908.11047"},{"key":"2021080620254001800_bib49","article-title":"Frame-semantic parsing with softmax-margin segmental RNNs and a syntactic scaffold","author":"Swayamdipta","year":"2017","journal-title":"arXiv preprint arXiv:1706.09528"},{"key":"2021080620254001800_bib50","doi-asserted-by":"publisher","first-page":"3772","DOI":"10.18653\/v1\/D18-1412","article-title":"Syntactic scaffolds for semantic structures","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Swayamdipta","year":"2018"},{"key":"2021080620254001800_bib51","doi-asserted-by":"publisher","first-page":"4593","DOI":"10.18653\/v1\/P19-1452","article-title":"BERT rediscovers the classical NLP pipeline","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Tenney","year":"2019"},{"key":"2021080620254001800_bib52","first-page":"5998","article-title":"Attention is all you need","volume-title":"Advances in neural information processing systems","author":"Vaswani","year":"2017"},{"key":"2021080620254001800_bib53","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1075\/hop.22.lex4","article-title":"Lexically triggered veridicality inferences","volume":"22","author":"White","year":"2020","journal-title":"Handbook of Pragmatics: 22nd Annual Installment"},{"key":"2021080620254001800_bib54","doi-asserted-by":"crossref","first-page":"1713","DOI":"10.18653\/v1\/D16-1177","article-title":"Universal decompositional semantics on Universal Dependencies","volume-title":"Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing","author":"White","year":"2016"},{"key":"2021080620254001800_bib55","doi-asserted-by":"crossref","first-page":"4717","DOI":"10.18653\/v1\/D18-1501","article-title":"Lexicosyntactic inference in neural models","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"White","year":"2018"},{"key":"2021080620254001800_bib56","first-page":"5698","article-title":"The universal decompositional semantics dataset and decomp toolkit","volume-title":"Proceedings of the 12th Language Resources and Evaluation Conference","author":"White","year":"2020"},{"key":"2021080620254001800_bib57","first-page":"1","article-title":"CoNLL 2018 shared task: Multilingual parsing from raw text to Universal Dependencies","volume-title":"Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies","author":"Zeman","year":"2018"},{"key":"2021080620254001800_bib58","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18653\/v1\/K17-3001","article-title":"CoNLL 2017 shared task: Multilingual parsing from raw text to Universal Dependencies","volume-title":"Proceedings of the CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies","author":"Zeman","year":"2017"},{"key":"2021080620254001800_bib59","doi-asserted-by":"publisher","first-page":"80","DOI":"10.18653\/v1\/P19-1009","article-title":"AMR parsing as sequence-to-graph transduction","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Zhang","year":"2019"},{"key":"2021080620254001800_bib60","doi-asserted-by":"publisher","first-page":"3786","DOI":"10.18653\/v1\/D19-1392","article-title":"Broad-coverage semantic parsing as transduction","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Zhang","year":"2019"},{"key":"2021080620254001800_bib61","article-title":"An evaluation of PredPatt and open IE via stage 1 semantic role labeling","volume-title":"IWCS 2017 \u2014 12th International Conference on Computational Semantics \u2014 Short papers","author":"Zhang","year":"2017"},{"key":"2021080620254001800_bib62","doi-asserted-by":"publisher","first-page":"4306","DOI":"10.18653\/v1\/2020.acl-main.397","article-title":"AMR parsing with latent structural information","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Zhou","year":"2020"}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/tacl\/article-pdf\/doi\/10.1162\/tacl_a_00396\/1955190\/tacl_a_00396.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/tacl\/article-pdf\/doi\/10.1162\/tacl_a_00396\/1955190\/tacl_a_00396.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,20]],"date-time":"2021-09-20T19:30:04Z","timestamp":1632166204000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/doi\/10.1162\/tacl_a_00396\/106796\/Joint-Universal-Syntactic-and-Semantic-Parsing"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021]]},"references-count":62,"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00396","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021]]},"published":{"date-parts":[[2021]]}}}