{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T06:38:51Z","timestamp":1777531131539,"version":"3.51.4"},"reference-count":67,"publisher":"MIT Press - Journals","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Transactions of the Association for Computational Linguistics"],"published-print":{"date-parts":[[2021,2]]},"abstract":"<jats:p> We propose the Recursive Non-autoregressive Graph-to-Graph Transformer architecture (RNGTr) for the iterative refinement of arbitrary graphs through the recursive application of a non-autoregressive Graph-to-Graph Transformer and apply it to syntactic dependency parsing. We demonstrate the power and effectiveness of RNGTr on several dependency corpora, using a refinement model pre-trained with BERT. We also introduce Syntactic Transformer (SynTr), a non-recursive parser similar to our refinement model. RNGTr can improve the accuracy of a variety of initial parsers on 13 languages from the Universal Dependencies Treebanks, English and Chinese Penn Treebanks, and the German CoNLL2009 corpus, even improving over the new state-of-the-art results achieved by SynTr, significantly improving the state-of-the-art for all corpora tested. <\/jats:p>","DOI":"10.1162\/tacl_a_00358","type":"journal-article","created":{"date-parts":[[2021,3,3]],"date-time":"2021-03-03T19:45:18Z","timestamp":1614800718000},"page":"120-138","source":"Crossref","is-referenced-by-count":5,"title":["Recursive Non-Autoregressive Graph-to-Graph Transformer for Dependency Parsing with Iterative Refinement"],"prefix":"10.1162","volume":"9","author":[{"given":"Alireza","family":"Mohammadshahi","sequence":"first","affiliation":[{"name":"Idiap Research Institute \/ EPFL."}]},{"given":"James","family":"Henderson","sequence":"additional","affiliation":[{"name":"Idiap Research Institute."}]}],"member":"281","reference":[{"key":"bib1","doi-asserted-by":"crossref","first-page":"2442","DOI":"10.18653\/v1\/P16-1231","volume-title":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Andor Daniel","year":"2016"},{"key":"bib2","first-page":"388","volume-title":"Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Proceedings of the Main Conference","author":"Attardi Giuseppe","year":"2007"},{"key":"bib3","first-page":"4251","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Awasthi Abhijeet","year":"2019"},{"key":"bib4","doi-asserted-by":"crossref","first-page":"2005","DOI":"10.18653\/v1\/D16-1211","volume-title":"Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing","author":"Ballesteros Miguel","year":"2016"},{"key":"bib5","first-page":"957","volume-title":"Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL)","author":"Carreras Xavier","year":"2007"},{"key":"bib6","doi-asserted-by":"crossref","first-page":"740","DOI":"10.3115\/v1\/D14-1082","volume-title":"Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Chen Danqi","year":"2014"},{"key":"bib7","author":"Chen Huadong","year":"2017","journal-title":"Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"},{"key":"bib8","doi-asserted-by":"crossref","first-page":"2204","DOI":"10.18653\/v1\/D16-1238","volume-title":"Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing","author":"Cheng Hao","year":"2016"},{"issue":"1","key":"bib9","first-page":"131","volume":"25","author":"Chi Zhiyi","year":"1999","journal-title":"Computational Linguistics"},{"key":"bib10","first-page":"1396","volume-title":"Science Sinica","volume":"14","author":"Yoeng-jin Chu","year":"1965"},{"key":"bib11","doi-asserted-by":"crossref","first-page":"32","DOI":"10.18653\/v1\/P16-2006","volume-title":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)","author":"Cross James","year":"2016"},{"key":"bib12","first-page":"99","volume-title":"Proceedings of the 15th International Workshop on Treebanks and Linguistic Theories (TLT15)","author":"de Lhoneux Miryam","year":"2017"},{"key":"bib13","first-page":"4171","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)","author":"Devlin Jacob","year":"2019"},{"key":"bib14","unstructured":"Timothy Dozat and Christopher D. Manning. 2016. Deep biaffine attention for neural dependency parsing."},{"key":"bib15","first-page":"334","volume-title":"Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)","author":"Dyer Chris","year":"2015"},{"issue":"4","key":"bib16","doi-asserted-by":"crossref","first-page":"233","DOI":"10.6028\/jres.071B.032","volume":"71","author":"Edmonds Jack","year":"1967","journal-title":"Journal of Research of the national Bureau of Standards B"},{"key":"bib17","volume-title":"COLING 1996 Volume 1: The 16th International Conference on Computational Linguistics","author":"Eisner Jason M.","year":"1996"},{"key":"bib18","first-page":"710","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)","author":"Fern\u00e1ndez-Gonz\u00e1lez Daniel","year":"2019"},{"key":"bib19","first-page":"1","volume-title":"Proceedings of the Thirteenth Conference on Computational Natural Language Learning (CoNLL 2009): Shared Task","author":"Haji\u010d Jan","year":"2009"},{"key":"bib20","doi-asserted-by":"crossref","first-page":"42","DOI":"10.3115\/1654494.1654499","volume-title":"Proceedings of the Ninth International Workshop on Parsing Technology","author":"Hall Keith","year":"2005"},{"key":"bib21","first-page":"58","volume-title":"Proceedings of the NoDaLiDa 2017 Workshop on Universal Dependencies (UDW 2017)","author":"Hennig Felix","year":"2017"},{"key":"bib22","first-page":"pages 2475\u20142485","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Ji Tao","year":"2019"},{"issue":"2","key":"bib23","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1145\/201019.201022","volume":"42","author":"Karger David R.","year":"1995","journal-title":"Journal of the ACM (JACM)"},{"key":"bib24","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00101"},{"key":"bib25","first-page":"1","volume-title":"Computational Linguistics and Intelligent Text Processing. CICLing 2005. Lecture Notes in Computer Science, vol 3406","author":"Knight K.","year":"2005"},{"key":"bib26","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Kondratyuk Dan","year":"2019"},{"key":"bib27","first-page":"1","volume-title":"Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics","author":"Koo Terry","year":"2010"},{"key":"bib28","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Kulmizev Artur","year":"2019"},{"key":"bib29","doi-asserted-by":"crossref","first-page":"1744","DOI":"10.18653\/v1\/D16-1180","volume-title":"Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing","author":"Kuncoro Adhiguna","year":"2016"},{"key":"bib30","first-page":"1173","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Lee Jason","year":"2018"},{"key":"bib31","first-page":"99","volume-title":"Proceedings of the 15th International Workshop on Treebanks and Linguistic Theories (TLT15)","author":"de Lhoneux Miryam","year":"2017"},{"key":"bib32","first-page":"8319","volume-title":"The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, The Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, New York, NY, USA, February 7\u201312, 2020","author":"Li Zuchao","year":"2020"},{"key":"bib33","author":"Lichtarge Jared","year":"2018","journal-title":"arXiv preprint arXiv:1811.01710"},{"key":"bib34","first-page":"59","volume-title":"Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 1: Long Papers)","author":"Ma Xuezhe","year":"2017"},{"key":"bib35","first-page":"1403","volume-title":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Ma Xuezhe","year":"2018"},{"key":"bib36","first-page":"785","volume-title":"Proceedings of COLING 2012: Posters","author":"Ma Xuezhe","year":"2012"},{"key":"bib37","first-page":"1506","volume-title":"Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing","author":"Marcheggiani Diego","year":"2017"},{"issue":"2","key":"bib38","first-page":"313","volume":"19","author":"Marcus Mitchell P.","year":"1993","journal-title":"Computational Linguistics"},{"key":"bib39","first-page":"91","volume-title":"Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL\u201905)","author":"McDonald Ryan","year":"2005"},{"key":"bib40","doi-asserted-by":"publisher","DOI":"10.1162\/coli_a_00039"},{"key":"bib41","volume-title":"11th Conference of the European Chapter of the Association for Computational Linguistics","author":"McDonald Ryan","year":"2006"},{"key":"bib42","first-page":"523","volume-title":"Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing","author":"McDonald Ryan","year":"2005"},{"key":"bib43","first-page":"3278","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings","author":"Mohammadshahi Alireza","year":"2020"},{"key":"bib44","volume-title":"LREC 2008","author":"Nilsson Jens","year":"2008"},{"key":"bib45","unstructured":"Joakim Nivre, Mitchell Abrams, \u017eeljko Agi\u0107, Lars Ahrenberg, Lene Antonsen, Katya Aplonova, Maria Jesus Aranzabe, Gashaw Arutie, Masayuki Asahara, Luma Ateyah, Mohammed Attia, Aitziber Atutxa, Liesbeth Augustinus, Elena Badmaeva, Miguel Ballesteros, Esha Banerjee, Sebastian Bank, Verginica Barbu Mititelu, Victoria Basmov, John Bauer, Sandra Bellato, Kepa Bengoetxea, Yevgeni Berzak, Irshad Ahmad Bhat, Riyaz Ahmad Bhat, Erica Biagetti, Eckhard Bick, Rogier Blokland. 2018. Universal dependencies 2.3. LINDAT\/ CLARIN digital library at the Institute of Formal and Applied Linguistics (\u00daFAL), Faculty of Mathematics and Physics, Charles University."},{"key":"bib46","doi-asserted-by":"crossref","first-page":"64","DOI":"10.3115\/1220355.1220365","volume-title":"COLING 2004: Proceedings of the 20th International Conference on Computational Linguistics","author":"Nivre Joakim","year":"2004"},{"key":"bib47","unstructured":"Roman Novak, Michael Auli, and David Grangier. 2016. Iterative refinement for machine translation."},{"key":"bib48","unstructured":"Deric Pang, Lucy H. Lin, and Noah A. Smith. 2019. Improving natural language inference with a pretrained parser."},{"key":"bib49","first-page":"2227","volume-title":"Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers)","author":"Peters Matthew","year":"2018"},{"key":"bib50","doi-asserted-by":"crossref","first-page":"255","DOI":"10.3115\/981863.981897","volume-title":"34th Annual Meeting of the Association for Computational Linguistics","author":"Satta Girogion","year":"1996"},{"key":"bib51","first-page":"464","volume-title":"Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers)","author":"Shaw Peter","year":"2018"},{"key":"bib52","doi-asserted-by":"crossref","first-page":"2711","DOI":"10.18653\/v1\/D18-1291","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Smith Aaron","year":"2018"},{"key":"bib53","first-page":"197","volume-title":"Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies","author":"Straka Milan","year":"2018"},{"key":"bib54","doi-asserted-by":"crossref","first-page":"711","DOI":"10.18653\/v1\/D16-1068","volume-title":"Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing","author":"Tchernowitz Ilan","year":"2016"},{"key":"bib55","first-page":"144","volume-title":"Proceedings of the Tenth International Conference on Parsing Technologies","author":"Titov Ivan","year":"2007"},{"key":"bib56","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need."},{"key":"bib57","doi-asserted-by":"crossref","first-page":"2306","DOI":"10.18653\/v1\/P16-1218","volume-title":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Wang Wenhui","year":"2016"},{"key":"bib58","first-page":"323","volume-title":"Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)","author":"Weiss David","year":"2015"},{"key":"bib59","volume":"1910","author":"Wolf Thomas","year":"2019","journal-title":"ArXiv"},{"key":"bib60","author":"Yonghui Wu","year":"2016","journal-title":"arXiv preprint arXiv:1609.08144"},{"key":"bib61","volume-title":"COLING 2002: The 19th International Conference on Computational Linguistics","author":"Xue Nianwen","year":"2002"},{"key":"bib62","first-page":"195","volume-title":"Proceedings of the Eighth International Conference on Parsing Technologies","author":"Yamada Hiroyasu","year":"2003"},{"key":"bib63","first-page":"1","volume-title":"Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies","author":"Zeman Daniel","year":"2018"},{"key":"bib64","first-page":"320","volume-title":"Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning","author":"Zhang Hao","year":"2012"},{"key":"bib65","first-page":"188","volume-title":"Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies","author":"Zhang Yue","year":"2011"},{"key":"bib66","doi-asserted-by":"crossref","first-page":"2205","DOI":"10.18653\/v1\/D18-1244","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Zhang Yuhao","year":"2018"},{"key":"bib67","first-page":"1655","volume-title":"Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing","author":"Zheng Xiaoqing","year":"2017"}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/tacl_a_00358","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:39:51Z","timestamp":1615585191000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/97778"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2]]},"references-count":67,"alternative-id":["10.1162\/tacl_a_00358"],"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00358","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2]]}}}