{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2022,9,1]],"date-time":"2022-09-01T14:18:05Z","timestamp":1662041885978},"reference-count":74,"publisher":"MIT Press","issue":"3","license":[{"start":{"date-parts":[[2022,4,7]],"date-time":"2022-04-07T00:00:00Z","timestamp":1649289600000},"content-version":"vor","delay-in-days":96,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,9,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>We contribute to the discussion on parsing performance in NLP by introducing a measurement that evaluates the differences between the distributions of edge displacement (the directed distance of edges) seen in training and test data. We hypothesize that this measurement will be related to differences observed in parsing performance across treebanks. We motivate this by building upon previous work and then attempt to falsify this hypothesis by using a number of statistical methods. We establish that there is a statistical correlation between this measurement and parsing performance even when controlling for potential covariants. We then use this to establish a sampling technique that gives us an adversarial and complementary split. This gives an idea of the lower and upper bounds of parsing systems for a given treebank in lieu of freshly sampled data. In a broader sense, the methodology presented here can act as a reference for future correlation-based exploratory work in NLP.<\/jats:p>","DOI":"10.1162\/coli_a_00440","type":"journal-article","created":{"date-parts":[[2022,4,7]],"date-time":"2022-04-07T18:22:00Z","timestamp":1649355720000},"page":"517-554","update-policy":"http:\/\/dx.doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":0,"title":["The Impact of Edge Displacement Vaserstein Distance on UD Parsing Performance"],"prefix":"10.1162","volume":"48","author":[{"given":"Mark","family":"Anderson","sequence":"first","affiliation":[{"name":"Universidade da Coru\u00f1a, CITIC. m.anderson@udc.es"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carlos","family":"G\u00f3mez-Rodr\u00edguez","sequence":"additional","affiliation":[{"name":"Universidade da Coru\u00f1a, CITIC. carlos.gomez@udc.es"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","published-online":{"date-parts":[[2022,9,1]]},"reference":[{"key":"2022090113562834600_bib1","first-page":"1985","article-title":"A treebank-based study on the influence of Italian word order on parsing performance","volume-title":"Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC-2012)","author":"Alicante","year":"2012"},{"key":"2022090113562834600_bib2","volume-title":"Publication Manual of the American Psychological Association","author":"American Psychological Association","year":"2010","edition":"6th edition"},{"key":"2022090113562834600_bib3","first-page":"5147","article-title":"Inherent dependency displacement bias of transition-based algorithms","volume-title":"Proceedings of the 12th Language Resources and Evaluation Conference","author":"Anderson","year":"2020"},{"key":"2022090113562834600_bib4","doi-asserted-by":"publisher","first-page":"1090","DOI":"10.18653\/v1\/2021.acl-short.138","article-title":"Replicating and extending \u201cBecause their treebanks leak\u201d: Graph isomorphism, covariants, and parser performance","volume-title":"Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers)","author":"Anderson","year":"2021"},{"key":"2022090113562834600_bib5","first-page":"142","article-title":"A comparison between morphological complexity measures: Typological data vs. language corpora","volume-title":"Proceedings of the Workshop on Computational Linguistics for Linguistic Complexity (CL4LC)","author":"Bentz","year":"2016"},{"key":"2022090113562834600_bib6","doi-asserted-by":"publisher","first-page":"8","DOI":"10.18653\/v1\/W18-6002","article-title":"Using universal dependencies in cross-linguistic complexity research","volume-title":"Second Workshop on Universal Dependencies","author":"Berdicevskis","year":"2018"},{"key":"2022090113562834600_bib7","first-page":"1794","article-title":"Comparing the influence of different treebank annotations on dependency parsing","volume-title":"Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC\u201910)","author":"Bosco","year":"2010"},{"key":"2022090113562834600_bib8","unstructured":"Buch-Kromann, Matthias\n          . 2006. Discontinuous Grammar: A Dependency-Based Model of Human Parsing and Language Learning. Ph.D. thesis, Copenhagen Business School."},{"key":"2022090113562834600_bib9","doi-asserted-by":"crossref","first-page":"740","DOI":"10.3115\/v1\/D14-1082","article-title":"A fast and accurate dependency parser using neural networks","volume-title":"Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Chen","year":"2014"},{"key":"2022090113562834600_bib10","first-page":"1396","article-title":"On the shortest arborescence of a directed graph","volume":"14","author":"Chu","year":"1965","journal-title":"Scientia Sinica"},{"key":"2022090113562834600_bib11","first-page":"49","article-title":"Factors affecting the accuracy of Korean parsing","volume-title":"Proceedings of the NAACL HLT 2010 First Workshop on Statistical Parsing of Morphologically-Rich Languages","author":"Chung","year":"2010"},{"key":"2022090113562834600_bib12","first-page":"46","article-title":"Verification, reproduction and replication of NLP experiments: A case study on parsing Universal Dependencies","volume-title":"Proceedings of the Fourth Workshop on Universal Dependencies (UDW 2020)","author":"C\u00f6ltekin","year":"2020"},{"issue":"4","key":"2022090113562834600_bib13","doi-asserted-by":"publisher","DOI":"10.1145\/2407736.2407737","article-title":"An information-theoretic measure to evaluate parsing difficulty across treebanks","volume":"9","author":"Corazza","year":"2013","journal-title":"ACM Transactions on Audio, Speech, and Language Processing"},{"key":"2022090113562834600_bib14","doi-asserted-by":"crossref","unstructured":"Dehouck, Mathieu\n          . 2019. Multi-Lingual Dependency Parsing: Word Representation and Joint Training for Syntactic Analysis. (Parsing en D\u00e9pendances Multilingue: Repr\u00e9sentation de Mots et Apprentissage Joint pour l\u2019Analyse Syntaxique). Ph.D. thesis, Universit\u00e9 de Lille. 10.18653\/v1\/N19-1017","DOI":"10.18653\/v1\/N19-1017"},{"key":"2022090113562834600_bib15","doi-asserted-by":"publisher","first-page":"192","DOI":"10.18653\/v1\/2020.iwpt-1.20","article-title":"Efficient EUD parsing","volume-title":"Proceedings of the 16th International Conference on Parsing Technologies and the IWPT 2020 Shared Task on Parsing into Enhanced Universal Dependencies","author":"Dehouck","year":"2020"},{"key":"2022090113562834600_bib16","doi-asserted-by":"publisher","first-page":"2864","DOI":"10.18653\/v1\/D18-1312","article-title":"A framework for understanding the role of morphology in Universal Dependency parsing","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Dehouck","year":"2018"},{"key":"2022090113562834600_bib17","doi-asserted-by":"publisher","first-page":"3818","DOI":"10.18653\/v1\/2020.coling-main.339","article-title":"Data augmentation via subtree swapping for dependency parsing of low-resource languages","volume-title":"Proceedings of the 28th International Conference on Computational Linguistics","author":"Dehouck","year":"2020"},{"key":"2022090113562834600_bib18","article-title":"Deep biaffine attention for neural dependency parsing","volume-title":"5th International Conference on Learning Representations, ICLR 2017, Conference Track Proceedings","author":"Dozat","year":"2017"},{"issue":"4","key":"2022090113562834600_bib19","doi-asserted-by":"publisher","first-page":"233","DOI":"10.6028\/jres.071B.032","article-title":"Optimum branchings","volume":"71","author":"Edmonds","year":"1967","journal-title":"Journal of Research of the National Bureau of Standards B"},{"key":"2022090113562834600_bib20","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1007\/978-90-481-9352-3_8","article-title":"Favor short dependencies: Parsing with soft and hard constraints on dependency length","volume-title":"Trends in Parsing Technology","author":"Eisner","year":"2010"},{"key":"2022090113562834600_bib21","doi-asserted-by":"publisher","first-page":"25","DOI":"10.18653\/v1\/2020.iwpt-1.4","article-title":"Integrating graph-based and transition-based dependency parsers in the deep contextualized era","volume-title":"Proceedings of the 16th International Conference on Parsing Technologies and the IWPT 2020 Shared Task on Parsing into Enhanced Universal Dependencies","author":"Falenska","year":"2020"},{"key":"2022090113562834600_bib22","first-page":"18","article-title":"Lexicalized vs. delexicalized parsing in low-resource scenarios","volume-title":"Proceedings of the 15th International Conference on Parsing Technologies","author":"Falenska","year":"2017"},{"issue":"1","key":"2022090113562834600_bib23","doi-asserted-by":"publisher","first-page":"92","DOI":"10.2307\/1937887","article-title":"Multicollinearity in regression analysis: The problem revisited","volume":"49","author":"Farrar","year":"1967","journal-title":"Review of Economic and Statistics"},{"issue":"5","key":"2022090113562834600_bib24","doi-asserted-by":"publisher","first-page":"056135","DOI":"10.1103\/PhysRevE.70.056135","article-title":"Euclidean distance between syntactically linked words","volume":"70","author":"Ferrer-i-Cancho","year":"2004","journal-title":"Physical Review E"},{"issue":"S2","key":"2022090113562834600_bib25","doi-asserted-by":"publisher","first-page":"320","DOI":"10.1002\/cplx.21810","article-title":"Crossings as a side effect of dependency lengths","volume":"21","author":"Ferrer-i-Cancho","year":"2016","journal-title":"Complexity"},{"key":"2022090113562834600_bib26","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1016\/j.physa.2017.10.048","article-title":"Are crossing dependencies really scarce?","volume":"493","author":"CanchoRamon","year":"2018","journal-title":"Physica A: Statistical Mechanics and its Applications"},{"issue":"2","key":"2022090113562834600_bib27","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1515\/glot-2014-0014","article-title":"The risks of mixing dependency lengths from sequences of different length","volume":"5","author":"Ferrer-i-Cancho","year":"2014","journal-title":"Glottotheory"},{"key":"2022090113562834600_bib28","first-page":"381","article-title":"\u201ccba to check the spelling\u201d: Investigating parser performance on discussion forum posts","volume-title":"Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics","author":"Foster","year":"2010"},{"issue":"33","key":"2022090113562834600_bib29","doi-asserted-by":"publisher","first-page":"10336","DOI":"10.1073\/pnas.1502134112","article-title":"Large-scale evidence of dependency length minimization in 37 languages","volume":"112","author":"Futrell","year":"2015","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"2022090113562834600_bib30","first-page":"95","article-title":"The dependency locality theory: A distance-based theory of linguistic complexity","volume":"2000","author":"Gibson","year":"2000","journal-title":"Image, Language, Brain"},{"key":"2022090113562834600_bib31","first-page":"167","article-title":"Corpus variation and parser performance","volume-title":"Proceedings of the 2001 Conference on Empirical Methods in Natural Language Processing","author":"Gildea","year":"2001"},{"issue":"2","key":"2022090113562834600_bib32","doi-asserted-by":"publisher","first-page":"286","DOI":"10.1111\/j.1551-6709.2009.01073.x","article-title":"Do grammars minimize dependency length?","volume":"34","author":"Gildea","year":"2010","journal-title":"Cognitive Science"},{"key":"2022090113562834600_bib33","doi-asserted-by":"publisher","first-page":"200","DOI":"10.1016\/j.plrev.2017.05.007","article-title":"On the relation between dependency distance, crossing dependencies, and parsing","volume":"21","author":"G\u00f3mez-Rodr\u00edguez","year":"2017","journal-title":"Physics of Life Reviews"},{"issue":"6","key":"2022090113562834600_bib34","doi-asserted-by":"publisher","first-page":"062304","DOI":"10.1103\/PhysRevE.96.062304","article-title":"Scarcity of crossing dependencies: A direct outcome of a specific constraint?","volume":"96","author":"G\u00f3mez-Rodr\u00edguez","year":"2017","journal-title":"Physical Review E"},{"key":"2022090113562834600_bib35","doi-asserted-by":"publisher","first-page":"2786","DOI":"10.18653\/v1\/P19-1267","article-title":"We need to talk about standard splits","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Gorman","year":"2019"},{"issue":"1","key":"2022090113562834600_bib36","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v017.i01","article-title":"Relative importance for linear regression in R: The package relaimpo","volume":"17","author":"Groemping","year":"2006","journal-title":"Journal of Statistical Software"},{"key":"2022090113562834600_bib37","first-page":"121","article-title":"Diachronic trends in word order freedom and dependency length in dependency-annotated corpora of Latin and Ancient Greek","volume-title":"Proceedings of the Third International Conference on Dependency Linguistics (Depling 2015)","author":"Gulordava","year":"2015"},{"key":"2022090113562834600_bib38","doi-asserted-by":"publisher","first-page":"343","DOI":"10.1162\/tacl_a_00103","article-title":"Multi-lingual dependency parsing evaluation: A large-scale analysis of word order properties using artificial data","volume":"4","author":"Gulordava","year":"2016","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2022090113562834600_bib39","doi-asserted-by":"publisher","first-page":"204","DOI":"10.1016\/j.plrev.2017.06.005","article-title":"Cross-language diversity, head-direction and grammars. Comment on \u201cDependency distance: A new perspective on syntactic patterns in natural languages\u201d by Haitao Liu et al.","volume":"21","author":"Hudson","year":"2017","journal-title":"Physics of Life Reviews"},{"key":"2022090113562834600_bib40","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1016\/j.langsci.2015.04.002","article-title":"The effects of sentence length on dependency distance, dependency direction and the implications\u2013Based on a parallel English\u2013Chinese dependency treebank","volume":"50","author":"Jiang","year":"2015","journal-title":"Language Sciences"},{"key":"2022090113562834600_bib41","doi-asserted-by":"publisher","first-page":"2755","DOI":"10.18653\/v1\/D19-1277","article-title":"Deep contextualized word embeddings in transition-based and graph-based dependency parsing\u2014A tale of two parsers revisited","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Kulmizev","year":"2019"},{"key":"2022090113562834600_bib42","first-page":"15","article-title":"A testsuite for testing parser performance on complex German grammatical constructions","volume":"12","author":"K\u00fcbler","year":"2008","journal-title":"LOT Occasional Series"},{"key":"2022090113562834600_bib43","first-page":"99","article-title":"Old school vs. new school: Comparing transition-based parsers with and without neural network enhancement","volume-title":"Proceedings of the 15th Treebanks and Linguistic Theories Workshop (TLT)","author":"LhoneuxMiryam","year":"2017"},{"key":"2022090113562834600_bib44","first-page":"1","article-title":"Probability distribution of dependency distance","volume":"15","author":"Liu","year":"2007","journal-title":"Glottometrics"},{"issue":"2","key":"2022090113562834600_bib45","doi-asserted-by":"publisher","first-page":"159","DOI":"10.17791\/jcs.2008.9.2.159","article-title":"Dependency distance as a metric of language comprehension difficulty","volume":"9","author":"Liu","year":"2008","journal-title":"Journal of Cognitive Science"},{"key":"2022090113562834600_bib46","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1016\/j.plrev.2017.03.002","article-title":"Dependency distance: A new perspective on syntactic patterns in natural languages","volume":"21","author":"Liu","year":"2017","journal-title":"Physics of Life Reviews"},{"key":"2022090113562834600_bib47","doi-asserted-by":"publisher","first-page":"545","DOI":"10.3115\/1599081.1599150","article-title":"Comparative parser performance analysis across grammar frameworks through automatic tree conversion using synchronous grammars","volume-title":"Proceedings of the 22nd International Conference on Computational Linguistics (Coling 2008)","author":"Matsuzaki","year":"2008"},{"key":"2022090113562834600_bib48","doi-asserted-by":"publisher","first-page":"229","DOI":"10.18653\/v1\/W19-4226","article-title":"The SIGMORPHON 2019 shared task: Morphological analysis in context and cross-lingual transfer for inflection","volume-title":"Proceedings of the 16th Workshop on Computational Research in Phonetics, Phonology, and Morphology","author":"McCarthy","year":"2019"},{"issue":"1","key":"2022090113562834600_bib49","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1162\/coli_a_00039","article-title":"Analyzing and integrating dependency parsers","volume":"37","author":"McDonald","year":"2011","journal-title":"Computational Linguistics"},{"key":"2022090113562834600_bib50","doi-asserted-by":"publisher","first-page":"121","DOI":"10.3115\/1621410.1621426","article-title":"On the complexity of non-projective data-driven dependency parsing","volume-title":"Proceedings of the Tenth International Conference on Parsing Technologies","author":"McDonald","year":"2007"},{"key":"2022090113562834600_bib51","first-page":"839","article-title":"How does the granularity of an annotation scheme influence dependency parsing performance?","volume-title":"Proceedings of COLING 2012: Posters","author":"Mille","year":"2012"},{"key":"2022090113562834600_bib52","first-page":"123","article-title":"Dutch dependency parser performance across domains","volume":"16","author":"Plank","year":"2010","journal-title":"LOT Occasional Series"},{"key":"2022090113562834600_bib53","first-page":"219","article-title":"Constructions in Latvian treebank: The impact of annotation decisions on the dependency parsing performance","volume-title":"Human Language Technologies - The Baltic Perspective","author":"Pretkalnina","year":"2014"},{"key":"2022090113562834600_bib54","first-page":"218","article-title":"Universal Dependencies are hard to parse\u2014or are they?","volume-title":"Proceedings of the Fourth International Conference on Dependency Linguistics (Depling 2017)","author":"Rehbein","year":"2017"},{"key":"2022090113562834600_bib55","doi-asserted-by":"publisher","first-page":"14","DOI":"10.3115\/1622110.1622114","article-title":"Evaluating the effects of treebank size in a practical application for parsing","volume-title":"Software Engineering, Testing, and Quality Assurance for Natural Language Processing","author":"Sagae","year":"2008"},{"issue":"375","key":"2022090113562834600_bib56","doi-asserted-by":"publisher","first-page":"752","DOI":"10.2307\/2287559","article-title":"Introduction to bivariate and multivariate analysis","volume":"76","author":"Sen","year":"1981","journal-title":"Journal of the American Statistical Association"},{"issue":"3","key":"2022090113562834600_bib57","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell System Technical Journal"},{"key":"2022090113562834600_bib58","doi-asserted-by":"publisher","first-page":"591","DOI":"10.2307\/2333709","article-title":"An analysis of variance test for normality (complete samples)","volume":"52","author":"Shapiro","year":"1965","journal-title":"Biometrika"},{"key":"2022090113562834600_bib59","doi-asserted-by":"publisher","first-page":"2765","DOI":"10.18653\/v1\/2020.emnlp-main.220","article-title":"Some languages seem easier to parse because their treebanks leak","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"S\u00f8gaard","year":"2020"},{"key":"2022090113562834600_bib60","doi-asserted-by":"publisher","first-page":"1823","DOI":"10.18653\/v1\/2021.eacl-main.156","article-title":"We need to talk about random splits","volume-title":"Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume","author":"S\u00f8gaard","year":"2021"},{"key":"2022090113562834600_bib61","first-page":"105","article-title":"Overview of the EvaLatin 2020 evaluation campaign","volume-title":"Proceedings of LT4HALA 2020 - 1st Workshop on Language Technologies for Historical and Ancient Languages","author":"Sprugnoli","year":"2020"},{"key":"2022090113562834600_bib62","first-page":"197","article-title":"UDPipe 2.0 prototype at CoNLL 2018 UD shared task","volume-title":"Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies","author":"Straka","year":"2018"},{"key":"2022090113562834600_bib63","first-page":"4290","article-title":"UDPipe: Trainable pipeline for processing CoNLL-U files performing tokenization, morphological analysis, POS tagging and parsing","volume-title":"Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC\u201916)","author":"Straka","year":"2016"},{"key":"2022090113562834600_bib64","first-page":"208","article-title":"Parsing universal dependency treebanks using neural networks and search-based oracle","volume-title":"Proceedings of Fourteenth International Workshop on Treebanks and Linguistic Theories (TLT14)","author":"Straka","year":"2015"},{"key":"2022090113562834600_bib65","doi-asserted-by":"publisher","first-page":"88","DOI":"10.18653\/v1\/K17-3009","article-title":"Tokenizing, POS tagging, lemmatizing and parsing UD 2.0 with UDPipe","volume-title":"Proceedings of the CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies","author":"Straka","year":"2017"},{"key":"2022090113562834600_bib66","doi-asserted-by":"publisher","first-page":"717","DOI":"10.18653\/v1\/N19-1077","article-title":"Viable dependency parsing as sequence labeling","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)","author":"Strzyz","year":"2019"},{"key":"2022090113562834600_bib67","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1146\/annurev-linguistics-011817-045617","article-title":"Minimizing syntactic dependency lengths: Typological\/cognitive universal?","volume":"4","author":"Temperley","year":"2018","journal-title":"Annual Review of Linguistics"},{"issue":"12","key":"2022090113562834600_bib68","doi-asserted-by":"publisher","first-page":"765","DOI":"10.1002\/prop.19690171202","article-title":"Coherent bremsstrahlung of electrons in crystals","volume":"17","author":"Timm","year":"1969","journal-title":"Protein Science"},{"issue":"31","key":"2022090113562834600_bib69","doi-asserted-by":"publisher","first-page":"1026","DOI":"10.21105\/joss.01026","article-title":"Pingouin: Statistics in Python","volume":"3","author":"Vallat","year":"2018","journal-title":"Journal of Open Source Software"},{"issue":"3","key":"2022090113562834600_bib70","first-page":"64","article-title":"Markov processes over denumerable products of spaces, describing large systems of automata","volume":"5","author":"Vaserstein","year":"1969","journal-title":"Problemy Peredachi Informatsii"},{"issue":"12","key":"2022090113562834600_bib71","doi-asserted-by":"publisher","first-page":"2141","DOI":"10.1080\/00949655.2010.520163","article-title":"Comparisons of various types of normality tests","volume":"81","author":"Yap","year":"2011","journal-title":"Journal of Statistical Computation and Simulation"},{"key":"2022090113562834600_bib72","first-page":"1","article-title":"CoNLL 2018 shared task: Multilingual parsing from raw text to universal dependencies","volume-title":"Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies","author":"Zeman","year":"2018"},{"key":"2022090113562834600_bib73","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18653\/v1\/K17-3001","article-title":"Conll 2017 shared task: Multilingual parsing from raw text to universal dependencies","volume-title":"Proceedings of the CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies","author":"Zeman","year":"2017"},{"key":"2022090113562834600_bib74","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1007\/978-3-642-04617-9_28","article-title":"Correlating natural language parser performance with statistical measures of the text","volume-title":"KI\u201909: Proceedings of the 32nd Annual German Conference on Advances in Artificial Intelligence","author":"Zhang","year":"2009"}],"container-title":["Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/coli\/article-pdf\/48\/3\/517\/2040425\/coli_a_00440.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/coli\/article-pdf\/48\/3\/517\/2040425\/coli_a_00440.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,1]],"date-time":"2022-09-01T13:57:32Z","timestamp":1662040652000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/coli\/article\/48\/3\/517\/110443\/The-Impact-of-Edge-Displacement-Vaserstein"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022]]},"references-count":74,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,9,1]]},"published-print":{"date-parts":[[2022,9,1]]}},"URL":"https:\/\/doi.org\/10.1162\/coli_a_00440","relation":{},"ISSN":["0891-2017","1530-9312"],"issn-type":[{"value":"0891-2017","type":"print"},{"value":"1530-9312","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022]]},"published":{"date-parts":[[2022]]}}}