{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,1]],"date-time":"2025-05-01T23:10:02Z","timestamp":1746141002456,"version":"3.40.4"},"reference-count":54,"publisher":"Cambridge University Press (CUP)","issue":"2","license":[{"start":{"date-parts":[[2014,2,24]],"date-time":"2014-02-24T00:00:00Z","timestamp":1393200000000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Nat. Lang. Eng."],"published-print":{"date-parts":[[2016,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Statistical parsers often require careful parameter tuning and feature selection. This is a nontrivial task for application developers who are not interested in parsing for its own sake, and it can be time-consuming even for experienced researchers. In this paper we present MaltOptimizer, a tool developed to automatically explore parameters and features for MaltParser, a transition-based dependency parsing system that can be used to train parser's given treebank data. MaltParser provides a wide range of parameters for optimization, including nine different parsing algorithms, an expressive feature specification language that can be used to define arbitrarily rich feature models, and two machine learning libraries, each with their own parameters. MaltOptimizer is an interactive system that performs parser optimization in three stages. First, it performs an analysis of the training set in order to select a suitable starting point for optimization. Second, it selects the best parsing algorithm and tunes the parameters of this algorithm. Finally, it performs feature selection and tunes machine learning parameters. Experiments on a wide range of data sets show that MaltOptimizer quickly produces models that consistently outperform default settings and often approach the accuracy achieved through careful manual optimization.<\/jats:p>","DOI":"10.1017\/s1351324914000035","type":"journal-article","created":{"date-parts":[[2014,2,24]],"date-time":"2014-02-24T14:13:21Z","timestamp":1393251201000},"page":"187-213","source":"Crossref","is-referenced-by-count":5,"title":["MaltOptimizer: Fast and effective parser optimization"],"prefix":"10.1017","volume":"22","author":[{"given":"MIGUEL","family":"BALLESTEROS","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"JOAKIM","family":"NIVRE","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"56","published-online":{"date-parts":[[2014,2,24]]},"reference":[{"key":"S1351324914000035_ref025","unstructured":"Hall J 2008. Transition-Based Natural Language Parsing with Dependency and Constituency Representations. PhD thesis, V\u00e4xj\u00f6 University, Sweden."},{"key":"S1351324914000035_ref030","first-page":"403","volume-title":"Proceedings of the Conference on Uncertainty in AI","author":"McCallum","year":"2003"},{"key":"S1351324914000035_ref016","first-page":"551","article-title":"Online passive-aggressive algorithms","volume":"7","author":"Crammer","year":"2006","journal-title":"Journal of Machine Learning Research"},{"key":"S1351324914000035_ref005","first-page":"2757","volume-title":"Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC)","author":"Ballesteros","year":"2012"},{"key":"S1351324914000035_ref052","first-page":"219","volume-title":"Proceedings of the 16th Belgian-Dutch Conference on Artificial Intelligence","author":"van den Bosch","year":"2004"},{"key":"S1351324914000035_ref051","first-page":"44","volume-title":"Proceedings of the European Chapter of the Association for Computational Linguistics (EACL)","author":"Tsarfaty","year":"2012"},{"key":"S1351324914000035_ref048","first-page":"40","volume-title":"Proceedings of the ICON-2010 Tools Contest on Indian Language Dependency Parsing","author":"Prudhvi","year":"2010"},{"key":"S1351324914000035_ref050","first-page":"35","volume-title":"Proceedings of 10th Workshop on Asian Language Resources, at 24th International Conference on Computational Linguistics (COLING)","author":"Seraji","year":"2012"},{"key":"S1351324914000035_ref031","unstructured":"McDonald R 2006. Discriminative Learning and Spanning Tree Algorithms for Dependency Parsing. PhD thesis, University of Pennsylvania, Philadelphia, PA."},{"key":"S1351324914000035_ref053","first-page":"189","volume-title":"Proceedings of the Second Workshop on Treebanks and Linguistic Theories (TLT)","author":"Yli-Jyr\u00e4","year":"2003"},{"key":"S1351324914000035_ref020","first-page":"1871","article-title":"Liblinear: a library for large linear classification","volume":"9","author":"Fan","year":"2008","journal-title":"Journal of Machine Learning Research"},{"key":"S1351324914000035_ref019","first-page":"331","volume-title":"Proceedings of the Ninth International Conference on Music Information Retrieval (ISMIR)","author":"Doraisamy","year":"2008"},{"key":"S1351324914000035_ref002","first-page":"699","volume-title":"The 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (ACL)","author":"Agirre","year":"2011"},{"key":"S1351324914000035_ref013","first-page":"1052","volume-title":"Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (ACL)","author":"Choi","year":"2013"},{"key":"S1351324914000035_ref018","first-page":"1057","volume-title":"Proceedings of the 28th International Conference on Machine Learning (ICML)","author":"Das","year":"2011"},{"key":"S1351324914000035_ref014","first-page":"79","volume-title":"Proceedings of the Fourth Workshop on Statistical Parsing of Morphologically Rich Languages (SPMRL)","author":"Cirik","year":"2013"},{"key":"S1351324914000035_ref003","doi-asserted-by":"crossref","first-page":"63","DOI":"10.18653\/v1\/W13-4907","volume-title":"Proceedings of the Fourth Workshop on Statistical Parsing of Morphologically Rich Languages (SPMRL)","author":"Ballesteros","year":"2013"},{"key":"S1351324914000035_ref011","unstructured":"Cassel S. 2009. MaltParser and LIBLINEAR: Transition-Based Dependency Parsing with Linear Classification for Feature Model Optimization. M.Phil. thesis, Uppsala University, Uppsala, Sweden."},{"key":"S1351324914000035_ref038","first-page":"396","volume-title":"Proceedings of Human Language Technologies: The Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL HLT)","author":"Nivre","year":"2007"},{"key":"S1351324914000035_ref004","first-page":"119","article-title":"Exploring automatic feature selection for transition-based dependency parsing","volume":"51","author":"Ballesteros","year":"2013","journal-title":"Procesamiento del Lenguaje Natural"},{"key":"S1351324914000035_ref028","first-page":"213","volume-title":"Proceedings of the SPIE Conference on Image and Signal Processing for Remote Sensing IX","author":"Korycinski","year":"2003"},{"key":"S1351324914000035_ref009","first-page":"1455","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL)","author":"Bohnet","year":"2012"},{"key":"S1351324914000035_ref054","first-page":"188","volume-title":"Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics (ACL)","author":"Zhang","year":"2011"},{"key":"S1351324914000035_ref022","first-page":"66","volume-title":"Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics (EACL)","author":"G\u00f3mez-Rodr\u00edguez","year":"2012"},{"key":"S1351324914000035_ref033","first-page":"122","volume-title":"Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL)","author":"McDonald","year":"2007"},{"key":"S1351324914000035_ref039","doi-asserted-by":"publisher","DOI":"10.1162\/coli.07-056-R1-07-027"},{"key":"S1351324914000035_ref037","first-page":"50","volume-title":"Proceedings of the Workshop on Incremental Parsing: Bringing Engineering and Cognition Together at the 42nd Annual Meeting of the Association for Computational Linguistics (ACL)","author":"Nivre","year":"2004"},{"key":"S1351324914000035_ref007","first-page":"13","volume-title":"Proceedings of the Second International Conference on Dependency Linguistics (DEPLING)","author":"Ballesteros","year":"2013"},{"key":"S1351324914000035_ref006","first-page":"171","article-title":"Optimizing planar and 2-planar parsers with MaltOptimizer","volume":"49","author":"Ballesteros","year":"2012","journal-title":"Procesamiento del Lenguaje Natural"},{"key":"S1351324914000035_ref017","first-page":"84","volume-title":"Proceedings of the 14th European Conference on Machine Learning (ECML)","author":"Daelemans","year":"2003"},{"key":"S1351324914000035_ref001","first-page":"97","volume-title":"Proceedings of the 24th International Conference on Computational Linguistics (COLING)","author":"Agirre","year":"2012"},{"key":"S1351324914000035_ref027","first-page":"93","volume-title":"Proceedings of the Tenth Belgian-Dutch Conference on Machine Learning (BENELEARN)","author":"Kool","year":"2000"},{"key":"S1351324914000035_ref042","first-page":"915","volume-title":"Proceedings of the CoNLL Shared Task at the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CONLL)","author":"Nivre","year":"2007"},{"key":"S1351324914000035_ref026","first-page":"933","volume-title":"Proceedings of the CoNLL Shared Task at the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CONLL)","author":"Hall","year":"2007"},{"key":"S1351324914000035_ref021","doi-asserted-by":"crossref","first-page":"71","DOI":"10.18653\/v1\/W13-4908","volume-title":"Proceedings of the Fourth Workshop on Statistical Parsing of Morphologically Rich Languages (SPMRL)","author":"Goenaga","year":"2013"},{"key":"S1351324914000035_ref044","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1017\/S1351324906004505","article-title":"Maltparser: a language-independent system for data-driven dependency parsing","volume":"13","author":"Nivre","year":"2007","journal-title":"Natural Language Engineering"},{"key":"S1351324914000035_ref029","first-page":"133","volume-title":"Proceedings of the Eleventh International Workshop on Treebanks and Linguistic Theories (TLT11)","author":"Mambrini","year":"2012"},{"key":"S1351324914000035_ref045","first-page":"221","volume-title":"Proceedings of the 10th Conference on Computational Natural Language Learning (CoNLL)","author":"Nivre","year":"2006"},{"key":"S1351324914000035_ref032","first-page":"216","volume-title":"Proceedings of the 10th Conference on Computational Natural Language Learning (CoNLL)","author":"McDonald","year":"2006"},{"key":"S1351324914000035_ref008","first-page":"58","volume-title":"Proceedings of the System Demonstration Session of the Thirteenth Conference of the European Chapter of the Association for Computational Linguistics (EACL)","author":"Ballesteros","year":"2012"},{"volume-title":"Machine Learning","year":"1997","author":"Mitchell","key":"S1351324914000035_ref034"},{"key":"S1351324914000035_ref036","unstructured":"Nivre J. 2003. An efficient algorithm for projective dependency parsing. In Proceedings of the 8th International Workshop on Parsing Technologies (IWPT), pp. 149\u201360."},{"key":"S1351324914000035_ref012","doi-asserted-by":"publisher","DOI":"10.1145\/1961189.1961199"},{"key":"S1351324914000035_ref023","first-page":"1492","volume-title":"Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics (ACL)","author":"G\u00f3mez-Rodr\u00edguez","year":"2010"},{"key":"S1351324914000035_ref043","first-page":"2216","volume-title":"Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC)","author":"Nivre","year":"2006"},{"key":"S1351324914000035_ref046","doi-asserted-by":"publisher","DOI":"10.3115\/1697236.1697250"},{"key":"S1351324914000035_ref049","doi-asserted-by":"crossref","first-page":"146","DOI":"10.18653\/v1\/W13-4917","volume-title":"Proceedings of the Fourth Workshop on Statistical Parsing of Morphologically Rich Languages (SPMRL)","author":"Seddah","year":"2013"},{"key":"S1351324914000035_ref040","first-page":"351","volume-title":"Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP (ACL-IJCNLP)","author":"Nivre","year":"2009"},{"key":"S1351324914000035_ref015","first-page":"95","volume-title":"Proceedings of the 39th Annual ACM Southeast Conference","author":"Covington","year":"2001"},{"key":"S1351324914000035_ref024","first-page":"1157","article-title":"An introduction to variable and feature selection","volume":"3","author":"Guyon","year":"2003","journal-title":"Journal of Machine Learning Research"},{"key":"S1351324914000035_ref010","first-page":"149","volume-title":"Proceedings of the 10th Conference on Computational Natural Language Learning (CoNLL)","author":"Buchholz","year":"2006"},{"key":"S1351324914000035_ref041","unstructured":"Nivre J. , and Hall J. 2010. A Quick Guide to MaltParser Optimization. Tech. rept. 1. MaltParser (maltparser.org)."},{"key":"S1351324914000035_ref047","first-page":"99","volume-title":"Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL)","author":"Nivre","year":"2005"},{"key":"S1351324914000035_ref035","first-page":"824","volume-title":"Proceedings of the 23rd International Conference on Computational Linguistics (COLING)","author":"Nilsson","year":"2010"}],"container-title":["Natural Language Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S1351324914000035","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,1]],"date-time":"2025-05-01T22:37:32Z","timestamp":1746139052000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S1351324914000035\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,2,24]]},"references-count":54,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2016,3]]}},"alternative-id":["S1351324914000035"],"URL":"https:\/\/doi.org\/10.1017\/s1351324914000035","relation":{},"ISSN":["1351-3249","1469-8110"],"issn-type":[{"type":"print","value":"1351-3249"},{"type":"electronic","value":"1469-8110"}],"subject":[],"published":{"date-parts":[[2014,2,24]]}}}