{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,13]],"date-time":"2025-05-13T22:00:16Z","timestamp":1747173616617,"version":"3.40.5"},"reference-count":62,"publisher":"Cambridge University Press (CUP)","issue":"6","license":[{"start":{"date-parts":[[2022,1,20]],"date-time":"2022-01-20T00:00:00Z","timestamp":1642636800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["cambridge.org"],"crossmark-restriction":true},"short-container-title":["Nat. Lang. Eng."],"published-print":{"date-parts":[[2022,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We propose an integrated deep learning model for morphological segmentation, morpheme tagging, part-of-speech (POS) tagging, and syntactic parsing onto dependencies, using cross-level contextual information flow for every word, from segments to dependencies, with an attention mechanism at horizontal flow. Our model extends the work of Nguyen and Verspoor ((2018). <jats:italic>Proceedings of the CoNLL Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies<\/jats:italic>. The Association for Computational Linguistics, pp. 81\u201391.) on joint POS tagging and dependency parsing to also include morphological segmentation and morphological tagging. We report our results on several languages. Primary focus is agglutination in morphology, in particular Turkish morphology, for which we demonstrate improved performance compared to models trained for individual tasks. Being one of the earlier efforts in joint modeling of syntax and morphology along with dependencies, we discuss prospective guidelines for future comparison.<\/jats:p>","DOI":"10.1017\/s1351324921000371","type":"journal-article","created":{"date-parts":[[2022,1,20]],"date-time":"2022-01-20T14:20:56Z","timestamp":1642688456000},"page":"763-795","update-policy":"https:\/\/doi.org\/10.1017\/policypage","source":"Crossref","is-referenced-by-count":2,"title":["Joint learning of morphology and syntax with cross-level contextual information flow"],"prefix":"10.1017","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1700-0395","authenticated-orcid":false,"given":"Burcu","family":"Can","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"H\u00fcseyin","family":"Ale\u00e7ak\u0131r","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Suresh","family":"Manandhar","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cem","family":"Boz\u015fahin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"56","published-online":{"date-parts":[[2022,1,20]]},"reference":[{"year":"2008","author":"Sak","key":"S1351324921000371_ref50"},{"key":"S1351324921000371_ref42","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1272"},{"volume-title":"Turkish: A Comprehensive Grammar","year":"2005","author":"G\u00f6ksel","key":"S1351324921000371_ref21"},{"key":"S1351324921000371_ref24","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/E17-1048"},{"key":"S1351324921000371_ref2","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00286"},{"key":"S1351324921000371_ref15","unstructured":"Devlin, J. , Chang, M.-W. , Lee, K. and Toutanova, K. (2019). Bert: pre-training of deep bidirectional transformers for language understanding. In Proceedings of NAACL-HLT 2019, Minneapolis, Minnesota. Association for Computational Linguistics, pp. 4171\u20134186."},{"key":"S1351324921000371_ref7","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007379606734"},{"key":"S1351324921000371_ref1","first-page":"1","article-title":"Zemberek, an open source NLP framework for Turkic languages","volume":"10","author":"Akn","year":"2007","journal-title":"Structure"},{"key":"S1351324921000371_ref6","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-15754-7_77"},{"key":"S1351324921000371_ref57","doi-asserted-by":"crossref","unstructured":"Van Gael, J. , Vlachos, A. and Ghahramani, Z. (2009). The infinite HMM for unsupervised POS tagging. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 2-Volume 2. Association for Computational Linguistics, pp. 678\u2013687.","DOI":"10.3115\/1699571.1699601"},{"key":"S1351324921000371_ref3","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511586262"},{"key":"S1351324921000371_ref32","doi-asserted-by":"publisher","DOI":"10.3115\/1118853.1118869"},{"key":"S1351324921000371_ref33","doi-asserted-by":"publisher","DOI":"10.3115\/1273073.1273139"},{"key":"S1351324921000371_ref35","doi-asserted-by":"crossref","unstructured":"Li, J. , Liu, X. , Yin, W. , Yang, M. , Ma, L. and Jin, Y. (2020). Empirical evaluation of multi-task learning in deep neural networks for natural language processing. Neural Computing and Applications.","DOI":"10.1007\/s00521-020-05268-w"},{"key":"S1351324921000371_ref4","unstructured":"Anderson, S.R. , Brown, L. , Gaby, A. and Lecarme, J. (2006). Life on the edge: there\u2019s morphology there after all! Lingue e Linguaggio 1(1), 33\u201347."},{"key":"S1351324921000371_ref19","doi-asserted-by":"publisher","DOI":"10.3115\/992628.992688"},{"key":"S1351324921000371_ref22","doi-asserted-by":"publisher","DOI":"10.1162\/089120101750300490"},{"key":"S1351324921000371_ref46","first-page":"261","volume-title":"Building a Turkish Treebank","author":"Oflazer","year":"2003"},{"key":"S1351324921000371_ref48","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-1202"},{"key":"S1351324921000371_ref54","unstructured":"Sulubacak, U. and Eryi\u011fit, G. (2018). Implementing universal dependency, morphology and multiword expression annotation standards for Turkish language processing. Turkish Journal of Electrical Engineering & Computer Sciences."},{"volume-title":"LFG Conference, Workshop on Voice and Grammatical Functions in Austronesian Languages","year":"1998","author":"Foley","key":"S1351324921000371_ref20"},{"key":"S1351324921000371_ref31","doi-asserted-by":"crossref","unstructured":"Kornfilt, J. (2001). Functional projections and their subjects in Turkish clauses. In The Verb in Turkish. John Benjamins.","DOI":"10.1075\/la.44.08kor"},{"key":"S1351324921000371_ref10","doi-asserted-by":"publisher","DOI":"10.3115\/1117601.1117621"},{"key":"S1351324921000371_ref13","unstructured":"Dayan\u0131k, E. , Aky\u00fcrek, E. and Yuret, D. (2018). MorphNet: a sequence-to-sequence model that combines morphological analysis and disambiguation. CoRR, abs\/1805.07946."},{"key":"S1351324921000371_ref43","unstructured":"Neubig, G. , Dyer, C. , Goldberg, Y. , Matthews, A. , Ammar, W. , Anastasopoulos, A. , Ballesteros, M. , Chiang, D. , Clothiaux, D. , Cohn, T. , Duh, K. , Faruqui, M. , Gan, C. , Garrette, D. , Ji, Y. , Kong, L. , Kuncoro, A. , Kumar, G. , Malaviya, C. , Michel, P. , Oda, Y. , Richardson, M. , Saphra, N. , Swayamdipta, S. and Yin, P. (2017). Dynet: the dynamic neural network toolkit. arXiv preprint arXiv:1701.03980."},{"key":"S1351324921000371_ref52","doi-asserted-by":"publisher","DOI":"10.3115\/981574.981608"},{"key":"S1351324921000371_ref47","unstructured":"\u00d6zate\u015f, B. , \u00d6zg\u00fcr, A. , Gungor, T. and \u00d6zt\u00fcrk, B. (2018). A morphology-based representation model for LSTM-based dependency parsing of agglutinative languages. In Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies. Association for Computational Linguistics, pp. 238\u2013247."},{"key":"S1351324921000371_ref51","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33016949"},{"key":"S1351324921000371_ref23","first-page":"2335","article-title":"Producing power-law distributions and damping word frequencies with two-stage language models","volume":"12","author":"Goldwater","year":"2011","journal-title":"Journal of Machine Learning Research"},{"key":"S1351324921000371_ref60","doi-asserted-by":"publisher","DOI":"10.1109\/TASLP.2017.2788181"},{"key":"S1351324921000371_ref5","unstructured":"Boros, T. , Dumitrescu, S.D. and Burtica, R. (2018). NLP-cube: end-to-end raw text processing with neural networks. In Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies, Brussels, Belgium. Association for Computational Linguistics, pp. 171\u2013179."},{"key":"S1351324921000371_ref8","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-90165-7_8"},{"key":"S1351324921000371_ref49","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K18-2016"},{"key":"S1351324921000371_ref36","unstructured":"Lim, K. , Park, C. , Lee, C. and Poibeau, T. (2018). SEx BiST: a multi-source trainable parser with deep contextualized lexical representations. In Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies, Brussels, Belgium. Association for Computational Linguistics, pp. 143\u2013152."},{"key":"S1351324921000371_ref59","doi-asserted-by":"crossref","unstructured":"Vania, C. and Lopez, A. (2017). From characters to words to in between: do we capture morphology? In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Vancouver, Canada. Association for Computational Linguistics, pp. 2016\u20132027.","DOI":"10.18653\/v1\/P17-1184"},{"key":"S1351324921000371_ref39","doi-asserted-by":"publisher","DOI":"10.3115\/1219840.1219852"},{"key":"S1351324921000371_ref41","unstructured":"Mikolov, T. , Chen, K. , Corrado, G. and Dean, J. (2013). Efficient estimation of word representations in vector space. In Bengio Y. and LeCun, Y. (eds), 1st International Conference on Learning Representations, ICLR 2013, Scottsdale, Arizona, USA, May 2\u20134, 2013, Workshop Track Proceedings."},{"key":"S1351324921000371_ref17","unstructured":"Dozat, T. and Manning, C.D. (2017). Deep biaffine attention for neural dependency parsing. In 5th International Conference on Learning Representations, ICLR 2017, Conference Track Proceedings. OpenReview.net."},{"key":"S1351324921000371_ref29","unstructured":"K\u0131rnap, \u00d6. , Dayan\u0131k, E. and Yuret, D. (2018). Tree-stack LSTM in transition based dependency parsing. In Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies. Association for Computational Linguistics, pp. 124\u2013132."},{"key":"S1351324921000371_ref26","doi-asserted-by":"publisher","DOI":"10.1162\/coli.2007.33.3.355"},{"key":"S1351324921000371_ref38","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1441"},{"key":"S1351324921000371_ref12","doi-asserted-by":"publisher","DOI":"10.1145\/1187415.1187418"},{"key":"S1351324921000371_ref14","first-page":"255","article-title":"Universal dependencies","volume":"47","author":"de Marneffe","year":"2021","journal-title":"Computational Linguistics"},{"key":"S1351324921000371_ref18","unstructured":"Duthoo, E. and Mesnard, O. (2018). CEA LIST: processing low-resource languages for CoNLL 2018. In Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies, Brussels, Belgium."},{"key":"S1351324921000371_ref45","doi-asserted-by":"publisher","DOI":"10.3115\/1219840.1219853"},{"key":"S1351324921000371_ref11","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1078"},{"key":"S1351324921000371_ref16","unstructured":"Dos Santos, C.N. and Zadrozny, B. (2014). Learning character-level representations for part-of-speech tagging. In Proceedings of the 31st International Conference on International Conference on Machine Learning (ICML 2014) - Volume 32. JMLR.org, pp. II\u20131818\u2013II\u20131826."},{"key":"S1351324921000371_ref56","doi-asserted-by":"crossref","unstructured":"\u00dcst\u00fcn, A. , Kurfal, M. and Can, B. (2018). Characters or morphemes: how to represent words? In Proceedings of The Third Workshop on Representation Learning for NLP. Association for Computational Linguistics, pp. 144\u2013153.","DOI":"10.18653\/v1\/W18-3019"},{"key":"S1351324921000371_ref28","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00101"},{"key":"S1351324921000371_ref53","unstructured":"Straka, M. (2018). UDPipe 2.0 prototype at CoNLL 2018 UD shared task. In Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies, Brussels, Belgium. Association for Computational Linguistics, pp. 197\u2013207."},{"key":"S1351324921000371_ref62","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/N15-1005"},{"key":"S1351324921000371_ref25","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"S1351324921000371_ref9","unstructured":"Che, W. , Liu, Y. , Wang, Y. , Zheng, B. and Liu, T. (2018). Towards better UD parsing: deep contextualized word embeddings, ensemble, and treebank concatenation. In Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies. Association for Computational Linguistics, pp. 55\u201364."},{"key":"S1351324921000371_ref55","unstructured":"Sulubacak, U. , Gokirmak, M. , Tyers, F. , \u00c7\u00f6ltekin, \u00c7. , Nivre, J. and Eryi\u011fit, G. (2016). Universal dependencies for Turkish. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, Osaka, Japan. The COLING 2016 Organizing Committee, pp. 3444\u20133454."},{"key":"S1351324921000371_ref27","unstructured":"Kingma, D.P. and Ba, J. (2015). Adam: a method for stochastic optimization. In Bengio, Y. and LeCun Y. (eds), 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7\u20139, 2015, Conference Track Proceedings."},{"key":"S1351324921000371_ref40","unstructured":"McDonald, R. and Nivre, J. (2007). Characterizing the errors of data-driven dependency parsing models. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), Prague, Czech Republic. Association for Computational Linguistics, pp. 122\u2013131."},{"key":"S1351324921000371_ref37","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1176"},{"key":"S1351324921000371_ref61","unstructured":"Zeman, D. and Haji\u010d, J. (eds) (2018). Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies, Brussels, Belgium. Association for Computational Linguistics."},{"key":"S1351324921000371_ref34","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"S1351324921000371_ref44","doi-asserted-by":"crossref","unstructured":"Nguyen, D.Q. and Verspoor, K. (2018). An improved neural network model for joint POS tagging and dependency parsing. In Proceedings of the CoNLL Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies. The Association for Computational Linguistics, pp. 81\u201391.","DOI":"10.18653\/v1\/K17-3014"},{"key":"S1351324921000371_ref58","doi-asserted-by":"publisher","DOI":"10.1109\/KSE.2015.58"},{"key":"S1351324921000371_ref30","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1279"}],"container-title":["Natural Language Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S1351324921000371","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,23]],"date-time":"2022-11-23T08:40:41Z","timestamp":1669192841000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S1351324921000371\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,20]]},"references-count":62,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2022,11]]}},"alternative-id":["S1351324921000371"],"URL":"https:\/\/doi.org\/10.1017\/s1351324921000371","relation":{},"ISSN":["1351-3249","1469-8110"],"issn-type":[{"type":"print","value":"1351-3249"},{"type":"electronic","value":"1469-8110"}],"subject":[],"published":{"date-parts":[[2022,1,20]]},"assertion":[{"value":"\u00a9 The Author(s), 2022. Published by Cambridge University Press","name":"copyright","label":"Copyright","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}},{"value":"This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https:\/\/creativecommons.org\/licenses\/by\/4.0\/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.","name":"license","label":"License","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}},{"value":"This content has been made available to all.","name":"free","label":"Free to read"}]}}