{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,3]],"date-time":"2026-03-03T16:11:47Z","timestamp":1772554307750,"version":"3.50.1"},"reference-count":71,"publisher":"MIT Press","license":[{"start":{"date-parts":[[2021,11,5]],"date-time":"2021-11-05T00:00:00Z","timestamp":1636070400000},"content-version":"vor","delay-in-days":308,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,10,27]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Despite the progress made in recent years in addressing natural language understanding (NLU) challenges, the majority of this progress remains to be concentrated on resource-rich languages like English. This work focuses on Persian language, one of the widely spoken languages in the world, and yet there are few NLU datasets available for this language. The availability of high-quality evaluation datasets is a necessity for reliable assessment of the progress on different NLU tasks and domains. We introduce ParsiNLU, the first benchmark in Persian language that includes a range of language understanding tasks\u2014reading comprehension, textual entailment, and so on. These datasets are collected in a multitude of ways, often involving manual annotations by native speakers. This results in over 14.5k new instances across 6 distinct NLU tasks. Additionally, we present the first results on state-of-the-art monolingual and multilingual pre-trained language models on this benchmark and compare them with human performance, which provides valuable insights into our ability to tackle natural language understanding challenges in Persian. We hope ParsiNLU fosters further research and advances in Persian language understanding.1<\/jats:p>","DOI":"10.1162\/tacl_a_00419","type":"journal-article","created":{"date-parts":[[2021,11,5]],"date-time":"2021-11-05T12:56:13Z","timestamp":1636116973000},"page":"1147-1162","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":12,"title":["<scp>ParsiNLU<\/scp>: A Suite of Language Understanding Challenges for Persian"],"prefix":"10.1162","volume":"9","author":[{"given":"Daniel","family":"Khashabi","sequence":"first","affiliation":[{"name":"Allen Institute for AI, USA"}]},{"given":"Arman","family":"Cohan","sequence":"additional","affiliation":[{"name":"Allen Institute for AI, USA"}]},{"given":"Siamak","family":"Shakeri","sequence":"additional","affiliation":[{"name":"Google, USA"}]},{"given":"Pedram","family":"Hosseini","sequence":"additional","affiliation":[{"name":"George Washington University, USA"}]},{"given":"Pouya","family":"Pezeshkpour","sequence":"additional","affiliation":[{"name":"UC Irvine, USA"}]},{"given":"Malihe","family":"Alikhani","sequence":"additional","affiliation":[{"name":"University of Pittsburgh, USA"}]},{"given":"Moin","family":"Aminnaseri","sequence":"additional","affiliation":[{"name":"TaskRabbit, USA"}]},{"given":"Marzieh","family":"Bitaab","sequence":"additional","affiliation":[{"name":"Arizona State University, USA"}]},{"given":"Faeze","family":"Brahman","sequence":"additional","affiliation":[{"name":"UC Santa Cruz, USA"}]},{"given":"Sarik","family":"Ghazarian","sequence":"additional","affiliation":[{"name":"University of Southern California, USA"}]},{"given":"Mozhdeh","family":"Gheini","sequence":"additional","affiliation":[]},{"given":"Arman","family":"Kabiri","sequence":"additional","affiliation":[{"name":"IMRSV Data Labs, Canada"}]},{"given":"Rabeeh Karimi","family":"Mahabagdi","sequence":"additional","affiliation":[{"name":"EPFL, Switzerland"}]},{"given":"Omid","family":"Memarrast","sequence":"additional","affiliation":[{"name":"University of Illinois - Chicago, USA"}]},{"given":"Ahmadreza","family":"Mosallanezhad","sequence":"additional","affiliation":[{"name":"Arizona State University, USA"}]},{"given":"Erfan","family":"Noury","sequence":"additional","affiliation":[{"name":"University of Maryland Baltimore County, USA"}]},{"given":"Shahab","family":"Raji","sequence":"additional","affiliation":[{"name":"Rutgers University, USA"}]},{"given":"Mohammad Sadegh","family":"Rasooli","sequence":"additional","affiliation":[{"name":"University of Pennsylvania, USA"}]},{"given":"Sepideh","family":"Sadeghi","sequence":"additional","affiliation":[{"name":"Google, USA"}]},{"given":"Erfan Sadeqi","family":"Azer","sequence":"additional","affiliation":[{"name":"Google, USA"}]},{"given":"Niloofar Safi","family":"Samghabadi","sequence":"additional","affiliation":[{"name":"Expedia Inc., USA"}]},{"given":"Mahsa","family":"Shafaei","sequence":"additional","affiliation":[]},{"given":"Saber","family":"Sheybani","sequence":"additional","affiliation":[{"name":"Indiana University - Bloomington, USA"}]},{"given":"Ali","family":"Tazarv","sequence":"additional","affiliation":[{"name":"UC Irvine, USA"}]},{"given":"Yadollah","family":"Yaghoobzadeh","sequence":"additional","affiliation":[{"name":"Microsoft, Canada"}]}],"member":"281","published-online":{"date-parts":[[2021,10,27]]},"reference":[{"key":"2021110920492125400_bib1","article-title":"Farstail: A Persian natural language inference dataset","author":"Amirkhani","year":"2020","journal-title":"arXiv preprint arXiv:2009.08820"},{"key":"2021110920492125400_bib2","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1162\/tacl_a_00002","article-title":"Multiple instance learning networks for fine-grained sentiment analysis","volume":"6","author":"Angelidis","year":"2018","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2021110920492125400_bib3","doi-asserted-by":"publisher","first-page":"7674","DOI":"10.18653\/v1\/2020.emnlp-main.618","article-title":"Translation artifacts in cross-lingual transfer learning","volume-title":"Proceedings of EMNLP","author":"Artetxe","year":"2020"},{"key":"2021110920492125400_bib4","doi-asserted-by":"publisher","first-page":"4623","DOI":"10.18653\/v1\/2020.acl-main.421","article-title":"On the cross-lingual transferability of monolingual representations","volume-title":"Proceedings of ACL","author":"Artetxe","year":"2020"},{"key":"2021110920492125400_bib5","first-page":"2855","article-title":"Optimizing annotation effort using active learning strategies: A sentiment analysis case study in Persian","volume-title":"Proceedings of LREC","author":"Asli","year":"2020"},{"key":"2021110920492125400_bib6","article-title":"Pars-absa: An aspect- based sentiment analysis dataset for Persian","author":"Ataei","year":"2019","journal-title":"arXiv preprint arXiv:1908.01815"},{"key":"2021110920492125400_bib7","first-page":"1533","article-title":"Semantic parsing on freebase from question-answer pairs","volume-title":"Proceedings of EMNLP","author":"Berant","year":"2013"},{"issue":"2","key":"2021110920492125400_bib8","first-page":"48","article-title":"The role of the corpus in writing a grammar: An introduction to a software","volume":"19","author":"Bijankhan","year":"2004","journal-title":"Iranian Journal of Linguistics"},{"key":"2021110920492125400_bib9","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1075","article-title":"A large annotated corpus for learning natural language inference","volume-title":"Proceedings of EMNLP","author":"Bowman","year":"2015"},{"key":"2021110920492125400_bib10","doi-asserted-by":"publisher","first-page":"17","DOI":"10.3115\/1220835.1220838","article-title":"Improved statistical machine translation using paraphrases","volume-title":"Proceedings of NAACL","author":"Callison-Burch","year":"2006"},{"key":"2021110920492125400_bib11","doi-asserted-by":"publisher","first-page":"454","DOI":"10.1162\/tacl_a_00317","article-title":"TyDi QA: A benchmark for information- seeking question answering in typologically diverse languages","volume":"8","author":"Clark","year":"2020","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2021110920492125400_bib12","article-title":"Think you have solved question answering? try arc, the ai2 reasoning challenge","author":"Clark","year":"2018","journal-title":"arXiv preprint arXiv: 1803.05457"},{"issue":"4","key":"2021110920492125400_bib13","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1609\/aimag.v41i4.5304","article-title":"From \u2018F\u2019 to \u2018A\u2019 on the NY Regents Science Exams: An overview of the Aristo Project","volume":"41","author":"Clark","year":"2020","journal-title":"AI Magazine"},{"issue":"1","key":"2021110920492125400_bib14","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1177\/001316446002000104","article-title":"A coefficient of agreement for nominal scales","volume":"20","author":"Cohen","year":"1960","journal-title":"Educational and Psychological Measurement"},{"key":"2021110920492125400_bib15","doi-asserted-by":"publisher","first-page":"2475","DOI":"10.18653\/v1\/D18-1269","article-title":"XNLI: Evaluating cross-lingual sentence representations","volume-title":"Proceedings of EMNLP","author":"Conneau","year":"2018"},{"key":"2021110920492125400_bib16","doi-asserted-by":"publisher","DOI":"10.2200\/S00509ED1V01Y201305HLT023","volume-title":"Recognizing Textual Entailment: Models and Applications","author":"Dagan","year":"2013"},{"key":"2021110920492125400_bib17","first-page":"4171","article-title":"BERT: Pre-training of deep bidirectional transformers for language understanding","volume-title":"Proceedings of NAACL","author":"Devlin","year":"2019"},{"key":"2021110920492125400_bib18","doi-asserted-by":"publisher","first-page":"33","DOI":"10.3115\/1614049.1614058","article-title":"Answering the question you wish they had asked: The impact of paraphrasing for question answering","volume-title":"Proceedings of NAACL","author":"Duboue","year":"2006"},{"key":"2021110920492125400_bib19","article-title":"Parsbert: Transformer-based model for Persian language understanding","author":"Farahani","year":"2020","journal-title":"arXiv preprint arXiv:2005.12515"},{"issue":"5","key":"2021110920492125400_bib20","doi-asserted-by":"publisher","first-page":"378","DOI":"10.1037\/h0031619","article-title":"Measuring nominal scale agreement among many raters.","volume":"76","author":"Fleiss","year":"1971","journal-title":"Psychological Bulletin"},{"key":"2021110920492125400_bib21","doi-asserted-by":"publisher","first-page":"946","DOI":"10.18653\/v1\/2020.acl-main.89","article-title":"Injecting numerical reasoning skills into language models","volume-title":"Proceedings of ACL","author":"Geva","year":"2020"},{"key":"2021110920492125400_bib22","article-title":"MMQA: A multi-domain multi-lingual question-answering framework for English and Hindi","volume-title":"Proceedings of LREC","author":"Gupta","year":"2018"},{"key":"2021110920492125400_bib23","doi-asserted-by":"publisher","first-page":"379","DOI":"10.18653\/v1\/W19-5944","article-title":"Investigating evaluation of open-domain dialogue systems with human generated multiple references","volume-title":"Proceedings of SIGDIAL","author":"Gupta","year":"2019"},{"key":"2021110920492125400_bib24","article-title":"Sentipers: A sentiment analysis corpus for Persian","author":"Hosseini","year":"2018","journal-title":"arXiv preprint arXiv:1801.07737"},{"key":"2021110920492125400_bib25","first-page":"1917","article-title":"Product quality assessment using opinion mining in Persian online shopping","volume-title":"Proceedings of ICEE","author":"HosseinzadehBendarkheili","year":"2019"},{"key":"2021110920492125400_bib26","first-page":"4411","article-title":"Xtreme: A massively multilingual multi-task benchmark for evaluating cross-lingual generalisation","volume-title":"Proceedings of ICML","author":"Junjie","year":"2020"},{"key":"2021110920492125400_bib27","article-title":"Extracting an English- Persian parallel corpus from comparable corpora","volume-title":"Proceedings of LREC","author":"Karimi","year":"2018"},{"key":"2021110920492125400_bib28","article-title":"Mizan: A large Persian-English parallel corpus","author":"Kashefi","year":"2018","journal-title":"arXiv preprint arXiv:1801.02107"},{"key":"2021110920492125400_bib29","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.329","article-title":"GLUECoS: An evaluation benchmark for code-switched NLP","volume-title":"Proceedings of ACL","author":"Khanuja","year":"2020"},{"key":"2021110920492125400_bib30","doi-asserted-by":"publisher","first-page":"1896","DOI":"10.18653\/v1\/2020.findings-emnlp.171","article-title":"UnifiedQA: Crossing format boundaries with a single QA system","volume-title":"Proceedings of EMNLP (Findings)","author":"Khashabi","year":"2020"},{"key":"2021110920492125400_bib31","article-title":"GooAQ: Open question answering with diverse answer types","author":"Khashabi","year":"2021","journal-title":"arXiv preprint arXiv:2104.08727"},{"key":"2021110920492125400_bib32","first-page":"6323","article-title":"LSCP: Enhanced large scale colloquial Persian language understanding","volume-title":"Proceedings of LREC","author":"Khojasteh","year":"2020"},{"key":"2021110920492125400_bib33","first-page":"29","article-title":"Departamento de nosotros: How machine translated corpora affects language models in mrc tasks","volume-title":"Proceedings of the Workshop on Hybrid Intelligence for Natural Language Processing Tasks (HI4NLP 2020) co-located with 24th European Conference on Artificial Intelligence (ECAI 2020): Santiago de Compostela, Spain, August 29, 2020","author":"Khvalchik","year":"2020"},{"key":"2021110920492125400_bib34","doi-asserted-by":"publisher","first-page":"453","DOI":"10.1162\/tacl_a_00276","article-title":"Natural questions: A benchmark for question answering research","volume":"7","author":"Kwiatkowski","year":"2019","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2021110920492125400_bib35","doi-asserted-by":"publisher","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","author":"Richard Landis","year":"1977","journal-title":"Biometrics"},{"key":"2021110920492125400_bib36","doi-asserted-by":"publisher","first-page":"7315","DOI":"10.18653\/v1\/2020.acl-main.653","article-title":"MLQA: Evaluating cross-lingual extractive question answering","volume-title":"Proceedings of ACL","author":"Lewis","year":"2020"},{"key":"2021110920492125400_bib37","doi-asserted-by":"publisher","first-page":"6008","DOI":"10.18653\/v1\/2020.emnlp-main.484","article-title":"XGLUE: A new benchmark datasetfor cross-lingual pre-training, understanding and generation","volume-title":"Proceedings of EMNLP","author":"Liang","year":"2020"},{"key":"2021110920492125400_bib38","article-title":"Korquad1.0: Korean QA dataset for machine reading comprehension","author":"Lim","year":"2019","journal-title":"arXiv preprint arXiv:1909.07005"},{"issue":"1","key":"2021110920492125400_bib39","doi-asserted-by":"publisher","first-page":"1","DOI":"10.2200\/S00416ED1V01Y201204HLT016","article-title":"Sentiment analysis and opinion mining","volume":"5","author":"Liu","year":"2012","journal-title":"Synthesis Lectures on Human Language Technologies"},{"key":"2021110920492125400_bib40","article-title":"MKQA: A linguistically diverse benchmark for multilingual open domain question answering","author":"Longpre","year":"2020","journal-title":"arXiv preprint arXiv:2007.15207"},{"key":"2021110920492125400_bib41","volume-title":"The Indo-aryan Languages","author":"Masica","year":"1993"},{"key":"2021110920492125400_bib42","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1260","article-title":"Can a suit of armor conduct electricity? A new dataset for open book question answering","volume-title":"Proceedings of EMNLP","author":"Mihaylov","year":"2018"},{"key":"2021110920492125400_bib43","first-page":"75","article-title":"Improved language modeling for English-Persian statistical machine translation","volume-title":"Proceedings of the Workshop on Syntax and Structure in Statistical Translation","author":"Mohaghegh","year":"2010"},{"key":"2021110920492125400_bib44","first-page":"9","article-title":"Improving Persian- English statistical machine translation:experiments in domain adaptation","volume-title":"Proceedings of the Workshop on South Southeast Asian Natural Language Processing (WSSANLP)","author":"Mohaghegh","year":"2011"},{"key":"2021110920492125400_bib45","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1162\/tacl_a_00167","article-title":"The language demographics of Amazon Mechanical Turk","volume":"2","author":"Pavlick","year":"2014","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2021110920492125400_bib46","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1007\/978-3-642-19437-5_6","article-title":"TEP: Tehran English-Persian parallel corpus","volume-title":"International Conference on Intelligent Text Processing and Computational Linguistics","author":"Pilevar","year":"2011"},{"key":"2021110920492125400_bib47","first-page":"2362","article-title":"XCOPA: A multilingual dataset for causal commonsense reasoning","volume-title":"Proceedings of EMNLP","author":"Ponti","year":"2020"},{"key":"2021110920492125400_bib48","doi-asserted-by":"publisher","first-page":"27","DOI":"10.3115\/v1\/S14-2004","article-title":"SemEval-2014 task 4: Aspect based sentiment analysis","volume-title":"Proceedings of the International Workshop on Semantic Evaluation (SemEval 2014)","author":"Pontiki","year":"2014"},{"key":"2021110920492125400_bib49","doi-asserted-by":"publisher","first-page":"186","DOI":"10.18653\/v1\/W18-6319","article-title":"A call for clarity in reporting BLEU scores","volume-title":"Proceedings of WMT","author":"Post","year":"2018"},{"key":"2021110920492125400_bib50","first-page":"900","article-title":"Parallel global voices: A collection of multilingual corpora with citizen media stories","volume-title":"Proceedings of LREC","author":"Prokopidis","year":"2016"},{"issue":"140","key":"2021110920492125400_bib51","first-page":"1","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer","volume":"21","author":"Raffel","year":"2020","journal-title":"Journal of Machine Learning Research"},{"key":"2021110920492125400_bib52","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D16-1264","article-title":"SQUAD: 100,000+ questions for machine comprehension of text","volume-title":"Proceedings of EMNLP","author":"Rajpurkar","year":"2016"},{"key":"2021110920492125400_bib53","first-page":"1047","article-title":"Orthographic and morphological processing for Persian-to-English statistical machine translation","volume-title":"Proceedings of IJCNLP","author":"Rasooli","year":"2013"},{"key":"2021110920492125400_bib54","first-page":"193","article-title":"MCTest: A challenge dataset for the open-domain machine comprehension of text","volume-title":"Proceedings of EMNLP","author":"Richardson","year":"2013"},{"key":"2021110920492125400_bib55","doi-asserted-by":"crossref","unstructured":"Mojgan\n              Seraji\n            , CarinaJahani, Be\u00e1taMegyesi, and JoakimNivre. 2013. Uppsala Persian dependency treebank annotation guidelines. Technical report, Uppsala University.","DOI":"10.33011\/lilt.v7i.1297"},{"issue":"1","key":"2021110920492125400_bib56","doi-asserted-by":"publisher","first-page":"91","DOI":"10.29252\/jsdp.16","article-title":"Payma: A tagged corpus of Persian named entities","volume":"16","author":"Shahshahani","year":"2019","journal-title":"Signal and Data Processing"},{"key":"2021110920492125400_bib57","article-title":"Deepsentipers: Novel deep learning models trained over proposed augmented Persian sentiment corpus","author":"Sharami","year":"2020","journal-title":"arXiv preprint arXiv:2004.05328"},{"key":"2021110920492125400_bib58","doi-asserted-by":"publisher","first-page":"4717","DOI":"10.18653\/v1\/2020.emnlp-main.381","article-title":"Russiansuperglue: A Russian language understanding evaluation benchmark","volume-title":"Proceedings of EMNLP","author":"Shavrina","year":"2020"},{"key":"2021110920492125400_bib59","volume-title":"Ethnologue: Languages of Asia","author":"Simons","year":"2017"},{"key":"2021110920492125400_bib60","first-page":"380","article-title":"Utilizing BERT for aspect-based sentiment analysis via constructing auxiliary sentence","volume-title":"Proceedings of NAACL","author":"Sun","year":"2019"},{"key":"2021110920492125400_bib61","first-page":"4149","article-title":"CommonsenseQA: A question answering challenge targeting commonsense knowledge","volume-title":"Proceedings of NAACL","author":"Talmor","year":"2019"},{"issue":"6","key":"2021110920492125400_bib62","doi-asserted-by":"crossref","first-page":"823","DOI":"10.1177\/0165551510388123","article-title":"Aspect-based sentiment analysis of movie reviews on discussion boards","volume":"36","author":"Thet","year":"2010","journal-title":"Journal of Information Science"},{"key":"2021110920492125400_bib63","doi-asserted-by":"publisher","DOI":"10.1177\/0165551510388123","article-title":"The OPUS corpus - parallel and free: http:\/\/logos.uio.no\/opus","volume-title":"Proceedings of LREC","author":"Tiedemann","year":"2004"},{"key":"2021110920492125400_bib64","first-page":"3266","article-title":"Superglue: A stickier benchmark for general-purpose language understanding systems","volume-title":"Proceedings of NourIPS","author":"Wang","year":"2019"},{"key":"2021110920492125400_bib65","doi-asserted-by":"publisher","first-page":"1112","DOI":"10.18653\/v1\/N18-1101","article-title":"A broad-coverage challenge corpus for sentence understanding through inference","volume-title":"Proceedings of NAACL","author":"Williams","year":"2018"},{"key":"2021110920492125400_bib66","first-page":"4762","article-title":"CLUE: A chinese language understanding evaluation benchmark","volume-title":"Proceedings of COLING","author":"Liang","year":"2020"},{"key":"2021110920492125400_bib67","first-page":"483","article-title":"MT5: A massively multilingual pre-trained text-to-text transformer","volume-title":"Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Xue","year":"2021"},{"key":"2021110920492125400_bib68","doi-asserted-by":"publisher","first-page":"3678","DOI":"10.18653\/v1\/D19-1382","article-title":"PAWS-X: A cross-lingual adversarial dataset for paraphrase identification","volume-title":"Proceedings of EMNLP-IJCNLP","author":"Yang","year":"2019"},{"key":"2021110920492125400_bib69","doi-asserted-by":"publisher","first-page":"656","DOI":"10.18653\/v1\/P18-2104","article-title":"Adaptive knowledge sharing in multi-task learning: Improving low-resource neural machine translation","volume-title":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)","author":"Zaremoodi","year":"2018"},{"key":"2021110920492125400_bib70","doi-asserted-by":"publisher","first-page":"1628","DOI":"10.18653\/v1\/2020.acl-main.148","article-title":"Improving massively multilingual neural machine translation and zero-shot translation","volume-title":"Proceedings of ACL","author":"Zhang","year":"2020"},{"key":"2021110920492125400_bib71","doi-asserted-by":"publisher","DOI":"10.3115\/1072228.1072389","article-title":"Lexical query paraphrasing for document retrieval","volume-title":"Proceedings of COLING","author":"Zukerman","year":"2002"}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/tacl\/article-pdf\/doi\/10.1162\/tacl_a_00419\/1971807\/tacl_a_00419.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/tacl\/article-pdf\/doi\/10.1162\/tacl_a_00419\/1971807\/tacl_a_00419.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,11,9]],"date-time":"2021-11-09T20:49:56Z","timestamp":1636490996000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/doi\/10.1162\/tacl_a_00419\/107835\/ParsiNLU-A-Suite-of-Language-Understanding"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021]]},"references-count":71,"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00419","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021]]},"published":{"date-parts":[[2021]]}}}