{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T05:05:34Z","timestamp":1782363934418,"version":"3.54.5"},"publisher-location":"Cham","reference-count":47,"publisher":"Springer International Publishing","isbn-type":[{"value":"9783030997380","type":"print"},{"value":"9783030997397","type":"electronic"}],"license":[{"start":{"date-parts":[[2022,1,1]],"date-time":"2022-01-01T00:00:00Z","timestamp":1640995200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2022,1,1]],"date-time":"2022-01-01T00:00:00Z","timestamp":1640995200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022]]},"DOI":"10.1007\/978-3-030-99739-7_41","type":"book-chapter","created":{"date-parts":[[2022,4,4]],"date-time":"2022-04-04T23:02:47Z","timestamp":1649113367000},"page":"321-328","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":33,"title":["Leaf: Multiple-Choice Question Generation"],"prefix":"10.1007","author":[{"given":"Kristiyan","family":"Vachev","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Momchil","family":"Hardalov","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Georgi","family":"Karadzhov","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Georgi","family":"Georgiev","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ivan","family":"Koychev","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Preslav","family":"Nakov","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,4,5]]},"reference":[{"key":"41_CR1","doi-asserted-by":"crossref","unstructured":"Jacopo Amidei, Paul Piwek, and Alistair Willis. Evaluation methodologies in automatic question generation 2013\u20132018. In Proceedings of the 11th International Conference on Natural Language Generation, INLG \u201920, pages 307\u2013317, Tilburg University, The Netherlands, 2018. Association for Computational Linguistics","DOI":"10.18653\/v1\/W18-6537"},{"key":"41_CR2","unstructured":"Hangbo Bao, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Xiaodong Liu, Yu Wang, Jianfeng Gao, Songhao Piao, Ming Zhou, and Hsiao-Wuen Hon. UniLMv2: Pseudo-masked language models for unified language model pre-training. In Proceedings of the 37th International Conference on Machine Learning, volume 119 of ICML \u201920, pages 642\u2013652. PMLR, 2020"},{"key":"41_CR3","doi-asserted-by":"crossref","unstructured":"Ho-Lam Chung, Ying-Hong Chan, and Yao-Chung Fan. A BERT-based distractor generation scheme with multi-tasking and negative answer training strategies. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 4390\u20134400. Association for Computational Linguistics, 2020","DOI":"10.18653\/v1\/2020.findings-emnlp.393"},{"key":"41_CR4","doi-asserted-by":"publisher","first-page":"454","DOI":"10.1162\/tacl_a_00317","volume":"8","author":"JH Clark","year":"2020","unstructured":"Clark, J.H., Choi, E., Collins, M., Garrette, D., Kwiatkowski, T., Nikolaev, V., Palomaki, J.: TyDi QA: A benchmark for information-seeking question answering in typologically diverse languages. Transactions of the Association for Computational Linguistics 8, 454\u2013470 (2020)","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"41_CR5","unstructured":"Peter Clark, Isaac Cowhey, Oren Etzioni, Tushar Khot, Ashish Sabharwal, Carissa Schoenick, and Oyvind Tafjord. Think you have solved question answering? Try ARC, the AI2 Reasoning Challenge. arXiv:1803.05457, 2018"},{"key":"41_CR6","doi-asserted-by":"crossref","unstructured":"Peter Clark, Oren Etzioni, Tushar Khot, Daniel Khashabi, Bhavana Dalvi Mishra, Kyle Richardson, Ashish Sabharwal, Carissa Schoenick, Oyvind Tafjord, Niket Tandon, Sumithra Bhakthavatsalam, Dirk Groeneveld, Michal Guerquin, and Michael Schmitz. From \u2018F\u2019 to \u2018A\u2019 on the N.Y. Regents Science Exams: An overview of the Aristo project. AI Mag., 41(4):39\u201353, 2020","DOI":"10.1609\/aimag.v41i4.5304"},{"key":"41_CR7","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT \u201919, pages 4171\u20134186, Minneapolis, Minnesota, USA, 2019. Association for Computational Linguistics"},{"key":"41_CR8","unstructured":"Li\u00a0Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu\u00a0Wang, Jianfeng Gao, Ming Zhou, and Hsiao-Wuen Hon. Unified language model pre-training for natural language understanding and generation. In Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS\u00a0\u201919, pages 13042\u201313054, Vancouver, British Columbia, Canada, 2019"},{"key":"41_CR9","unstructured":"Xinya Du, Junru Shao, and Claire Cardie. Learning to ask: Neural question generation for reading comprehension. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, ACL \u201917, pages 1342\u20131352, Vancouver, Canada, 2017. Association for Computational Linguistics"},{"key":"41_CR10","doi-asserted-by":"crossref","unstructured":"Nan Duan, Duyu Tang, Peng Chen, and Ming Zhou. Question generation for question answering. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, EMNLP \u201917, pages 866\u2013874, Copenhagen, Denmark, 2017. Association for Computational Linguistics","DOI":"10.18653\/v1\/D17-1090"},{"key":"41_CR11","doi-asserted-by":"crossref","unstructured":"Yifan Gao, Lidong Bing, Piji Li, Irwin King, and Michael R. Lyu. Generating distractors for reading comprehension questions from real examinations. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 33 of AAAI \u201919, pages 6423\u20136430, 2019","DOI":"10.1609\/aaai.v33i01.33016423"},{"key":"41_CR12","doi-asserted-by":"crossref","unstructured":"Momchil Hardalov, Ivan Koychev, and Preslav Nakov. Beyond English-only reading comprehension: Experiments in zero-shot multilingual transfer for Bulgarian. In Proceedings of the International Conference on Recent Advances in Natural Language Processing, RANLP 19, pages 447\u2013459, Varna, Bulgaria, 2019. INCOMA Ltd","DOI":"10.26615\/978-954-452-056-4_053"},{"key":"41_CR13","doi-asserted-by":"crossref","unstructured":"Momchil Hardalov, Todor Mihaylov, Dimitrina Zlatkova, Yoan Dinkov, Ivan Koychev, and Preslav Nakov. EXAMS: A multi-subject high school examinations dataset for cross-lingual and multilingual question answering. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP \u201920, pages 5427\u20135444. Association for Computational Linguistics, 2020","DOI":"10.18653\/v1\/2020.emnlp-main.438"},{"key":"41_CR14","doi-asserted-by":"crossref","unstructured":"Ayako Hoshino and Hiroshi Nakagawa. WebExperimenter for multiple-choice question generation. In Proceedings of HLT\/EMNLP 2005 Interactive Demonstrations, HLT\/EMNLP \u201905, pages 18\u201319, Vancouver, British Columbia, Canada, 2005. Association for Computational Linguistics","DOI":"10.3115\/1225733.1225743"},{"key":"41_CR15","unstructured":"Junjie Hu, Sebastian Ruder, Aditya Siddhant, Graham Neubig, Orhan Firat, and Melvin Johnson. XTREME: A massively multilingual multi-task benchmark for evaluating cross-lingual generalisation. In Proceedings of the 37th International Conference on Machine Learning, volume 119 of ICML \u201920, pages 4411\u20134421. PMLR, 2020"},{"key":"41_CR16","doi-asserted-by":"crossref","unstructured":"Yimin Jing, Deyi Xiong, and Zhen Yan. BiPaR: A bilingual parallel dataset for multilingual and cross-lingual reading comprehension on novels. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, EMNLP-IJCNLP \u201919, pages 2452\u20132462, Hong Kong, China, 2019. Association for Computational Linguistics","DOI":"10.18653\/v1\/D19-1249"},{"key":"41_CR17","doi-asserted-by":"crossref","unstructured":"Kalpesh Krishna and Mohit Iyyer. Generating question-answer hierarchies. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, ACL \u201919, pages 2321\u20132334, Florence, Italy, 2019. Association for Computational Linguistics","DOI":"10.18653\/v1\/P19-1224"},{"key":"41_CR18","doi-asserted-by":"crossref","unstructured":"Ghader Kurdi, Jared Leo, Bijan Parsia, Uli Sattler, and Salam Al-Emari. A systematic review of automatic question generation for educational purposes. International Journal of Artificial Intelligence in Education, 30, 2019","DOI":"10.1007\/s40593-019-00186-y"},{"key":"41_CR19","doi-asserted-by":"crossref","unstructured":"Guokun Lai, Qizhe Xie, Hanxiao Liu, Yiming Yang, and Eduard Hovy. RACE: Large-scale ReAding comprehension dataset from examinations. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, EMNLP \u201917, pages 785\u2013794, Copenhagen, Denmark, 2017. Association for Computational Linguistics","DOI":"10.18653\/v1\/D17-1082"},{"key":"41_CR20","unstructured":"Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, and Radu Soricut. ALBERT: A lite BERT for self-supervised learning of language representations. In Proceedigs of the 8th International Conference on Learning Representations, ICLR \u201920, Addis Ababa, Ethiopia, 2020. OpenReview.net"},{"key":"41_CR21","doi-asserted-by":"crossref","unstructured":"Alon Lavie and Abhaya Agarwal. METEOR: An automatic metric for MT evaluation with high levels of correlation with human judgments. In Proceedings of the Second Workshop on Statistical Machine Translation, WMT \u201907, pages 228\u2013231, Prague, Czech Republic, 2007. Association for Computational Linguistics","DOI":"10.3115\/1626355.1626389"},{"key":"41_CR22","doi-asserted-by":"crossref","unstructured":"John Lee, Baikun Liang, and Haley Fong. Restatement and question generation for counsellor chatbot. In Proceedings of the 1st Workshop on NLP for Positive Impact, pages 1\u20137. Association for Computational Linguistics, 2021","DOI":"10.18653\/v1\/2021.nlp4posimpact-1.1"},{"key":"41_CR23","doi-asserted-by":"crossref","unstructured":"Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. BART: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, ACL \u201920, pages 7871\u20137880. Association for Computational Linguistics, 2020","DOI":"10.18653\/v1\/2020.acl-main.703"},{"key":"41_CR24","doi-asserted-by":"crossref","unstructured":"Patrick Lewis, Barlas Oguz, Ruty Rinott, Sebastian Riedel, and Holger Schwenk. MLQA: Evaluating cross-lingual extractive question answering. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, ACL \u201920, pages 7315\u20137330. Association for Computational Linguistics, 2020","DOI":"10.18653\/v1\/2020.acl-main.653"},{"key":"41_CR25","unstructured":"Chin-Yew Lin. ROUGE: A package for automatic evaluation of summaries. In Proceedigs of the Workshop on Text Summarization Branches Out, pages 74\u201381, Barcelona, Spain, 2004. Association for Computational Linguistics"},{"key":"41_CR26","unstructured":"Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, Tianlu Wang, Shuohui Chen, Daniel Simig, Myle Ott, Naman Goyal, Shruti Bhosale, Jingfei Du, et al. Few-shot learning with multilingual language models. arXiv:2112.10668, 2021"},{"key":"41_CR27","unstructured":"Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. RoBERTa: A robustly optimized BERT pretraining approach. arXiv:1907.11692, 2019"},{"key":"41_CR28","doi-asserted-by":"crossref","unstructured":"Todor Mihaylov, Peter Clark, Tushar Khot, and Ashish Sabharwal. Can a suit of armor conduct electricity? A new dataset for open book question answering. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, EMNLP \u201918, pages 2381\u20132391, Brussels, Belgium, 2018. Association for Computational Linguistics","DOI":"10.18653\/v1\/D18-1260"},{"key":"41_CR29","doi-asserted-by":"crossref","unstructured":"Ruslan Mitkov and Le An Ha. Computer-aided generation of multiple-choice tests. In Proceedings of the HLT-NAACL 03 Workshop on Building Educational Applications Using Natural Language Processing, BEA \u201903, pages 17\u201322, Edmonton, Alberta, Canada, 2003","DOI":"10.3115\/1118894.1118897"},{"key":"41_CR30","doi-asserted-by":"crossref","unstructured":"Kiet Van Nguyen, Khiem Vinh Tran, Son T. Luu, Anh Gia-Tuan Nguyen, and Ngan Luu-Thuy Nguyen. Enhancing lexical-based approach with external knowledge for Vietnamese multiple-choice machine reading comprehension. IEEE Access, 8:201404\u2013201417, 2020","DOI":"10.1109\/ACCESS.2020.3035701"},{"key":"41_CR31","unstructured":"Jeroen Offerijns, Suzan Verberne, and Tessa Verhoef. Better distractions: Transformer-based distractor generation and multiple choice question filtering. arXiv:2010.09598, 2020"},{"key":"41_CR32","doi-asserted-by":"crossref","unstructured":"Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, ACL \u201902, pages 311\u2013318, Philadelphia, Pennsylvania, USA, 2002. Association for Computational Linguistics","DOI":"10.3115\/1073083.1073135"},{"key":"41_CR33","unstructured":"Weizhen Qi, Yu Yan, Yeyun Gong, Dayiheng Liu, Nan Duan, Jiusheng Chen, Ruofei Zhang, and Ming Zhou. ProphetNet: Predicting future n-gram for sequence-to-sequence pre-training. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 2401\u20132410. Association for Computational Linguistics, 2020"},{"key":"41_CR34","unstructured":"Questgen. Questgen: AI powered question generator. http:\/\/questgen.ai\/. Accessed: 2022\u201301-05"},{"key":"41_CR35","unstructured":"Quillionz. Quillionz - world\u2019s first AI-powered question generator. https:\/\/www.quillionz.com\/. Accessed: 2022\u201301-05"},{"issue":"140","key":"41_CR36","first-page":"1","volume":"21","author":"C Raffel","year":"2020","unstructured":"Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., Liu, P.J.: Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research 21(140), 1\u201367 (2020)","journal-title":"Journal of Machine Learning Research"},{"key":"41_CR37","doi-asserted-by":"crossref","unstructured":"Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. SQuAD: 100,000+ questions for machine comprehension of text. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, EMNLP \u201916, pages 2383\u20132392, Austin, Texas, USA, 2016. Association for Computational Linguistics","DOI":"10.18653\/v1\/D16-1264"},{"key":"41_CR38","doi-asserted-by":"crossref","unstructured":"Henry L. Roediger III, Adam L. Putnam, and Megan A. Smith. Chapter one - ten benefits of testing and their applications to educational practice. In Psychology of Learning and Motivation, volume 55, pages 1\u201336. Academic Press, 2011","DOI":"10.1016\/B978-0-12-387691-1.00001-6"},{"key":"41_CR39","doi-asserted-by":"crossref","unstructured":"Melissa Roemmele, Deep Sidhpura, Steve DeNeefe, and Ling Tsou. AnswerQuest: A system for generating question-answer items from multi-paragraph documents. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations, EACL \u201921, pages 40\u201352, Online, 2021. Association for Computational Linguistics","DOI":"10.18653\/v1\/2021.eacl-demos.6"},{"key":"41_CR40","doi-asserted-by":"crossref","unstructured":"Linfeng Song, Zhiguo Wang, Wael Hamza, Yue Zhang, and Daniel Gildea. Leveraging context information for natural question generation. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT \u201918, pages 569\u2013574, New Orleans, Louisiana, USA, 2018. Association for Computational Linguistics","DOI":"10.18653\/v1\/N18-2090"},{"issue":"1","key":"41_CR41","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s41039-017-0051-y","volume":"12","author":"Y Susanti","year":"2017","unstructured":"Susanti, Y., Tokunaga, T., Nishikawa, H., Obari, H.: Evaluation of automatically generated english vocabulary questions. Research and practice in technology enhanced learning 12(1), 1\u201321 (2017)","journal-title":"Research and practice in technology enhanced learning"},{"key":"41_CR42","doi-asserted-by":"crossref","unstructured":"Oyvind Tafjord, Peter Clark, Matt Gardner, Wen-tau Yih, and Ashish Sabharwal. Quarel: A dataset and models for answering questions about qualitative relationships. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 33 of AAAI \u201919, pages 7063\u20137071, 2019","DOI":"10.1609\/aaai.v33i01.33017063"},{"key":"41_CR43","unstructured":"Andrew Trask, Phil Michalak, and John Liu. sense2vec - a fast and accurate method for word sense disambiguation in neural word embeddings. arXiv:1511.06388, 2015"},{"key":"41_CR44","doi-asserted-by":"crossref","unstructured":"Adam Trischler, Tong Wang, Xingdi Yuan, Justin Harris, Alessandro Sordoni, Philip Bachman, and Kaheer Suleman. NewsQA: A machine comprehension dataset. In Proceedings of the 2nd Workshop on Representation Learning for NLP, RepL4NLP \u201917, pages 191\u2013200, Vancouver, Canada, 2017. Association for Computational Linguistics","DOI":"10.18653\/v1\/W17-2623"},{"key":"41_CR45","doi-asserted-by":"crossref","unstructured":"Kristiyan Vachev, Momchil Hardalov, Georgi Karadzhov, Georgi Georgiev, Ivan Koychev, and Preslav Nakov. Generating answer candidates for quizzes and answer-aware question generators. In Proceedings of the Student Research Workshop Associated with RANLP 2021, RANLP \u201921, pages 203\u2013209. INCOMA Ltd., 2021","DOI":"10.26615\/issn.2603-2821.2021_028"},{"key":"41_CR46","doi-asserted-by":"crossref","unstructured":"Dongling Xiao, Han Zhang, Yu-Kun Li, Yu Sun, Hao Tian, Hua Wu, and Haifeng Wang. ERNIE-GEN: an enhanced multi-flow pre-training and fine-tuning framework for natural language generation. In Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, IJCAI \u201920, pages 3997\u20134003. ijcai.org, 2020","DOI":"10.24963\/ijcai.2020\/553"},{"key":"41_CR47","doi-asserted-by":"crossref","unstructured":"Qingyu Zhou, Nan Yang, Furu Wei, Chuanqi Tan, Hangbo Bao, and Ming Zhou. Neural question generation from text: A preliminary study. In Natural Language Processing and Chinese Computing, pages 662\u2013671, Cham, 2018. Springer International Publishing","DOI":"10.1007\/978-3-319-73618-1_56"}],"container-title":["Lecture Notes in Computer Science","Advances in Information Retrieval"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-030-99739-7_41","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,12]],"date-time":"2024-03-12T15:39:41Z","timestamp":1710257981000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-030-99739-7_41"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022]]},"ISBN":["9783030997380","9783030997397"],"references-count":47,"URL":"https:\/\/doi.org\/10.1007\/978-3-030-99739-7_41","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"value":"0302-9743","type":"print"},{"value":"1611-3349","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022]]},"assertion":[{"value":"5 April 2022","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"ECIR","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"European Conference on Information Retrieval","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Stavanger","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Norway","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2022","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"10 April 2022","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"14 April 2022","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"44","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"ecir2022","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/ecir2022.org","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Double-blind","order":1,"name":"type","label":"Type","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"EasyChair","order":2,"name":"conference_management_system","label":"Conference Management System","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"395","order":3,"name":"number_of_submissions_sent_for_review","label":"Number of Submissions Sent for Review","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"35","order":4,"name":"number_of_full_papers_accepted","label":"Number of Full Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"29","order":5,"name":"number_of_short_papers_accepted","label":"Number of Short Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"9% - The value is computed by the equation \"Number of Full Papers Accepted \/ Number of Submissions Sent for Review * 100\" and then rounded to a whole number.","order":6,"name":"acceptance_rate_of_full_papers","label":"Acceptance Rate of Full Papers","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"3","order":7,"name":"average_number_of_reviews_per_paper","label":"Average Number of Reviews per Paper","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"4-6","order":8,"name":"average_number_of_papers_per_reviewer","label":"Average Number of Papers per Reviewer","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"Yes","order":9,"name":"external_reviewers_involved","label":"External Reviewers Involved","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"Additionally, there are other papers: 11 reproducibility, 12 doctoral, 13 CLEF Labs, 5 workshops and 4 tutorials.","order":10,"name":"additional_info_on_review_process","label":"Additional Info on Review Process","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}}]}}