{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,17]],"date-time":"2026-08-17T15:34:23Z","timestamp":1786980863270,"version":"build-2736575974"},"reference-count":21,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,1,3]],"date-time":"2024-01-03T00:00:00Z","timestamp":1704240000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,1,3]],"date-time":"2024-01-03T00:00:00Z","timestamp":1704240000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100006378","name":"Universitas Indonesia","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100006378","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Lang Resources &amp; Evaluation"],"published-print":{"date-parts":[[2025,3]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Constructing a question-answering dataset can be prohibitively expensive, making it difficult for researchers to make one for an under-resourced language, such as Indonesian. We create a novel Indonesian Question Answering dataset that is produced automatically end-to-end. The process uses Context Free Grammar, the Wikipedia Indonesian Corpus, and the concept of the proxy model. The dataset consists of 134 thousand simple questions and 60 thousand complex questions. It achieved competitive grammatical and model accuracy compared to the translated dataset but suffers from some issues due to resource constraints.<\/jats:p>","DOI":"10.1007\/s10579-023-09702-y","type":"journal-article","created":{"date-parts":[[2024,1,3]],"date-time":"2024-01-03T09:02:43Z","timestamp":1704272563000},"page":"135-160","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["AC-IQuAD: Automatically Constructed Indonesian Question Answering Dataset by Leveraging Wikidata"],"prefix":"10.1007","volume":"59","author":[{"given":"Kerenza","family":"Doxolodeo","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adila Alfa","family":"Krisnadhi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,1,3]]},"reference":[{"key":"9702_CR1","unstructured":"Carrino, C. P., Costa-juss\u00e0, M. R., & Fonollosa, J. A. R. (2020). Automatic spanish translation of squad dataset for multi-lingual question answering. In N. Calzolari, F. B\u00e9chet, & P. Blache, et\u00a0al (Eds.), Proceedings of the 12th language resources and evaluation conference, LREC 2020, May 11\u201316, 2020 (pp. 5515\u20135523). European Language Resources Association. https:\/\/aclanthology.org\/2020.lrec-1.677\/"},{"key":"9702_CR2","doi-asserted-by":"publisher","first-page":"454","DOI":"10.1162\/tacl_a_00317","volume":"8","author":"JH Clark","year":"2020","unstructured":"Clark, J. H., Palomaki, J., Nikolaev, V., et al. (2020). Tydi QA: A benchmark for information-seeking question answering in typologically diverse languages. Transactions of the Association for Computational Linguistics, 8, 454\u2013470. https:\/\/doi.org\/10.1162\/tacl_a_00317","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"9702_CR3","doi-asserted-by":"publisher","unstructured":"Devlin, J., Chang, M., & Lee, K. et\u00a0al. (2019). BERT: pre-training of deep bidirectional transformers for language understanding. In J. Burstein, C. Doran, & T. Solorio (Eds.), Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: Human language technologies, NAACL-HLT 2019, June 2\u20137, 2019 (Vol. 1, (Long and Short Papers), pp. 4171\u20134186). Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/n19-1423","DOI":"10.18653\/v1\/n19-1423"},{"key":"9702_CR4","doi-asserted-by":"publisher","unstructured":"Dubey, M., Banerjee, D., & Abdelkawi, A. et\u00a0al (2019). Lc-quad 2.0: A large dataset for complex question answering over wikidata and dbpedia. In: Ghidini C, Hartig O, Maleshkova M, et\u00a0al. (Eds.), The semantic web\u2014ISWC 2019\u201418th international semantic web conference, October 26\u201330, 2019, Proceedings, Part II, Lecture Notes in Computer Science (Vol. 11779, pp. 69\u201378). Springer. https:\/\/doi.org\/10.1007\/978-3-030-30796-7_5","DOI":"10.1007\/978-3-030-30796-7_5"},{"key":"9702_CR5","doi-asserted-by":"publisher","unstructured":"Eyal, M., Baumel, T., & Elhadad, M. (2019). Question answering as an automatic evaluation metric for news article summarization. In J. Burstein, C. Doran, & T. Solorio (Eds.), Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: Human language technologies, NAACL-HLT 2019 June 2\u20137, 2019 (Vol. 1 (Long and Short Papers), pp. 3938\u20133948). Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/n19-1395","DOI":"10.18653\/v1\/n19-1395"},{"key":"9702_CR6","unstructured":"Ghosh, I. (2020). Ranked: The 100 most spoken languages around the world. https:\/\/www.visualcapitalist.com\/100-most-spoken-languages\/"},{"key":"9702_CR7","unstructured":"Heilman, M., & Smith, N. A. (2010). Good question! statistical ranking for question generation. In Human language technologies: Conference of the North American chapter of the association of computational linguistics, proceedings, June 2\u20134, 2010 (pp. 609\u2013617). The Association for Computational Linguistics. https:\/\/aclanthology.org\/N10-1086\/"},{"key":"9702_CR8","doi-asserted-by":"publisher","unstructured":"Jia, R., & Liang, P. (2017). Adversarial examples for evaluating reading comprehension systems. In M. Palmer, R. Hwa, & S. Riedel (Eds.), Proceedings of the 2017 conference on empirical methods in natural language processing, EMNLP 2017, September 9\u201311, 2017 (pp. 2021\u20132031). Association for Computational Linguistics, https:\/\/doi.org\/10.18653\/v1\/d17-1215","DOI":"10.18653\/v1\/d17-1215"},{"key":"9702_CR9","doi-asserted-by":"crossref","unstructured":"Lample, G., Ott, M., & Conneau, A. et\u00a0al (2018). Phrase-based & neural unsupervised machine translation. In E. Riloff, D. Chiang, & J. Hockenmaier, et\u00a0al (Eds.), Proceedings of the 2018 conference on empirical methods in natural language processing, October 31\u2013November 4, 2018 (pp. 5039\u20135049). Association for Computational Linguistics. https:\/\/aclanthology.org\/D18-1549\/","DOI":"10.18653\/v1\/D18-1549"},{"issue":"2","key":"9702_CR10","doi-asserted-by":"publisher","first-page":"167","DOI":"10.3233\/SW-140134","volume":"6","author":"J Lehmann","year":"2015","unstructured":"Lehmann, J., Isele, R., Jakob, M., et al. (2015). Dbpedia\u2014A large-scale, multilingual knowledge base extracted from wikipedia. Semantic Web, 6(2), 167\u2013195. https:\/\/doi.org\/10.3233\/SW-140134","journal-title":"Semantic Web"},{"key":"9702_CR11","doi-asserted-by":"publisher","unstructured":"Lewis, PSH., Denoyer, L., & Riedel, S. (2019). Unsupervised question answering by cloze translation. In A. Korhonen, D. R. Traum, & L. M\u00e0rquez (Eds.), Proceedings of the 57th conference of the association for computational linguistics, ACL 2019, July 28\u2013August 2, 2019 (Vol. 1: Long Papers, pp. 4896\u20134910). Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/p19-1484","DOI":"10.18653\/v1\/p19-1484"},{"issue":"3","key":"9702_CR12","doi-asserted-by":"publisher","first-page":"276","DOI":"10.11613\/BM.2012.031","volume":"22","author":"ML McHugh","year":"2012","unstructured":"McHugh, M. L. (2012). Interrater reliability: The kappa statistic. Biochemia Medica, 22(3), 276\u2013282.","journal-title":"Biochemia Medica"},{"key":"9702_CR13","doi-asserted-by":"publisher","unstructured":"Muis, F. J., & Purwarianti, A. (2020). Sequence-to-sequence learning for Indonesian automatic question generator. In 2020 7th international conference on advance informatics: Concepts, theory and applications (ICAICTA) (pp. 1\u20136). https:\/\/doi.org\/10.1109\/ICAICTA49861.2020.9429032","DOI":"10.1109\/ICAICTA49861.2020.9429032"},{"key":"9702_CR14","doi-asserted-by":"publisher","unstructured":"Rajpurkar, P., Jia, R., & Liang, P. (2018). Know what you don\u2019t know: Unanswerable questions for squad. In I. Gurevych, Y. Miyao (Eds.), Proceedings of the 56th annual meeting of the association for computational linguistics, ACL 2018, July 15\u201320, 2018 (Vol. 2: Short Papers, pp. 784\u2013789). Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/P18-2124. https:\/\/aclanthology.org\/P18-2124\/","DOI":"10.18653\/v1\/P18-2124"},{"key":"9702_CR15","doi-asserted-by":"crossref","unstructured":"Reimers, N., Gurevych, I. (2019). Sentence-bert: Sentence embeddings using siamese bert-networks. arXiv preprint arXiv:1908.10084","DOI":"10.18653\/v1\/D19-1410"},{"key":"9702_CR16","doi-asserted-by":"publisher","unstructured":"Serban, I. V., Garc\u00eda-Dur\u00e1n, A., Gulcehre, C. et\u00a0al. (2016). Generating factoid questions with recurrent neural networks: The 30M factoid question-answer corpus. In Proceedings of the 54th annual meeting of the association for computational linguistics (Vol. 1: Long Papers, pp. 588\u2013598). Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/P16-1056, https:\/\/aclanthology.org\/P16-1056","DOI":"10.18653\/v1\/P16-1056"},{"key":"9702_CR17","unstructured":"Siblini, W., Pasqual, C., & Lavielle, A. et\u00a0al. (2019). Multilingual question answering from formatted text applied to conversational agents. CoRR abs\/1910.04659. http:\/\/arxiv.org\/abs\/1910.04659"},{"key":"9702_CR18","unstructured":"Turk, A. M. (2017). Mturk is now available to requesters from 43 countries. https:\/\/blog.mturk.com\/mturk-is-now-available-to-requesters-from-43-countries-77d16e6a164e"},{"issue":"10","key":"9702_CR19","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1145\/2629489","volume":"57","author":"D Vrandecic","year":"2014","unstructured":"Vrandecic, D., & Kr\u00f6tzsch, M. (2014). Wikidata: A free collaborative knowledgebase. Communication of the ACM, 57(10), 78\u201385. https:\/\/doi.org\/10.1145\/2629489","journal-title":"Communication of the ACM"},{"key":"9702_CR20","doi-asserted-by":"publisher","unstructured":"Weissenborn, D., Wiese, G., & Seiffe, L. (2017). Making neural QA as simple as possible but not simpler. In R. Levy, & L. Specia (Eds.), Proceedings of the 21st conference on computational natural language learning (CoNLL 2017), August 3\u20134, 2017 (pp. 271\u2013280). Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/K17-1028","DOI":"10.18653\/v1\/K17-1028"},{"key":"9702_CR21","doi-asserted-by":"crossref","unstructured":"Wilie, B., Vincentio, K., & Winata, G. I. et\u00a0al. (2020). Indonlu: Benchmark and resources for evaluating indonesian natural language understanding. In K. Wong, K. Knight, & H. Wu (Eds.), Proceedings of the 1st conference of the asia-pacific chapter of the association for computational linguistics and the 10th international joint conference on natural language processing, AACL\/IJCNLP 2020, December 4\u20137, 2020 (pp. 843\u2013857). Association for Computational Linguistics. https:\/\/aclanthology.org\/2020.aacl-main.85\/","DOI":"10.18653\/v1\/2020.aacl-main.85"}],"container-title":["Language Resources and Evaluation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10579-023-09702-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10579-023-09702-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10579-023-09702-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,17]],"date-time":"2025-03-17T08:25:27Z","timestamp":1742199927000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10579-023-09702-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,3]]},"references-count":21,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,3]]}},"alternative-id":["9702"],"URL":"https:\/\/doi.org\/10.1007\/s10579-023-09702-y","relation":{},"ISSN":["1574-020X","1574-0218"],"issn-type":[{"value":"1574-020X","type":"print"},{"value":"1574-0218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,3]]},"assertion":[{"value":"27 October 2023","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 January 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflicts of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}