{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,13]],"date-time":"2025-03-13T03:40:33Z","timestamp":1741837233314,"version":"3.38.0"},"reference-count":50,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,3,13]],"date-time":"2025-03-13T00:00:00Z","timestamp":1741824000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,3,13]],"date-time":"2025-03-13T00:00:00Z","timestamp":1741824000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100005416","name":"Research Council of Norway","doi-asserted-by":"crossref","award":["325741"],"award-info":[{"award-number":["325741"]}],"id":[{"id":"10.13039\/501100005416","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100010662","name":"H2020 Excellent Science","doi-asserted-by":"publisher","award":["964800"],"award-info":[{"award-number":["964800"]}],"id":[{"id":"10.13039\/100010662","id-type":"DOI","asserted-by":"publisher"}]},{"name":"HORIZON-ERC-POC","award":["101123485"],"award-info":[{"award-number":["101123485"]}]},{"DOI":"10.13039\/100019180","name":"HORIZON EUROPE European Research Council","doi-asserted-by":"publisher","award":["101136262"],"award-info":[{"award-number":["101136262"]}],"id":[{"id":"10.13039\/100019180","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100007465","name":"UiT The Arctic University of Norway","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100007465","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Discov Artif Intell"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Solving math word problems of varying complexities is one of the most challenging and exciting research questions in artificial intelligence (AI), particularly in natural language processing (NLP) and machine learning (ML). Foundational language models such as GPT must be evaluated for intelligence, and solving word problems is a key method for this assessment. These problems become especially difficult when presented in low-resource regional languages such as Bengali. Word problem solving integrates the cognitive domains of language processing, comprehension, and transformation into real-world solutions. During the past decade, advances in AI and machine learning have significantly progressed in addressing this complex issue. Although researchers worldwide have primarily utilized datasets in English and some in Chinese, there has been a lack of standard datasets for low-resource languages such as Bengali. In this pioneering study, we introduce the first Bengali Math Word Problem Benchmark Data Set (BMWP), comprising 8653 word problems. We detail the creation of this dataset and the benchmarking methods employed. Furthermore, we investigate operation prediction from Bengali word problems using state-of-the-art deep learning (DL) techniques. We implemented and compared various standard DL-based neural network architectures, achieving an accuracy of <jats:inline-formula>\n              <jats:alternatives>\n                <jats:tex-math>$$92 \\pm 2\\%$$<\/jats:tex-math>\n                <mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                  <mml:mrow>\n                    <mml:mn>92<\/mml:mn>\n                    <mml:mo>\u00b1<\/mml:mo>\n                    <mml:mn>2<\/mml:mn>\n                    <mml:mo>%<\/mml:mo>\n                  <\/mml:mrow>\n                <\/mml:math>\n              <\/jats:alternatives>\n            <\/jats:inline-formula>. The data set and the code will be available at <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"https:\/\/github.com\/SanchitaMondal\/BMWP\" ext-link-type=\"uri\">https:\/\/github.com\/SanchitaMondal\/BMWP<\/jats:ext-link>.<\/jats:p>","DOI":"10.1007\/s44163-025-00243-7","type":"journal-article","created":{"date-parts":[[2025,3,13]],"date-time":"2025-03-13T03:05:07Z","timestamp":1741835107000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["BMWP: the first Bengali math word problems dataset for operation prediction and solving"],"prefix":"10.1007","volume":"5","author":[{"given":"Sanchita","family":"Mondal","sequence":"first","affiliation":[]},{"given":"Debnarayan","family":"Khatua","sequence":"additional","affiliation":[]},{"given":"Sourav","family":"Mandal","sequence":"additional","affiliation":[]},{"given":"Dilip K.","family":"Prasad","sequence":"additional","affiliation":[]},{"given":"Arif Ahmed","family":"Sekh","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,3,13]]},"reference":[{"key":"243_CR1","unstructured":"Cao Y, Li S, Liu Y, Yan Z, Dai Y, Yu PS, Sun L. A comprehensive survey of ai-generated content (aigc): a history of generative ai from gan to chatgpt. arXiv preprint arXiv:2303.04226. 2023."},{"key":"243_CR2","doi-asserted-by":"crossref","unstructured":"Kushman N, Artzi Y, Zettlemoyer L, Barzilay R. Learning to automatically solve algebra word problems. In: Proceedings of the 52nd annual meeting of the association for computational linguistics (Volume 1: Long Papers), 2014, 271\u2013281.","DOI":"10.3115\/v1\/P14-1026"},{"key":"243_CR3","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1162\/tacl_a_00012","volume":"6","author":"S Roy","year":"2018","unstructured":"Roy S, Roth D. Mapping to declarative knowledge for word problem solving. Trans Assoc Comput Linguist. 2018;6:159\u201372.","journal-title":"Trans Assoc Comput Linguist"},{"key":"243_CR4","doi-asserted-by":"crossref","unstructured":"Koncel-Kedziorski R, Roy S, Amini A, Kushman N, Hajishirzi H. Mawps: a math word problem repository. In: Proceedings of the 2016 conference of the north american chapter of the association for computational linguistics: human language technologies. 2016, 1152\u20131157.","DOI":"10.18653\/v1\/N16-1136"},{"key":"243_CR5","doi-asserted-by":"crossref","unstructured":"Wang Y, Liu X, Shi S. Deep neural solver for math word problems. In: Proceedings of the 2017 conference on empirical methods in natural language processing, 2017, 845\u2013854","DOI":"10.18653\/v1\/D17-1088"},{"key":"#cr-split#-243_CR6.1","unstructured":"Sharma H, Mishra P, Sharma DM. HAWP: a dataset for hindi arithmetic word problem solving. In: Calzolari N, B\u00e9chet F, Blache P, Choukri K, Cieri C, Declerck T, Goggi S, Isahara H, Maegaard B, Mariani J, Mazo H, Odijk J, Piperidis S (eds) proceedings of the thirteenth Language Resources and Evaluation Conference, LREC 2022, Marseille, France, 20-25 June (2022)"},{"key":"#cr-split#-243_CR6.2","unstructured":"3479-3490. European Language Resources Association, 2022. https:\/\/aclanthology.org\/2022.lrec-1.373."},{"key":"#cr-split#-243_CR7.1","unstructured":"Alghamdi R, Liang Z, Zhang X. Armath: a dataset for solving arabic math word problems. In: Calzolari N, B\u00e9chet F, Blache P, Choukri K, Cieri C, Declerck T, Goggi S, Isahara H, Maegaard B, Mariani J, Mazo H, Odijk J, Piperidis S, (eds) proceedings of the thirteenth language resources and evaluation conference, LREC 2022, Marseille, France, 20-25 June (2022)"},{"key":"#cr-split#-243_CR7.2","unstructured":"pp. 351-362. European Language Resources Association, 2022. https:\/\/aclanthology.org\/2022.lrec-1.37."},{"key":"243_CR8","doi-asserted-by":"crossref","unstructured":"Gedik E. Solving turkish math word problems by sequence-to-sequence encoder-decoder models. PhD thesis, Bogazi\u00e7i University, 2022.","DOI":"10.55730\/1300-0632.3993"},{"key":"243_CR9","doi-asserted-by":"publisher","unstructured":"Ki KS, Lee D, Gweon G. Kotab: Korean template-based arithmetic solver with BERT. In: Lee W, Chen L, Moon Y, Bourgeois J, Bennis M, Li Y, Ha Y, Kwon H, Cuzzocrea A (eds) 2020 IEEE International Conference on Big Data and Smart Computing, BigComp 2020, Busan, Korea (South), February 19\u201322, 2020, pp. 279\u2013282. IEEE, 2020. https:\/\/doi.org\/10.1109\/BigComp48618.2020.00-61 .","DOI":"10.1109\/BigComp48618.2020.00-61"},{"key":"243_CR10","unstructured":"Riley MS, et al. Development of children\u2019s problem-solving ability in arithmetic. 1984."},{"issue":"1","key":"243_CR11","doi-asserted-by":"publisher","first-page":"27","DOI":"10.2307\/748656","volume":"12","author":"TP Carpenter","year":"1981","unstructured":"Carpenter TP, Moser JM, Hiebert J. Problem structure and first-grade children\u2019s initial solution processes for simple addition and subtraction problems. J Res Math Educ. 1981;12(1):27\u201339.","journal-title":"J Res Math Educ"},{"issue":"4","key":"243_CR12","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1007\/BF00366618","volume":"13","author":"P Nesher","year":"1982","unstructured":"Nesher P, Greeno JG, Riley MS. The development of semantic categories for addition and subtraction. Educ Stud Math. 1982;13(4):373\u201394.","journal-title":"Educ Stud Math"},{"key":"243_CR13","doi-asserted-by":"crossref","unstructured":"Vergnaud G. A classification of cognitive tasks and operations of thought involved in addition and subtraction problems. In: Addition and subtraction. Routledge; 2020, 39\u201359.","DOI":"10.1201\/9781003046585-4"},{"key":"243_CR14","unstructured":"Heller J, Greeno J. Semantic processing in arithmetic word problem solving. In: Annual Meeting of the Midwestern Psychological Association, Chicago, 1978."},{"issue":"1","key":"243_CR15","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1207\/s1532690xci0201_2","volume":"2","author":"RV Morales","year":"1985","unstructured":"Morales RV, Shute VJ, Pellegrino JW. Developmental differences in understanding and solving simple mathematics word problems. Cognit Instruct. 1985;2(1):41\u201357.","journal-title":"Cognit Instruct"},{"issue":"1","key":"243_CR16","doi-asserted-by":"publisher","first-page":"1135770","DOI":"10.1080\/2331186X.2015.1135770","volume":"3","author":"S Kingsdorf","year":"2016","unstructured":"Kingsdorf S, Krawec J. A broad look at the literature on math word problem-solving interventions for third graders. Cogent Educ. 2016;3(1):1135770.","journal-title":"Cogent Educ"},{"key":"243_CR17","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1016\/j.lindif.2016.10.015","volume":"52","author":"AY Wang","year":"2016","unstructured":"Wang AY, Fuchs LS, Fuchs D. Cognitive and linguistic predictors of mathematical word problems with and without irrelevant information. Learn Individual Differ. 2016;52:79\u201387.","journal-title":"Learn Individual Differ"},{"key":"243_CR18","unstructured":"Feigenbaum EA, Feldman J. Computers and thought vol. 7. New York McGraw-Hill, 1963."},{"key":"243_CR19","unstructured":"Bobrow DG. Natural language input for a computer problem solving system, 1964."},{"key":"243_CR20","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1007\/s10462-009-9110-0","volume":"29","author":"A Mukherjee","year":"2008","unstructured":"Mukherjee A, Garain U. A review of methods for automatic understanding of natural language mathematical problems. Artif Intell Rev. 2008;29:93\u2013122.","journal-title":"Artif Intell Rev"},{"key":"243_CR21","first-page":"95","volume":"2017","author":"S Mandal","year":"2019","unstructured":"Mandal S, Naskar SK. Solving arithmetic mathematical word problems: a review and recent advancements. Inf Technol Appl Math ICITAM. 2019;2017:95\u2013114.","journal-title":"Inf Technol Appl Math ICITAM"},{"issue":"9","key":"243_CR22","doi-asserted-by":"publisher","first-page":"2287","DOI":"10.1109\/TPAMI.2019.2914054","volume":"42","author":"D Zhang","year":"2019","unstructured":"Zhang D, Wang L, Zhang L, Dai BT, Shen HT. The gap of semantic parsing: a survey on automatic math word problem solvers. IEEE Trans Pattern Anal Mach Intell. 2019;42(9):2287\u2013305.","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"243_CR23","doi-asserted-by":"crossref","unstructured":"Ling W, Yogatama D, Dyer C, Blunsom P. Program induction by rationale generation: learning to solve and explain algebraic word problems. arXiv preprint, 2017, arXiv:1705.04146.","DOI":"10.18653\/v1\/P17-1015"},{"key":"243_CR24","unstructured":"Amini A, Gabriel S, Lin P, Koncel-Kedziorski R, Choi Y, Hajishirzi H. Mathqa: towards interpretable math word problem solving with operation-based formalisms. arXiv preprint, 2019. arXiv:1905.13319."},{"key":"243_CR25","unstructured":"Zhao W, Shang M, Liu Y, Wang L, Liu J. Ape210k: a large-scale and template-rich dataset of math word problems. arXiv preprint. 2020. arXiv:2009.11506."},{"key":"243_CR26","doi-asserted-by":"crossref","unstructured":"Mitra A, Baral C. Learning to use formulas to solve simple arithmetic problems. In: Proceedings of the 54th annual meeting of the association for computational linguistics (Volume 1: Long Papers), 2016; 2144\u20132153.","DOI":"10.18653\/v1\/P16-1202"},{"key":"243_CR27","unstructured":"Webber B, Cohn T, He Y, Liu Y. Learning to solve arithmetic word problems with verb categorization. In: Proceedings of the 2020 conference on Empirical Methods in Natural Language Processing (EMNLP) 2020"},{"key":"243_CR28","doi-asserted-by":"crossref","unstructured":"Miao S-Y, Liang C-C, Su K-Y. A diverse corpus for evaluating and developing english math word problem solvers. arXiv preprint. 2021. arXiv:2106.15772.","DOI":"10.18653\/v1\/2020.acl-main.92"},{"key":"243_CR29","doi-asserted-by":"crossref","unstructured":"Patel A, Bhattamishra S, Goyal N. Are nlp models really able to solve simple math word problems? arXiv preprint. 2021. arXiv:2103.07191.","DOI":"10.18653\/v1\/2021.naacl-main.168"},{"key":"243_CR30","doi-asserted-by":"crossref","unstructured":"Zhang J, Wang L, Lee RK-W, Bin Y, Wang Y, Shao J, Lim E-P. Graph-to-tree learning for solving math word problems. In: Proceedings of the 58th annual meeting of the association for computational linguistics, 2020. 3928\u20133937.","DOI":"10.18653\/v1\/2020.acl-main.362"},{"key":"243_CR31","doi-asserted-by":"crossref","unstructured":"Huang D, Shi S, Lin C-Y, Yin J, Ma W-Y. How well do computers solve math word problems? large-scale dataset construction and evaluation. In: Proceedings of the 54th annual meeting of the association for computational linguistics (Volume 1: Long Papers), 2016. 887\u2013896.","DOI":"10.18653\/v1\/P16-1084"},{"key":"243_CR32","unstructured":"Hendrycks D, Burns C, Kadavath S, Arora A, Basart S, Tang E, Song D, Steinhardt, J. Measuring mathematical problem solving with the math dataset. arXiv preprint. 2021. arXiv:2103.03874."},{"key":"243_CR33","unstructured":"Upadhyay S, Chang M-W. Annotating derivations: a new evaluation strategy and dataset for algebra word problems. arXiv preprint. 2016. arXiv:1609.07197."},{"key":"243_CR34","doi-asserted-by":"crossref","unstructured":"Liang C-C, Wong Y-S, Lin Y-C, Su K-Y. A meaning-based statistical english math word problem solver. arXiv preprint. 2018. arXiv:1803.06064.","DOI":"10.18653\/v1\/N18-1060"},{"key":"243_CR35","doi-asserted-by":"crossref","unstructured":"Qin J, Lin L, Liang X, Zhang R, Lin L. Semantically-aligned universal tree-structured solver for math word problems. arXiv preprint. 2020. arXiv:2010.06823.","DOI":"10.18653\/v1\/2020.emnlp-main.309"},{"key":"243_CR36","unstructured":"Alghamdi R, Liang Z, Zhang X. Armath: a dataset for solving arabic math word problems. In: Proceedings of the thirteenth language resources and evaluation conference, 2022, 351\u2013362."},{"key":"243_CR37","doi-asserted-by":"crossref","unstructured":"Ki KS, Lee DG, Gweon G. Kotab: Korean template-based arithmetic solver with bert. In: 2020 IEEE International Conference on Big Data and Smart Computing (BigComp), 2020, 279\u2013282 . IEEE.","DOI":"10.1109\/BigComp48618.2020.00-61"},{"key":"243_CR38","unstructured":"Sharma H, Mishra P, Sharma DM. Hawp: a dataset for hindi arithmetic word problem solving. In: Proceedings of the thirteenth language resources and evaluation conference, 2022, 3479\u20133490."},{"key":"243_CR39","doi-asserted-by":"crossref","unstructured":"Roy S, Roth D. Solving general arithmetic word problems. arXiv preprint arXiv:1608.01413. 2016.","DOI":"10.18653\/v1\/D15-1202"},{"issue":"19","key":"243_CR40","doi-asserted-by":"publisher","first-page":"3525","DOI":"10.3390\/math10193525","volume":"10","author":"K Kim","year":"2022","unstructured":"Kim K, Chun C. Synthetic data generator for solving korean arithmetic word problem. Mathematics. 2022;10(19):3525.","journal-title":"Mathematics"},{"key":"243_CR41","unstructured":"Hossain A. BNLTK(Bangla Natural Language Processing Toolkit) is open-source python package for Bengali Natural Language Processing. https:\/\/pypi.org\/project\/bnltk\/. 2019."},{"key":"243_CR42","doi-asserted-by":"crossref","unstructured":"Pennington J, Socher R, Manning CD. Glove: Global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2014; 1532\u20131543.","DOI":"10.3115\/v1\/D14-1162"},{"issue":"8","key":"243_CR43","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput. 1997;9(8):1735\u201380.","journal-title":"Neural Comput"},{"issue":"5\u20136","key":"243_CR44","doi-asserted-by":"publisher","first-page":"602","DOI":"10.1016\/j.neunet.2005.06.042","volume":"18","author":"A Graves","year":"2005","unstructured":"Graves A, Schmidhuber J. Framewise phoneme classification with bidirectional lstm and other neural network architectures. Neural networks. 2005;18(5\u20136):602\u201310.","journal-title":"Neural Netw"},{"key":"243_CR45","doi-asserted-by":"crossref","unstructured":"Dyer C, Ballesteros M, Ling W, Matthews A, Smith NA. Transition-based dependency parsing with stack long short-term memory. arXiv preprint (2015); arXiv:1505.08075.","DOI":"10.3115\/v1\/P15-1033"},{"key":"243_CR46","unstructured":"Jozefowicz R, Zaremba W, Sutskever I. An empirical exploration of recurrent network architectures. In: International Conference on Machine Learning, 2015; 2342\u20132350 . PMLR."},{"issue":"11","key":"243_CR47","doi-asserted-by":"publisher","first-page":"2673","DOI":"10.1109\/78.650093","volume":"45","author":"M Schuster","year":"1997","unstructured":"Schuster M, Paliwal KK. Bidirectional recurrent neural networks. IEEE Trans Signal Process. 1997;45(11):2673\u201381.","journal-title":"IEEE Trans Signal Process"},{"key":"243_CR48","first-page":"64","volume":"5","author":"LR Medsker","year":"2001","unstructured":"Medsker LR, Jain L. Recurrent neural networks. Des Appl. 2001;5:64\u20137.","journal-title":"Des Appl"}],"container-title":["Discover Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44163-025-00243-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s44163-025-00243-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44163-025-00243-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,13]],"date-time":"2025-03-13T03:05:32Z","timestamp":1741835132000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s44163-025-00243-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,13]]},"references-count":50,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["243"],"URL":"https:\/\/doi.org\/10.1007\/s44163-025-00243-7","relation":{},"ISSN":["2731-0809"],"issn-type":[{"value":"2731-0809","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,13]]},"assertion":[{"value":"10 December 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 March 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 March 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors assert that there are no competing interests associated with the research presented in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"25"}}