{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,19]],"date-time":"2026-01-19T10:00:06Z","timestamp":1768816806555,"version":"3.49.0"},"reference-count":27,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2023,4,14]],"date-time":"2023-04-14T00:00:00Z","timestamp":1681430400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["62272093"],"award-info":[{"award-number":["62272093"]}]},{"name":"National Natural Science Foundation of China","award":["62137001"],"award-info":[{"award-number":["62137001"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>In order to find solutions to math word problems, some modules have been designed to check the generated expressions, but they neither take into account the symmetry between math word problems and their corresponding mathematical expressions, nor do they utilize the efficiency of pretrained language models in natural language understanding tasks. Anyway, designing fine-tuning tasks for pretrained language models that encourage cooperation with other modules to improve the performance of math word problem solvers is an unaddressed problem. To solve these problems, in this paper we propose a BERT-based model for solving math word problems with a supervision module. Based on pretrained language models, we present a fine-tuning task to predict the number of different operators in the expressions to learn the potential relationships between the problems and the expressions. Meanwhile, a supervision module is designed to check the incorrect expressions generated and improve the model\u2019s performance by optimizing the encoder. A series of experiments are conducted on three datasets, and the experimental results demonstrate the effectiveness of our model and its component\u2019s designs.<\/jats:p>","DOI":"10.3390\/sym15040916","type":"journal-article","created":{"date-parts":[[2023,4,14]],"date-time":"2023-04-14T10:29:16Z","timestamp":1681468156000},"page":"916","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["BEM-SM: A BERT-Encoder Model with Symmetry Supervision Module for Solving Math Word Problem"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-9507-9365","authenticated-orcid":false,"given":"Yijia","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, Notrheastern University, Shenyang 110819, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tiancheng","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Notrheastern University, Shenyang 110819, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peng","family":"Xie","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Notrheastern University, Shenyang 110819, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0287-8867","authenticated-orcid":false,"given":"Minghe","family":"Yu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Notrheastern University, Shenyang 110819, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3171-8889","authenticated-orcid":false,"given":"Ge","family":"Yu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Notrheastern University, Shenyang 110819, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,4,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Wang, Y., Liu, X., and Shi, S. (2017, January 7\u201311). Deep neural solver for math word problems. Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, Copenhagen, Denmark.","DOI":"10.18653\/v1\/D17-1088"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Wang, L., Wang, Y., Cai, D., Zhang, D., and Liu, X. (2018). Translating a math word problem to an expression tree. arXiv.","DOI":"10.18653\/v1\/D18-1132"},{"key":"ref_3","unstructured":"Wang, L., Zhang, D., Zhang, J., Xu, X., Gao, L., Dai, B.T., and Shen, H.T. (February, January 27). Template-based math word problem solvers with recursive neural networks. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Chiang, T.R., and Chen, Y.N. (2018). Semantically-aligned equation generation for solving and reasoning math word problems. arXiv.","DOI":"10.18653\/v1\/N19-1272"},{"key":"ref_5","unstructured":"Li, J., Wang, L., Zhang, J., Wang, Y., Dai, B.T., and Zhang, D. (August, January 28). Modeling intra-relation in math word problems with different functional multi-head attentions. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_6","unstructured":"Meng, Y., and Rumshisky, A. (2019). Solving math word problems with double-decoder transformer. arXiv."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Liu, Q., Guan, W., Li, S., and Kawahara, D. (2019, January 3\u20137). Tree-structured decoding for solving math word problems. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.","DOI":"10.18653\/v1\/D19-1241"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Xie, Z., and Sun, S. (2019, January 10\u201316). A goal-driven tree-structured neural model for math word problems. Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence (IJCAI-19), Macao, China.","DOI":"10.24963\/ijcai.2019\/736"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhang, J., Wang, L., Lee, R.K.W., Bin, Y., Wang, Y., Shao, J., and Lim, E.P. (2020, January 5\u201310). Graph-to-tree learning for solving math word problems. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.","DOI":"10.18653\/v1\/2020.acl-main.362"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhang, J., Lee, R.K.W., Lim, E.P., Qin, W., Wang, L., Shao, J., and Sun, Q. (2020, January 11\u201317). Teacher-student networks with multiple decoders for solving math word problem. Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence (IJCAI-20), Yokohama, Japan.","DOI":"10.24963\/ijcai.2020\/555"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Wu, Q., Zhang, Q., Fu, J., and Huang, X.J. (2020, January 16\u201320). A knowledge-aware sequence-to-tree network for math word problem solving. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Online.","DOI":"10.18653\/v1\/2020.emnlp-main.579"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Lin, X., Huang, Z., Zhao, H., Chen, E., Liu, Q., Wang, H., and Wang, S. (2021, January 2\u20139). Hms: A hierarchical solver with dependency-enhanced understanding for math word problem. Proceedings of the AAAI Conference on Artificial Intelligence, Online.","DOI":"10.1609\/aaai.v35i5.16547"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1007\/s10462-009-9110-0","article-title":"A review of methods for automatic understanding of natural language mathematical problems","volume":"29","author":"Mukherjee","year":"2008","journal-title":"Artif. Intell. Rev."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Liang, C.C., Hsu, K.Y., Huang, C.T., Li, C.M., Miao, S.Y., and Su, K.Y. (2016, January 9\u201315). A tag-based statistical english math word problem solver with understanding, reasoning and explanation. Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence (IJCAI-16), New York, NY, USA.","DOI":"10.24963\/ijcai.2017\/775"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2287","DOI":"10.1109\/TPAMI.2019.2914054","article-title":"The gap of semantic parsing: A survey on automatic math word problem solvers","volume":"42","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_16","first-page":"1","article-title":"Attention is all you need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_17","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Sun, Y., Wang, S., Li, Y., Feng, S., Tian, H., Wu, H., and Wang, H. (2020, January 7\u201312). Ernie 2.0: A continual pre-training framework for language understanding. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i05.6428"},{"key":"ref_19","unstructured":"Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., and Stoyanov, V. (2019). Roberta: A robustly optimized bert pretraining approach. arXiv."},{"key":"ref_20","unstructured":"Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., and Soricut, R. (2019). Albert: A lite bert for self-supervised learning of language representations. arXiv."},{"key":"ref_21","unstructured":"Clark, K.L., Le, M., Manning, Q., and ELECTRA, C. (2020). Pre-training text encoders as discriminators rather than generators. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Cui, Y., Che, W., Liu, T., Qin, B., Wang, S., and Hu, G. (2020). Revisiting pre-trained models for chinese natural language processing. arXiv.","DOI":"10.18653\/v1\/2020.findings-emnlp.58"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Liang, Z., and Zhang, X. (2021, January 19\u201327). Solving math word problems with teacher supervision. Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence (IJCAI-21), Montreal, QC, Canada.","DOI":"10.24963\/ijcai.2021\/485"},{"key":"ref_24","unstructured":"Zhao, W., Shang, M., Liu, Y., Wang, L., and Liu, J. (2020). Ape210k: A large-scale and template-rich dataset of math word problems. arXiv."},{"key":"ref_25","unstructured":"Amini, A., Gabriel, S., Lin, P., Koncel-Kedziorski, R., Choi, Y., and Hajishirzi, H. (2019). Mathqa: Towards interpretable math word problem solving with operation-based formalisms. arXiv."},{"key":"ref_26","unstructured":"Liang, Z., Zhang, J., Shao, J., and Zhang, X. (2021). Mwp-bert: A strong baseline for math word problems. arXiv."},{"key":"ref_27","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/15\/4\/916\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:16:03Z","timestamp":1760123763000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/15\/4\/916"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,14]]},"references-count":27,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,4]]}},"alternative-id":["sym15040916"],"URL":"https:\/\/doi.org\/10.3390\/sym15040916","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,14]]}}}