{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T00:29:44Z","timestamp":1777854584230,"version":"3.51.4"},"reference-count":35,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2023,7,20]],"date-time":"2023-07-20T00:00:00Z","timestamp":1689811200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/501100001843","name":"Science and Engineering Research Board","doi-asserted-by":"publisher","award":["YSS\/2015\/000988"],"award-info":[{"award-number":["YSS\/2015\/000988"]}],"id":[{"id":"10.13039\/501100001843","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Information Science"],"published-print":{"date-parts":[[2026,2]]},"abstract":"<jats:p>\n                    The article presents an approach to recognise formula entailment, which concerns finding entailment relationships between pairs of math formulae. As the current formula-similarity-detection approaches fail to account for broader relationships between pairs of math formulae, recognising formula entailment becomes paramount. To this end, a long short-term memory (LSTM) neural network using symbol-by-symbol attention for recognising formula entailment is implemented. However, owing to the unavailability of relevant training and validation corpora, the first and foremost step is to create a sufficiently large-sized symbol-level MATHENTAIL data set in an automated fashion. Depending on the extent of similarity between the corresponding symbol embeddings, the symbol pairs in the MATHENTAIL data set are assigned \u2018entailment\u2019 or \u2018neutral\u2019 labels. An improved symbol-to-vector (isymbol2vec) method generates mathematical symbols (in L\n                    <jats:sup>A<\/jats:sup>\n                    T\n                    <jats:sub>E<\/jats:sub>\n                    X) and their embeddings using the Wikipedia corpus of scientific documents and Continuous Bag of Words (CBOW) architecture. Eventually, the LSTM network, trained and validated using the MATHENTAIL data set, predicts formulae entailment for test formulae pairs with a reasonable accuracy of 62.2%.\n                  <\/jats:p>","DOI":"10.1177\/01655515231184826","type":"journal-article","created":{"date-parts":[[2023,7,20]],"date-time":"2023-07-20T06:54:40Z","timestamp":1689836080000},"page":"214-227","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["Recognising formula entailment using long short-term memory network"],"prefix":"10.1177","volume":"52","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1666-4464","authenticated-orcid":false,"given":"Amarnath","family":"Pathak","sequence":"first","affiliation":[{"name":"Kendriya Vidyalaya Khairagarh, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3834-5154","authenticated-orcid":false,"given":"Partha","family":"Pakray","sequence":"additional","affiliation":[{"name":"National Institute of Technology Silchar, India"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2023,7,20]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/11736790_9"},{"key":"e_1_3_3_3_2","unstructured":"Aizawa A Kohlhase M Ounis I. NTCIR-10 math pilot task overview. In: Proceedings of the 10th NTCIR conference Tokyo Japan 2013 pp. 654\u2013661 https:\/\/research.nii.ac.jp\/ntcir\/workshop\/OnlineProceedings10\/pdf\/NTCIR\/MATH\/04-NTCIR10-MATH-KohlhaseM_intro.pdf"},{"key":"e_1_3_3_4_2","unstructured":"L\u00ed\u0161ka M Sojka P Ru\u017eicka M. Similarity search for mathematics: Masaryk University team at the NTCIR-10 math task. In: Proceedings of the 10th NTCIR conference on evaluation of information access technologies Tokyo Japan 2013 pp. 686\u2013691 https:\/\/is.muni.cz\/publication\/1112631\/en\/Similarity-Search-for-Mathematics-Masaryk-University-team-at-the-NTCIR-10-Math-Task\/Liska-Sojka-Ruzicka"},{"key":"e_1_3_3_5_2","unstructured":"Zanibbi R Aizawa A Kohlhase M et al. NTCIR-12 MathIR task overview. In: Proceedings of the 12th NTCIR conference Tokyo Japan 2016 pp. 299\u2013308 https:\/\/www.cs.rit.edu\/~rlaz\/files\/ntcir12-mathir.pdf"},{"key":"e_1_3_3_6_2","unstructured":"Ruzicka M Sojka P L\u00edska M. Math indexer and searcher under the hood: fine-tuning query expansion and unification strategies. In: Proceedings of the 12th NTCIR conference on evaluation of information access technologies Tokyo Japan 2016 pp. 331\u2013337 https:\/\/research.nii.ac.jp\/ntcir\/workshop\/OnlineProceedings12\/pdf\/ntcir\/MathIR\/05-NTCIR12-MathIR-RuzickaM_slides.pdf"},{"key":"e_1_3_3_7_2","first-page":"23","volume-title":"Proceedings of the international workshop on multidisciplinary trends in artificial intelligence","author":"Kumar PP","unstructured":"Kumar PP, Agarwal A, Bhagvati C. A structure based approach for mathematical expression retrieval. In: Proceedings of the international workshop on multidisciplinary trends in artificial intelligence, Ho Chi Minh City, Vietnam, 26\u201328 December 2012, pp. 23\u201334. Berlin: Springer."},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/2484028.2484083"},{"key":"e_1_3_3_9_2","unstructured":"Krstovski K Blei DM. Equation embeddings https:\/\/arxiv.org\/abs\/1803.09123"},{"key":"e_1_3_3_10_2","doi-asserted-by":"crossref","unstructured":"Yasunaga M Lafferty JD. TopicEq: a joint topic and mathematical equation model for scientific texts. In: Proceedings of the AAAI conference on artificial intelligence 2019 vol. 33 pp. 7394\u20137401 https:\/\/ojs.aaai.org\/index.php\/AAAI\/article\/view\/4728","DOI":"10.1609\/aaai.v33i01.33017394"},{"key":"e_1_3_3_11_2","doi-asserted-by":"crossref","unstructured":"Mansouri B Rohatgi S Oard DW et al. Tangent-CFT: an embedding model for mathematical formulas. In: Proceedings of the 2019 ACM SIGIR international conference on theory of information retrieval 2019 pp. 11\u201318 https:\/\/www.cs.rit.edu\/~rlaz\/files\/Mansouri_ICTIR2019.pdf","DOI":"10.1145\/3341981.3344235"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-020-03502-9"},{"key":"e_1_3_3_13_2","unstructured":"Gao L Jiang Z Yin Y et al. Preliminary exploration of formula embedding for mathematical information retrieval: can mathematical formulae be embedded like a natural language?https:\/\/arxiv.org\/abs\/1707.05154"},{"key":"e_1_3_3_14_2","unstructured":"Mikolov T Chen K Corrado G et al. Efficient estimation of word representations in vector space https:\/\/arxiv.org\/abs\/1301.3781"},{"key":"e_1_3_3_15_2","unstructured":"Thanda A Agarwal A Singla K et al. A document retrieval system for math queries. In: Proceedings of the 12th NTCIR conference on evaluation of information access technologies Tokyo Japan 2016 pp. 346\u2013353 http:\/\/research.nii.ac.jp\/ntcir\/workshop\/OnlineProceedings12\/pdf\/ntcir\/MathIR\/07-NTCIR12-MathIR-ThandaA.pdf"},{"key":"e_1_3_3_16_2","unstructured":"Le Q Mikolov T. Distributed representations of sentences and documents. In: Proceedings of the international conference on machine learning Beijing China 2014 pp. 1188\u20131196 https:\/\/cs.stanford.edu\/~quocle\/paragraph_vector.pdf"},{"key":"e_1_3_3_17_2","unstructured":"Deng Y Kanervisto A Rush AM. What you get is what you see: a visual markup decompiler https:\/\/www.researchgate.net\/publication\/308262743_What_You_Get_Is_What_You_See_A_Visual_Markup_Decompiler"},{"key":"e_1_3_3_18_2","unstructured":"Evans R Saxton D Amos D et al. Can neural networks understand logical entailment? In: Proceedings of the sixth international conference on learning representations (ICLR) Vancouver BC Canada 2018 pp. 1\u201315 https:\/\/openreview.net\/pdf?id=SkZxCk-0Z"},{"key":"e_1_3_3_19_2","doi-asserted-by":"crossref","unstructured":"Khot T Sabharwal A Clark P. SciTaiL: a textual entailment dataset from science question answering. In: Proceedings of the AAAI conference on artificial intelligence 2018 pp. 1\u20139 https:\/\/ojs.aaai.org\/index.php\/AAAI\/article\/view\/12022","DOI":"10.1609\/aaai.v32i1.12022"},{"key":"e_1_3_3_20_2","doi-asserted-by":"crossref","unstructured":"Yin W Roth D Sch\u00fctze H. End-task oriented textual entailment via deep explorations of inter-sentence interactions. In: Proceedings of the 56th annual meeting of the association for computational linguistics Melbourne VIC Australia 2018 vol. 2 pp. 540\u2013545 https:\/\/aclanthology.org\/P18-2086\/","DOI":"10.18653\/v1\/P18-2086"},{"key":"e_1_3_3_21_2","unstructured":"Zaremba W Kurach K Fergus R. Learning to discover efficient mathematical identities. In: Proceedings of the advances in neural information processing systems Montreal QC Canada 2014 pp. 1278\u20131286 https:\/\/proceedings.neurips.cc\/paper\/2014\/file\/08419be897405321542838d77f855226-Paper.pdf"},{"key":"e_1_3_3_22_2","unstructured":"Allamanis M Chanthirasegaran P Kohli P et al. Learning continuous semantic representations of symbolic expressions https:\/\/arxiv.org\/abs\/1611.01423"},{"key":"e_1_3_3_23_2","doi-asserted-by":"crossref","unstructured":"Meuschke N Schubotz M Hamborg F et al. Analyzing mathematical content to detect academic plagiarism. In: Proceedings of the 2017 ACM conference on information and knowledge management Singapore 2017 pp. 2211\u20132214 https:\/\/d-nb.info\/1163536059\/34","DOI":"10.1145\/3132847.3133144"},{"key":"e_1_3_3_24_2","unstructured":"Hambasan R Kohlhase M Prodescu CC. MathWeb-search at NTCIR-11. In: Proceedings of the 11th NTCIR conference Tokyo Japan vol. 11 2014 pp. 114\u2013119 http:\/\/research.nii.ac.jp\/ntcir\/workshop\/OnlineProceedings11\/pdf\/NTCIR\/Math-2\/05-NTCIR11-MATH-HambasanR.pdf"},{"issue":"2","key":"e_1_3_3_25_2","first-page":"253","article-title":"MathIRs: retrieval system for scientific documents","volume":"21","author":"Pathak A","year":"2017","unstructured":"Pathak A, Pakray P, Sarkar S, et al. MathIRs: retrieval system for scientific documents. Comput Sist 2017; 21(2): 253\u2013265.","journal-title":"Comput Sist"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-017-9296-8"},{"key":"e_1_3_3_27_2","doi-asserted-by":"crossref","unstructured":"Schubotz M Grigorev A Leich M et al. Semantification of identifiers in mathematics for better math information retrieval. In: Proceedings of the 39th international ACM SIGIR conference on research and development in information retrieval Pisa 2016 pp. 135\u2013144 https:\/\/d-nb.info\/1163536121\/34","DOI":"10.1145\/2911451.2911503"},{"key":"e_1_3_3_28_2","doi-asserted-by":"crossref","unstructured":"Schubotz M Kr\u00e4mer L Meuschke N et al. Evaluating and improving the extraction of mathematical identifier definitions. In: Proceedings of the international conference of the cross-language evaluation forum for European languages Dublin 2017 pp. 82\u201394 https:\/\/d-nb.info\/1163534730\/34","DOI":"10.1007\/978-3-319-65813-1_7"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/RPC.2017.8168063"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/2756406.2756918"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3084158"},{"key":"e_1_3_3_32_2","doi-asserted-by":"crossref","unstructured":"Sojka P L\u00ed\u0161ka M. The art of mathematics retrieval. In: Proceedings of the 11th ACM symposium on document engineering 2011 pp. 57\u201360 https:\/\/www.researchgate.net\/publication\/221352888_The_art_of_mathematics_retrieval","DOI":"10.1145\/2034691.2034703"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/1148170.1148348"},{"key":"e_1_3_3_34_2","doi-asserted-by":"crossref","unstructured":"Zanibbi R Yuan B. Keyword and image-based retrieval for mathematical expressions https:\/\/www.cs.rit.edu\/~rlaz\/files\/ZanibbiYuanDRR2011.pdf","DOI":"10.1117\/12.873312"},{"key":"e_1_3_3_35_2","unstructured":"Rockt\u00e4schel T Grefenstette E Hermann KM et al. Reasoning about entailment with neural attention. In: Proceedings of the 4th international conference on learning representations San Juan Puerto Rico 2016 pp. 1\u20139 https:\/\/www.researchgate.net\/publication\/282181875_Reasoning_about_Entailment_with_Neural_Attention"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12864-019-6413-7"}],"container-title":["Journal of Information Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/01655515231184826","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/01655515231184826","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/01655515231184826","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T23:10:11Z","timestamp":1777504211000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/01655515231184826"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,20]]},"references-count":35,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,2]]}},"alternative-id":["10.1177\/01655515231184826"],"URL":"https:\/\/doi.org\/10.1177\/01655515231184826","relation":{},"ISSN":["0165-5515","1741-6485"],"issn-type":[{"value":"0165-5515","type":"print"},{"value":"1741-6485","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,20]]}}}