{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T11:00:16Z","timestamp":1762254016930,"version":"3.37.3"},"reference-count":29,"publisher":"Wiley","license":[{"start":{"date-parts":[[2022,1,4]],"date-time":"2022-01-04T00:00:00Z","timestamp":1641254400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003787","name":"Natural Science Foundation of Hebei Province","doi-asserted-by":"publisher","award":["F2019201329","QN2018214"],"award-info":[{"award-number":["F2019201329","QN2018214"]}],"id":[{"id":"10.13039\/501100003787","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003482","name":"Department of Education of Hebei Province","doi-asserted-by":"publisher","award":["F2019201329","QN2018214"],"award-info":[{"award-number":["F2019201329","QN2018214"]}],"id":[{"id":"10.13039\/501100003482","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Scientific Programming"],"published-print":{"date-parts":[[2022,1,4]]},"abstract":"<jats:p>Aiming at the defects of traditional full-text retrieval models in dealing with mathematical expressions, which are special objects different from ordinary texts, a multimodal retrieval and ranking method for scientific documents based on hesitant fuzzy sets (HFS) and XLNet is proposed. This method integrates multimodal information, such as mathematical expression images and context text, as keywords to realize the retrieval of scientific documents. In the image modal, the images of mathematical expressions are recognized, and the hesitancy fuzzy set theory is introduced to calculate the hesitancy fuzzy similarity between mathematical query expressions and the mathematical expressions in candidate scientific documents. Meanwhile, in the text mode, XLNet is used to generate word vectors of the mathematical expression context to obtain the similarity between the query text and the mathematical expression context of the candidate scientific documents. Finally, the multimodal evaluation is integrated, and the hesitation fuzzy set is constructed at the document level to obtain the final scores of the scientific documents and corresponding ranked output. The experimental results show that the recall and precision of this method are 0.774 and 0.663 on the NTCIR dataset, respectively, and the average normalized discounted cumulative gain (NDCG) value of the top-10 ranking results is 0.880 on the Chinese scientific document (CSD) dataset.<\/jats:p>","DOI":"10.1155\/2022\/5373531","type":"journal-article","created":{"date-parts":[[2022,1,4]],"date-time":"2022-01-04T17:35:16Z","timestamp":1641317716000},"page":"1-11","source":"Crossref","is-referenced-by-count":1,"title":["A Multimodal Retrieval and Ranking Method for Scientific Documents Based on HFS and XLNet"],"prefix":"10.1155","volume":"2022","author":[{"given":"Meichao","family":"Yan","sequence":"first","affiliation":[{"name":"School of Cyber Security and Computer, Hebei University, Baoding 071002, China"},{"name":"Institute of Intelligent Image and Document Information Processing, Hebei University, Baoding 071002, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yu","family":"Wen","sequence":"additional","affiliation":[{"name":"School of Cyber Security and Computer, Hebei University, Baoding 071002, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qingxuan","family":"Shi","sequence":"additional","affiliation":[{"name":"School of Cyber Security and Computer, Hebei University, Baoding 071002, China"},{"name":"Institute of Intelligent Image and Document Information Processing, Hebei University, Baoding 071002, China"},{"name":"Hebei Machine Vision Engineering Research Center, Hebei University, Baoding 071002, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2746-2278","authenticated-orcid":true,"given":"Xuedong","family":"Tian","sequence":"additional","affiliation":[{"name":"School of Cyber Security and Computer, Hebei University, Baoding 071002, China"},{"name":"Institute of Intelligent Image and Document Information Processing, Hebei University, Baoding 071002, China"},{"name":"Hebei Machine Vision Engineering Research Center, Hebei University, Baoding 071002, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","reference":[{"key":"1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-62075-6_24"},{"key":"2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-55789-8_14"},{"key":"3","doi-asserted-by":"publisher","DOI":"10.1007\/11832225_33"},{"key":"4","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3269233"},{"key":"5","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-45439-5_47"},{"key":"6","doi-asserted-by":"publisher","DOI":"10.1109\/CSE.2011.52"},{"key":"7","doi-asserted-by":"publisher","DOI":"10.1145\/2756406.2756918"},{"key":"8","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-08434-3_29"},{"key":"9","doi-asserted-by":"publisher","DOI":"10.1145\/2810355.2810359"},{"key":"10","doi-asserted-by":"publisher","DOI":"10.11925\/infotech.2096-3467.2019.0943"},{"key":"11","doi-asserted-by":"publisher","DOI":"10.1109\/ICCSNT.2013.6967179"},{"key":"12","doi-asserted-by":"publisher","DOI":"10.1109\/icmlc.2014.7009727"},{"key":"13","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-017-9296-8"},{"key":"14","doi-asserted-by":"publisher","DOI":"10.1109\/wacv45572.2020.9093612"},{"first-page":"2121","article-title":"Devise: a deep visual-semantic embedding model","author":"A. Frome","key":"15"},{"key":"16","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2020.2997020"},{"key":"17","doi-asserted-by":"publisher","DOI":"10.1145\/3178119"},{"key":"18","doi-asserted-by":"publisher","DOI":"10.1145\/3477180"},{"key":"19","doi-asserted-by":"publisher","DOI":"10.1145\/958220.958239"},{"first-page":"980","article-title":"Image-to-markup generation with coarse-to-fine attention","author":"Y. T. Deng","key":"20"},{"key":"21","doi-asserted-by":"publisher","DOI":"10.1002\/int.20418"},{"key":"22","doi-asserted-by":"publisher","DOI":"10.1016\/s0019-9958(65)90241-x"},{"first-page":"5754","article-title":"Xlnet: generalized autoregressive pretraining for language understanding","author":"Z. L. Yang","key":"23"},{"article-title":"An image is worth 16x16 words: transformers for image recognition at scale","year":"2020","author":"A. Dosovitskiy","key":"24"},{"key":"25","doi-asserted-by":"publisher","DOI":"10.1109\/cvpr.2016.90"},{"first-page":"5998","article-title":"Attention is all you need","author":"A. Vaswani","key":"26"},{"issue":"3","key":"27","first-page":"204","article-title":"A relevance ranking algorithm of mathematical expression retrieval results","volume":"43","author":"X. D. Tian","year":"2017","journal-title":"Computer Engineering"},{"key":"28","doi-asserted-by":"publisher","DOI":"10.1109\/CIS.2014.174"},{"first-page":"289","article-title":"A distributed system for SearchOnMath based on the Microsoft BizSpark program","author":"R. M. Oliveira","key":"29"}],"container-title":["Scientific Programming"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/sp\/2022\/5373531.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/sp\/2022\/5373531.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/sp\/2022\/5373531.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,1,4]],"date-time":"2022-01-04T17:35:21Z","timestamp":1641317721000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.hindawi.com\/journals\/sp\/2022\/5373531\/"}},"subtitle":[],"editor":[{"given":"Liang","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2022,1,4]]},"references-count":29,"alternative-id":["5373531","5373531"],"URL":"https:\/\/doi.org\/10.1155\/2022\/5373531","relation":{},"ISSN":["1875-919X","1058-9244"],"issn-type":[{"type":"electronic","value":"1875-919X"},{"type":"print","value":"1058-9244"}],"subject":[],"published":{"date-parts":[[2022,1,4]]}}}