{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:31:03Z","timestamp":1760239863685,"version":"build-2065373602"},"reference-count":45,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2019,1,24]],"date-time":"2019-01-24T00:00:00Z","timestamp":1548288000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>In recent years, entity-based ranking models have led to exciting breakthroughs in the research of information retrieval. Compared with traditional retrieval models, entity-based representation enables a better understanding of queries and documents. However, the existing entity-based models neglect the importance of entities in a document. This paper attempts to explore the effects of the importance of entities in a document. Specifically, the dataset analysis is conducted which verifies the correlation between the importance of entities in a document and document ranking. Then, this paper enhances two entity-based models\u2014toy model and Explicit Semantic Ranking model (ESR)\u2014by considering the importance of entities. In contrast to the existing models, the enhanced models assign the weights of entities according to their importance. Experimental results show that the enhanced toy model and ESR can outperform the two baselines by as much as 4.57% and 2.74% on NDCG@20 respectively, and further experiments reveal that the strength of the enhanced models is more evident on long queries and the queries where ESR fails, confirming the effectiveness of taking the importance of entities into account.<\/jats:p>","DOI":"10.3390\/info10020039","type":"journal-article","created":{"date-parts":[[2019,1,24]],"date-time":"2019-01-24T11:12:48Z","timestamp":1548328368000},"page":"39","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Exploring the Importance of Entities in Semantic Ranking"],"prefix":"10.3390","volume":"10","author":[{"given":"Zhenyang","family":"Li","sequence":"first","affiliation":[{"name":"Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"Key Laboratory of Network Information System Technology (NIST), Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}]},{"given":"Guangluan","family":"Xu","sequence":"additional","affiliation":[{"name":"Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"Key Laboratory of Network Information System Technology (NIST), Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}]},{"given":"Xiao","family":"Liang","sequence":"additional","affiliation":[{"name":"Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"Key Laboratory of Network Information System Technology (NIST), Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"}]},{"given":"Feng","family":"Li","sequence":"additional","affiliation":[{"name":"Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"Key Laboratory of Network Information System Technology (NIST), Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"}]},{"given":"Lei","family":"Wang","sequence":"additional","affiliation":[{"name":"Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"Key Laboratory of Network Information System Technology (NIST), Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"}]},{"given":"Daobing","family":"Zhang","sequence":"additional","affiliation":[{"name":"Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"Key Laboratory of Network Information System Technology (NIST), Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,1,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Guo, J., Fan, Y., Ai, Q., and Croft, W.B. (2016). Semantic Matching by Non-Linear Word Transportation for Information Retrieval. Proceedings of the 25th ACM International on Conference on Information and Knowledge Management, ACM.","DOI":"10.1145\/2983323.2983768"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Huang, P.S., He, X., Gao, J., Deng, L., Acero, A., and Heck, L. (2013). Learning Deep Structured Semantic Models for Web Search Using Clickthrough Data. Proceedings of the 22Nd ACM International Conference on Information & Knowledge Management, ACM.","DOI":"10.1145\/2505515.2505665"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Guo, J., Fan, Y., Ai, Q., and Croft, W.B. (2016). A Deep Relevance Matching Model for Ad-hoc Retrieval. Proceedings of the 25th ACM International on Conference on Information and Knowledge Management, ACM.","DOI":"10.1145\/2983323.2983769"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Manning, C.D., Raghavan, P., and Sch\u00fctze, H. (2008). Introduction to Information Retrieval, Cambridge University Press.","DOI":"10.1017\/CBO9780511809071"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1561\/1500000019","article-title":"The Probabilistic Relevance Framework: BM25 and Beyond","volume":"3","author":"Robertson","year":"2009","journal-title":"Found. Trends Inf. Retr."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Xiong, C., Power, R., and Callan, J. (2017). Explicit Semantic Ranking for Academic Search via Knowledge Graph Embedding. Proceedings of the 26th International Conference on World Wide Web, International World Wide Web Conferences Steering Committee.","DOI":"10.1145\/3038912.3052558"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Xiong, C., Callan, J., and Liu, T.Y. (2016). Bag-of-Entities Representation for Ranking. Proceedings of the 2016 ACM International Conference on the Theory of Information Retrieval, ACM.","DOI":"10.1145\/2970398.2970423"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Liu, Z., Xiong, C., Sun, M., and Liu, Z. (2018). Entity-Duet Neural Ranking: Understanding the Role of Knowledge Graph Semantics in Neural Information Retrieval. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Association for Computational Linguistics.","DOI":"10.18653\/v1\/P18-1223"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ferragina, P., and Scaiella, U. (2010). TAGME: On-the-fly Annotation of Short Text Fragments (by Wikipedia Entities). Proceedings of the 19th ACM International Conference on Information and Knowledge Management, ACM.","DOI":"10.1145\/1871437.1871689"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Hasibi, F., Balog, K., and Bratsberg, S.E. (2015). Entity Linking in Queries: Tasks and Evaluation. Proceedings of the 2015 International Conference on The Theory of Information Retrieval, ACM.","DOI":"10.1145\/2808194.2809473"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Yin, D., Hu, Y., Tang, J., Daly, T., Zhou, M., Ouyang, H., Chen, J., Kang, C., Deng, H., and Nobata, C. (2016). Ranking Relevance in Yahoo Search. Proceedings of the 22Nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM.","DOI":"10.1145\/2939672.2939677"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1007\/s10791-015-9267-x","article-title":"Latent entity space: A novel retrieval approach for entity-bearing queries","volume":"18","author":"Liu","year":"2015","journal-title":"Inf. Retr. J."},{"key":"ref_13","unstructured":"Burges, C.J.C., Bottou, L., Welling, M., Ghahramani, Z., and Weinberger, K.Q. (2013). Distributed Representations of Words and Phrases and their Compositionality. Advances in Neural Information Processing Systems 26, Curran Associates, Inc."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1561\/1500000035","article-title":"Semantic Matching in Search","volume":"7","author":"Li","year":"2014","journal-title":"Found. Trends Inf. Retr."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Shen, Y., He, X., Gao, J., Deng, L., and Mesnil, G. (2014). Learning Semantic Representations Using Convolutional Neural Networks for Web Search. Proceedings of the 23rd International Conference on World Wide Web, ACM.","DOI":"10.1145\/2567948.2577348"},{"key":"ref_16","unstructured":"Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N.D., and Weinberger, K.Q. (2014). Convolutional Neural Network Architectures for Matching Natural Language Sentences. Advances in Neural Information Processing Systems 27, Curran Associates, Inc."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Pang, L., Lan, Y., Guo, J., Xu, J., Wan, S., and Cheng, X. (2016, January 12\u201317). Text Matching as Image Recognition. Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA.","DOI":"10.1609\/aaai.v30i1.10341"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Buckley, C., Salton, G., Allan, J., and Singhal, A. (1994, January 2\u20134). Automatic Query Expansion Using SMART: TREC 3. Proceedings of The Third Text REtrieval Conference, TREC 1994, Gaithersburg, MD, USA.","DOI":"10.6028\/NIST.SP.500-225.cornell"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Cao, G., Nie, J.Y., Gao, J., and Robertson, S. (2008). Selecting Good Expansion Terms for Pseudo-relevance Feedback. Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM.","DOI":"10.1145\/1390334.1390377"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Metzler, D., and Croft, W.B. (2007). Latent Concept Expansion Using Markov Random Fields. Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM.","DOI":"10.1145\/1277741.1277796"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1145\/245108.245124","article-title":"Fab: Content-based, Collaborative Recommendation","volume":"40","author":"Shoham","year":"1997","journal-title":"Commun. ACM"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/j.knosys.2013.03.012","article-title":"Recommender systems survey","volume":"46","author":"Bobadilla","year":"2013","journal-title":"Knowl.-Based Syst."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Pouli, V., Kafetzoglou, S., Tsiropoulou, E.E., Dimitriou, A., and Papavassiliou, S. (2015, January 13\u201315). Personalized multimedia content retrieval through relevance feedback techniques for enhanced user experience. Proceedings of the 2015 13th International Conference on Telecommunications (ConTEL), Graz, Austria.","DOI":"10.1109\/ConTEL.2015.7231205"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1007\/s11042-016-4209-1","article-title":"A holistic approach for personalization, relevance feedback & recommendation in enriched multimedia content","volume":"77","author":"Stai","year":"2018","journal-title":"Multimedia Tools Appl."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Aberer, K., Choi, K.S., Noy, N., Allemang, D., Lee, K.I., Nixon, L., Golbeck, J., Mika, P., Maynard, D., and Mizoguchi, R. (2007). DBpedia: A Nucleus for a Web of Open Data. The Semantic Web, Springer.","DOI":"10.1007\/978-3-540-76298-0"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Bollacker, K., Evans, C., Paritosh, P., Sturge, T., and Taylor, J. (2008). Freebase: A Collaboratively Created Graph Database for Structuring Human Knowledge. Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, ACM.","DOI":"10.1145\/1376616.1376746"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., and Dyer, C. (2016, January 12\u201317). Neural Architectures for Named Entity Recognition. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, CA, USA.","DOI":"10.18653\/v1\/N16-1030"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1109\/TKDE.2014.2327028","article-title":"Entity Linking with a Knowledge Base: Issues, Techniques, and Solutions","volume":"27","author":"Shen","year":"2015","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wang, Z., Zhang, J., Feng, J., and Chen, Z. (2014, January 27\u201331). Knowledge Graph Embedding by Translating on Hyperplanes. Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence, Qu\u00e9bec City, QC, Canada.","DOI":"10.1609\/aaai.v28i1.8870"},{"key":"ref_30","unstructured":"Croft, W.B., Metzler, D., and Strohman, T. (2009). Search Engines\u2014Information Retrieval in Practice, Pearson Education."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Raviv, H., Kurland, O., and Carmel, D. (2016). Document Retrieval Using Entity-Based Language Models. Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM.","DOI":"10.1145\/2911451.2911508"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Dietz, L., Kotov, A., and Meij, E. (2016). Utilizing Knowledge Bases in Text-centric Information Retrieval. Proceedings of the 2016 ACM International Conference on the Theory of Information Retrieval, ACM.","DOI":"10.1145\/2970398.2970441"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Xiong, C., Liu, Z., Callan, J., and Hovy, E. (2017). JointSem: Combining Query Entity Linking and Entity Based Document Ranking. Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, ACM.","DOI":"10.1145\/3132847.3133048"},{"key":"ref_34","unstructured":"Burges, C.J.C., Bottou, L., Welling, M., Ghahramani, Z., and Weinberger, K.Q. (2013). Translating Embeddings for Modeling Multi-relational Data. Advances in Neural Information Processing Systems 26, Curran Associates, Inc."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Lin, Y., Liu, Z., Sun, M., Liu, Y., and Zhu, X. (2015, January 25\u201330). Learning Entity and Relation Embeddings for Knowledge Graph Completion. Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, Austin, TX, USA.","DOI":"10.1609\/aaai.v29i1.9491"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Xiong, C., Dai, Z., Callan, J., Liu, Z., and Power, R. (2017). End-to-End Neural Ad-hoc Ranking with Kernel Pooling. Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM.","DOI":"10.1145\/3077136.3080809"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Fuhr, N., Kamps, J., Lalmas, M., and Trotman, A. (2008). Overview of the INEX 2007 Entity Ranking Track, Springer. Focused Access to XML Documents.","DOI":"10.1007\/978-3-540-85902-4"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1016\/j.neucom.2015.04.004","article-title":"Learning to rank related entities in Web search","volume":"166","author":"Kang","year":"2015","journal-title":"Neurocomputing"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1007\/s11704-017-6471-4","article-title":"NERank+: A graph-based approach for entity ranking in document collections","volume":"12","author":"Wang","year":"2018","journal-title":"Front. Comput. Sci."},{"key":"ref_40","unstructured":"Mihalcea, R., and Tarau, P. (2004). TextRank: Bringing Order into Texts. Emnlp, Association for Computational Linguistics."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Ammar, W., Groeneveld, D., Bhagavatula, C., Beltagy, I., Crawford, M., Downey, D., Dunkelberger, J., Elgohary, A., Feldman, S., and Ha, V. (2018). Construction of the Literature Graph in Semantic Scholar. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 3 (Industry Papers), Association for Computational Linguistics.","DOI":"10.18653\/v1\/N18-3011"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Xiong, C., Callan, J., and Liu, T.Y. (2017). Word-Entity Duet Representations for Document Ranking. Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM.","DOI":"10.1145\/3077136.3080768"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1561\/1500000016","article-title":"Learning to Rank for Information Retrieval","volume":"3","author":"Liu","year":"2009","journal-title":"Found. Trends Inf. Retr."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1109\/MS.2011.122","article-title":"Fast and Accurate Annotation of Short Texts with Wikipedia Pages","volume":"29","author":"Ferragina","year":"2012","journal-title":"IEEE Softw."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Joachims, T. (2002). Optimizing Search Engines Using Clickthrough Data. Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM.","DOI":"10.1145\/775047.775067"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/10\/2\/39\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:28:30Z","timestamp":1760185710000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/10\/2\/39"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,24]]},"references-count":45,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2019,2]]}},"alternative-id":["info10020039"],"URL":"https:\/\/doi.org\/10.3390\/info10020039","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2019,1,24]]}}}