{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,8]],"date-time":"2026-02-08T09:09:06Z","timestamp":1770541746298,"version":"3.49.0"},"reference-count":48,"publisher":"Association for Computing Machinery (ACM)","issue":"4","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2024,12]]},"abstract":"<jats:p>\n            Ranking indicators are essential tools for comparing the importance of various entities such as cities or scientists. While extensively used in fields like econometrics and scientometrics, many other domains lack systematic approaches for developing these indicators. In this paper, we introduce a novel method for automatically discovering ranking indicators from very large knowledge graphs. To this end, we formalize the notion of\n            <jats:italic>counting graph pattern<\/jats:italic>\n            (CG) as a special SPARQL query, and the concept of\n            <jats:italic>ideal ranking indicator<\/jats:italic>\n            as a CG whose result induces a strict total order on a set of entities. To assess the interestingness of ranking indicators, we employ the\n            <jats:italic>proportion of covered entities<\/jats:italic>\n            along with an inequality measure, namely the Gini coefficient. We further present Algorithm\n            <jats:italic>Ranking Indicator Pattern Miner (RIPM)<\/jats:italic>\n            , to efficiently identify interesting ranking indicators for a given field, thanks to pruning techniques for handling the very large search space. Our experimental study shows the effectiveness of our optimizations. It also validates that RIPM extracts\n            <jats:italic>transparent, diverse, and understandable<\/jats:italic>\n            indicators through a user survey and a comparison with two baselines. This work has significant implications for fields lacking dedicated communities working on ranking tasks, providing a robust tool to automatically produce ranking indicators, and the associated rankings.\n          <\/jats:p>","DOI":"10.14778\/3717755.3717775","type":"journal-article","created":{"date-parts":[[2025,5,20]],"date-time":"2025-05-20T15:51:49Z","timestamp":1747756309000},"page":"1183-1195","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Ranking Indicator Discovery from Very Large Knowledge Graphs"],"prefix":"10.14778","volume":"18","author":[{"given":"Hassan","family":"Abdallah","sequence":"first","affiliation":[{"name":"LIFAT, University of Tours Blois, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"B\u00e9atrice","family":"Markhoff","sequence":"additional","affiliation":[{"name":"CITERES, University of Tours Blois, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Arnaud","family":"Soulet","sequence":"additional","affiliation":[{"name":"LIFAT, University of Tours Blois, France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,5,20]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-011-0389-7"},{"key":"e_1_2_1_2_1","unstructured":"Hassan Abdallah B\u00e9atrice Markhoff and Arnaud Soulet. 2024. A Complex Network Model for Knowledge Graphs' Relationships. Preprint. (2024)."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/0022-0531(70)90039-6"},{"key":"e_1_2_1_4_1","volume-title":"DBpedia: A nucleus for a web of open data. In international semantic web conference","author":"Auer S\u00f6ren","unstructured":"S\u00f6ren Auer, Christian Bizer, Georgi Kobilarov, Jens Lehmann, Richard Cyganiak, and Zachary Ives. 2007. DBpedia: A nucleus for a web of open data. In international semantic web conference. Springer, 722\u2013735."},{"key":"e_1_2_1_5_1","volume-title":"Why measure performance? Different purposes require different measures. Public administration review 63, 5","author":"Behn Robert D","year":"2003","unstructured":"Robert D Behn. 2003. Why measure performance? Different purposes require different measures. Public administration review 63, 5 (2003), 586\u2013606."},{"key":"e_1_2_1_6_1","volume-title":"The semantic web. Scientific american 284, 5","author":"Berners-Lee Tim","year":"2001","unstructured":"Tim Berners-Lee, James Hendler, and Ora Lassila. 2001. The semantic web. Scientific american 284, 5 (2001), 34\u201343."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.joi.2014.09.005"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.14778\/3598581.3598606"},{"key":"e_1_2_1_9_1","volume-title":"Measuring inequality","author":"Cowell Frank Alan","unstructured":"Frank Alan Cowell. 2011. Measuring inequality. Oxford University Press."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2011.04.004"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-13489-0_16"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3342220.3343660"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1031171.1031289"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-33220-4_23"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.14778\/3436905.3436922"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1515\/libr.1998.48.2.67"},{"key":"e_1_2_1_18_1","first-page":"73","article-title":"On the measure of concentration with special reference to income and statistics","volume":"208","author":"Gini Corrado","year":"1936","unstructured":"Corrado Gini. 1936. On the measure of concentration with special reference to income and statistics. Colorado College Publication, General Series 208 (1936), 73\u201379.","journal-title":"Colorado College Publication, General Series"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0507655102"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447772"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/324133.324140"},{"key":"e_1_2_1_22_1","volume-title":"USA","author":"Kostylev Egor V","year":"2015","unstructured":"Egor V Kostylev, Juan L Reutter, Miguel Romero, and Domagoj Vrgo\u010d. 2015. SPARQL with property paths. In The Semantic Web-ISWC 2015: 14th International Semantic Web Conference, Bethlehem, PA, USA, October 11-15, 2015, Proceedings, Part I 14. Springer, 3\u201318."},{"key":"e_1_2_1_23_1","volume-title":"The measurement of observer agreement for categorical data. biometrics","author":"Richard Landis J","year":"1977","unstructured":"J Richard Landis and Gary G Koch. 1977. The measurement of observer agreement for categorical data. biometrics (1977), 159\u2013174."},{"key":"e_1_2_1_24_1","volume-title":"Empirical bernstein bounds and sample variance penalization. arXiv preprint arXiv:0907.3740","author":"Maurer Andreas","year":"2009","unstructured":"Andreas Maurer and Massimiliano Pontil. 2009. Empirical bernstein bounds and sample variance penalization. arXiv preprint arXiv:0907.3740 (2009)."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-023-00800-5"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313652"},{"key":"e_1_2_1_27_1","volume-title":"The tyranny of metrics","author":"Muller Jerry Z","unstructured":"Jerry Z Muller. 2018. The tyranny of metrics. Princeton University Press."},{"key":"e_1_2_1_28_1","volume-title":"Pareto distributions and Zipf's law. Contemporary physics 46, 5","author":"Newman Mark EJ","year":"2005","unstructured":"Mark EJ Newman. 2005. Power laws, Pareto distributions and Zipf's law. Contemporary physics 46, 5 (2005), 323\u2013351."},{"key":"e_1_2_1_29_1","unstructured":"OpenAI. 2024. ChatGPT4 (Aug 8 version). https:\/\/chat.openai.com Large language model."},{"key":"e_1_2_1_31_1","volume-title":"Total-order ranking methods. Data handling in Science and Technology 27","author":"Pavan M","year":"2008","unstructured":"M Pavan and R Todeschini. 2008. Total-order ranking methods. Data handling in Science and Technology 27 (2008), 51\u201372."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-49461-2_34"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1567274.1567278"},{"key":"e_1_2_1_34_1","volume-title":"Fairness in rankings and recommendations: an overview. The VLDB Journal","author":"Pitoura Evaggelia","year":"2022","unstructured":"Evaggelia Pitoura, Kostas Stefanidis, and Georgia Koutrika. 2022. Fairness in rankings and recommendations: an overview. The VLDB Journal (2022), 1\u201328."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630280508"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3639563"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02018108"},{"key":"e_1_2_1_38_1","volume-title":"The class of additively decomposable inequality measures. Econometrica: Journal of the Econometric Society","author":"Shorrocks Anthony F","year":"1980","unstructured":"Anthony F Shorrocks. 1980. The class of additively decomposable inequality measures. Econometrica: Journal of the Econometric Society (1980), 613\u2013625."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-00671-6_22"},{"key":"e_1_2_1_40_1","volume-title":"FOAF Within UK Academic Web Space: A Webometric Analysis of the Semantic Web","author":"Stuart David","year":"2012","unstructured":"David Stuart. 2012. FOAF Within UK Academic Web Space: A Webometric Analysis of the Semantic Web'. Social Information Research (Library and Information Science, Volume 5). Emerald Group Publishing Limited (2012), 173\u2013191."},{"key":"e_1_2_1_41_1","volume-title":"Web metrics for library and information professionals","author":"Stuart David","unstructured":"David Stuart. 2014. Web metrics for library and information professionals. Facet Publishing."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242667"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1177\/0165551507087238"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0064841"},{"key":"e_1_2_1_45_1","volume-title":"Annual review of information science and technology 39, 1","author":"Thelwall Mike","year":"2005","unstructured":"Mike Thelwall, Liwen Vaughan, and Lennart Bj\u00f6rneborn. 2005. Webometrics. Annual review of information science and technology 39, 1 (2005), 81\u2013135."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-3157-6_2"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2629489"},{"key":"e_1_2_1_48_1","volume-title":"Proceedings, Part I 18","author":"Wang Xiaxia","year":"2019","unstructured":"Xiaxia Wang, Jinchi Chen, Shuxin Li, Gong Cheng, Jeff Z Pan, Evgeny Kharlamov, and Yuzhong Qu. 2019. A framework for evaluating snippet generation for dataset search. In The Semantic Web-ISWC 2019: 18th International Semantic Web Conference, Auckland, New Zealand, October 26\u201330, 2019, Proceedings, Part I 18. Springer, 680\u2013697."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.14778\/3476311.3476393"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1026512029530"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3717755.3717775","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,20]],"date-time":"2025-05-20T16:17:20Z","timestamp":1747757840000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3717755.3717775"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12]]},"references-count":48,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,12]]}},"alternative-id":["10.14778\/3717755.3717775"],"URL":"https:\/\/doi.org\/10.14778\/3717755.3717775","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2024,12]]},"assertion":[{"value":"2025-05-20","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}