{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T02:09:09Z","timestamp":1740103749202,"version":"3.37.3"},"reference-count":49,"publisher":"Wiley","license":[{"start":{"date-parts":[[2020,12,7]],"date-time":"2020-12-07T00:00:00Z","timestamp":1607299200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key R&D Program of China","award":["2019YFB1704700","61573257","71690234","61873191","61973237","19JG0500700","20JG0500200"],"award-info":[{"award-number":["2019YFB1704700","61573257","71690234","61873191","61973237","19JG0500700","20JG0500200"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["2019YFB1704700","61573257","71690234","61873191","61973237","19JG0500700","20JG0500200"],"award-info":[{"award-number":["2019YFB1704700","61573257","71690234","61873191","61973237","19JG0500700","20JG0500200"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003399","name":"Science and Technology Commission of Shanghai Municipality","doi-asserted-by":"publisher","award":["2019YFB1704700","61573257","71690234","61873191","61973237","19JG0500700","20JG0500200"],"award-info":[{"award-number":["2019YFB1704700","61573257","71690234","61873191","61973237","19JG0500700","20JG0500200"]}],"id":[{"id":"10.13039\/501100003399","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Complexity"],"published-print":{"date-parts":[[2020,12,7]]},"abstract":"<jats:p>With the emergence of numerous link prediction methods, how to accurately evaluate them and select the appropriate one has become a key problem that cannot be ignored. Since AUC was first used for link prediction evaluation in 2008, it is arguably the most preferred metric because it well balances the role of wins (the testing link has a higher score than the unobserved link) and the role of draws (they have the same score). However, in many cases, AUC does not show enough discrimination when evaluating link prediction methods, especially those based on local similarity. Hence, we propose a new metric, called W-index, which considers only the effect of wins rather than draws. Our extensive experiments on various networks show that the W-index makes the accuracy scores of link prediction methods more distinguishable, and it can not only widen the local gap of these methods but also enlarge their global distance. We further show the reliability of the W-index by ranking change analysis and correlation analysis. In particular, some community-based approaches, which have been deemed effective, do not show any advantages after our reevaluation. Our results suggest that the W-index is a promising metric for link prediction evaluation, capable of offering convincing discrimination.<\/jats:p>","DOI":"10.1155\/2020\/7307058","type":"journal-article","created":{"date-parts":[[2020,12,9]],"date-time":"2020-12-09T03:29:50Z","timestamp":1607484590000},"page":"1-17","source":"Crossref","is-referenced-by-count":0,"title":["W-Index: An Index for Evaluating Link Prediction considering Only the Role of Wins"],"prefix":"10.1155","volume":"2020","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5048-0792","authenticated-orcid":true,"given":"Yun","family":"Yuan","sequence":"first","affiliation":[{"name":"School of Electronic and Information Engineering, Tongji University, Shanghai 201804, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6454-8102","authenticated-orcid":true,"given":"Jingwei","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Electronic and Information Engineering, Tongji University, Shanghai 201804, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9947-7746","authenticated-orcid":true,"given":"Yunlong","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Electronic and Information Engineering, Tongji University, Shanghai 201804, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8902-5460","authenticated-orcid":true,"given":"Min","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Electronic and Information Engineering, Tongji University, Shanghai 201804, China"}]}],"member":"311","reference":[{"key":"1","doi-asserted-by":"publisher","DOI":"10.1145\/3012704"},{"first-page":"87","article-title":"Negative link prediction in social media","author":"J. Tang","key":"2"},{"key":"3","doi-asserted-by":"publisher","DOI":"10.1155\/2019\/4906903"},{"key":"4","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2783381"},{"key":"5","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/2753638"},{"key":"6","doi-asserted-by":"publisher","DOI":"10.1109\/tcsii.2019.2903558"},{"key":"7","doi-asserted-by":"publisher","DOI":"10.1016\/j.physa.2019.122343"},{"key":"8","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/bts670"},{"key":"9","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-017-00680-8"},{"key":"10","article-title":"A novel method for forecasting Construction Cost Index based on complex network","volume":"527","author":"S. Mao","year":"2019","journal-title":"Physica A: Statistical Mechanics and its Applications"},{"key":"11","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/9104387"},{"key":"12","doi-asserted-by":"publisher","DOI":"10.1016\/j.physa.2019.02.028"},{"key":"13","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/7312603"},{"key":"14","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/3579758"},{"key":"15","doi-asserted-by":"publisher","DOI":"10.1155\/2017\/8581365"},{"key":"16","doi-asserted-by":"publisher","DOI":"10.1103\/physreve.101.022310"},{"key":"17","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-017-9590-2"},{"key":"18","doi-asserted-by":"publisher","DOI":"10.1109\/bdcloud-socialcom-sustaincom.2016.63"},{"key":"19","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-014-0789-0"},{"first-page":"376","article-title":"Link prediction: fair and effective evaluation","author":"R. Lichtenwalter","key":"20"},{"key":"21","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1145\/963770.963772","article-title":"Evaluating collaborative filtering recommender systems","volume":"22","author":"J. Herlocker","year":"2004","journal-title":"ACM Transactions on Information Systems"},{"key":"22","doi-asserted-by":"publisher","DOI":"10.1038\/nature06830"},{"first-page":"233","article-title":"The relationship between precision-recall and ROC curves","author":"J. Davis","key":"23"},{"first-page":"322","article-title":"Local probabilistic models for link prediction","author":"C. Wang","key":"24"},{"key":"25","doi-asserted-by":"publisher","DOI":"10.1145\/1835804.1835837"},{"first-page":"281","article-title":"Multi-relational link prediction in heterogeneous information networks","author":"D. Davis","key":"26"},{"key":"27","doi-asserted-by":"publisher","DOI":"10.1148\/radiology.143.1.7063747"},{"issue":"3","key":"28","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1109\/TKDE.2005.50","article-title":"Using AUC and accuracy in evaluating learning algorithms","volume":"17","author":"H. Jin","year":"2005","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"29","doi-asserted-by":"crossref","first-page":"478","DOI":"10.1007\/978-3-540-74958-5_44","article-title":"An improved model selection heuristic for AUC","volume-title":"Machine Learning: ECML 2007","author":"S. Wu","year":"2007"},{"first-page":"33","article-title":"Modifying ROC curves to incorporate predicted probabilities","author":"C. Ferri","key":"30"},{"key":"31","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1007\/978-3-540-74976-9_8","article-title":"Efficient AUC optimization for classification","volume-title":"Knowledge Discovery in Databases: PKDD 2007","author":"T. Calders","year":"2007"},{"issue":"6","key":"32","doi-asserted-by":"crossref","first-page":"1150","DOI":"10.1016\/j.physa.2010.11.027","article-title":"Link prediction in complex networks: a survey","volume":"390","author":"L. Y. Lu","year":"2011","journal-title":"Physica A"},{"key":"33","doi-asserted-by":"publisher","DOI":"10.1103\/physreve.80.046122"},{"key":"34","doi-asserted-by":"publisher","DOI":"10.1103\/physreve.72.027104"},{"key":"35","doi-asserted-by":"publisher","DOI":"10.1101\/054064"},{"key":"36","doi-asserted-by":"publisher","DOI":"10.1038\/453047a"},{"key":"37","doi-asserted-by":"publisher","DOI":"10.1103\/physreve.73.026120"},{"key":"38","doi-asserted-by":"publisher","DOI":"10.1140\/epjb\/e2009-00335-8"},{"key":"39","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1007\/978-3-642-34459-6_10","article-title":"Link prediction in complex networks based on community information","volume-title":"Advances in Artificial Intelligence-SBIA 2012","author":"J. C. Valverde-Rebaza","year":"2012"},{"first-page":"158","article-title":"A vertex similarity index using community information to improve link prediction accuracy","author":"J. Wang","key":"40"},{"key":"41","doi-asserted-by":"publisher","DOI":"10.1209\/0295-5075\/89\/58007"},{"key":"42","doi-asserted-by":"publisher","DOI":"10.1142\/s0219525903001067"},{"key":"43"},{"article-title":"The political blogosphere and the 2004 U.S. Election: divided they blog","author":"L. A. Adamic","key":"44","doi-asserted-by":"crossref","DOI":"10.1145\/1134271.1134277"},{"key":"45","doi-asserted-by":"publisher","DOI":"10.1145\/3341161.3342890"},{"article-title":"The network data repository with interactive graph analytics and visualization","author":"R. A. Rossi","key":"46","doi-asserted-by":"crossref","DOI":"10.1609\/aaai.v29i1.9277"},{"key":"47","doi-asserted-by":"publisher","DOI":"10.1088\/1742-5468\/2008\/10\/p1000"},{"key":"48","doi-asserted-by":"publisher","DOI":"10.1063\/1.5107440"},{"key":"49","article-title":"Are three points for a win really better than two? theoretical and empirical evidence for German Soccer","author":"A. Dilger","year":"2008","journal-title":"SSRN Electronic Journal"}],"container-title":["Complexity"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/complexity\/2020\/7307058.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/complexity\/2020\/7307058.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/complexity\/2020\/7307058.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,3]],"date-time":"2022-12-03T16:05:23Z","timestamp":1670083523000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.hindawi.com\/journals\/complexity\/2020\/7307058\/"}},"subtitle":[],"editor":[{"given":"Hens","family":"Chittaranjan","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2020,12,7]]},"references-count":49,"alternative-id":["7307058","7307058"],"URL":"https:\/\/doi.org\/10.1155\/2020\/7307058","relation":{},"ISSN":["1099-0526","1076-2787"],"issn-type":[{"type":"electronic","value":"1099-0526"},{"type":"print","value":"1076-2787"}],"subject":[],"published":{"date-parts":[[2020,12,7]]}}}