{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,16]],"date-time":"2025-07-16T13:18:09Z","timestamp":1752671889159,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":32,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,7,6]],"date-time":"2022-07-06T00:00:00Z","timestamp":1657065600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000185","name":"Defense Advanced Research Projects Agency","doi-asserted-by":"publisher","award":["W911NF-19-20271"],"award-info":[{"award-number":["W911NF-19-20271"]}],"id":[{"id":"10.13039\/100000185","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,7,6]]},"DOI":"10.1145\/3477495.3531879","type":"proceedings-article","created":{"date-parts":[[2022,7,7]],"date-time":"2022-07-07T15:12:13Z","timestamp":1657206733000},"page":"2467-2472","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Assessing Scientific Research Papers with Knowledge Graphs"],"prefix":"10.1145","author":[{"given":"Kexuan","family":"Sun","sequence":"first","affiliation":[{"name":"University of Southern California, Los Angeles, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhiqiang","family":"Qiu","sequence":"additional","affiliation":[{"name":"University of Southern California, Los Angeles, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Abel","family":"Salinas","sequence":"additional","affiliation":[{"name":"University of Southern California, Los Angeles, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuzhong","family":"Huang","sequence":"additional","affiliation":[{"name":"University of Southern California, Los Angeles, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dong-Ho","family":"Lee","sequence":"additional","affiliation":[{"name":"University of Southern California, Los Angeles, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel","family":"Benjamin","sequence":"additional","affiliation":[{"name":"Nova Southeastern University, Fort Lauderdale, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fred","family":"Morstatter","sequence":"additional","affiliation":[{"name":"University of Southern California, Los Angeles, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiang","family":"Ren","sequence":"additional","affiliation":[{"name":"University of Southern California, Los Angeles, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kristina","family":"Lerman","sequence":"additional","affiliation":[{"name":"University of Southern California, Los Angeles, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jay","family":"Pujara","sequence":"additional","affiliation":[{"name":"University of Southern California, Los Angeles, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,7,7]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Proceedings of the Thirty-Fourth Annual Conference on Advances in Neural Information Processing Systems .","author":"Abboud Ralph","year":"2020","unstructured":"Ralph Abboud , . Ismail . Ilkan Ceylan , Thomas Lukasiewicz , and Tommaso Salvatori . 2020 . BoxE: A Box Embedding Model for Knowledge Base Completion . In Proceedings of the Thirty-Fourth Annual Conference on Advances in Neural Information Processing Systems . Ralph Abboud, .Ismail .Ilkan Ceylan, Thomas Lukasiewicz, and Tommaso Salvatori. 2020. BoxE: A Box Embedding Model for Knowledge Base Completion. In Proceedings of the Thirty-Fourth Annual Conference on Advances in Neural Information Processing Systems ."},{"key":"e_1_3_2_2_2_1","first-page":"1","article-title":"PyKEEN 1.0: A Python Library for Training and Evaluating Knowledge Graph Embeddings","volume":"22","author":"Ali Mehdi","year":"2021","unstructured":"Mehdi Ali , Max Berrendorf , Charles Tapley Hoyt , Laurent Vermue , Sahand Sharifzadeh , Volker Tresp , and Jens Lehmann . 2021 . PyKEEN 1.0: A Python Library for Training and Evaluating Knowledge Graph Embeddings . Journal of Machine Learning Research , Vol. 22 , 82 (2021), 1 -- 6 . Mehdi Ali, Max Berrendorf, Charles Tapley Hoyt, Laurent Vermue, Sahand Sharifzadeh, Volker Tresp, and Jens Lehmann. 2021. PyKEEN 1.0: A Python Library for Training and Evaluating Knowledge Graph Embeddings . Journal of Machine Learning Research , Vol. 22, 82 (2021), 1--6.","journal-title":"Journal of Machine Learning Research"},{"key":"#cr-split#-e_1_3_2_2_3_1.1","doi-asserted-by":"crossref","unstructured":"Nazanin Alipourfard Beatrix Arendt Daniel M Benjamin Noam Benkler Michael M Bishop Mark Burstein Martin Bush James Caverlee Yiling Chen Chae Clark and etal 2021. Systematizing Confidence in Open Research and Evidence (SCORE). https:\/\/doi.org\/10.31235\/osf.io\/46mnb 10.31235\/osf.io","DOI":"10.31235\/osf.io\/46mnb"},{"key":"#cr-split#-e_1_3_2_2_3_1.2","doi-asserted-by":"crossref","unstructured":"Nazanin Alipourfard Beatrix Arendt Daniel M Benjamin Noam Benkler Michael M Bishop Mark Burstein Martin Bush James Caverlee Yiling Chen Chae Clark and et al. 2021. Systematizing Confidence in Open Research and Evidence (SCORE). https:\/\/doi.org\/10.31235\/osf.io\/46mnb","DOI":"10.31235\/osf.io\/46mnb"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0225826"},{"key":"e_1_3_2_2_5_1","volume-title":"Nature","volume":"533","author":"Baker Monya","year":"2016","unstructured":"Monya Baker . 2016 . IS THERE A REPRODUCIBILITY CRISIS ? Nature , Vol. 533 (05 2016), 452--454. Monya Baker. 2016. IS THERE A REPRODUCIBILITY CRISIS? Nature , Vol. 533 (05 2016), 452--454."},{"key":"e_1_3_2_2_6_1","volume-title":"Ellis","author":"Glenn Begley C.","year":"2012","unstructured":"C. Glenn Begley and Lee M . Ellis . 2012 . Raise standards for preclinical cancer research textbar Nature . , Vol. 83 , 7391 (2012), 531--533. https:\/\/doi.org\/doi.org\/10.1038\/483531a 10.1038\/483531a C. Glenn Begley and Lee M. Ellis. 2012. Raise standards for preclinical cancer research textbar Nature. , Vol. 83, 7391 (2012), 531--533. https:\/\/doi.org\/doi.org\/10.1038\/483531a"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"crossref","unstructured":"Iz Beltagy Kyle Lo and Arman Cohan. 2019. SciBERT: Pretrained Language Model for Scientific Text. In EMNLP .  Iz Beltagy Kyle Lo and Arman Cohan. 2019. SciBERT: Pretrained Language Model for Scientific Text. In EMNLP .","DOI":"10.18653\/v1\/D19-1371"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.385"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1376616.1376746"},{"key":"e_1_3_2_2_10_1","volume-title":"Advances in Neural Information Processing Systems","volume":"26","author":"Bordes Antoine","year":"2013","unstructured":"Antoine Bordes , Nicolas Usunier , Alberto Garcia-Duran , Jason Weston , and Oksana Yakhnenko . 2013 . Translating Embeddings for Modeling Multi-relational Data . In Advances in Neural Information Processing Systems , Vol. 26 . Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. 2013. Translating Embeddings for Modeling Multi-relational Data. In Advances in Neural Information Processing Systems, Vol. 26."},{"key":"e_1_3_2_2_11_1","volume-title":"Science","volume":"351","author":"Camerer Colin F.","year":"2016","unstructured":"Colin F. Camerer , Anna Dreber , Eskil Forsell , Teck-Hua Ho , J\u00fcrgen Huber , Magnus Johannesson , Michael Kirchler , Johan Almenberg , Adam Altmejd , Taizan Chan , Emma Heikensten , Felix Holzmeister , Taisuke Imai , Siri Isaksson , Gideon Nave , Thomas Pfeiffer , Michael Razen , and Hang Wu . 2016 . Evaluating replicability of laboratory experiments in economics . Science , Vol. 351 , 6280 (2016), 1433--1436. https:\/\/doi.org\/10.1126\/science.aaf0918 10.1126\/science.aaf0918 Colin F. Camerer, Anna Dreber, Eskil Forsell, Teck-Hua Ho, J\u00fcrgen Huber, Magnus Johannesson, Michael Kirchler, Johan Almenberg, Adam Altmejd, Taizan Chan, Emma Heikensten, Felix Holzmeister, Taisuke Imai, Siri Isaksson, Gideon Nave, Thomas Pfeiffer, Michael Razen, and Hang Wu. 2016. Evaluating replicability of laboratory experiments in economics. Science , Vol. 351, 6280 (2016), 1433--1436. https:\/\/doi.org\/10.1126\/science.aaf0918"},{"key":"e_1_3_2_2_12_1","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 4171--4186","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding . In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 4171--4186 . https:\/\/doi.org\/10.18653\/v1\/N19--1423 10.18653\/v1 Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 4171--4186. https:\/\/doi.org\/10.18653\/v1\/N19--1423"},{"key":"e_1_3_2_2_13_1","volume-title":"Alexandria Denis, Nicole Perfito, Elizabeth Iorns, and Brian A Nosek.","author":"Errington Timothy M","year":"2021","unstructured":"Timothy M Errington , Courtney K Soderberg Maya Mathur , Alexandria Denis, Nicole Perfito, Elizabeth Iorns, and Brian A Nosek. 2021 . Investigating the replicability of preclinical cancer biology. (2021). https:\/\/doi.org\/10.7554\/eLife.71601 10.7554\/eLife.71601 Timothy M Errington, Courtney K Soderberg Maya Mathur, Alexandria Denis, Nicole Perfito, Elizabeth Iorns, and Brian A Nosek. 2021. Investigating the replicability of preclinical cancer biology. (2021). https:\/\/doi.org\/10.7554\/eLife.71601"},{"key":"e_1_3_2_2_14_1","volume-title":"PLOS Medicine","volume":"2","author":"Ioannidis John P. A.","year":"2005","unstructured":"John P. A. Ioannidis . 2005 . Why Most Published Research Findings Are False . PLOS Medicine , Vol. 2 (08 2005), null. https:\/\/doi.org\/10.1371\/journal.pmed.0020124 10.1371\/journal.pmed.0020124 John P. A. Ioannidis. 2005. Why Most Published Research Findings Are False. PLOS Medicine , Vol. 2 (08 2005), null. https:\/\/doi.org\/10.1371\/journal.pmed.0020124"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-1067"},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/30.1-2.81"},{"key":"e_1_3_2_2_17_1","unstructured":"Agustinus Kristiadi Mohammad Asif Khan Denis Lukovnikov Jens Lehmann and Asja Fischer. [n.d.]. Incorporating Literals into Knowledge Graph Embeddings. In The Semantic Web . 347--363. https:\/\/doi.org\/10.1007\/978--3-030--30793--6_20    10.1007\/978--3-030--30793--6_20\nAgustinus Kristiadi Mohammad Asif Khan Denis Lukovnikov Jens Lehmann and Asja Fischer. [n.d.]. Incorporating Literals into Knowledge Graph Embeddings. In The Semantic Web . 347--363. https:\/\/doi.org\/10.1007\/978--3-030--30793--6_20"},{"key":"e_1_3_2_2_18_1","volume-title":"London","author":"Lakatos Imre","year":"1970","unstructured":"Imre Lakatos . 1970 . Criticism and the Growth of Knowledge (Proceedings of the International Colloquium in the Philosophy of Science , London 1965, Volume 4). (1970). Imre Lakatos. 1970. Criticism and the Growth of Knowledge (Proceedings of the International Colloquium in the Philosophy of Science, London 1965, Volume 4). (1970)."},{"key":"e_1_3_2_2_19_1","volume-title":"S\u00f6ren Auer, and Christian Bizer.","author":"Lehmann Jens","year":"2014","unstructured":"Jens Lehmann , Robert Isele , Max Jakob , Anja Jentzsch , Dimitris Kontokostas , Pablo Mendes , Sebastian Hellmann , Mohamed Morsey , Patrick Van Kleef , S\u00f6ren Auer, and Christian Bizer. 2014 . DBpedia - A Large-scale, Multilingual Knowledge Base Extracted from Wikipedia. Semantic Web Journal , Vol. 6 (01 2014). https:\/\/doi.org\/10.3233\/SW-140134 10.3233\/SW-140134 Jens Lehmann, Robert Isele, Max Jakob, Anja Jentzsch, Dimitris Kontokostas, Pablo Mendes, Sebastian Hellmann, Mohamed Morsey, Patrick Van Kleef, S\u00f6ren Auer, and Christian Bizer. 2014. DBpedia - A Large-scale, Multilingual Knowledge Base Extracted from Wikipedia. Semantic Web Journal , Vol. 6 (01 2014). https:\/\/doi.org\/10.3233\/SW-140134"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v29i1.9491"},{"key":"e_1_3_2_2_21_1","volume-title":"Joanna Asia Biega, and Fabian M. Suchanek","author":"Mahdisoltani Farzaneh","year":"2015","unstructured":"Farzaneh Mahdisoltani , Joanna Asia Biega, and Fabian M. Suchanek . 2015 . YAGO3: A Knowledge Base from Multilingual Wikipedias. In CIDR . Farzaneh Mahdisoltani, Joanna Asia Biega, and Fabian M. Suchanek. 2015. YAGO3: A Knowledge Base from Multilingual Wikipedias. In CIDR ."},{"key":"e_1_3_2_2_22_1","unstructured":"Tomas Mikolov Kai Chen Greg Corrado and Jeffrey Dean. 2013. Efficient Estimation of Word Representations in Vector Space. (2013). arxiv: 1301.3781  Tomas Mikolov Kai Chen Greg Corrado and Jeffrey Dean. 2013. Efficient Estimation of Word Representations in Vector Space. (2013). arxiv: 1301.3781"},{"key":"e_1_3_2_2_23_1","volume-title":"Errington","author":"Nosek Brian A.","year":"2020","unstructured":"Brian A. Nosek and Timothy M . Errington . 2020 . What is replication? PLOS Biology , Vol. 18 (03 2020), 1--8. https:\/\/doi.org\/10.1371\/journal.pbio.3000691 10.1371\/journal.pbio.3000691 Brian A. Nosek and Timothy M. Errington. 2020. What is replication? PLOS Biology , Vol. 18 (03 2020), 1--8. https:\/\/doi.org\/10.1371\/journal.pbio.3000691"},{"key":"e_1_3_2_2_24_1","volume-title":"Estimating the reproducibility of psychological science textbar Science","author":"Collaboration Open Science","year":"2015","unstructured":"Open Science Collaboration . 2015. Estimating the reproducibility of psychological science textbar Science . , Vol. 349 , 6251 ( 2015 ). https:\/\/doi.org\/10.1126\/science.aac4716 10.1126\/science.aac4716 Open Science Collaboration. 2015. Estimating the reproducibility of psychological science textbar Science. , Vol. 349, 6251 (2015). https:\/\/doi.org\/10.1126\/science.aac4716"},{"key":"e_1_3_2_2_25_1","volume-title":"Believe it or not: how much can we rely on published data on potential drug targets?","author":"Prinz Florian","year":"2011","unstructured":"Florian Prinz , Thomas Schlange , and Khusru Asadullah . 2011. Believe it or not: how much can we rely on published data on potential drug targets? , Vol. 10 , 9 ( 2011 ), 712--712. https:\/\/doi.org\/10.1038\/nrd3439-c1 10.1038\/nrd3439-c1 Florian Prinz, Thomas Schlange, and Khusru Asadullah. 2011. Believe it or not: how much can we rely on published data on potential drug targets? , Vol. 10, 9 (2011), 712--712. https:\/\/doi.org\/10.1038\/nrd3439-c1"},{"key":"e_1_3_2_2_26_1","volume-title":"Proceedings of The 33rd International Conference on Machine Learning (Proceedings of Machine Learning Research)","volume":"48","author":"Trouillon Th\u00e9o","year":"2016","unstructured":"Th\u00e9o Trouillon , Johannes Welbl , Sebastian Riedel , Eric Gaussier , and Guillaume Bouchard . 2016 . Complex Embeddings for Simple Link Prediction . In Proceedings of The 33rd International Conference on Machine Learning (Proceedings of Machine Learning Research) , Vol. 48 . 2071--2080. Th\u00e9o Trouillon, Johannes Welbl, Sebastian Riedel, Eric Gaussier, and Guillaume Bouchard. 2016. Complex Embeddings for Simple Link Prediction. In Proceedings of The 33rd International Conference on Machine Learning (Proceedings of Machine Learning Research), Vol. 48. 2071--2080."},{"key":"e_1_3_2_2_27_1","volume-title":"Composition-based Multi-Relational Graph Convolutional Networks. In International Conference on Learning Representations .","author":"Vashishth Shikhar","year":"2020","unstructured":"Shikhar Vashishth , Soumya Sanyal , Vikram Nitin , and Partha Talukdar . 2020 . Composition-based Multi-Relational Graph Convolutional Networks. In International Conference on Learning Representations . Shikhar Vashishth, Soumya Sanyal, Vikram Nitin, and Partha Talukdar. 2020. Composition-based Multi-Relational Graph Convolutional Networks. In International Conference on Learning Representations ."},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v30i1.10329"},{"key":"e_1_3_2_2_29_1","unstructured":"Jiacheng Xu Xipeng Qiu Kan Chen and Xuanjing Huang. 2017. Knowledge Graph Representation with Jointly Structural and Textual Encoding. In IJCAI .  Jiacheng Xu Xipeng Qiu Kan Chen and Xuanjing Huang. 2017. Knowledge Graph Representation with Jointly Structural and Textual Encoding. In IJCAI ."},{"key":"e_1_3_2_2_30_1","volume-title":"Embedding Entities and Relations for Learning and Inference in Knowledge Bases. In 3rd International Conference on Learning Representations, ICLR 2015 .","author":"Yang Bishan","year":"2015","unstructured":"Bishan Yang , Wen-tau Yih, Xiaodong He , Jianfeng Gao , and Li Deng . 2015 . Embedding Entities and Relations for Learning and Inference in Knowledge Bases. In 3rd International Conference on Learning Representations, ICLR 2015 . Bishan Yang, Wen-tau Yih, Xiaodong He, Jianfeng Gao, and Li Deng. 2015. Embedding Entities and Relations for Learning and Inference in Knowledge Bases. In 3rd International Conference on Learning Representations, ICLR 2015 ."},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1909046117"}],"event":{"name":"SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval","sponsor":["SIGIR ACM Special Interest Group on Information Retrieval"],"location":"Madrid Spain","acronym":"SIGIR '22"},"container-title":["Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3477495.3531879","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3477495.3531879","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3477495.3531879","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:10:27Z","timestamp":1750183827000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3477495.3531879"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,6]]},"references-count":32,"alternative-id":["10.1145\/3477495.3531879","10.1145\/3477495"],"URL":"https:\/\/doi.org\/10.1145\/3477495.3531879","relation":{},"subject":[],"published":{"date-parts":[[2022,7,6]]},"assertion":[{"value":"2022-07-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}