{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T22:43:55Z","timestamp":1777070635664,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":46,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,10,27]],"date-time":"2022-10-27T00:00:00Z","timestamp":1666828800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,10,27]]},"DOI":"10.1145\/3579051.3579072","type":"proceedings-article","created":{"date-parts":[[2023,2,14]],"date-time":"2023-02-14T00:19:46Z","timestamp":1676333986000},"page":"104-109","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["A Closer Look at Probability Calibration of Knowledge Graph Embedding"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0331-131X","authenticated-orcid":false,"given":"Ruiqi","family":"Zhu","sequence":"first","affiliation":[{"name":"University of Edinburgh, School of Informatics, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4579-0080","authenticated-orcid":false,"given":"Fangrong","family":"Wang","sequence":"additional","affiliation":[{"name":"University of Edinburgh, School of Informatics, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0578-6474","authenticated-orcid":false,"given":"Alan","family":"Bundy","sequence":"additional","affiliation":[{"name":"University of Edinburgh, School of Informatics, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6665-2242","authenticated-orcid":false,"given":"Xue","family":"Li","sequence":"additional","affiliation":[{"name":"University of Edinburgh, School of Informatics, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6868-9858","authenticated-orcid":false,"given":"Kwabena","family":"Nuamah","sequence":"additional","affiliation":[{"name":"University of Edinburgh, School of Informatics, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5660-3036","authenticated-orcid":false,"given":"Lei","family":"Xu","sequence":"additional","affiliation":[{"name":"Ireland Research Centre, Huawei, Ireland Research Centre, Huawei, Ireland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9795-5310","authenticated-orcid":false,"given":"Stefano","family":"Mauceri","sequence":"additional","affiliation":[{"name":"Ireland Research Centre, Huawei, Ireland Research Centre, Huawei, Ireland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9779-2088","authenticated-orcid":false,"given":"Jeff Z.","family":"Pan","sequence":"additional","affiliation":[{"name":"School of Informatics, University of Edinburgh, United Kingdom and Huawei, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,2,13]]},"reference":[{"key":"e_1_3_2_1_1_1","first-page":"9649","article-title":"Boxe: A box embedding model for knowledge base completion","volume":"33","author":"Abboud Ralph","year":"2020","unstructured":"Ralph Abboud , Ismail Ceylan , Thomas Lukasiewicz , and Tommaso Salvatori . 2020 . Boxe: A box embedding model for knowledge base completion . Advances in Neural Information Processing Systems 33 (2020), 9649 \u2013 9661 . Ralph Abboud, Ismail Ceylan, Thomas Lukasiewicz, and Tommaso Salvatori. 2020. Boxe: A box embedding model for knowledge base completion. Advances in Neural Information Processing Systems 33 (2020), 9649\u20139661.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_2_1","first-page":"1","article-title":"PyKEEN 1.0: A Python Library for Training and Evaluating Knowledge Graph Embeddings","volume":"22","author":"Ali Mehdi","year":"2021","unstructured":"Mehdi Ali , Max Berrendorf , Charles\u00a0Tapley Hoyt , Laurent Vermue , Sahand Sharifzadeh , Volker Tresp , and Jens Lehmann . 2021 . PyKEEN 1.0: A Python Library for Training and Evaluating Knowledge Graph Embeddings . Journal of Machine Learning Research 22 , 82 (2021), 1 \u2013 6 . http:\/\/jmlr.org\/papers\/v22\/20-825.html Mehdi Ali, Max Berrendorf, Charles\u00a0Tapley Hoyt, Laurent Vermue, Sahand Sharifzadeh, Volker Tresp, and Jens Lehmann. 2021. PyKEEN 1.0: A Python Library for Training and Evaluating Knowledge Graph Embeddings. Journal of Machine Learning Research 22, 82 (2021), 1\u20136. http:\/\/jmlr.org\/papers\/v22\/20-825.html","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_1_3_1","volume-title":"Translating embeddings for modeling multi-relational data. Advances in neural information processing systems 26","author":"Bordes Antoine","year":"2013","unstructured":"Antoine Bordes , Nicolas Usunier , Alberto Garcia-Duran , Jason Weston , and Oksana Yakhnenko . 2013. Translating embeddings for modeling multi-relational data. Advances in neural information processing systems 26 ( 2013 ). Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. 2013. Translating embeddings for modeling multi-relational data. Advances in neural information processing systems 26 (2013)."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2018.2807452"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i8.16850"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.2595043"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11573"},{"key":"e_1_3_2_1_9_1","volume-title":"Proc. of 28th International Workshop on Description Logics (DL","author":"Garcia Jhonatan","year":"2015","unstructured":"Jhonatan Garcia , Jeff\u00a0 Z. Pan , Achille Fokoue , Katia Sycara , Yuqing Tang , and Federico Cerutti .2015. Handling uncertainty : An extension of DL-Lite with Subjective Logic . In Proc. of 28th International Workshop on Description Logics (DL 2015 ). Jhonatan Garcia, Jeff\u00a0Z. Pan, Achille Fokoue, Katia Sycara, Yuqing Tang, and Federico Cerutti.2015. Handling uncertainty: An extension of DL-Lite with Subjective Logic. In Proc. of 28th International Workshop on Description Logics (DL 2015)."},{"key":"e_1_3_2_1_10_1","volume-title":"International conference on machine learning. PMLR, 1321\u20131330","author":"Guo Chuan","year":"2017","unstructured":"Chuan Guo , Geoff Pleiss , Yu Sun , and Kilian\u00a0 Q Weinberger . 2017 . On calibration of modern neural networks . In International conference on machine learning. PMLR, 1321\u20131330 . Chuan Guo, Geoff Pleiss, Yu Sun, and Kilian\u00a0Q Weinberger. 2017. On calibration of modern neural networks. In International conference on machine learning. PMLR, 1321\u20131330."},{"key":"e_1_3_2_1_11_1","volume-title":"Evaluation of prediction models for decision-making: beyond calibration and discrimination. PLoS medicine 10, 7","author":"Holmberg Lars","year":"2013","unstructured":"Lars Holmberg and Andrew Vickers . 2013. Evaluation of prediction models for decision-making: beyond calibration and discrimination. PLoS medicine 10, 7 ( 2013 ), e1001491. Lars Holmberg and Andrew Vickers. 2013. Evaluation of prediction models for decision-making: beyond calibration and discrimination. PLoS medicine 10, 7 (2013), e1001491."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-1067"},{"key":"e_1_3_2_1_13_1","unstructured":"Charles Kemp Joshua\u00a0B Tenenbaum Thomas\u00a0L Griffiths Takeshi Yamada and Naonori Ueda. 2006. Learning systems of concepts with an infinite relational model. In AAAI Vol.\u00a03. 5.  Charles Kemp Joshua\u00a0B Tenenbaum Thomas\u00a0L Griffiths Takeshi Yamada and Naonori Ueda. 2006. Learning systems of concepts with an infinite relational model. In AAAI Vol.\u00a03. 5."},{"key":"e_1_3_2_1_14_1","unstructured":"Meelis Kull Telmo Silva\u00a0Filho and Peter Flach. 2017. Beta calibration: a well-founded and easily implemented improvement on logistic calibration for binary classifiers. In Artificial Intelligence and Statistics. PMLR 623\u2013631.  Meelis Kull Telmo Silva\u00a0Filho and Peter Flach. 2017. Beta calibration: a well-founded and easily implemented improvement on logistic calibration for binary classifiers. In Artificial Intelligence and Statistics. PMLR 623\u2013631."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1214\/17-EJS1338SI"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW50498.2020.00171"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.5555\/2886521.2886624"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/2888116.2888120"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2015.2483592"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v30i1.10314"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1102351.1102430"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"crossref","unstructured":"J.Z. Pan G. Vetere J.M. Gomez-Perez and H. Wu (Eds.). 2017. Exploiting Linked Data and Knowledge Graphs for Large Organisations. Springer.  J.Z. Pan G. Vetere J.M. Gomez-Perez and H. Wu (Eds.). 2017. Exploiting Linked Data and Knowledge Graphs for Large Organisations. Springer.","DOI":"10.1007\/978-3-319-45654-6"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-92673-3_3"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/11550907_131"},{"key":"e_1_3_2_1_25_1","unstructured":"Pouya Pezeshkpour Yifan Tian and Sameer Singh. 2020. Revisiting evaluation of knowledge base completion models. In Automated Knowledge Base Construction.  Pouya Pezeshkpour Yifan Tian and Sameer Singh. 2020. Revisiting evaluation of knowledge base completion models. In Automated Knowledge Base Construction."},{"key":"e_1_3_2_1_26_1","volume-title":"Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Advances in large margin classifiers 10, 3","author":"John Platt","year":"1999","unstructured":"John Platt 1999. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Advances in large margin classifiers 10, 3 ( 1999 ), 61\u201374. John Platt 1999. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Advances in large margin classifiers 10, 3 (1999), 61\u201374."},{"key":"e_1_3_2_1_27_1","volume-title":"Proc. of 2007 International Workshop on Description Logics (DL2007)","author":"Qi Guilin","year":"2007","unstructured":"Guilin Qi , Jeff\u00a0 Z. Pan , and Qiu Ji . 2007 . A Possibilistic Extension of Description Logics . In Proc. of 2007 International Workshop on Description Logics (DL2007) . Guilin Qi, Jeff\u00a0Z. Pan, and Qiu Ji. 2007. A Possibilistic Extension of Description Logics. In Proc. of 2007 International Workshop on Description Logics (DL2007)."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"crossref","unstructured":"Guilin Qi Jeff\u00a0Z. Pan and Qiu Ji. 2007. Extending Description Logics with Uncertainty Reasoning in Possibilistic Logic. In the Proc. of the 9th European Conference on Symbolic and Quantitave Approaches to Reasoning with Uncertainty (ECSQARU\u20192007). 828\u2013839.  Guilin Qi Jeff\u00a0Z. Pan and Qiu Ji. 2007. Extending Description Logics with Uncertainty Reasoning in Possibilistic Logic. In the Proc. of the 9th European Conference on Symbolic and Quantitave Approaches to Reasoning with Uncertainty (ECSQARU\u20192007). 828\u2013839.","DOI":"10.1007\/978-3-540-75256-1_72"},{"key":"e_1_3_2_1_29_1","volume-title":"Calibrating Knowledge Graphs","author":"Rao Aishwarya","unstructured":"Aishwarya Rao . 2021. Calibrating Knowledge Graphs . Rochester Institute of Technology . Aishwarya Rao. 2021. Calibrating Knowledge Graphs. Rochester Institute of Technology."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.667"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TrustCom.2012.294"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11535"},{"key":"e_1_3_2_1_33_1","volume-title":"Reasoning with neural tensor networks for knowledge base completion. Advances in neural information processing systems 26","author":"Socher Richard","year":"2013","unstructured":"Richard Socher , Danqi Chen , Christopher\u00a0 D Manning , and Andrew Ng. 2013. Reasoning with neural tensor networks for knowledge base completion. Advances in neural information processing systems 26 ( 2013 ). Richard Socher, Danqi Chen, Christopher\u00a0D Manning, and Andrew Ng. 2013. Reasoning with neural tensor networks for knowledge base completion. Advances in neural information processing systems 26 (2013)."},{"key":"e_1_3_2_1_34_1","volume-title":"Proceedings of the 2006 International Workshop on Description Logics (DL2006)","author":"Stoilos Giorgos","year":"2006","unstructured":"Giorgos Stoilos , Giorgos\u00a0 B. Stamou , and Jeff\u00a0 Z. Pan . 2006 . Handling Imprecise Knowledge with Fuzzy Description Logic . In Proceedings of the 2006 International Workshop on Description Logics (DL2006) . Giorgos Stoilos, Giorgos\u00a0B. Stamou, and Jeff\u00a0Z. Pan. 2006. Handling Imprecise Knowledge with Fuzzy Description Logic. In Proceedings of the 2006 International Workshop on Description Logics (DL2006)."},{"key":"e_1_3_2_1_35_1","volume-title":"Rotate: Knowledge graph embedding by relational rotation in complex space. arXiv preprint arXiv:1902.10197(2019).","author":"Sun Zhiqing","year":"2019","unstructured":"Zhiqing Sun , Zhi-Hong Deng , Jian-Yun Nie , and Jian Tang . 2019 . Rotate: Knowledge graph embedding by relational rotation in complex space. arXiv preprint arXiv:1902.10197(2019). Zhiqing Sun, Zhi-Hong Deng, Jian-Yun Nie, and Jian Tang. 2019. Rotate: Knowledge graph embedding by relational rotation in complex space. arXiv preprint arXiv:1902.10197(2019)."},{"key":"e_1_3_2_1_36_1","volume-title":"Probability Calibration for Knowledge Graph Embedding Models. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=S1g8K1BFwS","author":"Tabacof Pedro","year":"2020","unstructured":"Pedro Tabacof and Luca Costabello . 2020 . Probability Calibration for Knowledge Graph Embedding Models. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=S1g8K1BFwS Pedro Tabacof and Luca Costabello. 2020. Probability Calibration for Knowledge Graph Embedding Models. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=S1g8K1BFwS"},{"key":"e_1_3_2_1_37_1","volume-title":"International conference on machine learning. PMLR","author":"Trouillon Th\u00e9o","year":"2016","unstructured":"Th\u00e9o Trouillon , Johannes Welbl , Sebastian Riedel , \u00c9ric Gaussier , and Guillaume Bouchard . 2016 . Complex embeddings for simple link prediction . In International conference on machine learning. PMLR , 2071\u20132080. Th\u00e9o Trouillon, Johannes Welbl, Sebastian Riedel, \u00c9ric Gaussier, and Guillaume Bouchard. 2016. Complex embeddings for simple link prediction. In International conference on machine learning. PMLR, 2071\u20132080."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X14547233"},{"key":"e_1_3_2_1_39_1","volume-title":"Calibration: A frequency justification for personal probability. In Physics, philosophy and psychoanalysis","author":"Van\u00a0Fraassen C","year":"1983","unstructured":"Bas\u00a0 C Van\u00a0Fraassen . 1983 . Calibration: A frequency justification for personal probability. In Physics, philosophy and psychoanalysis . Springer , 295\u2013319. Bas\u00a0C Van\u00a0Fraassen. 1983. Calibration: A frequency justification for personal probability. In Physics, philosophy and psychoanalysis. Springer, 295\u2013319."},{"key":"e_1_3_2_1_40_1","volume-title":"The Stanford Encyclopedia of Philosophy (Spring 2016 ed.), Edward\u00a0N","author":"Vineberg Susan","unstructured":"Susan Vineberg . 2016. Dutch Book Arguments . In The Stanford Encyclopedia of Philosophy (Spring 2016 ed.), Edward\u00a0N . Zalta (Ed.). Metaphysics Research Lab, Stanford University . Susan Vineberg. 2016. Dutch Book Arguments. In The Stanford Encyclopedia of Philosophy (Spring 2016 ed.), Edward\u00a0N. Zalta (Ed.). Metaphysics Research Lab, Stanford University."},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v28i1.8870"},{"key":"e_1_3_2_1_42_1","unstructured":"Bishan Yang Wen-tau Yih Xiaodong He Jianfeng Gao and Li Deng. 2014. Embedding entities and relations for learning and inference in knowledge bases. arXiv preprint arXiv:1412.6575(2014).  Bishan Yang Wen-tau Yih Xiaodong He Jianfeng Gao and Li Deng. 2014. Embedding entities and relations for learning and inference in knowledge bases. arXiv preprint arXiv:1412.6575(2014)."},{"key":"e_1_3_2_1_43_1","unstructured":"Bianca Zadrozny and Charles Elkan. 2001. Obtaining calibrated probability estimates from decision trees and naive bayesian classifiers. In Icml Vol.\u00a01. Citeseer 609\u2013616.  Bianca Zadrozny and Charles Elkan. 2001. Obtaining calibrated probability estimates from decision trees and naive bayesian classifiers. In Icml Vol.\u00a01. Citeseer 609\u2013616."},{"key":"e_1_3_2_1_44_1","volume-title":"Toward better drug discovery with knowledge graph. Current opinion in structural biology 72","author":"Zeng Xiangxiang","year":"2022","unstructured":"Xiangxiang Zeng , Xinqi Tu , Yuansheng Liu , Xiangzheng Fu , and Yansen Su. 2022. Toward better drug discovery with knowledge graph. Current opinion in structural biology 72 ( 2022 ), 114\u2013126. Xiangxiang Zeng, Xinqi Tu, Yuansheng Liu, Xiangzheng Fu, and Yansen Su. 2022. Toward better drug discovery with knowledge graph. Current opinion in structural biology 72 (2022), 114\u2013126."},{"key":"e_1_3_2_1_45_1","first-page":"22313","article-title":"Calibrating predictions to decisions: A novel approach to multi-class calibration","volume":"34","author":"Zhao Shengjia","year":"2021","unstructured":"Shengjia Zhao , Michael Kim , Roshni Sahoo , Tengyu Ma , and Stefano Ermon . 2021 . Calibrating predictions to decisions: A novel approach to multi-class calibration . Advances in Neural Information Processing Systems 34 (2021), 22313 \u2013 22324 . Shengjia Zhao, Michael Kim, Roshni Sahoo, Tengyu Ma, and Stefano Ermon. 2021. Calibrating predictions to decisions: A novel approach to multi-class calibration. Advances in Neural Information Processing Systems 34 (2021), 22313\u201322324.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2021.108100"}],"event":{"name":"IJCKG 2022: 11th International Joint Conference On Knowledge Graphs","location":"Hangzhou China","acronym":"IJCKG 2022"},"container-title":["Proceedings of the 11th International Joint Conference on Knowledge Graphs"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3579051.3579072","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3579051.3579072","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:38:05Z","timestamp":1750178285000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3579051.3579072"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,27]]},"references-count":46,"alternative-id":["10.1145\/3579051.3579072","10.1145\/3579051"],"URL":"https:\/\/doi.org\/10.1145\/3579051.3579072","relation":{},"subject":[],"published":{"date-parts":[[2022,10,27]]},"assertion":[{"value":"2023-02-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}