{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T01:52:05Z","timestamp":1772070725117,"version":"3.50.1"},"reference-count":38,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2022,7,25]],"date-time":"2022-07-25T00:00:00Z","timestamp":1658707200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Institute of Informatics"},{"name":"The Graduate University for Advanced Studies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Knowledge graph completion (KGC) models are a feasible approach for manipulating facts in knowledge graphs. However, the lack of entity types in current KGC models results in inaccurate link prediction results. Most existing type-aware KGC models require entity type annotations, which are not always available and expensive to obtain. We propose ProtoE, an unsupervised method for learning implicit type and type constraint representations. ProtoE enhances type-agnostic KGC models by relation-specific prototype embeddings. Our method does not rely on entity type annotations to capture the type and type constraints of entities. Unlike existing unsupervised type representation learning methods, which have only a single representation for entity-type and relation-type constraints, our method can capture multiple type constraints in relations. Experimental results show that our method can improve the performance of both bilinear and translational KGC models in the link prediction task.<\/jats:p>","DOI":"10.3390\/info13080354","type":"journal-article","created":{"date-parts":[[2022,7,25]],"date-time":"2022-07-25T21:20:59Z","timestamp":1658784059000},"page":"354","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["ProtoE: Enhancing Knowledge Graph Completion Models with Unsupervised Type Representation Learning"],"prefix":"10.3390","volume":"13","author":[{"given":"Yuxun","family":"Lu","sequence":"first","affiliation":[{"name":"Department of Informatics, School of Multidisciplinary Sciences, The Graduate University for Advanced Studies, Tokyo 101-8430, Japan"},{"name":"National Institute of Informatics, Tokyo 101-8430, Japan"},{"name":"Department of Industrial Engineering and Economics, School of Engineering, Tokyo Institute of Technology, Tokyo 152-8552, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ryutaro","family":"Ichise","sequence":"additional","affiliation":[{"name":"National Institute of Informatics, Tokyo 101-8430, Japan"},{"name":"Department of Industrial Engineering and Economics, School of Engineering, Tokyo Institute of Technology, Tokyo 152-8552, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Lu, Y., Fang, Y., and Shi, C. (2020, January 6\u201310). Meta-learning on heterogeneous information networks for cold-start recommendation. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Virtual Event, CA, USA.","DOI":"10.1145\/3394486.3403207"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Dai, H., Kozareva, Z., Smola, A.J., and Song, L. (2018, January 2\u20137). Variational Reasoning for Question Answering with Knowledge Graph. Proceedings of the 32nd AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.12057"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ji, G., He, S., Xu, L., Liu, K., and Zhao, J. (2015, January 27\u201331). Knowledge Graph Embedding via Dynamic Mapping Matrix. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics, Beijing, China.","DOI":"10.3115\/v1\/P15-1067"},{"key":"ref_4","first-page":"2787","article-title":"Translating Embeddings for Modeling Multi-relational Data","volume":"26","author":"Bordes","year":"2013","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Wang, Z., Zhang, J., Feng, J., and Chen, Z. (2014, January 27\u201331). Knowledge Graph Embedding by Translating on Hyperplanes. Proceedings of the 28th AAAI Conference on Artificial Intelligence, Quebec City, QC, Canada.","DOI":"10.1609\/aaai.v28i1.8870"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Lin, Y., Liu, Z., Sun, M., Liu, Y., and Zhu, X. (2015, January 25\u201330). Learning Entity and Relation Embeddings for Knowledge Graph Completion. Proceedings of the 29th AAAI Conference on Artificial Intelligence, Austin, TX, USA.","DOI":"10.1609\/aaai.v29i1.9491"},{"key":"ref_7","unstructured":"Yang, B., Yih, W.T., He, X., Gao, J., and Deng, L. (2015, January 7\u20139). Embedding Entities and Relations for Learning and Inference in Knowledge Bases. Proceedings of the International Conference on Learning Representations, San Diego, CA, USA."},{"key":"ref_8","unstructured":"Nickel, M., Tresp, V., and Kriegel, H.P. (July, January 28). A Three-Way Model for Collective Learning on Multi-Relational Data. Proceedings of the 28th International Conference on International Conference on Machine Learning, Madison, WI, USA."},{"key":"ref_9","unstructured":"Trouillon, T., Welbl, J., Riedel, S., Gaussier, E., and Bouchard, G. (2016, January 19\u201324). Complex Embeddings for Simple Link Prediction. Proceedings of the 33rd International Conference on International Conference on Machine Learning, New York, NY, USA."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Balazevic, I., Allen, C., and Hospedales, T. (2019, January 3\u20137). TuckER: Tensor Factorization for Knowledge Graph Completion. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing, Hong Kong, China.","DOI":"10.18653\/v1\/D19-1522"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Nickel, M., Rosasco, L., and Poggio, T. (2016, January 12\u201317). Holographic Embeddings of Knowledge Graphs. Proceedings of the 30th AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA.","DOI":"10.1609\/aaai.v30i1.10314"},{"key":"ref_12","unstructured":"Kazemi, S.M., and Poole, D. (2018, January 3\u20138). SimplE Embedding for Link Prediction in Knowledge Graphs. Proceedings of the 32nd International Conference on Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_13","unstructured":"Liu, H., Wu, Y., and Yang, Y. (2017, January 6\u201311). Analogical Inference for Multi-Relational Embeddings. Proceedings of the 34th International Conference on Machine Learning, Sydney, NSW, Australia."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Dettmers, T., Minervini, P., Stenetorp, P., and Riedel, S. (2018, January 2\u20137). Convolutional 2D Knowledge Graph Embeddings. Proceedings of the 32nd AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.11573"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"941","DOI":"10.1109\/TKDE.2019.2893920","article-title":"Generalized Translation-Based Embedding of Knowledge Graph","volume":"32","author":"Ebisu","year":"2020","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Li, Z., Xu, Q., Jiang, Y., Cao, X., and Huang, Q. (2020, January 12\u201316). Quaternion-Based Knowledge Graph Network for Recommendation. Proceedings of the 28th ACM International Conference on Multimedia, Seattle, WA, USA.","DOI":"10.1145\/3394171.3413992"},{"key":"ref_17","unstructured":"Sun, Z., Deng, Z.H., Nie, J.Y., and Tang, J. (2019, January 6\u20139). RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space. Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA."},{"key":"ref_18","unstructured":"Xie, R., Liu, Z., and Sun, M. (2016, January 9\u201315). Representation Learning of Knowledge Graphs with Hierarchical Types. Proceedings of the 25th International Joint Conference on Artificial Intelligence, New York, NY, USA."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zhao, Y., Zhang, A., Xie, R., Liu, K., and Wang, X. (2020, January 5\u201310). Connecting Embeddings for Knowledge Graph Entity Typing. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Seattle, WA, USA.","DOI":"10.18653\/v1\/2020.acl-main.572"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Cui, Z., Kapanipathi, P., Talamadupula, K., Gao, T., and Ji, Q. (2021, January 2\u20139). Type-augmented Relation Prediction in Knowledge Graphs. Proceedings of the 35th AAAI Conference on Artificial Intelligence, Virtual.","DOI":"10.1609\/aaai.v35i8.16879"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Moon, C., Jones, P., and Samatova, N.F. (2017, January 6\u201310). Learning Entity Type Embeddings for Knowledge Graph Completion. Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, Singapore, Singapore.","DOI":"10.1145\/3132847.3133095"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Krompa\u00df, D., Baier, S., and Tresp, V. (2015, January 13\u201315). Type-Constrained Representation Learning in Knowledge Graphs. Proceedings of the 14th International Semantic Web Conference, Bethlehem, PA, USA.","DOI":"10.1007\/978-3-319-25007-6_37"},{"key":"ref_23","first-page":"1172","article-title":"AutoETER: Automated Entity Type Representation for Knowledge Graph Embedding","volume":"2020","author":"Niu","year":"2020","journal-title":"Find. Assoc. Comput. Linguist. Emnlp"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Ang, G., and Lim, E.P. (2022, January 22\u201327). Guided Attention Multimodal Multitask Financial Forecasting with Inter-Company Relationships and Global and Local News. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, Dublin, Ireland.","DOI":"10.18653\/v1\/2022.acl-long.437"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Jain, P., Kumar, P., and Chakrabarti, S. (2018, January 15\u201320). Type-sensitive knowledge base inference without explicit type supervision. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, Melbourne, Australia.","DOI":"10.18653\/v1\/P18-2013"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Lu, Y., and Ichise, R. (2021, January 7\u20138). Unsupervised Type Constraint Inference in Bilinear Knowledge Graph Completion Models. Proceedings of the 2021 IEEE International Conference on Big Knowledge, Auckland, New Zealand.","DOI":"10.1109\/ICKG52313.2021.00012"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1007\/BF02289464","article-title":"Some mathematical notes on three-mode factor analysis","volume":"31","author":"Tucker","year":"1966","journal-title":"Psychometrika"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1002\/sapm192761164","article-title":"The expression of a tensor or a polyadic as a sum of products","volume":"6","author":"Hitchcock","year":"1927","journal-title":"J. Math. Phys."},{"key":"ref_29","unstructured":"Mikolov, T., Sutskever, I., Chen, K., Corrado, G., and Dean, J. (2013, January 5\u201310). Distributed Representations of Words and Phrases and Their Compositionality. Proceedings of the 26th International Conference on Neural Information Processing Systems, Red Hook, NY, USA."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Pennington, J., Socher, R., and Manning, C.D. (2014, January 25\u201329). GloVe: Global Vectors for Word Representation. Proceedings of the 2014 Empirical Methods in Natural Language Processing, Doha, Qatar.","DOI":"10.3115\/v1\/D14-1162"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Che, F., Zhang, D., Tao, J., Niu, M., and Zhao, B. (2020, January 7\u201314). ParamE: Regarding Neural Network Parameters as Relation Embeddings for Knowledge Graph Completion. Proceedings of the AAAI Conference on Artificial Intelligence, Washington, DC, USA.","DOI":"10.1609\/aaai.v34i03.5665"},{"key":"ref_32","unstructured":"Hayashi, K., and Shimbo, M. (August, January 30). On the Equivalence of Holographic and Complex Embeddings for Link Prediction. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, Vancouver, Canada."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Bollacker, K., Evans, C., Paritosh, P., Sturge, T., and Taylor, J. (2008, January 9\u201312). Freebase: A Collaboratively Created Graph Database for Structuring Human Knowledge. Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, New York, NY, USA.","DOI":"10.1145\/1376616.1376746"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Suchanek, F.M., Kasneci, G., and Weikum, G. (2007, January 8\u201312). Yago: A Core of Semantic Knowledge. Proceedings of the 16th International Conference on World Wide Web, New York, NY, USA.","DOI":"10.1145\/1242572.1242667"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1145\/219717.219748","article-title":"WordNet: A Lexical Database for English","volume":"38","author":"Miller","year":"1995","journal-title":"ACM Commun."},{"key":"ref_36","unstructured":"Glorot, X., and Bengio, Y. (2010, January 13\u201315). Understanding the difficulty of training deep feedforward neural networks. Proceedings of the 13th International Conference on Artificial Intelligence and Statistics, Sardinia, Italy."},{"key":"ref_37","unstructured":"Kingma, D.P., and Ba, J. (2015, January 7\u20139). Adam: A Method for Stochastic Optimization. Proceedings of the International Conference on Learning Representations, San Diego, CA, USA."},{"key":"ref_38","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"Hinton","year":"2008","journal-title":"J. Mach. Learn. Res."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/13\/8\/354\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:56:20Z","timestamp":1760140580000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/13\/8\/354"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,25]]},"references-count":38,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["info13080354"],"URL":"https:\/\/doi.org\/10.3390\/info13080354","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,25]]}}}