{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,5]],"date-time":"2025-11-05T14:02:13Z","timestamp":1762351333303,"version":"build-2065373602"},"reference-count":54,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2022,2,14]],"date-time":"2022-02-14T00:00:00Z","timestamp":1644796800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61603309"],"award-info":[{"award-number":["61603309"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Heterogeneous information network (HIN) embedding is an important tool for tasks such as node classification, community detection, and recommendation. It aims to find the representations of nodes that preserve the proximity between entities of different nature. A family of approaches that are widely adopted applies random walk to generate a sequence of heterogeneous contexts, from which, the embedding is learned. However, due to the multipartite graph structure of HIN, hub nodes tend to be over-represented to their context in the sampled sequence, giving rise to imbalanced samples of the network. Here, we propose a new embedding method: CoarSAS2hvec. The self-avoiding short sequence sampling with the HIN coarsening procedure (CoarSAS) is utilized to better collect the rich information in HIN. An optimized loss function is used to improve the performance of the HIN structure embedding. CoarSAS2hvec outperforms nine other methods in node classification and community detection on four real-world data sets. Using entropy as a measure of the amount of information, we confirm that CoarSAS catches richer information of the network compared with that through other methods. Hence, the traditional loss function applied to samples by CoarSAS can also yield improved results. Our work addresses a limitation of the random-walk-based HIN embedding that has not been emphasized before, which can shed light on a range of problems in HIN analyses.<\/jats:p>","DOI":"10.3390\/e24020276","type":"journal-article","created":{"date-parts":[[2022,2,14]],"date-time":"2022-02-14T20:26:42Z","timestamp":1644870402000},"page":"276","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["CoarSAS2hvec: Heterogeneous Information Network Embedding with Balanced Network Sampling"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9293-721X","authenticated-orcid":false,"given":"Ling","family":"Zhan","sequence":"first","affiliation":[{"name":"College of Computer and Information Science, Southwest University, Chongqing 400715, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2337-2857","authenticated-orcid":false,"given":"Tao","family":"Jia","sequence":"additional","affiliation":[{"name":"College of Computer and Information Science, Southwest University, Chongqing 400715, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,14]]},"reference":[{"key":"ref_1","first-page":"1548","article-title":"Graph Regularized Nonnegative Mmatrix Factorization for Data Representation","volume":"33","author":"Cai","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_2","unstructured":"Zhao, Y., Liu, Z., and Sun, M. (2015, January 25\u201331). Representation Learning for Measuring Entity Relatedness with Rich Information. Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, Buenos Aires, Argentina."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Bourigault, S., Lamprier, S., and Gallinari, P. (2016, January 22\u201325). Representation Learning for Information Diffusion through Social Networks: An Embedded Cascade Model. Proceedings of the Ninth ACM International Conference on Web Search and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2835776.2835817"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Xie, W., Wang, X., and Jia, T. (2021). Independent Asymmetric Embedding Model for Cascade Prediction on Social Network. arXiv.","DOI":"10.1109\/CSCWD54268.2022.9776071"},{"key":"ref_5","unstructured":"Kipf, T.N., and Welling, M. (2017, January 24\u201326). Semi-Supervised Classification with Graph Convolutional Networks. Proceedings of the 5th International Conference on Learning Representations, ICLR 2017, Toulon, France."},{"key":"ref_6","unstructured":"Hamilton, W.L., Ying, Z., and Leskovec, J. (2017, January 4\u20139). Inductive Representation Learning on Large Graphs. Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, Long Beach, CA, USA."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"833","DOI":"10.1109\/TKDE.2018.2849727","article-title":"A Survey on Network Embedding","volume":"31","author":"Cui","year":"2019","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Perozzi, B., Al-Rfou, R., and Skiena, S. (2014, January 24\u201327). DeepWalk: Online Learning of Social Representations. Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY, USA. KDD \u201914.","DOI":"10.1145\/2623330.2623732"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Grover, A., and Leskovec, J. (2016, January 13\u201317). Node2vec: Scalable Feature Learning for Networks. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA. KDD \u201916.","DOI":"10.1145\/2939672.2939754"},{"key":"ref_10","unstructured":"Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013, January 2\u20134). Efficient Estimation of Word Representations in Vector Space. Proceedings of the 1st International Conference on Learning Representations, ICLR 2013, Scottsdale, AZ, USA."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Tang, J., Qu, M., and Mei, Q. (2015, January 10\u201313). PTE: Predictive Text Embedding through Large-Scale Heterogeneous Text Networks. Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Sydney, NSW, Australia. KDD \u201915.","DOI":"10.1145\/2783258.2783307"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Chang, S., Han, W., Tang, J., Qi, G.J., Aggarwal, C.C., and Huang, T.S. (2015, January 10\u201313). Heterogeneous Network Embedding via Deep Architectures. Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Sydney, Australia.","DOI":"10.1145\/2783258.2783296"},{"key":"ref_13","unstructured":"Yang, C., Xiao, Y., Zhang, Y., Sun, Y., and Han, J. (2020). Heterogeneous Network Representation Learning: A Unified Framework with Survey and Benchmark. IEEE Trans. Knowl. Data Eng."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1145\/2481244.2481248","article-title":"Mining heterogeneous information networks: A structural analysis approach","volume":"14","author":"Sun","year":"2012","journal-title":"SIGKDD Explor."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Dong, Y., Chawla, N.V., and Swami, A. (2017, January 13\u201317). Metapath2vec: Scalable Representation Learning for Heterogeneous Networks. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada.","DOI":"10.1145\/3097983.3098036"},{"key":"ref_16","first-page":"5337","article-title":"Hyperbolic Heterogeneous Information Network Embedding","volume":"33","author":"Wang","year":"2019","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Sun, Y., and Han, J. (2012). Mining Heterogeneous Information Networks: Principles and Methodologies, Morgan & Claypool Publishers. Synthesis Lectures on Data Mining and Knowledge Discovery.","DOI":"10.1007\/978-3-031-01902-9"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wang, X., Ji, H., Shi, C., Wang, B., Ye, Y., Cui, P., and Yu, P.S. (2019, January 13\u201317). Heterogeneous Graph Attention Network. Proceedings of the World Wide Web Conference, San Francisco, CA, USA.","DOI":"10.1145\/3308558.3313562"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Yang, Y., and Cui, X. (2021). Bert-Enhanced Text Graph Neural Network for Classification. Entropy, 23.","DOI":"10.3390\/e23111536"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Cen, Y., Zou, X., Zhang, J., Yang, H., Zhou, J., and Tang, J. (2019, January 4\u20138). Representation Learning for Attributed Multiplex Heterogeneous Network. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Anchorage, AK, USA.","DOI":"10.1145\/3292500.3330964"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhang, C., Song, D., Huang, C., Swami, A., and Chawla, N.V. (2019, January 4\u20138). Heterogeneous Graph Neural Network. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Anchorage, AK, USA.","DOI":"10.1145\/3292500.3330961"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Fu, T.y., Lee, W.C., and Lei, Z. (2017, January 6\u201310). HIN2Vec: Explore Meta-Paths in Heterogeneous Information Networks for Representation Learning. Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, Singapore.","DOI":"10.1145\/3132847.3132953"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Madhawa, K., and Murata, T. (2020). Active Learning for Node Classification: An Evaluation. Entropy, 22.","DOI":"10.3390\/e22101164"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Choong, J.J., Liu, X., and Murata, T. (2020). Optimizing Variational Graph Autoencoder for Community Detection with Dual Optimization. Entropy, 22.","DOI":"10.3390\/e22020197"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Tang, J., Qu, M., Wang, M., Zhang, M., Yan, J., and Mei, Q. (2015, January 18\u201322). LINE: Large-Scale Information Network Embedding. Proceedings of the 24th International Conference on World Wide Web, Florence, Italy.","DOI":"10.1145\/2736277.2741093"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Xu, L., Wei, X., Cao, J., and Yu, P.S. (2017, January 6\u201310). Embedding of Embedding (EOE): Joint Embedding for Coupled Heterogeneous Networks. Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, Cambridge, UK.","DOI":"10.1145\/3018661.3018723"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Chen, H., Yin, H., Wang, W., Wang, H., Nguyen, Q.V.H., and Li, X. (2018, January 19\u201323). PME: Projected Metric Embedding on Heterogeneous Networks for Link Prediction. Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, London, UK.","DOI":"10.1145\/3219819.3219986"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Hu, B., Fang, Y., and Shi, C. (2019, January 4\u20138). Adversarial Learning on Heterogeneous Information Networks. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Anchorage, AK, USA.","DOI":"10.1145\/3292500.3330970"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1109\/TKDE.2020.2982898","article-title":"RHINE: Relation Structure-Aware Heterogeneous Information Network Embedding","volume":"34","author":"Shi","year":"2022","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_30","unstructured":"Bessiere, C. (2021, January 7\u201315). Network Schema Preserving Heterogeneous Information Network Embedding. Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, Yokohama, Japan."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"992","DOI":"10.14778\/3402707.3402736","article-title":"Pathsim: Meta path-based top-k similarity search in heterogeneous information networks","volume":"4","author":"Sun","year":"2011","journal-title":"Proc. VLDB Endow."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"He, Y., Song, Y., Li, J., Ji, C., Peng, J., and Peng, H. (2019, January 3\u20137). HeteSpaceyWalk: A Heterogeneous Spacey Random Walk for Heterogeneous Information Network Embedding. Proceedings of the 28th ACM International Conference on Information and Knowledge Management, Beijing, China.","DOI":"10.1145\/3357384.3358061"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Hussein, R., Yang, D., and Cudr\u00e9-Mauroux, P. (2018, January 22\u201326). Are Meta-Paths Necessary? Revisiting Heterogeneous Graph Embeddings. Proceedings of the 27th ACM International Conference on Information and Knowledge Management, Torino, Italy.","DOI":"10.1145\/3269206.3271777"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Lee, S., Park, C., and Yu, H. (2019, January 3\u20137). BHIN2vec: Balancing the Type of Relation in Heterogeneous Information Network. Proceedings of the 28th ACM International Conference on Information and Knowledge Management, Beijing, China.","DOI":"10.1145\/3357384.3357893"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Jiang, J.Y., Li, Z., Ju, C.J.T., and Wang, W. (2020, January 19\u201323). MARU: Meta-Context Aware Random Walks for Heterogeneous Network Representation Learning. Proceedings of the 29th ACM International Conference on Information and Knowledge Management, Virtual Event, Ireland.","DOI":"10.1145\/3340531.3412040"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1016\/j.future.2019.05.033","article-title":"Degree-biased random walk for large-scale network embedding","volume":"100","author":"Zhang","year":"2019","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Hung, P.T., and Yamanishi, K. (2021). Word2vec Skip-Gram Dimensionality Selection via Sequential Normalized Maximum Likelihood. Entropy, 23.","DOI":"10.3390\/e23080997"},{"key":"ref_38","unstructured":"Kingma, D.P., and Ba, J. (2015, January 7\u20139). Adam: A Method for Stochastic Optimization. Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"2479","DOI":"10.1109\/TKDE.2013.2297920","article-title":"HeteSim: A General Framework for Relevance Measure in Heterogeneous Networks","volume":"26","author":"Shi","year":"2014","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Ji, M., Sun, Y., Danilevsky, M., Han, J., and Gao, J. (2010). Graph Regularized Transductive Classification on Heterogeneous Information Networks. Machine Learning and Knowledge Discovery in Databases, Springer Berlin Heidelberg.","DOI":"10.1007\/978-3-642-15880-3_42"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Tang, J., Zhang, J., Yao, L., Li, J., Zhang, L., and Su, Z. (2008, January 24\u201327). ArnetMiner: Extraction and Mining of Academic Social Networks. Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Las Vegas, NV, USA.","DOI":"10.1145\/1401890.1402008"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Bollacker, K., Evans, C., Paritosh, P., Sturge, T., and Taylor, J. (2008, January 9\u201312). Freebase: A Collaboratively Created Graph Database for Structuring Human Knowledge. Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, Vancouver, BC, Canada.","DOI":"10.1145\/1376616.1376746"},{"key":"ref_43","unstructured":"Veli\u010dkovi\u0107, P., Cucurull, G., Casanova, A., Romero, A., Li\u00f2, P., and Bengio, Y. (May, January 30). Graph Attention Networks. Proceedings of the 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada."},{"key":"ref_44","unstructured":"Veli\u010dkovi\u0107, P., Fedus, W., Hamilton, W.L., Li\u00f2, P., Bengio, Y., and Hjelm, R.D. (2019, January 6\u20139). Deep Graph Infomax. Proceedings of the International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA."},{"key":"ref_45","first-page":"37","article-title":"Evaluation: From precision, recall and f-measure to roc., informedness, markedness & correlation","volume":"2","author":"Powers","year":"2011","journal-title":"J. Mach. Learn. Technol."},{"key":"ref_46","unstructured":"McDaid, A.F., Greene, D., and Hurley, N. (2011). Normalized mutual information to evaluate overlapping community finding algorithms. arXiv."},{"key":"ref_47","unstructured":"R\u00e9nyi, A. (1960, January 20\u201330). On Measures of Entropy and Information. Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, Volume 1: Contributions to the Theory of Statistics, Davis, CA, USA."},{"key":"ref_48","unstructured":"Vajapeyam, S. (2014). Understanding shannon\u2019s entropy metric for information. arXiv."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Zhang, J., Zhao, C., Wu, H., Lin, M., and Duan, R. (2018). Virtual Network Embedding Based on Graph Entropy. Entropy, 20.","DOI":"10.3390\/e20050315"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Jia, T., Wang, D., and Szymanski, B.K. (2017). Quantifying patterns of research-interest evolution. Nat. Hum. Behav., 1.","DOI":"10.1038\/s41562-017-0078"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"eabb9004","DOI":"10.1126\/sciadv.abb9004","article-title":"Neural embeddings of scholarly periodicals reveal complex disciplinary organizations","volume":"7","author":"Peng","year":"2021","journal-title":"Sci. Adv."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Tan, Y., Wang, X., and Jia, T. (2020). From syntactic structure to semantic relationship: Hypernym extraction from definitions by recurrent neural networks using the part of speech information. The Semantic Web\u2014ISWC 2020, Springer International Publishing.","DOI":"10.1007\/978-3-030-62419-4_30"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Chen, S., Zhang, Z., Mo, C., Wu, Q., Kochunov, P.V., and Hong, L.E. (2020). Characterizing the Complexity of Weighted Networks via Graph Embedding and Point Pattern Analysis. Entropy, 22.","DOI":"10.3390\/e22090925"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Wang, Y., Wang, X., Michalski, R., Ran, Y., and Jia, T. (2021). CasSeqGCN: Combining Network Structure and Temporal Sequence to Predict Information Cascades. arXiv.","DOI":"10.2139\/ssrn.4055231"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/2\/276\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:19:24Z","timestamp":1760134764000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/2\/276"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,14]]},"references-count":54,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["e24020276"],"URL":"https:\/\/doi.org\/10.3390\/e24020276","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2022,2,14]]}}}