{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:48:08Z","timestamp":1760244488229,"version":"build-2065373602"},"reference-count":43,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,12,23]],"date-time":"2022-12-23T00:00:00Z","timestamp":1671753600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"Nature Science Foundation of China","doi-asserted-by":"publisher","award":["61977010","62006210"],"award-info":[{"award-number":["61977010","62006210"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>To alleviate the impact of insufficient labels in less-labeled classification problems, self-supervised learning improves the performance of graph neural networks (GNNs) by focusing on the information of unlabeled nodes. However, none of the existing self-supervised pretext tasks perform optimally on different datasets, and the choice of hyperparameters is also included when combining self-supervised and supervised tasks. To select the best-performing self-supervised pretext task for each dataset and optimize the hyperparameters with no expert experience needed, we propose a novel auto graph self-supervised learning framework and enhance this framework with a one-shot active learning method. Experimental results on three real world citation datasets show that training GNNs with automatically optimized pretext tasks can achieve or even surpass the classification accuracy obtained with manually designed pretext tasks. On this basis, compared with using randomly selected labeled nodes, using actively selected labeled nodes can further improve the classification performance of GNNs. Both the active selection and the automatic optimization contribute to semi-supervised node classification.<\/jats:p>","DOI":"10.3390\/e25010030","type":"journal-article","created":{"date-parts":[[2022,12,27]],"date-time":"2022-12-27T04:40:39Z","timestamp":1672116039000},"page":"30","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Self-Supervised Node Classification with Strategy and Actively Selected Labeled Set"],"prefix":"10.3390","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5950-2887","authenticated-orcid":false,"given":"Yi","family":"Kang","sequence":"first","affiliation":[{"name":"School of Artificial Intelligence, Beijing Normal University, No. 19 Xinjiekouwai Street, Haidian District, Beijing 100875, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ke","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Beijing Normal University, No. 19 Xinjiekouwai Street, Haidian District, Beijing 100875, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhiyuan","family":"Cao","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Beijing Normal University, No. 19 Xinjiekouwai Street, Haidian District, Beijing 100875, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiacai","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Beijing Normal University, No. 19 Xinjiekouwai Street, Haidian District, Beijing 100875, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/TNNLS.2020.2978386","article-title":"A comprehensive survey on graph neural networks","volume":"32","author":"Wu","year":"2020","journal-title":"IEEE Trans. Neural Networks Learn. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s42979-021-00815-1","article-title":"Deep Learning: A Comprehensive Overview on Techniques, Taxonomy, Applications and Research Directions","volume":"2","author":"Sarker","year":"2021","journal-title":"SN Comput. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1616","DOI":"10.1109\/TKDE.2018.2807452","article-title":"A comprehensive survey of graph embedding: Problems, techniques, and applications","volume":"30","author":"Cai","year":"2018","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_4","unstructured":"Kipf, T.N., and Welling, M. (2017, January 24\u201326). Semi-Supervised Classification with Graph Convolutional Networks. Proceedings of the 5th International Conference on Learning Representations ICLR, Toulon, France."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Liu, Y., Jin, M., Pan, S., Zhou, C., Zheng, Y., Xia, F., and Yu, P. (2022). Graph self-supervised learning: A survey. IEEE Trans. Knowl. Data Eng.","DOI":"10.1109\/TKDE.2022.3172903"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Park, J., Lee, M., Chang, H.J., Lee, K., and Choi, J.Y. (November, January 27). Symmetric Graph Convolutional Autoencoder for Unsupervised Graph Representation Learning. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision, ICCV, Seoul, Republic of Korea.","DOI":"10.1109\/ICCV.2019.00662"},{"key":"ref_7","unstructured":"Jin, W., Derr, T., Liu, H., Wang, Y., Wang, S., Liu, Z., and Tang, J. (2020). Self-supervised learning on graphs: Deep insights and new direction. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Sun, K., Lin, Z., and Zhu, Z. (2020, January 7\u201312). Multi-stage self-supervised learning for graph convolutional networks on graphs with few labeled nodes. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i04.6048"},{"key":"ref_9","unstructured":"Velickovic, P., Fedus, W., Hamilton, W.L., Li\u00f2, P., Bengio, Y., and Hjelm, R.D. (2019, January 6\u20139). Deep Graph Infomax. Proceedings of the 7th International Conference on Learning Representations, ICLR, New Orleans, LA, USA."},{"key":"ref_10","unstructured":"Zhu, Y., Xu, Y., Yu, F., Liu, Q., Wu, S., and Wang, L. (2020, January 17). Deep Graph Contrastive Representation Learning. Proceedings of the ICML Workshop on Graph Representation Learning and Beyond, Online."},{"key":"ref_11","unstructured":"Hu, W., Liu, B., Gomes, J., Zitnik, M., Liang, P., Pande, V.S., and Leskovec, J. (2020, January 26\u201330). Strategies for Pre-training Graph Neural Networks. Proceedings of the 8th International Conference on Learning Representations, ICLR, Addis Ababa, Ethiopia."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Qiu, J., Chen, Q., Dong, Y., Zhang, J., Yang, H., Ding, M., Wang, K., and Tang, J. (2020, January 6\u201310). GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training. Proceedings of the KDD \u201920: The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Virtual Event.","DOI":"10.1145\/3394486.3403168"},{"key":"ref_13","unstructured":"Zhu, Q., Du, B., and Yan, P. (2020). Self-supervised training of graph convolutional networks. arXiv."},{"key":"ref_14","unstructured":"You, Y., Chen, T., Wang, Z., and Shen, Y. (2020, January 16\u201318). When does self-supervision help graph convolutional networks?. Proceedings of the International Conference on Machine Learning. PMLR, Cambridge, MA, USA."},{"key":"ref_15","unstructured":"Settles, B. (2009). Active Learning Literature Survey, University of Wisconsin-Madison Department of Computer Sciences. Technical Report TR-1648."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Hu, Z., Dong, Y., Wang, K., Chang, K., and Sun, Y. (2020, January 6\u201310). GPT-GNN: Generative Pre-Training of Graph Neural Networks. Proceedings of the KDD \u201920: The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Virtual Event.","DOI":"10.1145\/3394486.3403237"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.patrec.2021.04.021","article-title":"Graph-based neural network models with multiple self-supervised auxiliary tasks","volume":"148","author":"Manessi","year":"2021","journal-title":"Pattern Recognit. Lett."},{"key":"ref_18","unstructured":"Jin, W., Liu, X., Zhao, X., Ma, Y., Shah, N., and Tang, J. (2022, January 25\u201329). Automated Self-Supervised Learning for Graphs. Proceedings of the International Conference on Learning Representations, Virtual."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"106622","DOI":"10.1016\/j.knosys.2020.106622","article-title":"AutoML: A survey of the state-of-the-art","volume":"212","author":"He","year":"2021","journal-title":"Knowl.-Based Syst."},{"key":"ref_20","first-page":"281","article-title":"Random search for hyper-parameter optimization","volume":"13","author":"Bergstra","year":"2012","journal-title":"J. Mach. Learn. Res."},{"key":"ref_21","first-page":"1396","article-title":"A Practical Guide to Support Vector Classification","volume":"1","author":"Hsu","year":"2003","journal-title":"Bioinformatics"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Thornton, C., Hutter, F., Hoos, H.H., and Leyton-Brown, K. (2013, January 11\u201314). Auto-WEKA: Combined selection and hyperparameter optimization of classification algorithms. Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD, Chicago, IL, USA.","DOI":"10.1145\/2487575.2487629"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Stamoulis, D., Ding, R., Wang, D., Lymberopoulos, D., Priyantha, B., Liu, J., and Marculescu, D. (2019, January 16\u201320). Single-path nas: Designing hardware-efficient convnets in less than 4 hours. Proceedings of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases, W\u00fcrzburg, Germany.","DOI":"10.1007\/978-3-030-46147-8_29"},{"key":"ref_24","unstructured":"Zoph, B., and Le, Q.V. (2017, January 24\u201326). Neural Architecture Search with Reinforcement Learning. Proceedings of the 5th International Conference on Learning Representations, ICLR, Toulon, France."},{"key":"ref_25","unstructured":"Liu, H., Simonyan, K., and Yang, Y. (2019, January 6\u20139). DARTS: Differentiable Architecture Search. Proceedings of the 7th International Conference on Learning Representations, ICLR, Orleans, LA, USA."},{"key":"ref_26","unstructured":"Yao, Q., Wang, M., Chen, Y., Dai, W., Li, Y.F., Tu, W.W., Yang, Q., and Yu, Y. (2018). Taking human out of learning applications: A survey on automated machine learning. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Aggarwal, C.C., Kong, X., Gu, Q., Han, J., and Philip, S.Y. (2014). Active learning: A survey. Data Classification, Chapman and Hall\/CRC.","DOI":"10.1201\/b17320"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Settles, B., and Craven, M. (2008, January 25\u201327). An Analysis of Active Learning Strategies for Sequence Labeling Tasks. Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing, Honolulu, HI, USA.","DOI":"10.3115\/1613715.1613855"},{"key":"ref_29","unstructured":"Bilgic, M., Mihalkova, L., and Getoor, L. (2010, January 21\u201324). Active Learning for Networked Data. Proceedings of the 27th International Conference on Machine Learning (ICML-10), Haifa, Israel."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Lease, M., and Wallace, B.C. (2017, January 4\u20139). Active Discriminative Text Representation Learning. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.","DOI":"10.1609\/aaai.v31i1.10962"},{"key":"ref_31","unstructured":"Guo, Y., and Greiner, R. (2007, January 6\u201312). Optimistic active-learning using mutual information. Proceedings of the IJCAI, Hyderabad, India."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1007\/s10994-007-5019-5","article-title":"Active learning for logistic regression: An evaluation","volume":"68","author":"Schein","year":"2007","journal-title":"Mach. Learn."},{"key":"ref_33","unstructured":"Li, X., and Guo, Y. (2013, January 3\u20139). Active Learning with Multi-Label SVM Classification. Proceedings of the IJCAI 2013\u201423rd International Joint Conference on Artificial Intelligence, Beijing, China."},{"key":"ref_34","unstructured":"Cai, H., Zheng, V.W., and Chang, K.C. (2017). Active Learning for Graph Embedding. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Madhawa, K., and Murata, T. (2020). Active learning for node classification: An evaluation. Entropy, 22.","DOI":"10.3390\/e22101164"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Hao, Z., Lu, C., Huang, Z., Wang, H., Hu, Z., Liu, Q., Chen, E., and Lee, C. (2020, January 6\u201310). ASGN: An Active Semi-supervised Graph Neural Network for Molecular Property Prediction. Proceedings of the KDD \u201920: The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Virtual.","DOI":"10.1145\/3394486.3403117"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"3136","DOI":"10.1109\/TNNLS.2020.3009682","article-title":"Seal: Semisupervised adversarial active learning on attributed graphs","volume":"32","author":"Li","year":"2020","journal-title":"IEEE Trans. Neural Networks Learn. Syst."},{"key":"ref_38","unstructured":"Ahsan, R., and Zheleva, E. (2020, January 24). Effectiveness of Sampling Strategies for One-shot Active Learning from Relational Data. Proceedings of the 16th International Workshop on Mining and Learning with Graphs (MLG), San Diego, CA, USA."},{"key":"ref_39","first-page":"1","article-title":"Combining Self-supervised Learning and Active Learning for Disfluency Detection","volume":"21","author":"Wang","year":"2021","journal-title":"Trans. Asian -Low-Resour. Lang. Inf. Process."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Bengar, J.Z., van de Weijer, J., Twardowski, B., and Raducanu, B. (2021, January 10). Reducing Label Effort: Self-Supervised Meets Active Learning. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV) Workshops, Virtual.","DOI":"10.1109\/ICCVW54120.2021.00188"},{"key":"ref_41","first-page":"2539","article-title":"Weisfeiler-lehman graph kernels","volume":"12","author":"Shervashidze","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_42","unstructured":"Yang, Z., Cohen, W.W., and Salakhutdinov, R. (2016, January 19\u201324). Revisiting Semi-Supervised Learning with Graph Embeddings. Proceedings of the 33nd International Conference on Machine Learning, ICML, New York, NY, USA."},{"key":"ref_43","first-page":"2579","article-title":"Visualizing Data using t-SNE","volume":"9","author":"Laurens","year":"2008","journal-title":"J. Mach. Learn. Res."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/1\/30\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:49:48Z","timestamp":1760147388000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/1\/30"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,23]]},"references-count":43,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["e25010030"],"URL":"https:\/\/doi.org\/10.3390\/e25010030","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2022,12,23]]}}}