{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,14]],"date-time":"2026-07-14T17:26:06Z","timestamp":1784049966573,"version":"3.55.0"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,10,4]],"date-time":"2023-10-04T00:00:00Z","timestamp":1696377600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,10,4]],"date-time":"2023-10-04T00:00:00Z","timestamp":1696377600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["11864005"],"award-info":[{"award-number":["11864005"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Basic Ability Promotion Project for Yong Teachers in Guangxi","award":["2023KY0017"],"award-info":[{"award-number":["2023KY0017"]}]},{"DOI":"10.13039\/501100018571","name":"Specific Research Project of Guangxi for Research Bases and Talents","doi-asserted-by":"publisher","award":["AD23026105"],"award-info":[{"award-number":["AD23026105"]}],"id":[{"id":"10.13039\/501100018571","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Comput Intell Syst"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Graph convolutional network (GCN) is an effective tool for feature clustering. However, in the text classification task, the traditional TextGCN (GCN for Text Classification) ignores the context word order of the text. In addition, TextGCN constructs the text graph only according to the context relationship, so it is difficult for the word nodes to learn an effective semantic representation. Based on this, this paper proposes a text classification method that combines Transformer and GCN. To improve the semantic accuracy of word node features, we add a part of speech (POS) to the word-document graph and build edges between words based on POS. In the layer-to-layer of GCN, the Transformer is used to extract the contextual and sequential information of the text. We conducted the experiment on five representative datasets. The results show that our method can effectively improve the accuracy of text classification and is better than the comparison method.<\/jats:p>","DOI":"10.1007\/s44196-023-00337-z","type":"journal-article","created":{"date-parts":[[2023,10,4]],"date-time":"2023-10-04T11:01:44Z","timestamp":1696417304000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Transformer and Graph Convolutional Network for Text Classification"],"prefix":"10.1007","volume":"16","author":[{"given":"Boting","family":"Liu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weili","family":"Guan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Changjin","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhijie","family":"Fang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhiheng","family":"Lu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,10,4]]},"reference":[{"issue":"4","key":"337_CR1","doi-asserted-by":"publisher","first-page":"150","DOI":"10.3390\/info10040150","volume":"10","author":"K Kowsari","year":"2019","unstructured":"Kowsari, K., JafariMeimandi, K., Heidarysafa, M., et al.: Text classification algorithms: a survey. Information 10(4), 150 (2019)","journal-title":"Information"},{"key":"337_CR2","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1016\/j.eswa.2018.03.058","volume":"106","author":"MM Miro\u0144czuk","year":"2018","unstructured":"Miro\u0144czuk, M.M., Protasiewicz, J.: A recent overview of the state-of-the-art elements of text classification. Expert Syst. Appl. 106, 36\u201354 (2018)","journal-title":"Expert Syst. Appl."},{"key":"337_CR3","doi-asserted-by":"publisher","first-page":"290","DOI":"10.1007\/s11633-015-0912-z","volume":"15","author":"M Goudjil","year":"2018","unstructured":"Goudjil, M., Koudil, M., Bedda, M., et al.: A novel active learning method using SVM for text classification. Int. J. Autom. Comput. 15, 290\u2013298 (2018)","journal-title":"Int. J. Autom. Comput."},{"key":"337_CR4","doi-asserted-by":"publisher","first-page":"1356","DOI":"10.1016\/j.proeng.2014.03.129","volume":"69","author":"B Trstenjak","year":"2014","unstructured":"Trstenjak, B., Mikac, S., Donko, D.: KNN with TF-IDF based framework for text categorization. Procedia Eng. 69, 1356\u20131364 (2014)","journal-title":"Procedia Eng."},{"key":"337_CR5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s41133-020-00032-0","volume":"5","author":"K Shah","year":"2020","unstructured":"Shah, K., Patel, H., Sanghvi, D., et al.: A comparative analysis of logistic regression, random forest and KNN models for the text classification. Augment. Hum. Res. 5, 1\u201316 (2020)","journal-title":"Augment. Hum. Res."},{"key":"337_CR6","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1007\/978-3-319-53817-4_4","volume":"26","author":"Y Li","year":"2018","unstructured":"Li, Y., Yang, T.: Word embedding for understanding natural language: a survey. Guide Big Data Appl. 26, 83\u2013104 (2018)","journal-title":"Guide Big Data Appl."},{"key":"337_CR7","doi-asserted-by":"crossref","unstructured":"Vieira, J.P.A., Moura, R.S., An analysis of convolutional neural networks for sentence classification. In: XLIII Latin American computer conference (CLEI), vol. 2017. IEEE, pp 1\u20135 (2017)","DOI":"10.1109\/CLEI.2017.8226381"},{"key":"337_CR8","unstructured":"Liu, P., Qiu, X., Huang, X.: Recurrent neural network for text classification with multi-task learning. arXiv preprint arXiv:1605.05101 (2016)"},{"key":"337_CR9","first-page":"5988","volume":"30","author":"A Vaswani","year":"2017","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., et al.: Attention is all you need. Adv. Neural Inf. Process. Syst. 30, 5988\u20135999 (2017)","journal-title":"Adv. Neural Inf. Process. Syst."},{"issue":"01","key":"337_CR10","first-page":"7370","volume":"33","author":"L Yao","year":"2019","unstructured":"Yao, L., Mao, C., Luo, Y.: Graph convolutional networks for text classification. Proc. AAAI Conf. Artif. Intell. 33(01), 7370\u20137377 (2019)","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"337_CR11","doi-asserted-by":"crossref","unstructured":"Malekzadeh, M., Hajibabaee, P., Heidari, M., Review of graph neural network in text classification. In: IEEE 12th Annual Ubiquitous Computing, Electronics and Mobile Communication Conference (UEMCON), 2021, pp, 0084\u20130091. IEEE (2021)","DOI":"10.1109\/UEMCON53757.2021.9666633"},{"key":"337_CR12","doi-asserted-by":"crossref","unstructured":"Huang, L., Ma, D., Li, S., et al.: Text level graph neural network for text classification. arXiv preprint arXiv:1910.02356 (2019)","DOI":"10.18653\/v1\/D19-1345"},{"issue":"05","key":"337_CR13","first-page":"8409","volume":"34","author":"X Liu","year":"2020","unstructured":"Liu, X., You, X., Zhang, X., et al.: Tensor graph convolutional networks for text classification. Proc. AAAI Conf. Artif. Intell. 34(05), 8409\u20138416 (2020)","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"337_CR14","doi-asserted-by":"crossref","unstructured":"Xue, B., Zhu, C., Wang, X., et al.: The study on the text classification based on graph convolutional network and BiLSTM. In: Proceedings of the 8th International Conference on Computing and Artificial Intelligence, ACM, pp. 323\u2013331(2022)","DOI":"10.1145\/3532213.3532261"},{"key":"337_CR15","doi-asserted-by":"crossref","unstructured":"Fellbaum, C.: WordNet, Theory and Applications of Ontology: Computer Applications, pp. 231\u2013243. Springer, Dordrecht (2010)","DOI":"10.1007\/978-90-481-8847-5_10"},{"key":"337_CR16","doi-asserted-by":"crossref","unstructured":"Dong, Y., Yang, Z., Cao, H.: A text classification model based on GCN and BiGRU fusion. In: Proceedings of the 8th International Conference on Computing and Artificial Intelligence, ACM, pp. 318\u2013322 (2022)","DOI":"10.1145\/3532213.3532260"},{"issue":"1","key":"337_CR17","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1017\/S1351324916000334","volume":"23","author":"KW Church","year":"2017","unstructured":"Church, K.W.: Word2Vec. Nat. Lang. Eng. 23(1), 155\u2013162 (2017)","journal-title":"Nat. Lang. Eng."},{"key":"337_CR18","doi-asserted-by":"crossref","unstructured":"Fang, F., Hu, X., Shu, J., et al.: Text classification model based on multi-head self-attention mechanism and BiGRU. In: 2021 IEEE Conference on Telecommunications, Optics and Computer Science (TOCS), pp. 357\u2013361. IEEE (2021)","DOI":"10.1109\/TOCS53301.2021.9688981"},{"key":"337_CR19","unstructured":"Devlin, J., Chang, M.W., Lee, K., et al.: Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)"},{"key":"337_CR20","unstructured":"Ye, Z., Jiang, G., Liu, Y., et al.: Document and word representations generated by graph convolutional network and bert for short text classification. In: ECAI 2020, IOS Press, pp. 2275\u20132281 (2020)"},{"issue":"6","key":"337_CR21","doi-asserted-by":"publisher","first-page":"3099","DOI":"10.1007\/s11280-020-00823-w","volume":"23","author":"J Huang","year":"2020","unstructured":"Huang, J., Peng, M., Li, P., et al.: Improving biterm topic model with word embeddings. World Wide Web 23(6), 3099\u20133124 (2020)","journal-title":"World Wide Web"},{"key":"337_CR22","doi-asserted-by":"crossref","unstructured":"Lin, Y., Meng, Y., Sun, X., et al.: Bertgcn: transductive text classification by combining gcn and bert. arXiv preprint arXiv:2105.05727 (2021)","DOI":"10.18653\/v1\/2021.findings-acl.126"},{"key":"337_CR23","doi-asserted-by":"crossref","unstructured":"Wang, K., Han, S.C., Poon, J.: InducT-GCN: inductive graph convolutional networks for text classification. In: 2022 26th International Conference on Pattern Recognition (ICPR), pp. 1243\u20131249. IEEE (2022)","DOI":"10.1109\/ICPR56361.2022.9956075"},{"key":"337_CR24","volume-title":"Natural Language Processing with Python","author":"S Bird","year":"2009","unstructured":"Bird, S., Edward, L., et al.: Natural Language Processing with Python. O\u2019Reilly Media Inc, Sebastopol (2009)"},{"key":"337_CR25","first-page":"31","volume":"30","author":"G Bouma","year":"2009","unstructured":"Bouma, G.: Normalized (pointwise) mutual information in collocation extraction. Proc. GSCL 30, 31\u201340 (2009)","journal-title":"Proc. GSCL"},{"issue":"1","key":"337_CR26","first-page":"29","volume":"242","author":"J Ramos","year":"2003","unstructured":"Ramos, J.: Using tf-idf to determine word relevance in document queries. Proc. First Instr. Conf. Mach. Learn. 242(1), 29\u201348 (2003)","journal-title":"Proc. First Instr. Conf. Mach. Learn."},{"key":"337_CR27","unstructured":"Misra, D.M.: A self regularized non-monotonic activation function. arXiv preprint arXiv:1908.08681 (2019)"},{"key":"337_CR28","doi-asserted-by":"crossref","unstructured":"Soyalp, G., Alar, A., Ozkanli, K., et al.: Improving Text Classification with Transformer. In: 2021 6th International Conference on Computer Science and Engineering (UBMK), pp. 707\u2013712. IEEE (2021)","DOI":"10.1109\/UBMK52708.2021.9558906"},{"issue":"1","key":"337_CR29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40649-019-0069-y","volume":"6","author":"S Zhang","year":"2019","unstructured":"Zhang, S., Tong, H., Xu, J., et al.: Graph convolutional networks: a comprehensive review. Comput. Soc. Netw. 6(1), 1\u201323 (2019)","journal-title":"Comput. Soc. Netw."},{"key":"337_CR30","doi-asserted-by":"publisher","first-page":"19854","DOI":"10.1109\/ACCESS.2021.3054521","volume":"9","author":"Y Feng","year":"2021","unstructured":"Feng, Y., Cheng, Y.: Short text sentiment analysis based on multi-channel CNN with multi-head attention mechanism. IEEE Access 9, 19854\u201319863 (2021)","journal-title":"IEEE Access"},{"key":"337_CR31","doi-asserted-by":"crossref","unstructured":"Joulin, A., Grave, E., Bojanowski, P., et al.: Bag of tricks for efficient text classification. arXiv preprint arXiv:1607.01759 (2016)","DOI":"10.18653\/v1\/E17-2068"},{"key":"337_CR32","doi-asserted-by":"crossref","unstructured":"Pennington, J., Socher, R., Manning, C.D.: Glove: global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), ACL, pp. 1532\u20131543 (2014)","DOI":"10.3115\/v1\/D14-1162"},{"issue":"11","key":"337_CR33","first-page":"2579","volume":"9","author":"L Van der Maaten","year":"2018","unstructured":"Van der Maaten, L., Hinton, G.: Visualizing high-dimensional data using t-SNE. J. Mach. Learn. Res. 9(11), 2579\u20132605 (2018)","journal-title":"J. Mach. Learn. Res."}],"container-title":["International Journal of Computational Intelligence Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44196-023-00337-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s44196-023-00337-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44196-023-00337-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,20]],"date-time":"2023-11-20T17:03:45Z","timestamp":1700499825000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s44196-023-00337-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,4]]},"references-count":33,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["337"],"URL":"https:\/\/doi.org\/10.1007\/s44196-023-00337-z","relation":{},"ISSN":["1875-6883"],"issn-type":[{"value":"1875-6883","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,4]]},"assertion":[{"value":"27 February 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 September 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 October 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}}],"article-number":"161"}}