{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T06:57:44Z","timestamp":1760597864631,"version":"build-2065373602"},"reference-count":44,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2019,1,24]],"date-time":"2019-01-24T00:00:00Z","timestamp":1548288000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61632011, 61573231, 61432011, 61672331"],"award-info":[{"award-number":["61632011, 61573231, 61432011, 61672331"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>A large-scale and high-quality training dataset is an important guarantee to learn an ideal classifier for text sentiment classification. However, manually constructing such a training dataset with sentiment labels is a labor-intensive and time-consuming task. Therefore, based on the idea of effectively utilizing unlabeled samples, a synthetical framework that covers the whole process of semi-supervised learning from seed selection, iterative modification of the training text set, to the co-training strategy of the classifier is proposed in this paper for text sentiment classification. To provide an important basis for selecting the seed texts and modifying the training text set, three kinds of measures\u2014the cluster similarity degree of an unlabeled text, the cluster uncertainty degree of a pseudo-label text to a learner, and the reliability degree of a pseudo-label text to a learner\u2014are defined. With these measures, a seed selection method based on Random Swap clustering, a hybrid modification method of the training text set based on active learning and self-learning, and an alternately co-training strategy of the ensemble classifier of the Maximum Entropy and Support Vector Machine are proposed and combined into our framework. The experimental results on three Chinese datasets (COAE2014, COAE2015, and a Hotel review, respectively) and five English datasets (Books, DVD, Electronics, Kitchen, and MR, respectively) in the real world verify the effectiveness of the proposed framework.<\/jats:p>","DOI":"10.3390\/sym11020133","type":"journal-article","created":{"date-parts":[[2019,1,24]],"date-time":"2019-01-24T11:12:48Z","timestamp":1548328368000},"page":"133","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Cooperative Hybrid Semi-Supervised Learning for Text Sentiment Classification"],"prefix":"10.3390","volume":"11","author":[{"given":"Yang","family":"Li","sequence":"first","affiliation":[{"name":"School of Computer and Information Technology, Shanxi University, Taiyuan 030006, China"}]},{"given":"Ying","family":"Lv","sequence":"additional","affiliation":[{"name":"School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1553-2937","authenticated-orcid":false,"given":"Suge","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer and Information Technology, Shanxi University, Taiyuan 030006, China"},{"name":"Key Laboratory of Computational Intelligence and Chinese Information Processing of Ministry of Education, Shanxi University, Taiyuan 030006, China"}]},{"given":"Jiye","family":"Liang","sequence":"additional","affiliation":[{"name":"School of Computer and Information Technology, Shanxi University, Taiyuan 030006, China"},{"name":"Key Laboratory of Computational Intelligence and Chinese Information Processing of Ministry of Education, Shanxi University, Taiyuan 030006, China"}]},{"given":"Juanzi","family":"Li","sequence":"additional","affiliation":[{"name":"Computer Science Department, Tsinghua University, Beijing 100084, China"}]},{"given":"Xiaoli","family":"Li","sequence":"additional","affiliation":[{"name":"Institute for Infocomm Research, A*Star, Singapore 138632, Singapore"}]}],"member":"1968","published-online":{"date-parts":[[2019,1,24]]},"reference":[{"key":"ref_1","first-page":"1","article-title":"Sentiment analysis in multiple languages: feature selection for opinion classification in Web forums","volume":"26","author":"Abbasi","year":"2008","journal-title":"ACM Trans. Inf. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Pang, B., Lee, L., and Vaithyanathan, S. (2002, January 6\u20137). Thumbs up? Sentiment classification using machine learning techniques. Proceedings of the Empirical Methods in Natural Language Processing, Philadelphia, PA, USA.","DOI":"10.3115\/1118693.1118704"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Xia, R., Wang, C., Dai, X.Y., and Li, T. (2015, January 29\u201330). Co-training for semi-supervised sentiment classification based on dual-view bags-of-words representation. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Coference on National Language Proceeding, Nanchang, China.","DOI":"10.3115\/v1\/P15-1102"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1016\/j.eswa.2016.10.043","article-title":"Sentiment analysis leveraging emotions and word embeddings","volume":"69","author":"Giatsoglou","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_5","unstructured":"Wu, F., Huang, Y., and Yan, J. (August, January 30). Active sentiment domain adaptation. Proceedings of the Meeting of the Association for Computational Linguistics, Vancouver, BC, Canada."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.eswa.2016.03.031","article-title":"Unsupervised method for sentiment analysis in online texts","volume":"58","year":"2016","journal-title":"Expert Syst. Appl."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1016\/j.patrec.2016.12.009","article-title":"Lexicon based feature extraction for emotion text classification","volume":"93","author":"Bandhakavi","year":"2017","journal-title":"Pattern Recognit. Lett."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Colhon, M., Vl\u0103dutescu, \u015e., and Negrea, X. (2017). How objective a neutral word is? A neutrosophic approach for the objectivity degrees of neutral words. Symmetry, 9.","DOI":"10.3390\/sym9110280"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1016\/j.eswa.2016.11.022","article-title":"Company event popularity for financial markets using twitter and sentiment analysis","volume":"71","author":"Daniel","year":"2016","journal-title":"Expert Syst. Appl."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1016\/j.dss.2016.05.010","article-title":"Predicting wins and spread in the Premier League using a sentiment analysis of twitter","volume":"88","author":"Schumaker","year":"2016","journal-title":"Dicis. Support Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"9603","DOI":"10.1016\/j.eswa.2015.07.052","article-title":"Sentiment analysis on social media for stock movement prediction","volume":"42","author":"Nguyen","year":"2015","journal-title":"Expert Syst. Appl."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Kim, Y. (2014, January 25\u201329). Convolutional Neural Networks for sentence classification. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, Doha, Qatar.","DOI":"10.3115\/v1\/D14-1181"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.neucom.2016.02.077","article-title":"Sentiment analysis for Chinese microblog based on deep neural networks with convolutional extension features","volume":"210","author":"Sun","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.knosys.2018.04.006","article-title":"Sentiment classification with word localization based on weakly supervised learning with a convolutional neural network","volume":"152","author":"Lee","year":"2018","journal-title":"Knowl.-Based Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1109\/TKDE.2017.2756658","article-title":"Weakly-supervised deep embedding for product review sentiment analysis","volume":"30","author":"Wei","year":"2018","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_16","unstructured":"Zhou, Z.H., Zhan, D.C., and Yang, Q. (2007, January 22\u201323). Semi-supervised learning with very few labeled training examples. Proceedings of the Twenty-Second AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1007\/s10115-009-0209-z","article-title":"Semi-supervised learning by disagreement","volume":"24","author":"Zhou","year":"2010","journal-title":"Knowl. Inf. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2000","DOI":"10.1109\/TPAMI.2008.235","article-title":"SemiBoost: boosting for semi-supervised learning","volume":"31","author":"Mallapragada","year":"2009","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Qiu, L., Zhang, W., Hu, C., and Zhao, K. (2009, January 2\u20136). SELC: A self-supervised model for sentiment classification. Proceedings of the ACM Conference on Information and Knowledge Management, Hong Kong, China.","DOI":"10.1145\/1645953.1646072"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"606","DOI":"10.1016\/j.ipm.2010.11.003","article-title":"Self-training from labeled features for sentiment analysis","volume":"47","author":"He","year":"2011","journal-title":"Inf. Process. Manag."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.neucom.2012.01.030","article-title":"Approaching sentiment analysis by using semi-supervised learning of multi-dimensional classifiers","volume":"92","author":"Alzate","year":"2012","journal-title":"Neurocomputing"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1016\/j.ins.2015.04.003","article-title":"Combination of active learning and self-training for cross-lingual sentiment classification with density analysis of unlabelled samples","volume":"317","author":"Hajmohammadi","year":"2015","journal-title":"Inf. Sci."},{"key":"ref_23","first-page":"130","article-title":"Introduction to semi-supervised learning","volume":"3","author":"Zhu","year":"2009","journal-title":"Semi-Superv. Learn."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1016\/j.neucom.2014.05.055","article-title":"Adaptive multi-view selection for semi-supervised emotion recognition of posts in online student community","volume":"144","author":"Yang","year":"2014","journal-title":"Neurocomputing"},{"key":"ref_25","first-page":"127","article-title":"Active learning literature survey","volume":"39","author":"Settles","year":"2010","journal-title":"Univ. Wis."},{"key":"ref_26","unstructured":"Li, S., Xue, Y., Wang, Z., and Zhou, G. (2013, January 3\u201319). Active learning for cross-domain sentiment classification. Proceedings of the International Joint Conference on Artificial Intelligence, Beijing, China."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Tan, Z., Li, B., Huang, P., Ge, B., and Xiao, W. (2018). Neural relation classification using selective attention and symmetrical directional instances. Symmetry, 10.","DOI":"10.3390\/sym10090357"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Jiang, Z., Zhang, S., and Zeng, J. (2013). A Hybrid Generative\/Discriminative Method for Semi-Supervised Classification, Elsevier Science Publishers B. V.","DOI":"10.1016\/j.knosys.2012.07.020"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2372","DOI":"10.1016\/j.eswa.2013.09.035","article-title":"Semi-supervised learning combining co-training with active learning","volume":"41","author":"Zhang","year":"2014","journal-title":"Expert Syst. Appl."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.dss.2013.08.002","article-title":"Sentiment classification: The contribution of ensemble learning","volume":"57","author":"Wang","year":"2014","journal-title":"Decis. Support Syst."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1138","DOI":"10.1016\/j.ins.2010.11.023","article-title":"Ensemble of feature sets and classification algorithms for sentiment classification","volume":"181","author":"Xia","year":"2011","journal-title":"Inf. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/j.asoc.2016.11.022","article-title":"A sentiment classification model based on multiple classifiers","volume":"50","author":"Catal","year":"2017","journal-title":"Appl. Soft Comput."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1049","DOI":"10.1007\/s10579-013-9218-3","article-title":"Bootstrapping polarity classifiers with rule-based classification","volume":"47","author":"Wiegand","year":"2013","journal-title":"Lang. Resour. Eval."},{"key":"ref_34","first-page":"999","article-title":"Support vector machine active learning with applications to text classification","volume":"2","author":"Tong","year":"2002","journal-title":"J. Mach. Learn. Res."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"536","DOI":"10.1016\/j.neucom.2013.04.017","article-title":"Active deep learning method for semi-supervised sentiment classification","volume":"120","author":"Zhou","year":"2013","journal-title":"Neurocomputing"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1007\/s10115-012-0507-8","article-title":"A survey on instance selection for active learning","volume":"35","author":"Fu","year":"2013","journal-title":"Knowl. Inf. Syst."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1016\/j.ipm.2014.04.001","article-title":"Active learning for sentiment analysis on data streams: Methodology and workflow implementation in the ClowdFlows platform","volume":"51","author":"Kranjc","year":"2015","journal-title":"Inf. Process. Manag."},{"key":"ref_38","first-page":"530","article-title":"Semi-supervised learning for imbalanced sentiment classification","volume":"172","author":"Li","year":"2008","journal-title":"J. R. Stat. Soc."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1162\/COLI_a_00061","article-title":"Bilingual co-training for sentiment classification of chinese product reviews","volume":"37","author":"Wan","year":"2011","journal-title":"Comput. Linguist."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1186\/s40537-018-0122-y","article-title":"Efficiency of random swap clustering","volume":"5","year":"2018","journal-title":"J. Big Data"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"8696","DOI":"10.1016\/j.eswa.2011.01.077","article-title":"A feature selection method based on improved fisher\u2019s discriminant ratio for text sentiment classification","volume":"38","author":"Wang","year":"2011","journal-title":"Expert Syst. Appl."},{"key":"ref_42","unstructured":"Blitzer, J., Dredze, M., and Pereira, F. (2007, January 25\u201327). Biographies, bollywood, boom-boxes and blenders: Domain adaptation for sentiment classification. Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics, Prague, Czech Republic."},{"key":"ref_43","unstructured":"Wei, G., Li, S., Xue, Y., Meng, W., and Zhou, G. (2014, January 20\u201322). Semi-supervised sentiment classification with self-training on feature subspaces. Proceedings of the Workshop on Chinese Lexical Semantics, Zhengzhou, China."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Yang, M., Tu, W., Lu, Z., Yin, W., and Chow, K. (2015, January 24\u201326). LCCT: A semi-supervised model for sentiment classification. Proceedings of the Human Language Technologies: The 2015 Annual Conference of the North American Chapter of the ACL, Budapest, Hungary.","DOI":"10.3115\/v1\/N15-1057"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/11\/2\/133\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:28:33Z","timestamp":1760185713000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/11\/2\/133"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,24]]},"references-count":44,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2019,2]]}},"alternative-id":["sym11020133"],"URL":"https:\/\/doi.org\/10.3390\/sym11020133","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2019,1,24]]}}}