{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T14:02:39Z","timestamp":1753884159689,"version":"3.41.2"},"reference-count":37,"publisher":"World Scientific Pub Co Pte Ltd","issue":"10","funder":[{"name":"Key-Area Research and Development Program of Guangdong Province","award":["2019B010153002"],"award-info":[{"award-number":["2019B010153002"]}]},{"name":"Science and Technology Projects of Guangzhou","award":["202007040006"],"award-info":[{"award-number":["202007040006"]}]},{"name":"Program of Marine Economy Development (Six Marine Industries) Special Foundation of Department of Natural Resources of Guangdong Province","award":["GDNRC [2020]056"],"award-info":[{"award-number":["GDNRC [2020]056"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62002071"],"award-info":[{"award-number":["62002071"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Guangzhou Basic Research Project","award":["202102020420"],"award-info":[{"award-number":["202102020420"]}]},{"name":"Top Youth Talent Project of Zhujiang Talent Program","award":["2019QN01X516"],"award-info":[{"award-number":["2019QN01X516"]}]},{"name":"Guangdong Provincial Key Laboratory of Cyber-Physical System","award":["2020B1212060069"],"award-info":[{"award-number":["2020B1212060069"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Patt. Recogn. Artif. Intell."],"published-print":{"date-parts":[[2022,8]]},"abstract":"<jats:p> In recent years, semi-supervised learning has been investigated to take full advantages of increasing unlabeled data. Although pretrained deep learning models are successfully adopted on a massive amount of unlabeled data, they may not be applicable in specific domains as the data is limited. In this paper, we propose a model, termed Semi-supervised Variational AutoEncoder (SVAE), which consists of Gated Convolutional Neural Networks (GCNN) as both the encoder and the decoder. Since the canonical VAE suffers from Kullback\u2013Leibler (KL) vanishing problem, we attach a layer named Scalar after Batch Normalization (BN) to scale the output of the BN. We conduct experiments on two domain-specific datasets with a small amount of data. The results show that SVAE outperforms other alternative baselines for language modeling and semi-supervised learning studies. Especially, the results in the language modeling validate the effect of combining BN and Scalar for tackling the KL vanishing problem. Moreover, the visualization of the latent representations verifies the performance of SVAE on less data. <\/jats:p>","DOI":"10.1142\/s0218001422530068","type":"journal-article","created":{"date-parts":[[2022,6,9]],"date-time":"2022-06-09T07:51:53Z","timestamp":1654761113000},"source":"Crossref","is-referenced-by-count":4,"title":["An Improved Semi-supervised Variational Autoencoder with Gate Mechanism for Text Classification"],"prefix":"10.1142","volume":"36","author":[{"given":"Haiming","family":"Ye","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, Guangdong University of Technology, Guangzhou, 510006, P. R. China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5098-6459","authenticated-orcid":false,"given":"Weiwen","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Guangdong University of Technology, Guangzhou, 510006, P. R. China"}]},{"given":"Mengna","family":"Nie","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Guangdong University of Technology, Guangzhou, 510006, P. R. China"}]}],"member":"219","published-online":{"date-parts":[[2022,7,25]]},"reference":[{"key":"S0218001422530068BIB001","doi-asserted-by":"publisher","DOI":"10.1007\/s13369-020-04447-0"},{"key":"S0218001422530068BIB002","doi-asserted-by":"publisher","DOI":"10.1007\/s13369-021-05475-0"},{"key":"S0218001422530068BIB003","first-page":"1137","volume":"3","author":"Bengio Y.","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"S0218001422530068BIB004","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K16-1002"},{"key":"S0218001422530068BIB005","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1179"},{"key":"S0218001422530068BIB006","first-page":"3079","volume-title":"Proc. 28th Int. Conf. Neural Information Processing Systems - Vol. 2","author":"Dai A. M.","year":"2015"},{"key":"S0218001422530068BIB007","first-page":"933","volume-title":"Int. Conf. Machine Learning","author":"Dauphin Y. N.","year":"2017"},{"key":"S0218001422530068BIB008","first-page":"4171","volume-title":"Proc. 2019 Conf. North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vol. 1 (Long and Short Papers)","author":"Devlin J.","year":"2019"},{"key":"S0218001422530068BIB009","doi-asserted-by":"publisher","DOI":"10.1007\/s10489-021-02210-y"},{"key":"S0218001422530068BIB010","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1590"},{"key":"S0218001422530068BIB011","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"S0218001422530068BIB012","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"S0218001422530068BIB013","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2021.01.008"},{"key":"S0218001422530068BIB014","first-page":"526","volume-title":"Int. Conf. Machine Learning","author":"Johnson R.","year":"2016"},{"key":"S0218001422530068BIB015","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1181"},{"volume-title":"3rd Int. Conf. Learning Representations","year":"2014","author":"Kingma D. P.","key":"S0218001422530068BIB016"},{"volume-title":"2nd Int. Conf. Learning Representations (ICLR)","year":"2014","author":"Kingma D. P.","key":"S0218001422530068BIB017"},{"volume-title":"Advances in Neural Information Processing Systems","year":"2012","author":"Krizhevsky A.","key":"S0218001422530068BIB018"},{"issue":"2605","key":"S0218001422530068BIB019","first-page":"2579","volume":"9","author":"Laurens V. D. M.","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"S0218001422530068BIB020","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-8673"},{"key":"S0218001422530068BIB021","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080834"},{"key":"S0218001422530068BIB022","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2014.2329567"},{"key":"S0218001422530068BIB023","first-page":"142","volume-title":"Proc. 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies","author":"Maas A.","year":"2011"},{"key":"S0218001422530068BIB024","first-page":"1727","volume-title":"Int. Conf. Machine Learn.","author":"Miao Y.","year":"2016"},{"key":"S0218001422530068BIB025","first-page":"3111","volume-title":"Proc. 26th Int. Conf. Neural Information Processing Systems - Vol. 2","author":"Mikolov T.","year":"2013"},{"key":"S0218001422530068BIB026","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007692713085"},{"key":"S0218001422530068BIB027","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2015.2498525"},{"key":"S0218001422530068BIB028","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"S0218001422530068BIB029","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-1202"},{"key":"S0218001422530068BIB030","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1480"},{"key":"S0218001422530068BIB031","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v31i1.10966"},{"key":"S0218001422530068BIB032","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2019.2900734"},{"key":"S0218001422530068BIB033","first-page":"3881","volume-title":"Int. Conf. Machine Learning","author":"Yang Z.","year":"2017"},{"key":"S0218001422530068BIB034","volume-title":"Proc. 7th Int. Conf. Machine Learning","volume":"20","author":"Zhang T.","year":"2000"},{"key":"S0218001422530068BIB035","volume-title":"Advances in Neural Information Processing Systems","volume":"28","author":"Zhang X.","year":"2015"},{"key":"S0218001422530068BIB036","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1101"},{"key":"S0218001422530068BIB037","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.235"}],"container-title":["International Journal of Pattern Recognition and Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218001422530068","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,8,30]],"date-time":"2022-08-30T03:37:03Z","timestamp":1661830623000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0218001422530068"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,25]]},"references-count":37,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2022,8]]}},"alternative-id":["10.1142\/S0218001422530068"],"URL":"https:\/\/doi.org\/10.1142\/s0218001422530068","relation":{},"ISSN":["0218-0014","1793-6381"],"issn-type":[{"type":"print","value":"0218-0014"},{"type":"electronic","value":"1793-6381"}],"subject":[],"published":{"date-parts":[[2022,7,25]]},"article-number":"2253006"}}