{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T06:43:50Z","timestamp":1740120230242,"version":"3.37.3"},"reference-count":32,"publisher":"World Scientific Pub Co Pte Ltd","issue":"13","funder":[{"name":"the Fundamental Research Funds for the Central Universities of China in Chongqing University","award":["106112015CDJSK04JD02"],"award-info":[{"award-number":["106112015CDJSK04JD02"]}]},{"name":"the Graduate Research and Innovation Foundation of Chongqing University, China","award":["CYB18057"],"award-info":[{"award-number":["CYB18057"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Patt. Recogn. Artif. Intell."],"published-print":{"date-parts":[[2019,12,15]]},"abstract":"<jats:p> In the natural language environment, accurately inferring the meaning of a token according to its context is crucial to understanding a sophisticated expression. However, this is not easy for a machine. The traditional language models used to train distributed word vectors are often restricted by single-sense embedding. In this paper, we develop a model called MSCvec (Multi-sense Soft Clustering Vector) for word sense disambiguation of polysemy in context. We extract the features of individual words by the co-occurrence PPMI (Positive Pointwise Mutual Information) matrix, and decompose the matrix by NMF (Nonnegative Matrix Factorization) into low-rank representations of target words, which are used as the input of an unsupervised sparse soft clustering method called Sparse Fuzzy C-means (SFCM). We use SFCM to determine the global semantic space of words, and partition the subspaces of multiple senses of a polysemous word. We relabel candidate words by the negative average log likelihood, and train multi-sense embedding with extensional vocabulary by the fastText model. Compared with the traditional static embeddings, the result shows that NMF and SFCM design can improve the performance in word similarity and relatedness tasks as well as in text classification tasks of different types of text. Accurate semantic representation of MSCvec would be necessary to produce outstanding results. <\/jats:p>","DOI":"10.1142\/s021800141951011x","type":"journal-article","created":{"date-parts":[[2019,3,3]],"date-time":"2019-03-03T23:19:16Z","timestamp":1551655156000},"page":"1951011","source":"Crossref","is-referenced-by-count":0,"title":["Unsupervised Learning of Multi-Sense Embedding with Matrix Factorization and Sparse Soft Clustering"],"prefix":"10.1142","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5898-0211","authenticated-orcid":false,"given":"Fei","family":"Guo","sequence":"first","affiliation":[{"name":"College of Computer Science, Chongqing University 400030, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhongshi","family":"He","sequence":"additional","affiliation":[{"name":"College of Computer Science, Chongqing University 400030, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liangyan","family":"Li","sequence":"additional","affiliation":[{"name":"Research Center for Language Cognition and Language Application, Chongqing University 400030, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jing","family":"Xuan","sequence":"additional","affiliation":[{"name":"College of Computer Science, Chongqing University 400030, P. R. China"},{"name":"Research Center for Language Cognition and Language Application, Chongqing University 400030, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2019,12,17]]},"reference":[{"key":"S021800141951011XBIB001","doi-asserted-by":"publisher","DOI":"10.3115\/1620754.1620758"},{"volume-title":"Pattern Recognition with Fuzzy Objective Function Algorithms","year":"2013","author":"Bezdek J. C.","key":"S021800141951011XBIB004"},{"key":"S021800141951011XBIB005","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00051"},{"key":"S021800141951011XBIB006","doi-asserted-by":"publisher","DOI":"10.1137\/16M1080173"},{"key":"S021800141951011XBIB007","doi-asserted-by":"publisher","DOI":"10.1613\/jair.4135"},{"key":"S021800141951011XBIB008","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1110"},{"key":"S021800141951011XBIB009","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.1979.4766909"},{"key":"S021800141951011XBIB010","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-2506"},{"key":"S021800141951011XBIB011","doi-asserted-by":"publisher","DOI":"10.1145\/503104.503110"},{"key":"S021800141951011XBIB012","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D16-1235"},{"key":"S021800141951011XBIB013","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2001.940893"},{"key":"S021800141951011XBIB014","doi-asserted-by":"publisher","DOI":"10.1145\/2339530.2339751"},{"key":"S021800141951011XBIB016","doi-asserted-by":"publisher","DOI":"10.1080\/00437956.1954.11659520"},{"key":"S021800141951011XBIB017","doi-asserted-by":"publisher","DOI":"10.1162\/COLI_a_00237"},{"key":"S021800141951011XBIB018","first-page":"873","volume-title":"ACL \u201912 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics","author":"Huang E. H.","year":"2012"},{"key":"S021800141951011XBIB020","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/2929157"},{"key":"S021800141951011XBIB021","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2017.08.048"},{"key":"S021800141951011XBIB023","doi-asserted-by":"publisher","DOI":"10.1038\/44565"},{"key":"S021800141951011XBIB024","first-page":"2177","author":"Levy O.","year":"2014","journal-title":"Twenty-Eighth Conference on Neural Information Processing Systems"},{"key":"S021800141951011XBIB025","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00134"},{"key":"S021800141951011XBIB026","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1200"},{"key":"S021800141951011XBIB027","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2007.19.10.2756"},{"key":"S021800141951011XBIB028","first-page":"142","volume-title":"Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies","author":"Maas A. L.","year":"2011"},{"key":"S021800141951011XBIB029","first-page":"3111","volume-title":"Twenty-Seventh Conference on Neural Information Processing Systems","author":"Mikolov T.","year":"2013"},{"volume-title":"Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC-2018)","year":"2018","author":"Mikolov T.","key":"S021800141951011XBIB030"},{"key":"S021800141951011XBIB031","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"S021800141951011XBIB034","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2004.11.005"},{"key":"S021800141951011XBIB035","first-page":"1631","volume-title":"Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing","author":"Socher R.","year":"2013"},{"key":"S021800141951011XBIB037","first-page":"2579","volume":"9","author":"Van Der Maaten L. J. P.","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"S021800141951011XBIB038","first-page":"1137","volume":"3","author":"Vincent P.","year":"2003","journal-title":"Journal of Machine Learning Research"},{"key":"S021800141951011XBIB039","doi-asserted-by":"publisher","DOI":"10.1142\/S021800141854023X"},{"key":"S021800141951011XBIB040","first-page":"1","volume-title":"COLING \u201902 Proceedings of the 19th International Conference on Computational Linguistics","author":"Xin L.","year":"2002"}],"container-title":["International Journal of Pattern Recognition and Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S021800141951011X","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,12,18]],"date-time":"2019-12-18T03:00:12Z","timestamp":1576638012000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S021800141951011X"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,15]]},"references-count":32,"journal-issue":{"issue":"13","published-print":{"date-parts":[[2019,12,15]]}},"alternative-id":["10.1142\/S021800141951011X"],"URL":"https:\/\/doi.org\/10.1142\/s021800141951011x","relation":{},"ISSN":["0218-0014","1793-6381"],"issn-type":[{"type":"print","value":"0218-0014"},{"type":"electronic","value":"1793-6381"}],"subject":[],"published":{"date-parts":[[2019,12,15]]}}}