{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T06:30:30Z","timestamp":1777703430264,"version":"3.51.4"},"reference-count":34,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2019,6,4]],"date-time":"2019-06-04T00:00:00Z","timestamp":1559606400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"published-print":{"date-parts":[[2019,7,9]]},"abstract":"<jats:p>\u00a0Supervised Word Sense Disambiguation (WSD) systems use features of the target word and its context to learn about all possible samples in an annotated dataset. Recently, word embeddings have emerged as a powerful feature in many NLP tasks. In supervised WSD, word embeddings can be used as a high-quality feature representing the context of an ambiguous word. In this paper, four improvements to existing state-of-the-art WSD methods are proposed. First, we propose a new model for assigning vector coefficients for a more precise context representation. Second, we apply a PCA dimensionality reduction process to find a better transformation of feature matrices and train a more informative model. Third, a new weighting scheme is suggested to tackle the problem of unbalanced data in standard WSD datasets and finally, a novel idea is presented to combine word embedding features extracted from different independent corpora, which uses a voting aggregator among available trained models. All of these proposals individually improve disambiguation performance on Standard English lexical sample tasks, and using the combination of all proposed ideas makes a significant improvement in the accuracy score.<\/jats:p>","DOI":"10.3233\/jifs-182868","type":"journal-article","created":{"date-parts":[[2019,6,7]],"date-time":"2019-06-07T11:49:59Z","timestamp":1559908199000},"page":"1467-1476","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":2,"title":["Supervised word sense disambiguation using new features based on word embeddings"],"prefix":"10.1177","volume":"37","author":[{"given":"Majid","family":"Fahandezi Sadi","sequence":"first","affiliation":[{"name":"Department of Computer Engineering, University of Zanjan, University of Zanjan Blvd. Zanjan, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ebrahim","family":"Ansari","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Technology, Institute for Advanced Studies in Basic Sciences (IASBS), Zanjan, Iran"},{"name":"Research Center for Basic Sciences &amp; Modern Technologies (RBST), Institute for Advanced Studies in Basic Sciences (IASBS), Zanjan, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mohsen","family":"Afsharchi","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, University of Zanjan, University of Zanjan Blvd. Zanjan, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2019,6,4]]},"reference":[{"key":"e_1_3_2_2_2","volume-title":"Word sense disambiguation: Algorithms and applications","author":"Agirre E.","year":"2007","unstructured":"AgirreE. and EdmondsP.. 2007. Word sense disambiguation: Algorithms and applications, volume33. Springer Science & Business Media."},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30115-8_7"},{"key":"e_1_3_2_4_2","first-page":"1137","article-title":"A neural probabilistic language model","volume":"3","author":"Bengio Y.","year":"2003","unstructured":"BengioY., DucharmeR., VincentP. and JauvinC., A neural probabilistic language model, Journal of Machine Learning Research 3 (2003), 1137\u20131155.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1110"},{"key":"e_1_3_2_6_2","first-page":"1","volume-title":"The Proceedings of the Second International Workshop on EvaluatingWord Sense Disambiguation Systems","author":"Edmonds P.","year":"2001","unstructured":"EdmondsP. and CottonS., Senseval-2: overview., In The Proceedings of the Second International Workshop on EvaluatingWord Sense Disambiguation Systems (2001) pp. 1\u20135. Association for Computational Linguistics."},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCC.2011.2161285"},{"key":"e_1_3_2_8_2","first-page":"2265","article-title":"Euclidean embedding of co-occurrence data","volume":"8","author":"Globerson A.","year":"2007","unstructured":"GlobersonA., ChechikG., PereiraF. and TishbyN., Euclidean embedding of co-occurrence data, Journal of Machine Learning Research 8 (2007), 2265\u20132295.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_9_2","first-page":"497","volume-title":"Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers","author":"Guo J.","year":"2014","unstructured":"GuoJ., CheW., WangH. and LiuT., Learning sense-specific word embeddings by exploiting bilingual resources. , In Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers (2014), pp.497\u2013507."},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-1010"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1085"},{"key":"e_1_3_2_12_2","first-page":"2016","article-title":"Fasttext. zip: Compressing text classification models","author":"Joulin A.","unstructured":"JoulinA., GraveE., BojanowskiP., DouzeM., J\u00e9gouH. and MikolovT., Fasttext. zip: Compressing text classification models, arXiv preprint arXiv:1612.03651 2016.","journal-title":"arXiv preprint arXiv:1612.03651"},{"key":"e_1_3_2_13_2","unstructured":"K\u00e5geb\u00e4ckM. and SalomonssonH. Word sense disambiguation using a bidirectional lstm arXiv preprint arXiv:1606.03568 2016."},{"key":"e_1_3_2_14_2","unstructured":"LampleG. BallesterosM. SubramanianS. KawakamiK. and DyerC. Neural architectures for named entity recognition arXiv preprint arXiv:1603.01360 2016."},{"key":"e_1_3_2_15_2","unstructured":"LebretR. and CollobertR. Word emdeddings through hellinger pca arXiv preprint arXiv:1312.5542 2013."},{"key":"e_1_3_2_16_2","doi-asserted-by":"crossref","unstructured":"LiJ. and JurafskyD. Do multi-sense embeddings improve natural language understanding? arXiv preprint arXiv:1506.01070 2015.","DOI":"10.18653\/v1\/D15-1200"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1168"},{"key":"e_1_3_2_18_2","first-page":"2004","volume-title":"Proceedings of SENSEVAL-3, the third international workshop on the evaluation of systems for the semantic analysis of text","author":"Mihalcea R.","unstructured":"MihalceaR., ChklovskiT. and KilgarriffA., The senseval-3 english lexical sample task. In Proceedings of SENSEVAL-3, the third international workshop on the evaluation of systems for the semantic analysis of text 2004."},{"key":"e_1_3_2_19_2","first-page":"3111","article-title":"Distributed representations of words and phrases and their compositionality.","author":"Mikolov T.","year":"2013","unstructured":"MikolovT., SutskeverI., ChenK., CorradoG.S. and DeanJ., Distributed representations of words and phrases and their compositionality. , In Advances in neural information processing systems (2013), pp.3111\u20133119.","journal-title":"In Advances in neural information processing systems"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/219717.219748"},{"key":"e_1_3_2_21_2","first-page":"216","volume-title":"Proceedings of the 48th annual meeting of the association for computational linguistics","author":"Navigli R.","year":"2010","unstructured":"NavigliR. and Paolo PonzettoS., Babelnet: Building a very large multilingual semantic network . In Proceedings of the 48th annual meeting of the association for computational linguistics (2010) pp. 216\u2013225. Association for Computational Linguistics."},{"key":"e_1_3_2_22_2","first-page":"2015","article-title":"Efficient non-parametric estimation of multiple embeddings per word in vector space","author":"Neelakantan A.","unstructured":"NeelakantanA., ShankarJ., PassosA. and McCallumA., Efficient non-parametric estimation of multiple embeddings per word in vector space, arXiv preprint arXiv:1504.06654 2015.","journal-title":"arXiv preprint arXiv:1504.06654"},{"key":"e_1_3_2_23_2","first-page":"2017","article-title":"Making sense of word embeddings","author":"Pelevina M.","unstructured":"PelevinaM., ArefyevN., BiemannC. and PanchenkoA., Making sense of word embeddings, ArXiv preprint arXiv:1708.03390 2017.","journal-title":"ArXiv preprint arXiv:1708.03390"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-89656-4_8"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1120"},{"key":"e_1_3_2_27_2","unstructured":"RaunakV. Effective dimensionality reduction for word embeddings arXiv preprint arXiv:1708.03629 2017."},{"key":"e_1_3_2_28_2","first-page":"2015","article-title":"Autoextend: Extending word embeddings to embeddings for synsets and lexemes","author":"Rothe S.","unstructured":"RotheS. and Sch\u00fctzeH., Autoextend: Extending word embeddings to embeddings for synsets and lexemes, arXiv preprint arXiv:1507.01127 2015.","journal-title":"arXiv preprint arXiv:1507.01127"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/N15-1035"},{"key":"e_1_3_2_30_2","first-page":"151","volume-title":"Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers","author":"Tian F.","year":"2014","unstructured":"TianF., DaiH., BianJ., GaoB., ZhangR., ChenE. and LiuT-Y., A probabilistic model for learning multi-prototype word embeddings. . In Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers (2014), pp. 151\u2013160."},{"key":"e_1_3_2_31_2","first-page":"60","article-title":"Controlling the sensitivity of support vector machines.","volume":"55","author":"Veropoulos K.","year":"1999","unstructured":"VeropoulosK., CampbellC. and CristianiniN.et al., Controlling the sensitivity of support vector machines. , In Proceedings of the international joint conference on AI 55 (1999), 60.","journal-title":"In Proceedings of the international joint conference on AI"},{"key":"e_1_3_2_32_2","first-page":"2017","article-title":"Character composition model with convolutional neural networks for dependency parsing on morphologically rich languages","author":"Yu X.","unstructured":"YuX. and Thang VuN., Character composition model with convolutional neural networks for dependency parsing on morphologically rich languages, arXiv preprint arXiv:1705.10814 2017.","journal-title":"arXiv preprint arXiv:1705.10814"},{"key":"e_1_3_2_33_2","first-page":"2016","article-title":"Semi-supervised word sense disambiguation with neural models","author":"Yuan D.","unstructured":"YuanD., RichardsonJ., DohertyR., EvansC. and AltendorfE., Semi-supervised word sense disambiguation with neural models, arXiv preprint arXiv:1603.07012 2016.","journal-title":"arXiv preprint arXiv:1603.07012"},{"key":"e_1_3_2_34_2","first-page":"78","article-title":"It makes sense: A widecoverage word sense disambiguation system for free text.","author":"Zhong Z.","year":"2010","unstructured":"ZhongZ. and Tou NgH., It makes sense: A widecoverage word sense disambiguation system for free text. , In Proceedings of the ACL 2010 system demonstrations (2010) pp. 78\u201383. Association for Computational Linguistics.","journal-title":"In Proceedings of the ACL 2010 system demonstrations"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D13-1141"}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/JIFS-182868","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.3233\/JIFS-182868","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/JIFS-182868","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:38:42Z","timestamp":1777455522000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.3233\/JIFS-182868"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6,4]]},"references-count":34,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,7,9]]}},"alternative-id":["10.3233\/JIFS-182868"],"URL":"https:\/\/doi.org\/10.3233\/jifs-182868","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,6,4]]}}}