{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T14:12:57Z","timestamp":1760710377889},"reference-count":50,"publisher":"Institute of Electronics, Information and Communications Engineers (IEICE)","issue":"10","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IEICE Trans. Inf. & Syst."],"published-print":{"date-parts":[[2020,10,1]]},"DOI":"10.1587\/transinf.2018edp7410","type":"journal-article","created":{"date-parts":[[2020,9,30]],"date-time":"2020-09-30T22:31:34Z","timestamp":1601505094000},"page":"2216-2227","source":"Crossref","is-referenced-by-count":6,"title":["Sentence-Embedding and Similarity via Hybrid Bidirectional-LSTM and CNN Utilizing Weighted-Pooling Attention"],"prefix":"10.1587","volume":"E103.D","author":[{"given":"Degen","family":"HUANG","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, Dalian University of Technology"}]},{"given":"Anil","family":"AHMED","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Dalian University of Technology"}]},{"given":"Syed Yasser","family":"ARAFAT","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Engineering and Technology (UET)"}]},{"given":"Khawaja Iftekhar","family":"RASHID","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Dalian University of Technology"}]},{"given":"Qasim","family":"ABBAS","sequence":"additional","affiliation":[{"name":"School of Electronics and Physics, Dalian University of Technology"}]},{"given":"Fuji","family":"REN","sequence":"additional","affiliation":[{"name":"Department of Information Science and Intelligent System, Tokushima University"}]}],"member":"532","reference":[{"key":"1","unstructured":"[1] C. Kraus, \u201cPlagiarism detection-state-of-the-art systems (2016) and evaluation methods,\u201d arXiv Prepr. arXiv1603.03014, 2016."},{"key":"2","doi-asserted-by":"publisher","unstructured":"[2] H. Li, \u201cLearning to Rank for Information Retrieval and Natural Language Processing,\u201d Synth. Lect. Hum. Lang. Technol., vol.4, no.1, pp.1-113, 2011. 10.2200\/s00348ed1v01y201104hlt012","DOI":"10.2200\/S00348ED1V01Y201104HLT012"},{"key":"3","doi-asserted-by":"crossref","unstructured":"[3] S. Minaee and Z. Liu, \u201cAutomatic question-answering using a deep similarity neural network,\u201d 2017 IEEE Glob. Conf. Signal Inf. Process. Glob. 2017-Proc., vol.2018-Janua, pp.923-927, 2018. 10.1109\/globalsip.2017.8309095","DOI":"10.1109\/GlobalSIP.2017.8309095"},{"key":"4","doi-asserted-by":"crossref","unstructured":"[4] M.C. Lee, J.W. Chang, and T.C. Hsieh, \u201cA grammar-based semantic similarity algorithm for natural language sentences,\u201d Sci. World J., vol.2014, 2014.","DOI":"10.1155\/2014\/437162"},{"key":"5","unstructured":"[5] Q.V. Le and T. Mikolov, \u201cDistributed representations of sentences and documents,\u201d International Conference on Machine Learning, pp.1188-1196, 2014."},{"key":"6","unstructured":"[6] Q. Liu, Z.-H. Ling, H. Jiang, and Y. Hu, \u201cPart-of-speech relevance weights for learning word embeddings,\u201d arXiv Prepr. arXiv1603.07695, 2016."},{"key":"7","doi-asserted-by":"crossref","unstructured":"[7] R. Collobert and J. Weston, \u201cA Unified Architecture for Natural Language Processing: Deep Neural Networks with Multitask Learning,\u201d Proc. 25th Int. Conf. Mach. Learn.-ICML '08, pp.160-167, 2008. 10.1145\/1390156.1390177","DOI":"10.1145\/1390156.1390177"},{"key":"8","unstructured":"[8] H. Palangi, L. Deng, Y. Shen, J. Gao, X. He, J. Chen, X. Song, and R. Ward, \u201cDeep sentence embedding using long short-term memory networks: Analysis and application to information retrieval,\u201d pp.1-25, 2015."},{"key":"9","doi-asserted-by":"publisher","unstructured":"[9] Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, \u201cGradient-based learning applied to document recognition,\u201d Proc. IEEE, vol.86, no.11, pp.2278-2323, 1998. 10.1109\/5.726791","DOI":"10.1109\/5.726791"},{"key":"10","doi-asserted-by":"crossref","unstructured":"[10] N. Kalchbrenner, E. Grefenstette, and P. Blunsom, \u201cA convolutional neural network for modelling sentences,\u201d arXiv Prepr. arXiv1404.2188, 2014.","DOI":"10.3115\/v1\/P14-1062"},{"key":"11","unstructured":"[11] A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A.N. Gomez, L. Kaiser, and I. Polosukhin, \u201cAttention is all you need,\u201d Advances in Neural Information Processing Systems, pp.5998-6008, 2017."},{"key":"12","unstructured":"[12] I. Jolliffe, \u201cPrincipal component analysis,\u201d International Encyclopedia of Statistical Science, pp.1094-1096, Springer, 2011."},{"key":"13","doi-asserted-by":"publisher","unstructured":"[13] J. Bromley, J.W. Bentz, L. Bottou, I. Guyon, Y. Lecun, C. Moore, E. S\u00e4ckinger, and R. Shah, \u201cSignature Verification Using a \u2018Siamese\u2019 Time Delay Neural Network,\u201d Int. J. Pattern Recognit. Artif. Intell., vol.07, no.04, pp.669-688, 1993. 10.1142\/s0218001493000339","DOI":"10.1142\/S0218001493000339"},{"key":"14","doi-asserted-by":"crossref","unstructured":"[14] M. Marelli, L. Bentivogli, M. Baroni, R. Bernardi, S. Menini, and R. Zamparelli, \u201cSemEval-2014 Task 1: Evaluation of Compositional Distributional Semantic Models on Full Sentences through Semantic Relatedness and Textual Entailment,\u201d Proc. 8th Int. Work. Semant. Eval. (SemEval 2014), no.1, pp.1-8, 2014. 10.3115\/v1\/s14-2001","DOI":"10.3115\/v1\/S14-2001"},{"key":"15","unstructured":"[15] W.B. Dolan and C. Brockett, \u201cAutomatically constructing a corpus of sentential paraphrases,\u201d Proc. Third Int. Work. Paraphrasing, pp.9-16, 2005."},{"key":"16","doi-asserted-by":"crossref","unstructured":"[16] R. Mihalcea, C. Corley, and C. Strapparava, \u201cCorpus-based and knowledge-based measures of text semantic similarity,\u201d Proc. 21st Natl. Conf. Artif. Intell., vol.1, pp.775-780, 2006.","DOI":"10.1109\/MIS.2006.104"},{"key":"17","doi-asserted-by":"crossref","unstructured":"[17] Y. Wang, H. Huang, C. Feng, Q. Zhou, J. Gu, and X. Gao, \u201cCSE: Conceptual sentence embeddings based on attention model,\u201d Proc. ACL, vol.1, pp.505-515, 2016.","DOI":"10.18653\/v1\/P16-1048"},{"key":"18","unstructured":"[18] P. Huang, N.M.A. Urbana, X. He, J. Gao, L. Deng, A. Acero, and L. Heck, \u201cLearning deep structured semantic models for web search using clickthrough data,\u201d 22nd ACM Int. Conf. Inf. Knowl. Manag., pp.2333-2338, 2013."},{"key":"19","doi-asserted-by":"crossref","unstructured":"[19] Y. Shen, X. He, J. Gao, L. Deng, and G. Mesnil, \u201cA Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval,\u201d Proc. 23rd ACM Int. Conf. Conf. Inf. Knowl. Manag.- CIKM '14, pp.101-110, 2014. 10.1145\/2661829.2661935","DOI":"10.1145\/2661829.2661935"},{"key":"20","unstructured":"[20] Z. Gan, Y. Pu, R. Henao, C. Li, X. He, and L. Carin, \u201cLearning generic sentence representations using convolutional neural networks,\u201d arXiv Prepr. arXiv1611.07897, 2016."},{"key":"21","unstructured":"[21] J. Mueller, \u201cSiamese recurrent architectures for learning sentence similarity,\u201d Proc. 30th Conf. Artif. Intell. (AAAI 2016), no.2012, pp.2786-2792, 2016."},{"key":"22","unstructured":"[22] T. Kim, J. Choi, D. Edmiston, S. Bae, and S. Lee, \u201cDynamic compositionality in recursive neural networks with structure-aware tag representations,\u201d arXiv Prepr. arXiv1809.02286, 2018."},{"key":"23","unstructured":"[23] A. Sanborn and J. Skryzalin, \u201cDeep learning for semantic similarity -CS224d,\u201d CS224d Deep Learn. Nat. Lang. Process. Stanford, CA, USA Stanford Univ., 2015."},{"key":"24","doi-asserted-by":"crossref","unstructured":"[24] H. He and J. Lin, \u201cPairwise Word Interaction Modeling with Deep Neural Networks for Semantic Similarity Measurement,\u201d Proc. 2016 Conf. North Am. Chapter Assoc. Comput. Linguist. Hum. Lang. Technol., pp.937-948, 2016. 10.18653\/v1\/n16-1108","DOI":"10.18653\/v1\/N16-1108"},{"key":"25","unstructured":"[25] B. Hu, Z. Lu, H. Li, and Q. Chen, \u201cConvolutional neural network architectures for matching natural language sentences,\u201d Advances in Neural Information Processing Systems, pp.2042-2050, 2015."},{"key":"26","doi-asserted-by":"crossref","unstructured":"[26] K.S. Tai, R. Socher, and C.D. Manning, \u201cImproved Semantic Representations From Tree-Structured Long Short-Term Memory Networks,\u201d Proc. 53rd Annu. Meet. Assoc. Comput. Linguist. 7th Int. Jt. Conf. Nat. Lang. Process., pp.1556-1566, 2015. 10.3115\/v1\/p15-1150","DOI":"10.3115\/v1\/P15-1150"},{"key":"27","doi-asserted-by":"crossref","unstructured":"[27] H. Yao, H. Liu, and P. Zhang, \u201cA novel sentence similarity model with word embedding based on convolutional neural network,\u201d Concurr. Comput., no.Jan., 2018.","DOI":"10.1002\/cpe.4415"},{"key":"28","doi-asserted-by":"crossref","unstructured":"[28] H. He, K. Gimpel, and J. Lin, \u201cMulti-Perspective Sentence Similarity Modeling with Convolutional Neural Networks,\u201d Proc. 2015 Conf. Empir. Methods Nat. Lang. Process. (EMNLP 2015), no.1, pp.1576-1586, 2015. 10.18653\/v1\/d15-1181","DOI":"10.18653\/v1\/D15-1181"},{"key":"29","unstructured":"[29] D.P. Kingma and J. Ba, \u201cAdam: A method for stochastic optimization,\u201d International Conference on Learning Representations (ICLR), vol.5, 2014."},{"key":"30","doi-asserted-by":"crossref","unstructured":"[30] R. Johnson and T. Zhang, \u201cEffective use of word order for text categorization with convolutional neural networks,\u201d arXiv Prepr. arXiv1412.1058, 2014.","DOI":"10.3115\/v1\/N15-1011"},{"key":"31","unstructured":"[31] T. Mikolov, K. Chen, G. Corrado, and J. Dean, \u201cEfficient estimation of word representations in vector space,\u201d arXiv Prepr. arXiv1301.3781, 2013."},{"key":"32","doi-asserted-by":"crossref","unstructured":"[32] J. Pennington, R. Socher, and C. Manning, \u201cGlove: Global Vectors for Word Representation,\u201d Proc. 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp.1532-1543, 2014. 10.3115\/v1\/d14-1162","DOI":"10.3115\/v1\/D14-1162"},{"key":"33","unstructured":"[33] T. Mikolov, E. Grave, P. Bojanowski, C. Puhrsch, and A. Joulin, \u201cAdvances in pre-training distributed word representations,\u201d arXiv Prepr. arXiv1712.09405, 2017."},{"key":"34","doi-asserted-by":"publisher","unstructured":"[34] S. Hochreiter and J. Schmidhuber, \u201cLong Short-Term Memory,\u201d Neural Comput., vol.9, no.8, pp.1735-1780, 1997. 10.1162\/neco.1997.9.8.1735","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"35","doi-asserted-by":"crossref","unstructured":"[35] A. Graves, A.-R. Mohamed, and G. Hinton, \u201cSpeech recognition with deep recurrent neural networks,\u201d ICASSP, IEEE Int. Conf. Acoust. Speech Signal Process.-Proc., no.3, pp.6645-6649, 2013. 10.1109\/icassp.2013.6638947","DOI":"10.1109\/ICASSP.2013.6638947"},{"key":"36","doi-asserted-by":"publisher","unstructured":"[36] Y. Lecun, Y. Bengio, and G. Hinton, \u201cDeep learning,\u201d Nature, vol.521, no.7553, pp.436-444, 2015. 10.1038\/nature14539","DOI":"10.1038\/nature14539"},{"key":"37","unstructured":"[37] Y. Zhang and B. Wallace, \u201cA sensitivity analysis of (and practitioners' guide to) convolutional neural networks for sentence classification,\u201d arXiv Prepr. arXiv1510.03820, 2015."},{"key":"38","doi-asserted-by":"crossref","unstructured":"[38] F. Tao and G. Liu, \u201cAdvanced LSTM: A Study about Better Time Dependency Modeling in Emotion Recognition,\u201d 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.2906-2910, 2017. 10.1109\/icassp.2018.8461750","DOI":"10.1109\/ICASSP.2018.8461750"},{"key":"39","doi-asserted-by":"crossref","unstructured":"[39] J. Zhao, T.T. Zhu, and M. Lan, \u201cECNU: One Stone Two Birds: Ensemble of Heterogenous Measures for Semantic Relatedness and Textual Entailment,\u201d Proc. 8th International Workshop on Semantic Evaluation (SemEval 2014), no.SemEval, pp.271-277, 2014. 10.3115\/v1\/s14-2044","DOI":"10.3115\/v1\/S14-2044"},{"key":"40","doi-asserted-by":"crossref","unstructured":"[40] J. Bjerva, J. Bos, R. Van Der Goot, and M. Nissim, \u201cThe Meaning Factory: Formal Semantics for Recognizing Textual Entailment and Determining Semantic Similarity,\u201d SemEval, no.SemEval, pp.642-646, 2014. 10.3115\/v1\/s14-2114","DOI":"10.3115\/v1\/S14-2114"},{"key":"41","doi-asserted-by":"crossref","unstructured":"[41] A. Lai and J. Hockenmaier, \u201cIllinois-LH: A Denotational and Distributional Approach to Semantics,\u201d Proc. 8th Int. Work. Semant. Eval., no.SemEval, pp.329-334, 2014. 10.3115\/v1\/s14-2055","DOI":"10.3115\/v1\/S14-2055"},{"key":"42","doi-asserted-by":"crossref","unstructured":"[42] S. Jimenez, G. Due\u00f1as, J. Baquero, A. Gelbukh, G. Due, C.Universitaria, and A. Mendiz, \u201cUNAL-NLP: Combining soft cardinality features for semantic textual similarity, relatedness and entailment,\u201d Proc. 8th Int. Work. Semant. Eval. (SemEval 2014), no.1, pp.732-742, 2014.","DOI":"10.3115\/v1\/S14-2131"},{"key":"43","doi-asserted-by":"crossref","unstructured":"[43] T. Proisl, S. Evert, P. Greiner, B. Kabashi, and F.E. Fau,\u201cSemantiKLUE: Robust semantic similarity at multiple levels using maximum weight matching,\u201d Proc. 8th Int. Work. Semant. Eval. (SemEval 2014), no.SemEval, pp.532-540, 2014.","DOI":"10.3115\/v1\/S14-2093"},{"key":"44","doi-asserted-by":"crossref","unstructured":"[44] Y. Bestgen, \u201cCECL: a New Baseline and a Non-Compositional Approach for the Sick Benchmark,\u201d Proc. 8th Int. Work. Semant. Eval. (SemEval 2014), pp.160-165, 2014. 10.3115\/v1\/s14-2024","DOI":"10.3115\/v1\/S14-2024"},{"key":"45","doi-asserted-by":"publisher","unstructured":"[45] R. Socher, A. Karpathy, Q.V. Le, C.D. Manning, and A.Y. Ng, \u201cGrounded Compositional Semantics for Finding and Describing Images with Sentences,\u201d Trans. Assoc. Comput. Linguist., vol.2, no.0, pp.207-218, 2014. 10.1162\/tacl_a_00177","DOI":"10.1162\/tacl_a_00177"},{"key":"46","unstructured":"[46] N. Madnani, J. Tetreault, and M. Chodorow, \u201cRe-examining machine translation metrics for paraphrase identification,\u201d Proc. 2012 Conf. North Am. Chapter Assoc. Comput. Linguist. Hum. Lang. Technol., pp.182-190, 2012."},{"key":"47","doi-asserted-by":"crossref","unstructured":"[47] W. Yin and H. Sch\u00fctze, \u201cConvolutional neural network for paraphrase identification,\u201d Proc. 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp.901-911, 2015. 10.3115\/v1\/n15-1091","DOI":"10.3115\/v1\/N15-1091"},{"key":"48","unstructured":"[48] Y. Ji and J. Eisenstein, \u201cDiscriminative improvements to distributional sentence similarity,\u201d Proc. 2013 Conference on Empirical Methods in Natural Language Processing, pp.891-896, 2013."},{"key":"49","unstructured":"[49] R. Socher, E.H. Huang, J. Pennington, A.Y. Ng, and C.D. Manning, \u201cDynamic pooling and unfolding recursive autoencoders for paraphrase detection,\u201d Advances in Neural Information Processing Systems 24, pp.1-9, 2011."},{"key":"50","unstructured":"[50] L. van der Maaten, and G. Hinton, \u201cVisualizing data using t-SNE,\u201d J. Mach. Learn. Res., vol.1, pp.1-48, 2008."}],"container-title":["IEICE Transactions on Information and Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transinf\/E103.D\/10\/E103.D_2018EDP7410\/_pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,10,3]],"date-time":"2020-10-03T03:30:51Z","timestamp":1601695851000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transinf\/E103.D\/10\/E103.D_2018EDP7410\/_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,1]]},"references-count":50,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2020]]}},"URL":"https:\/\/doi.org\/10.1587\/transinf.2018edp7410","relation":{},"ISSN":["0916-8532","1745-1361"],"issn-type":[{"value":"0916-8532","type":"print"},{"value":"1745-1361","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10,1]]}}}