{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T02:04:46Z","timestamp":1784253886741,"version":"3.55.0"},"reference-count":53,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T00:00:00Z","timestamp":1776988800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T00:00:00Z","timestamp":1784246400000},"content-version":"vor","delay-in-days":84,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Neural Process Lett"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>An inseparable part of natural language processing (NLP) tasks is word embedding, which bridges machine and human language understanding. Although embedding as a representation system revolutionized NLP profoundly, an investigation of recently published word representation models leads us to focus on its limitations. The essence of word embedding is not fully developed to correctly decode contextual words in longer texts or handle phrases and homonyms, even heteronyms and polysemes. This issue, in turn, increases the dependence on various neural networks, more computations, and the cost of solving ambiguity. In order to overcome this issue, an approach suited to encode the inter-dependency among embeddings is presented. This approach is premised on the superposition principle, which helps the systems process sentences in a novel manner. Superposition adaptation is implemented by proposing a complex mapping model to both prevent interference of meaning and account for words\u2019 relations in the early phase of feeding word embedding to models. The proposed method successfully decodes meaningful correlations between words. It is evaluated on three NLP tasks with three public datasets in two languages (Chinese and English). Detailed experiments demonstrate that the proposed approach outperforms state-of-the-art methods, achieving 17% error reduction on average. Further discussion centers on results to confirm the effectiveness and reusability of the method for other tasks as well.<\/jats:p>","DOI":"10.1007\/s11063-026-11842-5","type":"journal-article","created":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T15:56:57Z","timestamp":1777046217000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A Novel Semantic Embedding Using Complex Mapping"],"prefix":"10.1007","volume":"58","author":[{"given":"Pourya","family":"Farzi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Saeed","family":"Farzi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,4,24]]},"reference":[{"key":"11842_CR1","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1016\/j.eng.2019.12.014","volume":"6","author":"M Zhou","year":"2020","unstructured":"Zhou M, Duan N, Liu S, Shum H-Y (2020) Progress in neural NLP: modeling, learning, and reasoning. Engineering 6:275\u2013290","journal-title":"Engineering"},{"key":"11842_CR2","doi-asserted-by":"publisher","first-page":"443","DOI":"10.1016\/j.neucom.2021.05.103","volume":"470","author":"I Lauriola","year":"2022","unstructured":"Lauriola I, Lavelli A, Aiolli F (2022) An introduction to deep learning in natural language processing: models, techniques, and tools. Neurocomputing 470:443\u2013456","journal-title":"Neurocomputing"},{"key":"11842_CR3","volume-title":"Feature engineering for machine learning: principles and techniques for data scientists","author":"A Zheng","year":"2018","unstructured":"Zheng A, Casari A (2018) Feature engineering for machine learning: principles and techniques for data scientists. O\u2019Reilly Media Inc, Sebastopol"},{"key":"11842_CR4","unstructured":"Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. In: Advances in neural information processing systems. pp 3111\u20133119"},{"key":"11842_CR5","unstructured":"Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781"},{"key":"11842_CR6","doi-asserted-by":"crossref","unstructured":"Pennington J, Socher R, Manning CD (2014) Glove: Global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). pp 1532\u20131543","DOI":"10.3115\/v1\/D14-1162"},{"key":"11842_CR7","doi-asserted-by":"crossref","unstructured":"Melamud O, Goldberger J, Dagan I (2016) context2vec: Learning generic context embedding with bidirectional LSTM. In: Proceedings of the 20th SIGNLL conference on computational natural language learning. pp 51\u201361","DOI":"10.18653\/v1\/K16-1006"},{"key":"11842_CR8","doi-asserted-by":"crossref","unstructured":"Peters ME, Neumann M, Iyyer M, Gardner M, Clark C, Lee K, Zettlemoyer L (2018) Deep contextualized word representations","DOI":"10.18653\/v1\/N18-1202"},{"key":"11842_CR9","doi-asserted-by":"publisher","first-page":"334","DOI":"10.1016\/j.fcij.2018.10.003","volume":"3","author":"A Tealab","year":"2018","unstructured":"Tealab A (2018) Time series forecasting using artificial neural networks methodologies: a systematic review. Future Comput Inform J 3:334\u2013340","journal-title":"Future Comput Inform J"},{"issue":"10","key":"11842_CR10","doi-asserted-by":"publisher","first-page":"4291","DOI":"10.1109\/TNNLS.2020.3019893","volume":"32","author":"A Galassi","year":"2020","unstructured":"Galassi A, Lippi M, Torroni P (2020) Attention in natural language processing. IEEE Trans Neural Netw Learn Syst 32(10):4291\u20134308","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"11842_CR11","doi-asserted-by":"publisher","first-page":"11721","DOI":"10.1007\/s11063-023-11396-w","volume":"55","author":"C Piao","year":"2023","unstructured":"Piao C, Wang Y, Zhu Y, Wei J-M, Liu J (2023) Word-context attention for text representation. Neural Process Lett 55:11721\u201311738. https:\/\/doi.org\/10.1007\/s11063-023-11396-w","journal-title":"Neural Process Lett"},{"key":"11842_CR12","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser \\Lukasz, Polosukhin I (2017) Attention is all you need. Advances in neural information processing systems 30"},{"key":"11842_CR13","unstructured":"Devlin J, Chang M-W, Lee K, Toutanova K (2018) Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805"},{"key":"11842_CR14","first-page":"9","volume":"1","author":"A Radford","year":"2019","unstructured":"Radford A, Wu J, Child R, Luan D, Amodei D, Sutskever I (2019) Language models are unsupervised multitask learners. OpenAI blog 1:9","journal-title":"OpenAI blog"},{"key":"11842_CR15","first-page":"1","volume":"21","author":"C Raffel","year":"2020","unstructured":"Raffel C, Shazeer N, Roberts A, Lee K, Narang S, Matena M, Zhou Y, Li W, Liu PJ (2020) Exploring the limits of transfer learning with a unified text-to-text transformer. J Mach Learn Res 21:1\u201367","journal-title":"J Mach Learn Res"},{"key":"11842_CR16","doi-asserted-by":"crossref","unstructured":"Dai Z, Yang Z, Yang Y, Carbonell J, Le QV, Salakhutdinov R (2019) Transformer-xl: attentive language models beyond a fixed-length context. arXiv preprint arXiv:1901.02860","DOI":"10.18653\/v1\/P19-1285"},{"key":"11842_CR17","first-page":"17283","volume":"33","author":"M Zaheer","year":"2020","unstructured":"Zaheer M, Guruganesh G, Dubey KA, Ainslie J, Alberti C, Ontanon S, Pham P, Ravula A, Wang Q, Yang L (2020) Big bird: transformers for longer sequences. Adv Neural Inf Process Syst 33:17283\u201317297","journal-title":"Adv Neural Inf Process Syst"},{"key":"11842_CR18","unstructured":"Beltagy I, Peters ME, Cohan A (2020) Longformer: the long-document transformer. arXiv preprint arXiv:200405150"},{"key":"11842_CR19","doi-asserted-by":"crossref","unstructured":"Wang B, Wang A, Chen F, Wang Y, Kuo C-CJ (2019) Evaluating word embedding models: methods and experimental results. APSIPA transactions on signal and information processing 8:","DOI":"10.1017\/ATSIP.2019.12"},{"key":"11842_CR20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3706418","volume":"57","author":"M Xu","year":"2025","unstructured":"Xu M, Cai D, Yin W, Wang S, Jin X, Liu X (2025) Resource-efficient algorithms and systems of foundation models: a survey. ACM Comput Surv 57:1\u201339. https:\/\/doi.org\/10.1145\/3706418","journal-title":"ACM Comput Surv"},{"key":"11842_CR21","unstructured":"Challagundla BC, Peddavenkatagari C (2024) Neural sequence-to-sequence modeling with attention by leveraging deep learning architectures for enhanced contextual understanding in abstractive text summarization"},{"key":"11842_CR22","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2021.106827","volume":"218","author":"S Li","year":"2021","unstructured":"Li S, Pan R, Luo H, Liu X, Zhao G (2021) Adaptive cross-contextual word embedding for word polysemy with unsupervised topic modeling. Knowl Based Syst 218:106827","journal-title":"Knowl Based Syst"},{"key":"11842_CR23","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1007\/s11063-020-10376-8","volume":"53","author":"Y Lee","year":"2021","unstructured":"Lee Y (2021) Systematic homonym detection and replacement based on contextual word embedding. Neural Process Lett 53:17\u201336","journal-title":"Neural Process Lett"},{"key":"11842_CR24","doi-asserted-by":"crossref","unstructured":"Wang Y-A, Chen Y-N (2020) What do position embeddings learn? An empirical study of pre-trained language model positional encoding. arXiv preprint arXiv:2010.04903","DOI":"10.18653\/v1\/2020.emnlp-main.555"},{"key":"11842_CR25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3434237","volume":"20","author":"U Naseem","year":"2021","unstructured":"Naseem U, Razzak I, Khan SK, Prasad M (2021) A comprehensive survey on word representation models: from classical to state-of-the-art word representation language models. Trans Asian Low-Resour Lang Inf Process 20:1\u201335","journal-title":"Trans Asian Low-Resour Lang Inf Process"},{"key":"11842_CR26","doi-asserted-by":"publisher","first-page":"8551","DOI":"10.1007\/s11063-023-11168-6","volume":"55","author":"J Chang","year":"2023","unstructured":"Chang J, Han X (2023) Character-to-word representation and global contextual representation for named entity recognition. Neural Process Lett 55:8551\u20138567. https:\/\/doi.org\/10.1007\/s11063-023-11168-6","journal-title":"Neural Process Lett"},{"key":"11842_CR27","doi-asserted-by":"crossref","unstructured":"Li Q, Uprety S, Wang B, Song D (2018) Quantum-inspired complex word embedding","DOI":"10.18653\/v1\/W18-3006"},{"key":"11842_CR28","doi-asserted-by":"publisher","first-page":"308","DOI":"10.3390\/axioms12030308","volume":"12","author":"W Lai","year":"2023","unstructured":"Lai W, Shi J, Chang Y (2023) Quantum-inspired fully complex-valued neutral network for sentiment analysis. Axioms 12:308","journal-title":"Axioms"},{"key":"11842_CR29","unstructured":"Wang B, Zhao D, Lioma C, Li Q, Zhang P, Simonsen JG (2020) Encoding word order in complex embeddings"},{"key":"11842_CR30","doi-asserted-by":"crossref","unstructured":"Sasoko WH, Setyanto A, Martinez-Bejar R (2024) Comparative study and evaluation of machine learning models for semantic textual similarity. In: 2024 8th international conference on information technology, information systems and electrical engineering (ICITISEE). IEEE, pp 364\u2013369","DOI":"10.1109\/ICITISEE63424.2024.10730053"},{"key":"11842_CR31","unstructured":"McCann B, Bradbury J, Xiong C, Socher R (2017) Learned in translation: contextualized word vectors. Advances in neural information processing systems 30"},{"key":"11842_CR32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.neucom.2015.12.091","volume":"190","author":"P Qin","year":"2016","unstructured":"Qin P, Xu W, Guo J (2016) An empirical convolutional neural network approach for semantic relation classification. Neurocomputing 190:1\u20139","journal-title":"Neurocomputing"},{"key":"11842_CR33","doi-asserted-by":"publisher","first-page":"23253","DOI":"10.1109\/ACCESS.2017.2776930","volume":"6","author":"Z Jianqiang","year":"2018","unstructured":"Jianqiang Z, Xiaolin G, Xuejun Z (2018) Deep convolution neural networks for twitter sentiment analysis. IEEE Access 6:23253\u201323260","journal-title":"IEEE Access"},{"key":"11842_CR34","unstructured":"Koner R, Shit S, Tresp V (2020) Relation transformer network. arXiv preprint arXiv:2004.06193"},{"key":"11842_CR35","unstructured":"Lee SYM, Chen Y, Huang C-R (2010) A text-driven rule-based system for emotion cause detection. In: Proceedings of the NAACL HLT 2010 workshop on computational approaches to analysis and generation of emotion in text. pp 45\u201353"},{"key":"11842_CR36","first-page":"145","volume-title":"Social media content analysis: natural language processing and beyond","author":"L Gui","year":"2018","unstructured":"Gui L, Xu R, Wu D, Lu Q, Zhou Y (2018) Event-driven emotion cause extraction with corpus construction. Social media content analysis: natural language processing and beyond. World Scientific, pp 145\u2013160"},{"key":"11842_CR37","doi-asserted-by":"crossref","unstructured":"Xia R, Zhang M, Ding Z (2019) RTHN: a RNN-transformer hierarchical network for emotion cause extraction. arXiv preprint arXiv:1906.01236","DOI":"10.24963\/ijcai.2019\/734"},{"key":"11842_CR38","doi-asserted-by":"crossref","unstructured":"Cer D, Diab M, Agirre E, Lopez-Gazpio I, Specia L (2017) Semeval-2017 task 1: Semantic textual similarity-multilingual and cross-lingual focused evaluation. arXiv preprint arXiv:1708.00055","DOI":"10.18653\/v1\/S17-2001"},{"key":"11842_CR39","doi-asserted-by":"crossref","unstructured":"Bowman SR, Angeli G, Potts C, Manning CD (2015) A large annotated corpus for learning natural language inference. arXiv preprint arXiv:1508.05326","DOI":"10.18653\/v1\/D15-1075"},{"key":"11842_CR40","doi-asserted-by":"crossref","unstructured":"Ranasinghe T, Or\u01cesan C, Mitkov R (2019) Semantic textual similarity with Siamese neural networks. In: Proceedings of the international conference on recent advances in natural language processing (RANLP 2019). pp 1004\u20131011","DOI":"10.26615\/978-954-452-056-4_116"},{"key":"11842_CR41","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3440755","volume":"54","author":"D Chandrasekaran","year":"2021","unstructured":"Chandrasekaran D, Mago V (2021) Evolution of semantic similarity\u2014a survey. ACM Comput Surv (CSUR) 54:1\u201337","journal-title":"ACM Comput Surv (CSUR)"},{"key":"11842_CR42","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.eswa.2019.04.054","volume":"132","author":"I Lopez-Gazpio","year":"2019","unstructured":"Lopez-Gazpio I, Maritxalar M, Lapata M, Agirre E (2019) Word n-gram attention models for sentence similarity and inference. Expert Syst Appl 132:1\u201311","journal-title":"Expert Syst Appl"},{"key":"11842_CR43","doi-asserted-by":"crossref","unstructured":"Parikh AP, T\u00e4ckstr\u00f6m O, Das D, Uszkoreit J (2016) A decomposable attention model for natural language inference. arXiv preprint arXiv:1606.01933","DOI":"10.18653\/v1\/D16-1244"},{"key":"11842_CR44","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1007\/s11063-024-11539-7","volume":"56","author":"X Zhou","year":"2024","unstructured":"Zhou X, Ren Z, Zhou S, Jiang Z, Yu T, Luo H (2024) Rethinking position embedding methods in the Transformer Architecture. Neural Process Lett 56:41. https:\/\/doi.org\/10.1007\/s11063-024-11539-7","journal-title":"Neural Process Lett"},{"key":"11842_CR45","doi-asserted-by":"publisher","first-page":"7109","DOI":"10.1007\/s10489-021-02188-7","volume":"51","author":"M Li","year":"2021","unstructured":"Li M, Zhao H, Su H, Qian Y, Li P (2021) Emotion-cause span extraction: a new task to emotion cause identification in texts. Appl Intell 51:7109\u20137121","journal-title":"Appl Intell"},{"key":"11842_CR46","doi-asserted-by":"publisher","first-page":"2339","DOI":"10.1109\/TASLP.2021.3089837","volume":"29","author":"C Fan","year":"2021","unstructured":"Fan C, Yuan C, Gui L, Zhang Y, Xu R (2021) Multi-task sequence tagging for emotion-cause pair extraction via tag distribution refinement. IEEE\/ACM Trans Audio Speech Lang Process 29:2339\u20132350","journal-title":"IEEE\/ACM Trans Audio Speech Lang Process"},{"key":"11842_CR47","doi-asserted-by":"crossref","unstructured":"Pagliardini M, Gupta P, Jaggi M (2017) Unsupervised learning of sentence embeddings using compositional n-gram features. arXiv preprint arXiv:1703.02507","DOI":"10.18653\/v1\/N18-1049"},{"key":"11842_CR48","doi-asserted-by":"crossref","unstructured":"Tai KS, Socher R, Manning CD (2015) Improved semantic representations from tree-structured long short-term memory networks. arXiv preprint arXiv:1503.00075","DOI":"10.3115\/v1\/P15-1150"},{"key":"11842_CR49","unstructured":"Choi J, Yoo KM, Lee S (2017) Unsupervised learning of task-specific tree structures with tree-lstms. arXiv preprint arXiv:1707.02786 17:143"},{"key":"11842_CR50","unstructured":"Chen Q, Zhu X, Ling Z, Wei S, Jiang H (2016) Enhancing and combining sequential and tree lstm for natural language inference. arXiv preprint arXiv:1609.06038"},{"key":"11842_CR51","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2020.106584","volume":"212","author":"G Hu","year":"2021","unstructured":"Hu G, Lu G, Zhao Y (2021) FSS-GCN: a graph convolutional networks with fusion of semantic and structure for emotion cause analysis. Knowl Based Syst 212:106584","journal-title":"Knowl Based Syst"},{"key":"11842_CR52","doi-asserted-by":"publisher","first-page":"3416","DOI":"10.3390\/app12073416","volume":"12","author":"W Zheng","year":"2022","unstructured":"Zheng W, Zhou Y, Liu S, Tian J, Yang B, Yin L (2022) A deep fusion matching network semantic reasoning model. Appl Sci 12:3416","journal-title":"Appl Sci"},{"key":"11842_CR53","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1007\/s11063-024-11616-x","volume":"56","author":"Z Chen","year":"2024","unstructured":"Chen Z, Zheng Y, Ge J, Yu W, Wang Z (2024) A parallel model for jointly extracting entities and relations. Neural Process Lett 56:165. https:\/\/doi.org\/10.1007\/s11063-024-11616-x","journal-title":"Neural Process Lett"}],"container-title":["Neural Processing Letters"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11063-026-11842-5","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11063-026-11842-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11063-026-11842-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T01:48:50Z","timestamp":1784252930000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11063-026-11842-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,24]]},"references-count":53,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2026,8]]}},"alternative-id":["11842"],"URL":"https:\/\/doi.org\/10.1007\/s11063-026-11842-5","relation":{},"ISSN":["1573-773X"],"issn-type":[{"value":"1573-773X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,24]]},"assertion":[{"value":"23 October 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 February 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 April 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors. The authors have no relevant financial or non-financial competing interests to declare.","order":1,"name":"Ethics","label":"Competing interest","group":{"name":"EthicsHeading","label":"Declarations"}}],"article-number":"47"}}