{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T23:53:37Z","timestamp":1773791617108,"version":"3.50.1"},"reference-count":107,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2021,3,15]],"date-time":"2021-03-15T00:00:00Z","timestamp":1615766400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"VC Research","award":["VCR 0000059"],"award-info":[{"award-number":["VCR 0000059"]}]},{"name":"AI University Research Centre (AI-URC) through the XJTLU Key Program Special Fund","award":["(KSF-P-02) and KSF-A-17"],"award-info":[{"award-number":["(KSF-P-02) and KSF-A-17"]}]},{"name":"Suzhou Bureau of Sci. and Tech. and the Key Industrial Tech. Inno. program","award":["SYG201840"],"award-info":[{"award-number":["SYG201840"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Internet Technol."],"published-print":{"date-parts":[[2021,6,23]]},"abstract":"<jats:p>Cyber-Physical Systems (CPS), as a multi-dimensional complex system that connects the physical world and the cyber world, has a strong demand for processing large amounts of heterogeneous data. These tasks also include Natural Language Inference (NLI) tasks based on text from different sources. However, the current research on natural language processing in CPS does not involve exploration in this field. Therefore, this study proposes a Siamese Network structure that combines Stacked Residual Long Short-Term Memory (bidirectional) with the Attention mechanism and Capsule Network for the NLI module in CPS, which is used to infer the relationship between text\/language data from different sources. This model is mainly used to implement NLI tasks and conduct a detailed evaluation in three main NLI benchmarks as the basic semantic understanding module in CPS. Comparative experiments prove that the proposed method achieves competitive performance, has a certain generalization ability, and can balance the performance and the number of trained parameters.<\/jats:p>","DOI":"10.1145\/3418208","type":"journal-article","created":{"date-parts":[[2021,3,15]],"date-time":"2021-03-15T20:21:14Z","timestamp":1615839674000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":16,"title":["A Hybrid Siamese Neural Network for Natural Language Inference in Cyber-Physical Systems"],"prefix":"10.1145","volume":"21","author":[{"given":"Pin","family":"Ni","sequence":"first","affiliation":[{"name":"The University of Auckland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuming","family":"Li","sequence":"additional","affiliation":[{"name":"The University of Auckland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gangmin","family":"Li","sequence":"additional","affiliation":[{"name":"Xi\u2019an Jiaotong-Liverpool University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Victor","family":"Chang","sequence":"additional","affiliation":[{"name":"Teesside University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,3,15]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12859-019-3119-4"},{"key":"e_1_2_1_2_1","volume-title":"Overview of the MEDIQA 2019 shared task on textual inference, question entailment and question answering. In Proceedings of the 18th BioNLP Workshop and Shared Task. 370\u2013379","author":"Abacha Asma Ben","year":"2019","unstructured":"Asma Ben Abacha , Chaitanya Shivade , and Dina Demner-Fushman . 2019 . Overview of the MEDIQA 2019 shared task on textual inference, question entailment and question answering. In Proceedings of the 18th BioNLP Workshop and Shared Task. 370\u2013379 . Asma Ben Abacha, Chaitanya Shivade, and Dina Demner-Fushman. 2019. Overview of the MEDIQA 2019 shared task on textual inference, question entailment and question answering. In Proceedings of the 18th BioNLP Workshop and Shared Task. 370\u2013379."},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the 2nd PASCAL Challenges Workshop on Recognising Textual Entailment. 128\u2013133","author":"Adams Rod","year":"2006","unstructured":"Rod Adams . 2006 . Textual entailment through extended lexical overlap . In Proceedings of the 2nd PASCAL Challenges Workshop on Recognising Textual Entailment. 128\u2013133 . Rod Adams. 2006. Textual entailment through extended lexical overlap. In Proceedings of the 2nd PASCAL Challenges Workshop on Recognising Textual Entailment. 128\u2013133."},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the 1st PASCAL Challenges Workshop on Recognising Textual Entailment.","author":"Akhmatova Elena","year":"2005","unstructured":"Elena Akhmatova . 2005 . Textual entailment resolution via atomic propositions . In Proceedings of the 1st PASCAL Challenges Workshop on Recognising Textual Entailment. Elena Akhmatova. 2005. Textual entailment resolution via atomic propositions. In Proceedings of the 1st PASCAL Challenges Workshop on Recognising Textual Entailment."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/1892211.1892215"},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 344\u2013354","author":"Angeli Gabor","unstructured":"Gabor Angeli , Melvin Jose Johnson Premkumar , and Christopher D. Manning . 2015. Leveraging linguistic structure for open domain information extraction . In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 344\u2013354 . Gabor Angeli, Melvin Jose Johnson Premkumar, and Christopher D. Manning. 2015. Leveraging linguistic structure for open domain information extraction. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 344\u2013354."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-5310"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/1619645.1619785"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the 1st Challenge Workshop: Recognizing Textual Entailment.","author":"Bayer Samuel","year":"2005","unstructured":"Samuel Bayer , John Burger , Lisa Ferro , John Henderson , and Er Yeh . 2005 . MITRE\u2019s submission to the EU Pascal RTE Challenge . In Proceedings of the 1st Challenge Workshop: Recognizing Textual Entailment. Samuel Bayer, John Burger, Lisa Ferro, John Henderson, and Er Yeh. 2005. MITRE\u2019s submission to the EU Pascal RTE Challenge. In Proceedings of the 1st Challenge Workshop: Recognizing Textual Entailment."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287763"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing. 632\u2013642","author":"Bowman Samuel","unstructured":"Samuel Bowman , Gabor Angeli , Christopher Potts , and Christopher D. Manning . 2015. A large annotated corpus for learning natural language inference . In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing. 632\u2013642 . Samuel Bowman, Gabor Angeli, Christopher Potts, and Christopher D. Manning. 2015. A large annotated corpus for learning natural language inference. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing. 632\u2013642."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/2987189.2987282"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2018-70"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1224"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1152"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-5307"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1070"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCDS.2019.2927399"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long and Short Papers). 4171\u20134186","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of deep bidirectional transformers for language understanding . In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long and Short Papers). 4171\u20134186 . Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long and Short Papers). 4171\u20134186."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1031171.1031289"},{"key":"e_1_2_1_21_1","volume-title":"Microsoft research paraphrase corpus. Microsoft. Retrieved","author":"Dolan Bill","year":"2020","unstructured":"Bill Dolan , Chris Brockett , and Chris Quirk . 2005. Microsoft research paraphrase corpus. Microsoft. Retrieved May 3, 2020 from https:\/\/www.microsoft.com\/en-us\/download\/details.aspx?id=52398. Bill Dolan, Chris Brockett, and Chris Quirk. 2005. Microsoft research paraphrase corpus. Microsoft. Retrieved May 3, 2020 from https:\/\/www.microsoft.com\/en-us\/download\/details.aspx?id=52398."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377704"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 2nd Joint Conference on Lexical and Computational Semantics (*Sem)","volume":"2","author":"Dzikovska Myroslava O.","year":"2013","unstructured":"Myroslava O. Dzikovska , Rodney Nielsen , Chris Brew , Claudia Leacock , Danilo Giampiccolo , Luisa Bentivogli , Peter Clark , Ido Dagan , and Hoa Trang Dang . 2013 . SemEval-2013 Task 7: The joint student response analysis and 8th recognizing textual entailment challenge . In Proceedings of the 2nd Joint Conference on Lexical and Computational Semantics (*Sem) , Volume 2 , Co-located with Proceedings of the 7th International Workshop on Semantic Evaluation (SemEval\u201913). 263\u2013274. Myroslava O. Dzikovska, Rodney Nielsen, Chris Brew, Claudia Leacock, Danilo Giampiccolo, Luisa Bentivogli, Peter Clark, Ido Dagan, and Hoa Trang Dang. 2013. SemEval-2013 Task 7: The joint student response analysis and 8th recognizing textual entailment challenge. In Proceedings of the 2nd Joint Conference on Lexical and Computational Semantics (*Sem), Volume 2, Co-located with Proceedings of the 7th International Workshop on Semantic Evaluation (SemEval\u201913). 263\u2013274."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-015-9313-8"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210183"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-1132"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-017-9584-0"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the International Conference on Learning Representations.","author":"Gong Yichen","year":"2018","unstructured":"Yichen Gong , Heng Luo , and Jian Zhang . 2018 . Natural language inference over interaction space . In Proceedings of the International Conference on Learning Representations. Yichen Gong, Heng Luo, and Jian Zhang. 2018. Natural language inference over interaction space. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2013.6638947"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the International Conference on Recent Developments in Science, Engineering, and Technology. 287\u2013297","author":"Gupta Anand","year":"2017","unstructured":"Anand Gupta , Manpreet Kaur , Disha Garg , and Karuna Saini . 2017 . Using variant directional dis (similarity) measures for the task of textual entailment . In Proceedings of the International Conference on Recent Developments in Science, Engineering, and Technology. 287\u2013297 . Anand Gupta, Manpreet Kaur, Disha Garg, and Karuna Saini. 2017. Using variant directional dis (similarity) measures for the task of textual entailment. In Proceedings of the International Conference on Recent Developments in Science, Engineering, and Technology. 287\u2013297."},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 2: Short Papers). 107\u2013112","author":"Gururangan Suchin","unstructured":"Suchin Gururangan , Swabha Swayamdipta , Omer Levy , Roy Schwartz , Samuel Bowman , and Noah A. Smith . 2018. Annotation artifacts in natural language inference data . In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 2: Short Papers). 107\u2013112 . Suchin Gururangan, Swabha Swayamdipta, Omer Levy, Roy Schwartz, Samuel Bowman, and Noah A. Smith. 2018. Annotation artifacts in natural language inference data. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 2: Short Papers). 107\u2013112."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.3115\/1220175.1220289"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2007.01.004"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.5555\/1857999.1858143"},{"key":"e_1_2_1_35_1","unstructured":"Geoffrey Hinton Oriol Vinyals and Jeff Dean. 2015. Distilling the knowledge in a neural network. arXiv:1503.02531  Geoffrey Hinton Oriol Vinyals and Jeff Dean. 2015. Distilling the knowledge in a neural network. arXiv:1503.02531"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4700\u20134708","author":"Huang Gao","unstructured":"Gao Huang , Zhuang Liu , Laurens Van Der Maaten , and Kilian Q. Weinberger . 2017. Densely connected convolutional networks . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4700\u20134708 . Gao Huang, Zhuang Liu, Laurens Van Der Maaten, and Kilian Q. Weinberger. 2017. Densely connected convolutional networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4700\u20134708."},{"key":"e_1_2_1_37_1","unstructured":"Jinbae Im and Sungzoon Cho. 2017. Distance-based self-attention network for natural language inference. arXiv:1712.02047  Jinbae Im and Sungzoon Cho. 2017. Distance-based self-attention network for natural language inference. arXiv:1712.02047"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. 891\u2013896","author":"Ji Yangfeng","year":"2013","unstructured":"Yangfeng Ji and Jacob Eisenstein . 2013 . Discriminative improvements to distributional sentence similarity . In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. 891\u2013896 . Yangfeng Ji and Jacob Eisenstein. 2013. Discriminative improvements to distributional sentence similarity. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. 891\u2013896."},{"key":"e_1_2_1_39_1","doi-asserted-by":"crossref","unstructured":"Xiaoqi Jiao Yichun Yin Lifeng Shang Xin Jiang Xiao Chen Linlin Li Fang Wang and Qun Liu. 2019. TinyBERT: Distilling BERT for natural language understanding. arXiv:1909.10351  Xiaoqi Jiao Yichun Yin Lifeng Shang Xin Jiang Xiao Chen Linlin Li Fang Wang and Qun Liu. 2019. TinyBERT: Distilling BERT for natural language understanding. arXiv:1909.10351","DOI":"10.18653\/v1\/2020.findings-emnlp.372"},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the PASCAL Challenges Workshop on Recognising Textual Entailment. 73\u201376","author":"Jijkoun Valentin","year":"2005","unstructured":"Valentin Jijkoun and Maarten de Rijke . 2005 . Recognizing textual entailment using lexical similarity . In Proceedings of the PASCAL Challenges Workshop on Recognising Textual Entailment. 73\u201376 . Valentin Jijkoun and Maarten de Rijke. 2005. Recognizing textual entailment using lexical similarity. In Proceedings of the PASCAL Challenges Workshop on Recognising Textual Entailment. 73\u201376."},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the 32nd AAAI Conference on Artificial Intelligence.","author":"Khot Tushar","year":"2018","unstructured":"Tushar Khot , Ashish Sabharwal , and Peter Clark . 2018 . SciTail: A textual entailment dataset from science question answering . In Proceedings of the 32nd AAAI Conference on Artificial Intelligence. Tushar Khot, Ashish Sabharwal, and Peter Clark. 2018. SciTail: A textual entailment dataset from science question answering. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33016586"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.5555\/2969442.2969607"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.24007"},{"key":"e_1_2_1_45_1","unstructured":"Guanyu Li Pengfei Zhang and Caiyan Jia. 2018. Attention boosted sequential inference model. arXiv:1812.01840  Guanyu Li Pengfei Zhang and Caiyan Jia. 2018. Attention boosted sequential inference model. arXiv:1812.01840"},{"key":"e_1_2_1_46_1","volume-title":"Proceedings of the 5th International Conference on Complexity, Future Information Systems, and Risk\u2014Volume 1: COMPLEXIS. 53\u201360","author":"Li Yuming","unstructured":"Yuming Li , Pin Ni , Gangmin Li , and Victor Chang .2020. Effective piecewise CNN with attention mechanism for distant supervision on relation extraction task . In Proceedings of the 5th International Conference on Complexity, Future Information Systems, and Risk\u2014Volume 1: COMPLEXIS. 53\u201360 . DOI:https:\/\/doi.org\/10.5220\/0009582700530060 10.5220\/0009582700530060 Yuming Li, Pin Ni, Gangmin Li, and Victor Chang.2020. Effective piecewise CNN with attention mechanism for distant supervision on relation extraction task. In Proceedings of the 5th International Conference on Complexity, Future Information Systems, and Risk\u2014Volume 1: COMPLEXIS. 53\u201360. DOI:https:\/\/doi.org\/10.5220\/0009582700530060"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/BigData47090.2019.9005449"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.5555\/2145432.2145476"},{"key":"e_1_2_1_49_1","unstructured":"Xiaodong Liu Kevin Duh and Jianfeng Gao. 2018. Stochastic answer networks for natural language inference. arXiv:1804.07888  Xiaodong Liu Kevin Duh and Jianfeng Gao. 2018. Stochastic answer networks for natural language inference. arXiv:1804.07888"},{"key":"e_1_2_1_50_1","unstructured":"Xiaodong Liu Pengcheng He Weizhu Chen and Jianfeng Gao. 2019. Improving multi-task deep neural networks via knowledge distillation for natural language understanding. arXiv:1904.09482  Xiaodong Liu Pengcheng He Weizhu Chen and Jianfeng Gao. 2019. Improving multi-task deep neural networks via knowledge distillation for natural language understanding. arXiv:1904.09482"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1441"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.5555\/1654536.1654575"},{"key":"e_1_2_1_53_1","volume-title":"Human Language Technology","author":"Matsuyoshi Suguru","unstructured":"Suguru Matsuyoshi . 2016. Identification of event and topic for multi-document summarization . In Human Language Technology . Springer , 304. Suguru Matsuyoshi. 2016. Identification of event and topic for multi-document summarization. In Human Language Technology. Springer, 304."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.5555\/3295222.3295377"},{"key":"e_1_2_1_55_1","volume-title":"Proceedings of the 2009 Text Analysis Conference (TAC \u201909)","author":"Mehdad Yashar","year":"2009","unstructured":"Yashar Mehdad , Matteo Negri , Elena Cabrio , Milen Ognianov Kouylekov , and Bernardo Magnini . 2009 . EDITS: An open source framework for recognizing textual entailment . In Proceedings of the 2009 Text Analysis Conference (TAC \u201909) . Yashar Mehdad, Matteo Negri, Elena Cabrio, Milen Ognianov Kouylekov, and Bernardo Magnini. 2009. EDITS: An open source framework for recognizing textual entailment. In Proceedings of the 2009 Text Analysis Conference (TAC \u201909)."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.3115\/1073445.1073467"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-2022"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/E17-1002"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-020-04805-x"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/BigData47090.2019.9006331"},{"key":"e_1_2_1_61_1","volume-title":"Goodman","author":"Nie Allen","year":"2017","unstructured":"Allen Nie , Erin D. Bennett , and Noah D . Goodman . 2017 . Dissent : Sentence representation learning from explicit discourse relations. arXiv:1710.04334 Allen Nie, Erin D. Bennett, and Noah D. Goodman. 2017. Dissent: Sentence representation learning from explicit discourse relations. arXiv:1710.04334"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-5308"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1017\/S135132490999012X"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.13052\/jwe1540-9589.1785"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10590-009-9060-y"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1091"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-1202"},{"key":"e_1_2_1_68_1","volume-title":"Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers. 2923\u20132934","author":"Prakash Aaditya","year":"2016","unstructured":"Aaditya Prakash , Sadid A. Hasan , Kathy Lee , Vivek Datla , Ashequl Qadir , Joey Liu , and Oladimeji Farri . 2016 . Neural paraphrase generation with stacked residual LSTM networks . In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers. 2923\u20132934 . Aaditya Prakash, Sadid A. Hasan, Kathy Lee, Vivek Datla, Ashequl Qadir, Joey Liu, and Oladimeji Farri. 2016. Neural paraphrase generation with stacked residual LSTM networks. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers. 2923\u20132934."},{"key":"e_1_2_1_69_1","volume-title":"Retrieved","author":"Radford Alec","year":"2018","unstructured":"Alec Radford , Karthik Narasimhan , Tim Salimans , and Ilya Sutskever . 2018 . Improving language understanding by generative pre-training . Retrieved January 25, 2021 from https:\/\/s3-us-west-2.amazonaws.com\/openai-assets\/research-covers\/language-unsupervised\/language_understanding_paper.pdf. Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever. 2018. Improving language understanding by generative pre-training. Retrieved January 25, 2021 from https:\/\/s3-us-west-2.amazonaws.com\/openai-assets\/research-covers\/language-unsupervised\/language_understanding_paper.pdf."},{"key":"e_1_2_1_70_1","volume-title":"Liu","author":"Raffel Colin","year":"2019","unstructured":"Colin Raffel , Noam Shazeer , Adam Roberts , Katherine Lee , Sharan Narang , Michael Matena , Yanqi Zhou , Wei Li , and Peter J . Liu . 2019 . Exploring the limits of transfer learning with a unified text-to-text transformer. arXiv:1910.10683 Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2019. Exploring the limits of transfer learning with a unified text-to-text transformer. arXiv:1910.10683"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.5555\/1619499.1619510"},{"key":"e_1_2_1_72_1","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR\u201916)","author":"Rockt\u00e4schel Tim","year":"2016","unstructured":"Tim Rockt\u00e4schel , Edward Grefenstette , Karl Moritz Hermann , Tom\u00e1\u0161 Ko\u010disk\u1ef3 , and Phil Blunsom . 2016 . Reasoning about entailment with neural attention . In Proceedings of the International Conference on Learning Representations (ICLR\u201916) . Tim Rockt\u00e4schel, Edward Grefenstette, Karl Moritz Hermann, Tom\u00e1\u0161 Ko\u010disk\u1ef3, and Phil Blunsom. 2016. Reasoning about entailment with neural attention. In Proceedings of the International Conference on Learning Representations (ICLR\u201916)."},{"key":"e_1_2_1_73_1","volume-title":"Proceedings of the 11th Conference of the European Chapter of the Association for Computational Linguistics.","author":"Romano Lorenza","year":"2006","unstructured":"Lorenza Romano , Milen Kouylekov , Idan Szpektor , Ido Dagan , and Alberto Lavelli . 2006 . Investigating a generic paraphrase-based approach for relation extraction . In Proceedings of the 11th Conference of the European Chapter of the Association for Computational Linguistics. Lorenza Romano, Milen Kouylekov, Idan Szpektor, Ido Dagan, and Alberto Lavelli. 2006. Investigating a generic paraphrase-based approach for relation extraction. In Proceedings of the 11th Conference of the European Chapter of the Association for Computational Linguistics."},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00118"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.5555\/3294996.3295142"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1041"},{"key":"e_1_2_1_77_1","volume-title":"Proceedings of the 2018 AAAI Conference on Artificial Intelligence. 5446\u20135455","author":"Shen Tao","year":"2018","unstructured":"Tao Shen , Jing Jiang , Tianyi Zhou , Shirui Pan , Guodong Long , and Chengqi Zhang . 2018 . DiSAN: Directional self-attention network for RNN\/CNN-free language understanding . In Proceedings of the 2018 AAAI Conference on Artificial Intelligence. 5446\u20135455 . Tao Shen, Jing Jiang, Tianyi Zhou, Shirui Pan, Guodong Long, and Chengqi Zhang. 2018. DiSAN: Directional self-attention network for RNN\/CNN-free language understanding. In Proceedings of the 2018 AAAI Conference on Artificial Intelligence. 5446\u20135455."},{"key":"e_1_2_1_78_1","unstructured":"Ta-Chun Su and Hsiang-Chih Cheng. 2019. SesameBERT: Attention for anywhere. arXiv:1910.03176  Ta-Chun Su and Hsiang-Chih Cheng. 2019. SesameBERT: Attention for anywhere. arXiv:1910.03176"},{"key":"e_1_2_1_79_1","volume-title":"Proceedings of the International Conference on Learning Representations.","author":"Subramanian Sandeep","unstructured":"Sandeep Subramanian , Adam Trischler , Yoshua Bengio , and Christopher J. Pal . 2018. Learning general purpose distributed sentence representations via large scale multi-task learning . In Proceedings of the International Conference on Learning Representations. Sandeep Subramanian, Adam Trischler, Yoshua Bengio, and Christopher J. Pal. 2018. Learning general purpose distributed sentence representations via large scale multi-task learning. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1441"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2011.2161529"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.5555\/3304222.3304383"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1044"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1185"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210009"},{"key":"e_1_2_1_86_1","unstructured":"Iulia Turc Ming-Wei Chang Kenton Lee and Kristina Toutanova. 2019. Well-read students learn better: The impact of student initialization on knowledge distillation. arXiv:1980.08962  Iulia Turc Ming-Wei Chang Kenton Lee and Kristina Toutanova. 2019. Well-read students learn better: The impact of student initialization on knowledge distillation. arXiv:1980.08962"},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.5555\/3295222.3295349"},{"key":"e_1_2_1_88_1","volume-title":"NLP4RE 2019: The 2nd Workshop on Natural Language Processing for Requirements Engineering.","author":"Vogelsang Andreas","unstructured":"Andreas Vogelsang , Kerstin Hartig , Florian Pudlitz , Aaron Schlutter , and Jonas Winkler . 2019. Supporting the development of cyber-physical systems with natural language processing: A report . In NLP4RE 2019: The 2nd Workshop on Natural Language Processing for Requirements Engineering. Andreas Vogelsang, Kerstin Hartig, Florian Pudlitz, Aaron Schlutter, and Jonas Winkler. 2019. Supporting the development of cyber-physical systems with natural language processing: A report. In NLP4RE 2019: The 2nd Workshop on Natural Language Processing for Requirements Engineering."},{"key":"e_1_2_1_89_1","first-page":"17","volume-title":"Proceedings of the 2nd Workshop on Evaluating Vector Space Representations for NLP. 56\u201360","author":"Vu Hoa Trong","year":"1865","unstructured":"Hoa Trong Vu , Thuong-Hai Pham , Xiaoyu Bai , Marc Tanti , Lonneke van der Plas, and Albert Gatt. 2017. LCT-MALTA\u2019s submission to RepEval 2017 shared task . In Proceedings of the 2nd Workshop on Evaluating Vector Space Representations for NLP. 56\u201360 . DOI:https:\/\/doi.org\/10. 1865 3\/v1\/W 17 - 5311 10.18653\/v1 Hoa Trong Vu, Thuong-Hai Pham, Xiaoyu Bai, Marc Tanti, Lonneke van der Plas, and Albert Gatt. 2017. LCT-MALTA\u2019s submission to RepEval 2017 shared task. In Proceedings of the 2nd Workshop on Evaluating Vector Space Representations for NLP. 56\u201360. DOI:https:\/\/doi.org\/10.18653\/v1\/W17-5311"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-5446"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-1170"},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.5555\/3171837.3171865"},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-44739-0_35"},{"key":"e_1_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-1101"},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2020.01.064"},{"key":"e_1_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.3390\/s17020403"},{"key":"e_1_2_1_97_1","unstructured":"Canwen Xu Wangchunshu Zhou Tao Ge Furu Wei and Ming Zhou. 2020. BERT-of-Theseus: Compressing BERT by progressive module replacing. arxiv:cs.CL\/2002.02925  Canwen Xu Wangchunshu Zhou Tao Ge Furu Wei and Ming Zhou. 2020. BERT-of-Theseus: Compressing BERT by progressive module replacing. arxiv:cs.CL\/2002.02925"},{"key":"e_1_2_1_98_1","volume-title":"Proceedings of the 2nd Workshop on Evaluating Vector Space Representations for NLP. 46\u201350","author":"Yang Han","unstructured":"Han Yang , Marta R Costa-Juss\u00e0 , and Jos\u00e9 A. R. Fonollosa . 2017. Character-level intra attention network for natural language inference . In Proceedings of the 2nd Workshop on Evaluating Vector Space Representations for NLP. 46\u201350 . Han Yang, Marta R Costa-Juss\u00e0, and Jos\u00e9 A. R. Fonollosa. 2017. Character-level intra attention network for natural language inference. In Proceedings of the 2nd Workshop on Evaluating Vector Space Representations for NLP. 46\u201350."},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1465"},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00097"},{"key":"e_1_2_1_101_1","unstructured":"Deunsol Yoon Dongbok Lee and SangKeun Lee. 2018. Dynamic self-attention: Computing attention over words dynamically for sentence embedding. arXiv:1808.07383  Deunsol Yoon Dongbok Lee and SangKeun Lee. 2018. Dynamic self-attention: Computing attention over words dynamically for sentence embedding. arXiv:1808.07383"},{"key":"e_1_2_1_102_1","doi-asserted-by":"publisher","DOI":"10.5555\/1859664.1859673"},{"key":"e_1_2_1_103_1","unstructured":"Wojciech Zaremba and Ilya Sutskever. 2014. Learning to execute. arXiv:1410.4615  Wojciech Zaremba and Ilya Sutskever. 2014. Learning to execute. arXiv:1410.4615"},{"key":"e_1_2_1_104_1","doi-asserted-by":"publisher","DOI":"10.5555\/3298483.3298688"},{"key":"e_1_2_1_105_1","volume-title":"Proceedings of the 33rd Pacific Asia Conference on Language, Information, and Computation (PACLIC\u201919)","author":"Zhang Zhuosheng","year":"2019","unstructured":"Zhuosheng Zhang , Yuwei Wu , Zuchao Li , and Hai Zhao . 2019 . Explicit contextual semantics for text comprehension . In Proceedings of the 33rd Pacific Asia Conference on Language, Information, and Computation (PACLIC\u201919) . 298\u2013308. Zhuosheng Zhang, Yuwei Wu, Zuchao Li, and Hai Zhao. 2019. Explicit contextual semantics for text comprehension. In Proceedings of the 33rd Pacific Asia Conference on Language, Information, and Computation (PACLIC\u201919). 298\u2013308."},{"key":"e_1_2_1_106_1","volume-title":"Proceedings of the 34th AAAI Conference on Artificial Intelligence (AAAI\u201920)","author":"Zhang Zhuosheng","year":"2020","unstructured":"Zhuosheng Zhang , Yuwei Wu , Hai Zhao , Zuchao Li , Shuailiang Zhang , Xi Zhou , and Xiang Zhou . 2020 . Semantics-aware BERT for language understanding . In Proceedings of the 34th AAAI Conference on Artificial Intelligence (AAAI\u201920) . Zhuosheng Zhang, Yuwei Wu, Hai Zhao, Zuchao Li, Shuailiang Zhang, Xi Zhou, and Xiang Zhou. 2020. Semantics-aware BERT for language understanding. In Proceedings of the 34th AAAI Conference on Artificial Intelligence (AAAI\u201920)."},{"key":"e_1_2_1_107_1","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing.","author":"Zhao Wei","year":"2018","unstructured":"Wei Zhao , Jianbo Ye , Min Yang , Zeyang Lei , Suofei Zhang , and Zhou Zhao . 2018 . Investigating capsule networks with dynamic routing for text classification . In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. Wei Zhao, Jianbo Ye, Min Yang, Zeyang Lei, Suofei Zhang, and Zhou Zhao. 2018. Investigating capsule networks with dynamic routing for text classification. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing."}],"container-title":["ACM Transactions on Internet Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3418208","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3418208","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:36Z","timestamp":1750195896000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3418208"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,15]]},"references-count":107,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,6,23]]}},"alternative-id":["10.1145\/3418208"],"URL":"https:\/\/doi.org\/10.1145\/3418208","relation":{},"ISSN":["1533-5399","1557-6051"],"issn-type":[{"value":"1533-5399","type":"print"},{"value":"1557-6051","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,15]]},"assertion":[{"value":"2020-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-03-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}