{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:36:48Z","timestamp":1760240208890,"version":"build-2065373602"},"reference-count":29,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2019,4,8]],"date-time":"2019-04-08T00:00:00Z","timestamp":1554681600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Special Plan of Major Scientific Instruments and Equipment of the State","award":["No.2018YFF01013101"],"award-info":[{"award-number":["No.2018YFF01013101"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Generative conversational systems consisting of a neural network-based structural model and a linguistic model have always been considered to be an attractive area. However, conversational systems tend to generate single-turn responses with a lack of diversity and informativeness. For this reason, the conversational system method is further developed by modeling and analyzing the joint structural and linguistic model, as presented in the paper. Firstly, we establish a novel dual-encoder structural model based on the new Convolutional Neural Network architecture and strengthened attention with intention. It is able to effectively extract the features of variable-length sequences and then mine their deep semantic information. Secondly, a linguistic model combining the maximum mutual information with the foolish punishment mechanism is proposed. Thirdly, the conversational system for the joint structural and linguistic model is observed and discussed. Then, to validate the effectiveness of the proposed method, some different models are tested, evaluated and compared with respect to Response Coherence, Response Diversity, Length of Conversation and Human Evaluation. As these comparative results show, the proposed method is able to effectively improve the response quality of the generative conversational system.<\/jats:p>","DOI":"10.3390\/s19071675","type":"journal-article","created":{"date-parts":[[2019,4,8]],"date-time":"2019-04-08T11:54:52Z","timestamp":1554724492000},"page":"1675","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Research on Modeling and Analysis of Generative Conversational System Based on Optimal Joint Structural and Linguistic Model"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2494-8667","authenticated-orcid":false,"given":"Yingzhong","family":"Tian","sequence":"first","affiliation":[{"name":"School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200072, China"},{"name":"Shanghai Key Laboratory of Intelligent Manufacturing and Robotics, Shanghai 200072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yafei","family":"Jia","sequence":"additional","affiliation":[{"name":"School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1973-8550","authenticated-orcid":false,"given":"Long","family":"Li","sequence":"additional","affiliation":[{"name":"School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200072, China"},{"name":"Shanghai Key Laboratory of Intelligent Manufacturing and Robotics, Shanghai 200072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zongnan","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenbin","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Mechanical and Electrical Engineering Shenzhen Polytechnic, Shenzhen 518055, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,4,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Xing, C., Wu, W., Wu, Y., Liu, J., Huang, Y., Zhou, M., and Ma, W.Y. (2017, January 4\u20139). Topic Aware Neural Response Generation. Proceedings of the AAAI\u201917 Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.","DOI":"10.1609\/aaai.v31i1.10981"},{"key":"ref_2","unstructured":"Kaisheng, Y., Baolin, P., Geoffrey, Z., and Kam-Fai, W. (arXiv, 2016). An Attentional Neural Conversation Model with Improved Specificity, arXiv."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Cao, K., and Clark, S. (2017, January 3\u20137). Latent Variable Dialogue Models and their Diversity. Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Short Papers, Valencia, Spain.","DOI":"10.18653\/v1\/E17-2029"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Sordoni, A., Bengio, Y., Vahabi, H., Lioma, C., Grue Simonsen, J., and Nie, J.Y. (2015, January 18\u201323). A Hierarchical Recurrent Encoder-Decoder for Generative Context-Aware Query Suggestion. Proceedings of the CIKM \u201915 24th ACM International on Conference on Information and Knowledge Management, Melbourne, Australia.","DOI":"10.1145\/2806416.2806493"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Serban Iulian, V., Sordoni, A., Lowe, R., Charlin, L., Pineau, J., Courville, A., and Bengio, Y. (2017, January 4\u20139). A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialogues. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.","DOI":"10.1609\/aaai.v31i1.10983"},{"key":"ref_6","first-page":"504","article-title":"A Conditional Variational Framework for Dialog Generation","volume":"2","author":"Shen","year":"2017","journal-title":"Assoc. Comput. Linguist."},{"key":"ref_7","first-page":"3104","article-title":"Sequence to Sequence Learning with Neural Networks","volume":"27","author":"Sutskever","year":"2014","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_8","first-page":"3349","article-title":"Sequence to Backward and Forward Sequence: A Content-Introducing Approach to Generative Short-Text Conversation","volume":"5","author":"Mou","year":"2016","journal-title":"Assoc. Comput. Linguist."},{"key":"ref_9","first-page":"1551","article-title":"Language Modeling with gated convolu-tional networks","volume":"2","author":"Dauphin","year":"2017","journal-title":"Int. Mach. Learn. Soc."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Fuji, R., and Jiawen, D. (2018). Background Knowledge Based Multi-Stream Neural Network for Text Classification. Appl. Sci., 8.","DOI":"10.3390\/app8122472"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"654","DOI":"10.3390\/app8050654","article-title":"Deep Neural Networks for Document Processing of Music Score Images","volume":"8","author":"Francisco","year":"2018","journal-title":"Appl. Sci."},{"key":"ref_12","first-page":"2029","article-title":"Convolutional Sequence to Sequence Learning","volume":"3","author":"Gehring","year":"2017","journal-title":"Int. Mach. Learn. Soc."},{"key":"ref_13","unstructured":"Zhang, Y., and Wallace, B.C. (2017). A Sensitivity Analysis of (and Practitioners\u2019 Guide to) Convolutional Neural Networks for Sentence Classification, Springer."},{"key":"ref_14","first-page":"123","article-title":"A Convolutional Encoder Model for Neural Machine Translation","volume":"1","author":"Gehring","year":"2016","journal-title":"ACL"},{"key":"ref_15","unstructured":"Jiwei, L., Michel, G., Brockett, C., Jianfeng, G., and Dolan, B. (2016, January 12\u201317). A Diversity-Promoting Objective Function for Neural Conversation Models. Proceedings of the NAACL-HLT 2016, San Diego, CA, USA."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Li, J., Monroe, W., Ritter, A., Galley, M., Jianfeng, G., and Jurafsky, D. (2016, January 1\u20135). Deep Reinforcement Learning for Dialogue Generation. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, TX, USA.","DOI":"10.18653\/v1\/D16-1127"},{"key":"ref_17","first-page":"175","article-title":"Attention, Intention, and the Structure of discourse","volume":"12","author":"Grosz","year":"1986","journal-title":"Comput. Linguist."},{"key":"ref_18","unstructured":"Yao, K., Zweig, G., and Peng, B. (2015, January 11). Attention with Intention for a Neural Network Conversation Model. Proceedings of the NIPS 2015 Workshop on Machine Learning for Spoken Language Understanding and Interaction, Montreal, QC, Canada."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Liu, C.W., Lowe, R., Serban, I.V., Noseworthy, M., Charlin, L., and Pineau, J. (2016, January 1\u20135). How Not to Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, TX, USA.","DOI":"10.18653\/v1\/D16-1230"},{"key":"ref_20","unstructured":"Kaiming, H., Xiangyu, Z., Shaoqing, R., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Computer Society, Las Vegas, NV, USA."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Kalchbrenner, N., Grefenstette, E., and Blunsom, P. (2014, January 23\u201325). A Convolutional Neural Network for Modelling Sentences. Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, Baltimore, MD, USA.","DOI":"10.3115\/v1\/P14-1062"},{"key":"ref_22","unstructured":"Minh-Thang, L., Hieu, P., and Manning, C.D. (2015, January 17\u201321). Effective Approaches to Attentional-Based Neural Machine Translation. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal."},{"key":"ref_23","unstructured":"Markus, F., and Yaser, A. (2017, January 4). Beam Search Strategies for Neural Machine Translation. Proceedings of the First Workshop on Neural Machine Translation, Vancouver, BC, Canada."},{"key":"ref_24","unstructured":"Vigayakumar, A.K., Cogswell, M., Selvaraju, R.R., Sun, Q., Stefan, L., Crandall, D., and Batra, D. (May, January 30). Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Models. Proceedings of the International Conference on Learning Representations, Vancouver, BC, Canada."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1075\/cilt.309.19tie","article-title":"News from OPUS\u2014A collection of multilingual parallel corpora with tools and interfaces","volume":"Volume 5","author":"Tiedemann","year":"2009","journal-title":"Recent Advances in Natural Language Processing"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1017\/S0269888912000343","article-title":"A Survey on Metrics for the Evaluation of User Simulations","volume":"28","author":"Pietquin","year":"2013","journal-title":"Knowl. Eng. Rev."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Galley, M., Brockett, C., Sordoni, A., Ji, Y., Auli, M., Quirk, C., Mitchell, M., Gao, J., and Dolan, B. (2015, January 26\u201331). \u03b4 BLEU: A discriminative metric for generation tasks with intrinsically diverse targets. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Short Papers), Beijing, China.","DOI":"10.3115\/v1\/P15-2073"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Papineni, K., Roukos, S., Ward, T., and Zhu, W.J. (2002, January 7\u201312). BLEU: A Method for Automatic Evaluation of Machine Translation. Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, Philadelphia, PA, USA.","DOI":"10.3115\/1073083.1073135"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhang, H., Lan, Y., Guo, J., Xu, J., and Cheng, X. (2018, January 13\u201319). Reinforcing coherence for sequence to sequence model in dialogue generation. Proceedings of the International Joint Conferences on Artificial Intelligence, Stockholm, Sweden.","DOI":"10.24963\/ijcai.2018\/635"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/7\/1675\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:43:44Z","timestamp":1760186624000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/7\/1675"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,4,8]]},"references-count":29,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2019,4]]}},"alternative-id":["s19071675"],"URL":"https:\/\/doi.org\/10.3390\/s19071675","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2019,4,8]]}}}