{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:27:58Z","timestamp":1760232478688,"version":"build-2065373602"},"reference-count":36,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2022,11,3]],"date-time":"2022-11-03T00:00:00Z","timestamp":1667433600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Emotional tracking on time-varying virtual space communication aims to identify sentiments and opinions expressed in a piece of user-generated content. However, the existing research mainly focuses on the user\u2019s single post, despite the fact that social network data are sequential. In this article, we propose a sentiment analysis model based on time series prediction in order to understand and master the chronological evolution of the user\u2019s point of view. Specifically, with the help of a domain-knowledge-enhanced pre-trained encoder, the model embeds tokens for each moment in the text sequence. We then propose an attention-based temporal prediction model to extract rich timing information from historical posting records, which improves the prediction of the user\u2019s current state and personalizes the analysis of user\u2019s sentiment changes in social networks. The experiments show that the proposed model improves on four kinds of sentiment tasks and significantly outperforms the strong baseline.<\/jats:p>","DOI":"10.3390\/s22218450","type":"journal-article","created":{"date-parts":[[2022,11,3]],"date-time":"2022-11-03T04:49:20Z","timestamp":1667450960000},"page":"8450","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Synergy Masks of Domain Attribute Model DaBERT: Emotional Tracking on Time-Varying Virtual Space Communication"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7992-3892","authenticated-orcid":false,"given":"Ye","family":"Wang","sequence":"first","affiliation":[{"name":"College of Computer, National University of Defense Technology, Changsha 410073, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1841-539X","authenticated-orcid":false,"given":"Zhenghan","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Software & Microelectronics, Peking University, Beijing 100191, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1083-9486","authenticated-orcid":false,"given":"Changzeng","family":"Fu","sequence":"additional","affiliation":[{"name":"SSTC, Northeastern University, Qinhuangdao 066004, China"},{"name":"Graduate School of Engineering Science, Osaka University, Toyonaka 560-0043, Osaka, Japan"}]}],"member":"1968","published-online":{"date-parts":[[2022,11,3]]},"reference":[{"key":"ref_1","unstructured":"Ecemi\u015f, A., Dokuz, A.\u015e., and Celik, M. (2018, January 10\u201311). Temporal Sentiment Analysis of Socially Important Locations of Social Media Users. Proceedings of the Third International Conference on Smart City Applications, Tetouan, Morocco."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/S0925-2312(01)00702-0","article-title":"Time series forecasting using a hybrid ARIMA and neural network model","volume":"50","author":"Zhang","year":"2003","journal-title":"Neurocomputing"},{"key":"ref_3","unstructured":"Kenton, J.D.M.W.C., and Toutanova, L.K. (2019, January 2\u20137). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the NAACL-HLT, Minneapolis, MN, USA."},{"key":"ref_4","unstructured":"Pang, B., Lee, L., and Vaithyanathan, S. (2002, January 6\u20137). Thumbs up? Sentiment Classification using Machine Learning Techniques. Proceedings of the 2002 Conference on Empirical Methods in Natural Language Processing (EMNLP 2002), Philadelphia, PA, USA."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Poria, S., Chaturvedi, I., Cambria, E., and Bisio, F. (2016, January 24\u201329). Sentic LDA: Improving on LDA with semantic similarity for aspect-based sentiment analysis. Proceedings of the 2016 International Joint Conference on Neural Networks (IJCNN), Vancouver, BC, Canada.","DOI":"10.1109\/IJCNN.2016.7727784"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1007\/s10791-010-9141-9","article-title":"Investigating task performance of probabilistic topic models: An empirical study of PLSA and LDA","volume":"14","author":"Lu","year":"2011","journal-title":"Inf. Retr."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Lin, C., He, Y., Pedrinaci, C., and Domingue, J. (2012, January 11\u201315). Feature lda: A supervised topic model for automatic detection of web api documentations from the web. Proceedings of the International Semantic Web Conference, Boston, MA, USA.","DOI":"10.1007\/978-3-642-35176-1_21"},{"key":"ref_8","unstructured":"Perotte, A., Wood, F., Elhadad, N., and Bartlett, N. (2011). Hierarchically supervised latent Dirichlet allocation. Adv. Neural Inf. Process. Syst., 24."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1016\/j.knosys.2016.05.032","article-title":"Contextual sentiment analysis for social media genres","volume":"108","author":"Muhammad","year":"2016","journal-title":"Knowl.-Based Syst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Akhtar, M.S., Kumar, A., Ghosal, D., Ekbal, A., and Bhattacharyya, P. (2017, January 7\u201311). A multilayer perceptron based ensemble technique for fine-grained financial sentiment analysis. Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, Copenhagen, Denmark.","DOI":"10.18653\/v1\/D17-1057"},{"key":"ref_11","unstructured":"McCann, B., Bradbury, J., Xiong, C., and Socher, R. (2017, January 4\u20139). Learned in translation: Contextualized word vectors. Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, Long Beach, CA, USA."},{"key":"ref_12","unstructured":"Yao, L., Mao, C., and Luo, Y. (February, January 27). Graph convolutional networks for text classification. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lai, G., Chang, W.C., Yang, Y., and Liu, H. (2018, January 8\u201312). Modeling Long-and Short-Term Temporal Patterns with Deep Neural Networks. Proceedings of the SIGIR, Ann Arbor, MI, USA.","DOI":"10.1145\/3209978.3210006"},{"key":"ref_14","unstructured":"Li, Y., Yu, R., Shahabi, C., and Liu, Y. (May, January 30). Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting. Proceedings of the International Conference on Learning Representations, Vancouver, BC, Canada."},{"key":"ref_15","unstructured":"Franceschi, J.Y., Dieuleveut, A., and Jaggi, M. (2019, January 8\u201314). Unsupervised scalable representation learning for multivariate time series. Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, Vancouver, BC, Canada."},{"key":"ref_16","unstructured":"Oreshkin, B.N., Carpov, D., Chapados, N., and Bengio, Y. (2019, January 6\u20139). N-BEATS: Neural basis expansion analysis for interpretable time series forecasting. Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA."},{"key":"ref_17","unstructured":"Sen, R., Yu, H.F., and Dhillon, I.S. (2019, January 8\u201314). Think globally, act locally: A deep neural network approach to high-dimensional time series forecasting. Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, Vancouver, BC, Canada."},{"key":"ref_18","first-page":"815","article-title":"Chinese mood variation analysis based on Sina Weibo","volume":"33","author":"Jingying","year":"2016","journal-title":"J. Univ. Chin. Acad. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Giachanou, A., and Crestani, F. (2016, January 17\u201321). Tracking sentiment by time series analysis. Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, Pisa, Italy.","DOI":"10.1145\/2911451.2914702"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"O\u2019Connor, B., Balasubramanyan, R., Routledge, B.R., and Smith, N.A. (2010, January 23\u201326). From tweets to polls: Linking text sentiment to public opinion time series. Proceedings of the Fourth International AAAI Conference on Weblogs and Social Media, Washington, DC, USA.","DOI":"10.1609\/icwsm.v4i1.14031"},{"key":"ref_21","unstructured":"An, X., Ganguly, A.R., Fang, Y., Scyphers, S.B., Hunter, A.M., and Dy, J.G. (2014, January 24\u201327). Tracking climate change opinions from twitter data. Proceedings of the Workshop on Data Science for Social Good, New York, NY, USA."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Ranco, G., Aleksovski, D., Caldarelli, G., Gr\u010dar, M., and Mozeti\u010d, I. (2015). The effects of Twitter sentiment on stock price returns. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0138441"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Shan, Y., Hoens, T.R., Jiao, J., Wang, H., Yu, D., and Mao, J. (2016, January 13\u201317). Deep crossing: Web-scale modeling without manually crafted combinatorial features. Proceedings of the 22nd ACM Sigkdd International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939704"},{"key":"ref_24","first-page":"2009","article-title":"Twitter sentiment classification using distant supervision","volume":"1","author":"Go","year":"2009","journal-title":"CS224N Proj. Rep. Stanf."},{"key":"ref_25","unstructured":"Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C.D., Ng, A.Y., and Potts, C. (2013, January 18\u201321). Recursive deep models for semantic compositionality over a sentiment treebank. Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, Seattle, WA, USA."},{"key":"ref_26","unstructured":"Asghar, N. (2016). Yelp dataset challenge: Review rating prediction. arXiv."},{"key":"ref_27","unstructured":"Baccianella, S., Esuli, A., and Sebastiani, F. (2010, January 17\u201323). Sentiwordnet 3.0: An enhanced lexical resource for sentiment analysis and opinion mining. Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC\u201910), Valletta, Malta."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Cambria, E., Poria, S., Hazarika, D., and Kwok, K. (2018, January 2\u20137). SenticNet 5: Discovering conceptual primitives for sentiment analysis by means of context embeddings. Proceedings of the AAAI Conference on Artificial Intelligence, New Orleans, LO, USA.","DOI":"10.1609\/aaai.v32i1.11559"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Qin, Y., Song, D., Cheng, H., Cheng, W., Jiang, G., and Cottrell, G.W. (2017). A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction. arXiv.","DOI":"10.24963\/ijcai.2017\/366"},{"key":"ref_30","unstructured":"Jin, X., Yu, X., Wang, X., Bai, Y., Su, T., and Kong, J. (2019, January 13\u201315). Prediction for Time Series with CNN and LSTM. Proceedings of the 11th International Conference on Modelling, Identification and Control (ICMIC2019), Tianjin, China."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"104785","DOI":"10.1016\/j.knosys.2019.05.028","article-title":"EA-LSTM: Evolutionary attention-based LSTM for time series prediction","volume":"181","author":"Li","year":"2019","journal-title":"Knowl.-Based Syst."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Arras, L., Montavon, G., M\u00fcller, K.R., and Samek, W. (2017, January 9\u201311). Explaining Recurrent Neural Network Predictions in Sentiment Analysis. Proceedings of the EMNLP 2017, Copenhagen, Denmark.","DOI":"10.18653\/v1\/W17-5221"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1007\/s12559-018-9549-x","article-title":"Sentic LSTM: A hybrid network for targeted aspect-based sentiment analysis","volume":"10","author":"Ma","year":"2018","journal-title":"Cogn. Comput."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"8187","DOI":"10.1007\/s00500-019-04402-8","article-title":"Exploration of social media for sentiment analysis using deep learning","volume":"24","author":"Chen","year":"2020","journal-title":"Soft Comput."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"376","DOI":"10.1016\/j.procs.2017.06.037","article-title":"CNN for situations understanding based on sentiment analysis of twitter data","volume":"111","author":"Liao","year":"2017","journal-title":"Procedia Comput. Sci."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Alayba, A.M., Palade, V., England, M., and Iqbal, R. (2018, January 27\u201330). A combined CNN and LSTM model for arabic sentiment analysis. Proceedings of the International Cross-Domain Conference for Machine Learning and Knowledge Extraction, Hamburg, Germany.","DOI":"10.1007\/978-3-319-99740-7_12"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/21\/8450\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:09:49Z","timestamp":1760144989000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/21\/8450"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,3]]},"references-count":36,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2022,11]]}},"alternative-id":["s22218450"],"URL":"https:\/\/doi.org\/10.3390\/s22218450","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,11,3]]}}}