{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T13:16:46Z","timestamp":1782825406865,"version":"3.54.5"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,4,2]],"date-time":"2024-04-02T00:00:00Z","timestamp":1712016000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,2]],"date-time":"2024-04-02T00:00:00Z","timestamp":1712016000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program","doi-asserted-by":"crossref","award":["2020YFB1712104"],"award-info":[{"award-number":["2020YFB1712104"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61572074"],"award-info":[{"award-number":["61572074"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Comput Intell Syst"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Typically, user behaviour occurs continuously, and considering this dynamic sequence correlation can lead to more accurate recommendations. Sequential recommendation systems have, therefore, become an important means of solving the problem of network information overload. However, existing attention mechanisms are still insufficient for modelling users\u2019 dynamic and diverse preferences. This paper presents a recommendation model based on a multiheaded self-attention mechanism and multitemporal embeddings of long- and short-term interests (MSMT-LSI). MSMT-LSI balances users\u2019 long- and short-term benefits through two multihead self-attention networks and finally forms a hybrid representation for recommendation. After finding the most suitable parameter combinations for the MSMT-LSI model through parameter sensitivity analysis and verifying the advantages of the long- and short-term fusion strategy, related experiments on five well-known datasets and their analysis shows that the performance of MSMT-LSI is better than that of the classical model on the same benchmark dataset.<\/jats:p>","DOI":"10.1007\/s44196-024-00460-5","type":"journal-article","created":{"date-parts":[[2024,4,2]],"date-time":"2024-04-02T12:02:00Z","timestamp":1712059320000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["A Sequential Recommendation Model for Balancing Long- and Short-Term Benefits"],"prefix":"10.1007","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5408-7549","authenticated-orcid":false,"given":"Hongbo","family":"Wang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yizhe","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,4,2]]},"reference":[{"key":"460_CR1","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-10-0748-4","volume-title":"Spatio-Temporal Recommendation in Social Media","author":"H Yin","year":"2016","unstructured":"Yin, H., Cui, B.: Spatio-Temporal Recommendation in Social Media. Springer, Singapore (2016)"},{"key":"460_CR2","unstructured":"Rendle, S., Freudenthaler, C., Gantner, Z., et al: Bpr: Bayesian personalized ranking from implicit feedback. In: Proc. of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence (UAI \u201909), Arlington, Virginia, USA, pp. 452\u2013461 (2009)"},{"key":"460_CR3","doi-asserted-by":"crossref","unstructured":"Wu, C.Y., Ahmed, A., Beutel, A., et al: Recurrent recommender networks. In: Proc. of the Tenth ACM International Conference on Web Search and Data Mining (WSDM \u201917), Cambridge, United Kingdom, pp. 495\u2013503 (2017)","DOI":"10.1145\/3018661.3018689"},{"key":"460_CR4","doi-asserted-by":"publisher","unstructured":"Xie, R.B., Wang, Y.L., Wang, R., Lu, Y.F., et al: Long short-term temporal meta-learning in online recommendation. In: Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining (WSDM \u201922). Association for Computing Machinery, New York, NY, USA, pp. 1168\u20131176 (2022) https:\/\/doi.org\/10.1145\/3488560.3498371","DOI":"10.1145\/3488560.3498371"},{"key":"460_CR5","doi-asserted-by":"crossref","unstructured":"Rush, A.M., Chopra, S., Weston, J.: A neural attention model for abstractive sentence summarization. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP 2015), Lisbon, Portugal, pp. 379\u2013389 (2015)","DOI":"10.18653\/v1\/D15-1044"},{"issue":"09","key":"460_CR6","first-page":"212","volume":"57","author":"Z Zhang","year":"2021","unstructured":"Zhang, Z., Shan, Y., Yuan, J.: Remote sensing image detection algorithm combining multi-scale and attention mechanism. J. ZheJiang Univ. 57(09), 212\u2013216 (2021)","journal-title":"J. ZheJiang Univ."},{"key":"460_CR7","unstructured":"Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate (2014). https:\/\/doi.org\/1409.0473"},{"issue":"01","key":"460_CR8","first-page":"131","volume":"37","author":"Y Li","year":"2020","unstructured":"Li, Y., Zhang, E., Tang, Z.: Research on speech recognition based on hybrid attention mechanism. Appl. Res. Comput. 37(01), 131\u2013134 (2020)","journal-title":"Appl. Res. Comput."},{"key":"460_CR9","doi-asserted-by":"crossref","unstructured":"Yap, G.E., Li, X.L., Yu, P.S.: Effective next-items recommendation via personalized sequential pattern mining. In: Proc. of the 17th International Conference on Database Systems for Advanced Applications (DASFAA 2012), Busan, South Korea, pp. 48\u201364 (2012)","DOI":"10.1007\/978-3-642-29035-0_4"},{"key":"460_CR10","doi-asserted-by":"crossref","unstructured":"He, R., McAuley, J.: Fusing similarity models with Markov chains for sparse sequential recommendation. In: Proc. of the 2016 IEEE 16th International Conference on Data Mining (ICDM), Barcelona, Spain, pp. 191\u2013200 (2016)","DOI":"10.1109\/ICDM.2016.0030"},{"key":"460_CR11","doi-asserted-by":"crossref","unstructured":"Rendle, S., Freudenthaler, C., Schmidt-Thieme, L.: Factorizing personalized Markov chains for next-basket recommendation. In: Proc. of the 19th International Conference on World Wide Web, Raleigh, North Carolina, USA, pp. 811\u2013820 (2010)","DOI":"10.1145\/1772690.1772773"},{"key":"460_CR12","unstructured":"Hidasi, B., Karatzoglou, A., Baltrunas, L., et al.: Session-based recommendations with recurrent neural networks (2016). https:\/\/doi.org\/1511. 06939v4"},{"key":"460_CR13","doi-asserted-by":"crossref","unstructured":"Tang, J., Wang, K.: Personalized top-n sequential recommendation via convolutional sequence embedding. In: Proc. of the Eleventh ACM International Conference on Web Search and Data Mining, Los Angeles, CA, USA, pp. 565\u2013573 (2018)","DOI":"10.1145\/3159652.3159656"},{"key":"460_CR14","doi-asserted-by":"crossref","unstructured":"Wang, S., Hu, L., Cao, L., et al: Attention-based transactional context embedding for next-item recommendation. In: Proc. of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), New Orleans, Louisiana, USA, pp. 2532\u20132539 (2018)","DOI":"10.1609\/aaai.v32i1.11851"},{"key":"460_CR15","doi-asserted-by":"publisher","unstructured":"Zhang, S., Tay, Y., Yao, L., Sun, A.: Next Item Recommendation with Self-Attention (2018). https:\/\/doi.org\/10.48550\/arXiv.1808.06414","DOI":"10.48550\/arXiv.1808.06414"},{"key":"460_CR16","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., et al: Attention is all you need. In: Proc. of Advances in Neural Information Processing Systems (NIPS 2017), Long Beach, Los Angeles, USA, pp. 5998\u20136008 (2017)"},{"key":"460_CR17","doi-asserted-by":"crossref","unstructured":"Kang, W.C., McAuley, J.: Self-attentive sequential recommendation. In: Proc. of the 2018 IEEE International Conference on Data Mining (ICDM), Singapore, pp. 197\u2013206 (2018)","DOI":"10.1109\/ICDM.2018.00035"},{"key":"460_CR18","doi-asserted-by":"crossref","unstructured":"Huang, X., Qian, S., Fang, Q., et al: Csan: Contextual self-attention network for user sequential recommendation. In: Proc. of the 26th ACM International Conference on Multimedia, Seoul, Korea, pp. 447\u2013455 (2018)","DOI":"10.1145\/3240508.3240609"},{"key":"460_CR19","doi-asserted-by":"crossref","unstructured":"Li, J., Wang, Y., McAuley, J.: Time interval aware self-attention for sequential recommendation. In: Proc. of the 13th International Conference on Web Search and Data Mining, Houston, TX, USA, pp. 322\u2013330 (2020)","DOI":"10.1145\/3336191.3371786"},{"key":"460_CR20","doi-asserted-by":"publisher","unstructured":"Sun, F., Liu, J., Wu, J., Pei, C., Lin, X., Ou, W., Jiang, P.: Bert4rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer, pp. 1441\u20131450 (2019). https:\/\/doi.org\/10.1145\/3357384.3357895","DOI":"10.1145\/3357384.3357895"},{"key":"460_CR21","doi-asserted-by":"publisher","unstructured":"Rashed, A., Elsayed, S., Schmidt-Thieme, L.: Context and Attribute-aware Sequential Recommendation via Cross-attention, pp. 71\u201380 (2022). https:\/\/doi.org\/10.1145\/3523227.3546777","DOI":"10.1145\/3523227.3546777"},{"key":"460_CR22","first-page":"1","volume":"2019","author":"Q Tan","year":"2019","unstructured":"Tan, Q., Liu, F.: Recommendation based on users\u2019 long-term and short term interests with attention. Math. Probl. Eng. 2019, 1\u201313 (2019)","journal-title":"Math. Probl. Eng."},{"key":"460_CR23","doi-asserted-by":"crossref","unstructured":"Ying, H., Zhuang, F., Zhang, F., et al: Sequential recommender system based on hierarchical attention network. In: Proc. of the Twenty-Seventh International Joint Conference on Artificial Intelligence (IJCAI 2018), Stockholm, Sweden, pp. 3926\u20133932 (2018)","DOI":"10.24963\/ijcai.2018\/546"},{"key":"460_CR24","doi-asserted-by":"publisher","unstructured":"Zhou, K., Wang, H., Zhao, W.X., Zhu, Y., Wang, S., Zhang, F., Wang, Z., Wen, J.-R.: S3-rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximization, pp. 1893\u20131902 (2020). https:\/\/doi.org\/10.1145\/3340531.3411954","DOI":"10.1145\/3340531.3411954"},{"key":"460_CR25","doi-asserted-by":"publisher","unstructured":"Qiu, R., Huang, Z., Yin, H.: Memory augmented multi-instance contrastive predictive coding for sequential recommendation. In: 2021 IEEE International Conference on Data Mining (ICDM), pp. 519\u2013528. https:\/\/doi.org\/10.1109\/ICDM51629.2021.00063","DOI":"10.1109\/ICDM51629.2021.00063"},{"key":"460_CR26","doi-asserted-by":"publisher","unstructured":"Bian, S., Zhao, W.X., Zhou, K., Cai, J., He, Y., Yin, C., Wen, J.-R.: Contrastive Curriculum Learning for Sequential User Behavior Modeling via Data Augmentation, pp. 3737\u20133746 (2021). https:\/\/doi.org\/10.1145\/3459637.3481905","DOI":"10.1145\/3459637.3481905"},{"key":"460_CR27","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1016\/j.neucom.2021.02.015","volume":"441","author":"J Zhang","year":"2021","unstructured":"Zhang, J., Wang, D., Yu, D.: Tlsan: time-aware long- and short-term attention network for next-item recommendation. Neurocomputing 441, 179\u2013191 (2021). https:\/\/doi.org\/10.1016\/j.neucom.2021.02.015","journal-title":"Neurocomputing"},{"key":"460_CR28","doi-asserted-by":"crossref","unstructured":"Shaw, P., Uszkoreit, J., Vaswani, A.: Self-attention with relative position representations. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, New Orleans, Louisiana, pp. 464\u2013468 (2018)","DOI":"10.18653\/v1\/N18-2074"},{"key":"460_CR29","doi-asserted-by":"publisher","unstructured":"Devlin, J., Chang, M.-W., Lee, K., Toutanova, K.: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (2019). https:\/\/doi.org\/10.48550\/arXiv.1810.04805","DOI":"10.48550\/arXiv.1810.04805"},{"key":"460_CR30","doi-asserted-by":"publisher","unstructured":"Sun, F., Liu, J., Wu, J., Pei, C., Lin, X., Ou, W., Jiang, P.: Bert4rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer, pp. 1441-1450. Association for Computing Machinery, New York, NY, USA (2019). https:\/\/doi.org\/10.1145\/3357384.3357895.","DOI":"10.1145\/3357384.3357895."},{"key":"460_CR31","doi-asserted-by":"crossref","unstructured":"Dai, Z., Yang, Z., Yang, Y., Carbonell, J., Le, Q.V., Salakhutdinov, R.: Transformer-xl: Attentive language models beyond a fixed-length context. In: 57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), pp. 2978\u20132988 (2019)","DOI":"10.18653\/v1\/P19-1285"},{"key":"460_CR32","unstructured":"Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., Le, Q.V. XLNet: generalized autoregressive pretraining for language understanding. In: Advances in Neural Information Processing Systems, vol. 32 (2019)"},{"key":"460_CR33","unstructured":"CiteULike. The Best Online Gambling Sites for 2022[EB\/OL]. [2022-02-15]. http:\/\/www.citeulike.org"},{"issue":"4","key":"460_CR34","first-page":"1","volume":"5","author":"FM Harper","year":"2015","unstructured":"Harper, F.M., Konstan, J.A.: The movielens datasets: history and context. ACM Trans. Interact. Intell. Syst. (TIIS) 5(4), 1\u201319 (2015)","journal-title":"ACM Trans. Interact. Intell. Syst. (TIIS)"},{"key":"460_CR35","doi-asserted-by":"crossref","unstructured":"McAuley, J., Targett, C., Shi, Q., et al: Image-based recommendations on styles and substitutes. In: Proc. of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2015), Santiago, Chile, pp. 43\u201352 (2015)","DOI":"10.1145\/2766462.2767755"},{"key":"460_CR36","first-page":"353","volume":"16","author":"B Weike","year":"2021","unstructured":"Weike, B., Chun, Y.: Recommendation system with long-term and shortterm sequential self-attention network. CAAI Trans. Intell. Syst. 16, 353\u2013361 (2021)","journal-title":"CAAI Trans. Intell. Syst."},{"key":"460_CR37","doi-asserted-by":"crossref","unstructured":"Chen, H.Y.T., Chen, H., et al: Air: Attentional intention-aware recommender systems. In: Proc. of 35th IEEE International Conference on Data Engineering (ICDE 2019), Macao, China, pp. 304\u2013315 (2019)","DOI":"10.1109\/ICDE.2019.00035"},{"key":"460_CR38","unstructured":"Kingma, D.P., Ba, J.: Adam: A Method for Stochastic Optimization (2014). https:\/\/doi.org\/1412.6980"}],"container-title":["International Journal of Computational Intelligence Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44196-024-00460-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s44196-024-00460-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44196-024-00460-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,2]],"date-time":"2024-04-02T12:04:49Z","timestamp":1712059489000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s44196-024-00460-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,2]]},"references-count":38,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["460"],"URL":"https:\/\/doi.org\/10.1007\/s44196-024-00460-5","relation":{},"ISSN":["1875-6883"],"issn-type":[{"value":"1875-6883","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,2]]},"assertion":[{"value":"28 August 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 March 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 April 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that there are no conflicts of interest regarding the publication of this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical Approval and Consent to Participate"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for Publication"}}],"article-number":"75"}}