{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T15:16:57Z","timestamp":1790090217575,"version":"4.0.1"},"reference-count":33,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2023,2,20]],"date-time":"2023-02-20T00:00:00Z","timestamp":1676851200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Strategic Priority Research Program of the Chinese Academy of Sciences","award":["XDA23100100"],"award-info":[{"award-number":["XDA23100100"]}]},{"name":"Strategic Priority Research Program of the Chinese Academy of Sciences","award":["202008320044"],"award-info":[{"award-number":["202008320044"]}]},{"name":"Strategic Priority Research Program of the Chinese Academy of Sciences","award":["42050101"],"award-info":[{"award-number":["42050101"]}]},{"name":"Chinese Scholarship Council","award":["XDA23100100"],"award-info":[{"award-number":["XDA23100100"]}]},{"name":"Chinese Scholarship Council","award":["202008320044"],"award-info":[{"award-number":["202008320044"]}]},{"name":"Chinese Scholarship Council","award":["42050101"],"award-info":[{"award-number":["42050101"]}]},{"name":"National Natural Science Foundation of China","award":["XDA23100100"],"award-info":[{"award-number":["XDA23100100"]}]},{"name":"National Natural Science Foundation of China","award":["202008320044"],"award-info":[{"award-number":["202008320044"]}]},{"name":"National Natural Science Foundation of China","award":["42050101"],"award-info":[{"award-number":["42050101"]}]},{"name":"Vilas Associates Competition Award from the University of Wisconsin\u2013Madison","award":["XDA23100100"],"award-info":[{"award-number":["XDA23100100"]}]},{"name":"Vilas Associates Competition Award from the University of Wisconsin\u2013Madison","award":["202008320044"],"award-info":[{"award-number":["202008320044"]}]},{"name":"Vilas Associates Competition Award from the University of Wisconsin\u2013Madison","award":["42050101"],"award-info":[{"award-number":["42050101"]}]},{"name":"Microsoft AI for Earth","award":["XDA23100100"],"award-info":[{"award-number":["XDA23100100"]}]},{"name":"Microsoft AI for Earth","award":["202008320044"],"award-info":[{"award-number":["202008320044"]}]},{"name":"Microsoft AI for Earth","award":["42050101"],"award-info":[{"award-number":["42050101"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>Location-based social networks (LBSN) allow users to socialize with friends by sharing their daily life experiences online. In particular, a large amount of check-ins data generated by LBSNs capture the visit locations of users and open a new line of research of spatio-temporal big data, i.e., the next point-of-interest (POI) recommendation. At present, while some advanced methods have been proposed for POI recommendation, existing work only leverages the temporal information of two consecutive LBSN check-ins. Specifically, these methods only focus on adjacent visit sequences but ignore non-contiguous visits, while these visits can be important in understanding the spatio-temporal correlation within the trajectory. In order to fully mine this non-contiguous visit information, we propose a multi-layer Spatio-Temporal deep learning attention model for POI recommendation, Spatio-Temporal Transformer Recommender (STTF-Recommender). To incorporate the spatio-temporal patterns, we encode the information in the user\u2019s trajectory as latent representations into their embeddings before feeding them. To mine the spatio-temporal relationship between any two visited locations, we utilize the Transformer aggregation layer. To match the most plausible candidates from all locations, we develop on an attention matcher based on the attention mechanism. The STTF-Recommender was evaluated with two real-world datasets, and the findings showed that STTF improves at least 13.75% in the mean value of the Recall index at different scales compared with the state-of-the-art models.<\/jats:p>","DOI":"10.3390\/ijgi12020079","type":"journal-article","created":{"date-parts":[[2023,2,20]],"date-time":"2023-02-20T05:57:52Z","timestamp":1676872672000},"page":"79","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Spatio-Temporal Transformer Recommender: Next Location Recommendation with Attention Mechanism by Mining the Spatio-Temporal Relationship between Visited Locations"],"prefix":"10.3390","volume":"12","author":[{"given":"Shuqiang","family":"Xu","sequence":"first","affiliation":[{"name":"College of Computer, Nanjing University of Posts and Telecommunications, Nanjing 210023, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3499-7294","authenticated-orcid":false,"given":"Qunying","family":"Huang","sequence":"additional","affiliation":[{"name":"Spatial Computing and Data Mining Lab, Department of Geography, University of Wisconsin-Madison, Madison, WI 53706, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2828-8491","authenticated-orcid":false,"given":"Zhiqiang","family":"Zou","sequence":"additional","affiliation":[{"name":"College of Computer, Nanjing University of Posts and Telecommunications, Nanjing 210023, China"},{"name":"Jiangsu Key Laboratory of Big Data Security and Intelligent Processing, Nanjing 210023, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1873","DOI":"10.1080\/13658816.2016.1145225","article-title":"Activity patterns, socioeconomic status and urban spatial structure: What can social media data tell us?","volume":"30","author":"Huang","year":"2016","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1621","DOI":"10.1007\/s11280-019-00777-8","article-title":"Survey on user location prediction based on geo-social networking data","volume":"23","author":"Xu","year":"2020","journal-title":"World Wide Web"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1016\/j.neucom.2021.05.114","article-title":"A survey on deep learning based Point-of-Interest (POI) recommendations","volume":"472","author":"Islam","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Zou, Z., Xie, X., and Sha, C. (2015, January 12\u201314). Mining User Behavior and Similarity in Location-Based Social Networks. Proceedings of the 2015 Seventh International Symposium on Parallel Architectures, Algorithms and Programming (PAAP), Nanjing, China.","DOI":"10.1109\/PAAP.2015.40"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3681","DOI":"10.1109\/TKDE.2020.3025580","article-title":"Deep Learning for Spatio-Temporal Data Mining: A Survey","volume":"34","author":"Wang","year":"2020","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.comcom.2013.06.009","article-title":"A survey of collaborative filtering based social recommender systems","volume":"41","author":"Yang","year":"2014","journal-title":"Comput. Commun."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Sun, K., Qian, T., Chen, T., Liang, Y., Nguyen, Q.V.H., and Yin, H. (2020, January 7\u201312). Where to Go Next: Modeling Long- and Short-Term User Preferences for Point-of-Interest Recommendation. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i01.5353"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Luo, Y., Liu, Q., and Liu, Z. (2021, January 19\u201323). STAN: Spatio-Temporal Attention Network for Next Location Recommendation. Proceedings of the Web Conference 2021, Ljubljana, Slovenia.","DOI":"10.1145\/3442381.3449998"},{"key":"ref_9","unstructured":"Liu, Q., Wu, S., Wang, L., and Tan, T. (2021, January 12\u201317). Predicting the Next Location: A Recurrent Model with Spatial and Temporal Contexts. Proceedings of the AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Feng, J., Li, Y., Zhang, C., Sun, F., Meng, F., Guo, A., and Jin, D. (2018, January 23\u201327). Deepmove: Predicting Human Mobility with Attentional Recurrent Networks. Proceedings of the 2018 World Wide Web Conference, Lyon, France.","DOI":"10.1145\/3178876.3186058"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Sun, F., Liu, J., Wu, J., Pei, C., Lin, X., Ou, W., and Jiang, P. (2019, January 3\u20137). BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer. Proceedings of the 28th ACM International Conference on Information and Knowledge Management, Beijing, China.","DOI":"10.1145\/3357384.3357895"},{"key":"ref_12","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2019, January 4\u20139). Attention is all you need. Proceedings of the Advances in Neural Information Processing Systems 30 (NIPS 2017), Long Beach, CA, USA."},{"key":"ref_13","unstructured":"Shani, G., Heckerman, D., and Brafman, R.I. (2005). An MDP-based recommender system. J. Mach. Learn. Res., 6."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Rendle, S., Freudenthaler, C., and Schmidt-Thieme, L. (2010, January 26\u201330). Factorizing personalized Markov chains for next-basket recommen-dation. Proceedings of the 19th International World Wide Web Conference, Raleigh, NC, USA.","DOI":"10.1145\/1772690.1772773"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"He, R., Kang, W.-C., and McAuley, J. (2017, January 27\u201331). Translation-based Recommendation. Proceedings of the Translation-Based Recommendation, Como, Italy.","DOI":"10.1145\/3109859.3109882"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Cho, K., van Merri\u00ebnboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. (2014, January 25\u201329). Learning Phrase Representations Using RNN Encoder-Decoder for Statistical Machine Translation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.","DOI":"10.3115\/v1\/D14-1179"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_18","unstructured":"Hidasi, B., Karatzoglou, A., Baltrunas, L., and Tikk, D. (2016). Session-based recommendations with recurrent neural networks. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Donkers, T., Loepp, B., and Ziegler, J. (2017, January 27\u201331). Sequential User-based Recurrent Neural Network Recommendations. Proceedings of the Eleventh ACM Conference on Recommender Systems, Como, Italy.","DOI":"10.1145\/3109859.3109877"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Li, J., Wang, Y., and McAuley, J. (2020, January 3\u20137). Time Interval Aware Self-Attention for Sequential Recommendation. Proceedings of the Thirteenth ACM International Conference on Web Search and Data Mining, Houston, TX, USA.","DOI":"10.1145\/3336191.3371786"},{"key":"ref_21","first-page":"32","article-title":"Exploiting semantic annotations for clustering geographic areas and users in location-based social networks","volume":"WS-11-02","author":"Noulas","year":"2011","journal-title":"AAAI Work.-Tech. Rep."},{"key":"ref_22","unstructured":"He, J., Li, X., Liao, L., and Wang, M. (2019). Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Springer International Publishing. Proceedings, Part II 18."},{"key":"ref_23","unstructured":"Liu, W., Wang, Z.J., Yao, B., Nie, M., Wang, J., Mao, R., and Yin, J. (2018). Lecture Notes in Comput-er Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Springer."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1020","DOI":"10.1109\/TCSS.2019.2938239","article-title":"HiRecS: A Hierarchical Contextual Location Recommendation System","volume":"6","author":"Baral","year":"2019","journal-title":"IEEE Trans. Comput. Soc. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Huang, Q., Li, Z., Li, J., and Chang, C. (2016, January 31). Mining frequent trajectory patterns from online footprints. Proceedings of the 7th ACM SIGSPATIAL International Workshop on GeoStreaming, San Francisco, CA, USA.","DOI":"10.1145\/3003421.3003431"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1109\/TCSS.2019.2907563","article-title":"Lori: A learning-to-rank-based integration method of location recommendation","volume":"6","author":"Li","year":"2019","journal-title":"IEEE Trans. Comput. Soc. Syst."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Yang, D., Fankhauser, B., Rosso, P., and Cudre-Mauroux, P. (2020, January 11\u201317). Location Prediction over Sparse User Mobility Traces Using RNNs. Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, Yokohama, Japan.","DOI":"10.24963\/ijcai.2020\/302"},{"key":"ref_28","unstructured":"Halder, S., Lim, K.H., Chan, J., and Zhang, X. (2021). Pacific-Asia Conference on Knowledge Discovery and Data Mining: 25th Pacific-Asia Conference, PAKDD 2021, Virtual Event, 11\u201314 May 2021, Springer International Publishing."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Li, R., Shen, Y., and Zhu, Y. (2018, January 17\u201320). Next Point-of-Interest Recommendation with Temporal and Multi-level Context Attention. Proceedings of the 2018 IEEE International Conference on Data Mining (ICDM), Singapore.","DOI":"10.1109\/ICDM.2018.00144"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Qin, Y., Song, D., Chen, H., Cheng, W., Jiang, G., and Cottrell, G.W. (2017). A dual-stage attention-based recurrent neural network for time series prediction. IJCAI, 2627\u20132633.","DOI":"10.24963\/ijcai.2017\/366"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.neucom.2019.12.122","article-title":"Exploiting geographical-temporal awareness attention for next point-of-interest recommendation","volume":"400","author":"Liu","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Liu, T., Liao, J., Wu, Z., Wang, Y., and Wang, J. (2019, January 10\u201313). A Geographical-Temporal Awareness Hierarchical Attention Network for Next Point-of-Interest Recommendation. Proceedings of the International Conference on Multimedia Retrieval, Ottawa, ON, Canada.","DOI":"10.1145\/3323873.3325024"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2472","DOI":"10.1109\/TKDE.2020.3005735","article-title":"Timeaware location prediction by convolutional area-of-interest modeling and memory-augmented attentive lstm","volume":"34","author":"Liu","year":"2020","journal-title":"IEEE Trans. Knowl. Data Eng."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/12\/2\/79\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:37:00Z","timestamp":1760121420000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/12\/2\/79"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,20]]},"references-count":33,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["ijgi12020079"],"URL":"https:\/\/doi.org\/10.3390\/ijgi12020079","relation":{},"ISSN":["2220-9964"],"issn-type":[{"value":"2220-9964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,20]]}}}