{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T15:31:07Z","timestamp":1784215867458,"version":"3.55.0"},"reference-count":42,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,11,26]],"date-time":"2024-11-26T00:00:00Z","timestamp":1732579200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neurorobot."],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>With the rapid development of the tourism industry, the demand for accurate and personalized travel route recommendations has significantly increased. However, traditional methods often fail to effectively integrate visual and sequential information, leading to recommendations that are both less accurate and less personalized.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>This paper introduces SelfAM-Vtrans, a novel algorithm that leverages multimodal data\u2014combining visual Transformers, LSTMs, and self-attention mechanisms\u2014to enhance the accuracy and personalization of travel route recommendations. SelfAM-Vtrans integrates visual and sequential information by employing a visual Transformer to extract features from travel images, thereby capturing spatial relationships within them. Concurrently, a Long Short-Term Memory (LSTM) network encodes sequential data to capture the temporal dependencies within travel sequences. To effectively merge these two modalities, a self-attention mechanism fuses the visual features and sequential encodings, thoroughly accounting for their interdependencies. Based on this fused representation, a classification or regression model is trained using real travel datasets to recommend optimal travel routes.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results and discussion<\/jats:title><jats:p>The algorithm was rigorously evaluated through experiments conducted on real-world travel datasets, and its performance was benchmarked against other route recommendation methods. The results demonstrate that SelfAM-Vtrans significantly outperforms traditional approaches in terms of both recommendation accuracy and personalization. By comprehensively incorporating both visual and sequential data, this method offers travelers more tailored and precise route suggestions, thereby enriching the overall travel experience.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fnbot.2024.1439195","type":"journal-article","created":{"date-parts":[[2024,11,26]],"date-time":"2024-11-26T06:26:39Z","timestamp":1732602399000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["A multimodal travel route recommendation system leveraging visual Transformers and self-attention mechanisms"],"prefix":"10.3389","volume":"18","author":[{"given":"Zhang","family":"Juan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jing","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ming","family":"Gao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,11,26]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"114324","DOI":"10.1016\/j.eswa.2020.114324","article-title":"Tourism recommendation system based on semantic clustering and sentiment analysis","volume":"167","author":"Abbasi-Moud","year":"2021","journal-title":"Expert Syst. Appl"},{"key":"B2","doi-asserted-by":"publisher","first-page":"18546","DOI":"10.1109\/TITS.2022.3150715","article-title":"Using vision transformers for spatial-context-aware rain and road surface condition detection on freeways","volume":"23","author":"Abdelraouf","year":"2022","journal-title":"IEEE Trans. Intell. Transport. Syst"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1605.05362","article-title":"Yelp dataset challenge: review rating prediction","author":"Asghar","year":"2016","journal-title":"arXiv preprint arXiv:1605.05362"},{"key":"B4","doi-asserted-by":"publisher","first-page":"4407","DOI":"10.3233\/JIFS-201218","article-title":"Personalized travel route recommendation algorithm based on improved genetic algorithm","volume":"40","author":"Chen","year":"2021","journal-title":"J. Intell. Fuzzy Syst"},{"key":"B5","doi-asserted-by":"publisher","first-page":"116234","DOI":"10.1016\/j.eswa.2021.116234","article-title":"Multi-view graph attention network for travel recommendation","volume":"191","author":"Chen","year":"2022","journal-title":"Expert Syst. Appl"},{"key":"B6","doi-asserted-by":"crossref","first-page":"729","DOI":"10.1109\/MDM48529.2020.00071","article-title":"\u201cPersonalized tourism route recommendation based on user's active interests,\u201d","volume-title":"2020 21st IEEE International Conference on Mobile Data Management (MDM)","author":"Duan","year":"2020"},{"key":"B7","doi-asserted-by":"publisher","first-page":"667","DOI":"10.1080\/14733285.2019.1685074","article-title":"Social relationships, nature, and traffic: findings from a child-centred approach to measuring active school travel route perceptions","volume":"18","author":"Egli","year":"2020","journal-title":"Child. Geograph"},{"key":"B8","doi-asserted-by":"publisher","first-page":"17","DOI":"10.5120\/15885-4685","article-title":"A modified approach towards tourism recommendation system with collaborative filtering and association rule mining","volume":"91","author":"Gandhi","year":"2014","journal-title":"Int. J. Comput. Appl"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3463240","author":"Goldenberg","year":"2021","journal-title":"Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval"},{"key":"B10","first-page":"934","article-title":"\u201cTwo-stage trajectory generation model for realistic human mobility simulation,\u201d","volume-title":"2023 IEEE International Conference on High Performance Computing & Communications, Data Science & Systems, Smart City & Dependability in Sensor, Cloud & Big Data Systems & Application (HPCC\/DSS\/SmartCity\/DependSys)","author":"Gong","year":"2023"},{"key":"B11","doi-asserted-by":"publisher","first-page":"33365","DOI":"10.1007\/s11042-018-6776-9","article-title":"Personalized travel route recommendation from multi-source social media data","volume":"79","author":"Hu","year":"2020","journal-title":"Multimedia Tools Appl"},{"key":"B12","doi-asserted-by":"publisher","first-page":"106302","DOI":"10.1016\/j.knosys.2020.106302","article-title":"Spatio-temporal feature fusion for dynamic taxi route recommendation via deep reinforcement learning","volume":"205","author":"Ji","year":"2020","journal-title":"Knowl. Based Syst"},{"key":"B13","doi-asserted-by":"publisher","first-page":"200094","DOI":"10.1016\/j.sasc.2024.200094","article-title":"Cultural tourism attraction recommendation model based on optimized weighted association rule algorithm","volume":"6","author":"Jiang","year":"2024","journal-title":"Syst. Soft Comput"},{"key":"B14","doi-asserted-by":"publisher","first-page":"4710","DOI":"10.1109\/TIE.2017.2674624","article-title":"Manipulability optimization of redundant manipulators using dynamic neural networks","volume":"64","author":"Jin","year":"2017","journal-title":"IEEE Trans. Industr. Electron"},{"key":"B15","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1016\/j.neucom.2018.01.002","article-title":"Robot manipulator control using neural networks: a survey","volume":"285","author":"Jin","year":"2018","journal-title":"Neurocomputing"},{"key":"B16","doi-asserted-by":"publisher","first-page":"2615","DOI":"10.1109\/TNNLS.2015.2497715","article-title":"Integration-enhanced zhang neural network for real-time-varying matrix inversion in the presence of various kinds of noises","volume":"27","author":"Jin","year":"2015","journal-title":"IEEE Trans. Neural Netw. Learn. Syst"},{"key":"B17","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1109\/AICCSA.2017.12","article-title":"\u201cA personalized hybrid tourism recommender system,\u201d","volume-title":"2017 IEEE\/ACS 14th International Conference on Computer Systems and Applications (AICCSA)","author":"Kbaier","year":"2017"},{"key":"B18","doi-asserted-by":"publisher","first-page":"26703","DOI":"10.1109\/ACCESS.2017.2778293","article-title":"Personalized attraction recommendation system for tourists through check-in data","volume":"5","author":"Kesorn","year":"2017","journal-title":"IEEE Access"},{"key":"B19","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1186\/s13677-023-00427-5","article-title":"NPR-LBN: next point of interest recommendation using large bipartite networks with edge and cloud computing","volume":"12","author":"Khan","year":"2023","journal-title":"J. Cloud Comput"},{"key":"B20","unstructured":"Kong\n              W.-K.\n            \n            \n              Zheng\n              S.-Y.\n            \n            \n              Nguyen\n              M.-L.\n            \n            \n              Ma\n              Q.\n            \n          \n          A Multi-agent Reinforcement Learning Approach Towards Congestion-Aware Route Recommendation for Tourists. DEIM2022\n          \n          2022"},{"key":"B21","doi-asserted-by":"publisher","first-page":"1956","DOI":"10.1007\/s11263-020-01316-z","article-title":"The open images dataset V4: unified image classification, object detection, and visual relationship detection at scale","volume":"128","author":"Kuznetsova","year":"2020","journal-title":"Int. J. Comput. Vis"},{"key":"B22","doi-asserted-by":"publisher","first-page":"45","DOI":"10.3126\/jes2.v3i1.66234","article-title":"Machine learning-based social media review analysis for recommending tourist spots","volume":"3","author":"Lahagun","year":"2024","journal-title":"J. Eng. Sci"},{"key":"B23","doi-asserted-by":"publisher","first-page":"561","DOI":"10.14569\/IJACSA.2024.0150561","article-title":"Tourist attraction recommendation model based on RFPAP-NNPAP algorithm","volume":"15","author":"Li","year":"2024","journal-title":"Int. J. Adv. Comput. Sci. Appl"},{"key":"B24","doi-asserted-by":"publisher","first-page":"3409808","DOI":"10.1109\/JSTARS.2024.3409808","article-title":"DTCNet: transformer-CNN distillation for super-resolution of remote sensing image","volume":"2024","author":"Lin","year":"2024","journal-title":"IEEE J. Select. Top. Appl. Earth Observ. Rem. Sens"},{"key":"B25","unstructured":"Neural radiance fields convert 2D to 3D texture\n          \n          40\n          44\n          \n            \n              Lin\n              Z.\n            \n            \n              Wang\n              C.\n            \n            \n              Li\n              Z.\n            \n            \n              Wang\n              Z.\n            \n            \n              Liu\n              X.\n            \n            \n              Zhu\n              Y.\n            \n          \n          37478036\n          Appl. Sci. Biotechnol. J. Adv. Res\n          3"},{"key":"B26","unstructured":"Text sentiment detection and classification based on integrated learning algorithm\n          \n          27\n          33\n          \n            \n              Lin\n              Z.\n            \n            \n              Wang\n              Z.\n            \n            \n              Zhu\n              Y.\n            \n            \n              Li\n              Z.\n            \n            \n              Qin\n              H.\n            \n          \n          Appl. Sci. Eng. J. Adv. Res\n          3"},{"key":"B27","unstructured":"Lorenzi\n              F.\n            \n          \n          Proceedings of the 2007 ACM Conference on Recommender Systems\n          \n          2007"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313647","author":"Nilizadeh","year":"2019","journal-title":"The World Wide Web Conference"},{"key":"B29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s00779-020-01476-2","article-title":"A study on topic models using lda and word2vec in travel route recommendation: focus on convergence travel and tours reviews","volume":"2","author":"Park","year":"2022","journal-title":"Person. Ubiquit. Comput"},{"key":"B30","first-page":"196","article-title":"\u201cWhere in the world is this image? transformer-based geo-localization in the wild,\u201d","volume-title":"European Conference on Computer Vision","author":"Pramanick","year":"2022"},{"key":"B31","doi-asserted-by":"publisher","first-page":"102078","DOI":"10.1016\/j.ipm.2019.102078","article-title":"An extensive study on the evolution of context-aware personalized travel recommender systems","volume":"57","author":"Renjith","year":"2020","journal-title":"Inform. Process. Manag"},{"key":"B32","doi-asserted-by":"crossref","unstructured":"\u201cGenetic algorithm based personalized travel recommendation system,\u201d\n          \n          867\n          874\n          \n            \n              Sharma\n              R.\n            \n          \n          IEEE\n          2024 2nd International Conference on Intelligent Data Communication Technologies and Internet of Things (IDCIoT)\n          \n          2024","DOI":"10.1109\/IDCIoT59759.2024.10467470"},{"key":"B33","doi-asserted-by":"publisher","first-page":"16414","DOI":"10.3390\/su142416414","article-title":"Understanding user preferences in location-based social networks via a novel self-attention mechanism","volume":"14","author":"Shi","year":"2022","journal-title":"Sustainability"},{"key":"B34","doi-asserted-by":"publisher","first-page":"214","DOI":"10.1609\/aaai.v34i01.5353","article-title":"Where to go next: modeling long-and short-term user preferences for point-of-interest recommendation","volume":"34","author":"Sun","year":"2020","journal-title":"Proc. AAAI Conf. Artif. Intell"},{"key":"B35","doi-asserted-by":"publisher","first-page":"670","DOI":"10.1049\/cit2.12192","article-title":"An activated variable parameter gradient-based neural network for time-variant constrained quadratic programming and its applications","volume":"8","author":"Wang","year":"2023","journal-title":"CAAI Trans. Intell. Technol"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0240656","article-title":"Applying internet information technology combined with deep learning to tourism collaborative recommendation system","author":"Wang","year":"2020","journal-title":"PLoS ONE"},{"key":"B37","doi-asserted-by":"publisher","first-page":"1773","DOI":"10.1080\/13683500.2019.1649372","article-title":"Sharing memorable tourism experiences on mobile social media and how it influences further travel decisions","volume":"23","author":"Wong","year":"2020","journal-title":"Curr. Iss. Tour"},{"key":"B38","doi-asserted-by":"publisher","first-page":"120490","DOI":"10.1016\/j.eswa.2023.120490","article-title":"Nonlinear rnn with noise-immune: a robust and learning-free method for hyperspectral image target detection","volume":"229","author":"Xiao","year":"2023","journal-title":"Expert Syst. Appl"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.1145\/3477495.3531983","author":"Yang","year":"2022","journal-title":"Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval"},{"key":"B40","doi-asserted-by":"publisher","first-page":"857292","DOI":"10.3389\/fpsyg.2022.857292","article-title":"Big data recommendation research based on travel consumer sentiment analysis","volume":"13","author":"Yuan","year":"2022","journal-title":"Front. Psychol"},{"key":"B41","doi-asserted-by":"publisher","first-page":"1396979","DOI":"10.3389\/fnbot.2024.1396979","article-title":"Residual learning-based robotic image analysis model for low-voltage distributed photovoltaic fault identification and positioning","volume":"18","author":"Zhang","year":"2024","journal-title":"Front. Neurorobot"},{"key":"B42","doi-asserted-by":"publisher","first-page":"8121","DOI":"10.1109\/ACCESS.2020.3047264","article-title":"Intelligent tourism recommendation algorithm based on text mining and MP nerve cell model of multivariate transportation modes","volume":"9","author":"Zhou","year":"2020","journal-title":"IEEE Access"}],"container-title":["Frontiers in Neurorobotics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2024.1439195\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,26]],"date-time":"2024-11-26T06:26:46Z","timestamp":1732602406000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2024.1439195\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,26]]},"references-count":42,"alternative-id":["10.3389\/fnbot.2024.1439195"],"URL":"https:\/\/doi.org\/10.3389\/fnbot.2024.1439195","relation":{},"ISSN":["1662-5218"],"issn-type":[{"value":"1662-5218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,26]]},"article-number":"1439195"}}