{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T22:47:48Z","timestamp":1778885268175,"version":"3.51.4"},"reference-count":49,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2025,11,27]],"date-time":"2025-11-27T00:00:00Z","timestamp":1764201600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100012024","name":"Multimedia University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100012024","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Effective web service selection and recommendation are critical for ensuring high-quality performance in distributed and service-oriented systems. Recent research has increasingly explored the use of BERT (Bidirectional Encoder Representations from Transformers) to enhance semantic understanding of service descriptions, user requirements, and Quality of Service (QoS) prediction. This systematic review examines the application of BERT-based models in QoS-aware web service selection and recommendation. A structured database search was conducted across IEEE, ACM, ScienceDirect, and Google Scholar covering studies published between 2020 and 2024, resulting in twenty-five eligible articles based on predefined inclusion criteria and PRISMA screening. The review shows that BERT improves semantic representation and mitigates cold-start and sparsity issues, contributing to better service ranking and QoS prediction accuracy. However, challenges persist, including limited availability of benchmark datasets, high computational overhead, and limited interpretability of model decisions. The review identifies five key research gaps and outlines future directions, including domain-specific pre-training, hybrid semantic\u2013numerical models, multi-modal QoS reasoning, and lightweight transformer architectures for deployment in dynamic and resource-constrained environments. These findings highlight the potential of BERT to support more intelligent, adaptive, and scalable web service management.<\/jats:p>","DOI":"10.3390\/fi17120543","type":"journal-article","created":{"date-parts":[[2025,11,28]],"date-time":"2025-11-28T08:26:57Z","timestamp":1764318417000},"page":"543","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["BERT-Based Approaches for Web Service Selection and Recommendation: A Systematic Review with a Focus on QoS Prediction"],"prefix":"10.3390","volume":"17","author":[{"given":"Vijayalakshmi","family":"Mahanra Rao","sequence":"first","affiliation":[{"name":"Faculty of Information Science & Technology, Multimedia University, Melaka 75450, Malaysia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2780-6069","authenticated-orcid":false,"given":"R Kanesaraj","family":"Ramasamy","sequence":"additional","affiliation":[{"name":"Faculty of Computing and Informatics, Multimedia University, Cyberjaya 63000, Malaysia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0052-4870","authenticated-orcid":false,"given":"Md Shohel","family":"Sayeed","sequence":"additional","affiliation":[{"name":"Faculty of Information Science & Technology, Multimedia University, Melaka 75450, Malaysia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,11,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"53649","DOI":"10.1109\/ACCESS.2020.2979253","article-title":"Benchmark dataset selection of web services technologies: A factor analysis","volume":"8","author":"Hasnain","year":"2020","journal-title":"IEEE Access"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1910","DOI":"10.1109\/ACCESS.2019.2962703","article-title":"Predictive-trend-aware composition of web services with time-varying quality-of-service","volume":"8","author":"Sun","year":"2020","journal-title":"IEEE Access"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"111897","DOI":"10.1109\/ACCESS.2023.3323584","article-title":"Dynamic service composition method based on zero-sum game integrated inverse reinforcement learning","volume":"11","author":"Yuan","year":"2023","journal-title":"IEEE Access"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Rajendran, V., Ramasamy, R.K., and Mohd-Isa, W.N. (2022). Improved eagle strategy algorithm for dynamic web service composition in the IoT: A conceptual approach. Future Internet, 14.","DOI":"10.3390\/fi14020056"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"61301","DOI":"10.1109\/ACCESS.2024.3392607","article-title":"A method to enhance web service clustering by integrating label-enhanced functional semantics and service collaboration","volume":"12","author":"Liu","year":"2024","journal-title":"IEEE Access"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"50489","DOI":"10.1109\/ACCESS.2024.3385341","article-title":"A semi-supervised learning approach to quality-based web service classification","volume":"12","author":"Bonab","year":"2024","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"91855","DOI":"10.1109\/ACCESS.2022.3197662","article-title":"Bangla-bert: Transformer-based efficient model for transfer learning and language understanding","volume":"10","author":"Kowsher","year":"2022","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"158346","DOI":"10.1109\/ACCESS.2020.3020245","article-title":"A near-real-time answer discovery for open-domain with unanswerable questions from the web","volume":"8","author":"Kim","year":"2020","journal-title":"IEEE Access"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"49708","DOI":"10.1109\/ACCESS.2024.3384487","article-title":"Cooperative mashup embedding leveraging knowledge graph for web api recommendation","volume":"12","author":"Zhang","year":"2024","journal-title":"IEEE Access"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ramasamy, R.K., Chua, F.F., Haw, S.C., and Ho, C.K. (2022). WSFeIn: A novel, dynamic web service composition adapter for cloud-based mobile application. Sustainability, 14.","DOI":"10.3390\/su142113946"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1186\/s40537-022-00592-5","article-title":"A systematic review and research perspective on recommender systems","volume":"9","author":"Roy","year":"2022","journal-title":"J. Big Data"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2439","DOI":"10.1109\/TSC.2020.2980793","article-title":"A survey on web service QoS prediction methods","volume":"15","author":"Ghafouri","year":"2020","journal-title":"IEEE Trans. Serv. Comput."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3945","DOI":"10.1109\/TNSM.2024.3395428","article-title":"TPMCF: Temporal QoS Prediction Using Multi-Source Collaborative Features","volume":"21","author":"Kumar","year":"2024","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Liu, H., Zhang, Z., Li, H., Wu, Q., and Zhang, Y. (2024). Large Language Model Aided QoS Prediction for Service Recommendation. arXiv.","DOI":"10.1109\/SSE67621.2025.00023"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Atzeni, D., Bacciu, D., Mazzei, D., and Prencipe, G. (2022). A systematic review of Wi-Fi and machine learning integration with topic modeling techniques. Sensors, 22.","DOI":"10.3390\/s22134925"},{"key":"ref_16","unstructured":"Xu, Z., Gu, Y., and Yao, D. (2025). WARBERT: A Hierarchical BERT-based Model for Web API Recommendation. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Li, M., Xu, H., Tu, Z., Su, T., Xu, X., and Wang, Z. (2022, January 10\u201316). A deep learning based personalized QoE\/QoS correlation model for composite services. Proceedings of the 2022 IEEE International Conference on Web Services (ICWS), Barcelona, Spain.","DOI":"10.1109\/ICWS55610.2022.00053"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Long, S., Tan, J., Mao, B., Tang, F., Li, Y., Zhao, M., and Kato, N. (2025). A Survey on Intelligent Network Operations and Performance Optimization Based on Large Language Models. IEEE Commun. Surv. Tutor.","DOI":"10.1109\/COMST.2025.3526606"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"98","DOI":"10.3390\/telecom5010006","article-title":"An evaluation survey of knowledge-based approaches in telecommunication applications","volume":"5","author":"Koudouridis","year":"2024","journal-title":"Telecom"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Alsayed, A.S., Dam, H.K., and Nguyen, C. (2024). MicroRec: Leveraging Large Language Models for Microservice Recommendation. MSR \u201824: Proceedings of the 21st International Conference on Mining Software Repositories, Lisbon, Portugal, 15\u201316 April 2024, Association for Computing Machinery.","DOI":"10.1145\/3643991.3644916"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Liu, H., Zhang, W., Zhang, X., Cao, Z., and Tian, R. (2022, January 21\u201323). Context-aware and QoS prediction-based cross-domain microservice instance discovery. Proceedings of the 2022 IEEE 13th International Conference on Software Engineering and Service Science (ICSESS), Beijing, China.","DOI":"10.1109\/ICSESS54813.2022.9930241"},{"key":"ref_22","first-page":"529","article-title":"Deep Learning-Based Text Classification to Improve Web Service Discovery","volume":"28","author":"Meghazi","year":"2024","journal-title":"Comput. Y Sist."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zeng, K., and Paik, I. (2021, January 20\u201323). Dynamic service recommendation using lightweight BERT-based service embedding in edge computing. Proceedings of the 2021 IEEE 14th International Symposium on Embedded Multicore\/Many-core Systems-on-Chip (MCSoC), Singapore.","DOI":"10.1109\/MCSoC51149.2021.00035"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1311","DOI":"10.1109\/TSC.2023.3326208","article-title":"A deep-learning model for service QoS prediction based on feature mapping and inference","volume":"17","author":"Zhang","year":"2023","journal-title":"IEEE Trans. Serv. Comput."},{"key":"ref_25","unstructured":"Alam, K.A., and Haroon, M. (2024, January 9\u201311). Evaluating Fine-tuned BERT-based Language Models for Web API Recommendation. Proceedings of the 2024 IEEE International Conference on Cloud Computing Technology and Science (CloudCom), Abu Dhabi, United Arab Emirates."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1007\/s12243-023-00980-9","article-title":"Generative AI in mobile networks: A survey","volume":"79","author":"Karapantelakis","year":"2024","journal-title":"Ann. Telecommun."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"156392","DOI":"10.1109\/ACCESS.2021.3128283","article-title":"IT infrastructure anomaly detection and failure handling: A systematic literature review focusing on datasets, log preprocessing, machine & deep learning approaches and automated tool","volume":"9","author":"Bhanage","year":"2021","journal-title":"IEEE Access"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Qu, G., Chen, Q., Wei, W., Lin, Z., Chen, X., and Huang, K. (2025). Mobile edge intelligence for large language models: A contemporary survey. IEEE Commun. Surv. Tutor.","DOI":"10.36227\/techrxiv.172115025.57884352\/v1"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1055","DOI":"10.1109\/TNSM.2024.3493758","article-title":"FeD-TST: Federated Temporal Sparse Transformers for QoS prediction in Dynamic IoT Networks","volume":"22","author":"Hameed","year":"2024","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"564","DOI":"10.1109\/JAS.2021.1004392","article-title":"QoS Prediction Model of Cloud Services Based on Deep Learning","volume":"9","author":"Huang","year":"2022","journal-title":"IEEE\/CAA J. Autom. Sin."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Le, F., Srivatsa, M., Ganti, R., and Sekar, V. (2022, January 14\u201315). Rethinking data-driven networking with foundation models: Challenges and opportunities. Proceedings of the 21st ACM Workshop on Hot Topics in Networks, Austin, TX, USA.","DOI":"10.1145\/3563766.3564109"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Jeong, C., Jang, S., Shin, H., Park, E., and Choi, S. (2019). A Context-Aware Citation Recommendation Model with BERT and Graph Convolutional Networks. arXiv.","DOI":"10.1007\/s11192-020-03561-y"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1109\/TSC.2023.3343351","article-title":"QoSGNN: Boosting QoS Prediction Performance with Graph Neural Networks","volume":"17","author":"Liu","year":"2023","journal-title":"IEEE Trans. Serv. Comput."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2587","DOI":"10.1109\/TNSM.2023.3236348","article-title":"Toward Effective Personalized Service QoS Prediction From the Perspective of Multi-Task Learning","volume":"20","author":"Lian","year":"2023","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"key":"ref_35","unstructured":"Jirsik, T., Tr\u010dka, \u0160., and Celeda, P. (2019, January 8\u201312). Quality of service forecasting with LSTM neural network. Proceedings of the 2019 IFIP\/IEEE Symposium on Integrated Network and Service Management (IM), Washington, DC, USA."},{"key":"ref_36","first-page":"2085","article-title":"QoS-aware diversified service selection","volume":"16","author":"Guo","year":"2022","journal-title":"IEEE Trans. Serv. Comput."},{"key":"ref_37","unstructured":"Boulakbech, M., Messai, N., Sam, Y., and Devogele, T. (December, January 28). Deep learning model for personalized web service recommendations using attention mechanism. Proceedings of the International Conference on Service-Oriented Computing, Rome, Italy."},{"key":"ref_38","first-page":"213","article-title":"Lcpcwsc: A web service classification approach based on label confusion and priori correction","volume":"20","author":"Xue","year":"2024","journal-title":"Int. J. Web Inf. Syst."},{"key":"ref_39","first-page":"133","article-title":"Interpretable web service recommendation based on disentangled representation learning","volume":"45","author":"Huang","year":"2023","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Wang, X., Zhou, P., Wang, Y., Liu, X., Liu, J., and Wu, H. (2021, January 22\u201325). Servicebert: A pre-trained model for web service tagging and recommendation. Proceedings of the International Conference on Service-Oriented Computing, Online.","DOI":"10.1007\/978-3-030-91431-8_29"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Yang, Y., Qamar, N., Liu, P., Grolinger, K., Wang, W., Li, Z., and Liao, Z. (2020, January 19\u201323). Servenet: A deep neural network for web services classification. Proceedings of the 2020 IEEE International Conference on Web Services (ICWS), Beijing, China.","DOI":"10.1109\/ICWS49710.2020.00029"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Wang, Z., Zhang, X., Li, Z.S., and Yan, M. (2025). QoSBERT: An Uncertainty-Aware Approach Based on Pre-trained Language Models for Service Quality Prediction. IEEE Trans. Serv. Comput., 1\u201313.","DOI":"10.1109\/TSC.2025.3620138"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1553","DOI":"10.1162\/tacl_a_00619","article-title":"Pre-train, prompt, and recommendation: A comprehensive survey of language modeling paradigm adaptations in recommender systems","volume":"11","author":"Liu","year":"2023","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Van, M.M., and Tran, T.T. (2024, January 9\u201310). BeLightRec: A Lightweight Recommender System Enhanced with BERT. Proceedings of the International Conference on Intelligent Systems and Data Science, Nha Trang, Vietnam.","DOI":"10.1007\/978-981-97-9616-8_3"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Kharidia, V., Paprunia, D., and Kanikar, P. (2024, January 18\u201319). LightFusionRec: Lightweight Transformers-Based Cross-Domain Recommendation Model. Proceedings of the 2024 First International Conference on Software, Systems and Information Technology (SSITCON), Tumkur, India.","DOI":"10.1109\/SSITCON62437.2024.10796005"},{"key":"ref_46","unstructured":"Liu, Q., Zhao, X., Wang, Y., Wang, Y., Zhang, Z., Sun, Y., Li, X., Wang, M., Jia, P., and Chen, C. (2024). Large language model enhanced recommender systems: Taxonomy, trend, application and future. arXiv."},{"key":"ref_47","first-page":"1641","article-title":"BERT Algorithm used in Google Search","volume":"70","author":"Singh","year":"2021","journal-title":"Math. Stat. Eng. Appl."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Sun, F., Liu, J., Wu, J., Pei, C., Lin, X., Ou, W., and Jiang, P. (2019, January 3\u20137). BERT4Rec: Sequential recommendation with bidirectional encoder representations from transformer. Proceedings of the 28th ACM International Conference on Information and Knowledge Management, Beijing, China.","DOI":"10.1145\/3357384.3357895"},{"key":"ref_49","unstructured":"(2025, October 23). Fine-Tune and Host Hugging Face Bert Models on Amazon Sagemaker|AWS Machine Learning Blog. Available online: https:\/\/aws.amazon.com\/blogs\/machine-learning\/fine-tune-and-host-hugging-face-bert-models-on-amazon-sagemaker\/."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/17\/12\/543\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,29]],"date-time":"2025-11-29T05:14:00Z","timestamp":1764393240000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/17\/12\/543"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,27]]},"references-count":49,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["fi17120543"],"URL":"https:\/\/doi.org\/10.3390\/fi17120543","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,27]]}}}