{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T08:18:42Z","timestamp":1772612322819,"version":"3.50.1"},"reference-count":27,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2026,3,2]],"date-time":"2026-03-02T00:00:00Z","timestamp":1772409600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100012024","name":"Multimedia University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100012024","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Transformer-based language models have been increasingly adopted to enhance semantic awareness in web service selection systems. However, the computational cost of large transformer encoders poses significant challenges for real-time and resource-constrained deployment scenarios. This study presents a deployment-oriented hybrid semantic\u2013QoS framework that integrates transformer-based domain-level semantic signals with traditional Quality of Service (QoS) metrics to support scalable service selection pipelines. Rather than aiming to establish end-to-end ranking optimality, this work focuses on a comparative analysis of transformer encoders within a unified pipeline, emphasizing accuracy\u2013latency trade-offs, resource utilization, and deployment feasibility. Four representative BERT family models\u2014BERT, DistilBERT, RoBERTa, and ALBERT\u2014are evaluated under identical experimental conditions. The semantic component operates at the level of domain relevance estimation, and its output is combined with QoS indicators using a controllable weighting mechanism to examine sensitivity to deployment priorities. The results reveal clear trade-offs between semantic expressiveness and computational efficiency, with lightweight models such as DistilBERT demonstrating favorable scalability and response-time characteristics despite reduced semantic capacity. The findings provide practical insights for selecting transformer encoders in QoS-aware service selection pipelines deployed in cloud, edge, or real-time environments. By framing evaluation around deployment feasibility rather than ranking optimality, this study offers guidance for balancing semantic enrichment with operational constraints in real-world service selection systems.<\/jats:p>","DOI":"10.3390\/info17030242","type":"journal-article","created":{"date-parts":[[2026,3,2]],"date-time":"2026-03-02T14:06:56Z","timestamp":1772460416000},"page":"242","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A Deployment-Oriented Hybrid Semantic\u2013QoS Framework for Web Service Selection: A Comparative Study of Transformer Encoders"],"prefix":"10.3390","volume":"17","author":[{"given":"Vijayalakshmi","family":"Mahanra Rao","sequence":"first","affiliation":[{"name":"Faculty of Information Science & Technology, Multimedia University, Bukit Beruang, Melaka 75450, Malaysia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2780-6069","authenticated-orcid":false,"given":"R Kanesaraj","family":"Ramasamy","sequence":"additional","affiliation":[{"name":"Faculty of Computing and Informatics, Multimedia University, Cyberjaya 63000, Malaysia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0052-4870","authenticated-orcid":false,"given":"Md Shohel","family":"Sayeed","sequence":"additional","affiliation":[{"name":"Faculty of Information Science & Technology, Multimedia University, Bukit Beruang, Melaka 75450, Malaysia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2026,3,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1167","DOI":"10.1016\/j.infsof.2014.03.012","article-title":"Quality models for web services: A systematic mapping","volume":"56","author":"Oriol","year":"2014","journal-title":"Inf. Softw. Technol."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Yan, Y., Sun, P., Zhang, J., Ma, Y., Zhao, L., and Qin, Y. (2022). Dynamic qos prediction algorithm based on kalman filter modification. Sensors, 22.","DOI":"10.3390\/s22155651"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"55","DOI":"10.18488\/76.v9i1.2992","article-title":"Proposing new routing protocol based on chaos algorithm","volume":"9","author":"Majdi","year":"2022","journal-title":"Rev. Comput. Eng. Res."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"e7003","DOI":"10.1002\/cpe.7003","article-title":"dvo +\u2009lclmf: A web service recommendation mechanism withqosprivacy preservation","volume":"34","author":"Li","year":"2022","journal-title":"Concurr. Comput. Pract. Exp."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"13352","DOI":"10.1007\/s10489-022-04042-w","article-title":"Feature selection and clustering based web service selection using qoss","volume":"53","author":"Purohit","year":"2022","journal-title":"Appl. Intell."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"8822992","DOI":"10.1155\/2020\/8822992","article-title":"Service recommendation with high accuracy and diversity","volume":"2020","author":"Wu","year":"2020","journal-title":"Wirel. Commun. Mob. Comput."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"50489","DOI":"10.1109\/ACCESS.2024.3385341","article-title":"A semi-supervised learning approach to quality-based web service classification","volume":"12","author":"Bonab","year":"2024","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1408","DOI":"10.11591\/ijai.v13.i2.pp1408-1419","article-title":"Comparative analysis of fuzzy multi-criteria decision-making methods for quality of service-based web service selection","volume":"13","author":"Aazagreyir","year":"2024","journal-title":"IAES Int. J. Artif. Intell. (IJ-AI)"},{"key":"ref_9","first-page":"169","article-title":"Semantic annotation based mechanism for web service discovery and recommendation","volume":"14","author":"Merin","year":"2023","journal-title":"J. Wirel. Mob. Netw. Ubiquitous Comput. Dependable Appl."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"e8038","DOI":"10.1002\/cpe.8038","article-title":"Knowledge distillation representation and dcnmix quality prediction-based web service recommendation","volume":"38","author":"Cao","year":"2024","journal-title":"Concurr. Comput. Pract. Exp."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Kang, G., Liang, B., Xu, J., Liu, J., Wen, Y., and Kang, Y. (2023). Qos-centric diversified web service recommendation based on personalized determinantal point process. Electronics, 12.","DOI":"10.3390\/electronics12122575"},{"key":"ref_12","first-page":"e12695","article-title":"qos-aware web service recommendation via exploring the users\u2019 personalized diversity preferences","volume":"6","author":"Kang","year":"2023","journal-title":"Eng. Rep."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Huang, X., and Zhao, G. (2023, January 17\u201319). Web service recommendation based on knowledge graph enhanced. Proceedings of the International Conference on Cloud Computing, Performance Computing, and Deep Learning (CCPCDL 2023), Huzhou, China.","DOI":"10.1117\/12.2678867"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"6993","DOI":"10.1109\/ACCESS.2024.3350642","article-title":"A novel qos prediction model for web services based on an adaptive neuro-fuzzy inference system using coot optimization","volume":"12","author":"Jithendra","year":"2024","journal-title":"IEEE Access"},{"key":"ref_15","unstructured":"Devlin, J., Chang, M., Lee, K., and Toutanova, K. (2019, January 2\u20137). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MN, USA."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Vu, V., Nguyen, Q., Tunyan, E., and Ock, C. (2021). Improving the performance of vietnamese\u2013korean neural machine translation with contextual embedding. Appl. Sci., 11.","DOI":"10.3390\/app112311119"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Gordon, M., Duh, K., and Andrews, N. (2020, January 9). Compressing bert: Studying the effects of weight pruning on transfer learning. Proceedings of the 5th Workshop on Representation Learning for NLP, Online.","DOI":"10.18653\/v1\/2020.repl4nlp-1.18"},{"key":"ref_18","first-page":"213","article-title":"Lcpcwsc: A web service classification approach based on label confusion and priori correction","volume":"20","author":"Xue","year":"2024","journal-title":"Int. J. Web Inf. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1935","DOI":"10.1093\/jamia\/ocaa189","article-title":"Clinical concept extraction using transformers","volume":"27","author":"Yang","year":"2020","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"746","DOI":"10.1162\/tacl_a_00486","article-title":"Fact checking with insufficient evidence","volume":"10","author":"Atanasova","year":"2022","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2706","DOI":"10.47191\/ijcsrr\/V7-i5-32","article-title":"Enhancing customer service in banking with ai: Intent classification using distilbert","volume":"7","author":"Kumar","year":"2024","journal-title":"Int. J. Curr. Sci. Res. Rev."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"McCoy, R., Min, J., and Linzen, T. (2020, January 20). Berts of a feather do not generalize together: Large variability in generalization across models with similar test set performance. Proceedings of the Third BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP, Online.","DOI":"10.18653\/v1\/2020.blackboxnlp-1.21"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Al-Masri, E., and Mahmoud, Q.H. (2008, January 21\u201325). Investigating web services on the world wide web. Proceedings of the ACM 17th International Conference on World Wide Web (WWW \u201808), Beijing, China.","DOI":"10.1145\/1367497.1367605"},{"key":"ref_24","first-page":"19","article-title":"Comparative Analysis of State-of-the-Art Q&A Models: BERT, RoBERTa, DistilBERT, and ALBERT on SQuAD v2 Dataset","volume":"1","author":"Ozkurt","year":"2024","journal-title":"Chaos Fractals"},{"key":"ref_25","unstructured":"(2025, November 24). BERT vs. RoBERTa vs DistilBERT. Swiftorial. Available online: https:\/\/www.swiftorial.com\/matchups\/nlp_platforms\/bert-vs-roberta-vs-distilbert."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"30104","DOI":"10.1038\/s41598-025-16001-9","article-title":"Optimised knowledge distillation for efficient social media emotion recognition using DistilBERT and ALBERT","volume":"15","author":"Hussain","year":"2025","journal-title":"Sci. Rep."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3388","DOI":"10.1109\/TNSM.2025.3570464","article-title":"GACL: Graph Attention Collaborative Learning for Temporal QoS Prediction","volume":"22","author":"Hu","year":"2025","journal-title":"IEEE Trans. Netw. Serv. Manag."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/17\/3\/242\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T05:17:31Z","timestamp":1772601451000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/17\/3\/242"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,2]]},"references-count":27,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2026,3]]}},"alternative-id":["info17030242"],"URL":"https:\/\/doi.org\/10.3390\/info17030242","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,2]]}}}