{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T01:10:38Z","timestamp":1760058638411,"version":"build-2065373602"},"reference-count":50,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2025,4,17]],"date-time":"2025-04-17T00:00:00Z","timestamp":1744848000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["BDCC"],"abstract":"<jats:p>Recommender systems aspire to provide users with recommendations that have a high probability of being accepted. This is accomplished by producing rating predictions for products that the users have not evaluated, and, afterwards, the products with the highest prediction scores are recommended to them. Collaborative filtering is a popular recommender system technique which generates rating prediction scores by blending the ratings that users with similar preferences have previously given to these products. However, predictions may entail errors, which will either lead to recommending products that the users would not accept or failing to recommend products that the users would actually accept. The first case is considered much more critical, since the recommender system will lose a significant amount of reliability and consequently interest. In this paper, after performing a study on rating prediction confidence factors in collaborative filtering, (a) we introduce the concept of prediction reliability classes, (b) we rank these classes in relation to the utility of the rating predictions belonging to each class, and (c) we present a collaborative filtering recommendation algorithm which exploits these reliability classes for prediction formulation. The efficacy of the presented algorithm is evaluated through an extensive multi-parameter evaluation process, which demonstrates that it significantly enhances recommendation quality.<\/jats:p>","DOI":"10.3390\/bdcc9040106","type":"journal-article","created":{"date-parts":[[2025,4,17]],"date-time":"2025-04-17T06:53:46Z","timestamp":1744872826000},"page":"106","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["From Rating Predictions to Reliable Recommendations in Collaborative Filtering: The Concept of Recommendation Reliability Classes"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7487-374X","authenticated-orcid":false,"given":"Dionisis","family":"Margaris","sequence":"first","affiliation":[{"name":"Department of Digital Systems, University of the Peloponnese, Valioti\u2019s building, Kladas, 231 00 Sparta, Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9940-1821","authenticated-orcid":false,"given":"Costas","family":"Vassilakis","sequence":"additional","affiliation":[{"name":"Department of Informatics and Telecommunications, University of the Peloponnese, Akadimaikou G. K. Vlachou, 221 31 Tripoli, Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3646-1362","authenticated-orcid":false,"given":"Dimitris","family":"Spiliotopoulos","sequence":"additional","affiliation":[{"name":"Department of Management Science and Technology, University of the Peloponnese, Sehi Location (Former 4th Shooting Range), 221 31 Tripoli, Greece"}]}],"member":"1968","published-online":{"date-parts":[[2025,4,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"113651","DOI":"10.1016\/j.eswa.2020.113651","article-title":"Improving Neighbor-Based Collaborative Filtering by Using a Hybrid Similarity Measurement","volume":"160","author":"Wang","year":"2020","journal-title":"Expert Syst. Appl."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"142795","DOI":"10.1109\/ACCESS.2020.3013733","article-title":"Improving Prediction Accuracy in Neighborhood-Based Collaborative Filtering by Using Local Similarity","volume":"8","author":"Rosa","year":"2020","journal-title":"IEEE Access"},{"key":"ref_3","first-page":"343","article-title":"A Survey of Similarity Measures for Collaborative Filtering-Based Recommender System","volume":"Volume 1053","author":"Pant","year":"2020","journal-title":"Soft Computing: Theories and Applications"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"115482","DOI":"10.1016\/j.eswa.2021.115482","article-title":"Survey of Similarity Functions on Neighborhood-Based Collaborative Filtering","volume":"185","author":"Khojamli","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Nguyen, L.V., Vo, Q.-T., and Nguyen, T.-H. (2023). Adaptive KNN-Based Extended Collaborative Filtering Recommendation Services. Big Data Cogn. Comput., 7.","DOI":"10.3390\/bdcc7020106"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"7645","DOI":"10.1016\/j.jksuci.2021.09.014","article-title":"Similarity Measures for Collaborative Filtering-Based Recommender Systems: Review and Experimental Comparison","volume":"34","author":"Fkih","year":"2022","journal-title":"J. King Saud Univ. Comput. Inf. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Ricci, F., Rokach, L., and Shapira, B. (2022). Advances in Collaborative Filtering. Recommender Systems Handbook, Springer.","DOI":"10.1007\/978-1-0716-2197-4"},{"key":"ref_8","first-page":"4425","article-title":"A Survey on Accuracy-Oriented Neural Recommendation: From Collaborative Filtering to Information-Rich Recommendation","volume":"35","author":"Wu","year":"2022","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Margaris, D., Vassilakis, C., and Spiliotopoulos, D. (2022). On Producing Accurate Rating Predictions in Sparse Collaborative Filtering Datasets. Information, 13.","DOI":"10.3390\/info13060302"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Spiliotopoulos, D., Margaris, D., and Vassilakis, C. (2022). On Exploiting Rating Prediction Accuracy Features in Dense Collaborative Filtering Datasets. Information, 13.","DOI":"10.3390\/info13090428"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.elerap.2016.05.001","article-title":"A Clustering Based Approach to Improving the Efficiency of Collaborative Filtering Recommendation","volume":"18","author":"Liao","year":"2016","journal-title":"Electron. Commer. Res. Appl."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"108581","DOI":"10.1109\/ACCESS.2019.2933048","article-title":"A Collaborative Filtering Approach Based on Na\u00efve Bayes Classifier","volume":"7","author":"Ortega","year":"2019","journal-title":"IEEE Access"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Margaris, D., and Vassilakis, C. (2017, January 3\u20136). Improving Collaborative Filtering\u2019s Rating Prediction Quality in Dense Datasets, by Pruning Old Ratings. Proceedings of the 2017 IEEE Symposium on Computers and Communications (ISCC), Heraklion, Greece.","DOI":"10.1109\/ISCC.2017.8024683"},{"key":"ref_14","first-page":"48","article-title":"Improve Performance of Association Rule-Based Collaborative Filtering Recommendation Systems Using Genetic Algorithm","volume":"11","author":"Neysiani","year":"2019","journal-title":"Int. J. Inf. Technol. Comput. Sci."},{"key":"ref_15","first-page":"173","article-title":"Combining User-Based and Item-Based Collaborative Filtering Using Machine Learning","volume":"Volume 107","author":"Satapathy","year":"2019","journal-title":"Information and Communication Technology for Intelligent Systems"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"He, X., Deng, K., Wang, X., Li, Y., Zhang, Y., and Wang, M. (2020, January 25\u201330). LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation. Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, China.","DOI":"10.1145\/3397271.3401063"},{"key":"ref_17","first-page":"7870","article-title":"Disentangled Graph Neural Networks for Session-Based Recommendation","volume":"35","author":"Li","year":"2023","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wei, Y., Wang, X., Li, Q., Nie, L., Li, Y., Li, X., and Chua, T.-S. (2021, January 20\u201324). Contrastive Learning for Cold-Start Recommendation. Proceedings of the 29th ACM International Conference on Multimedia, Virtual Event, China.","DOI":"10.1145\/3474085.3475665"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1633","DOI":"10.1109\/TPAMI.2016.2605085","article-title":"Social Collaborative Filtering by Trust","volume":"39","author":"Yang","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1016\/j.ins.2017.08.008","article-title":"A Hybrid User Similarity Model for Collaborative Filtering","volume":"418\u2013419","author":"Wang","year":"2017","journal-title":"Inf. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Islam, R., Keya, K.N., Zeng, Z., Pan, S., and Foulds, J. (2021, January 19\u201323). Debiasing Career Recommendations with Neural Fair Collaborative Filtering. Proceedings of the Web Conference 2021, Ljubljana, Slovenia.","DOI":"10.1145\/3442381.3449904"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1142\/S0219622021500619","article-title":"Pointer-Based Item-to-Item Collaborative Filtering Recommendation System Using a Machine Learning Model","volume":"21","author":"Iwendi","year":"2022","journal-title":"Int. J. Inf. Technol. Decis. Mak."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"107952","DOI":"10.1016\/j.comnet.2021.107952","article-title":"An Adaptive Trust Model Based on Recommendation Filtering Algorithm for the Internet of Things Systems","volume":"190","author":"Chen","year":"2021","journal-title":"Comput. Netw."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2338","DOI":"10.1080\/13683500.2021.2014792","article-title":"Personalized Travel Recommendation: A Hybrid Method with Collaborative Filtering and Social Network Analysis","volume":"25","author":"Chang","year":"2022","journal-title":"Curr. Issues Tour."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"e6232","DOI":"10.1002\/cpe.6232","article-title":"Extending Collaborative Filtering Recommendation Using Word Embedding: A Hybrid Approach","volume":"35","author":"Nguyen","year":"2023","journal-title":"Concurr. Comput. Pract. Exp."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"543","DOI":"10.1007\/978-981-10-3773-3_53","article-title":"Proposed Approach for Book Recommendation Based on User K-NN","volume":"Volume 554","author":"Bhatia","year":"2018","journal-title":"Advances in Computer and Computational Sciences"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"106545","DOI":"10.1016\/j.knosys.2020.106545","article-title":"A Deep Learning Based Algorithm for Multi-Criteria Recommender Systems","volume":"211","author":"Shambour","year":"2021","journal-title":"Knowl. Based Syst."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Margaris, D., Sgardelis, K., Spiliotopoulos, D., and Vassilakis, C. (2024). Exploiting Rating Prediction Certainty for Recommendation Formulation in Collaborative Filtering. Big Data Cogn. Comput., 8.","DOI":"10.3390\/bdcc8060053"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Sgardelis, K., Margaris, D., Spiliotopoulos, D., Vassilakis, C., and Ougiaroglou, S. (2024, January 17\u201319). Improving Recommendation Quality in Collaborative Filtering by Including Prediction Confidence Factors. Proceedings of the 20th International Conference on Web Information Systems and Technologies, Porto, Portugal.","DOI":"10.5220\/0013052200003825"},{"key":"ref_30","first-page":"750","article-title":"NEAR: Non-Supervised Explainability Architecture for Accurate Review-Based Collaborative Filtering","volume":"36","author":"Pugoy","year":"2022","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"101019","DOI":"10.1016\/j.elerap.2020.101019","article-title":"Neural Text Similarity of User Reviews for Improving Collaborative Filtering Recommender Systems","volume":"45","author":"Ghasemi","year":"2021","journal-title":"Electron. Commer. Res. Appl."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"121102","DOI":"10.1016\/j.ins.2024.121102","article-title":"KGCF: Social Relationship-Aware Graph Collaborative Filtering for Recommendation","volume":"680","author":"Chen","year":"2024","journal-title":"Inf. Sci."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1016\/j.eswa.2006.04.018","article-title":"Application of Support Vector Machines to Corporate Credit Rating Prediction","volume":"33","author":"Lee","year":"2007","journal-title":"Expert Syst. Appl."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Ni, J., Li, J., and McAuley, J. (2019, January 3\u20137). Justifying Recommendations Using Distantly-Labeled Reviews and Fine-Grained Aspects. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.","DOI":"10.18653\/v1\/D19-1018"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Guo, G., Zhang, J., Thalmann, D., and Yorke-Smith, N. (2014, January 17\u201320). ETAF: An Extended Trust Antecedents Framework for Trust Prediction. Proceedings of the 2014 IEEE\/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2014), Beijing, China.","DOI":"10.1109\/ASONAM.2014.6921639"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1007\/978-3-540-39718-2_23","article-title":"Trust Management for the Semantic Web","volume":"Volume 2870","author":"Fensel","year":"2003","journal-title":"The Semantic Web\u2014ISWC 2003"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2827872","article-title":"The MovieLens Datasets: History and Context","volume":"5","author":"Harper","year":"2016","journal-title":"ACM Trans. Interact. Intell. Syst."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Krichene, W., and Rendle, S. (2020, January 6\u201310). On Sampled Metrics for Item Recommendation. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Virtual Event, CA, USA.","DOI":"10.1145\/3394486.3403226"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Chin, J.Y., Chen, Y., and Cong, G. (2022, January 21\u201325). The Datasets Dilemma: How Much Do We Really Know About Recommendation Datasets?. Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining, Virtual Event, AZ, USA.","DOI":"10.1145\/3488560.3498519"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"102304","DOI":"10.1016\/j.ipm.2020.102304","article-title":"What Makes a Review a Reliable Rating in Recommender Systems?","volume":"57","author":"Margaris","year":"2020","journal-title":"Inf. Process. Manag."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Felfernig, A., Boratto, L., Stettinger, M., and Tkal\u010di\u010d, M. (2024). Evaluating Group Recommender Systems. Group Recommender Systems, Springer Nature. Signals and Communication Technology.","DOI":"10.1007\/978-3-031-44943-7"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Felfernig, A., Boratto, L., Stettinger, M., and Tkal\u010di\u010d, M. (2018). Evaluating Group Recommender Systems. Group Recommender Systems, Springer. Springer Briefs in Electrical and Computer Engineering.","DOI":"10.1007\/978-3-319-75067-5"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1007\/s00453-012-9717-4","article-title":"Analysis of Agglomerative Clustering","volume":"69","author":"Ackermann","year":"2014","journal-title":"Algorithmica"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"126433","DOI":"10.1016\/j.physa.2021.126433","article-title":"Revisiting Agglomerative Clustering","volume":"585","author":"Tokuda","year":"2022","journal-title":"Phys. A Stat. Mech. Appl."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1327","DOI":"10.3233\/IDA-163129","article-title":"Davies Bouldin Index Based Hierarchical Initialization K-Means","volume":"21","author":"Xiao","year":"2017","journal-title":"Intell. Data Anal."},{"key":"ref_46","first-page":"18","article-title":"Neural Collaborative Filtering Classification Model to Obtain Prediction Reliabilities","volume":"7","author":"Bobadilla","year":"2022","journal-title":"Int. J. Interact. Multimed. Artif. Intell."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"He, X., Liao, L., Zhang, H., Nie, L., Hu, X., and Chua, T.-S. (2017, January 3\u20137). Neural Collaborative Filtering. Proceedings of the 26th International Conference on World Wide Web, Perth, Australia.","DOI":"10.1145\/3038912.3052569"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"456","DOI":"10.1016\/j.procs.2023.03.058","article-title":"A Collaborative Filtering Movies Recommendation System Based on Graph Neural Network","volume":"220","author":"Nesmaoui","year":"2023","journal-title":"Procedia Comput. Sci."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"7805","DOI":"10.1007\/s11042-020-09949-5","article-title":"Presentation of a Recommender System with Ensemble Learning and Graph Embedding: A Case on MovieLens","volume":"80","author":"Forouzandeh","year":"2021","journal-title":"Multimed. Tools Appl."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Ho, T.-L., Le, A.-C., and Vu, D.-H. (2023). Multiview Fusion Using Transformer Model for Recommender Systems: Integrating the Utility Matrix and Textual Sources. Appl. Sci., 13.","DOI":"10.3390\/app13106324"}],"container-title":["Big Data and Cognitive Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-2289\/9\/4\/106\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:16:20Z","timestamp":1760030180000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-2289\/9\/4\/106"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,17]]},"references-count":50,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2025,4]]}},"alternative-id":["bdcc9040106"],"URL":"https:\/\/doi.org\/10.3390\/bdcc9040106","relation":{},"ISSN":["2504-2289"],"issn-type":[{"type":"electronic","value":"2504-2289"}],"subject":[],"published":{"date-parts":[[2025,4,17]]}}}