{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T00:44:56Z","timestamp":1777941896032,"version":"3.51.4"},"reference-count":48,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,3,12]],"date-time":"2023-03-12T00:00:00Z","timestamp":1678579200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["72171123"],"award-info":[{"award-number":["72171123"]}]},{"name":"National Natural Science Foundation of China","award":["72171149"],"award-info":[{"award-number":["72171149"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>Online customer reviews (OCRs) are the real feelings of customers in the process of using products, which have great reference value for potential customers\u2019 purchase decisions. However, it is difficult for consumers to extract helpful information from very large numbers of OCRs. To support consumers\u2019 purchase decisions, this paper proposes a hybrid method to rank alternative products through OCRs. In this method, we use the fine-grained Bidirectional Encoder Representation from Transformers (BERT) model for aspect-level sentiment analysis (SA) and convert SA results of sub-criteria into a corresponding interval intuitionistic fuzzy number, accurately extracting customer satisfaction in OCRs and reducing the errors caused by different amounts of OCRs. Furthermore, in order to obtain the ranking results of products, the subjective and objective weights are combined to determine weight of feature. Subsequently, an improved interval intuitionistic fuzzy VIKOR method is proposed to rank mobile games. Finally, we conduct a case study and make some comparisons, which show that our method can reduce the complexity of accurately obtaining consumers\u2019 personal preferences and help consumers make more accurate decisions.<\/jats:p>","DOI":"10.3390\/systems11030148","type":"journal-article","created":{"date-parts":[[2023,3,13]],"date-time":"2023-03-13T03:03:57Z","timestamp":1678676637000},"page":"148","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Online-Review-Driven Products Ranking: A Hybrid Approach"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4746-270X","authenticated-orcid":false,"given":"Shaojian","family":"Qu","sequence":"first","affiliation":[{"name":"School of Management Science and Engineering, Nanjing University of Information Science and Technology, Nanjing 210044, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yang","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Science, University of Shanghai for Science and Technology, Shanghai 200093, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ying","family":"Ji","sequence":"additional","affiliation":[{"name":"School of Management, Shanghai University, Shanghai 200444, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zheng","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Management Science and Engineering, Nanjing University of Information Science and Technology, Nanjing 210044, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ruijuan","family":"Geng","sequence":"additional","affiliation":[{"name":"School of Science, University of Shanghai for Science and Technology, Shanghai 200093, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1016\/j.jbusres.2021.07.014","article-title":"The impact of online review variance of new products on consumer adoption intentions","volume":"136","author":"Wu","year":"2021","journal-title":"J. Bus. Res."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"226","DOI":"10.1177\/0165551519828627","article-title":"Twitter sentiment analysis using fuzzy integral classifier fusion","volume":"46","author":"Emadi","year":"2020","journal-title":"J. Inf. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1177\/0165551518808195","article-title":"Sequential patterns rule-based approach for opinion target extraction from customer reviews","volume":"45","author":"Rana","year":"2019","journal-title":"J. Inf. Sci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1016\/j.ins.2019.07.025","article-title":"Representing sentiment analysis results of online reviews using interval type-2 fuzzy numbers and its application to product ranking","volume":"504","author":"Bi","year":"2019","journal-title":"Inf. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"386","DOI":"10.1016\/j.elerap.2007.11.004","article-title":"eWOM overload and its effect on consumer behavioral intention depending on consumer involvement","volume":"7","author":"Park","year":"2008","journal-title":"Electron. Commer. Res. Appl."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"493","DOI":"10.2478\/amns.2020.2.00026","article-title":"Users\u2019 sentiment analysis of shopping websites based on online reviews","volume":"5","author":"Wang","year":"2020","journal-title":"Appl. Math. Nonlinear Sci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1177\/0165551518790424","article-title":"CredSaT: Credibility ranking of users in big social data incorporating semantic analysis and temporal factor","volume":"45","author":"Wongthongtham","year":"2019","journal-title":"J. Inf. Sci."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"595","DOI":"10.1049\/joe.2019.1212","article-title":"Using normal dictionaries to extract multiple semantic relationships","volume":"2020","author":"Liang","year":"2020","journal-title":"J. Eng."},{"key":"ref_9","first-page":"346","article-title":"Developing cross-lingual sentiment analysis of malay twitter data using lexicon-based approach","volume":"10","author":"Zabha","year":"2019","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_10","first-page":"463","article-title":"A generic lexicon-based framework for sentiment analysis","volume":"42","author":"Moussa","year":"2018","journal-title":"Int. J. Comput. Appl."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"386","DOI":"10.1177\/1063293X211031485","article-title":"An automated learning model for sentiment analysis and data classification of Twitter data using balanced CA-SVM","volume":"29","author":"Cyril","year":"2021","journal-title":"Concurr. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1089\/big.2019.0130","article-title":"CDNB: CAVIAR-dragonfly optimization with naive bayes for the sentiment and affect analysis in social media","volume":"8","author":"Patil","year":"2020","journal-title":"Big Data"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Dogra, V., Alharithi, F.S., Alvarez, R.M., Singh, A., and Qahtani, A.M. (2022). NLP-Based application for analyzing private and public banks stocks reaction to news events in the Indian stock exchange. Systems, 10.","DOI":"10.3390\/systems10060233"},{"key":"ref_14","unstructured":"Araci, D. (2019). FinBERT: Financial sentiment analysis with pre-trained language models. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1037","DOI":"10.1142\/S021962202050025X","article-title":"An integration of sentiment analysis and MCDM approach for smartphone recommendation","volume":"19","author":"Kumar","year":"2020","journal-title":"Int. J. Inf. Technol. Decis. Mak."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1993","DOI":"10.1109\/TSMC.2018.2875163","article-title":"A fuzzy decision support model with sentiment analysis for items comparison in e-commerce: The case study of http:\/\/PConline.com","volume":"49","author":"Ji","year":"2019","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/j.inffus.2016.11.012","article-title":"Ranking products through online reviews: A method based on sentiment analysis technique and intuitionistic fuzzy set theory","volume":"36","author":"Liu","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Li, H.M., Liang, M.X., Zhang, C.Y., and Cao, Y.C. (2022). Risk evaluation of water environmental treatment PPP projects based on the intuitionistic fuzzy MULTIMOORA improved FMEA method. Systems, 10.","DOI":"10.3390\/systems10050163"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Song, J.K., Jiang, L.N., Liu, Z.C., Leng, X.L., and He, Z.G. (2022). Selection of third-party reverse logistics service provider based on intuitionistic fuzzy multi-criteria decision making. Systems, 10.","DOI":"10.3390\/systems10050188"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1016\/j.cie.2019.01.051","article-title":"Improved decisions for marketing, supply and purchasing: Mining big data through an integration of sentiment analysis and intuitionistic fuzzy multi criteria assessment","volume":"129","author":"Cali","year":"2019","journal-title":"Comput. Ind. Eng."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1245","DOI":"10.1016\/j.ipm.2019.02.018","article-title":"Deep learning-based sentiment classification of evaluative text based on multi-feature fusion","volume":"56","author":"Abdi","year":"2019","journal-title":"Inf. Process. Manag."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1177\/0047287517747753","article-title":"Sentiment analysis in tourism: Capitalizing on big data","volume":"58","author":"Alaei","year":"2019","journal-title":"J. Travel Res."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1177\/0165551519828620","article-title":"Twitter speaks: A case of national disaster situational awareness","volume":"46","author":"Karami","year":"2020","journal-title":"J. Inf. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1177\/0165551518761013","article-title":"Bibliometrics of sentiment analysis literature","volume":"45","author":"Keramatfar","year":"2019","journal-title":"J. Inf. Sci."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"832","DOI":"10.3390\/make1030048","article-title":"A CNN-BiLSTM model for document-level sentiment analysis","volume":"1","author":"Rhanoui","year":"2019","journal-title":"Mach. Learn. Knowl. Extr."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/j.eswa.2016.10.065","article-title":"Improving sentiment analysis via sentence type classification using BiLSTM-CRF and CNN","volume":"72","author":"Chen","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_27","first-page":"1453","article-title":"Temporal-aware multi-category products recommendation model based on aspect-level sentiment analysis","volume":"40","author":"Ding","year":"2018","journal-title":"J. Electron. Inf. Technol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"6939","DOI":"10.1007\/s11042-018-6445-z","article-title":"A survey on sentiment analysis and opinion mining for social multimedia","volume":"78","author":"Li","year":"2019","journal-title":"Multimed. Tools Appl."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"247","DOI":"10.15611\/aoe.2022.1.11","article-title":"The impact of social media peer communication on customer behaviour-evidence from romania","volume":"48","author":"Anastasiei","year":"2022","journal-title":"Argum. Oeconomica"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Kauffmann, E., Peral, J., Gil, D., Ferr\u00e1ndez, A., Sellers, R., and Mora, H. (2019). Managing marketing decision-making with sentiment analysis: An evaluation of the main product features using text data mining. Sustainability, 11.","DOI":"10.3390\/su11154235"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"466","DOI":"10.3390\/jtaer16030029","article-title":"What makes an online review more helpful: An interpretation framework using XGBoost and SHAP values","volume":"16","author":"Meng","year":"2021","journal-title":"J. Theor. Appl. Electron. Commer. Res."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1725","DOI":"10.1007\/s10489-019-01577-3","article-title":"Customized ranking for products through online reviews: A method incorporating prospect theory with an improved VIKOR","volume":"50","author":"Zhang","year":"2020","journal-title":"Appl. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1497","DOI":"10.1142\/S021962201750033X","article-title":"A method for ranking products through online reviews based on sentiment classification and interval-valued intuitionistic fuzzy TOPSIS","volume":"16","author":"Liu","year":"2017","journal-title":"Int. J. Inf. Technol. Decis. Mak."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"4663","DOI":"10.1007\/s00521-020-05411-7","article-title":"Applying BERT to analyze investor sentiment in stock market","volume":"33","author":"Li","year":"2020","journal-title":"Neural Comput. Appl."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1177\/0165551517703514","article-title":"Lexicon-based sentiment analysis: Comparative evaluation of six sentiment lexicons","volume":"44","author":"Khoo","year":"2018","journal-title":"J. Inf. Sci."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"843","DOI":"10.1007\/s00607-015-0439-8","article-title":"CAPRA: A comprehensive approach to product ranking using customer reviews","volume":"97","author":"Najmi","year":"2015","journal-title":"Computing"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"990","DOI":"10.1108\/K-01-2018-0029","article-title":"Ranking products with IF-based sentiment word framework and TODIM method","volume":"48","author":"Wu","year":"2019","journal-title":"Kybernetes"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1016\/j.elerap.2014.11.004","article-title":"Visualizing market structure through online product reviews: Integrate topic modeling, TOPSIS, and multi-dimensional scaling approaches","volume":"14","author":"Chen","year":"2015","journal-title":"Electron. Commer. Res. Appl."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"5245","DOI":"10.1007\/s13369-014-1033-7","article-title":"A fuzzy PROMETHEE approach for mining customer reviews in Chinese","volume":"39","author":"Peng","year":"2014","journal-title":"Arab. J. Sci. Eng."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2882","DOI":"10.1080\/1331677X.2019.1658534","article-title":"Marketing strategies evaluation based on big data analysis: A CLUSTERING-MCDM approach","volume":"32","author":"Mahdiraji","year":"2019","journal-title":"Econ. Res.-Ekon. Istra\u017eivanja"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1016\/0165-0114(89)90205-4","article-title":"Interval valued intuitionistic fuzzy sets","volume":"31","author":"Atanassov","year":"1989","journal-title":"Fuzzy Sets Syst."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1016\/j.knosys.2010.04.010","article-title":"Induced generalized intuitionistic fuzzy operators","volume":"24","author":"Xu","year":"2011","journal-title":"Knowl. Based Syst."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"107007","DOI":"10.1016\/j.asoc.2020.107007","article-title":"Fuzzy best-worst method and its application in initial water rights allocation","volume":"101","author":"Xu","year":"2021","journal-title":"Appl. Soft Comput."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1287\/orsc.1050.0156","article-title":"Why do users contribute to firm-hosted user communities? The case of computer-controlled music instruments","volume":"17","author":"Jeppesen","year":"2006","journal-title":"Organ. Sci."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"85","DOI":"10.21315\/mjms2018.25.6.9","article-title":"A review on sample size determination for cronbach\u2019s alpha test: A simple guide for researchers","volume":"25","author":"Bujang","year":"2018","journal-title":"Malays. J. Med. Sci."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"83","DOI":"10.20405\/kl.2021.11.93.83","article-title":"Constructing sentiment lexicon for subject-specific sentiment analysis","volume":"93","author":"Ah","year":"2021","journal-title":"Korean Linguist."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"32280","DOI":"10.1109\/ACCESS.2022.3160172","article-title":"A study of the application of weight distributing method combining sentiment dictionary and TF-IDF for text sentiment analysis","volume":"10","author":"Liu","year":"2022","journal-title":"IEEE Access"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"3428","DOI":"10.3390\/su15043428","article-title":"Analyzing healthcare and wellness products&rsquo; Quality embedded in online customer reviews: Assessment with a hybrid fuzzy LMAW and fermatean fuzzy WASPAS method","volume":"15","year":"2023","journal-title":"Sustainability"}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/11\/3\/148\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:53:14Z","timestamp":1760122394000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/11\/3\/148"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,12]]},"references-count":48,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["systems11030148"],"URL":"https:\/\/doi.org\/10.3390\/systems11030148","relation":{},"ISSN":["2079-8954"],"issn-type":[{"value":"2079-8954","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,12]]}}}