{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T00:35:00Z","timestamp":1773189300556,"version":"3.50.1"},"reference-count":53,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2025,8,25]],"date-time":"2025-08-25T00:00:00Z","timestamp":1756080000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"MICIU\/AEI\/ 10.13039\/501100011033","award":["PID2022-139297OB-I00"],"award-info":[{"award-number":["PID2022-139297OB-I00"]}]},{"name":"MICIU\/AEI\/ 10.13039\/501100011033","award":["C-ING-165-UGR23"],"award-info":[{"award-number":["C-ING-165-UGR23"]}]},{"name":"Regional Ministry of University, Research and Innovation","award":["PID2022-139297OB-I00"],"award-info":[{"award-number":["PID2022-139297OB-I00"]}]},{"name":"Regional Ministry of University, Research and Innovation","award":["C-ING-165-UGR23"],"award-info":[{"award-number":["C-ING-165-UGR23"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>The growing ubiquity of digital platforms has enabled unprecedented participation in large-scale group decision-making processes. Nevertheless, integrating subjective linguistically expressed opinions into structured decision protocols remains a significant challenge. This paper presents a novel framework that leverages the semantic and affective capabilities of large language models to support large-scale group decision-making tasks by extracting and quantifying experts\u2019 communicative traits\u2014specifically clarity and trust\u2014from natural language input. Based on these traits, participants are clustered into behavioural groups, each of which is assigned a representative preference structure and a weight reflecting its internal cohesion and communicative quality. A sentiment-informed consensus mechanism then aggregates these group-level matrices to form a collective decision outcome. The method enhances scalability and interpretability while preserving the richness of human expression. The results suggest that incorporating behavioural dimensions into large-scale group decision-making via large language models fosters fairer, more balanced, and semantically grounded decisions, offering a promising avenue for next-generation decision-support systems.<\/jats:p>","DOI":"10.3390\/fi17090381","type":"journal-article","created":{"date-parts":[[2025,8,26]],"date-time":"2025-08-26T06:26:14Z","timestamp":1756189574000},"page":"381","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Modelling Large-Scale Group Decision-Making Through Grouping with Large Language Models"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-4806-8313","authenticated-orcid":false,"given":"Juan Carlos","family":"Gonz\u00e1lez-Quesada","sequence":"first","affiliation":[{"name":"Department of Computer Science and Artificial Intelligence, Andalusian Research Institute in Data Science and Computational Intelligence, DaSCI, University of Granada, 18071 Granada, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7998-5476","authenticated-orcid":false,"given":"Jos\u00e9 Ram\u00f3n","family":"Trillo","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Artificial Intelligence, Andalusian Research Institute in Data Science and Computational Intelligence, DaSCI, University of Granada, 18071 Granada, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0219-2937","authenticated-orcid":false,"given":"Carlos","family":"Porcel","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Artificial Intelligence, Andalusian Research Institute in Data Science and Computational Intelligence, DaSCI, University of Granada, 18071 Granada, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4253-8629","authenticated-orcid":false,"given":"Ignacio Javier","family":"P\u00e9rez","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Artificial Intelligence, Andalusian Research Institute in Data Science and Computational Intelligence, DaSCI, University of Granada, 18071 Granada, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7012-8649","authenticated-orcid":false,"given":"Francisco Javier","family":"Cabrerizo","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Artificial Intelligence, Andalusian Research Institute in Data Science and Computational Intelligence, DaSCI, University of Granada, 18071 Granada, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2025,8,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1287","DOI":"10.1109\/TFUZZ.2021.3057705","article-title":"A dynamic feedback mechanism with attitudinal consensus threshold for minimum adjustment cost in group decision making","volume":"30","author":"Sun","year":"2021","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"624","DOI":"10.1016\/j.ejor.2013.04.046","article-title":"A method based on PSO and granular computing of linguistic information to solve group decision making problems defined in heterogeneous contexts","volume":"230","author":"Cabrerizo","year":"2013","journal-title":"Eur. J. Oper. Res."},{"key":"ref_3","first-page":"1695","article-title":"Improved clustering algorithm and its application in complex huge group decision-making","volume":"28","author":"Chen","year":"2006","journal-title":"Syst. Eng. Electron."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1016\/j.ejor.2017.07.030","article-title":"Jie Ke versus AlphaGo: A ranking approach using decision making method for large-scale data with incomplete information","volume":"265","author":"Chao","year":"2018","journal-title":"Eur. J. Oper. Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1016\/j.cie.2017.11.025","article-title":"A two-stage consensus method for large-scale multi-attribute group decision making with an application to earthquake shelter selection","volume":"116","author":"Xu","year":"2018","journal-title":"Comput. Ind. Eng."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1109\/TFUZZ.2018.2876655","article-title":"Alternative ranking-based clustering and reliability index-based consensus reaching process for hesitant fuzzy large scale group decision making","volume":"27","author":"Liu","year":"2018","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1016\/j.knosys.2018.09.010","article-title":"A large-group emergency risk decision method based on data mining of public attribute preferences","volume":"163","author":"Xu","year":"2019","journal-title":"Knowl.-Based Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"109249","DOI":"10.1016\/j.asoc.2022.109249","article-title":"Consensus progress for large-scale group decision making in social networks with incomplete probabilistic hesitant fuzzy information","volume":"126","author":"Lu","year":"2022","journal-title":"Appl. Soft Comput."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Li, Q., Liu, G., Zhang, T., and Xu, Y. A consensus algorithm based on the worst consistency index of hesitant fuzzy preference relations in group decision-making. Complex Intell. Syst., 2022. in press.","DOI":"10.1007\/s40747-022-00863-x"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"4291","DOI":"10.1109\/TNNLS.2020.3019893","article-title":"Attention in natural language processing","volume":"32","author":"Galassi","year":"2020","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_11","first-page":"1","article-title":"Statistical Significance Testing for Natural Language Processing","volume":"13","author":"Dror","year":"2020","journal-title":"Synth. Lect. Hum. Lang. Technol."},{"key":"ref_12","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017). Attention is all you need. Adv. Neural Inf. Process. Syst., 30."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"426","DOI":"10.1080\/03610918.2018.1563145","article-title":"Combining clustering of variables and feature selection using random forests","volume":"50","author":"Chavent","year":"2021","journal-title":"Commun.-Stat.-Simul. Comput."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"114355","DOI":"10.1016\/j.eswa.2020.114355","article-title":"A hesitant fuzzy linguistic bi-objective clustering method for large-scale group decision-making","volume":"168","author":"Zheng","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1109\/TFUZZ.2018.2857720","article-title":"A consensus model for large-scale linguistic group decision making with a feedback recommendation based on clustered personalized individual semantics and opposing consensus groups","volume":"27","author":"Li","year":"2018","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/j.inffus.2017.09.011","article-title":"A consensus model for large-scale group decision making with hesitant fuzzy information and changeable clusters","volume":"41","author":"Wu","year":"2018","journal-title":"Inf. Fusion"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.inffus.2020.05.004","article-title":"A trust-similarity analysis-based clustering method for large-scale group decision-making under a social network","volume":"63","author":"Du","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"105973","DOI":"10.1016\/j.asoc.2019.105973","article-title":"Clustering-based method for large group decision making with hesitant fuzzy linguistic information: Integrating correlation and consensus","volume":"87","author":"Zhong","year":"2020","journal-title":"Appl. Soft Comput."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"105501","DOI":"10.1016\/j.ijmedinf.2024.105501","article-title":"Integrating human expertise & automated methods for a dynamic and multi-parametric evaluation of large language models\u2019 feasibility in clinical decision-making","volume":"188","author":"Sblendorio","year":"2024","journal-title":"Int. J. Med. Inform."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Qader, W.A., Ameen, M.M., and Ahmed, B.I. (2019, January 23\u201325). An overview of bag of words; importance, implementation, applications, and challenges. Proceedings of the 2019 International Engineering Conference (IEC), Erbil, Iraq.","DOI":"10.1109\/IEC47844.2019.8950616"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1080\/19312458.2018.1455817","article-title":"More than bags of words: Sentiment analysis with word embeddings","volume":"12","author":"Rudkowsky","year":"2018","journal-title":"Commun. Methods Meas."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"100211","DOI":"10.1016\/j.hcc.2024.100211","article-title":"A survey on large language model (llm) security and privacy: The good, the bad, and the ugly","volume":"4","author":"Yao","year":"2024","journal-title":"High-Confid. Comput."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wu, D., Nie, L., Mumtaz, R.A., and Agarwal, K. (2024). A llm-based hybrid-transformer diagnosis system in healthcare. IEEE J. Biomed. Health Inform.","DOI":"10.1109\/JBHI.2024.3481412"},{"key":"ref_24","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019, January 2\u20137). BERT: Pretraining of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MN, USA."},{"key":"ref_25","first-page":"1877","article-title":"Language Models are Few-Shot Learners","volume":"33","author":"Brown","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"23522","DOI":"10.1109\/ACCESS.2020.2969854","article-title":"Sentiment analysis for E-commerce product reviews in Chinese based on sentiment lexicon and deep learning","volume":"8","author":"Yang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1016\/j.future.2020.06.050","article-title":"Transformer based deep intelligent contextual embedding for twitter sentiment analysis","volume":"113","author":"Naseem","year":"2020","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"105657","DOI":"10.1016\/j.knosys.2020.105657","article-title":"A dynamic group decision making process for high number of alternatives using hesitant Fuzzy Ontologies and sentiment analysis","volume":"195","author":"Cabrerizo","year":"2020","journal-title":"Knowl.-Based Syst."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"957","DOI":"10.1016\/j.ejor.2019.10.006","article-title":"Adaptive consensus reaching process with hybrid strategies for large-scale group decision making","volume":"282","author":"Tang","year":"2020","journal-title":"Eur. J. Oper. Res."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2875","DOI":"10.1109\/TFUZZ.2019.2949758","article-title":"Managing multigranular unbalanced hesitant fuzzy linguistic information in multiattribute large-scale group decision making: A linguistic distribution-based approach","volume":"28","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/j.inffus.2018.12.004","article-title":"An overview on managing additive consistency of reciprocal preference relations for consistency-driven decision making and fusion: Taxonomy and future directions","volume":"52","author":"Li","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1016\/j.inffus.2019.06.028","article-title":"A novel multi-criteria group decision-making method for heterogeneous and dynamic contexts using multi-granular fuzzy linguistic modelling and consensus measures","volume":"53","author":"Wu","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1914","DOI":"10.1080\/01605682.2020.1748529","article-title":"Consistency improvement for fuzzy preference relations with self-confidence: An application in two-sided matching decision making","volume":"72","author":"Zhang","year":"2021","journal-title":"J. Oper. Res. Soc."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/j.fss.2014.03.016","article-title":"Building consensus in group decision making with an allocation of information granularity","volume":"255","author":"Cabrerizo","year":"2014","journal-title":"Fuzzy Sets Syst."},{"key":"ref_35","first-page":"1109","article-title":"Fuzzy decision making and consensus: Challenges","volume":"29","author":"Cabrerizo","year":"2015","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1984","DOI":"10.1109\/TFUZZ.2019.2928787","article-title":"Collective scenario understanding in a multivehicle system by consensus decision making","volume":"28","author":"Cavaliere","year":"2019","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1016\/j.eswa.2019.03.023","article-title":"Dealing with group decision-making environments that have a high amount of alternatives using card-sorting techniques","volume":"127","year":"2019","journal-title":"Expert Syst. Appl."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1016\/0165-0114(95)00162-X","article-title":"Direct approach processes in group decision making using linguistic OWA operators","volume":"79","author":"Herrera","year":"1996","journal-title":"Fuzzy Sets Syst."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"737","DOI":"10.1016\/j.ejor.2018.11.075","article-title":"Large-scale group decision making model based on social network analysis: Trust relationship-based conflict detection and elimination","volume":"275","author":"Liu","year":"2019","journal-title":"Eur. J. Oper. Res."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"106842","DOI":"10.1016\/j.cie.2020.106842","article-title":"A k-core decomposition-based opinion leaders identifying method and clustering-based consensus model for large-scale group decision making","volume":"150","author":"Gao","year":"2020","journal-title":"Comput. Ind. Eng."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"410","DOI":"10.1016\/j.ins.2018.10.058","article-title":"Confidence consensus-based model for large-scale group decision making: A novel approach to managing non-cooperative behaviors","volume":"477","author":"Xu","year":"2019","journal-title":"Inf. Sci."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1080\/01605682.2018.1458017","article-title":"A large-scale group decision-making with incomplete multi-granular probabilistic linguistic term sets and its application in sustainable supplier selection","volume":"70","author":"Song","year":"2019","journal-title":"J. Oper. Res. Soc."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/j.inffus.2019.03.001","article-title":"Consensus model for large-scale group decision making based on fuzzy preference relation with self-confidence: Detecting and managing overconfidence behaviors","volume":"52","author":"Liu","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1016\/j.inffus.2013.04.002","article-title":"A review of soft consensus models in a fuzzy environment","volume":"17","author":"Cabrerizo","year":"2014","journal-title":"Inf. Fusion"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1617","DOI":"10.1007\/s00500-012-0975-5","article-title":"A new consensus model for group decision making using fuzzy ontology","volume":"17","author":"Mezei","year":"2013","journal-title":"Soft Comput."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"105488","DOI":"10.1016\/j.asoc.2019.105488","article-title":"A bibliometric analysis of aggregation operators","volume":"81","year":"2019","journal-title":"Appl. Soft Comput."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"226","DOI":"10.1007\/s40314-020-01251-2","article-title":"Decision-making model under complex picture fuzzy Hamacher aggregation operators","volume":"39","author":"Akram","year":"2020","journal-title":"Comput. Appl. Math."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/S0165-0114(97)00087-0","article-title":"Fuzzy sets and decision analysis","volume":"90","author":"Roubens","year":"1997","journal-title":"Fuzzy Sets Syst."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Trillo, J.R., Cabrerizo, F.J., Chiclana, F., Mart\u00ednez, M.\u00c1., Mata, F., and Herrera-Viedma, E. (2022). Theorem Verification of the Quantifier-Guided Dominance Degree with the Mean Operator for Additive Preference Relations. Mathematics, 10.","DOI":"10.3390\/math10122035"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"7149","DOI":"10.1007\/s10586-017-1077-z","article-title":"Opinion mining on large scale data using sentiment analysis and k-means clustering","volume":"22","author":"Riaz","year":"2019","journal-title":"Clust. Comput."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"499","DOI":"10.1016\/j.ins.2021.06.047","article-title":"An efficient consensus reaching framework for large-scale social network group decision making and its application in urban resettlement","volume":"575","author":"Chao","year":"2021","journal-title":"Inf. Sci."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1016\/j.ejor.2020.05.047","article-title":"Large-scale group decision-making with non-cooperative behaviors and heterogeneous preferences: An application in financial inclusion","volume":"288","author":"Chao","year":"2021","journal-title":"Eur. J. Oper. Res."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"633","DOI":"10.1016\/j.inffus.2022.11.009","article-title":"A large scale group decision making system based on sentiment analysis cluster","volume":"91","author":"Trillo","year":"2023","journal-title":"Inf. Fusion"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/17\/9\/381\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T18:32:23Z","timestamp":1760034743000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/17\/9\/381"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,25]]},"references-count":53,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2025,9]]}},"alternative-id":["fi17090381"],"URL":"https:\/\/doi.org\/10.3390\/fi17090381","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,25]]}}}