{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T15:22:40Z","timestamp":1772119360305,"version":"3.50.1"},"reference-count":52,"publisher":"Springer Science and Business Media LLC","issue":"10","license":[{"start":{"date-parts":[[2023,2,10]],"date-time":"2023-02-10T00:00:00Z","timestamp":1675987200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,2,10]],"date-time":"2023-02-10T00:00:00Z","timestamp":1675987200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001823","name":"Ministerstvo \u0160kolstv\u00ed, Ml\u00e1de\u017ee a Telov\u00fdchovy","doi-asserted-by":"publisher","award":["SP2021\/86"],"award-info":[{"award-number":["SP2021\/86"]}],"id":[{"id":"10.13039\/501100001823","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Soft Comput"],"published-print":{"date-parts":[[2023,5]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    Valuable information for decision-making can be obtained by collecting and analyzing opinions from diverse stakeholder or respondent groups, which usually have different backgrounds and are variously affected by the topics under survey. For this to succeed, it is necessary to manage the uncertainty of respondents\u2019 opinions, different number of filled questionnaires among groups, different number of questions for each stakeholder group, and relevance of subsets of respondent groups. This work proposes handling the hesitance of respondents\u2019 opinions for the rating scale questions. To evaluate the collected opinions, a three-level aggregation model is developed. In the first level, the overall opinion of each respondent is computed as a mean of fuzzy numbers covering uncertain answers and their respective hesitance. In the second level, stakeholder groups are considered as a whole. Aggregation by a relative quantifier is applied to calculate the validity of a proposition\n                    <jats:italic>the majority of respondents have a positive or negative opinion<\/jats:italic>\n                    . At the third level, the consensus among diverse subsets of stakeholder groups is calculated considering the relevance of each group independently as well as their so-called coalitions by Choquet integral. Finally, the proposed model is illustrated by a real-life case study.\n                  <\/jats:p>","DOI":"10.1007\/s00500-023-07853-2","type":"journal-article","created":{"date-parts":[[2023,2,10]],"date-time":"2023-02-10T12:33:34Z","timestamp":1676032414000},"page":"6653-6669","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Three-level model for opinion aggregation under hesitance"],"prefix":"10.1007","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3223-3138","authenticated-orcid":false,"given":"Franti\u0161ek","family":"Zapletal","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Miroslav","family":"Hudec","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Milo\u0161","family":"\u0160va\u0148a","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Radek","family":"N\u011bmec","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,2,10]]},"reference":[{"key":"7853_CR1","volume-title":"Measuring the user experience, collecting, analyzing, and presenting usability metrics (interactive technologies)","author":"W Albert","year":"2013","unstructured":"Albert W, Tullis T (2013) Measuring the user experience, collecting, analyzing, and presenting usability metrics (interactive technologies), 2nd edn. Elsevier, Dodrecht","edition":"2"},{"key":"7853_CR2","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-030-15305-2","volume-title":"Discrete fuzzy measures","author":"G Beliakov","year":"2020","unstructured":"Beliakov G, James S, Wu J-Z (2020) Discrete fuzzy measures. Springer, Cham"},{"key":"7853_CR3","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-24753-3","volume-title":"Practical guide to averaging functions","author":"G Beliakov","year":"2016","unstructured":"Beliakov G, Sola HB, Calvo T (2016) Practical guide to averaging functions. Springer, Cham"},{"key":"7853_CR4","doi-asserted-by":"crossref","unstructured":"Bueno I, Carrasco RA, Ure\u00f1a R, Herrera-Viedma E (2019) Application of an opinion consensus aggregation model based on owa operators to the recommendation of tourist sites. Procedia Computer Science, 162:539\u2013546. 7th International Conference on Information Technology and Quantitative Management (ITQM 2019): Information technology and quantitative management based on Artificial Intelligence","DOI":"10.1016\/j.procs.2019.12.021"},{"key":"7853_CR5","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.asoc.2014.11.050","volume":"28","author":"J-F Chen","year":"2015","unstructured":"Chen J-F, Hsieh H-N, Do QH (2015) Evaluating teaching performance based on fuzzy ahp and comprehensive evaluation approach. Appl Soft Comput 28:100\u2013108","journal-title":"Appl Soft Comput"},{"issue":"2","key":"7853_CR6","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1016\/S0165-0114(00)00004-X","volume":"122","author":"F Chiclana","year":"2001","unstructured":"Chiclana F, Herrera F, Herrera-Viedma E (2001) Integrating multiplicative preference relations in a multipurpose decision-making model based on fuzzy preference relations. Fuzzy Sets Syst 122(2):277\u2013291","journal-title":"Fuzzy Sets Syst"},{"key":"7853_CR7","first-page":"1953","volume":"5","author":"G Choquet","year":"1953","unstructured":"Choquet G (1953) Theory of capacities. Ann Inst Fourier 5:1953\u20131954","journal-title":"Ann Inst Fourier"},{"issue":"3","key":"7853_CR8","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1007\/s11083-015-9382-8","volume":"33","author":"M Couceiro","year":"2016","unstructured":"Couceiro M, Dubois D, Prade H, Waldhauser T (2016) Decision-making with sugeno integrals. Order 33(3):517\u2013535","journal-title":"Order"},{"key":"7853_CR9","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/j.fss.2003.10.038","volume":"142","author":"D Dubois","year":"2004","unstructured":"Dubois D, Prade H (2004) On the use of aggregation operations in information fusion processes. Fuzzy Sets Syst 142:143\u2013161","journal-title":"Fuzzy Sets Syst"},{"key":"7853_CR10","doi-asserted-by":"crossref","DOI":"10.1002\/9781119256489","volume-title":"Soft computing evaluation logic: the Lsp decision method and its applications","author":"J Dujmovi\u0107","year":"2018","unstructured":"Dujmovi\u0107 J (2018) Soft computing evaluation logic: the Lsp decision method and its applications. Wiley, New York"},{"issue":"3","key":"7853_CR11","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1080\/09500799708666923","volume":"11","author":"C Fourali","year":"1997","unstructured":"Fourali C (1997) Using fuzzy logic in educational measurement: the case of portfolio assessment. Eval Res Educ 11(3):129\u2013148","journal-title":"Eval Res Educ"},{"key":"7853_CR12","doi-asserted-by":"crossref","DOI":"10.4018\/978-1-59140-324-1","volume-title":"Fuzzy databases: modeling design and implementation","author":"J Galindo","year":"2006","unstructured":"Galindo J, Urrutia A, Piattini M (2006) Fuzzy databases: modeling design and implementation. Idea Group Publishing Inc., Hershey"},{"key":"7853_CR13","doi-asserted-by":"crossref","unstructured":"Gil MA, Gonz\u00e1lez-Rodr\u00edguez G (2012) Fuzzy vs. Likert Scale in Statistics, pages 407\u2013420","DOI":"10.1007\/978-3-642-24666-1_27"},{"key":"7853_CR14","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-30690-2","volume-title":"Set functions games and capacities in decision making","author":"M Grabisch","year":"2016","unstructured":"Grabisch M (2016) Set functions games and capacities in decision making. Springer, Cham"},{"key":"7853_CR15","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139644150","volume-title":"Aggregation functions","author":"M Grabisch","year":"2009","unstructured":"Grabisch M, Marichal J-L, Mesiar R, Pap E (2009) Aggregation functions. Cambridge University Press, Cambridge"},{"issue":"2","key":"7853_CR16","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1109\/3477.915345","volume":"31","author":"F Herrera","year":"2001","unstructured":"Herrera F, Mart\u00ednez L (2001) A model based on linguistic 2-tuples for dealing with multigranular hierarchical linguistic contexts in multi-expert decision-making. IEEE Trans Syst Man Cybern Part B 31(2):227\u2013234","journal-title":"IEEE Trans Syst Man Cybern Part B"},{"key":"7853_CR17","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-42518-4","volume-title":"Fuzziness in information systems: how to deal with crisp and fuzzy data in selection, classification, and summarization","author":"M Hudec","year":"2016","unstructured":"Hudec M (2016) Fuzziness in information systems: how to deal with crisp and fuzzy data in selection, classification, and summarization. Springer, Cham"},{"issue":"2","key":"7853_CR18","first-page":"1","volume":"14","author":"M Hyman","year":"2016","unstructured":"Hyman M, Sierra JJ (2016) Open-versus close-ended survey questions. Bus Outlook 14(2):1\u20135","journal-title":"Bus Outlook"},{"key":"7853_CR19","doi-asserted-by":"crossref","DOI":"10.1002\/9781118644898","volume-title":"Multi-criteria decision analysis: methods and software","author":"A Ishizaka","year":"2013","unstructured":"Ishizaka A, Nemery P (2013) Multi-criteria decision analysis: methods and software. Wiley, New York"},{"issue":"1","key":"7853_CR20","first-page":"11","volume":"1","author":"R Johns","year":"2010","unstructured":"Johns R (2010) Likert items and scales. Surv Quest Bank Methods Fact Sheet 1(1):11\u201328","journal-title":"Surv Quest Bank Methods Fact Sheet"},{"key":"7853_CR21","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1016\/j.ins.2005.03.002","volume":"173","author":"J Kacprzyk","year":"2005","unstructured":"Kacprzyk J, Zadrozny S (2005) Linguistic database summaries and their protoforms: towards natural language based knowledge discovery tools. Inf Sci 173:281\u2013304","journal-title":"Inf Sci"},{"key":"7853_CR22","volume-title":"Fundamentals of computational intelligence","author":"J Keller","year":"2016","unstructured":"Keller J, Derong L, Fogel D (2016) Fundamentals of computational intelligence. IEEE Press Wiley, Hoboken"},{"key":"7853_CR23","doi-asserted-by":"crossref","DOI":"10.1007\/978-94-015-9540-7","volume-title":"Triangular norms","author":"E Klement","year":"2000","unstructured":"Klement E, Mesiar R, Pap E (2000) Triangular norms. Kluwer, Dordrecht"},{"issue":"1","key":"7853_CR24","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1016\/S0377-2217(97)00163-X","volume":"106","author":"R Lahdelma","year":"1998","unstructured":"Lahdelma R, Hokkanen J, Salminen P (1998) Smaa-stochastic multiobjective acceptability analysis. European J Oper Res 106(1):137\u2013143","journal-title":"European J Oper Res"},{"key":"7853_CR25","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1007\/s11135-005-8103-6","volume":"38","author":"M Lalla","year":"2005","unstructured":"Lalla M, Facchinetti G, Giovanni M (2005) Ordinal scales and fuzzy set systems to measure agreement: an application to the evaluation of teaching activity. Qua Quant 38:577\u2013601","journal-title":"Qua Quant"},{"issue":"5","key":"7853_CR26","doi-asserted-by":"crossref","first-page":"1609","DOI":"10.1016\/j.eswa.2012.09.015","volume":"40","author":"Q Li","year":"2013","unstructured":"Li Q (2013) A novel likert scale based on fuzzy sets theory. Exp Syst Appl 40(5):1609\u20131618","journal-title":"Exp Syst Appl"},{"issue":"5","key":"7853_CR27","doi-asserted-by":"crossref","first-page":"1609","DOI":"10.1016\/j.eswa.2012.09.015","volume":"40","author":"Q Li","year":"2013","unstructured":"Li Q (2013) A novel likert scale based on fuzzy sets theory. Exp Syst Appl 40(5):1609\u20131618","journal-title":"Exp Syst Appl"},{"issue":"2","key":"7853_CR28","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1037\/h0043158","volume":"63","author":"G Miller","year":"1956","unstructured":"Miller G (1956) The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychol Rev 63(2):81\u201397","journal-title":"Psychol Rev"},{"key":"7853_CR29","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1016\/j.ins.2018.10.022","volume":"476","author":"J Morente-Molinera","year":"2019","unstructured":"Morente-Molinera J, Kou G, Pang C, Cabrerizo F, Selamat A, Herrera-Viedma E (2019) An automatic procedure to create fuzzy ontologies from users\u2019 opinions using sentiment analysis procedures and multi-granular fuzzy linguistic modelling methods. Inf Sci 476:222\u2013238","journal-title":"Inf Sci"},{"key":"7853_CR30","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/j.asoc.2018.03.047","volume":"68","author":"J Morente-Molinera","year":"2018","unstructured":"Morente-Molinera J, Kou G, P\u00e9rez I, Samuylov K, Selamat A, Herrera-Viedma E (2018) A group decision making support system for the web: how to work in environments with a high number of participants and alternatives. Appl Soft Comput 68:191\u2013201","journal-title":"Appl Soft Comput"},{"issue":"2","key":"7853_CR31","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1016\/0165-0114(93)90148-B","volume":"56","author":"T Murofushi","year":"1993","unstructured":"Murofushi T, Sugeno M (1993) Some quantities represented by the choquet integral. Fuzzy Sets Syst 56(2):229\u2013235","journal-title":"Fuzzy Sets Syst"},{"key":"7853_CR32","unstructured":"Nemoto T, Beglar D (2014) Likert-scale questionnaires. In JALT 2013 conference proceedings, pp. 1\u20138"},{"key":"7853_CR33","doi-asserted-by":"crossref","unstructured":"Rakovsk\u00e1 E, Hudec M (2019) A three-levelled aggregation model for evaluating software usability by fuzzy logic. Int J Appl Math Comput Sci 29(3):489\u2013501","DOI":"10.2478\/amcs-2019-0036"},{"key":"7853_CR34","volume-title":"Generalized concavity in fuzzy optimization and decision analysis","author":"J Ram\u00edk","year":"2012","unstructured":"Ram\u00edk J, Vlach M (2012) Generalized concavity in fuzzy optimization and decision analysis. Springer Science & Business Media, Cham"},{"key":"7853_CR35","unstructured":"\u00c1rva G, T\u00f3th Z, J\u00f3n\u00e1s T, Surman V (2019) Will the likert scale pass the final exam? a novel, fuzzy-number-based evaluation of supervisors\u2019 performance"},{"issue":"7\u20138","key":"7853_CR36","doi-asserted-by":"crossref","first-page":"801","DOI":"10.1016\/j.mcm.2006.03.023","volume":"45","author":"H-S Shih","year":"2007","unstructured":"Shih H-S, Shyur H-J, Lee ES (2007) An extension of topsis for group decision making. Math Comput Modell 45(7\u20138):801\u2013813","journal-title":"Math Comput Modell"},{"key":"7853_CR37","doi-asserted-by":"crossref","DOI":"10.1002\/9781118447895","volume-title":"Designing and conducting business surveys","author":"G Snijkers","year":"2013","unstructured":"Snijkers G, Haraldsen G, Jones J, Willimack D (2013) Designing and conducting business surveys. Wiley, Hoboken"},{"key":"7853_CR38","volume-title":"Conducting online surveys","author":"VM Sue","year":"2012","unstructured":"Sue VM, Ritter LA (2012) Conducting online surveys. Sage"},{"issue":"12","key":"7853_CR39","doi-asserted-by":"crossref","first-page":"7745","DOI":"10.1016\/j.eswa.2010.04.066","volume":"37","author":"C-C Sun","year":"2010","unstructured":"Sun C-C (2010) A performance evaluation model by integrating fuzzy ahp and fuzzy topsis methods. Expert systems with applications 37(12):7745\u20137754","journal-title":"Expert systems with applications"},{"key":"7853_CR40","doi-asserted-by":"crossref","first-page":"218","DOI":"10.4018\/978-1-59904-853-6.ch009","volume-title":"Handbook of research on fuzzy information processing in databases","author":"C Tudorie","year":"2008","unstructured":"Tudorie C (2008) Qualifying objects in classical relational database querying. In: Galindo J (ed) Handbook of research on fuzzy information processing in databases. Information Science Reference, Hershey, pp 218\u2013245"},{"key":"7853_CR41","unstructured":"van Grinsven VT (2015) Motivation in Business Survey Response Behavior. Ph.D. thesis, University of Utrecht, Utrecht"},{"issue":"3","key":"7853_CR42","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1016\/j.kjss.2017.01.002","volume":"38","author":"P Vonglao","year":"2017","unstructured":"Vonglao P (2017) Application of fuzzy logic to improve the likert scale to measure latent variables. Kasetsart Journal of Social Sciences 38(3):337\u2013344","journal-title":"Kasetsart Journal of Social Sciences"},{"key":"7853_CR43","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4757-5303-5","volume-title":"Fuzzy Meas Theor","author":"Z Wang","year":"1992","unstructured":"Wang Z, Klir G (1992) Fuzzy Meas Theor. Plenum Press, New York"},{"key":"7853_CR44","volume-title":"Analyzing strategic behavior in business and economics: a game theory primer","author":"TJ Webster","year":"2014","unstructured":"Webster TJ (2014) Analyzing strategic behavior in business and economics: a game theory primer. Lexington Books"},{"key":"7853_CR45","doi-asserted-by":"crossref","DOI":"10.1016\/j.jclepro.2019.118132","volume":"241","author":"P Wicher","year":"2019","unstructured":"Wicher P, Zapletal F, Lenort R (2019) Sustainability performance assessment of industrial corporation using fuzzy analytic network process. J Clean Prod 241:118132","journal-title":"J Clean Prod"},{"key":"7853_CR46","volume-title":"Handbook of survey research","author":"J Wright","year":"2010","unstructured":"Wright J, Marsden P (2010) Handbook of survey research, 2nd edn. Elsevier, San Diego","edition":"2"},{"key":"7853_CR47","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/0020-0255(82)90033-0","volume":"28","author":"R Yager","year":"1982","unstructured":"Yager R (1982) A new approach to the summarization of data. Inf Sci 28:69\u201386","journal-title":"Inf Sci"},{"key":"7853_CR48","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1016\/S0019-9958(65)90241-X","volume":"8","author":"LA Zadeh","year":"1965","unstructured":"Zadeh LA (1965) Fuzzy sets. Inf Control 8:338\u2013353","journal-title":"Inf Control"},{"key":"7853_CR49","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/0020-0255(75)90036-5","volume":"8","author":"LA Zadeh","year":"1975","unstructured":"Zadeh LA (1975) The concept of a linguistic variable and its application to approximate reasoning: part I. Inf Sci 8:199\u2013249","journal-title":"Inf Sci"},{"issue":"2","key":"7853_CR50","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1109\/91.493904","volume":"4","author":"LA Zadeh","year":"1996","unstructured":"Zadeh LA (1996) Fuzzy logic = computing with words. IEEE Trans Fuzzy Syst 4(2):103\u2013111","journal-title":"IEEE Trans Fuzzy Syst"},{"issue":"2","key":"7853_CR51","doi-asserted-by":"crossref","first-page":"1045","DOI":"10.1007\/s10479-018-2769-3","volume":"271","author":"X Zhou","year":"2018","unstructured":"Zhou X, Hu Y, Deng Y, Chan FT, Ishizaka A (2018) A dematel-based completion method for incomplete pairwise comparison matrix in ahp. Ann Oper Res 271(2):1045\u20131066","journal-title":"Ann Oper Res"},{"issue":"8","key":"7853_CR52","doi-asserted-by":"crossref","first-page":"2744","DOI":"10.3390\/su10082744","volume":"10","author":"J Zhu","year":"2018","unstructured":"Zhu J, Li Y (2018) Green supplier selection based on consensus process and integrating prioritized operator and choquet integral. Sustainability 10(8):2744","journal-title":"Sustainability"}],"container-title":["Soft Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00500-023-07853-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00500-023-07853-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00500-023-07853-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,21]],"date-time":"2023-04-21T00:14:53Z","timestamp":1682036093000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00500-023-07853-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,10]]},"references-count":52,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2023,5]]}},"alternative-id":["7853"],"URL":"https:\/\/doi.org\/10.1007\/s00500-023-07853-2","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-1199252\/v1","asserted-by":"object"}]},"ISSN":["1432-7643","1433-7479"],"issn-type":[{"value":"1432-7643","type":"print"},{"value":"1433-7479","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,10]]},"assertion":[{"value":"11 January 2023","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 February 2023","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflicts of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"This paper does not contain any studies with human participants or animals performed by the author.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"Informed consent was obtained from all individual participants included in the study.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}}]}}