{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:43:05Z","timestamp":1760236985429,"version":"build-2065373602"},"reference-count":66,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2020,2,13]],"date-time":"2020-02-13T00:00:00Z","timestamp":1581552000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Spanish Ministry of Science, Innovation and Universities and FEDER","award":["RTI2018-095518-B-C21"],"award-info":[{"award-number":["RTI2018-095518-B-C21"]}]},{"name":"Spanish Ministry of Health","award":["CIBERCB06\/02\/1002"],"award-info":[{"award-number":["CIBERCB06\/02\/1002"]}]},{"name":"Catalan Government","award":["2017SGR656"],"award-info":[{"award-number":["2017SGR656"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Axioms"],"abstract":"<jats:p>This article presents an empirical comparative assessment of the measurement quality of two instruments commonly used to measure fuzzy characteristics in computer-assisted questionnaires: a graphic scale (a line production scale using a slider bar) and an endecanary scale (a 0\u201310 rating scale using radio buttons). Data are analyzed by means of multitrait\u2013multimethod models estimated as structural equation models with a mean and covariance structure. For the first time in such research, the results include bias, valid variance, method variance, and random error variance. The data are taken from a program that assesses entrepreneurial competences in undergraduate Economics and Business students by means of questionnaires administered on desktop computers. Neither of the measurement instruments was found to be biased with respect to the other, meaning that their scores are comparable. While both instruments achieve valid and reliable measurements, the reliability and validity are higher for the endecanary scale. This study contributes to the still scarce literature on fuzzy measurement instruments and on the comparability and relative merits of graphic and discrete rating scales on computer-assisted questionnaires.<\/jats:p>","DOI":"10.3390\/axioms9010021","type":"journal-article","created":{"date-parts":[[2020,2,14]],"date-time":"2020-02-14T10:09:57Z","timestamp":1581674997000},"page":"21","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["A Comparative Assessment of Graphic and 0\u201310 Rating Scales Used to Measure Entrepreneurial Competences"],"prefix":"10.3390","volume":"9","author":[{"given":"Laura","family":"Vall-Llosera","sequence":"first","affiliation":[{"name":"Department of Economics, Faculty building of Economics and Business, University of Girona, c. Universitat 10, 17003 Girona, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6274-9410","authenticated-orcid":false,"given":"Salvador","family":"Linares-Mustar\u00f3s","sequence":"additional","affiliation":[{"name":"Department of Business Studies, Faculty building of Economics and Business, University of Girona, c. Universitat 10, 17003 Girona, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4742-820X","authenticated-orcid":false,"given":"Andrea","family":"Bikfalvi","sequence":"additional","affiliation":[{"name":"Department of Organization, Business Management and Product Design, Faculty building of Economics and Business, University of Girona, c. Universitat 10, 17003 Girona, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5204-6882","authenticated-orcid":false,"given":"Germ\u00e0","family":"Coenders","sequence":"additional","affiliation":[{"name":"Department of Economics, Faculty building of Economics and Business, University of Girona, c. Universitat 10, 17003 Girona, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,2,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1016\/S0019-9958(65)90241-X","article-title":"Fuzzy sets","volume":"8","author":"Zadeh","year":"1965","journal-title":"Inf. Control"},{"key":"ref_2","first-page":"736","article-title":"The assessment of cash flow forecasting","volume":"42","year":"2013","journal-title":"Kybernetes"},{"doi-asserted-by":"crossref","unstructured":"Jaini, N., and Utyuzhnikov, S. (2017). A fuzzy trade-off ranking method for multi-criteria decision-making. Axioms, 7.","key":"ref_3","DOI":"10.3390\/axioms7010001"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"157","DOI":"10.3926\/ic.1352","article-title":"Evolutionary positioning of outsourcing in the local public administration","volume":"15","author":"Linares","year":"2019","journal-title":"Intang. Cap."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/S0304-3959(01)00349-9","article-title":"Clinical importance of changes in chronic pain intensity measured on an 11-point numerical pain rating scale","volume":"94","author":"Farrar","year":"2001","journal-title":"Pain"},{"unstructured":"Riedl, C., Blohm, I., Leimeister, J.M., and Krcmar, H. (2010, January 24). Rating scales for collective intelligence in innovation communities: Why quick and easy decision making does not get it right. Proceedings of the Thirty First International Conference on Information Systems, St. Louis, MO, USA.","key":"ref_6"},{"doi-asserted-by":"crossref","unstructured":"Gonzalez Campos, J.A., and Manriquez Penafiel, R.A. (2016). A method for ordering of LR-type fuzzy numbers: An important decision criteria. Axioms, 5.","key":"ref_7","DOI":"10.3390\/axioms5030022"},{"doi-asserted-by":"crossref","unstructured":"Hern\u00e1ndez, P., Cubillo, S., Torres-Blanc, C., and Guerrero, J. (2017). New order on type 2 fuzzy numbers. Axioms, 6.","key":"ref_8","DOI":"10.3390\/axioms6030022"},{"doi-asserted-by":"crossref","unstructured":"Piasecki, K. (2018). Revision of the Kosi\u0144ski\u2019s theory of ordered fuzzy numbers. Axioms, 7.","key":"ref_9","DOI":"10.3390\/axioms7010016"},{"key":"ref_10","first-page":"27","article-title":"Developing a generalized fuzzy multi-criteria decision making for personnel selection","volume":"23","author":"Tuana","year":"2018","journal-title":"Fuzzy Econ. Rev."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/0020-0255(75)90036-5","article-title":"The concept of a linguistic variable and its application to approximate reasoning-I","volume":"8","author":"Zadeh","year":"1975","journal-title":"Inf. Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1504\/IJAMS.2009.026201","article-title":"Fuzzy consideration sets: A new approach based on direct use of consumer preferences","volume":"1","author":"Curry","year":"2009","journal-title":"Int. J. Appl. Manag. Sci."},{"doi-asserted-by":"crossref","unstructured":"Dey, A., Pradhan, R., Pal, A., and Pal, T. (2014, January 14). The fuzzy robust graph coloring problem. Proceedings of the 3rd International Conference on Frontiers of Intelligent Computing: Theory and Applications (FICTA) Paniora, Odisha, India.","key":"ref_13","DOI":"10.1007\/978-3-319-11933-5_91"},{"doi-asserted-by":"crossref","unstructured":"Dey, A., Pal, A., and Pal, T. (2016). Interval type 2 fuzzy set in fuzzy shortest path problem. Mathematics, 4.","key":"ref_14","DOI":"10.3390\/math4040062"},{"doi-asserted-by":"crossref","unstructured":"Dey, A., Son, L.H., Kumar, P.K., Selvachandran, G., and Quek, S.G. (2018). New concepts on vertex and edge coloring of simple vague graphs. Symmetry, 10.","key":"ref_15","DOI":"10.3390\/sym10090373"},{"key":"ref_16","first-page":"23","article-title":"A formalization of the theory of expertons. Theoretical foundations, properties and development of software for its calculation","volume":"21","year":"2016","journal-title":"Fuzzy Econ. Rev."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1002\/int.22055","article-title":"The ordered weighted average in the theory of expertons","volume":"34","year":"2019","journal-title":"Int. J. Intell. Syst."},{"key":"ref_18","first-page":"67","article-title":"Forgotten effects in the valuation of the social well-being index in Mexico\u2019s sustainable development","volume":"24","year":"2019","journal-title":"Fuzzy Econ. Rev."},{"key":"ref_19","first-page":"485","article-title":"Teor\u00eda de conjuntos cl\u00e1sica versus teor\u00eda de subconjuntos borrosos. Un ejemplo elemental comparativo","volume":"2","year":"2014","journal-title":"Tribuna Plural: La Revista Cient\u00edfica"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1037\/h0043158","article-title":"The magical number seven, plus or minus two: Some limits on our capacity for processing information","volume":"63","author":"Miller","year":"1956","journal-title":"Psychol. Rev."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1037\/0033-295X.101.2.353","article-title":"The magical number seven: Still magic after all these years?","volume":"101","author":"Baddeley","year":"1994","journal-title":"Psychol. Rev."},{"doi-asserted-by":"crossref","unstructured":"Gil-Aluja, J. (2004). Fuzzy Sets in the Management of Uncertainty, Springer Science & Business Media.","key":"ref_22","DOI":"10.1007\/978-3-540-39699-4"},{"unstructured":"Doumpos, M., and Zopounidis, C. (2015). New practical tools for minimizing human error in research into forgotten effects. Computational Data Analysis Techniques in Economics and Finance, Nova.","key":"ref_23"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1523","DOI":"10.1007\/s11135-017-0533-4","article-title":"A classification of response scale characteristics that affect data quality: A literature review","volume":"52","author":"DeCastellarnau","year":"2018","journal-title":"Qual. Quant."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1177\/0894439317750089","article-title":"Measurement reliability, validity, and quality of slider versus radio button scales in an online probability-based panel in Norway","volume":"37","author":"Bosch","year":"2019","journal-title":"Soc. Sci. Comput. Rev."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1177\/00131640121971356","article-title":"Score reliability in web- or Internet-based surveys: Unnumbered graphic rating scales versus Likert-type scales","volume":"61","author":"Cook","year":"2001","journal-title":"Educ. Psychol. Meas."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/0883-9026(90)90023-M","article-title":"What are we talking about when we talk about entrepreneurship?","volume":"5","author":"Gartner","year":"1990","journal-title":"J. Bus. Ventur."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"255","DOI":"10.22452\/mjcs.vol31no4.2","article-title":"A genetic algorithm for solving fuzzy shortest path problems with interval type-2 fuzzy arc lengths","volume":"31","author":"Dey","year":"2018","journal-title":"Malays. J. Comput. Sci."},{"key":"ref_29","first-page":"1","article-title":"Fuzzy minimum spanning tree with interval type 2 fuzzy arc length: Formulation and a new genetic algorithm","volume":"2019","author":"Dey","year":"2019","journal-title":"Soft Comput."},{"doi-asserted-by":"crossref","unstructured":"Moayedi, H., Tien Bui, D., G\u00f6r, M., Pradhan, B., and Jaafari, A. (2019). The feasibility of three prediction techniques of the artificial neural network, adaptive neuro-fuzzy inference system, and hybrid particle swarm optimization for assessing the safety factor of cohesive slopes. ISPRS Int. J. Geo-Inf., 8.","key":"ref_30","DOI":"10.3390\/ijgi8090391"},{"doi-asserted-by":"crossref","unstructured":"Polishchuk, V., Kelemen, M., Gavurov\u00e1, B., Varotsos, C., Andoga, R., Gera, M., Christodoulakis, J., Sou\u0161ek, R., Kozuba, J., and Hospodka, J. (2019). A fuzzy model of risk assessment for environmental start-up projects in the air transport sector. Int. J. Environ. Res. Public Health, 16.","key":"ref_31","DOI":"10.3390\/ijerph16193573"},{"doi-asserted-by":"crossref","unstructured":"Castillo, O., Valdez, F., Soria, J., Amador-Angulo, L., Ochoa, P., and Peraza, C. (2019). Comparative study in fuzzy controller optimization using bee colony, differential evolution, and harmony search algorithms. Algorithms, 12.","key":"ref_32","DOI":"10.3390\/a12010009"},{"unstructured":"Kaufmann, A. (1990, January 3). Expert appraisements and counter-appraisements with experton processes. Proceedings of the First International Symposium on Uncertainty Modeling and Analysis, College Park, MD, USA.","key":"ref_33"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"736","DOI":"10.1108\/K-04-2013-0065","article-title":"Forgotten effects of corporate social and environmental responsibility","volume":"42","year":"2013","journal-title":"Kybernetes"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1037\/h0036653","article-title":"Magnitude estimations of expressions of frequency and amount","volume":"59","author":"Bass","year":"1974","journal-title":"J. Appl. Psychol."},{"unstructured":"Osgood, C.E., Suci, G.J., and Tannenbaum, P.H. (1975). The Measurement of Meaning, University of Illinois Press.","key":"ref_36"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"376","DOI":"10.2307\/2110859","article-title":"On the magnitude scaling of political opinion in survey research","volume":"25","author":"Lodge","year":"1981","journal-title":"Am. J. Political Sci."},{"unstructured":"Saris, W.E. (1988). Variation in Response Functions: A Source of Measurement Error in Attitude Research, Sociometric Research Foundation.","key":"ref_38"},{"unstructured":"Fowler, F.J. (2013). Survey Research Methods, Sage.","key":"ref_39"},{"unstructured":"Groves, R.M., Fowler, F.J., Couper, M.P., Lepkowski, J.M., Singer, E., and Tourangeau, R. (2011). Survey Methodology, Wiley.","key":"ref_40"},{"doi-asserted-by":"crossref","unstructured":"Saris, W.E. (1987). Continuous Scales in the Social Sciences: An Attractive Possibility, Sociometric Research Foundation.","key":"ref_41","DOI":"10.1007\/978-1-349-19051-5"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1177\/0894439305281503","article-title":"Evaluating the effectiveness of visual analog scales: A web experiment","volume":"24","author":"Couper","year":"2006","journal-title":"Soc. Sci. Comput. Rev."},{"unstructured":"De Pijper, W.M., and Saris, W.E. (1986). The Formulation of Interviews Using the Program INTERV, Sociometric Research Foundation.","key":"ref_43"},{"unstructured":"Saris, W.E., and Munnich, \u00c1. (1995). The Multitratit-Multimethod Approach to Evaluate Measurement Instruments, E\u00f6tv\u00f6s University Press.","key":"ref_44"},{"unstructured":"Cape, P. (2009, January 2). Slider scales in online surveys. Proceedings of the CASRO Panel Conference, New Orleans, LA, USA.","key":"ref_45"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1093\/poq\/nft077","article-title":"Clicking vs. dragging: Different uses of the mouse and their implications for online surveys","volume":"78","author":"Sikkel","year":"2014","journal-title":"Public Opin. Q."},{"key":"ref_47","first-page":"37","article-title":"Project managers\u2019 competence identification","volume":"2","author":"Bikfalvi","year":"2011","journal-title":"Int. J. Hum. Cap. Inf. Technol. Prof."},{"unstructured":"Kent, C.A., Sexton, D.L., and Vesper, K.H. (1982). The social dimensions of entrepreneurship. Encyclopedia of Entrepreneurship, Prentice Hall.","key":"ref_48"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1016\/0749-5978(91)90020-T","article-title":"The theory planned behavior","volume":"50","author":"Ajzen","year":"1991","journal-title":"Organ. Behav. Hum. Decis. Process."},{"unstructured":"Ord\u00f3\u00f1ez de Pablos, P., Lytras, M.D., Karwowski, W., and Lee, R.W.B. (2006). Managing managerial mosaic: The Evolute methodology. Electronic Globalized Business and Sustainable Development through IT Management: Strategies and Perspectives, IGI Global.","key":"ref_50"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1046\/j.1540-6520.2003.00035.x","article-title":"Enterprise education: Influencing students\u2019 perceptions of entrepreneurship","volume":"28","author":"Peterman","year":"2003","journal-title":"Entrep. Theory Pract."},{"unstructured":"Palolen, E. (2005). Tricuspoid-The Competence Evaluation Application for Entrepreneurs, Tampere University of Technology.","key":"ref_52"},{"unstructured":"Ferligoj, A., and Mrvar, A. (2000). Systematic and random method effects. Estimating method bias and method variance. Developments in Survey Methodology, Metodolo\u0161ki Zvezki 15, FDV.","key":"ref_53"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1037\/h0046016","article-title":"Convergent and discriminant validation by the multitrait multimethod matrices","volume":"56","author":"Campbell","year":"1959","journal-title":"Psychol. Bull."},{"unstructured":"Saris, W.E., and Munnich, A. (1995). Memory effects in MTMM studies. Multitrait Multimethod Approach to Evaluate Measurement Instruments, E\u00f6tv\u00f6s University Press.","key":"ref_55"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1086\/268840","article-title":"Construct validity and error components of survey measures. A structural modeling approach","volume":"48","author":"Andrews","year":"1984","journal-title":"Public Opin. Q."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1207\/S15328007SEM0702_5","article-title":"Testing nested additive, multiplicative and general multitrait-multimethod models","volume":"7","author":"Coenders","year":"2000","journal-title":"Struct. Equ. Model."},{"doi-asserted-by":"crossref","unstructured":"Saris, W.E., and Gallhofer, I.N. (2014). Design, Evaluation, and Analysis of Questionnaires for Survey Research, Wiley.","key":"ref_58","DOI":"10.1002\/9781118634646"},{"unstructured":"Sobel, M.E., and Becker, M.P. (2000). Three likelihood-based methods for mean and covariance structure analysis with nonnormal missing data. Sociological Methodology, American Sociological Association.","key":"ref_59"},{"unstructured":"Muth\u00e9n, L.K., and Muth\u00e9n, B.O. (2017). Mplus User\u2019s Guide, Muth\u00e9n & Muth\u00e9n. [8th ed.].","key":"ref_60"},{"key":"ref_61","first-page":"1","article-title":"Exploring slider vs. categorical response formats in webbased surveys","volume":"11","author":"Roster","year":"2015","journal-title":"J. Res. Pract."},{"unstructured":"Saris, W.E., Oberski, D.L., Revilla, M., Zavala Rojas, D., Gallhofer, L., Lilleoja, I., and Gruner, T. (2011). Final Report about the Project JRA3 as Part of ESS; RECSM Working Paper, No. 24, RECSM\/UPF.","key":"ref_62"},{"doi-asserted-by":"crossref","unstructured":"Beatty, P., Collins, D., Kaye, L., Padilla, J.L., Willis, G., and Wilmot, A. (2020). How mobile device screen size affects data collected in web surveys. Advances in Questionnaire Design, Development, Evaluation and Testing, Wiley & Sons.","key":"ref_63","DOI":"10.1002\/9781119263685"},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1027\/1614-2241\/a000151","article-title":"Comparing the performance of agree\/disagree and item-specific questions across PCs and smartphones","volume":"14","author":"Revilla","year":"2018","journal-title":"Methodology"},{"doi-asserted-by":"crossref","unstructured":"Biemer, P.P., de Leeuw, E.D., Eckman, S., Edwards, B., Kreuter, F., and Lyberg, L.E. (2017). Mobile web surveys. Total Survey Error in Practice, Wiley & Sons.","key":"ref_65","DOI":"10.1002\/9781119041702"},{"doi-asserted-by":"crossref","unstructured":"Beatty, P., Collins, D., Kaye, L., Padilla, J.L., Willis, G., and Wilmot, A. (2020). A framework for making decisions about question evaluation methods. Advances in Questionnaire Design, Development, Evaluation and Testing, Wiley & Sons.","key":"ref_66","DOI":"10.1002\/9781119263685"}],"container-title":["Axioms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-1680\/9\/1\/21\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T08:57:26Z","timestamp":1760173046000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-1680\/9\/1\/21"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,13]]},"references-count":66,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,3]]}},"alternative-id":["axioms9010021"],"URL":"https:\/\/doi.org\/10.3390\/axioms9010021","relation":{},"ISSN":["2075-1680"],"issn-type":[{"type":"electronic","value":"2075-1680"}],"subject":[],"published":{"date-parts":[[2020,2,13]]}}}