{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,20]],"date-time":"2026-03-20T22:08:09Z","timestamp":1774044489543,"version":"3.50.1"},"reference-count":49,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2025,6,27]],"date-time":"2025-06-27T00:00:00Z","timestamp":1750982400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Bialystok University of Technology and founded by the Ministry of Science and Higher Education","award":["WZ\/WI-IIT\/2\/25"],"award-info":[{"award-number":["WZ\/WI-IIT\/2\/25"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Questionnaire data plays a key role in social research, especially when evaluating public attitudes using Likert-type scales. Yet, traditional analyses often merge some ordinal categories and exclude responses such as Don\u2019t Know, No Answer, or Refused\u2014risking the loss of valuable information. This study introduces BS-TOSIE (Belief Structure-Based TOPSIS for Survey Item Evaluation), a novel method that preserves and integrates all response types, including ambiguous ones. By combining the Belief Structure framework with the TOPSIS (Technique for Order Preference by Similarity to Ideal Solution) method, BS-TOSIE offers a structured approach to ranking and evaluating individual survey items measured on an ordinal scale, even in the presence of missing or incomplete data. Response distributions are transformed into a belief structure vector, enabling comparison against ideal and anti-ideal benchmarks. We demonstrate this approach using data from the Quality of Life in European Cities survey to assess perceptions of local governance in European cities. This study analyzes changes in citizen satisfaction with local public administration across five key dimensions\u2014timeliness, procedural clarity, fairness of fees, digital accessibility, and perceived corruption\u2014in 83 European cities between 2019 and 2023. The findings reveal persistent regional disparities, with Northern and Western European cities consistently outperforming those in Southern and Eastern Europe, although some cities in Central Europe show signs of improvement. Zurich consistently received high satisfaction scores, while other cities, such as Rome and Palermo, showed lower scores. Unlike traditional methods, our approach preserves the full spectrum of responses, yielding more nuanced and interpretable insights. The results show that BS-TOSIE enhances both the clarity and depth of survey analysis, making a methodological contribution to the evaluation of ordinal data and offering empirical insights into public perceptions of local city administration.<\/jats:p>","DOI":"10.3390\/info16070546","type":"journal-article","created":{"date-parts":[[2025,6,30]],"date-time":"2025-06-30T13:06:17Z","timestamp":1751288777000},"page":"546","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Improving Survey Data Interpretation: A Novel Approach to Analyze Single-Item Ordinal Responses with Non-Response Categories"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2249-7217","authenticated-orcid":false,"given":"Ewa","family":"Roszkowska","sequence":"first","affiliation":[{"name":"Faculty of Computer Science, Bialystok University of Technology, Wiejska 45A, 15-351 Bialystok, Poland"}]}],"member":"1968","published-online":{"date-parts":[[2025,6,27]]},"reference":[{"key":"ref_1","unstructured":"Bryman, A. (2016). Social Research Methods, Oxford University Press."},{"key":"ref_2","unstructured":"Babbie, E.R. (2020). The Practice of Social Research, Cengage Au."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Vaus, D.D., and de Vaus, D. (2013). Surveys in Social Research, Routledge. [6th ed.].","DOI":"10.4324\/9780203519196"},{"key":"ref_4","unstructured":"Fowler, F.J. (2013). Survey Research Methods, SAGE Publications."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"625","DOI":"10.1007\/s10459-010-9222-y","article-title":"Likert Scales, Levels of Measurement and the \u201cLaws\u201d of Statistics","volume":"15","author":"Norman","year":"2010","journal-title":"Adv. Health Sci. Educ."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"541","DOI":"10.4300\/JGME-5-4-18","article-title":"Analyzing and Interpreting Data from Likert-Type Scales","volume":"5","author":"Sullivan","year":"2013","journal-title":"J. Grad. Med. Educ."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1002\/acp.2350050305","article-title":"Response Strategies for Coping with the Cognitive Demands of Attitude Measures in Surveys","volume":"5","author":"Krosnick","year":"1991","journal-title":"Appl. Cogn. Psychol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1108\/QAE-06-2017-0034","article-title":"The Survey Response Process from a Cognitive Viewpoint","volume":"26","author":"Tourangeau","year":"2018","journal-title":"Qual. Assur. Educ."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"859","DOI":"10.1037\/0033-2909.133.5.859","article-title":"Sensitive Questions in Surveys","volume":"133","author":"Tourangeau","year":"2007","journal-title":"Psychol. Bull."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"De Leeuw, E.D., Hox, J., and Dillman, D. (2012). International Handbook of Survey Methodology, Routledge.","DOI":"10.4324\/9780203843123"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1093\/biomet\/63.3.581","article-title":"Inference and Missing Data","volume":"63","author":"Rubin","year":"1976","journal-title":"Biometrika"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Arminger, G., Clogg, C.C., and Sobel, M.E. (1995). Missing Data. Handbook of Statistical Modeling for the Social and Behavioral Sciences, Springer.","DOI":"10.1007\/978-1-4899-1292-3"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Little, R.J., and Rubin, D.B. (2019). Statistical Analysis with Missing Data, John Wiley & Sons.","DOI":"10.1002\/9781119482260"},{"key":"ref_14","unstructured":"De Dominicis, L., Berlingieri, F., d\u2019Hombres, B., Gentile, C., Mauri, C., Stepanova, E., Pontarollo, N., and European Commission (2023). Report on the Quality of Life in European Cities, 2023, Publications Office. Available online: https:\/\/ec.europa.eu\/regional_policy\/sources\/reports\/qol2023\/2023_quality_life_european_cities_en.pdf."},{"key":"ref_15","unstructured":"(2024, October 19). Inforegio\u2014Quality of Life in European Cities. Available online: https:\/\/ec.europa.eu\/regional_policy\/information-sources\/maps\/quality-of-life_en."},{"key":"ref_16","unstructured":"Bolsi, P., de Dominics, L., Castelli, C., d\u2019Hombres, B., Montalt, V., and Pontarollo, N. (2020). Report on the Quality of Life in European Cities, 2020, European Union."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Roszkowska, E., and Wachowicz, T. (2024). Smart Cities and Resident Well-Being: Using the BTOPSIS Method to Assess Citizen Life Satisfaction in European Cities. Appl. Sci., 14.","DOI":"10.3390\/app142311051"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1504\/IJKBD.2019.105126","article-title":"City Life Satisfaction: A Measurement for Smart and Sustainable Cities from the Citizens\u2019 Perspective","volume":"10","author":"Silva","year":"2019","journal-title":"Int. J. Knowl.-Based Dev."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Bartniczak, B., and Raszkowski, A. (2022). Implementation of the Sustainable Cities and Communities Sustainable Development Goal (SDG) in the European Union. Sustainability, 14.","DOI":"10.3390\/su142416808"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"119926","DOI":"10.1016\/j.jclepro.2019.119926","article-title":"Governance and Quality of Life in Smart Cities: Towards Sustainable Development Goals","volume":"253","author":"Severo","year":"2020","journal-title":"J. Clean. Prod."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1016\/j.scs.2017.02.016","article-title":"Smart Sustainable Cities of the Future: An Extensive Interdisciplinary Literature Review","volume":"31","author":"Bibri","year":"2017","journal-title":"Sustain. Cities Soc."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"103926","DOI":"10.1016\/j.scs.2022.103926","article-title":"Sustainable Cities and Communities Assessment Using the DARIA-TOPSIS Method","volume":"83","author":"Ziemba","year":"2022","journal-title":"Sustain. Cities Soc."},{"key":"ref_23","first-page":"187","article-title":"Temporal VIKOR\u2014A New MCDA Method Supporting Sustainability Assessment","volume":"Volume 63","author":"Silaghi","year":"2023","journal-title":"Advances in Information Systems Development"},{"key":"ref_24","unstructured":"(2025, May 06). Data.Europa.Eu. Available online: https:\/\/data.europa.eu\/data\/datasets\/s2070_419_eng?locale=en."},{"key":"ref_25","unstructured":"(2025, May 06). European Quality of Government Index|University of Gothenburg. Available online: https:\/\/www.gu.se\/en\/quality-government\/qog-data\/data-downloads\/european-quality-of-government-index."},{"key":"ref_26","unstructured":"(2025, May 06). The Global Urban Monitoring Framework|UN-Habitat. Available online: https:\/\/unhabitat.org\/the-global-urban-monitoring-framework."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1016\/j.sbspro.2014.10.025","article-title":"Smart City Logistics on Cloud Computing Model","volume":"151","author":"Nowicka","year":"2014","journal-title":"Procedia-Soc. Behav. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"819","DOI":"10.1111\/j.1540-6210.2012.02593.x","article-title":"E-Participation, Transparency, and Trust in Local Government","volume":"72","author":"Kim","year":"2012","journal-title":"Public Adm. Rev."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1080\/17487870.2012.759422","article-title":"The Institutional, Economic and Social Determinants of Local Government Transparency","volume":"16","year":"2013","journal-title":"J. Econ. Policy Reform"},{"key":"ref_30","unstructured":"Boyle, R. (2012). Using Fees and Charges-Cost Recovery in Local Government. Local Gov. Res. Ser. Rep., 3, Available online: https:\/\/www.ipa.ie\/_fileUpload\/Documents\/LocalGov_RS_No3.pdf."},{"key":"ref_31","first-page":"90","article-title":"Electronic Administration Styles and Their Determinants. Evidence from Spanish Local Governments","volume":"10","year":"2014","journal-title":"Transylv. Rev. Adm. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"299","DOI":"10.29316\/rs\/188762","article-title":"Digital Accessibility of Social Welfare Institutions","volume":"18","author":"Nowak","year":"2024","journal-title":"Rozpr. Spo\u0142eczne\/Soc. Diss."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"101810","DOI":"10.1016\/j.ejpoleco.2019.08.001","article-title":"Corruption and Economic Growth: New Empirical Evidence","volume":"60","author":"Potrafke","year":"2019","journal-title":"Eur. J. Political Econ."},{"key":"ref_34","first-page":"68","article-title":"Regional Governance Matters: Quality of Government within European Union Member States: Reg","volume":"48","author":"Charron","year":"2023","journal-title":"Stud."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1925","DOI":"10.1111\/pirs.12437","article-title":"Measuring Quality of Government in EU Regions across Space and Time","volume":"98","author":"Charron","year":"2019","journal-title":"Pap. Reg. Sci."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1016\/j.ejor.2004.09.017","article-title":"The Evidential Reasoning Approach for MADA under Both Probabilistic and Fuzzy Uncertainties","volume":"171","author":"Yang","year":"2006","journal-title":"Eur. J. Oper. Res."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1109\/TSMCA.2002.802746","article-title":"On the Evidential Reasoning Algorithm for Multiple Attribute Decision Analysis under Uncertainty","volume":"32","author":"Yang","year":"2002","journal-title":"IEEE Trans. Syst. Man Cybern.-Part A Syst. Hum."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1458","DOI":"10.1109\/21.310529","article-title":"A General Multi-Level Evaluation Process for Hybrid MADM with Uncertainty","volume":"24","author":"Yang","year":"1994","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1007\/s11633-010-0515-7","article-title":"TOPSIS with Belief Structure for Group Belief Multiple Criteria Decision Making","volume":"7","author":"Jiang","year":"2010","journal-title":"Int. J. Autom. Comput."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Guo, P., and Pedrycz, W. (2014). Decision-Making Under Conditions of Multiple Values and Variation in Conditions of Risk and Uncertainty. Human-Centric Decision-Making Models for Social Sciences, Springer. Studies in Computational Intelligence.","DOI":"10.1007\/978-3-642-39307-5"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"9400","DOI":"10.1016\/j.eswa.2011.01.128","article-title":"TOPSIS with Fuzzy Belief Structure for Group Belief Multiple Criteria Decision Making","volume":"38","author":"Jiang","year":"2011","journal-title":"Expert Syst. Appl."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1007\/s00170-014-6466-3","article-title":"A New FMEA Method by Integrating Fuzzy Belief Structure and TOPSIS to Improve Risk Evaluation Process","volume":"77","author":"Vahdani","year":"2015","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"108","DOI":"10.3846\/16484142.2016.1133454","article-title":"Fuzzy Belief Structure Based Vikor Method: An Application for Ranking Delay Causes of Tehran Metro System by FMEA Criteria","volume":"31","author":"Hajiagha","year":"2016","journal-title":"Transport"},{"key":"ref_44","first-page":"171","article-title":"A TOPSIS, VIKOR and DEA Integrated Evaluation Method with Belief Structure under Uncertainty to Rank Alternatives","volume":"11","author":"Amini","year":"2019","journal-title":"Int. J. Adv. Oper. Manag."},{"key":"ref_45","unstructured":"Jefma\u0144ski, B. (2019, January 18\u201320). Intuitionistic Fuzzy Synthetic Measure for Ordinal Data. Proceedings of the Conference of the Section on Classification and Data Analysis of the Polish Statistical Association, Szczecin, Poland."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Jefma\u0144ski, B., Roszkowska, E., and Kusterka-Jefma\u0144ska, M. (2021). Intuitionistic Fuzzy Synthetic Measure on the Basis of Survey Responses and Aggregated Ordinal Data. Entropy, 23.","DOI":"10.3390\/e23121636"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Jajuga, K., Dehnel, G., and Walesiak, M. (2022). Application of the Intuitionistic Fuzzy Synthetic Measure in the Subjective Quality of Life Measurement Based on Survey Data. Modern Classification and Data Analysis, Springer International Publishing.","DOI":"10.1007\/978-3-031-10190-8"},{"key":"ref_48","first-page":"708","article-title":"The Intuitionistic Fuzzy Synthetic Measure in a Dynamic Analysis of the Subjective Quality of Life of Citizens of European Cities","volume":"88","author":"Roszkowska","year":"2024","journal-title":"Ekon. Sr."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Roszkowska, E., and Jefma\u0144ski, B. (2021). Interval-Valued Intuitionistic Fuzzy Synthetic Measure (I-VIFSM) Based on Hellwig\u2019s Approach in the Analysis of Survey Data. Mathematics, 9.","DOI":"10.3390\/math9030201"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/7\/546\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:59:55Z","timestamp":1760032795000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/7\/546"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,27]]},"references-count":49,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2025,7]]}},"alternative-id":["info16070546"],"URL":"https:\/\/doi.org\/10.3390\/info16070546","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,27]]}}}