{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T00:21:08Z","timestamp":1776385268780,"version":"3.51.2"},"reference-count":68,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2023,9,13]],"date-time":"2023-09-13T00:00:00Z","timestamp":1694563200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Portuguese national funds through the Foundation for Science and Technology","award":["PTDC\/GES-OUT\/2662\/20"],"award-info":[{"award-number":["PTDC\/GES-OUT\/2662\/20"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sustainability"],"abstract":"<jats:p>Policymakers face numerous challenges in benchmarking and assessing cities\u2019 current development states. This study extends the understandings of previous research to provide a new perspective about how to rank smart cities\u2019 developments by comparing the existing initiatives with city population density (as a proxy of socio-demographic characteristics) and the respective smart city phase. Quantitative analysis was performed to cluster the European Union cities according to the number of existing projects in the literature organized by smart city categories. Furthermore, to allow for the assessment of the city\u2019s state, a composite indicator was developed that takes into consideration the different category weights to ultimately provide a smart city ranking. By clustering the categories using a Principal Component Analysis (PCA), it was possible to relate them with a specific smart city phase. In addition, for a reasonable benchmark, the city\u2019s population density was considered. Moreover, this paper ranks the cities of the European Union and provides insightful information about the development phase of the smart city concept of each territory. The results show that on a normalized scale of 0 to 1000, the largest cities or the ones with most initiatives do not rank first. Furthermore, it shows that in similar socio-demographic contexts, there are variations in the smart city stage. Therefore, applying the contribution and findings of this research can help identify these differences and establish a set of best practices for improving the design and effectiveness of smart city strategies.<\/jats:p>","DOI":"10.3390\/su151813675","type":"journal-article","created":{"date-parts":[[2023,9,14]],"date-time":"2023-09-14T09:57:56Z","timestamp":1694685476000},"page":"13675","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Assessing and Ranking EU Cities Based on the Development Phase of the Smart City Concept"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6053-0976","authenticated-orcid":false,"given":"Diogo","family":"Correia","sequence":"first","affiliation":[{"name":"Research Unit on Governance, Competitiveness and Public Policies (GOVCOPP), Department of Economics, Management, Industrial Engineering and Tourism (DEGEIT), School of Design, Management and Production Technologies\u2014North Aveiro School (ESAN), University of Aveiro, Campus Universit\u00e1rio de Santiago, 3810-193 Aveiro, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0472-2767","authenticated-orcid":false,"given":"Jo\u00e3o Louren\u00e7o","family":"Marques","sequence":"additional","affiliation":[{"name":"Research Unit on Governance, Competitiveness and Public Policies (GOVCOPP), Department of Social, Political and Territorial Sciences (DCSJP), University of Aveiro, Campus Universit\u00e1rio de Santiago, 3810-193 Aveiro, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7791-1932","authenticated-orcid":false,"given":"Leonor","family":"Teixeira","sequence":"additional","affiliation":[{"name":"Department of Economics, Management, Industrial Engineering and Tourism (DEGEIT), Institute of Electronics and Informatics Engineering of Aveiro (IEETA)\/Intelligent Systems Associate Laboratory (LASI), University of Aveiro, 3010-193 Aveiro, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"S3","DOI":"10.1016\/j.cities.2014.06.007","article-title":"Smart city policies: A spatial approach","volume":"41","author":"Angelidou","year":"2014","journal-title":"Cities"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Chourabi, H., Nam, T., Walker, S., Gil-Garcia, J.R., Mellouli, S., Nahon, K., Pardo, T.A., and Scholl, H.J. (2012, January 4\u20137). Understanding smart cities: An integrative framework. Proceedings of the Annual Hawaii International Conference on System Sciences, Maui, HI, USA.","DOI":"10.1109\/HICSS.2012.615"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1080\/10630730601145989","article-title":"New technologies, same dilemmas: Policy and design issues for the augmented city","volume":"13","author":"Aurigi","year":"2006","journal-title":"J. Urban Technol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1080\/13604819708900051","article-title":"Urbanising cyberspace?","volume":"2","author":"Graham","year":"1997","journal-title":"City"},{"key":"ref_5","unstructured":"Van Bastelaer, B. (1998, January 29\u201330). Digital cities and transferability of results. Proceedings of the 4th EDC Conference on Digital Cities, Salzburg, Austria."},{"key":"ref_6","unstructured":"Gibson, R.W., Kozmetsky, D.V., and Smilor, G. (1992). The Technopolis Phenomenon: Smart Cities, Fast Systems, Global Networks, Rowman & Littlefield."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1080\/10864415.1999.11518344","article-title":"Creating the Digital Economy: Strategies and Perspectives from Singapore","volume":"3","author":"Tan","year":"1999","journal-title":"Int. J. Electron. Commer."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1016\/j.sbspro.2014.11.137","article-title":"Digital Dimension of Smart City: Critical Analysis","volume":"156","year":"2014","journal-title":"Procedia Soc. Behav. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"114960","DOI":"10.1016\/j.ecoenv.2023.114960","article-title":"Ecotoxicology and Environmental Safety VAR-tree model based spatio-temporal characterization and prediction of O3 concentration in China","volume":"257","author":"Dai","year":"2023","journal-title":"Ecotoxicol. Environ. Saf."},{"key":"ref_10","first-page":"2130211","article-title":"Fulfilment of last-mile urban logistics for sustainable and inclusive smart cities: A case study conducted in Portugal","volume":"2022","author":"Correia","year":"2022","journal-title":"Int. J. Logist. Res. Appl."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"263","DOI":"10.3390\/systems10060263","article-title":"Haze Risk Assessment Based on Improved PCA-MEE and ISPO-LightGBM Model","volume":"10","author":"Dai","year":"2022","journal-title":"Systems"},{"key":"ref_12","unstructured":"Cohen, B. (2022, January 14). The 3 Generations of Smart Cities. Available online: https:\/\/www.fastcompany.com\/3047795\/the-3-generations-of-smart-cities."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/j.techfore.2018.07.033","article-title":"Technological Forecasting & Social Change Towards the smart city 2.0: Empirical evidence of using smartness as a tool for tackling social challenges","volume":"142","author":"Trencher","year":"2019","journal-title":"Technol. Forecast. Soc. Chang."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Coletta, C., Evans, L., Heaphy, L., and Kitchin, R. (2018). Creating Smart Cities, Routledge. [1st ed.].","DOI":"10.4324\/9781351182409"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"66","DOI":"10.2495\/TDI-V6-N1-66-80","article-title":"City@Path: A Collaborative Smart City Planning and Assessment Tool","volume":"Volume 6","author":"Correia","year":"2022","journal-title":"Transport Development and Integration"},{"key":"ref_16","first-page":"5","article-title":"Smart city strategy and its implementation barriers: Czech experience","volume":"15","author":"Janurova","year":"2020","journal-title":"Theor. Empir. Res. Urban Manag."},{"key":"ref_17","unstructured":"Kitchin, R. (2022, January 14). Getting Smarter about Smart Cities: Improving Data Privacy and Data Security. Available online: https:\/\/api.semanticscholar.org\/CorpusID:168484266."},{"key":"ref_18","unstructured":"Griffiths, H. (2022, January 14). Smart City Demonstrators: A Global Review of Challenges and Lessons Learned. Available online: https:\/\/cp.catapult.org.uk\/wp-content\/uploads\/2021\/01\/SMART-CITY-DEMONSTRATORS-A-global-review-of-challenges-and-lessons-learned.pdf."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1108\/LHT-12-2018-0203","article-title":"The scientometrics of literature on smart cities","volume":"38","author":"Moradi","year":"2020","journal-title":"Libr. Hi Tech"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1205","DOI":"10.1007\/s11192-018-2901-9","article-title":"Smart city research 1990\u20132016","volume":"117","author":"Ingwersen","year":"2018","journal-title":"Scientometrics"},{"key":"ref_21","unstructured":"Dias, G.P. (2018, January 13\u201316). Smart cities research in Portugal and Spain. Proceedings of the 2018 13th Iberian Conference on Information Systems and Technologies (Cisti), Caceres, Spain."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Correia, D., Teixeira, L., and Marques, J.L. (2022). Reviewing the State-of-the-Art of Smart Cities in Portugal: Evidence Based on Content Analysis of a Portuguese Magazine. Publications, 9.","DOI":"10.3390\/publications9040049"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Sm\u00e9kalov\u00e1, L., and Ku\u010dera, F. (2020). Smart city projects in the small-sized municipalities: Contribution of the cohesion policy. Sci. Pap. Univ. Pardubic. Ser. D Fac. Econ. Adm., 28.","DOI":"10.46585\/sp28021067"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"5","DOI":"10.22215\/timreview\/1264","article-title":"Towards Smart City Concept in Small Cities","volume":"9","author":"Ruohomaa","year":"2019","journal-title":"Technol. Innov. Manag. Rev."},{"key":"ref_25","first-page":"313","article-title":"Implementing smart city solutions: Smart city map and city drop","volume":"28","author":"Gheorghi","year":"2017","journal-title":"Calitatea Vietii"},{"key":"ref_26","first-page":"1061","article-title":"Slovak Republic on the way to build smart cities based on KPIs with first Slovak smart city index","volume":"28","author":"Kona","year":"2020","journal-title":"Sci. Pap. Univ. Pardubic. Ser. D Fac. Econ. Adm."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"032072","DOI":"10.1088\/1757-899X\/603\/3\/032072","article-title":"Potential of Culture for Sustainable Urban Development","volume":"603","author":"Vitkova","year":"2019","journal-title":"IOP Conf. Ser. Mater. Sci. Eng."},{"key":"ref_28","first-page":"95","article-title":"The smart city concept in Poland and Ukraine: In search of cooperation opportunities","volume":"52","author":"Lozynskyy","year":"2021","journal-title":"Bull. Geogr. Socio-Econ. Ser."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"102938","DOI":"10.1016\/j.cities.2020.102938","article-title":"Implementing smart city strategies in Greece: Appetite for success","volume":"108","author":"Siokas","year":"2020","journal-title":"Cities"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1080\/10630732.2017.1348884","article-title":"Smart City Pilot Projects: Exploring the Dimensions and Conditions of Scaling Up","volume":"24","author":"Buuse","year":"2017","journal-title":"J. Urban Technol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1776","DOI":"10.3390\/smartcities5040089","article-title":"The State-of-the-Art of Smart Cities in the European Union","volume":"5","author":"Correia","year":"2022","journal-title":"Smart Cities"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1016\/j.scs.2018.10.009","article-title":"The Lisbon ranking for smart sustainable cities in Europe","volume":"44","author":"Akande","year":"2019","journal-title":"Sustain. Cities Soc."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1016\/j.techfore.2018.07.024","article-title":"A Multiple-Attribute Decision Making-based approach for smart city rankings design","volume":"142","author":"Escolar","year":"2018","journal-title":"Technol. Forecast. Soc. Chang."},{"key":"ref_34","unstructured":"Giffinger, R. (2022, January 14). Smart Cities Ranking of European Medium-Sized Cities. Available online: https:\/\/repositum.tuwien.at\/bitstream\/20.500.12708\/153435\/1\/Giffinger-2007-Smart%20cities.%20Ranking%20of%20European%20medium-sized%20cities.%20Fin...-vor.pdf."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"7","DOI":"10.5821\/ace.v4i12.2483","article-title":"Smart cities ranking: An effective instrument for the positioning of the cities?","volume":"4","author":"Giffinger","year":"2010","journal-title":"ACE Archit. City Environ."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1080\/13511610.2012.660325","article-title":"Modelling the smart city performance","volume":"25","author":"Lombardi","year":"2012","journal-title":"Innov. Eur. J. Soc. Sci. Res."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/S0264-2751(98)00050-X","article-title":"Smart cities: The Singapore case","volume":"16","author":"Mahizhnan","year":"1999","journal-title":"Cities"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1080\/10630732.2014.942092","article-title":"Smart cities: Definitions, dimensions, performance, and initiatives","volume":"22","author":"Albino","year":"2015","journal-title":"J. Urban Technol."},{"key":"ref_39","first-page":"47","article-title":"Smart Growth, Smart Cities, and the Crisis at the Pump A Worldwide Phenomenon","volume":"32","author":"Eger","year":"2009","journal-title":"I-Ways J. E-Gov. Policy Regul."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Thuzar, M. (2011). Urbanization in Southeast Asia: Developing Smart Cities for the Future?. Reg. Outlook, 96\u2013100.","DOI":"10.1355\/9789814311694-022"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Nam, T., and Pardo, T.A. (2011, January 12\u201315). Conceptualizing smart city with dimensions of technology, people, and institutions. Proceedings of the ACM International Conference Proceeding Series, College Park, MD, USA.","DOI":"10.1145\/2037556.2037602"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1080\/10630732.2011.601117","article-title":"Smart Cities in Europe","volume":"18","author":"Caragliu","year":"2009","journal-title":"J. Urban Technol."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1016\/j.ijinfomgt.2019.01.004","article-title":"Smart cities: Advances in research\u2014An information systems perspective","volume":"47","author":"Ismagilova","year":"2019","journal-title":"Int. J. Inf. Manag."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1016\/j.eswa.2017.06.027","article-title":"Smart health: Big data enabled health paradigm within smart cities","volume":"87","author":"Pramanik","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"50","DOI":"10.15581\/002.ART-2152","article-title":"Smart Cities, Sustainable Progress: Opportunities for Urban Development","volume":"14","author":"Barrionuevo","year":"2012","journal-title":"IESE Insight"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1080\/13511610.2012.660331","article-title":"Innovation: The European Journal of Social Science Research Smart cities in the innovation age","volume":"25","author":"Kourtit","year":"2012","journal-title":"Innov. Eur. J. Soc. Sci. Res."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.cities.2013.12.010","article-title":"Current trends in smart city initiatives: Some stylised facts","volume":"38","author":"Neirotti","year":"2014","journal-title":"Cities"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1109\/MCE.2016.2556879","article-title":"Everything you wanted to know about smart cities: The Internet of things is the backbone","volume":"5","author":"Mohanty","year":"2016","journal-title":"IEEE Consum. Electron. Mag."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1016\/j.cities.2016.09.009","article-title":"What are the differences between sustainable and smart cities?","volume":"60","author":"Ahvenniemi","year":"2017","journal-title":"Cities"},{"key":"ref_50","unstructured":"Wolf, J., Borges, M., Marques, J.L., and Castro, E. (2019). New Paths of Entrepreneurship Development, Springer."},{"key":"ref_51","unstructured":"Ruohomaa, H., Ivanova, N., Podkletnov, D., and Ivanova, K. (2022, January 14). The socio-technical impact of the current disruptive technologies on the smart city concept realization. Available online: http:\/\/www.math.bas.bg\/infres\/~ivanova\/KMI-papers\/2019-CEUR-SPb_Workshop-Ruohomaa_et_al.pdf."},{"key":"ref_52","unstructured":"Mosannenzadeh, F., and Vettorato, D. (2014). Defining Smart City. A Conceptual Framework Based on Keyword Analysis. TeMA-J. Land Use Mobil. Environ., 998."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1080\/10630732.2017.1348880","article-title":"The Role of Smart City Characteristics in the Plans of Fifteen Cities","volume":"24","author":"Angelidou","year":"2017","journal-title":"J. Urban Technol."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1016\/j.cities.2015.05.004","article-title":"Smart cities: A conjuncture of four forces","volume":"47","author":"Angelidou","year":"2015","journal-title":"Cities"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1016\/j.techfore.2018.09.014","article-title":"Driving elements to make cities smarter: Evidences from European projects","volume":"142","author":"Camboim","year":"2019","journal-title":"Technol. Forecast. Soc. Chang."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"103116","DOI":"10.1016\/j.cities.2021.103116","article-title":"The many faces of the smart city: Differing value propositions in the activity portfolios of nine cities","volume":"112","year":"2021","journal-title":"Cities"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"941","DOI":"10.1080\/09654313.2017.1294149","article-title":"Big data analytics for mitigating carbon emissions in smart cities: Opportunities and challenges","volume":"25","author":"Giest","year":"2017","journal-title":"Eur. Plan. Stud."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Noori, N., Hoppe, T., and de Jong, M. (2020). Classifying pathways for smart city development: Comparing design, governance and implementation in Amsterdam, Barcelona, Dubai, and Abu Dhabi. Sustainability, 12.","DOI":"10.3390\/su12104030"},{"key":"ref_59","unstructured":"Ojo, A., Curry, E., and Janowski, T. (2014, January 9\u201311). Designing next generation smart city initiatives\u2014Harnessing findings and lessons from a study of ten smart city programs. Proceedings of the ECIS 2014 Proceedings, Proceedings of the 22nd European Conference on Information Systems, Tel Aviv, Israel."},{"key":"ref_60","unstructured":"Phumpiu Chang, P., and Rivera Kuri, J.L. (2022, January 14). Monterrey Envisioned as a Smart City Developed through International Model Examples; WIT Transactions on Ecology and the Environment. Available online: https:\/\/www.witpress.com\/elibrary\/wit-transactions-on-ecology-and-the-environment."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"104213","DOI":"10.1016\/j.cities.2023.104213","article-title":"Participatory methodology guidelines to promote citizens participation in decision-making: Evidence based on a Portuguese case study","volume":"135","author":"Correia","year":"2023","journal-title":"Cities"},{"key":"ref_62","first-page":"819","article-title":"Identification and prioritization of barriers in building smart cities","volume":"9","author":"Goyal","year":"2018","journal-title":"Int. J. Mech. Eng. Technol."},{"key":"ref_63","unstructured":"Jayasena, N.S., Mallawaarachchi, H., and Waidyasekara, K.G.A.S. (2019, January 23\u201325). A critical review on the drivers and barriers for enabling smart cities. Proceedings of the International Conference on Industrial Engineering and Operations Management, Toronto, ON, Canada."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"762","DOI":"10.1016\/j.rser.2014.08.077","article-title":"Barriers to renewable\/sustainable energy technologies adoption: Indian perspective","volume":"41","author":"Luthra","year":"2015","journal-title":"Renew. Sustain. Energy Rev."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1007\/s10796-018-9873-4","article-title":"Barriers to the Development of Smart Cities in Indian Context","volume":"21","author":"Rana","year":"2019","journal-title":"Inf. Syst. Front."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.cities.2016.07.007","article-title":"A case-based learning methodology to predict barriers to implementation of smart and sustainable urban energy projects","volume":"60","author":"Mosannenzadeh","year":"2017","journal-title":"Cities"},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/j.enpol.2017.02.007","article-title":"Identifying and prioritizing barriers to implementation of smart energy city projects in Europe: An empirical approach","volume":"105","author":"Mosannenzadeh","year":"2017","journal-title":"Energy Policy"},{"key":"ref_68","first-page":"179","article-title":"Investigating Smart City Barriers: Contribution of Experts based on a Delphi Analysis","volume":"10","author":"Correia","year":"2022","journal-title":"Int. Rev. Spat. Plan. Sustain. Dev."}],"container-title":["Sustainability"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2071-1050\/15\/18\/13675\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:50:10Z","timestamp":1760129410000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2071-1050\/15\/18\/13675"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,13]]},"references-count":68,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["su151813675"],"URL":"https:\/\/doi.org\/10.3390\/su151813675","relation":{},"ISSN":["2071-1050"],"issn-type":[{"value":"2071-1050","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,13]]}}}