{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T22:37:50Z","timestamp":1776465470898,"version":"3.51.2"},"reference-count":35,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2025,4,14]],"date-time":"2025-04-14T00:00:00Z","timestamp":1744588800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Eiffage","award":["ANR-16-IDEX-0003"],"award-info":[{"award-number":["ANR-16-IDEX-0003"]}]},{"name":"Eiffage","award":["ANR-21-EXES-0007"],"award-info":[{"award-number":["ANR-21-EXES-0007"]}]},{"name":"ANR","award":["ANR-16-IDEX-0003"],"award-info":[{"award-number":["ANR-16-IDEX-0003"]}]},{"name":"ANR","award":["ANR-21-EXES-0007"],"award-info":[{"award-number":["ANR-21-EXES-0007"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["BDCC"],"abstract":"<jats:p>The emergence of Multimodal Large Language Models (MLLMs) has made methods of artificial intelligence accessible to the general public in a conversational way. It offers tools for the automated visual assessment of the quality of a built environment for professionals of urban planning without requiring specific technical knowledge on computing. We investigated the capability of MLLMs to perceive urban environments based on images and textual prompts. We compared the outputs of several popular models\u2014ChatGPT, Gemini and Grok\u2014to the visual assessment of experts in Architecture, Engineering and Construction (AEC) in the context of a real estate construction project. Our analysis was based on subjective attributes proposed to characterize various aspects of a built environment. Four urban identities served as case studies, set in a virtual environment designed using professional 3D models. We found that there can be an alignment between human and AI evaluation on some aspects such as space and scale and architectural style, and more general accordance in environments with vegetation. However, there were noticeable differences in response patterns between the AIs and AEC experts, particularly concerning subjective aspects such as the general emotional resonance of specific urban identities. It raises questions regarding the hallucinations of generative AI where the AI invents information and behaves creatively but its outputs are not accurate.<\/jats:p>","DOI":"10.3390\/bdcc9040100","type":"journal-article","created":{"date-parts":[[2025,4,14]],"date-time":"2025-04-14T06:18:36Z","timestamp":1744611516000},"page":"100","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Subjective Assessment of a Built Environment by ChatGPT, Gemini and Grok: Comparison with Architecture, Engineering and Construction Expert Perception"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8783-1226","authenticated-orcid":false,"given":"Rachid","family":"Belaroussi","sequence":"first","affiliation":[{"name":"COSYS-GRETTIA, University Gustave Eiffel, F-77447 Marne-la-Vall\u00e9e, France"}]}],"member":"1968","published-online":{"date-parts":[[2025,4,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ewing, R., Clemente, O., Neckerman, K.M., Purciel-Hill, M., Quinn, J.W., and Rundle, A. (2013). Measuring Urban Design: Metrics for Livable Places, Island Press.","DOI":"10.5822\/978-1-61091-209-9"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1177\/0265813515625641","article-title":"How walkable is Walker\u2019s paradise?","volume":"44","author":"Koschinsky","year":"2017","journal-title":"Environ. Plan. B Urban Anal. City Sci."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Liao, B., van den Berg, P.E.W., van Wesemael, P.J., and Arentze, T.A. (2020). How does walkability change behavior? A comparison between different age groups in the Netherlands. Int. J. Environ. Res. Public Health, 17.","DOI":"10.3390\/ijerph17020540"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"04018042","DOI":"10.1061\/(ASCE)UP.1943-5444.0000483","article-title":"Variability in sidewalk pedestrian level of service measures and rating","volume":"144","author":"Karatas","year":"2018","journal-title":"J. Urban Plan. Dev."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"S223","DOI":"10.1123\/jpah.3.s1.s223","article-title":"Identifying and measuring urban design qualities related to walkability","volume":"3","author":"Ewing","year":"2006","journal-title":"J. Phys. Act. Health"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Belaroussi, R., Issa, E., Cameli, L., Lantieri, C., and Adel\u00e9, S. (2024). Exploring Virtual Environments to Assess the Quality of Public Spaces. Algorithms, 17.","DOI":"10.3390\/a17030124"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"110295","DOI":"10.1016\/j.buildenv.2023.110295","article-title":"Quality of crowdsourced geospatial building information: A global assessment of OpenStreetMap attributes","volume":"237","author":"Biljecki","year":"2023","journal-title":"Build. Environ."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Gomez-Tone, H.C., Alpaca Ch\u00e1vez, M., V\u00e1squez Samalvides, L., and Martin-Gutierrez, J. (2022). Introducing Immersive Virtual Reality in the Initial Phases of the Design Process;Case Study: Freshmen Designing Ephemeral Architecture. Buildings, 12.","DOI":"10.3390\/buildings12050518"},{"key":"ref_9","first-page":"139","article-title":"Architectural design quality assessment based on analytic hierarchy process: A case study","volume":"31","author":"Harputlugil","year":"2014","journal-title":"METU J. Fac. Archit."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Corticelli, R., Pazzini, M., Mazzoli, C., Lantieri, C., Ferrante, A., and Vignali, V. (2022). Urban Regeneration and Soft Mobility: The Case Study of the Rimini Canal Port in Italy. Sustainability, 14.","DOI":"10.3390\/su142114529"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"127152","DOI":"10.1016\/j.ufug.2021.127152","article-title":"Developing a quantitative tool to measure the extent to which public spaces meet user needs","volume":"62","author":"Alwah","year":"2021","journal-title":"Urban For. Urban Green."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"103342","DOI":"10.1016\/j.ijhcs.2024.103342","article-title":"Towards the use of virtual reality prototypes in architecture to collect user experiences: An assessment of the comparability of patient experiences in a virtual and a real ambulatory pathway","volume":"192","author":"Vinet","year":"2024","journal-title":"Int. J. Hum.-Comput. Stud."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1007\/s42489-020-00069-6","article-title":"Creating Immersive Virtual Environments Based on Open Geospatial Data and Game Engines","volume":"71","author":"Keil","year":"2021","journal-title":"KN-J. Cartogr. Geogr. Inf."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"100063","DOI":"10.1016\/j.urbmob.2023.100063","article-title":"People as planners: Stakeholder participation in the street experimentation process using a virtual urban living lab","volume":"4","author":"Scerri","year":"2023","journal-title":"J. Urban Mobil."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Belaroussi, R., Gonz\u00e1lez, E.D., Dupin, F., and Martin-Gutierrez, J. (2023). Appraisal of Architectural Ambiances in a Future District. Sustainability, 15.","DOI":"10.3390\/su151813295"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"G\u00f3mez-Tone, H.C., Martin-Gutierrez, J., Bustamante-Escapa, J., and Bustamante-Escapa, P. (2021). Spatial Skills and Perceptions of Space: Representing 2D Drawings as 3D Drawings inside Immersive Virtual Reality. Appl. Sci., 11.","DOI":"10.3390\/app11041475"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"e06322","DOI":"10.1016\/j.heliyon.2021.e06322","article-title":"Natural language processing for urban research: A systematic review","volume":"7","author":"Cai","year":"2021","journal-title":"Heliyon"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Jang, K.M., and Kim, Y. (2019). Crowd-sourced cognitive mapping: A new way of displaying people\u2019s cognitive perception of urban space. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0218590"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3274413","article-title":"The spirit of the city: Using social media to capture neighborhood ambiance","volume":"2","author":"Redi","year":"2018","journal-title":"Proc. ACM Hum.-Comput. Interact."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"103045","DOI":"10.1016\/j.cities.2020.103045","article-title":"Reading the city through its neighbourhoods: Deep text embeddings of Yelp reviews as a basis for determining similarity and change","volume":"110","author":"Olson","year":"2021","journal-title":"Cities"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"104399","DOI":"10.1016\/j.cities.2023.104399","article-title":"Insights in a city through the eyes of Airbnb reviews: Sensing urban characteristics from homestay guest experiences","volume":"140","author":"Wang","year":"2023","journal-title":"Cities"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"104217","DOI":"10.1016\/j.landurbplan.2021.104217","article-title":"Street view imagery in urban analytics and GIS: A review","volume":"215","author":"Biljecki","year":"2021","journal-title":"Landsc. Urban Plan."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"104802","DOI":"10.1016\/j.landurbplan.2023.104802","article-title":"Revealing spatio-temporal evolution of urban visual environments with street view imagery","volume":"237","author":"Liang","year":"2023","journal-title":"Landsc. Urban Plan."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"102481","DOI":"10.1016\/j.cities.2019.102481","article-title":"Understanding cities with machine eyes: A review of deep computer vision in urban analytics","volume":"96","author":"Ibrahim","year":"2020","journal-title":"Cities"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"104329","DOI":"10.1016\/j.cities.2023.104329","article-title":"Automatic assessment of public open spaces using street view imagery","volume":"137","author":"Chen","year":"2023","journal-title":"Cities"},{"key":"ref_26","unstructured":"Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F.L., Almeida, D., Altenschmidt, J., Altman, S., and Anadkat, S. (2023). Gpt-4 technical report. arXiv."},{"key":"ref_27","unstructured":"Liu, A., Feng, B., Xue, B., Wang, B., Wu, B., Lu, C., Zhao, C., Deng, C., Zhang, C., and Ruan, C. (2024). Deepseek-v3 technical report. arXiv."},{"key":"ref_28","unstructured":"xAI (2025, February 21). Grok 3 Beta\u2014The Age of Reasoning Agents. Available online: https:\/\/x.ai\/news\/grok-3."},{"key":"ref_29","unstructured":"Fu, C., Zhang, R., Wang, Z., Huang, Y., Zhang, Z., Qiu, L., Ye, G., Shen, Y., Zhang, M., and Chen, P. (2023). A Challenger to GPT-4V? Early Explorations of Gemini in Visual Expertise. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"87713","DOI":"10.1109\/ACCESS.2024.3408843","article-title":"Automatic Estimation for Visual Quality Changes of Street Space Via Street-View Images and Multimodal Large Language Models","volume":"12","author":"Liang","year":"2024","journal-title":"IEEE Access"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"102243","DOI":"10.1016\/j.compenvurbsys.2024.102243","article-title":"Urban attractiveness according to ChatGPT: Contrasting AI and human insights","volume":"117","author":"Malekzadeh","year":"2025","journal-title":"Comput. Environ. Urban Syst."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Xiao, Y., and Song, M. (2024). How are urban design qualities associated with perceived walkability? An AI approach using street view images and deep learning. Int. J. Urban Sci., 1\u201326.","DOI":"10.1080\/12265934.2024.2429824"},{"key":"ref_33","unstructured":"OpenAI (2025, January 30). Analysis of Urban Design Factors Based on Visual Input, 2025. AI-Generated Response from ChatGPT on January 14, 2025. Retrieved via Interaction. Available online: https:\/\/chatgpt.com\/."},{"key":"ref_34","unstructured":"Gemini, G. (2025, January 30). Qualitative Image Analysis Using Gemini. 2025. Retrieved via Interaction. Available online: https:\/\/gemini.google.com\/app."},{"key":"ref_35","unstructured":"Grok 3 (xAI) (2025, February 19). Personal Communication Regarding Urban Environment Analysis Based on Provided Images, 2025. Analysis Provided via AI Interaction. Available online: https:\/\/grok.com\/."}],"container-title":["Big Data and Cognitive Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-2289\/9\/4\/100\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:14:05Z","timestamp":1760030045000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-2289\/9\/4\/100"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,14]]},"references-count":35,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2025,4]]}},"alternative-id":["bdcc9040100"],"URL":"https:\/\/doi.org\/10.3390\/bdcc9040100","relation":{},"ISSN":["2504-2289"],"issn-type":[{"value":"2504-2289","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,14]]}}}