{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T15:32:23Z","timestamp":1772638343846,"version":"3.50.1"},"reference-count":61,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,3,14]],"date-time":"2025-03-14T00:00:00Z","timestamp":1741910400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Sci."],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>Understanding how urban environments shape public sentiment is crucial for urban planning. Traditional methods, such as surveys, often fail to capture evolving sentiment dynamics. This study leverages language and vision models to assess the influence of urban features on public emotions across spatial contexts and timeframes.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>A two-phase computational framework was developed. First, sentiment inference used a BERT-based model to extract sentiment from geotagged social media posts. Second, urban context inference applied PSPNet and Mask R-CNN to street view imagery to quantify urban design features, including visual enclosure, human scale, and streetscape complexity. The study integrates publicly available data and spatial simulation techniques to examine sentiment-urban form relationships over time.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>The analysis reveals that greenery and pedestrian-friendly infrastructure positively influence sentiment, while excessive openness and fenced-off areas correlate with negative sentiment. A hotspot analysis highlights shifting sentiment patterns, particularly during societal disruptions like the COVID-19 pandemic.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>Findings emphasize the need to incorporate public sentiment into urban simulations to create inclusive, safe, and resilient environments. The study provides data-driven insights for planners, supporting human-centered design interventions that enhance urban livability.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fcomp.2025.1504523","type":"journal-article","created":{"date-parts":[[2025,3,14]],"date-time":"2025-03-14T07:06:37Z","timestamp":1741935997000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Urban sentiment mapping using language and vision models in spatial analysis"],"prefix":"10.3389","volume":"7","author":[{"given":"Jayedi","family":"Aman","sequence":"first","affiliation":[]},{"given":"Timothy C.","family":"Matisziw","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2025,3,14]]},"reference":[{"key":"ref1","author":"Ahn","year":"2022","journal-title":"Measuring the City: The Power of Urban Metrics\u2019, Projections. Edited by C. Ahn, C. Ignaccolo, and A. Salazar-Miranda, 16. Measuring the City: The Power of Urban Metrics (MIT Press). Available at:"},{"key":"ref2","volume-title":"A pattern language: Towns, buildings, Construction","author":"Alexander","year":"1977"},{"key":"ref3","first-page":"595","volume-title":"Sensing the City: Leveraging Geotagged Social Media Posts and Street View Imagery to Model Urban Streetscapes Using Deep Neural Networks. Jeroen van Ameijde, Nicole Gardner, Kyung Hoon Hyun, Dan Luo, Urvi Sheth (Eds.), POST-CARBON - Proceedings of the 27th CAADRIA Conference, Sydney","author":"Aman","year":"2022"},{"key":"ref4","doi-asserted-by":"publisher","first-page":"1218","DOI":"10.3389\/fbuil.2021.721218","article-title":"Walkability and its relationships with health, sustainability, and livability: elements of physical environment and evaluation frameworks","volume":"7","author":"Baobeid","year":"2021","journal-title":"Front. Built Environ."},{"key":"ref5","doi-asserted-by":"publisher","first-page":"274","DOI":"10.1177\/2043820613513390","article-title":"Big data, smart cities and city planning","volume":"3","author":"Batty","year":"2013","journal-title":"Dialog. Human Geography"},{"key":"ref6","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1007\/978-1-4615-5203-1_2","article-title":"Discrete choice methods and their applications to short term travel decisions","volume-title":"Handbook of transportation science","author":"Ben-Akiva","year":"1999"},{"key":"ref7","doi-asserted-by":"publisher","first-page":"104217","DOI":"10.1016\/j.landurbplan.2021.104217","article-title":"Street view imagery in urban analytics and GIS: a review","volume":"215","author":"Biljecki","year":"2021","journal-title":"Landsc. Urban Plan."},{"key":"ref8","first-page":"1877","article-title":"Language models are few-shot learners","volume":"33","author":"Brown","year":"2020","journal-title":"Adv. Neural Inf. Proces. Syst."},{"key":"ref9","volume-title":"Public places, urban spaces: The dimensions of Urban Design","author":"Carmona","year":"2010"},{"key":"ref10","doi-asserted-by":"publisher","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","article-title":"DeepLab: semantic image segmentation with deep convolutional nets, Atrous convolution, and fully connected CRFs","volume":"40","author":"Chen","year":"2018","journal-title":"IEEE transactions on pattern analysis and machine intelligence"},{"key":"ref11","doi-asserted-by":"publisher","first-page":"527","DOI":"10.1016\/j.ufug.2015.03.007","article-title":"A review of methodologies used in studies investigating human behaviour as determinant of outcome for exposure to \u2018naturalistic and urban environments.\u2019","volume":"14","author":"Choudhry","year":"2015","journal-title":"Urban For. Urban Green."},{"key":"ref12","doi-asserted-by":"publisher","first-page":"103539","DOI":"10.1016\/j.jbi.2020.103539","article-title":"Comparing deep learning architectures for sentiment analysis on drug reviews","volume":"110","author":"Col\u00f3n-Ruiz","year":"2020","journal-title":"J. Biomed. Inform."},{"key":"ref13","author":"Devlin","year":"2019"},{"key":"ref14","doi-asserted-by":"publisher","first-page":"4794","DOI":"10.3390\/ijerph19084794","article-title":"Exploring the relationship between urban youth sentiment and the built environment using machine learning and Weibo comments","volume":"19","author":"Duan","year":"2022","journal-title":"Int. J. Environ. Res. Public Health"},{"key":"ref15","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1007\/978-3-319-46448-0_12","article-title":"Deep learning the City: quantifying urban perception at a global scale","volume-title":"Computer vision \u2013 ECCV 2016","author":"Dubey","year":"2016"},{"key":"ref16","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1080\/13574800802451155","article-title":"Measuring the unmeasurable: Urban Design qualities related to walkability","volume":"14","author":"Ewing","year":"2009","journal-title":"J. Urban Des."},{"key":"ref17","doi-asserted-by":"publisher","first-page":"S223","DOI":"10.1123\/jpah.3.s1.s223","article-title":"Identifying and measuring Urban Design qualities related to walkability","volume":"3","author":"Ewing","year":"2006","journal-title":"J. Phys. Act. Health"},{"key":"ref18","volume-title":"Cities for people","author":"Gehl","year":"2013"},{"key":"ref19","volume-title":"Cities for people (illustrated edition)","author":"Gehl","year":"2010"},{"key":"ref20","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1111\/j.1538-4632.1992.tb00261.x","article-title":"The analysis of spatial association by use of distance statistics","volume":"24","author":"Getis","year":"1992","journal-title":"Geogr. Anal."},{"key":"ref21","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1007\/s10708-007-9111-y","article-title":"Citizens as sensors: the world of volunteered geography","volume":"69","author":"Goodchild","year":"2007","journal-title":"GeoJournal"},{"key":"ref22","volume-title":"Street View static API overview","author":"Google Street View","year":"2022"},{"key":"ref23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.17645\/up.v1i2.609","article-title":"Revealing cultural ecosystem services through Instagram images: the potential of social media volunteered geographic information for urban green infrastructure planning and governance","volume":"1","author":"Guerrero","year":"2016","journal-title":"Urban Plan."},{"key":"ref24","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1016\/j.landurbplan.2014.10.001","article-title":"Environmental affordances: a practical approach for design of nearby outdoor settings in urban residential areas","volume":"134","author":"Hadavi","year":"2015","journal-title":"Landsc. Urban Plan."},{"key":"ref25","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1016\/j.jenvp.2006.07.007","article-title":"The need for psychological restoration as a determinant of environmental preferences","volume":"26","author":"Hartig","year":"2006","journal-title":"J. Environ. Psychol."},{"key":"ref26","doi-asserted-by":"publisher","first-page":"2980","DOI":"10.1109\/ICCV.2017.322","article-title":"Mask R-CNN","author":"He","year":"2017","journal-title":"2017 EEE Int. Conf. Computer Vision"},{"key":"ref27","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2024.1276923","article-title":"Exploring the non-linear relationship and synergistic effect between urban built environment and public sentiment integrating macro- and micro-level perspective: a case study in San Francisco","volume":"15","author":"He","year":"2024","journal-title":"Front. Psychol."},{"key":"ref28","doi-asserted-by":"publisher","first-page":"110192","DOI":"10.1016\/j.isci.2024.110192","article-title":"Sentiment and semantic analysis: urban quality inference using machine learning algorithms","volume":"27","author":"Ho","year":"2024","journal-title":"iScience"},{"key":"ref29","volume-title":"The death and life of great American cities","author":"Jacobs","year":"1961"},{"key":"ref30","doi-asserted-by":"publisher","first-page":"e0218590","DOI":"10.1371\/journal.pone.0218590","article-title":"Crowd-sourced cognitive mapping: a new way of displaying people\u2019s cognitive perception of urban space","volume":"14","author":"Jang","year":"2019","journal-title":"PLoS One"},{"key":"ref31","article-title":"ultralytics\/yolov5: V7.0 - YOLOv5 SOTA Realtime Instance Segmentation (Version v7.0) [Computer software]. Zenodo.","author":"Jocher","year":"2022"},{"key":"ref32","first-page":"pp. xii, 340","volume-title":"The experience of nature: A psychological perspective","author":"Kaplan","year":"1989"},{"key":"ref33","author":"Kheiri","year":"2023"},{"key":"ref34","first-page":"475","article-title":"Urban Emotion-The interrogation of social media and its implications within urban context. Cogn. City AI","author":"Kim","year":"2020"},{"key":"ref35","doi-asserted-by":"publisher","first-page":"210","DOI":"10.3390\/engproc2023059210","article-title":"Traffic management system using YOLO algorithm","volume":"59","author":"Kunekar","year":"2024","journal-title":"Eng. Proceed."},{"key":"ref36","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1909.11942","article-title":"ALBERT: a lite BERT for self-supervised learning of language representations (no. arXiv:1909.11942)","author":"Lan","year":"2020","journal-title":"arXiv"},{"key":"ref37","doi-asserted-by":"publisher","first-page":"10249","DOI":"10.3390\/ijerph191610249","article-title":"Multidisciplinary understanding of the urban heating problem and mitigation: a conceptual framework for urban planning","volume":"19","author":"Lee","year":"2022","journal-title":"Int. J. Environ. Res. Public Health"},{"key":"ref38","doi-asserted-by":"publisher","first-page":"Article 9","DOI":"10.3390\/land13091500","article-title":"Understanding how people perceive and interact with public space through social media big data: a case study of Xiamen, China","volume":"13","author":"Li","year":"2024","journal-title":"Land"},{"key":"ref39","doi-asserted-by":"publisher","first-page":"020091","DOI":"10.1063\/1.5090745","article-title":"A comparative study on digital twin models","volume":"2073","author":"Liu","year":"2019","journal-title":"AIP Conf. Proceed."},{"key":"ref40","doi-asserted-by":"publisher","first-page":"127917","DOI":"10.1016\/j.ufug.2023.127917","article-title":"Assessing urban greenery by harvesting street view data: A review","volume":"83","author":"Lu","year":"2023","journal-title":"Urban For. Urban Green."},{"key":"ref41","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1007\/s11042-010-0623-y","article-title":"Geotagging in multimedia and computer vision\u2014a survey","volume":"51","author":"Luo","year":"2011","journal-title":"Multimed. Tools Appl."},{"key":"ref42","volume-title":"The image of the City","author":"Lynch","year":"1964"},{"key":"ref43","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1016\/j.cities.2017.02.007","article-title":"Using locative social media and urban cartographies to identify and locate successful urban plazas","volume":"64","author":"Mart\u00ed","year":"2017","journal-title":"Cities"},{"key":"ref44","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1207\/S15427633SCC032&3_06","article-title":"Where\u2019s downtown?: behavioral methods for determining referents of vague spatial queries","volume":"3","author":"Montello","year":"2003","journal-title":"Spatial Cognition Computation"},{"key":"ref45","doi-asserted-by":"publisher","first-page":"483","DOI":"10.1111\/pirs.12652","article-title":"Quantifying walking capability: a novel aggregated index based on spatial perspective and analyses","volume":"101","author":"Motieyan","year":"2022","journal-title":"Pap. Reg. Sci."},{"key":"ref46","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1080\/01944369008975742","article-title":"The evaluative image of the City","volume":"56","author":"Nasar","year":"1990","journal-title":"J. Am. Plan. Assoc."},{"key":"ref47","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1910.10683","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer (no. arXiv:1910.10683)","author":"Raffel","year":"2023","journal-title":"arXiv"},{"key":"ref48","doi-asserted-by":"publisher","first-page":"779","DOI":"10.1109\/CVPR.2016.91","article-title":"You only look once: unified, real-time object detection","volume":"2016","author":"Redmon","year":"2016","journal-title":"IEEE Conf. Computer Vision Pattern Recognition"},{"key":"ref49","first-page":"234","volume-title":"U-Net: Convolutional Networks for Biomedical Image Segmentation. In N. Navab, J. Hornegger, W. M. Wells, & A. F. Frangi (Eds.), Medical Image Computing and Computer-Assisted Intervention - MICCAI 2015","author":"Ronneberger","year":"2015"},{"key":"ref50","doi-asserted-by":"publisher","first-page":"7115","DOI":"10.3390\/s20247115","article-title":"Human sentiment and activity recognition in disaster situations using social media images based on deep learning","volume":"20","author":"Sadiq","year":"2020","journal-title":"Sensors"},{"key":"ref51","author":"Sanh","year":"2019"},{"key":"ref52","doi-asserted-by":"publisher","first-page":"425","DOI":"10.3390\/analytics3040023","article-title":"Electric vehicle sentiment analysis using large language models","volume":"3","author":"Sharma","year":"2024","journal-title":"Analytics"},{"key":"ref53","doi-asserted-by":"publisher","first-page":"234","DOI":"10.1080\/14616680701422871","article-title":"Use of landscape perception methods in tourism studies: a review of photo-based research approaches","volume":"9","author":"Steen Jacobsen","year":"2007","journal-title":"Tour. Geogr."},{"key":"ref54","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1057\/palgrave.udi.9000166","article-title":"Connecting new urbanism and American planning: an historical interpretation","volume":"11","author":"Talen","year":"2006","journal-title":"Urban Des. Int."},{"key":"ref55","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1177\/0739456X0202200104","article-title":"Beyond relativism: reclaiming the search for Good City form","volume":"22","author":"Talen","year":"2002","journal-title":"J. Plan. Educ. Res."},{"key":"ref56","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1002\/9781119241072.ch5","article-title":"Scenic beauty","volume-title":"Environmental psychology","author":"Tveit","year":"2018"},{"key":"ref57","first-page":"85","volume-title":"Aesthetic and Affective Response to Natural Environment. In I. Altman & J. F. Wohlwill (Eds.), Behavior and the Natural Environment","author":"Ulrich","year":"1983"},{"key":"ref58","year":"2021"},{"key":"ref59","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1906.08237","article-title":"XLNet: generalized autoregressive Pretraining for language understanding (no. arXiv:1906.08237)","author":"Yang","year":"2020","journal-title":"arXiv"},{"key":"ref60","doi-asserted-by":"publisher","first-page":"Article 22","DOI":"10.3390\/su142215472","article-title":"Evaluating pedestrian environment using DeepLab models based on Street walkability in small and medium-sized cities: case study in Gaoping, China","volume":"14","author":"Zhang","year":"2022","journal-title":"Sustain. For."},{"key":"ref61","doi-asserted-by":"publisher","first-page":"6230","DOI":"10.1109\/CVPR.2017.660","article-title":"Pyramid scene parsing network","volume":"2017","author":"Zhao","year":"2017","journal-title":"IEEE Conf. Computer Vision Pattern Recognition"}],"container-title":["Frontiers in Computer Science"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2025.1504523\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,14]],"date-time":"2025-03-14T07:06:45Z","timestamp":1741936005000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2025.1504523\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,14]]},"references-count":61,"alternative-id":["10.3389\/fcomp.2025.1504523"],"URL":"https:\/\/doi.org\/10.3389\/fcomp.2025.1504523","relation":{},"ISSN":["2624-9898"],"issn-type":[{"value":"2624-9898","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,14]]},"article-number":"1504523"}}