{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,4]],"date-time":"2026-08-04T14:49:39Z","timestamp":1785854979641,"version":"3.56.0"},"reference-count":62,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"\n Background<\/jats:title>\n The COVID-19 pandemic continues to hold an important place in the collective memory as of 2024. As of March 2024, >676 million cases, 6 million deaths, and 13 billion vaccine doses have been reported. It is crucial to evaluate sociopsychological impacts as well as public health indicators such as these to understand the effects of the COVID-19 pandemic.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aimed to explore the sentiments of residents of major US cities toward restrictions on social activities in 2022 during the transitional phase of the COVID-19 pandemic, from the peak of the pandemic to its gradual decline. By illuminating people\u2019s susceptibility to COVID-19, we provide insights into the general sentiment trends during the recovery phase of the pandemic.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n To analyze these trends, we collected posts (N=119,437) on the social media platform Twitter (now X) created by people living in New York City, Los Angeles, and Chicago from December 2021 to December 2022, which were impacted by the COVID-19 pandemic in similar ways. A total of 47,111 unique users authored these posts. In addition, for privacy considerations, any identifiable information, such as author IDs and usernames, was excluded, retaining only the text for analysis. Then, we developed a sentiment estimation model by fine-tuning a large language model on the collected data and used it to analyze how citizens\u2019 sentiments evolved throughout the pandemic.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n In the evaluation of models, GPT-3.5 Turbo with fine-tuning outperformed GPT-3.5 Turbo without fine-tuning and Robustly Optimized Bidirectional Encoder Representations from Transformers Pretraining Approach (RoBERTa)\u2013large with fine-tuning, demonstrating significant accuracy (0.80), recall (0.79), precision (0.79), and F1-score (0.79). The findings using GPT-3.5 Turbo with fine-tuning reveal a significant relationship between sentiment levels and actual cases in all 3 cities. Specifically, the correlation coefficient for New York City is 0.89 (95% CI 0.81-0.93), for Los Angeles is 0.39 (95% CI 0.14-0.60), and for Chicago is 0.65 (95% CI 0.47-0.78). Furthermore, feature words analysis showed that COVID-19\u2013related keywords were replaced with non\u2013COVID-19-related keywords in New York City and Los Angeles from January 2022 onward and Chicago from March 2022 onward.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n The results show a gradual decline in sentiment and interest in restrictions across all 3 cities as the pandemic approached its conclusion. These results are also ensured by a sentiment estimation model fine-tuned on actual Twitter posts. This study represents the first attempt from a macro perspective to depict sentiment using a classification model created with actual data from the period when COVID-19 was prevalent. This approach can be applied to the spread of other infectious diseases by adjusting search keywords for observational data.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/63824","type":"journal-article","created":{"date-parts":[[2024,12,24]],"date-time":"2024-12-24T03:46:51Z","timestamp":1735012011000},"page":"e63824","source":"Crossref","is-referenced-by-count":4,"title":["Understanding Citizens\u2019 Response to Social Activities on Twitter in US Metropolises During the COVID-19 Recovery Phase Using a Fine-Tuned Large Language Model: Application of AI"],"prefix":"10.2196","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0940-3570","authenticated-orcid":false,"given":"Ryuichi","family":"Saito","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7837-2857","authenticated-orcid":false,"given":"Sho","family":"Tsugawa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2025,2,11]]},"reference":[{"key":"ref1","unstructured":"Coronavirus disease (COVID-19) pandemicWorld Health Organization2024-06-30https:\/\/www.who.int\/europe\/emergencies\/situations\/covid-19"},{"key":"ref2","unstructured":"Statement on the fifteenth meeting of the IHR (2005) emergency committee on the COVID-19 pandemicWorld Health Organization2024-06-30https:\/\/tinyurl.com\/mr3c9854"},{"key":"ref3","unstructured":"COVID-19 mapJohns Hopkins Coronavirus Resource Center2024-06-30https:\/\/coronavirus.jhu.edu\/map.html"},{"key":"ref4","doi-asserted-by":"publisher","DOI":"10.1007\/S00521-023-08788-3"},{"key":"ref5","doi-asserted-by":"publisher","DOI":"10.1093\/poq\/nfl033"},{"key":"ref6","doi-asserted-by":"publisher","DOI":"10.1177\/20563051221084950"},{"key":"ref7","doi-asserted-by":"publisher","DOI":"10.1177\/14614448211058850"},{"key":"ref8","doi-asserted-by":"publisher","DOI":"10.1177\/14614448231187529"},{"key":"ref9","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-022-01312-y"},{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.3390\/ijerph17062032"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.1177\/20563051211048413"},{"key":"ref12","doi-asserted-by":"publisher","DOI":"10.2196\/30854"},{"key":"ref13","doi-asserted-by":"publisher","DOI":"10.2196\/40408"},{"key":"ref14","doi-asserted-by":"publisher","DOI":"10.2196\/37466"},{"key":"ref15","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0246548"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.1007\/s42001-022-00186-4"},{"key":"ref17","unstructured":"AnthesEA C.D.C. airport surveillance program found the earliest known U.S. cases of Omicron subvariantsThe New York Times2024-04-29https:\/\/www.nytimes.com\/2022\/03\/24\/health\/cdc-us-ba2.html"},{"key":"ref18","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/7503.003.0022"},{"key":"ref19","doi-asserted-by":"publisher","DOI":"10.1007\/S10462-022-10144-1"},{"key":"ref20","doi-asserted-by":"publisher","DOI":"10.1017\/dap.2021.38"},{"key":"ref21","doi-asserted-by":"publisher","DOI":"10.1177\/2056305119865465"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2021.2020323"},{"key":"ref23","first-page":"5998","volume":"30","author":"Vaswani, A","year":"2017","journal-title":"Adv Neural Inf Process Syst"},{"key":"ref24","unstructured":"RadfordANarasimhanKSalimansTSutskeverIImproving language understanding by generative pre-trainingOpenAI CDN20182024-04-29https:\/\/cdn.openai.com\/research-covers\/language-unsupervised\/language_understanding_paper.pdf"},{"key":"ref25","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.naacl-short"},{"key":"ref26","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-023-08662-2"},{"key":"ref27","doi-asserted-by":"publisher","DOI":"10.2196\/26618"},{"key":"ref28","author":"Brown, TB","journal-title":"arXiv"},{"key":"ref29","unstructured":"OpenAI platformOpenAI2024-06-30https:\/\/platform.openai.com\/docs\/models\/gpt-3-5-turbo"},{"key":"ref30","doi-asserted-by":"publisher","DOI":"10.1093\/pubmed\/fdab057"},{"key":"ref31","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0266602"},{"key":"ref32","doi-asserted-by":"publisher","DOI":"10.1111\/jrh.12556"},{"key":"ref33","unstructured":"RyuichiSaito1 \/COVID 19-Twitter-USA-restoringGitHub Repository2024-04-29https:\/\/github.com\/RyuichiSaito1\/covid19-twitter-usa-restoring\/"},{"key":"ref34","unstructured":"City and town population totals: 2020-2023US Census Bureau2024-06-30https:\/\/www.census.gov\/data\/tables\/time-series\/demo\/popest\/2020s-total-cities-and-towns.html"},{"key":"ref35","unstructured":"Twitter APIX Developer Platform2024-04-29https:\/\/developer.x.com\/en\/docs\/x-api"},{"key":"ref36","unstructured":"JurafskyDMartinJHSpeech and language processingStanford University2024-06-30https:\/\/web.stanford.edu\/~jurafsky\/slp3\/"},{"key":"ref37","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.5870"},{"key":"ref38","author":"Liu, Y","journal-title":"arXiv"},{"key":"ref39","unstructured":"COVID-19-data: a repository of data on coronavirus cases and deaths in the U.SGitHub2024-06-30https:\/\/github.com\/nytimes\/covid-19-data"},{"key":"ref40","doi-asserted-by":"publisher","DOI":"10.1016\/j.chaos.2021.110718"},{"key":"ref41","unstructured":"Omicron is spreading fast. Can New York do more to slow it down?The New York Times2024-02-11https:\/\/www.nytimes.com\/2021\/12\/22\/nyregion\/omicron-nyc-spread.html"},{"key":"ref42","unstructured":"As yet another wave of COVID looms, New Yorkers ask: should i worry?The New York Times2024-02-11https:\/\/www.nytimes.com\/2022\/04\/07\/nyregion\/omicron-variant-ba2.html"},{"key":"ref43","unstructured":"Health experts warily eye XBB.1.5, the latest Omicron subvariantThe New York Times2024-02-11https:\/\/www.nytimes.com\/2023\/01\/07\/science\/covid-omicron-variants-xbb.html"},{"key":"ref44","unstructured":"Mayor de Blasio announces vaccine mandate for private-sector workers, and major expansions to nation-leading \u201ckey to NYC\u201d programThe City of New York2024-02-11https:\/\/www.nyc.gov\/office-of-the-mayor\/news\/807-21\/mayor-de-blasio-vaccine-mandate-private-sector-workers-major-expansions-to"},{"key":"ref45","unstructured":"Health officials urge New Yorkers to wear masks again and visit test to treat clinics as COVID cases riseCBS Broadcasting2024-02-11https:\/\/www.cbsnews.com\/newyork\/news\/health-officials-urge-new-yorkers-to-wear-masks-again-as-covid-cases-rise-test-to-treat\/"},{"key":"ref46","unstructured":"Coronavirus cases soaring in L.A. countyLos Angeles Times2024-02-11https:\/\/www.latimes.com\/california\/story\/2021-12-23\/coronavirus-cases-soaring-in-l-a-county"},{"key":"ref47","unstructured":"California could see coronavirus uptick with BA.2 subvariantLos Angeles Times2024-02-11https:\/\/www.latimes.com\/california\/story\/2022-03-29\/spring-omicron-ba-2-wave-is-likely-but-how-big-will-it-be"},{"key":"ref48","unstructured":"Stunning spread of BA.5 shows why this California COVID wave is so differentLos Angeles Times2024-02-12https:\/\/www.latimes.com\/california\/story\/2022-07-12\/omicron-ba5-coronaviru"},{"key":"ref49","unstructured":"The XBB.1.5 variant is taking over on the East Coast. Will it happen in California too?Los Angeles Times2024-02-12https:\/\/www.latimes.com\/science\/story\/2023-01-05\/xbb-1-5-variant-is-taking-over-the-east-coast-will-it-happen-in-california"},{"key":"ref50","unstructured":"CDPH requires masking for all public indoor settings to slow the spread of COVID-19 in response to increasing case rates and hospitalizationCalifornia Department of Public Health2024-02-12https:\/\/www.cdph.ca.gov\/Programs\/OPA\/pages\/nr21-352.aspx"},{"key":"ref51","unstructured":"State public health officer order of March 3, 2023California Department of Public Health2024-02-12https:\/\/www.cdph.ca.gov\/Programs\/CID\/DCDC\/pages\/covid-19\/order-of-the-state-public-health-officer-health-care-worker-vaccine-requirement.aspx"},{"key":"ref52","unstructured":"Omicron creates \u2018fifth wave\u2019 Of COVID-19 in Chicago, with officials urging people to get tested before holidaysBlock Club Chicago2024-02-12https:\/\/blockclubchicago.org\/2021\/12\/22\/omicron-creates-fifth-wave-of-covid-19-in-chicago-with-officials-urging-people-to-get-tested-before-holidays\/"},{"key":"ref53","unstructured":"Sub-lineages of Omicron in ChicagoChicago Department of Public Health2024-02-12https:\/\/www.chicago.gov\/content\/dam\/city\/sites\/covid\/reports\/2022\/Omicron_sub-lineages_Data_Brief_May-2022.pdf"},{"key":"ref54","unstructured":"\u2018The virus not done with us yet': health officials warn of reinfection as BA.5 variant spreadsABC Eyewitness News2024-02-12https:\/\/abc7chicago.com\/covid-19-ba5-variant\/12049925\/"},{"key":"ref55","unstructured":"Illinois indoor masking requirement to end Monday, February 28, 2022State of Illinois Government2024-02-12https:\/\/www.illinois.gov\/news\/press-release.24545.html"},{"key":"ref56","unstructured":"Public health order no. 2021-2 - proof of vaccination in public places (fourth amended and re-issued)City of Chicago Government2024-02-12https:\/\/www.chicago.gov\/city\/en\/sites\/covid-19\/home\/health-orders.html"},{"key":"ref57","doi-asserted-by":"publisher","DOI":"10.15585\/mmwr.mm7232a3"},{"key":"ref58","unstructured":"U.S. social network users 2023, by age groupStatista2024-06-30https:\/\/www.statista.com\/statistics\/1337525\/us-distribution-leading-social-media-platforms-by-age-group\/"},{"key":"ref59","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-58347-1_10"},{"key":"ref60","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.eacl-main.7"},{"key":"ref61","doi-asserted-by":"publisher","DOI":"10.1016\/j.cities.2022.104054"},{"key":"ref62","unstructured":"X\/Twitter user distribution by gender in the U.SStatista2024-06-30https:\/\/www.statista.com\/statistics\/678794\/united-states-twitter-gender-distribution\/"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jmir.org\/2025\/1\/e63824","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,4]],"date-time":"2026-08-04T13:56:38Z","timestamp":1785851798000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jmir.org\/2025\/1\/e63824"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,11]]},"references-count":62,"URL":"https:\/\/doi.org\/10.2196\/63824","relation":{},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,11]]}}}