{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,20]],"date-time":"2026-10-20T16:06:17Z","timestamp":1792512377695,"version":"4.5.0"},"reference-count":54,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Online reviews of health care services represent a growing source of unsolicited, citizen-generated data that can complement traditional instruments for monitoring public perception of health systems. However, longitudinal analyses examining how citizens\u2019 perceptions evolved before, during, and after the COVID-19 pandemic remain scarce, and existing studies have rarely differentiated between levels of care.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aimed to examine the longitudinal evolution of public perception of a regional public health system over a 10-year period, with particular attention to differences between primary care and hospital services, and to assess whether the COVID-19 pandemic produced a temporary disruption or a more persistent structural shift in citizens\u2019 evaluation of health care.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n A retrospective longitudinal observational study was conducted using 47,589 online reviews from 812 public health care facilities in Andalusia, Spain, collected from Google Maps between 2016 and 2025. Reviews were classified as positive or negative based on star ratings and validated against manual annotation using Cohen \u03ba. The proportion of negative reviews was analyzed across 3 periods: prepandemic (2016\u20102019), pandemic (2020\u20102022), and postpandemic (2023\u20102025). Structural breaks were identified through change-point detection analysis. Logistic regression models with robust standard errors clustered at the facility level were used to quantify differences in negative sentiment across levels of care and over time.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n The proportion of negative reviews increased from 38.7% (2598\/6713) in the prepandemic period to 73.7% (13,296\/18,046) during the pandemic, remaining elevated at 66.5% (15,181\/22,830) in the postpandemic period. Change-point detection identified March 2020 as a major structural break. The pandemic had markedly different effects across levels of care: negative reviews in primary care rose from 34.8% (1330\/3819) to 81.9% (10,138\/12,371) during the pandemic, remaining at 75.7% (9464\/12,505) postpandemic, whereas hospital care showed a more moderate increase from 43.8% (1268\/2894) to 55.6% (3158\/5675), remaining stable thereafter. Logistic regression models confirmed that the trajectory of negative perception in primary care diverged significantly from hospital care during and after the pandemic, with interaction terms indicating substantially higher odds of negative reviews in primary care during the pandemic (odds ratio 5.28, 95% CI 3.95\u20107.07) and postpandemic period (odds ratio 3.66, 95% CI 2.66\u20105.03).<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n The findings indicate that the COVID-19 pandemic was associated with a persistent structural shift in public perception of health care services rather than a temporary fluctuation and that this shift was disproportionately concentrated in primary care. The sustained deterioration in citizens\u2019 perception of primary care observed years after the acute crisis suggests that postpandemic recovery strategies should explicitly address the postcrisis phase and prioritize the relational and communicative dimensions of primary care alongside structural capacity. Large-scale digital trace data offer a scalable and continuous complement to traditional patient satisfaction instruments for monitoring health system legitimacy over time. These findings should be interpreted in light of the self-selection bias inherent to online reviews and the single-region scope of the analysis.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/96824","type":"journal-article","created":{"date-parts":[[2026,6,26]],"date-time":"2026-06-26T10:55:08Z","timestamp":1782471308000},"page":"e96824-e96824","source":"Crossref","is-referenced-by-count":1,"title":["Public Perception of Health Care Before, During, and After COVID-19: Longitudinal Analysis of Online Reviews"],"prefix":"10.2196","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-0437-0708","authenticated-orcid":false,"given":"Javier","family":"Gazquez-Garcia","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7033-5971","authenticated-orcid":false,"given":"Carlos Luis","family":"S\u00e1nchez-Bocanegra","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2819-5597","authenticated-orcid":false,"given":"Carlos","family":"Fernandez-Llatas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,8,12]]},"reference":[{"issue":"1","key":"R1","doi-asserted-by":"publisher","DOI":"10.2196\/66141","article-title":"Developing a framework for online review-based health care service quality assessment: text-mining study","volume":"27","author":"Zhang","journal-title":"J Med Internet Res"},{"key":"R2","doi-asserted-by":"publisher","DOI":"10.2196\/70410","article-title":"Perceived quality of service in primary health care based on Google Maps reviews before, during, and after the COVID-19 pandemic: sentiment analysis","volume":"27","author":"Aunimo","journal-title":"J Med Internet Res"},{"issue":"1","key":"R3","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1097\/HMR.0000000000000386","article-title":"Learning from patients: the impact of using patients\u2019 narratives on patient experience scores","volume":"49","author":"Nembhard","journal-title":"Health Care Manage Rev"},{"issue":"2","key":"R4","doi-asserted-by":"publisher","first-page":"13","DOI":"10.35680\/2372-0247.1943","article-title":"The perceived usefulness of patient narrative feedback in primary care settings","volume":"11","author":"Matta","journal-title":"Patient Exp J"},{"issue":"10","key":"R5","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0275045","article-title":"Health service improvement using positive patient feedback: systematic scoping review","volume":"18","author":"Lloyd","journal-title":"PLOS ONE"},{"issue":"11","key":"R6","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.2721","article-title":"Use of sentiment analysis for capturing patient experience from free-text comments posted online","volume":"15","author":"Greaves","journal-title":"J Med Internet Res"},{"issue":"7","key":"R7","doi-asserted-by":"publisher","DOI":"10.2196\/19064","article-title":"Using text mining techniques to identify health care providers with patient safety problems: exploratory study","volume":"23","author":"Hendrickx","journal-title":"J Med Internet Res"},{"issue":"6245","key":"R8","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1126\/science.aaa8685","article-title":"Advances in natural language processing","volume":"349","author":"Hirschberg","journal-title":"Science"},{"issue":"1","key":"R9","doi-asserted-by":"publisher","first-page":"214","DOI":"10.15265\/IY-2017-029","article-title":"Capturing the patient\u2019s perspective: a review of advances in natural language processing of health-related text","volume":"26","author":"Gonzalez-Hernandez","journal-title":"Yearb Med Inform"},{"issue":"1","key":"R10","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-022-01923-5","article-title":"Analyzing patient experiences using natural language processing: development and validation of the artificial intelligence patient reported experience measure (AI-PREM)","volume":"22","author":"van Buchem","journal-title":"BMC Med Inform Decis Mak"},{"issue":"1","key":"R11","doi-asserted-by":"publisher","DOI":"10.1136\/bmjhci-2020-100262","article-title":"Applying natural language processing and machine learning techniques to patient experience feedback: a systematic review","volume":"28","author":"Khanbhai","journal-title":"BMJ Health Care Inform"},{"issue":"1","key":"R12","doi-asserted-by":"publisher","DOI":"10.2196\/72853","article-title":"The use of natural language processing to interpret unstructured patient feedback on health services: scoping review","volume":"27","author":"Feizollah","journal-title":"J Med Internet Res"},{"key":"R13","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2025.1560089","article-title":"Trust, trust repair, and public health: a scoping review","volume":"13","author":"Kalulu","journal-title":"Front Public Health"},{"issue":"1","key":"R14","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2018-028061","article-title":"A study of the nature and level of trust between patients and healthcare providers, its dimensions and determinants: a scoping review protocol","volume":"10","author":"Rasiah","journal-title":"BMJ Open"},{"issue":"2","key":"R15","doi-asserted-by":"publisher","DOI":"10.1002\/emp2.12913","article-title":"A cross-sectional analysis of Yelp and Google reviews of hospitals in the United States","volume":"4","author":"Zitek","journal-title":"J Am Coll Emerg Physicians Open"},{"key":"R16","doi-asserted-by":"publisher","DOI":"10.2196\/69075","article-title":"Analyzing patient complaints in web-based reviews of private hospitals in Selangor, Malaysia, using large language model-assisted content analysis: mixed methods study","volume":"9","author":"Sulaiman","journal-title":"JMIR Form Res"},{"issue":"9","key":"R17","doi-asserted-by":"publisher","first-page":"e1454","DOI":"10.1016\/S2214-109X(23)00279-6","article-title":"Health system resilience: a critical review and reconceptualisation","volume":"11","author":"Witter","journal-title":"Lancet Glob Health"},{"issue":"1","key":"R18","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.33241","article-title":"The impact of COVID-19 on primary care: a scoping review","volume":"15","author":"Khalil-Khan","journal-title":"Cureus"},{"key":"R19","doi-asserted-by":"publisher","DOI":"10.2196\/49943","article-title":"Impact of COVID-19 on the pediatric primary care model in Catalonia: analysis of changes in the number and type of face-to-face and remote visits","volume":"7","author":"Castillo-Rodenas","journal-title":"JMIR Pediatr Parent"},{"key":"R20","doi-asserted-by":"publisher","DOI":"10.1016\/j.gaceta.2022.05.004","article-title":"Impact of the pandemic on primary care. SESPAS Report 2022 [Article in Spanish]","volume":"36","author":"Satu\u00e9 de Velasco","journal-title":"Gac Sanit"},{"issue":"1","key":"R21","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-023-28831-6","article-title":"Impact of the first wave of the COVID-19 pandemic on non-COVID inpatient care in southern Spain","volume":"13","author":"Gasch-Illescas","journal-title":"Sci Rep"},{"issue":"10","key":"R22","doi-asserted-by":"publisher","first-page":"1411","DOI":"10.3390\/healthcare11101411","article-title":"The relationship between internet patient satisfaction ratings and COVID-19 outcomes","volume":"11","author":"Stanley","journal-title":"Healthcare (Basel)"},{"issue":"1","key":"R23","doi-asserted-by":"publisher","first-page":"121","DOI":"10.35680\/2372-0247.1881","article-title":"Evaluation of online patient complaints regarding city hospitals in T\u00fcrkiye during the COVID-19 pandemic: a content analysis study","volume":"11","author":"\u00c7\u0131nar","journal-title":"Patient Exp J"},{"issue":"3","key":"R24","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2020-045343","article-title":"Impact of COVID-19 pandemic on utilisation of healthcare services: a systematic review","volume":"11","author":"Moynihan","journal-title":"BMJ Open"},{"issue":"1","key":"R25","doi-asserted-by":"publisher","DOI":"10.1186\/s12961-024-01114-w","article-title":"Concept analysis of health system resilience","volume":"22","author":"Al Asfoor","journal-title":"Health Res Policy Syst"},{"key":"R26","unstructured":"Shvetsova O . Institutional change in healthcare as brought about by the critical juncture of the COVID-19 pandemic. Binghamton University; 2025. URL: https:\/\/orb.binghamton.edu\/working_paper_series\/21 [Accessed 17-07-2026]"},{"issue":"9596","key":"R27","doi-asserted-by":"publisher","first-page":"1453","DOI":"10.1016\/S0140-6736(07)61602-X","article-title":"The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies","volume":"370","author":"von Elm","journal-title":"The Lancet"},{"key":"R28","unstructured":"Junta de Andaluc\u00eda. Consejer\u00eda de Salud y Familias. Decreto 8\/2020, de 30 de enero, por el que se regulan los \u00f3rganos de \u00e9tica asistencial y de la investigaci\u00f3n biom\u00e9dica en andaluc\u00eda [Article in Spanish]. Bolet\u00edn Oficial de la Junta de Andaluc\u00eda. Feb 2, 2020. URL: https:\/\/www.juntadeandalucia.es\/boja\/2020\/24\/3 [Accessed 28-07-2026]"},{"key":"R29","unstructured":"Ley 14\/2007, de 3 de julio, de investigaci\u00f3n biom\u00e9dica [Article in Spanish]. Agencia Estatal Bolet\u00edn Oficial del Estado. URL: https:\/\/www.boe.es\/buscar\/act.php?id=BOE-A-2007-12945 [Accessed 28-07-2026]"},{"key":"#cr-split#-R30.1","unstructured":"Regulation (EU) 2016\/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95\/46\/EC (General Data Protection Regulation) (Text with EEA relevance). European Union"},{"key":"#cr-split#-R30.2","unstructured":"May 4, 2016. URL: https:\/\/eur-lex.europa.eu\/eli\/reg\/2016\/679\/oj [Accessed 28-07-2026]"},{"key":"R31","unstructured":"Ley org\u00e1nica 3\/2018, de 5 de diciembre, de protecci\u00f3n de datos personales y garant\u00eda de los derechos digitales [Article in Spanish]. Agencia Estatal Bolet\u00edn Oficial del Estado. URL: https:\/\/www.boe.es\/buscar\/act.php?id=BOE-A-2018-16673 [Accessed 28-07-2026]"},{"issue":"5","key":"R32","first-page":"360","volume":"37","author":"Viera","journal-title":"Fam Med"},{"key":"R33","unstructured":"Statement on the fifteenth meeting of the IHR (2005) emergency committee on the COVID-19 pandemic. World Health Organization. URL: https:\/\/www.who.int\/news\/item\/05-05-2023-statement-on-the-fifteenth-meeting-of-the-international-health-regulations-(2005)-emergency-committee-regarding-the-coronavirus-disease-(covid-19)-pandemic [Accessed 22-05-2026]"},{"key":"R34","doi-asserted-by":"publisher","DOI":"10.12688\/wellcomeopenres.17834.1","article-title":"Conceptualising and assessing health system resilience to shocks: a cross-disciplinary view","volume":"7","author":"Ismail","journal-title":"Wellcome Open Res"},{"key":"R35","doi-asserted-by":"crossref","unstructured":"Capoccia G . Critical junctures and institutional change. In: Mahoney J Thelen K , editors. Advances in Comparative-Historical Analysis. Cambridge University Press; 2015:147-179. [doi: 10.1017\/CBO9781316273104.007]","DOI":"10.1017\/CBO9781316273104.007"},{"issue":"Issue 1","key":"R36","doi-asserted-by":"publisher","DOI":"10.34172\/ijhpm.2022.6659","article-title":"Re-evaluating our knowledge of health system resilience during COVID-19: lessons from the first two years of the pandemic","volume":"12","author":"Saulnier","journal-title":"Int J Health Policy Manag"},{"issue":"6","key":"R37","doi-asserted-by":"publisher","DOI":"10.1136\/bmjgh-2024-017358","article-title":"Health systems governance, shocks and resilience: a scoping review of key concepts and theories","volume":"10","author":"Belloni","journal-title":"BMJ Glob Health"},{"issue":"21","key":"R38","doi-asserted-by":"publisher","DOI":"10.3390\/ijerph192114150","article-title":"Let us take it into our own hands: patient experience during the COVID-19 pandemic","volume":"19","author":"Bar\u00e1nkov\u00e1","journal-title":"Int J Environ Res Public Health"},{"key":"R39","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2023.1152054","article-title":"Thinking beyond the virus: perspective of patients on the quality of hospital care before and during the COVID-19 pandemic","volume":"11","author":"Wong","journal-title":"Front Public Health"},{"key":"R40","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.o2665","article-title":"Primary care in Spain: underfunded, understaffed, and neglected","volume":"379","author":"Garc\u00eda Rada","journal-title":"BMJ"},{"issue":"1","key":"R41","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2296-11-81","article-title":"The European primary care monitor: structure, process and outcome indicators","volume":"11","author":"Kringos","journal-title":"BMC Fam Pract"},{"issue":"2","key":"R42","doi-asserted-by":"publisher","DOI":"10.1016\/j.aprim.2023.102792","article-title":"Assessing patient satisfaction with telephone-based consultations before, during and after the COVID-19 pandemic in Spain","volume":"56","author":"Iguacel","journal-title":"Aten Primaria"},{"issue":"2","key":"R43","doi-asserted-by":"publisher","first-page":"69","DOI":"10.26441\/RC21.2-2022-A4","article-title":"Impacto de la COVID-19 en la comunicaci\u00f3n de los hospitales en Espa\u00f1a. Adaptaciones y evaluaci\u00f3n de sus profesionales [Article in Spanish]","volume":"21","author":"Costa-S\u00e1nchez","journal-title":"Revista de Comunicaci\u00f3n"},{"issue":"7","key":"R44","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2024-090248","article-title":"From unconditionality to disenchantment among primary healthcare professionals during the COVID-19 pandemic: a qualitative study from Madrid, Spain","volume":"15","author":"Cura-Gonzalez","journal-title":"BMJ Open"},{"issue":"7391","key":"R45","doi-asserted-by":"publisher","first-page":"692","DOI":"10.1136\/bmj.326.7391.692","article-title":"Primary care in the United States: primary care gatekeeping and referrals: effective filter or failed experiment?","volume":"326","author":"Forrest","journal-title":"BMJ"},{"key":"R46","unstructured":"Does healthcare deliver?: Results from the patient-reported indicator surveys (PaRIS). OECD; 2025. URL: https:\/\/www.oecd.org\/en\/publications\/does-healthcare-deliver_c8af05a5-en\/full-report\/building-trustworthy-21st-century-healthcare-systems_2139da94.html [Accessed 22-05-2026]"},{"key":"R47","doi-asserted-by":"publisher","DOI":"10.34172\/ijhpm.2024.8410","article-title":"Placing trust at the heart of health policy and systems","volume":"13","author":"McKee","journal-title":"Int J Health Policy Manag"},{"key":"R48","doi-asserted-by":"publisher","DOI":"10.2147\/RMHP.S471250","article-title":"Trust building in public health approaches: the importance of a \u201cpeople-centered\u201d concept in crisis response","volume":"17","author":"Correia","journal-title":"Risk Manag Healthc Policy"},{"issue":"2","key":"R49","doi-asserted-by":"publisher","DOI":"10.3390\/ijerph20021600","article-title":"Primary and community care transformation in post-COVID era: nationwide general practitioner survey","volume":"20","author":"Solanes-Cab\u00fas","journal-title":"Int J Environ Res Public Health"},{"issue":"4","key":"R50","doi-asserted-by":"publisher","first-page":"697","DOI":"10.1377\/hlthaff.2015.1030","article-title":"Yelp reviews of hospital care can supplement and inform traditional surveys of the patient experience of care","volume":"35","author":"Ranard","journal-title":"Health Aff (Millwood)"},{"issue":"2","key":"R51","doi-asserted-by":"publisher","first-page":"449","DOI":"10.25300\/MISQ\/2017\/41.2.06","article-title":"On self-selection biases in online product reviews","volume":"41","author":"Hu","journal-title":"MIS Q"},{"key":"R52","doi-asserted-by":"crossref","unstructured":"Gazquez-Garcia J S\u00e1nchez-Bocanegra CL Fernandez-Llatas C . Public perception of health care before, during, and after COVID-19: a longitudinal analysis of online reviews (preprint). J Med Internet Res. Preprint posted online on Apr 1, 2026. [doi: 10.2196\/preprints.96824]","DOI":"10.2196\/preprints.96824"},{"key":"R53","unstructured":"Javiergazq\/online-reviews-health-system-covid. GitHub. URL: https:\/\/github.com\/javiergazq\/online-reviews-health-system-covid [Accessed 20-07-2026]"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","deposited":{"date-parts":[[2026,8,12]],"date-time":"2026-08-12T19:42:07Z","timestamp":1786563727000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jmir.org\/2026\/1\/e96824"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,12]]},"references-count":54,"URL":"https:\/\/doi.org\/10.2196\/96824","relation":{},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,12]]},"article-number":"v28i1e96824"}}