{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T19:02:06Z","timestamp":1790017326981,"version":"4.0.1"},"reference-count":32,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Public Health Surveill"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec sec-type=\"background\">\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Mobile exposure notification apps (ENAs) can play a significant role in future pandemics. Identifying lessons learned and areas for improvement from such apps, particularly within specific social and cultural contexts, is therefore crucial.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"objective\">\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>This study aimed to evaluate the Finnish ENA \u201cKoronavilkku,\u201d according to chosen key performance indicators to assess the ENA\u2019s use and performance during the COVID-19 pandemic in Finland, and to identify strengths and improvement areas.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"methods\">\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Using available data on Finland\u2019s ENA, we defined metrics for four key performance indicators: ENA use extent, enablers and barriers to use, the ENA\u2019s influence on user behavior, and overall acceptability. We performed an evaluation study combining system data and data from a survey of 4061 respondents conducted in April 2022. A sentiment analysis was performed on open-ended responses.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"results\">\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Koronavilkku ENA peak coverage reached approximately 53% of active smartphone users shortly after launch. Use declined over time, particularly among individuals diagnosed with COVID-19. User engagement remained high\u2014among ENA users who received a token, the proportion that entered their token into the ENA was more than 50% during the whole study period. Males, individuals older than 34 years, and those living alone were less likely to use the ENA, while those with higher education and households with children were more likely to be ENA users. Almost 70% (64,642\/94,280) of SARS-CoV-2\u2013positive users reported not receiving a token from health authorities. Users reported higher adherence to pandemic guidance than nonusers, with prevalence ratios ranging from 1.24 (95% CI 1.19\u20101.29) to 1.65 (95% CI 1.45\u20101.91). Descriptive analyses suggested higher reported adherence among partially compliant users after exposure notifications, whereas little change was observed among noncompliant individuals. Overall acceptability was relatively high, with 68% of respondents using it at least once. However, 49% of those users eventually discontinued use. Our sentiment analysis of open-ended feedback suggests that users expressed more positive attitudes toward the ENA compared to nonusers. However, a substantial portion of the feedback reflected neutral or negative sentiments.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"conclusions\">\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Based on observed ENA use trends, we recommend maintaining long-term public interest and engagement in ENAs during prolonged emergencies. Tailored communication should be developed encouraging uptake among demographic groups with lower adoption rates. Initial studies during app rollout could inform these strategies. A major barrier to the ENA\u2019s performance was token issuance; earlier and more systematic automation of token distribution in Finland could have enabled more timely exposure notifications and reduced bottlenecks. Future ENAs should define evaluation criteria during development, with periodic assessments measuring effectiveness and informing improvements. A deeper analysis of open-ended feedback provided for the Koronavilkku ENA using advanced language models could provide additional insights into user perceptions and concerns. By addressing these areas, future digital contact tracing tools may improve uptake, acceptability, and integration into pandemic response efforts.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2196\/89472","type":"journal-article","created":{"date-parts":[[2026,7,13]],"date-time":"2026-07-13T03:10:07Z","timestamp":1783912207000},"page":"e89472-e89472","source":"Crossref","is-referenced-by-count":0,"title":["Evaluation of the Finnish Exposure Notification App \u201cKoronavilkku\u201d According to Key Performance Indicators: Cross-Sectional Study"],"prefix":"10.2196","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5367-8403","authenticated-orcid":false,"given":"Wioleta","family":"Kitowska","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1779-5941","authenticated-orcid":false,"given":"Mika","family":"Pihlajam\u00e4ki","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3909-5137","authenticated-orcid":false,"given":"Sara","family":"Wickstr\u00f6m","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1556-0169","authenticated-orcid":false,"given":"Kaija","family":"Tolmunen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6254-3180","authenticated-orcid":false,"given":"Otto","family":"Helve","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-8369-6552","authenticated-orcid":false,"given":"Juha","family":"Mykk\u00e4nen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1819-518X","authenticated-orcid":false,"given":"Timoth\u00e9e","family":"Dub","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0330-7396","authenticated-orcid":false,"given":"Lotta","family":"Siira","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,9,21]]},"reference":[{"key":"R1","unstructured":"COVID-19 cases in the infectious diseases registry. The National Institute for Health and Welfare (THL). URL: https:\/\/sampo.thl.fi\/pivot\/prod\/en\/epirapo\/covid19case\/fact_epirapo_covid19case [Accessed 04-09-2025]"},{"key":"R2","unstructured":"Press releases on the government\u2019s decisions. Finnish Government. URL: https:\/\/valtioneuvosto.fi\/en\/decisions\/press-releases [Accessed 04-09-2025]"},{"issue":"4","key":"R3","doi-asserted-by":"publisher","first-page":"649","DOI":"10.1016\/j.hlpt.2020.08.005","article-title":"COVID-19 pandemic in Finland - preliminary analysis on health system response and economic consequences","volume":"9","author":"Tiirinki","journal-title":"Health Policy Technol"},{"key":"R4","doi-asserted-by":"publisher","DOI":"10.2196\/46563","article-title":"Implementing and maintaining a SARS-CoV-2 exposure notification application for mobile phones: the Finnish experience","volume":"9","author":"Pihlajam\u00e4ki","journal-title":"JMIR Public Health Surveill"},{"issue":"7863","key":"R5","doi-asserted-by":"publisher","first-page":"408","DOI":"10.1038\/s41586-021-03606-z","article-title":"The epidemiological impact of the NHS COVID-19 app","volume":"594","author":"Wymant","journal-title":"Nature"},{"issue":"1","key":"R6","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-021-00422-7","article-title":"Modeling the effect of exposure notification and non-pharmaceutical interventions on COVID-19 transmission in Washington state","volume":"4","author":"Abueg","journal-title":"NPJ Digit Med"},{"issue":"20","key":"R7","doi-asserted-by":"publisher","first-page":"7113","DOI":"10.3390\/app10207113","article-title":"Evaluating the effectiveness of COVID-19 bluetooth-based smartphone contact tracing applications","volume":"10","author":"Hern\u00e1ndez-Orallo","journal-title":"Appl Sci"},{"key":"R8","unstructured":"Hinch R Probert W Nurtay A et al. Effective configurations of a digital contact tracing app: a report to NHSX. London: NHSX; 2020. URL: https:\/\/api.semanticscholar.org\/CorpusID:216028666 [Accessed 17-08-2026]"},{"issue":"1","key":"R9","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-83540-2","article-title":"Extensions of the SEIR model for the analysis of tailored social distancing and tracing approaches to cope with COVID-19","volume":"11","author":"Grimm","journal-title":"Sci Rep"},{"issue":"7","key":"R10","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2021-050519","article-title":"Effectiveness of contact tracing apps for SARS-CoV-2: a rapid systematic review","volume":"11","author":"Jenniskens","journal-title":"BMJ Open"},{"key":"R11","doi-asserted-by":"publisher","DOI":"10.1016\/j.puhe.2025.02.019","article-title":"Effectiveness of digital contact tracing interventions for COVID-19: a systematic scoping review","volume":"242","author":"Quach","journal-title":"Public Health"},{"issue":"7","key":"R12","doi-asserted-by":"publisher","DOI":"10.2196\/27768","article-title":"Early acceptability of a mobile app for contact tracing during the COVID-19 pandemic in France: national web-based survey","volume":"9","author":"Touzani","journal-title":"JMIR Mhealth Uhealth"},{"issue":"9","key":"R13","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0256660","article-title":"Sociodemographic characteristics determine download and use of a Corona contact tracing app in Germany-Results of the COSMO surveys","volume":"16","author":"Grill","journal-title":"PLoS ONE"},{"issue":"3","key":"R14","doi-asserted-by":"publisher","DOI":"10.2196\/23362","article-title":"Barriers to the large-scale adoption of a COVID-19 contact tracing app in Germany: survey study","volume":"23","author":"Blom","journal-title":"J Med Internet Res"},{"issue":"1","key":"R15","doi-asserted-by":"publisher","DOI":"10.2196\/22113","article-title":"Reasons for nonuse, discontinuation of use, and acceptance of additional functionalities of a COVID-19 contact tracing App: cross-sectional survey study","volume":"8","author":"Walrave","journal-title":"JMIR Public Health Surveill"},{"key":"R16","doi-asserted-by":"publisher","DOI":"10.3389\/ijph.2021.1603992","article-title":"Adherence and association of digital proximity tracing app notifications with earlier time to quarantine: results from the Zurich SARS-CoV-2 cohort study","volume":"66","author":"Ballouz","journal-title":"Int J Public Health"},{"issue":"1","key":"R17","doi-asserted-by":"publisher","DOI":"10.1186\/s12889-023-17150-0","article-title":"Use of a digital contact tracing system in Singapore to mitigate COVID-19 spread","volume":"23","author":"Chow","journal-title":"BMC Public Health"},{"key":"R18","unstructured":"Koronavilkku-kokonaisuuden viikkoraportti [Web page in Finnish]. Finnish Institute for Health and Welfare (THL). URL: https:\/\/www.thl.fi\/episeuranta\/vilkku\/koronavilkku_viikkoraportti.html [Accessed 07-05-2026]"},{"key":"R19","unstructured":"European Commission, Directorate-General for Communications Networks, Content and Technology Digital Contact Tracing Study \u2013 Study on Lessons Learned, Best Practices and Epidemiological Impact of the Common European Approach on Digital Contact Tracing to Combat and Exit the COVID-19 Pandemic. Publications Office of the European Union; 2022. [doi: 10.2759\/146050]"},{"issue":"6491","key":"R20","doi-asserted-by":"publisher","DOI":"10.1126\/science.abb6936","article-title":"Quantifying SARS-CoV-2 transmission suggests epidemic control with digital contact tracing","volume":"368","author":"Ferretti","journal-title":"Science"},{"issue":"3","key":"R21","doi-asserted-by":"publisher","DOI":"10.2196\/26399","article-title":"Health care students\u2019 knowledge of and attitudes, beliefs, and practices toward the French COVID-19 App: cross-sectional questionnaire study","volume":"23","author":"Montagni","journal-title":"J Med Internet Res"},{"issue":"9","key":"R22","doi-asserted-by":"publisher","DOI":"10.2196\/29085","article-title":"Public adoption of and trust in the NHS COVID-19 contact tracing app in the United Kingdom: quantitative online survey study","volume":"23","author":"Dowthwaite","journal-title":"J Med Internet Res"},{"key":"R23","unstructured":"Communicable diseases act [Web page in Finnish]. Finlex. 2016. URL: https:\/\/www.finlex.fi\/en\/legislation\/2016\/1227?language=fin&highlightId=1156046&highlightParams=%7B%22type%22%3A%22BASIC%22%2C%22search%22%3A%221227%2F2016%22%7D [Accessed 23-08-2026]"},{"key":"R24","unstructured":"Government resolution VM\/2021\/205 [Webpage in Finnish]. Ministry of Finance Finland. 2021. URL: https:\/\/vm.fi\/paatos?decisionId=0900908f80778508 [Accessed 10-08-2025]"},{"issue":"3","key":"R25","doi-asserted-by":"publisher","DOI":"10.2196\/27882","article-title":"The Dutch COVID-19 contact tracing app (the CoronaMelder): usability study","volume":"5","author":"Bente","journal-title":"JMIR Form Res"},{"issue":"1","key":"R26","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-98249-5","article-title":"Psychological factors shaping public responses to COVID-19 digital contact tracing technologies in Germany","volume":"11","author":"Kozyreva","journal-title":"Sci Rep"},{"issue":"5","key":"R27","doi-asserted-by":"publisher","first-page":"425","DOI":"10.1002\/ejsp.2420220502","article-title":"Positive\u2010negative asymmetry or \u2018When the heart needs a reason\u2019","volume":"22","author":"Lewicka","journal-title":"Euro J Social Psych"},{"issue":"3","key":"R28","doi-asserted-by":"publisher","first-page":"614","DOI":"10.1177\/1094428106295504","article-title":"A comment on employee surveys: negativity bias in open-ended responses","volume":"11","author":"Poncheri","journal-title":"Organ Res Methods"},{"issue":"5","key":"R29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.29115\/SP-2014-0024","article-title":"Open-ended survey questions: item nonresponse nightmare or qualitative data dream?","volume":"7","author":"Miller","journal-title":"Surv Pract"},{"issue":"1","key":"R30","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1007\/s11845-021-02529-y","article-title":"Sentiment analysis of user feedback on the HSE\u2019s Covid-19 contact tracing app","volume":"191","author":"Rekanar","journal-title":"Ir J Med Sci"},{"key":"R31","unstructured":"THL has updated its instructions regarding coronavirus testing [Web page in Finnish]. Finnish National Institute for Health and Welfare THL. URL: https:\/\/www.sttinfo.fi\/tiedote\/69928530\/thl-on-paivittanyt-koronavirustestaukseen-liittyvia-ohjeitaan?publisherId=69817778 [Accessed 23-08-2026]"},{"key":"R32","unstructured":"Mild coronavirus symptoms usually do not require testing \u2013 avoid contact for five days and follow regional guidelines [Web page in Finnish]. Finnish National Institute for Health and Welfare THL. URL: https:\/\/www.sttinfo.fi\/tiedote\/69929563\/lievien-koronavirusoireiden-takia-ei-yleensa-tarvitse-kayda-testissa-valta-kontakteja-viiden-paivan-ajan-ja-noudata-alueellisia-ohjeita?publisherId=69817778 [Accessed 23-08-2026]"}],"container-title":["JMIR Public Health and Surveillance"],"original-title":[],"language":"en","deposited":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T18:22:56Z","timestamp":1790014976000},"score":1,"resource":{"primary":{"URL":"https:\/\/publichealth.jmir.org\/2026\/1\/e89472"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,21]]},"references-count":32,"URL":"https:\/\/doi.org\/10.2196\/89472","relation":{},"ISSN":["2369-2960"],"issn-type":[{"value":"2369-2960","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,21]]},"article-number":"v12i4e89472"}}