{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T06:03:48Z","timestamp":1792735428723,"version":"4.5.0"},"reference-count":39,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,1,21]],"date-time":"2025-01-21T00:00:00Z","timestamp":1737417600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,1,21]],"date-time":"2025-01-21T00:00:00Z","timestamp":1737417600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Background<\/jats:title>\n            <jats:p>The NHS App launched in 2019 as the \u2018digital front door\u2019 to the National Health Service in England with core features including General Practitioner (GP) appointment booking, repeat prescriptions, patient access to records and, later on, COVID-19 vaccination certification. Similar patient portals have been adopted in different formats and with variable levels of success. In this longitudinal study (2021\u20132023) we examined how the NHS App became implemented in the pandemic context and beyond.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Methods<\/jats:title>\n            <jats:p>We recruited 88 participants in 62 qualitative interviews and four focus groups. Participants included patients, carers, members of the public, clinical\/non-clinical NHS staff from five GP practices (where we also conducted over 60\u00a0h of observations) across England, as well as other industry, policy and civil rights stakeholders. Document analysis also contributed to participant recruitment and data interpretation. Data collection and analysis was informed by the Non-Adoption, Abandonment, Scale-up, Spread and Sustainability (NASSS) framework.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>Our study identified the various ways in which complexity manifested as part of the implementation, use and roll-out of the NHS App. Patients had diverse (positive and negative) user experiences as the app evolved, with some of its features described as more useful than others (e.g. prescription ordering, COVID Pass). As the app primarily provided a gateway to general practice systems and infrastructures, not all features were available by default or consistently to all users, with information often appearing fragmented or system-facing (e.g. coded). NHS staff viewed the app as constituting core NHS infrastructure in the long term which made it appealing, even though initially there was less recognition of its immediate value. There was variable organisational capacity to enable implementation and to put in place processes and staff roles required to support patient adoption. Shifting emphasis towards in-person care, challenges with digital inclusion and controversies related to features such as patient access to own records further complicated roll-out.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusions<\/jats:title>\n            <jats:p>As the NHS App remains a complex innovation in a shifting landscape, it is clear ongoing work is needed to ensure its potential can be sustained to meet patient, service and policy needs.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Clinical study registration<\/jats:title>\n            <jats:p>ISRCTN72729780.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1186\/s12916-024-03842-w","type":"journal-article","created":{"date-parts":[[2025,1,21]],"date-time":"2025-01-21T14:16:41Z","timestamp":1737469001000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Qualitative evaluation of the implementation and national roll-out of the NHS App in England"],"prefix":"10.1186","volume":"23","author":[{"given":"Claire","family":"Reidy","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chrysanthi","family":"Papoutsi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sukriti","family":"KC","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bernard","family":"Gudgin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anthony A.","family":"Laverty","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Felix","family":"Greaves","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John","family":"Powell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,1,21]]},"reference":[{"issue":"701","key":"3842_CR1","doi-asserted-by":"publisher","first-page":"609","DOI":"10.3399\/bjgp20X713837","volume":"70","author":"G Neve","year":"2020","unstructured":"Neve G, Fyfe M, Hayhoe B, Kumar S. Digital health in primary care: risks and recommendations. Br J Gen Pract. 2020;70(701):609\u201310.","journal-title":"Br J Gen Pract"},{"key":"3842_CR2","unstructured":"NHS England. The NHS long term plan. https:\/\/www.longtermplan.nhs.uk\/wp-content\/uploads\/2019\/08\/nhs-long-term-plan-version-1.2.pdf. Accessed 12 May 2023."},{"key":"3842_CR3","unstructured":"Department for Health and Social Care. NHS App hits over 30 million sign-ups. https:\/\/www.gov.uk\/government\/news\/nhs-app-hits-over-30-million-sign-ups. Accessed 12 May 2023."},{"issue":"1","key":"3842_CR4","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1186\/s13012-016-0510-7","volume":"11","author":"J Ross","year":"2016","unstructured":"Ross J, Stevenson F, Lau R, Murray E. Factors that influence the implementation of e-health: a systematic review of systematic reviews (an update). Implement Sci. 2016;11(1):146.","journal-title":"Implement Sci"},{"key":"3842_CR5","unstructured":"British Medical Association, NHS England. Investment and evolution: A five-year framework for GP contract reform to implement the NHS long term plan. https:\/\/www.england.nhs.uk\/wp-content\/uploads\/2019\/01\/gp-contract-2019.pdf. Accessed 20 May 2023."},{"key":"3842_CR6","unstructured":"NHS Digital. The NHS App: thinking big, starting small, scaling fast. https:\/\/digital.nhs.uk\/blog\/transformation-blog\/2019\/the-nhs-app-thinking-big-starting-small-scaling-fast. Accessed 18 May 2023."},{"key":"3842_CR7","unstructured":"Cabinet Office. COVID-19 Response: Summer 2021. https:\/\/www.gov.uk\/government\/publications\/covid-19-response-summer-2021-roadmap\/covid-19-response-summer-2021. Accessed 06 September 2024."},{"key":"3842_CR8","unstructured":"NHS England. NHS App begins public rollout. https:\/\/www.england.nhs.uk\/2019\/01\/nhs-app-begins-public-rollout\/. Accessed 18 May 2023."},{"key":"3842_CR9","unstructured":"NHS England. NHS long term plan implementation framework. https:\/\/www.longtermplan.nhs.uk\/wp-content\/uploads\/2019\/06\/long-term-plan-implementation-framework-v1.pdf. Accessed 18 May 2023."},{"key":"3842_CR10","unstructured":"NHS England, NHS Improvement. Advice on how to establish a remote \u2018total triage\u2019 model in general practice using online consultations. https:\/\/madeinheene.hee.nhs.uk\/Portals\/0\/Advice%20on%20how%20to%20establish%20a%20remote%20total%20triage%20model%20in%20GP%20using%20online%20consultations.pdf. Accessed 17 May 2023."},{"key":"3842_CR11","unstructured":"NHS Digital. NHS App pilot research findings. https:\/\/digital.nhs.uk\/services\/nhs-app\/nhs-app-pilot-research-report. Accessed 17 May 2023."},{"key":"3842_CR12","unstructured":"NHS Digital. NHS App: Conducting user research in lockdown. https:\/\/digital.nhs.uk\/blog\/design-matters\/2020\/nhs-app-conducting-user-research-in-lockdown. Accessed 17 May 2023."},{"key":"3842_CR13","unstructured":"NHS England. NHS App reaches record users on fifth anniversary. https:\/\/www.england.nhs.uk\/2023\/12\/nhs-app-reaches-record-users-on-fifth-anniversary\/. Accessed 18 Jan 2024."},{"issue":"6","key":"3842_CR14","doi-asserted-by":"publisher","first-page":"957","DOI":"10.1093\/jamia\/ocaa067","volume":"27","author":"J Wosik","year":"2020","unstructured":"Wosik J, Fudim M, Cameron B, Gellad ZF, Cho A, Phinney D, Curtis S, Roman M, Poon EG, Ferranti J, Katz JN, Tcheng J. Telehealth transformation: COVID-19 and the rise of virtual care. J Am Med Inform Assoc. 2020;27(6):957\u201362.","journal-title":"J Am Med Inform Assoc"},{"key":"3842_CR15","doi-asserted-by":"publisher","DOI":"10.7189\/jogh.11.01005","author":"C Pagliari","year":"2021","unstructured":"Pagliari C. Digital health and primary care: Past, pandemic and prospects. J Glob Health. 2021. https:\/\/doi.org\/10.7189\/jogh.11.01005.","journal-title":"J Glob Health"},{"key":"3842_CR16","doi-asserted-by":"publisher","DOI":"10.3399\/BJGP.2022.0150","author":"S Kc","year":"2023","unstructured":"Kc S, Tewolde S, Laverty AA, Costelloe C, Papoutsi C, Reidy C, Gudgin B, Shenton C, Majeed A, Powell J, Greaves F. Uptake and adoption of the NHS App in England: an observational study. Br J Gen Pract. 2023. https:\/\/doi.org\/10.3399\/BJGP.2022.0150.","journal-title":"Br J Gen Pract"},{"key":"3842_CR17","unstructured":"Office for Health Improvement and Disparities. Public health profiles 2023. https:\/\/fingertips.phe.org.uk. Accessed 06 Apr 2023."},{"key":"3842_CR18","doi-asserted-by":"publisher","DOI":"10.3389\/fdgth.2021.726095","author":"T Greenhalgh","year":"2021","unstructured":"Greenhalgh T, Rosen R, Shaw SE, Byng R, Faulkner S, Finlay T, Grundy E, Husain L, Hughes G, Leone C, Moore L, Papoutsi C, Pope C, Rybczynska-Bunt S, Rushforth A, Wherton J, Wieringa S, Wood GW. Planning and evaluating remote consultation services: a new conceptual framework incorporating complexity and practical ethics. Front Digit Health. 2021. https:\/\/doi.org\/10.3389\/fdgth.2021.726095.","journal-title":"Front Digit Health"},{"key":"3842_CR19","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.8775","author":"T Greenhalgh","year":"2017","unstructured":"Greenhalgh T, Wherton J, Papoutsi C, Lynch J, Hughes G, A\u2019Court C, Hinder S, Fahy N, Procter R, Shaw S. Beyond adoption: a new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J Med Internet Res. 2017. https:\/\/doi.org\/10.2196\/jmir.8775.","journal-title":"J Med Internet Res"},{"issue":"1","key":"3842_CR20","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1186\/s12916-018-1089-4","volume":"16","author":"T Greenhalgh","year":"2018","unstructured":"Greenhalgh T, Papoutsi C. Studying complexity in health services research: desperately seeking an overdue paradigm shift. BMC Med. 2018;16(1):95.","journal-title":"BMC Med"},{"issue":"4","key":"3842_CR21","doi-asserted-by":"publisher","first-page":"1893","DOI":"10.1007\/s11135-017-0574-8","volume":"52","author":"B Saunders","year":"2018","unstructured":"Saunders B, Sim J, Kingstone T, Baker S, Waterfield J, Bartlam B, Burroughs H, Jinks C. Saturation in qualitative research: exploring its conceptualization and operationalization. Qual Quant. 2018;52(4):1893\u2013907.","journal-title":"Qual Quant"},{"issue":"2","key":"3842_CR22","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1191\/1478088706qp063oa","volume":"3","author":"V Braun","year":"2006","unstructured":"Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77\u2013101.","journal-title":"Qual Res Psychol"},{"key":"3842_CR23","unstructured":"NHS England. NHS Digital: Spine. https:\/\/digital.nhs.uk\/services\/spine. Accessed 06 Sept 24."},{"key":"3842_CR24","unstructured":"NHS England. NHS Digital: Summary Care Record. https:\/\/digital.nhs.uk\/services\/summary-care-records-scr. Accessed 06 Sept 2024."},{"key":"3842_CR25","unstructured":"The British Medical Association. GP access to records programme \u2013 GPC England statement. https:\/\/www.bma.org.uk\/news-and-opinion\/gp-access-to-records-programme-gpc-england-statement. Accessed 12 Sept 2024."},{"issue":"1","key":"3842_CR26","doi-asserted-by":"publisher","first-page":"581","DOI":"10.1186\/s12913-022-07954-y","volume":"22","author":"G Louch","year":"2022","unstructured":"Louch G, Albutt A, Smyth K, O\u2019Hara JK. What do primary care staff think about patients accessing electronic health records? A focus group study. BMC Health Serv Res. 2022;22(1):581.","journal-title":"BMC Health Serv Res"},{"issue":"1","key":"3842_CR27","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1186\/s12913-021-06188-8","volume":"21","author":"TH N\u00f8st","year":"2021","unstructured":"N\u00f8st TH, Faxvaag A, Steinsbekk A. Participants\u2019 views and experiences from setting up a shared patient portal for primary and specialist health services- a qualitative study. BMC Health Serv Res. 2021;21(1):171.","journal-title":"BMC Health Serv Res"},{"issue":"3","key":"3842_CR28","doi-asserted-by":"publisher","first-page":"e044221","DOI":"10.1136\/bmjopen-2020-044221","volume":"11","author":"B McMillan","year":"2021","unstructured":"McMillan B, Davidge G, Brown L, Lyons M, Atherton H, Goulding R, Mold F, Morris RL, Sanders C. A qualitative exploration of patients\u2019 experiences, needs and expectations regarding online access to their primary care record. BMJ Open. 2021;11(3):e044221.","journal-title":"BMJ Open"},{"issue":"12","key":"3842_CR29","doi-asserted-by":"publisher","first-page":"1019","DOI":"10.1136\/bmjqs-2019-010581","volume":"29","author":"AL Neves","year":"2020","unstructured":"Neves AL, Freise L, Laranjo L, Carter AW, Darzi A, Mayer E. Impact of providing patients access to electronic health records on quality and safety of care: a systematic review and meta-analysis. BMJ Qual Saf. 2020;29(12):1019\u201332.","journal-title":"BMJ Qual Saf"},{"key":"3842_CR30","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.8989","author":"L Kooij","year":"2018","unstructured":"Kooij L, Groen WG, van Harten WH. Barriers and facilitators affecting patient portal implementation from an organizational perspective: qualitative study. J Med Internet Res. 2018. https:\/\/doi.org\/10.2196\/jmir.8989.","journal-title":"J Med Internet Res"},{"key":"3842_CR31","doi-asserted-by":"publisher","DOI":"10.2196\/16921","author":"P Hulter","year":"2020","unstructured":"Hulter P, Pluut B, Leenen-Brinkhuis C, de Mul M, Ahaus K, Weggelaar-Jansen AM. Adopting patient portals in hospitals: qualitative study. J Med Internet Res. 2020. https:\/\/doi.org\/10.2196\/16921.","journal-title":"J Med Internet Res"},{"issue":"3","key":"3842_CR32","doi-asserted-by":"publisher","first-page":"100761","DOI":"10.1016\/j.hlpt.2023.100761","volume":"12","author":"A Janssen","year":"2023","unstructured":"Janssen A, Keep M, Selvadurai H, Shaw T. Health professionals\u2019 experiences with a patient portal pre and post launch: a qualitative study. Health Policy Technol. 2023;12(3):100761.","journal-title":"Health Policy Technol"},{"key":"3842_CR33","unstructured":"Baird B, Maguire D. Understanding factors that enabled digital service change in general practice during the Covid-19 pandemic. King\u2019s Fund. 2021. https:\/\/www.kingsfund.org.uk\/publications\/digital-service-change-general-practice-during-covid-19. Accessed 15 Aug 2024."},{"issue":"6","key":"3842_CR34","doi-asserted-by":"publisher","first-page":"e383","DOI":"10.1016\/S2589-7500(21)00005-4","volume":"3","author":"A Sheikh","year":"2021","unstructured":"Sheikh A, Anderson M, Albala S, Casadei B, Franklin BD, Richards M, Taylor D, Tibble H, Mossialos E. Health information technology and digital innovation for national learning health and care systems. Lancet Digit Health. 2021;3(6):e383\u201396.","journal-title":"Lancet Digit Health"},{"key":"3842_CR35","doi-asserted-by":"publisher","first-page":"c5814","DOI":"10.1136\/bmj.c5814","volume":"341","author":"T Greenhalgh","year":"2010","unstructured":"Greenhalgh T, Hinder S, Stramer K, Bratan T, Russell J. Adoption, non-adoption, and abandonment of a personal electronic health record: case study of HealthSpace. BMJ. 2010;341:c5814.","journal-title":"BMJ"},{"issue":"1","key":"3842_CR36","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1186\/s12911-015-0202-2","volume":"15","author":"C Papoutsi","year":"2015","unstructured":"Papoutsi C, Reed JE, Marston C, Lewis R, Majeed A, Bell D. Patient and public views about the security and privacy of Electronic Health Records (EHRs) in the UK: results from a mixed methods study. BMC Med Inform Decis Mak. 2015;15(1):86.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"8\u20139","key":"3842_CR37","doi-asserted-by":"publisher","first-page":"871","DOI":"10.1093\/jamia\/ocz054","volume":"26","author":"MG Antonio","year":"2019","unstructured":"Antonio MG, Petrovskaya O, Lau F. Is research on patient portals attuned to health equity? A scoping review. J Am Med Inform Assoc. 2019;26(8\u20139):871\u201383.","journal-title":"J Am Med Inform Assoc"},{"issue":"17","key":"3842_CR38","doi-asserted-by":"publisher","first-page":"10591","DOI":"10.3390\/ijerph191710591","volume":"19","author":"H Alami","year":"2022","unstructured":"Alami H, Lehoux P, Shaw SE, Papoutsi C, Rybczynska-Bunt S, Fortin J-P. Virtual care and the inverse care law: implications for policy, practice, research, public and patients. Int J Environ Res Public Health. 2022;19(17):10591.","journal-title":"Int J Environ Res Public Health"},{"issue":"2","key":"3842_CR39","doi-asserted-by":"publisher","first-page":"340","DOI":"10.1111\/1468-0009.12509","volume":"99","author":"JE Chang","year":"2021","unstructured":"Chang JE, Lai AY, Gupta A, Nguyen AM, Berry CA, ShelleyY DR. Rapid transition to telehealth and the digital divide: implications for primary care access and equity in a post-COVID Era. Milbank Q. 2021;99(2):340\u201368.","journal-title":"Milbank Q"}],"container-title":["BMC Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12916-024-03842-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12916-024-03842-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12916-024-03842-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,21]],"date-time":"2025-01-21T14:16:48Z","timestamp":1737469008000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedicine.biomedcentral.com\/articles\/10.1186\/s12916-024-03842-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,21]]},"references-count":39,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["3842"],"URL":"https:\/\/doi.org\/10.1186\/s12916-024-03842-w","relation":{},"ISSN":["1741-7015"],"issn-type":[{"value":"1741-7015","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,21]]},"assertion":[{"value":"6 June 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 December 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 January 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Ethical approval for this study was granted by the National Research Ethics Service and Health Research Authority (Reference 21\/WS\/0031) and by each participant (either written or digitally recorded).","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"All participants provided informed consent for participation in this study.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"20"}}