{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T17:15:48Z","timestamp":1777137348451,"version":"3.51.4"},"reference-count":57,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,2,3]],"date-time":"2020-02-03T00:00:00Z","timestamp":1580688000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,2,3]],"date-time":"2020-02-03T00:00:00Z","timestamp":1580688000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Fueled by advances in technology, increased access to smartphones, and capital investment, the number of available health \u201capps\u201d has exploded in recent years. Patients use their smartphones for many things, but not as much as they might for health, especially for managing their chronic conditions. Moreover, while significant work is ongoing to develop, validate, and evaluate these apps, it is less clear how to effectively disseminate apps into routine clinical practice. We propose a framework for prescribing apps and outline the key issues that need to be addressed to enable app dissemination in clinical care. This includes: education and awareness, creating digital formularies, workflow and EHR integration, payment models, and patient\/provider support. As work in digital health continues to expand, integrating health apps into clinical care delivery will be critical if digital health is to achieve its potential.<\/jats:p>","DOI":"10.1038\/s41746-019-0212-z","type":"journal-article","created":{"date-parts":[[2020,2,3]],"date-time":"2020-02-03T11:04:14Z","timestamp":1580727854000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":303,"title":["Beyond validation: getting health apps into clinical practice"],"prefix":"10.1038","volume":"3","author":[{"given":"William J.","family":"Gordon","sequence":"first","affiliation":[]},{"given":"Adam","family":"Landman","sequence":"additional","affiliation":[]},{"given":"Haipeng","family":"Zhang","sequence":"additional","affiliation":[]},{"given":"David W.","family":"Bates","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,2,3]]},"reference":[{"key":"212_CR1","doi-asserted-by":"publisher","first-page":"1975","DOI":"10.1001\/jama.2018.14378","volume":"320","author":"DW Bates","year":"2018","unstructured":"Bates, D. W., Landman, A. & Levine, D. M. Health apps and health policy: what is needed? JAMA 320, 1975\u20131976 (2018).","journal-title":"JAMA"},{"key":"212_CR2","unstructured":"Pew Research Center. 2019 Core Trends Survey. https:\/\/www.pewresearch.org\/wp-content\/uploads\/2019\/05\/FT_19.05.23_DigitalDivideCommType_methodology_topline.pdf."},{"key":"212_CR3","unstructured":"Policy for Device Software Functions and Mobile Medical Applications. https:\/\/www.fda.gov\/media\/80958\/download (2019)."},{"key":"212_CR4","doi-asserted-by":"publisher","first-page":"1851","DOI":"10.1001\/jama.2014.2564","volume":"311","author":"AC Powell","year":"2014","unstructured":"Powell, A. C., Landman, A. B. & Bates, D. W. In search of a few good apps. JAMA 311, 1851\u20131852 (2014).","journal-title":"JAMA"},{"key":"212_CR5","doi-asserted-by":"publisher","first-page":"e52","DOI":"10.1016\/S2589-7500(19)30013-5","volume":"1","author":"P Henson","year":"2019","unstructured":"Henson, P., David, G., Albright, K. & Torous, J. Deriving a practical framework for the evaluation of health apps. Lancet Digit. Health 1, e52\u2013e54 (2019).","journal-title":"Lancet Digit. Health"},{"key":"212_CR6","doi-asserted-by":"crossref","unstructured":"Van Velthoven, M. H., Smith, J., Wells, G. & Brindley, D. Digital health app development standards: a systematic review protocol. BMJ Open 8, e022969 (2018).","DOI":"10.1136\/bmjopen-2018-022969"},{"key":"212_CR7","unstructured":"World Health Organization. Classification of Digital Health Interventions v1.0: A Shared Language to Describe the Uses of Digital Technology for Health. https:\/\/apps.who.int\/iris\/bitstream\/handle\/10665\/260480\/WHO-RHR-18.06-eng.pdf;jsessionid=EF5C7B012765D3D18F62E3B3C71E67DC?sequence=1 (2018)."},{"key":"212_CR8","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1038\/s41746-019-0111-3","volume":"2","author":"SC Mathews","year":"2019","unstructured":"Mathews, S. C. et al. Digital health: a path to validation. NPJ Digit. Med. 2, 38 (2019).","journal-title":"NPJ Digit. Med."},{"key":"212_CR9","unstructured":"Mercom Capital. Digital Health Funding and M&A 2018. Fourth Quarter and Annual Report. Funding and merger & acquisition activity for the Digital Health\/Healthcare IT sector. https:\/\/mercomcapital.com\/wp-content\/uploads\/2019\/01\/MercomDigitalHealthFundingMAQ42018ExecSumm.pdf."},{"key":"212_CR10","unstructured":"FDA, CDRH. Digital Health Innovation Action Plan. https:\/\/www.fda.gov\/downloads\/MedicalDevices\/DigitalHealth\/UCM568735.pdf."},{"key":"212_CR11","doi-asserted-by":"publisher","first-page":"730","DOI":"10.7326\/M17-2715","volume":"168","author":"TT Lee","year":"2018","unstructured":"Lee, T. T. & Kesselheim, A. S. U.S. Food and Drug Administration Precertification Pilot Program for Digital Health Software: Weighing the Benefits and Risks. Ann. Intern. Med. 168, 730\u2013732 (2018).","journal-title":"Ann. Intern. Med."},{"key":"212_CR12","unstructured":"FDA. Developing a Software Precertification Program: A Working Model (v1.0\u2014January 2019). https:\/\/www.fda.gov\/downloads\/MedicalDevices\/DigitalHealth\/DigitalHealthPreCertProgram\/UCM629276.pdf (2019)."},{"key":"212_CR13","unstructured":"National Institute for Health and Care Excellence. Evidence Standards for Health and Care Excellence. https:\/\/www.nice.org.uk\/Media\/Default\/About\/what-we-do\/our-programmes\/evidence-standards-framework\/digital-evidence-standards-framework.pdf (2019)."},{"key":"212_CR14","doi-asserted-by":"publisher","first-page":"e58","DOI":"10.1016\/S2589-7500(19)30025-1","volume":"1","author":"S Leigh","year":"2019","unstructured":"Leigh, S. & Ashall-Payne, L. The role of health-care providers in mHealth adoption. Lancet Digit. Health 1, e58\u2013e59 (2019).","journal-title":"Lancet Digit. Health"},{"key":"212_CR15","doi-asserted-by":"publisher","first-page":"2310","DOI":"10.1377\/hlthaff.2016.0578","volume":"35","author":"K Singh","year":"2016","unstructured":"Singh, K. et al. Many mobile health apps target high-need, high-cost populations, but gaps remain. Health Aff. Proj. Hope 35, 2310\u20132318 (2016).","journal-title":"Health Aff. Proj. Hope"},{"key":"212_CR16","unstructured":"Food and Drug Administration. The fda recommends only using cleared or approved medical devices to help assess or diagnose a head injury, including concussion: FDA safety communication. https:\/\/www.fda.gov\/medical-devices\/safety-communications\/fda-recommends-only-using-cleared-or-approved-medical-devices-help-assess-or-diagnose-head-injury."},{"key":"212_CR17","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1038\/s41551-019-0426-z","volume":"3","author":"WJ Gordon","year":"2019","unstructured":"Gordon, W. J. & Stern, A. D. Challenges and opportunities in software-driven medical devices. Nat. Biomed. Eng. 3, 493\u2013497 (2019).","journal-title":"Nat. Biomed. Eng."},{"key":"212_CR18","unstructured":"Official Journal of the European Union. Directive 2007\/47\/EC of the European parliament and of the council (2007)."},{"key":"212_CR19","unstructured":"FTC Releases New Guidance For Developers of Mobile Health Apps. https:\/\/www.ftc.gov\/news-events\/press-releases\/2016\/04\/ftc-releases-new-guidance-developers-mobile-health-apps."},{"key":"212_CR20","unstructured":"Communication from the Commission to the European Parliament, The Council, The European Economic and Social Committee and the Committee of the regioNS eHealth Action Plan 2012\u20132020\u2014Innovative healthcare for the 21st century. https:\/\/eur-lex.europa.eu\/legal-content\/EN\/ALL\/?uri=CELEX:52012DC0736 (2012)."},{"key":"212_CR21","unstructured":"REGULATION (EU) 2017\/745 OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL. (2017)."},{"key":"212_CR22","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1038\/s41746-019-0093-1","volume":"2","author":"ME Larsen","year":"2019","unstructured":"Larsen, M. E. et al. Using science to sell apps: evaluation of mental health app store quality claims. NPJ Digit. Med. 2, 18 (2019).","journal-title":"NPJ Digit. Med."},{"key":"212_CR23","doi-asserted-by":"publisher","first-page":"518","DOI":"10.1002\/da.22654","volume":"34","author":"M Sucala","year":"2017","unstructured":"Sucala, M. et al. Anxiety: there is an app for that. A systematic review of anxiety apps. Depress Anxiety 34, 518\u2013525 (2017).","journal-title":"Depress Anxiety"},{"key":"212_CR24","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1038\/s41746-018-0021-9","volume":"1","author":"O Byambasuren","year":"2018","unstructured":"Byambasuren, O., Sanders, S., Beller, E. & Glasziou, P. Prescribable mHealth apps identified from an overview of systematic reviews. NPJ Digit. Med. 1, 12 (2018).","journal-title":"NPJ Digit. Med."},{"key":"212_CR25","doi-asserted-by":"publisher","first-page":"363","DOI":"10.1007\/s13142-014-0293-9","volume":"4","author":"ED Boudreaux","year":"2014","unstructured":"Boudreaux, E. D. et al. Evaluating and selecting mobile health apps: strategies for healthcare providers and healthcare organizations. Transl. Behav. Med. 4, 363\u2013371 (2014).","journal-title":"Transl. Behav. Med."},{"key":"212_CR26","doi-asserted-by":"publisher","DOI":"10.2196\/13199","volume":"7","author":"O Byambasuren","year":"2019","unstructured":"Byambasuren, O., Beller, E. & Glasziou, P. Current knowledge and adoption of mobile health apps among Australian general practitioners: survey study. JMIR MHealth UHealth 7, e13199 (2019).","journal-title":"JMIR MHealth UHealth"},{"key":"212_CR27","doi-asserted-by":"publisher","DOI":"10.2196\/14086","volume":"21","author":"G Giunti","year":"2019","unstructured":"Giunti, G., Guisado-Fernandez, E., Belani, H. & Lacalle-Remigio, J. R. Mapping the access of future doctors to health information technologies training in the European Union: cross-sectional descriptive study. J. Med. Internet Res. 21, e14086 (2019).","journal-title":"J. Med. Internet Res."},{"key":"212_CR28","unstructured":"American Medical Association. AMA expansion of national effort creating medical school of the future. https:\/\/www.ama-assn.org\/press-center\/press-releases\/ama-expansion-national-effort-creating-medical-school-future (2019)."},{"key":"212_CR29","unstructured":"reSET\u00ae & reSET-O. https:\/\/peartherapeutics.com\/products\/reset-reset-o\/."},{"key":"212_CR30","doi-asserted-by":"publisher","first-page":"S106","DOI":"10.1016\/j.pmrj.2017.02.018","volume":"9","author":"C-K Kao","year":"2017","unstructured":"Kao, C.-K. & Liebovitz, D. M. Consumer mobile health apps: current state, barriers, and future directions. PM R. 9, S106\u2013S115 (2017).","journal-title":"PM R."},{"key":"212_CR31","first-page":"960","volume":"15","author":"B Wang","year":"2013","unstructured":"Wang, B. & Kesselheim, A. S. The role of direct-to-consumer pharmaceutical advertising in patient consumerism. Virtual Mentor VM 15, 960\u2013965 (2013).","journal-title":"Virtual Mentor VM"},{"key":"212_CR32","unstructured":"Werble, C. Health policy brief: formularies. Health Aff. (Millwood) 11 (2017)."},{"key":"212_CR33","unstructured":"Express Scripts. Digital Health Made Smarter and Simpler. https:\/\/lab.express-scripts.com\/lab\/insights\/industry-updates\/digital-health-made-smarter-and-simpler (2019)."},{"key":"212_CR34","unstructured":"Muoio, D. CVS Health kicks off digital health-friendly service for PBM clients with Big Health\u2019s Sleepio. https:\/\/www.mobihealthnews.com\/content\/north-america\/cvs-health-kicks-digital-health-friendly-service-pbm-clients-big-health-s (2019)."},{"key":"212_CR35","doi-asserted-by":"publisher","first-page":"1871","DOI":"10.1111\/j.1475-6773.2006.00689.x","volume":"42","author":"M Tai-Seale","year":"2007","unstructured":"Tai-Seale, M., McGuire, T. G. & Zhang, W. Time allocation in primary care office visits. Health Serv. Res. 42, 1871\u20131894 (2007).","journal-title":"Health Serv. Res."},{"key":"212_CR36","doi-asserted-by":"publisher","first-page":"91","DOI":"10.22454\/FamMed.2018.184803","volume":"50","author":"RA Young","year":"2018","unstructured":"Young, R. A., Burge, S. K., Kumar, K. A., Wilson, J. M. & Ortiz, D. F. A time-motion study of primary care Physicians\u2019 work in the electronic health record era. Fam. Med. 50, 91\u201399 (2018).","journal-title":"Fam. Med."},{"key":"212_CR37","unstructured":"Centers for Medicare & Medicaid Services (CMS), HHS. Medicare and Medicaid Programs; Electronic Health Record Incentive Program\u2014Stage 3 and Modifications to Meaningful Use in 2015 Through 2017. 42 CFR Parts 412 and 495 (2015)."},{"key":"212_CR38","unstructured":"Department of Health and Human Services. 21st Century Cures Act: Interoperability, Information Blocking, and the ONC Health IT Certification Program. Federal Register 84 No 42 (2019)."},{"key":"212_CR39","unstructured":"Gordon, W. J., Chopra, A. & Landman, A. Patient-led data sharing\u2014a new paradigm for electronic health data. NEJM Catalyst. https:\/\/catalyst.nejm.org\/patient-led-health-data-paradigm\/ (2018)."},{"key":"212_CR40","unstructured":"Jonah Comstock. Medicare to reimburse for Diabetes Prevention Program, including Omada\u2019s digital version. http:\/\/www.mobihealthnews.com\/content\/medicare-reimburse-diabetes-prevention-program-including-omadas-digital-version (2016)."},{"key":"212_CR41","unstructured":"Sweeney, E. Omada Health made its name with its technology. Now it\u2019s luring insurers with operational innovation. https:\/\/www.fiercehealthcare.com\/tech\/omada-health-diabetes-digital-health-operational-innovation-cigna-bcbs-minnesota-sean-duffy (2018)."},{"key":"212_CR42","unstructured":"Dolan, B. Report: Two insurers to pay $100 monthly fee for WellDoc. https:\/\/www.mobihealthnews.com\/18255\/report-two-insurers-to-pay-100-monthly-fee-for-welldoc (2012)."},{"key":"212_CR43","doi-asserted-by":"publisher","first-page":"1071","DOI":"10.1016\/j.jaip.2017.01.004","volume":"5","author":"DB Price","year":"2017","unstructured":"Price, D. B. et al. Inhaler errors in the CRITIKAL study: type, frequency, and association with asthma outcomes. J. Allergy Clin. Immunol. Pract. 5, 1071\u20131081 (2017). e9.","journal-title":"J. Allergy Clin. Immunol. Pract."},{"key":"212_CR44","unstructured":"Digital Medicine Society. Digital Medicine Society https:\/\/www.dimesociety.org\/."},{"key":"212_CR45","unstructured":"Ochsner Health System. The O Bar at Ochsner Health System. https:\/\/www.ochsner.org\/io\/the-o-bar-1."},{"key":"212_CR46","unstructured":"Hamilton, K. 3 Reasons for \u201cGenius Bars\u201d in Health Care. https:\/\/www.medstarhealth.org\/digitalblog\/2016\/11\/11\/3-reasons-for-genius-bars-in-health-care\/ (2016)."},{"key":"212_CR47","unstructured":"Prescription Drug-Use-Related Software; Establishment of a Public Docket; Request for Comments. Federal Register https:\/\/www.federalregister.gov\/documents\/2018\/11\/20\/2018-25206\/prescription-drug-use-related-software-establishment-of-a-public-docket-request-for-comments (2018)."},{"key":"212_CR48","unstructured":"Apple Inc. Apple announces effortless solution bringing health records to iPhone. https:\/\/www.apple.com\/newsroom\/2018\/01\/apple-announces-effortless-solution-bringing-health-records-to-iPhone\/ (2018)."},{"key":"212_CR49","doi-asserted-by":"crossref","unstructured":"Mackert, M., Mabry-Flynn, A., Champlin, S., Donovan, E. E. & Pounders, K. Health literacy and health information technology adoption: the potential for a new digital divide. J. Med. Internet Res. 18, e264 (2016).","DOI":"10.2196\/jmir.6349"},{"key":"212_CR50","doi-asserted-by":"publisher","first-page":"927","DOI":"10.1093\/jamia\/ocx020","volume":"24","author":"AT Perzynski","year":"2017","unstructured":"Perzynski, A. T. et al. Patient portals and broadband internet inequality. J. Am. Med. Inform. Assoc. JAMIA 24, 927\u2013932 (2017).","journal-title":"J. Am. Med. Inform. Assoc. JAMIA"},{"key":"212_CR51","doi-asserted-by":"publisher","DOI":"10.2196\/14871","volume":"21","author":"WJ Gordon","year":"2019","unstructured":"Gordon, W. J. et al. Comparing characteristics of patients who connect their iPhones to an electronic health records system versus patients who connect without personal devices: cohort study. J. Med. Internet Res. 21, e14871 (2019).","journal-title":"J. Med. Internet Res."},{"key":"212_CR52","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1080\/01972243.2018.1438550","volume":"34","author":"N Bol","year":"2018","unstructured":"Bol, N., Helberger, N. & Weert, J. C. M. Differences in mobile health app use: a source of new digital inequalities? Inf. Soc. 34, 183\u2013193 (2018).","journal-title":"Inf. Soc."},{"key":"212_CR53","doi-asserted-by":"publisher","first-page":"31","DOI":"10.21037\/mhealth.2018.07.02","volume":"4","author":"N Vangeepuram","year":"2018","unstructured":"Vangeepuram, N. et al. Smartphone ownership and perspectives on health apps among a vulnerable population in East Harlem, New York. mHealth 4, 31 (2018).","journal-title":"mHealth"},{"key":"212_CR54","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1056\/NEJMp1716845","volume":"378","author":"AA Wright","year":"2018","unstructured":"Wright, A. A. & Katz, I. T. Beyond burnout\u2014redesigning care to restore meaning and sanity for physicians. N. Engl. J. Med. 378, 309\u2013311 (2018).","journal-title":"N. Engl. J. Med."},{"key":"212_CR55","doi-asserted-by":"publisher","first-page":"1317","DOI":"10.1001\/jamainternmed.2018.3713","volume":"178","author":"M Panagioti","year":"2018","unstructured":"Panagioti, M. et al. Association between physician burnout and patient safety, professionalism, and patient satisfaction: a systematic review and meta-analysis. JAMA Intern. Med. 178, 1317\u20131330 (2018).","journal-title":"JAMA Intern. Med."},{"key":"212_CR56","doi-asserted-by":"publisher","first-page":"50","DOI":"10.7326\/M18-0139","volume":"169","author":"NL Downing","year":"2018","unstructured":"Downing, N. L., Bates, D. W. & Longhurst, C. A. Physician burnout in the electronic health record era: are we ignoring the real cause? Ann. Intern. Med. 169, 50 (2018).","journal-title":"Ann. Intern. Med."},{"key":"212_CR57","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1093\/jamia\/ocy145","volume":"26","author":"RL Gardner","year":"2019","unstructured":"Gardner, R. L. et al. Physician stress and burnout: the impact of health information technology. J. Am. Med. Inform. Assoc. JAMIA 26, 106\u2013114 (2019).","journal-title":"J. Am. Med. Inform. Assoc. JAMIA"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0212-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0212-z","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0212-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,7]],"date-time":"2022-12-07T01:50:50Z","timestamp":1670377850000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0212-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,3]]},"references-count":57,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["212"],"URL":"https:\/\/doi.org\/10.1038\/s41746-019-0212-z","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,3]]},"assertion":[{"value":"23 September 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 December 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 February 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"W.J.G. reported research funding from IBM, for work unrelated to this manuscript. A.L. reported receiving personal fees from Abbott Medical Device Cybersecurity Council outside the submitted work. H.Z. reported employment at Cake, an end-of-life planning technology company. DWB reported consulting for EarlySense, which makes patient safety monitoring systems. He receives cash compensation from CDI-Negev Ltd, which is a not-for-profit incubator for health information technology startups. He receives equity from ValeraHealth, which makes software to help patients with chronic diseases, from Clew, which makes software to support clinical decision-making in intensive care, and from MDClone, which produces deidentified versions of clinical data.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"14"}}