{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,11]],"date-time":"2026-02-11T02:51:34Z","timestamp":1770778294587,"version":"3.50.0"},"reference-count":32,"publisher":"Oxford University Press (OUP)","issue":"e1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2016,4,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Objective Numerous articles have reported on the development of patient portals, including development problems and solutions. We review these articles to inform future patient portal development efforts and to provide a summary of the evidence base that can guide future research.<\/jats:p>\n               <jats:p>Materials and Methods We performed a systematic review of relevant literature to answer 5 questions: (1) What categories of problems related to patient portal development have been defined? (2) What causal factors have been identified by problem analysis and diagnosis? (3) What solutions have been proposed to ameliorate these causal factors? (4) Which proposed solutions have been implemented and in which organizational contexts? (5) Have implemented solutions been evaluated and what learning has been generated? Through searches on PubMed, ScienceDirect and LISTA, we included 109 articles.<\/jats:p>\n               <jats:p>Results We identified 5 main problem categories: achieving patient engagement, provider engagement, appropriate data governance, security and interoperability, and a sustainable business model. Further, we identified key factors contributing to these problems as well as solutions proposed to ameliorate them. While about half (45) of the 109 articles proposed solutions, fewer than half of these solutions (18) were implemented, and even fewer (5) were evaluated to generate learning about their effects.<\/jats:p>\n               <jats:p>Discussion Few studies systematically report on the patient portal development processes. As a result, the review does not provide an evidence base for portal development.<\/jats:p>\n               <jats:p>Conclusion Our findings support a set of recommendations for advancement of the evidence base: future research should build on existing evidence, draw on principles from design sciences conveyed in the problem-solving cycle, and seek to produce evidence within various different organizational contexts.<\/jats:p>","DOI":"10.1093\/jamia\/ocv114","type":"journal-article","created":{"date-parts":[[2015,9,3]],"date-time":"2015-09-03T01:04:19Z","timestamp":1441242259000},"page":"e162-e168","source":"Crossref","is-referenced-by-count":92,"title":["What do we know about developing patient portals? a systematic literature review"],"prefix":"10.1093","volume":"23","author":[{"given":"Terese","family":"Otte-Trojel","sequence":"first","affiliation":[{"name":"Institute of Health Policy and Management, Erasmus University Rotterdam, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Antoinette","family":"de Bont","sequence":"additional","affiliation":[{"name":"Institute of Health Policy and Management, Erasmus University Rotterdam, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas G","family":"Rundall","sequence":"additional","affiliation":[{"name":"School of Public Health, University of California Berkeley, Berkeley, California, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joris","family":"van de Klundert","sequence":"additional","affiliation":[{"name":"Institute of Health Policy and Management, Erasmus University Rotterdam, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2015,9,2]]},"reference":[{"key":"2020110612364273200_ocv114-B1"},{"key":"2020110612364273200_ocv114-B2","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1186\/1472-6947-8-45","article-title":"Integrated personal health records: transformative tools for consumer-centric care","volume":"8","author":"Detmer","year":"2008","journal-title":"BMC Med Inform Decis Mak"},{"issue":"4","key":"2020110612364273200_ocv114-B3","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1136\/amiajnl-2013-002501","article-title":"How outcomes are achieved through patient portals: a realist review","volume":"21","author":"Otte-Trojel","year":"2014","journal-title":"J Am Med Inform Assoc"},{"key":"2020110612364273200_ocv114-B4","author":"Goldzweig"},{"issue":"6","key":"2020110612364273200_ocv114-B5","doi-asserted-by":"crossref","first-page":"e162","DOI":"10.2196\/jmir.2238","article-title":"The impact of electronic patient portals on patient care: a systematic review of controlled trials","volume":"14","author":"Ammenwerth","year":"2012","journal-title":"J Med Internet Res"},{"issue":"5","key":"2020110612364273200_ocv114-B6","first-page":"351","article-title":"The value of personal health records for chronic disease management: what do we know?","volume":"43","author":"Tenforde","year":"2011","journal-title":"Fam Med"},{"issue":"6","key":"2020110612364273200_ocv114-B7","doi-asserted-by":"crossref","first-page":"422","DOI":"10.1007\/s11892-010-0151-1","article-title":"Patient web portals to improve diabetes outcomes: a systematic review","volume":"10","author":"Osborn","year":"2010","journal-title":"Curr Diab Re."},{"issue":"19","key":"2020110612364273200_ocv114-B8","doi-asserted-by":"crossref","first-page":"2034","DOI":"10.1001\/jama.2012.68169","article-title":"Personal health records and health care utilization","volume":"308","author":"Bates","year":"2012","journal-title":"JAMA"},{"key":"2020110612364273200_ocv114-B9","doi-asserted-by":"crossref","first-page":"i2","DOI":"10.1136\/amiajnl-2011-000400","article-title":"Policies for patient access to clinical data via PHRs: current state and recommendations","volume":"18","author":"Collins","year":"2011","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"2020110612364273200_ocv114-B10","doi-asserted-by":"crossref","DOI":"10.2196\/jmir.3171","article-title":"The effect of patient portals on quality outcomes and its implications to meaningful use: a systematic review","volume":"17","author":"Kruse","year":"2015","journal-title":"J Med Internet Res"},{"issue":"2","key":"2020110612364273200_ocv114-B11","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1377\/hlthaff.2010.0342","article-title":"Many physicians are willing to use patients\u2019 electronic personal health records, but doctors differ by location, gender, and practice","volume":"30","author":"Wynia","year":"2011","journal-title":"Health Aff"},{"issue":"2","key":"2020110612364273200_ocv114-B12","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1197\/jamia.M2025","article-title":"Personal health records: definitions, benefits, and strategies for overcoming barriers to adoption","volume":"13","author":"Tang","year":"2006","journal-title":"J Am Med Inform Assoc"},{"issue":"7","key":"2020110612364273200_ocv114-B13","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1016\/j.ijmedinf.2010.04.005","article-title":"Issues and questions to consider in implementing secure electronic patient\u2013provider web portal communications systems","volume":"79","author":"Wakefield","year":"2010","journal-title":"Int J Med Inform"},{"issue":"2","key":"2020110612364273200_ocv114-B14","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1111\/j.1467-6486.2004.00430.x","article-title":"Management research based on the paradigm of the design sciences: the quest for field-tested and grounded technological rules","volume":"41","author":"Van Aken","year":"2004","journal-title":"J Manag Studies"},{"issue":"4","key":"2020110612364273200_ocv114-B15","doi-asserted-by":"crossref","first-page":"e43","DOI":"10.1016\/j.ijmedinf.2009.07.002","article-title":"Example of a Human Factors Engineering approach to a medication administration work system: potential impact on patient safety","volume":"79","author":"Beuscart-Z\u00e9phir","year":"2010","journal-title":"Int J Med Inform"},{"key":"2020110612364273200_ocv114-B16","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139094351","volume-title":"Problem Solving in Organizations","author":"Van Aken","year":"2012","edition":"2nd ed"},{"key":"2020110612364273200_ocv114-B17"},{"issue":"3","key":"2020110612364273200_ocv114-B18","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1016\/j.soncn.2011.04.007","article-title":"Electronic health records and personal health records","volume":"27","author":"Caligtan","year":"2011","journal-title":"Semin Oncol Nurs"},{"key":"2020110612364273200_ocv114-B19","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1186\/2046-4053-1-10","article-title":"Evidence summaries: the evolution of a rapid review approach","volume":"1","author":"Khangura","year":"2012","journal-title":"Syst Rev"},{"issue":"1","key":"2020110612364273200_ocv114-B20","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1186\/1748-5908-5-56","article-title":"Expediting systematic reviews: methods and implications of rapid reviews","volume":"5","author":"Ganann","year":"2010","journal-title":"Implement Sci"},{"key":"2020110612364273200_ocv114-B21","doi-asserted-by":"crossref","DOI":"10.7208\/chicago\/9780226180458.001.0001","volume-title":"Abductive Analysis:\n               Theorizing Qualitative Research","author":"Tavory","year":"2014"},{"key":"2020110612364273200_ocv114-B22","doi-asserted-by":"crossref","DOI":"10.1016\/j.ijmedinf.2015.07.001","article-title":"Developing patient portals in a fragmented healthcare system","author":"Otte-Trojel","year":"2015","journal-title":"Int J Med Inform"},{"issue":"3","key":"2020110612364273200_ocv114-B23","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1097\/JAC.0000000000000043","article-title":"Secure e-mailing between physicians and patients: transformational change in ambulatory care","volume":"37","author":"Garrido","year":"2014","journal-title":"J Amb Care Manag"},{"key":"2020110612364273200_ocv114-B24"},{"issue":"2","key":"2020110612364273200_ocv114-B25","doi-asserted-by":"crossref","first-page":"140","DOI":"10.3414\/ME10-01-0022","article-title":"Electronic health record interoperability as realized in Turkey\u2019s National Health Information System","volume":"50","author":"Dogac","year":"2011","journal-title":"Methods Inform Med"},{"issue":"1","key":"2020110612364273200_ocv114-B26","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1136\/amiajnl-2012-001146","article-title":"Patient-controlled sharing of medical imaging data across unaffiliated healthcare organizations","volume":"20","author":"Ge","year":"2013","journal-title":"J Am Med Inform Assoc"},{"issue":"3","key":"2020110612364273200_ocv114-B27","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1111\/j.1468-005X.2010.00249.x","article-title":"Changing the record: the inter-professional, subjective and embodied effects of electronic patient records","volume":"25","author":"Halford","year":"2010","journal-title":"New Tech Work Employ"},{"issue":"1","key":"2020110612364273200_ocv114-B28","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1177\/1460458207073648","article-title":"Managing integration work in an NHS electronic patient record (EPR) project","volume":"13","author":"Martin","year":"2007","journal-title":"Health Inform J"},{"issue":"58","key":"2020110612364273200_ocv114-B29","article-title":"Architecture of a consent management suite and integration into IHE-based regional health information networks","volume":"11","author":"Heinze","year":"2011","journal-title":"BMC Med Inform Decis Mak"},{"issue":"12","key":"2020110612364273200_ocv114-B30","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1016\/j.ijmedinf.2012.08.008","article-title":"Where should electronic records for patients be stored?","volume":"81","author":"Lapsia","year":"2012","journal-title":"Int J Med Inform"},{"issue":"1","key":"2020110612364273200_ocv114-B31","doi-asserted-by":"crossref","first-page":"e9","DOI":"10.2196\/ijmr.2346","article-title":"Developing electronic cooperation tools: a case from Norwegian Health Care. Eysenbach G, ed","volume":"2","author":"Larsen","year":"2013","journal-title":"Interactive J Med Res"},{"issue":"5","key":"2020110612364273200_ocv114-B32","doi-asserted-by":"crossref","first-page":"950","DOI":"10.2105\/AJPH.2008.144873","article-title":"Understanding the decisions and values of stakeholders in health information exchanges: experiences from Massachusetts","volume":"99","author":"Rudin","year":"2009","journal-title":"Am J Pub Health"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/23\/e1\/e162\/34148107\/ocv114.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/23\/e1\/e162\/34148107\/ocv114.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T17:45:32Z","timestamp":1604684732000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/23\/e1\/e162\/2379787"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,9,2]]},"references-count":32,"journal-issue":{"issue":"e1","published-online":{"date-parts":[[2015,9,2]]},"published-print":{"date-parts":[[2016,4,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocv114","relation":{},"ISSN":["1527-974X","1067-5027"],"issn-type":[{"value":"1527-974X","type":"electronic"},{"value":"1067-5027","type":"print"}],"subject":[],"published-other":{"date-parts":[[2016,4]]},"published":{"date-parts":[[2015,9,2]]}}}