{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T23:36:23Z","timestamp":1775086583668,"version":"3.50.1"},"reference-count":71,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2024,4,3]],"date-time":"2024-04-03T00:00:00Z","timestamp":1712102400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,3]],"date-time":"2024-04-03T00:00:00Z","timestamp":1712102400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002322","name":"Coordena\u00e7\u00e3o de Aperfei\u00e7oamento de Pessoal de N\u00edvel Superior","doi-asserted-by":"publisher","award":["DPG No 0010\/2023"],"award-info":[{"award-number":["DPG No 0010\/2023"]}],"id":[{"id":"10.13039\/501100002322","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006752","name":"Universidade do Porto","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006752","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Clin Pharm"],"published-print":{"date-parts":[[2024,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Key performance indicators (KPIs) are quantifiable measures used to monitor the quality of health services. Implementation guidelines for clinical pharmacy services (CPS) do not specify KPIs.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Aim<\/jats:title>\n                <jats:p>To assess the quality of the studies that have developed KPIs for CPS in inpatient hospital settings.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Method<\/jats:title>\n                <jats:p>A systematic review was conducted by searching in Web of Science, Scopus, and PubMed, supplemented with citation analyses and grey literature searches, to retrieve studies addressing the development of KPIs in CPS for hospital inpatients. Exclusions comprised drug- or disease-specific studies and those not written in English, French, Portuguese, or Spanish. The Appraisal of Indicators through Research and Evaluation (AIRE) instrument assessed methodological quality. Domain scores and an overall score were calculated using an equal-weight principle. KPIs were classified into structure, process, and outcome categories. The protocol is available at <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"doi\" xlink:href=\"10.17605\/OSF.IO\/KS2G3\">https:\/\/doi.org\/10.17605\/OSF.IO\/KS2G3<\/jats:ext-link>.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>We included thirteen studies that collectively developed 225 KPIs. Merely five studies scored over 50% on the AIRE instrument, with domains #3 (scientific evidence) and #4 (formulation and usage) displaying low scores. Among the KPIs, 8.4% were classified as structure, 85.8% as process, and 5.8% as outcome indicators. The overall methodological quality did not exhibit a clear association with a major focus on outcomes. None of the studies provided benchmarking reference values.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>The KPIs formulated for evaluating CPS in hospital settings primarily comprised process measures, predominantly suggested by pharmacists, with inadequate evidence support, lacked piloting or validation, and consequently, were devoid of benchmarking reference values.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s11096-024-01717-x","type":"journal-article","created":{"date-parts":[[2024,4,3]],"date-time":"2024-04-03T16:02:02Z","timestamp":1712160122000},"page":"602-613","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Clinical pharmacy key performance indicators for hospital inpatient setting: a systematic review"],"prefix":"10.1007","volume":"46","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9812-2783","authenticated-orcid":false,"given":"Lucas","family":"Magedanz","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4835-0064","authenticated-orcid":false,"given":"Hiolanda L\u00eado","family":"Silva","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9295-8018","authenticated-orcid":false,"given":"Dayani","family":"Galato","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8529-9595","authenticated-orcid":false,"given":"Fernando","family":"Fernandez-Llimos","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,4,3]]},"reference":[{"key":"1717_CR1","unstructured":"Farquhar M. AHRQ Quality Indicators. In: Hughes RG, editor. Patient Safety and Quality: An Evidence-Based Handbook for Nurses. Advances in Patient Safety. Rockville (MD): AHRQ 2008."},{"issue":"6","key":"1717_CR2","doi-asserted-by":"publisher","first-page":"816","DOI":"10.1592\/phco.28.6.816","volume":"28","author":"American College of Clinical Pharmacy","year":"2008","unstructured":"American College of Clinical Pharmacy. The definition of clinical pharmacy. Pharmacotherapy. 2008;28(6):816\u20137. https:\/\/doi.org\/10.1592\/phco.28.6.816.","journal-title":"Pharmacotherapy"},{"issue":"8","key":"1717_CR3","doi-asserted-by":"publisher","first-page":"1720","DOI":"10.1093\/ajhp\/50.8.1720","volume":"50","author":"ASHP Statement on Pharmaceutical Care","year":"1993","unstructured":"ASHP Statement on Pharmaceutical Care. Am J Health Syst Pharm. 1993;50(8):1720\u20133. https:\/\/doi.org\/10.1093\/ajhp\/50.8.1720.","journal-title":"Am J Health Syst Pharm"},{"key":"1717_CR4","unstructured":"Royal Pharmaceutical Society. Professional standards for hospital pharmacy services. https:\/\/www.rpharms.com\/Portals\/0\/RPS%20document%20library\/Open%20access\/Professional%20standards\/Professional%20standards%20for%20Hospital%20pharmacy\/rps-professional-standards-for-hospital-pharmacy.pdf. Accessed 31 Dec 2023."},{"issue":"5","key":"1717_CR5","doi-asserted-by":"publisher","first-page":"256","DOI":"10.1136\/ejhpharm-2014-000526","volume":"21","author":"The European Statements of Hospital Pharmacy","year":"2014","unstructured":"The European Statements of Hospital Pharmacy. Eur J Hosp Pharm. 2014;21(5):256\u20138. https:\/\/doi.org\/10.1136\/ejhpharm-2014-000526.","journal-title":"Eur J Hosp Pharm"},{"issue":"1","key":"1717_CR6","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1007\/s11096-023-01658-x","volume":"46","author":"V Paudyal","year":"2024","unstructured":"Paudyal V, Okuyan B, Henman MC, et al. Scope, content and quality of clinical pharmacy practice guidelines: a systematic review. Int J Clin Pharm. 2024;46(1):56\u201369. https:\/\/doi.org\/10.1007\/s11096-023-01658-x.","journal-title":"Int J Clin Pharm"},{"key":"1717_CR7","doi-asserted-by":"publisher","DOI":"10.1007\/s11096-023-01631-8","author":"K Fujita","year":"2023","unstructured":"Fujita K, Halvorsen KH, Sato N, et al. Pharmaceutical Care Network Europe definition of quality indicators for pharmaceutical care: a systematic literature review and international consensus development. Int J Clin Pharm. 2023;46:70-9.\u00a0https:\/\/doi.org\/10.1007\/s11096-023-01631-8.","journal-title":"Int J Clin Pharm"},{"key":"1717_CR8","doi-asserted-by":"publisher","unstructured":"Should key performance indicators for clinical services be mandatory? Can J Hosp Pharm. 2011;64(1):55\u20137. https:\/\/doi.org\/10.4212\/cjhp.v64i1.989","DOI":"10.4212\/cjhp.v64i1.989"},{"key":"1717_CR9","doi-asserted-by":"publisher","DOI":"10.1016\/j.jenvman.2020.111916","volume":"282","author":"MO van Schaik","year":"2021","unstructured":"van Schaik MO, Sucu S, Cappon HJ, et al. Mathematically formulated key performance indicators for design and evaluation of treatment trains for resource recovery from urban wastewater. J Environ Manag. 2021;282: 111916. https:\/\/doi.org\/10.1016\/j.jenvman.2020.111916.","journal-title":"J Environ Manag"},{"issue":"4","key":"1717_CR10","doi-asserted-by":"publisher","first-page":"965","DOI":"10.1007\/s10270-021-00894-x","volume":"20","author":"R Gilsing","year":"2021","unstructured":"Gilsing R, Wilbik A, Grefen P, et al. Defining business model key performance indicators using intentional linguistic summaries. Softw Syst Model. 2021;20(4):965\u201396. https:\/\/doi.org\/10.1007\/s10270-021-00894-x.","journal-title":"Softw Syst Model"},{"issue":"11","key":"1717_CR11","doi-asserted-by":"publisher","first-page":"1362","DOI":"10.1093\/ecco-jcc\/jjx099","volume":"11","author":"PS Morar","year":"2017","unstructured":"Morar PS, Hollingshead J, Bemelman W, et al. Establishing Key Performance Indicators [KPIs] and their importance for the surgical management of inflammatory bowel disease-results from a pan-European, Delphi consensus study. J Crohns Colitis. 2017;11(11):1362\u20138. https:\/\/doi.org\/10.1093\/ecco-jcc\/jjx099.","journal-title":"J Crohns Colitis"},{"issue":"Pt A","key":"1717_CR12","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1016\/j.yebeh.2019.07.034","volume":"98","author":"R Shawahna","year":"2019","unstructured":"Shawahna R. Development of key performance indicators to capture in measuring the impact of pharmacists in caring for patients with epilepsy in primary healthcare: a Delphi consensual study. Epilepsy Behav. 2019;98(Pt A):129\u201338. https:\/\/doi.org\/10.1016\/j.yebeh.2019.07.034.","journal-title":"Epilepsy Behav"},{"issue":"4","key":"1717_CR13","doi-asserted-by":"publisher","DOI":"10.1111\/ecc.13240","volume":"29","author":"C Mellett","year":"2020","unstructured":"Mellett C, O\u2019Donovan A, Hayes C. The development of outcome key performance indicators for systemic anti-cancer therapy using a modified Delphi method. Eur J Cancer Care Engl. 2020;29(4): e13240. https:\/\/doi.org\/10.1111\/ecc.13240.","journal-title":"Eur J Cancer Care Engl"},{"issue":"4","key":"1717_CR14","doi-asserted-by":"publisher","first-page":"2120","DOI":"10.18549\/PharmPract.2020.4.2120","volume":"18","author":"TM Salgado","year":"2020","unstructured":"Salgado TM, Reynolds TN, Frankart LM, et al. A key performance indicators redefinition initiative at a school of pharmacy using a modified Delphi consensus technique. Pharm Pract. 2020;18(4):2120. https:\/\/doi.org\/10.18549\/PharmPract.2020.4.2120.","journal-title":"Pharm Pract"},{"issue":"2","key":"1717_CR15","doi-asserted-by":"publisher","first-page":"517","DOI":"10.1007\/s11096-022-01375-x","volume":"44","author":"N Sato","year":"2022","unstructured":"Sato N, Fujita K, Kushida K, et al. Development and consensus testing of quality indicators for geriatric pharmacotherapy in primary care using a modified Delphi study. Int J Clin Pharm. 2022;44(2):517\u201338. https:\/\/doi.org\/10.1007\/s11096-022-01375-x.","journal-title":"Int J Clin Pharm"},{"issue":"23","key":"1717_CR16","doi-asserted-by":"publisher","first-page":"1958","DOI":"10.1093\/ajhp\/zxz225","volume":"76","author":"S Cassat","year":"2019","unstructured":"Cassat S, Massey L, Buckingham S, et al. Development of health-system inpatient pharmacy clinical metrics. Am J Health Syst Pharm. 2019;76(23):1958\u201364. https:\/\/doi.org\/10.1093\/ajhp\/zxz225.","journal-title":"Am J Health Syst Pharm"},{"key":"1717_CR17","unstructured":"Cochrane Handbook for Systematic Reviews of Interventions. https:\/\/training.cochrane.org\/handbook\/current. Accessed 31 Dec 2023."},{"key":"1717_CR18","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.n71","volume":"372","author":"MJ Page","year":"2021","unstructured":"Page MJ, McKenzie JE, Bossuyt PM, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372: n71. https:\/\/doi.org\/10.1136\/bmj.n71.","journal-title":"BMJ"},{"issue":"5","key":"1717_CR19","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1016\/0895-4356(93)90018-v","volume":"46","author":"T Byrt","year":"1993","unstructured":"Byrt T, Bishop J, Carlin JB. Bias, prevalence and kappa. J Clin Epidemiol. 1993;46(5):423\u20139. https:\/\/doi.org\/10.1016\/0895-4356(93)90018-v.","journal-title":"J Clin Epidemiol"},{"key":"1717_CR20","volume-title":"Appraisal of Indicators through Research and Evaluation (AIRE)","author":"J de Koning","year":"2007","unstructured":"de Koning J, Smulders A, Klazinga N. Appraisal of Indicators through Research and Evaluation (AIRE). Amsterdam: Academic Medical Center-University of Amsterdam; 2007."},{"key":"1717_CR21","unstructured":"de Koning J. Development and validation of a measurement instrument for appraising indicator quality: appraisal of indicators through research and evaluation (AIRE) instrument. https:\/\/www.egms.de\/static\/en\/meetings\/gmds2007\/07gmds798.shtml. Accessed 31 Dec 2023."},{"issue":"4","key":"1717_CR22","doi-asserted-by":"publisher","first-page":"556","DOI":"10.1016\/j.jpainsymman.2012.09.013","volume":"46","author":"ML De Roo","year":"2013","unstructured":"De Roo ML, Leemans K, Claessen SJ, et al. Quality indicators for palliative care: update of a systematic review. J Pain Symptom Manag. 2013;46(4):556\u201372. https:\/\/doi.org\/10.1016\/j.jpainsymman.2012.09.013.","journal-title":"J Pain Symptom Manag"},{"issue":"8","key":"1717_CR23","doi-asserted-by":"publisher","first-page":"3099","DOI":"10.1590\/1413-81232021268.03802020","volume":"26","author":"D Bicalho","year":"2021","unstructured":"Bicalho D, Santos TSS, Slater B, et al. Evaluation of quality indicators for management of the National School Feeding Program in Brazil: a systematic review. Cien Saude Colet. 2021;26(8):3099\u2013110. https:\/\/doi.org\/10.1590\/1413-81232021268.03802020.","journal-title":"Cien Saude Colet"},{"issue":"1","key":"1717_CR24","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1111\/cdoe.12429","volume":"47","author":"AJ Righolt","year":"2019","unstructured":"Righolt AJ, Sidorenkov G, Faggion CM Jr, et al. Quality measures for dental care: a systematic review. Community Dent Oral Epidemiol. 2019;47(1):12\u201323. https:\/\/doi.org\/10.1111\/cdoe.12429.","journal-title":"Community Dent Oral Epidemiol"},{"issue":"1","key":"1717_CR25","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0190298","volume":"13","author":"KJ Joling","year":"2018","unstructured":"Joling KJ, van Eenoo L, Vetrano DL, et al. Quality indicators for community care for older people: a systematic review. PLoS ONE. 2018;13(1): e0190298. https:\/\/doi.org\/10.1371\/journal.pone.0190298.","journal-title":"PLoS ONE"},{"issue":"1","key":"1717_CR26","doi-asserted-by":"publisher","first-page":"1408","DOI":"10.1186\/s12913-022-08804-7","volume":"22","author":"M Osinska","year":"2022","unstructured":"Osinska M, Favez L, Zuniga F. Evidence for publicly reported quality indicators in residential long-term care: a systematic review. BMC Health Serv Res. 2022;22(1):1408. https:\/\/doi.org\/10.1186\/s12913-022-08804-7.","journal-title":"BMC Health Serv Res"},{"issue":"2","key":"1717_CR27","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1111\/acem.12591","volume":"22","author":"K Strudwick","year":"2015","unstructured":"Strudwick K, Nelson M, Martin-Khan M, et al. Quality indicators for musculoskeletal injury management in the emergency department: a systematic review. Acad Emerg Med. 2015;22(2):127\u201341. https:\/\/doi.org\/10.1111\/acem.12591.","journal-title":"Acad Emerg Med"},{"issue":"12","key":"1717_CR28","doi-asserted-by":"publisher","first-page":"1743","DOI":"10.1001\/jama.260.12.1743","volume":"260","author":"A Donabedian","year":"1988","unstructured":"Donabedian A. The quality of care. How can it be assessed? JAMA. 1988;260(12):1743\u20138. https:\/\/doi.org\/10.1001\/jama.260.12.1743.","journal-title":"JAMA"},{"issue":"6","key":"1717_CR29","first-page":"1121","volume":"15","author":"CM Kozma","year":"1993","unstructured":"Kozma CM, Reeder CE, Schulz RM. Economic, clinical, and humanistic outcomes: a planning model for pharmacoeconomic research. Clin Ther. 1993;15(6):1121\u201332.","journal-title":"Clin Ther"},{"issue":"2","key":"1717_CR30","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1111\/j.1759-8893.2010.00001.x","volume":"1","author":"J Ng","year":"2010","unstructured":"Ng J, Harrison J. Key performance indicators for clinical pharmacy services in New Zealand public hospitals: stakeholder perspectives. J Pharm Health Ser Res. 2010;1(2):75\u201384. https:\/\/doi.org\/10.1111\/j.1759-8893.2010.00001.x.","journal-title":"J Pharm Health Ser Res"},{"issue":"3","key":"1717_CR31","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1016\/j.phclin.2013.03.006","volume":"48","author":"S Doerper","year":"2013","unstructured":"Doerper S, Morice S, Piney D, et al. La conciliation des traitements m\u00e9dicamenteux: logigramme d\u2019une d\u00e9marche efficiente pour pr\u00e9venir ou intercepter les erreurs m\u00e9dicamenteuses \u00e0 l\u2019admission du patient hospitalis\u00e9. Pharm Hosp Clin. 2013;48(3):153\u201360. https:\/\/doi.org\/10.1016\/j.phclin.2013.03.006.","journal-title":"Pharm Hosp Clin"},{"issue":"6","key":"1717_CR32","doi-asserted-by":"publisher","first-page":"656","DOI":"10.1177\/1060028015577445","volume":"49","author":"O Fernandes","year":"2015","unstructured":"Fernandes O, Gorman SK, Slavik RS, et al. Development of clinical pharmacy key performance indicators for hospital pharmacists using a modified Delphi approach. Ann Pharmacother. 2015;49(6):656\u201369. https:\/\/doi.org\/10.1177\/1060028015577445.","journal-title":"Ann Pharmacother"},{"issue":"1","key":"1717_CR33","first-page":"55","volume":"69","author":"O Fernandes","year":"2016","unstructured":"Fernandes O, Gorman SK, Slavik RS, et al. Development of clinical pharmacy key performance indicators for hospital pharmacists using a modified Delphi approach. Can J Hosp Pharm. 2016;69(1):55.","journal-title":"Can J Hosp Pharm"},{"issue":"3","key":"1717_CR34","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1111\/ijpp.12234","volume":"24","author":"MS Aljamal","year":"2016","unstructured":"Aljamal MS, Ashcroft D, Tully MP. Development of indicators to assess the quality of medicines reconciliation at hospital admission: an e-Delphi study. Int J Pharm Pract. 2016;24(3):209\u201316. https:\/\/doi.org\/10.1111\/ijpp.12234.","journal-title":"Int J Pharm Pract"},{"issue":"2","key":"1717_CR35","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1002\/jppr.1156","volume":"47","author":"GF Lloyd","year":"2016","unstructured":"Lloyd GF, Singh S, Barclay P, et al. Hospital pharmacists\u2019 perspectives on the role of key performance indicators in Australian pharmacy practice. J Pharm Pract Res. 2016;47(2):87\u201395. https:\/\/doi.org\/10.1002\/jppr.1156.","journal-title":"J Pharm Pract Res"},{"issue":"6","key":"1717_CR36","doi-asserted-by":"publisher","first-page":"1462","DOI":"10.1007\/s11096-018-0725-6","volume":"40","author":"M Cillis","year":"2018","unstructured":"Cillis M, Spinewine A, Krug B, et al. Development of a tool for benchmarking of clinical pharmacy activities. Int J Clin Pharm. 2018;40(6):1462\u201373. https:\/\/doi.org\/10.1007\/s11096-018-0725-6.","journal-title":"Int J Clin Pharm"},{"issue":"3","key":"1717_CR37","doi-asserted-by":"publisher","first-page":"533","DOI":"10.1007\/s11096-018-0623-y","volume":"40","author":"N Krzyzaniak","year":"2018","unstructured":"Krzyzaniak N, Pawlowska I, Bajorek B. Quality pharmacy services and key performance indicators in Polish NICUs: a Delphi approach. Int J Clin Pharm. 2018;40(3):533\u201342. https:\/\/doi.org\/10.1007\/s11096-018-0623-y.","journal-title":"Int J Clin Pharm"},{"key":"1717_CR38","doi-asserted-by":"publisher","first-page":"7527543","DOI":"10.1155\/2020\/7527543","volume":"2020","author":"R Shawahna","year":"2020","unstructured":"Shawahna R. Development of key performance indicators for capturing impact of pharmaceutical care in palestinian integrative healthcare facilities: a Delphi consensus study. Evid Based Complement Alternat Med. 2020;2020:7527543. https:\/\/doi.org\/10.1155\/2020\/7527543.","journal-title":"Evid Based Complement Alternat Med"},{"issue":"4","key":"1717_CR39","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1177\/0018578719897074","volume":"56","author":"AS Al-Jazairi","year":"2021","unstructured":"Al-Jazairi AS, Alnakhli AO. Quantifying clinical pharmacist activities in a tertiary care hospital using key performance indicators. Hosp Pharm. 2021;56(4):321\u20137. https:\/\/doi.org\/10.1177\/0018578719897074.","journal-title":"Hosp Pharm"},{"issue":"7","key":"1717_CR40","doi-asserted-by":"publisher","first-page":"883","DOI":"10.1002\/jac5.1479","volume":"4","author":"PK King","year":"2021","unstructured":"King PK, Burkhardt C, Rafferty A, et al. Quality measures of clinical pharmacy services during transitions of care. J Am Coll Clin Pharm. 2021;4(7):883\u2013907. https:\/\/doi.org\/10.1002\/jac5.1479.","journal-title":"J Am Coll Clin Pharm"},{"issue":"6","key":"1717_CR41","doi-asserted-by":"publisher","first-page":"1660","DOI":"10.1007\/s11096-021-01298-z","volume":"43","author":"H Lopes","year":"2021","unstructured":"Lopes H, Lopes AR, Farinha H, et al. Defining clinical pharmacy and support activities indicators for hospital practice using a combined nominal and focus group technique. Int J Clin Pharm. 2021;43(6):1660\u201382. https:\/\/doi.org\/10.1007\/s11096-021-01298-z.","journal-title":"Int J Clin Pharm"},{"issue":"3","key":"1717_CR42","first-page":"205","volume":"35","author":"J Ruiz Ramos","year":"2023","unstructured":"Ruiz Ramos J, Calderon Hernanz B, Castellanos Clemente Y, et al. Pharmacist care in hospital emergency departments: a consensus paper from the Spanish hospital pharmacy and emergency medicine associations. Emergencias. 2023;35(3):205\u201317.","journal-title":"Emergencias"},{"issue":"4","key":"1717_CR43","doi-asserted-by":"publisher","first-page":"180","DOI":"10.37532\/0976-0113.13(4).180","volume":"13","author":"C Anene-Okeke","year":"2022","unstructured":"Anene-Okeke C. Clinical pharmacy Key Performance Indicators (cpKPI) for hospital pharmacists in Nigeria. J Basic Clin Pharm. 2022;13(4):180\u20135. https:\/\/doi.org\/10.37532\/0976-0113.13(4).180.","journal-title":"J Basic Clin Pharm"},{"issue":"3 Suppl","key":"1717_CR44","doi-asserted-by":"publisher","first-page":"166","DOI":"10.2307\/3348969","volume":"44","author":"A Donabedian","year":"1966","unstructured":"Donabedian A. Evaluating the quality of medical care. Milbank Mem Fund Q. 1966;44(3 Suppl):166\u2013206. https:\/\/doi.org\/10.2307\/3348969.","journal-title":"Milbank Mem Fund Q"},{"issue":"5","key":"1717_CR45","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1016\/j.sapharm.2017.05.011","volume":"14","author":"TM Lima","year":"2018","unstructured":"Lima TM, Aguiar PM, Storpirtis S. Evaluation of quality indicator instruments for pharmaceutical care services: a systematic review and psychometric properties analysis. Res Social Adm Pharm. 2018;14(5):405\u201312. https:\/\/doi.org\/10.1016\/j.sapharm.2017.05.011.","journal-title":"Res Social Adm Pharm"},{"issue":"6","key":"1717_CR46","doi-asserted-by":"publisher","first-page":"1406","DOI":"10.1093\/jac\/dkab034","volume":"76","author":"F O'Riordan","year":"2021","unstructured":"O\u2019Riordan F, Shiely F, Byrne S, et al. Quality indicators for hospital antimicrobial stewardship programmes: a systematic review. J Antimicrob Chemother. 2021;76(6):1406\u201319. https:\/\/doi.org\/10.1093\/jac\/dkab034.","journal-title":"J Antimicrob Chemother"},{"issue":"5","key":"1717_CR47","doi-asserted-by":"publisher","first-page":"781","DOI":"10.1007\/s00228-022-03287-1","volume":"78","author":"AK Aung","year":"2022","unstructured":"Aung AK, Walker S, Khu YL, et al. Adverse drug reaction management in hospital settings: review on practice variations, quality indicators and education focus. Eur J Clin Pharmacol. 2022;78(5):781\u201391. https:\/\/doi.org\/10.1007\/s00228-022-03287-1.","journal-title":"Eur J Clin Pharmacol"},{"issue":"11","key":"1717_CR48","doi-asserted-by":"publisher","first-page":"1027","DOI":"10.1016\/j.sapharm.2018.01.001","volume":"14","author":"H Nazar","year":"2018","unstructured":"Nazar H, Nazar Z, Yeung A, et al. Consensus methodology to determine minor ailments appropriate to be directed for management within community pharmacy. Res Soc Adm Pharm. 2018;14(11):1027\u201342. https:\/\/doi.org\/10.1016\/j.sapharm.2018.01.001.","journal-title":"Res Soc Adm Pharm"},{"issue":"1","key":"1717_CR49","doi-asserted-by":"publisher","first-page":"347","DOI":"10.1007\/s00520-021-06404-5","volume":"30","author":"A Lemanska","year":"2022","unstructured":"Lemanska A, Poole K, Manders R, et al. Patient activation and patient-reported outcomes of men from a community pharmacy lifestyle intervention after prostate cancer treatment. Support Care Cancer. 2022;30(1):347\u201358. https:\/\/doi.org\/10.1007\/s00520-021-06404-5.","journal-title":"Support Care Cancer"},{"issue":"6","key":"1717_CR50","doi-asserted-by":"publisher","first-page":"1445","DOI":"10.1007\/s11096-016-0385-3","volume":"38","author":"T Dreischulte","year":"2016","unstructured":"Dreischulte T, Fernandez-Llimos F. Current perceptions of the term clinical pharmacy and its relationship to pharmaceutical care: a survey of members of the European Society of Clinical Pharmacy. Int J Clin Pharm. 2016;38(6):1445\u201356. https:\/\/doi.org\/10.1007\/s11096-016-0385-3.","journal-title":"Int J Clin Pharm"},{"issue":"4","key":"1717_CR51","doi-asserted-by":"publisher","first-page":"930","DOI":"10.1007\/s11096-022-01403-w","volume":"44","author":"D Greenwood","year":"2022","unstructured":"Greenwood D, Tully MP, Martin S, et al. Development of the Manchester framework for the evaluation of emergency department pharmacy services. Int J Clin Pharm. 2022;44(4):930\u20138. https:\/\/doi.org\/10.1007\/s11096-022-01403-w.","journal-title":"Int J Clin Pharm"},{"issue":"6","key":"1717_CR52","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0020476","volume":"6","author":"R Boulkedid","year":"2011","unstructured":"Boulkedid R, Abdoul H, Loustau M, et al. Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review. PLoS ONE. 2011;6(6): e20476. https:\/\/doi.org\/10.1371\/journal.pone.0020476.","journal-title":"PLoS ONE"},{"key":"1717_CR53","doi-asserted-by":"publisher","DOI":"10.1007\/s11096-023-01681-y","author":"ML Canning","year":"2024","unstructured":"Canning ML, Barras M, McDougall R, et al. Defining quality indicators, pharmaceutical care bundles and outcomes of clinical pharmacy service delivery using a Delphi consensus approach. Int J Clin Pharm. 2024. https:\/\/doi.org\/10.1007\/s11096-023-01681-y.","journal-title":"Int J Clin Pharm"},{"issue":"1","key":"1717_CR54","doi-asserted-by":"publisher","first-page":"557","DOI":"10.1186\/s12889-018-5463-0","volume":"18","author":"A Freitas","year":"2018","unstructured":"Freitas A, Santana P, Oliveira MD, et al. Indicators for evaluating European population health: a Delphi selection process. BMC Public Health. 2018;18(1):557. https:\/\/doi.org\/10.1186\/s12889-018-5463-0.","journal-title":"BMC Public Health"},{"issue":"10","key":"1717_CR55","doi-asserted-by":"publisher","first-page":"1083","DOI":"10.1016\/j.healthpol.2020.06.012","volume":"124","author":"L Franco-Trigo","year":"2020","unstructured":"Franco-Trigo L, Fernandez-Llimos F, Martinez-Martinez F, et al. Stakeholder analysis in health innovation planning processes: a systematic scoping review. Health Policy. 2020;124(10):1083\u201399. https:\/\/doi.org\/10.1016\/j.healthpol.2020.06.012.","journal-title":"Health Policy"},{"issue":"4","key":"1717_CR56","doi-asserted-by":"publisher","first-page":"837","DOI":"10.1007\/s11096-022-01422-7","volume":"44","author":"T Dreischulte","year":"2022","unstructured":"Dreischulte T, van den Bemt B, Steurbaut S, et al. European Society of Clinical Pharmacy definition of the term clinical pharmacy and its relationship to pharmaceutical care: a position paper. Int J Clin Pharm. 2022;44(4):837\u201342. https:\/\/doi.org\/10.1007\/s11096-022-01422-7.","journal-title":"Int J Clin Pharm"},{"issue":"3","key":"1717_CR57","first-page":"533","volume":"47","author":"CD Hepler","year":"1990","unstructured":"Hepler CD, Strand LM. Opportunities and responsibilities in pharmaceutical care. Am J Hosp Pharm. 1990;47(3):533\u201343.","journal-title":"Am J Hosp Pharm"},{"issue":"3","key":"1717_CR58","doi-asserted-by":"publisher","first-page":"544","DOI":"10.1007\/s11096-014-9933-x","volume":"36","author":"SS Allemann","year":"2014","unstructured":"Allemann SS, van Mil JW, Botermann L, et al. Pharmaceutical care: the PCNE definition 2013. Int J Clin Pharm. 2014;36(3):544\u201355. https:\/\/doi.org\/10.1007\/s11096-014-9933-x.","journal-title":"Int J Clin Pharm"},{"issue":"10","key":"1717_CR59","doi-asserted-by":"crossref","first-page":"193g","DOI":"10.5688\/aj7410193","volume":"74","author":"SI Ahmed","year":"2010","unstructured":"Ahmed SI, Hasan SS, Hassali MA. Clinical pharmacy and pharmaceutical care: a need to homogenize the concepts. Am J Pharm Educ. 2010;74(10):193g.","journal-title":"Am J Pharm Educ"},{"issue":"8","key":"1717_CR60","doi-asserted-by":"publisher","first-page":"1239","DOI":"10.1007\/s10198-021-01333-w","volume":"22","author":"BH Salampessy","year":"2021","unstructured":"Salampessy BH, Portrait FRM, van der Hijden E, et al. On the correlation between outcome indicators and the structure and process indicators used to proxy them in public health care reporting. Eur J Health Econ. 2021;22(8):1239\u201351. https:\/\/doi.org\/10.1007\/s10198-021-01333-w.","journal-title":"Eur J Health Econ"},{"issue":"6","key":"1717_CR61","doi-asserted-by":"publisher","first-page":"504","DOI":"10.1056\/NEJMp1511701","volume":"374","author":"ME Porter","year":"2016","unstructured":"Porter ME, Larsson S, Lee TH. Standardizing patient outcomes measurement. N Engl J Med. 2016;374(6):504\u20136. https:\/\/doi.org\/10.1056\/NEJMp1511701.","journal-title":"N Engl J Med"},{"issue":"26","key":"1717_CR62","doi-asserted-by":"publisher","first-page":"2477","DOI":"10.1056\/NEJMp1011024","volume":"363","author":"ME Porter","year":"2010","unstructured":"Porter ME. What is value in health care? N Engl J Med. 2010;363(26):2477\u201381. https:\/\/doi.org\/10.1056\/NEJMp1011024.","journal-title":"N Engl J Med"},{"issue":"5","key":"1717_CR63","doi-asserted-by":"publisher","first-page":"449","DOI":"10.1097\/PHH.0000000000000124","volume":"21","author":"JS Townsend","year":"2015","unstructured":"Townsend JS, Moore AR, Mulder TN, et al. What does a performance measurement system tell us about the national comprehensive cancer control program? J Public Health Manag Pract. 2015;21(5):449\u201358. https:\/\/doi.org\/10.1097\/PHH.0000000000000124.","journal-title":"J Public Health Manag Pract"},{"key":"1717_CR64","doi-asserted-by":"publisher","DOI":"10.3390\/pharmacy5020028","author":"LJ Kjeldsen","year":"2017","unstructured":"Kjeldsen LJ, Olesen C, Hansen MK, et al. Clinical Outcomes Used in Clinical Pharmacy Intervention Studies in Secondary Care. Pharmacy. 2017. https:\/\/doi.org\/10.3390\/pharmacy5020028.","journal-title":"Pharmacy"},{"issue":"22","key":"1717_CR65","doi-asserted-by":"publisher","first-page":"2348","DOI":"10.2146\/ajhp050358","volume":"62","author":"F Fernandez-Llimos","year":"2005","unstructured":"Fernandez-Llimos F, Faus MJ. From \u201cdrug-related problems\u201d to \u201cnegative clinical outcomes.\u201d Am J Health Syst Pharm. 2005;62(22):2348. https:\/\/doi.org\/10.2146\/ajhp050358.","journal-title":"Am J Health Syst Pharm"},{"issue":"4","key":"1717_CR66","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0152903","volume":"11","author":"LV Minard","year":"2016","unstructured":"Minard LV, Deal H, Harrison ME, et al. Pharmacists\u2019 perceptions of the barriers and facilitators to the implementation of clinical pharmacy Key Performance Indicators. PLoS ONE. 2016;11(4): e0152903. https:\/\/doi.org\/10.1371\/journal.pone.0152903.","journal-title":"PLoS ONE"},{"issue":"11","key":"1717_CR67","doi-asserted-by":"publisher","first-page":"964","DOI":"10.1136\/bmjqs-2012-001081","volume":"21","author":"GS Meyer","year":"2012","unstructured":"Meyer GS, Nelson EC, Pryor DB, et al. More quality measures versus measuring what matters: a call for balance and parsimony. BMJ Qual Saf. 2012;21(11):964\u20138. https:\/\/doi.org\/10.1136\/bmjqs-2012-001081.","journal-title":"BMJ Qual Saf"},{"key":"1717_CR68","unstructured":"Agency for Healthcare Research and Quality. AHRQ quality indicator tools for data analytics https:\/\/www.ahrq.gov\/data\/qualityindicators\/index.html. Accessed 30 Dec 2023."},{"issue":"7","key":"1717_CR69","doi-asserted-by":"publisher","first-page":"683","DOI":"10.1056\/NEJMsb1002320","volume":"363","author":"MR Chassin","year":"2010","unstructured":"Chassin MR, Loeb JM, Schmaltz SP, et al. Accountability measures\u2013using measurement to promote quality improvement. N Engl J Med. 2010;363(7):683\u20138. https:\/\/doi.org\/10.1056\/NEJMsb1002320.","journal-title":"N Engl J Med"},{"issue":"1","key":"1717_CR70","doi-asserted-by":"publisher","first-page":"2302","DOI":"10.18549\/PharmPract.2021.1.2302","volume":"19","author":"FS Tonin","year":"2021","unstructured":"Tonin FS, Aznar-Lou I, Pontinha VM, et al. Principles of pharmacoeconomic analysis: the case of pharmacist-led interventions. Pharm Pract. 2021;19(1):2302. https:\/\/doi.org\/10.18549\/PharmPract.2021.1.2302.","journal-title":"Pharm Pract"},{"key":"1717_CR71","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1016\/j.jclinepi.2023.06.013","volume":"160","author":"AM Manyara","year":"2023","unstructured":"Manyara AM, Davies P, Stewart D, et al. Definitions, acceptability, limitations, and guidance in the use and reporting of surrogate end points in trials: a scoping review. J Clin Epidemiol. 2023;160:83\u201399. https:\/\/doi.org\/10.1016\/j.jclinepi.2023.06.013.","journal-title":"J Clin Epidemiol"}],"container-title":["International Journal of Clinical Pharmacy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11096-024-01717-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11096-024-01717-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11096-024-01717-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,28]],"date-time":"2024-05-28T18:43:17Z","timestamp":1716921797000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11096-024-01717-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,3]]},"references-count":71,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,6]]}},"alternative-id":["1717"],"URL":"https:\/\/doi.org\/10.1007\/s11096-024-01717-x","relation":{},"ISSN":["2210-7703","2210-7711"],"issn-type":[{"value":"2210-7703","type":"print"},{"value":"2210-7711","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,3]]},"assertion":[{"value":"11 January 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 February 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 April 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"No conflicts of interest existed for this study.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest"}}]}}