{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,27]],"date-time":"2026-09-27T12:25:15Z","timestamp":1790511915026,"version":"4.1.0"},"reference-count":48,"publisher":"BMJ","issue":"3","content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["BMJ Open"],"accepted":{"date-parts":[[2015,12,15]]},"published-print":{"date-parts":[[2016,3]]},"abstract":"<jats:sec>\n                    <jats:title>Objectives<\/jats:title>\n                    <jats:p>Following appropriate validation, clinical prediction rules (CPRs) should undergo impact analysis to evaluate their effect on patient care. The aim of this systematic review is to narratively review and critically appraise CPR impact analysis studies relevant to primary care.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Setting<\/jats:title>\n                    <jats:p>Primary care.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Participants<\/jats:title>\n                    <jats:p>Adults and children.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Intervention<\/jats:title>\n                    <jats:p>Studies that implemented the CPR compared to usual care were included.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Study design<\/jats:title>\n                    <jats:p>Randomised controlled trial (RCT), controlled before\u2013after, and interrupted time series.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Primary outcome<\/jats:title>\n                    <jats:p>Physician behaviour and\/or patient outcomes.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>A total of 18 studies, incorporating 14 unique CPRs, were included. The main study design was RCT (n=13). Overall, 10 studies reported an improvement in primary outcome with CPR implementation. Of 6 musculoskeletal studies, 5 were effective in altering targeted physician behaviour in ordering imaging for patients presenting with ankle, knee and neck musculoskeletal injuries. Of 6 cardiovascular studies, 4 implemented cardiovascular risk scores, and 3 reported no impact on physician behaviour outcomes, such as prescribing and referral, or patient outcomes, such as reduction in serum lipid levels. 2 studies examined CPRs in decision-making for patients presenting with chest pain and reduced inappropriate admissions. Of 5 respiratory studies, 2 were effective in reducing antibiotic prescribing for sore throat following CPR implementation. Overall, study methodological quality was often unclear due to incomplete reporting.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Despite increasing interest in developing and validating CPRs relevant to primary care, relatively few have gone through impact analysis. To date, research has focused on a small number of CPRs across few clinical domains only.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1136\/bmjopen-2015-009957","type":"journal-article","created":{"date-parts":[[2016,3,15]],"date-time":"2016-03-15T22:53:56Z","timestamp":1458082436000},"page":"e009957","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":41,"title":["Impact analysis studies of clinical prediction rules relevant to primary care: a systematic review"],"prefix":"10.1136","volume":"6","author":[{"given":"Emma","family":"Wallace","sequence":"first","affiliation":[{"name":"HRB Centre for Primary Care Research, Royal College of Surgeons in Ireland, Dublin 2, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maike J M","family":"Uijen","sequence":"additional","affiliation":[{"name":"HRB Centre for Primary Care Research, Royal College of Surgeons in Ireland, Dublin 2, Ireland"},{"name":"Medical school, Radboud University, Nijmegen, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Barbara","family":"Clyne","sequence":"additional","affiliation":[{"name":"HRB Centre for Primary Care Research, Royal College of Surgeons in Ireland, Dublin 2, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Atieh","family":"Zarabzadeh","sequence":"additional","affiliation":[{"name":"HRB Centre for Primary Care Research, Royal College of Surgeons in Ireland, Dublin 2, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Claire","family":"Keogh","sequence":"additional","affiliation":[{"name":"HRB Centre for Primary Care Research, Royal College of Surgeons in Ireland, Dublin 2, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rose","family":"Galvin","sequence":"additional","affiliation":[{"name":"HRB Centre for Primary Care Research, Royal College of Surgeons in Ireland, Dublin 2, Ireland"},{"name":"Department of Clinical Therapies, University of Limerick, Limerick, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Susan M","family":"Smith","sequence":"additional","affiliation":[{"name":"HRB Centre for Primary Care Research, Royal College of Surgeons in Ireland, Dublin 2, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tom","family":"Fahey","sequence":"additional","affiliation":[{"name":"HRB Centre for Primary Care Research, Royal College of Surgeons in Ireland, Dublin 2, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2016,3,15]]},"reference":[{"key":"2025120618001220000_6.3.e009957.1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.284.1.79"},{"key":"2025120618001220000_6.3.e009957.2","doi-asserted-by":"publisher","DOI":"10.1370\/afm.1640"},{"key":"2025120618001220000_6.3.e009957.3","doi-asserted-by":"publisher","DOI":"10.1056\/NEJM198509263131306"},{"key":"2025120618001220000_6.3.e009957.4","doi-asserted-by":"publisher","DOI":"10.1001\/jama.1997.03540300056034"},{"key":"2025120618001220000_6.3.e009957.5","doi-asserted-by":"publisher","DOI":"10.7326\/0003-4819-144-3-200602070-00009"},{"key":"2025120618001220000_6.3.e009957.6","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2008.04.008"},{"key":"2025120618001220000_6.3.e009957.7","doi-asserted-by":"publisher","DOI":"10.1186\/1472-6947-11-62"},{"key":"2025120618001220000_6.3.e009957.8","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.b606"},{"key":"2025120618001220000_6.3.e009957.9","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2010.11.011"},{"key":"2025120618001220000_6.3.e009957.10","doi-asserted-by":"crossref","unstructured":"Ebell MH . Evidence-based diagnosis: a handbook of clinical prediction rules. New York: Springer-Verlag, 2001.","DOI":"10.1007\/978-1-4757-3514-7"},{"key":"2025120618001220000_6.3.e009957.11","unstructured":"Allen J , Gay BG , Crebolder H , et al . The European Definition of General Practice\/Family Medicine. Short version. WONCA Europe, 2011. http:\/\/www.unige.ch\/medecine\/umpr\/Enseignement\/stage3ememaster\/Definition_wonca_tree.pdf (accessed 18 Mar 2014)."},{"key":"2025120618001220000_6.3.e009957.12","unstructured":"WONCA International Classification Committee. The international classification of primary care. 2nd edn. http:\/\/www.kith.no\/upload\/2705\/icpc-2-english.pdf (accessed: 22 Mar 2014)."},{"key":"2025120618001220000_6.3.e009957.13","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.d5928"},{"key":"2025120618001220000_6.3.e009957.14","unstructured":"Cochrane Handbook for Systematic Reviews of Interventions. Version 5.1.0. March, 2011. http:\/\/handbook.cochrane.org\/"},{"key":"2025120618001220000_6.3.e009957.15","doi-asserted-by":"publisher","DOI":"10.1001\/jama.1997.03540480035035"},{"key":"2025120618001220000_6.3.e009957.16","doi-asserted-by":"publisher","DOI":"10.1001\/jama.1994.03510350037034"},{"key":"2025120618001220000_6.3.e009957.17","doi-asserted-by":"publisher","DOI":"10.1001\/jama.1997.03550230051036"},{"key":"2025120618001220000_6.3.e009957.18","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.b4146"},{"key":"2025120618001220000_6.3.e009957.19","first-page":"1165","article-title":"No impact from active dissemination of the Ottawa Ankle Rules: further evidence of the need for local implementation of practice guidelines","volume":"160","author":"Cameron","year":"1999","journal-title":"CMAJ"},{"key":"2025120618001220000_6.3.e009957.20","doi-asserted-by":"publisher","DOI":"10.1503\/cmaj.122050"},{"key":"2025120618001220000_6.3.e009957.21","doi-asserted-by":"publisher","DOI":"10.1056\/NEJM198405173102001"},{"key":"2025120618001220000_6.3.e009957.22","doi-asserted-by":"publisher","DOI":"10.1016\/j.annemergmed.2008.09.034"},{"key":"2025120618001220000_6.3.e009957.23","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.326.7383.251"},{"key":"2025120618001220000_6.3.e009957.24","first-page":"943","article-title":"[The estimation of cardiovascular risk in hypertensive patients is not modified by management of the hypertension]","volume":"93","author":"Hanon","year":"2000","journal-title":"Arch Mal Coeur Vaiss"},{"key":"2025120618001220000_6.3.e009957.25","doi-asserted-by":"publisher","DOI":"10.1007\/s11606-008-0825-4"},{"key":"2025120618001220000_6.3.e009957.26","doi-asserted-by":"publisher","DOI":"10.1001\/archinte.167.21.2296"},{"key":"2025120618001220000_6.3.e009957.27","doi-asserted-by":"publisher","DOI":"10.1007\/s11606-012-2268-1"},{"key":"2025120618001220000_6.3.e009957.28","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1177\/0272989X9801800211","article-title":"Effect of an explicit decision-support tool on decisions to prescribe antibiotics for sore throat","volume":"18","author":"McIsaac","year":"1998","journal-title":"Med Decis Making"},{"key":"2025120618001220000_6.3.e009957.29","first-page":"339","article-title":"Effect on antibiotic prescribing of repeated clinical prompts to use a sore throat score: lessons from a failed community intervention study","volume":"51","author":"McIsaac","year":"2002","journal-title":"J Fam Pract"},{"key":"2025120618001220000_6.3.e009957.30","first-page":"666","article-title":"Diagnosing streptococcal sore throat in adults: randomized controlled trial of in-office aids","volume":"53","author":"Worrall","year":"2007","journal-title":"Can Fam Physician"},{"key":"2025120618001220000_6.3.e009957.31","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.f5806"},{"key":"2025120618001220000_6.3.e009957.32","doi-asserted-by":"crossref","first-page":"1584","DOI":"10.1001\/jamainternmed.2013.8980","article-title":"Efficacy of an evidence-based clinical decision support in primary care practices: a randomized clinical trial","volume":"173","author":"McGinn","year":"2013","journal-title":"JAMA Intern Med"},{"key":"2025120618001220000_6.3.e009957.33","doi-asserted-by":"publisher","DOI":"10.1503\/cmaj.091974"},{"key":"2025120618001220000_6.3.e009957.34","first-page":"75","article-title":"A clinical score to reduce unnecessary antibiotic use in patients with sore throat","volume":"158","author":"McIsaac","year":"1998","journal-title":"CMAJ"},{"key":"2025120618001220000_6.3.e009957.35","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.311.7005.594"},{"key":"2025120618001220000_6.3.e009957.36","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.b3056"},{"key":"2025120618001220000_6.3.e009957.37","doi-asserted-by":"publisher","DOI":"10.1016\/j.jemermed.2004.08.016"},{"key":"2025120618001220000_6.3.e009957.38","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(08)61769-9"},{"key":"2025120618001220000_6.3.e009957.39","doi-asserted-by":"publisher","DOI":"10.1136\/emj.2003.011353"},{"key":"2025120618001220000_6.3.e009957.40","doi-asserted-by":"crossref","first-page":"421","DOI":"10.2217\/cer.12.51","article-title":"Struggling to bring clinical prediction rules to the point of care: missed opportunities to impact patient care","volume":"1","author":"Karlin-Zysman","year":"2012","journal-title":"J Comp Eff Res"},{"key":"2025120618001220000_6.3.e009957.41","doi-asserted-by":"publisher","DOI":"10.1542\/peds.2011-0043"},{"key":"2025120618001220000_6.3.e009957.42","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.1001744"},{"key":"2025120618001220000_6.3.e009957.43","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1016\/j.jclinepi.2014.11.010","article-title":"Transparent reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): the TRIPOD statement","volume":"68","author":"Collins","year":"2015","journal-title":"J Clin Epidemiol"},{"key":"2025120618001220000_6.3.e009957.44","doi-asserted-by":"publisher","DOI":"10.3399\/bjgp14X677860"},{"key":"2025120618001220000_6.3.e009957.45","unstructured":"O'Rourke N . Review of Referral Patterns and Triage Processes in Symptomatic Breast Units. A hospital perspective. Dublin: National Cancer Control Programme; 2012."},{"key":"2025120618001220000_6.3.e009957.46","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1186\/1471-2407-14-743","article-title":"Development and validation of a clinical prediction rule to identify suspected breast cancer: a prospective cohort study.","volume":"14","author":"Galvin","year":"2014","journal-title":"BMC cancer"},{"key":"2025120618001220000_6.3.e009957.47","unstructured":"Framingham Heart Study. 2014. https:\/\/www.framinghamheartstudy.org\/risk-functions\/coronary-heart-disease\/10-year-risk.php (accessed 15 Jun 2015)."},{"key":"2025120618001220000_6.3.e009957.48","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.c6624"}],"container-title":["BMJ Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmjopen-2015-009957","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,7]],"date-time":"2025-12-07T02:00:22Z","timestamp":1765072822000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmjopen.bmj.com\/lookup\/doi\/10.1136\/bmjopen-2015-009957"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,3]]},"references-count":48,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2016,3,15]]},"published-print":{"date-parts":[[2016,3]]}},"alternative-id":["10.1136\/bmjopen-2015-009957"],"URL":"https:\/\/doi.org\/10.1136\/bmjopen-2015-009957","relation":{},"ISSN":["2044-6055","2044-6055"],"issn-type":[{"value":"2044-6055","type":"print"},{"value":"2044-6055","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,3]]}}}