{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T10:03:34Z","timestamp":1780653814504,"version":"3.54.1"},"reference-count":24,"publisher":"Cambridge University Press (CUP)","issue":"4","license":[{"start":{"date-parts":[[2014,2,14]],"date-time":"2014-02-14T00:00:00Z","timestamp":1392336000000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"content-domain":{"domain":["journals.cambridge.org"],"crossmark-restriction":true},"short-container-title":["Prim Health Care Res Dev"],"published-print":{"date-parts":[[2014,10]]},"abstract":"<jats:sec id=\"S146342361400005X_abs1\" sec-type=\"general\">\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Data on the uptake of clinical guidelines into practice are\n                            essential to guide and evaluate quality improvement interventions.\n                            Organizations responsible for service specification, monitoring and\n                            improvement need to consider the practicality of and trade-offs made in\n                            different data collection methods. We examined the feasibility of\n                            deriving and applying review criteria for clinical guidelines in English\n                            primary care.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"S146342361400005X_abs2\" sec-type=\"methods\">\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We selected two sets of guidance, on osteoporosis and depression,\n                            and used a consensus process to derive review criteria. We manually\n                            extracted data on adherence to review criteria from patient records in\n                            20 general practices from three NHS primary care trusts in northern\n                            England. We compared the relative utility of extracted data with that of\n                            routinely available data, summarizing feasibility using what we termed a\n                            Resource Ratio.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"S146342361400005X_abs3\" sec-type=\"results\">\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Of 53 proposed review criteria we assessed, 41 were judged\n                            clinically important, valid, relevant and measurable. Thirty-one could\n                            be assessed in 10% or more of sampled patients, whereas 15 could be\n                            readily extracted (resource ratio of 15 or less). Only eight met all\n                            desirable attributes for use as review criteria. Resource ratios\n                            correlated poorly with local stakeholders\u2019 prior views on feasibility of\n                            data collection. We observed wide variations in compliance with review\n                            criteria, with notably low levels among self-care standards.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"S146342361400005X_abs4\" sec-type=\"conclusions\">\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>A minority of guideline recommendations were suitable for review\n                            criteria development, fewer still when using routinely available data.\n                            Local stakeholders tend to underestimate the actual resource\n                            requirements of data collection. Although improved design and use of\n                            clinical records may facilitate measurement of adherence to recommended\n                            practice, detailed assessments are still likely to rely upon some degree\n                            of manual data collection in the foreseeable future.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1017\/s146342361400005x","type":"journal-article","created":{"date-parts":[[2014,2,14]],"date-time":"2014-02-14T03:28:07Z","timestamp":1392348487000},"page":"396-405","update-policy":"https:\/\/doi.org\/10.1017\/policypage","source":"Crossref","is-referenced-by-count":4,"title":["Feasibility of applying review criteria for depression and osteoporosis\n                        national guidance in primary care"],"prefix":"10.1017","volume":"15","author":[{"given":"Mark F.","family":"Lambert","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Julia V.","family":"Cook","sequence":"additional","affiliation":[{"name":"Newcastle University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ella","family":"Roelant","sequence":"additional","affiliation":[{"name":"Newcastle University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Colin","family":"Bradshaw","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robbie","family":"Foy","sequence":"additional","affiliation":[{"name":"University of Leeds"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martin P.","family":"Eccles","sequence":"additional","affiliation":[{"name":"Newcastle University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"56","published-online":{"date-parts":[[2014,2,14]]},"reference":[{"key":"S146342361400005X_manual_ref-25","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.318.7183.593"},{"key":"S146342361400005X_manual_ref-13","doi-asserted-by":"publisher","DOI":"10.1007\/s001980050107"},{"key":"S146342361400005X_manual_ref-15","doi-asserted-by":"publisher","DOI":"10.3310\/hta8060"},{"key":"S146342361400005X_manual_ref-18","first-page":"2","article-title":"Consensus development methods, and their use in clinical guideline development: a review","author":"Murphy","year":"1998","journal-title":"Health Technology Assessment"},{"key":"S146342361400005X_manual_ref-19","unstructured":"National Institute for Health and Clinical\n                            Excellence. 2009: Depression in adults (update) [WWW Document]. NICE.\n                            Retrieved 3 December 2012 from\n                            http:\/\/www.nice.org.uk\/"},{"key":"S146342361400005X_manual_ref-27","first-page":"47","article-title":"NICE and the Quality and Outcomes Framework (QOF) 2009\u20132011","volume":"20","author":"Sutcliffe","year":"2012","journal-title":"Quality in Primary Care"},{"key":"S146342361400005X_manual_ref-21","unstructured":"National Institute for Health and Clinical\n                            Excellence. 2013a: Depression in adults quality standard Introduction\n                            and overview QS8 [WWW Document]. Retrieved 31 January 2013 from\n                            http:\/\/publications.nice.org.uk\/depression-in-adults-quality-standard-qs8"},{"key":"S146342361400005X_manual_ref-24","first-page":"21","article-title":"The NEBPINY programme (Phase 1). Changing practice \u2013 testing a facilitated evidence-based programme in primary care","volume":"9","author":"Rolfe","year":"2001","journal-title":"Journal of Clinical Governance"},{"key":"S146342361400005X_manual_ref-16","first-page":"690","article-title":"Developing primary care review criteria from evidence-based guidelines: coronary heart disease as a model","volume":"53","author":"Hutchinson","year":"2003","journal-title":"British Journal of General Practice"},{"key":"S146342361400005X_manual_ref-12","unstructured":"Department of Health. 2012: Functions of clinical\n                            commissioning groups [WWW Document]. Retrieved 26 February 2013 from\n                            http:\/\/www.dh.gov.uk\/health\/2012\/06\/ccg-functions\/"},{"key":"S146342361400005X_manual_ref-5","volume-title":"General Practitioners \u2013 briefing paper","year":"2010"},{"key":"S146342361400005X_manual_ref-23","unstructured":"NHS Business Services Authority. 2008: Prescription\n                            Services ePACT [WWW Document]. Retrieved 20 November 2013 from\n                            http:\/\/www.nhsbsa.nhs.uk\/815.aspx"},{"key":"S146342361400005X_manual_ref-11","volume-title":"High quality care for all: NHS Next Stage Review final report (No. Cm7432)","author":"Darzi","year":"2008"},{"key":"S146342361400005X_manual_ref-10","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(02)08657-9"},{"key":"S146342361400005X_manual_ref-26","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.329.7473.999"},{"key":"S146342361400005X_manual_ref-7","doi-asserted-by":"publisher","DOI":"10.1136\/qhc.11.4.358"},{"key":"S146342361400005X_manual_ref-9","article-title":"Guideline for the diagnosis and management of osteoporosis in postmenopausal women and men from the age of 50 years in the UK","author":"Compston","year":"2010","journal-title":"National Osteoporosis Guideline Group (NOGG)"},{"key":"S146342361400005X_manual_ref-8","doi-asserted-by":"publisher","DOI":"10.1136\/qhc.11.2.125"},{"key":"S146342361400005X_manual_ref-14","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMsa055505"},{"key":"S146342361400005X_manual_ref-20","unstructured":"National Institute for Health and Clinical\n                            Excellence. 2011: Osteoporosis - secondary prevention including\n                            strontium ranelate [WWW Document]. NICE. Retrieved 3 December 2012 from\n                            http:\/\/www.nice.org.uk\/"},{"key":"S146342361400005X_manual_ref-17","unstructured":"Information Centre for Health and Social Care. 2012:\n                            The Quality and Outcomes Framework 2010\/11 [WWW Document]. Information\n                            Centre for Health and Social Care. Retrieved 21 August 2012 from\n                            http:\/\/www.ic.nhs.uk\/qof"},{"key":"S146342361400005X_manual_ref-4","volume-title":"Is the treatment working? Progress with the NHS reform system","year":"2008"},{"key":"S146342361400005X_manual_ref-22","unstructured":"National Institute for Health and Clinical\n                            Excellence. 2013b: More information about the NICE quality standards\n                            [WWW Document]. Retrieved 4 July 2013 from\n                            http:\/\/www.nice.org.uk\/guidance\/qualitystandards\/moreinfoaboutnicequalitystandards.jsp"},{"key":"S146342361400005X_manual_ref-6","unstructured":"British Medical Association. 2013: QOF guidance\n                            previous revisions [WWW Document]. Retrieved 17 May 2013 from\n                            http:\/\/bma.org.uk\/practical-support-at-work\/contracts\/independent-contractors\/qof-guidance\/qof-guidance-previous-revisions"}],"container-title":["Primary Health Care Research &amp; Development"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S146342361400005X","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T09:15:38Z","timestamp":1780650938000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S146342361400005X\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,2,14]]},"references-count":24,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2014,10]]}},"alternative-id":["S146342361400005X"],"URL":"https:\/\/doi.org\/10.1017\/s146342361400005x","relation":{},"ISSN":["1463-4236","1477-1128"],"issn-type":[{"value":"1463-4236","type":"print"},{"value":"1477-1128","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,2,14]]},"assertion":[{"value":"\u00a9 Cambridge University Press 2014\u00a0","name":"license","label":"License","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}}]}}