{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T06:28:17Z","timestamp":1777098497786,"version":"3.51.4"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2005,7,27]],"date-time":"2005-07-27T00:00:00Z","timestamp":1122422400000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2005,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Background<\/jats:title>\n            <jats:p>Clinical practice guidelines are not uniformly successful in influencing clinicians' behaviour toward best practices. Implementability refers to a set of characteristics that predict ease of (and obstacles to) guideline implementation. Our objective is to develop and validate a tool for appraisal of implementability of clinical guidelines.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Methods<\/jats:title>\n            <jats:p>Indicators of implementability were identified from the literature and used to create items and dimensions of the GuideLine Implementability Appraisal (GLIA). GLIA consists of 31 items, arranged into 10 dimensions. Questions from 9 of the 10 dimensions are applied individually to each recommendation of the guideline. Decidability and Executability are critical dimensions. Other dimensions are Global, Presentation and Formatting, Measurable Outcomes, Apparent Validity, Flexibility, Effect on Process of Care, Novelty\/Innovation, and Computability. We conducted a series of validation activities, including validation of the construct of implementability, expert review of content for clarity, relevance, and comprehensiveness, and assessment of construct validity of the instrument. Finally, GLIA was applied to a draft guideline under development by national professional societies.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>Evidence of content validity and preliminary support for construct validity were obtained. The GLIA proved to be useful in identifying barriers to implementation in the draft guideline and the guideline was revised accordingly.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusion<\/jats:title>\n            <jats:p>GLIA may be useful to guideline <jats:italic>developers<\/jats:italic> who can apply the results to remedy defects in their guidelines. Likewise, guideline <jats:italic>implementers<\/jats:italic> may use GLIA to select implementable recommendations and to devise implementation strategies that address identified barriers. By aiding the design and operationalization of highly implementable guidelines, our goal is that application of GLIA may help to improve health outcomes, but further evaluation will be required to support this potential benefit.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1186\/1472-6947-5-23","type":"journal-article","created":{"date-parts":[[2005,7,28]],"date-time":"2005-07-28T21:11:05Z","timestamp":1122585065000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":279,"title":["The GuideLine Implementability Appraisal (GLIA): development of an instrument to identify obstacles to guideline implementation"],"prefix":"10.1186","volume":"5","author":[{"given":"Richard N","family":"Shiffman","sequence":"first","affiliation":[]},{"given":"Jane","family":"Dixon","sequence":"additional","affiliation":[]},{"given":"Cynthia","family":"Brandt","sequence":"additional","affiliation":[]},{"given":"Abdelwaheb","family":"Essaihi","sequence":"additional","affiliation":[]},{"given":"Allen","family":"Hsiao","sequence":"additional","affiliation":[]},{"given":"George","family":"Michel","sequence":"additional","affiliation":[]},{"given":"Ryan","family":"O'Connell","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2005,7,27]]},"reference":[{"issue":"6","key":"74_CR1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3310\/hta8060","volume":"8","author":"JM Grimshaw","year":"2004","unstructured":"Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8 (6): 1-72. Review","journal-title":"Health Technol Assess"},{"issue":"5","key":"74_CR2","doi-asserted-by":"publisher","first-page":"519","DOI":"10.1016\/S0091-7435(03)00014-8","volume":"36","author":"E Larson","year":"2003","unstructured":"Larson E: Status of practice guidelines in the United States: CDC guidelines as an example. [Review] [64 refs]. Preventive Medicine. 2003, 36 (5): 519-524. 10.1016\/S0091-7435(03)00014-8.","journal-title":"Preventive Medicine"},{"issue":"1","key":"74_CR3","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1093\/intqhc\/15.1.31","volume":"15","author":"JS Burgers","year":"2003","unstructured":"Burgers JS, Grol R, Klazinga NS, Makela M, Zaat J, AGREE Collaboration: Towards evidence-based clinical practice: an international survey of 18 clinical guideline programs. Int J Qual Health Care. 2003, 15 (1): 31-45. 10.1093\/intqhc\/15.1.31.","journal-title":"Int J Qual Health Care"},{"key":"74_CR4","doi-asserted-by":"publisher","first-page":"941","DOI":"10.1136\/bmj.325.7370.941","volume":"325","author":"M Eccles","year":"2002","unstructured":"Eccles M, McColl E, Steen N, Rousseau N, Grimshaw J, Parkin D: Effect of computerised evidence-based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trial. BMJ. 2002, 325: 941-948. 10.1136\/bmj.325.7370.941.","journal-title":"BMJ"},{"issue":"12","key":"74_CR5","doi-asserted-by":"publisher","first-page":"967","DOI":"10.1111\/j.1525-1497.2003.30635.x","volume":"18","author":"WM Tierney","year":"2003","unstructured":"Tierney WM, Overhage JM, Murray MD, Harris LE, Zhou XH, Eckert GJ, Smith FE, Nienaber N, McDonald CJ, Wolinsky FD: Effects of computerized guidelines for managing heart disease in primary care. J Gen Intern Med. 2003, 18 (12): 967-976. 10.1111\/j.1525-1497.2003.30635.x.","journal-title":"J Gen Intern Med"},{"issue":"10","key":"74_CR6","doi-asserted-by":"publisher","first-page":"816","DOI":"10.1046\/j.1525-1497.2003.20535.x","volume":"18","author":"GE Switzer","year":"2003","unstructured":"Switzer GE, Halm EA, Chang CC, Mittman BS, Walsh MB, Fine MJ: Physician awareness and self-reported use of local and national guidelines for community-acquired pneumonia. J Gen Intern Med. 2003, 18 (10): 816-823. 10.1046\/j.1525-1497.2003.20535.x.","journal-title":"J Gen Intern Med"},{"key":"74_CR7","doi-asserted-by":"publisher","first-page":"316","DOI":"10.1136\/jamia.1995.96073834","volume":"2","author":"WM Tierney","year":"1995","unstructured":"Tierney WM, Overhage JM, Takesue BY, Harris LE, Murray MD, Vargo DL, McDonald CJ: Computerizing guidelines to improve care and patient outcomes: the example of heart failure. J Am Med Inform Assoc. 1995, 2: 316-322.","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"74_CR8","first-page":"377","volume":"34","author":"DA Katz","year":"1999","unstructured":"Katz DA: Barriers between guidelines and improved patient care: an analysis of AHCPR's unstable angina clinical practice guideline. Health Serv Res. 1999, 34 (1): 377-389.","journal-title":"Health Serv Res"},{"key":"74_CR9","volume-title":"Guidelines for clinical practice: from development to use","author":"Institute of Medicine","year":"1992","unstructured":"Institute of Medicine: Guidelines for clinical practice: from development to use. Edited by: Field MJ, Lohr KN. 1992, Washington, DC , National Academy Press"},{"key":"74_CR10","first-page":"216","volume-title":"Changing professional practice: theory and practice of clinical guidelines implementation","author":"T Thorsen","year":"1999","unstructured":"Thorsen T, M\u00e4kel\u00e4 M: Changing professional practice: theory and practice of clinical guidelines implementation. 1999, Copenhagen , Danish Institute for Health Services Research and Development, 216-"},{"issue":"4","key":"74_CR11","first-page":"171","volume":"26","author":"LI Solberg","year":"2000","unstructured":"Solberg LI, Brekke ML, Fowles J, Jacobsen DN, Kottke TE, Mosser G, O'Connor PJ, Ohnsorg KA, Rolnick SJ: Lessons from experienced guideline implementers:attend to many factors and use multiple strategies. Jt Comm J Qual Improv. 2000, 26 (4): 171-188.","journal-title":"Jt Comm J Qual Improv"},{"key":"74_CR12","doi-asserted-by":"publisher","first-page":"202","DOI":"10.1097\/00005650-199403000-00002","volume":"32","author":"R Grilli","year":"1994","unstructured":"Grilli R, Lomas J: Evaluating the message: the relationship betweenm the compliance rate and the subject of a practice guideline. Medical Care. 1994, 32: 202-213.","journal-title":"Medical Care"},{"key":"74_CR13","doi-asserted-by":"publisher","first-page":"858","DOI":"10.1136\/bmj.317.7162.858","volume":"317","author":"R Grol","year":"1998","unstructured":"Grol R, Dalhuijsen J, Thomas S, Veld C, Rutten G, Mokkink H: Attributes of clinical guidelines that influence use of guidelines in general practice: observational study. BMJ. 1998, 317: 858-861.","journal-title":"BMJ"},{"issue":"1","key":"74_CR14","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1093\/intqhc\/11.1.21","volume":"11","author":"FA Cluzeau","year":"1999","unstructured":"Cluzeau FA, Littlejohns P, Grimshaw JM, Feder G, Moran SE: Development and application of a generic methodology to assess the quality of clinical guidelines. Int J Qual Health Care. 1999, 11 (1): 21-28. 10.1093\/intqhc\/11.1.21.","journal-title":"Int J Qual Health Care"},{"key":"74_CR15","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1136\/qhc.12.1.18","volume":"12","author":"AGREE Collaboration","year":"2003","unstructured":"AGREE Collaboration: Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project. Qual Saf Health Care. 2003, 12: 18-23. 10.1136\/qhc.12.1.18.","journal-title":"Qual Saf Health Care"},{"key":"74_CR16","doi-asserted-by":"publisher","first-page":"1900","DOI":"10.1001\/jama.281.20.1900","volume":"281","author":"TM Shaneyfelt","year":"1999","unstructured":"Shaneyfelt TM, Mayo-Smith MF, Rothwangl J: Are guidelines following guidelines? the methodological quality of clinical practice guidelines in the peer-reviewed medical literature. JAMA. 1999, 281: 1900-1905. 10.1001\/jama.281.20.1900.","journal-title":"JAMA"},{"key":"74_CR17","doi-asserted-by":"publisher","first-page":"493","DOI":"10.7326\/0003-4819-139-6-200309160-00013","volume":"139","author":"RN Shiffman","year":"2003","unstructured":"Shiffman RN, Shekelle P, Overhage JM, Slutsky J, Grimshaw J, Deshpande AM: Standardized reporting of clinical practice guidelines: a proposal from the Conference on Guideline Standardization. Ann Intern Med. 2003, 139: 493-498.","journal-title":"Ann Intern Med"},{"key":"74_CR18","doi-asserted-by":"crossref","unstructured":"Ryan TJ, Antman EM, Brooks NH, Califf RM, Hillis LD, Hiratzka LF, rapaport E, Riegel B, Russell RO, Smith EE, weaveer WD: 1999 Update: ACC\/AHA guidelines for the management of patients with acute myocardial infarction. [http:\/\/www.acc.org\/clinical\/guidelines\/nov96\/1999\/index.htm]","DOI":"10.1161\/01.CIR.100.9.1016"},{"issue":"4 Pt 1","key":"74_CR19","first-page":"843","volume":"103","author":"Anonymous","year":"1999","unstructured":"Anonymous: Practice parameter: the diagnosis, treatment, and evaluation of the initial urinary tract infection in febrile infants and young children. American Academy of Pediatrics. Committee on Quality Improvement. Subcommittee on Urinary Tract Infection [published errata appear in Pediatrics 1999 May;103(5 Pt 1):1052, 1999 Jul;104(1 Pt 1):118 and 2000 Jan;105(1 Pt 1):141] [see comments]. Pediatrics. 1999, 103 (4 Pt 1): 843-852.","journal-title":"Pediatrics"},{"key":"74_CR20","doi-asserted-by":"publisher","first-page":"76","DOI":"10.7326\/0003-4819-127-1-199707010-00014","volume":"127","author":"M Linzer","year":"1997","unstructured":"Linzer M, Yang EH, Estes M, Wang P, Vorperian VR, Kapoor WN: Diagnosing syncope: Part 2. unexplained syncope. Ann Intern Med. 1997, 127: 76-86.","journal-title":"Ann Intern Med"},{"key":"74_CR21","doi-asserted-by":"publisher","first-page":"382","DOI":"10.1097\/00006199-198611000-00017","volume":"35","author":"MR Lynn","year":"1986","unstructured":"Lynn MR: Determination and quantification of content validity. Nursing Research. 1986, 35: 382-385.","journal-title":"Nursing Research"},{"issue":"5","key":"74_CR22","doi-asserted-by":"publisher","first-page":"1412","DOI":"10.1542\/peds.113.5.1412","volume":"113","author":"Anonymous","year":"2004","unstructured":"Anonymous: Otitis media with effusion. Pediatrics. 2004, 113 (5): 1412-1429. 10.1542\/peds.113.5.1412.","journal-title":"Pediatrics"},{"key":"74_CR23","doi-asserted-by":"publisher","first-page":"343","DOI":"10.1136\/bmj.328.7435.343","volume":"328","author":"S Michie","year":"2004","unstructured":"Michie S, Johnston M: Changing clinical behaviour by making guidelines specific. BMJ. 2004, 328: 343-345. 10.1136\/bmj.328.7435.343.","journal-title":"BMJ"},{"key":"74_CR24","first-page":"1429","volume":"34","author":"PG Shekelle","year":"2000","unstructured":"Shekelle PG, Kravitz RL, Beart J, Marger M, Wang M, Lee M: Are nonspecific practice guidelines potentially harmful? a randomized trial of the effect of nonspecific versus specific guidelines on physician decision making. Health Services research. 2000, 34: 1429-1448.","journal-title":"Health Services research"},{"key":"74_CR25","doi-asserted-by":"publisher","first-page":"1271","DOI":"10.1056\/NEJM199310213291714","volume":"329","author":"PJ Greco","year":"1993","unstructured":"Greco PJ, Eisenberg JM: Changing physicians' practices. N Engl J Med. 1993, 329: 1271-1274. 10.1056\/NEJM199310213291714.","journal-title":"N Engl J Med"},{"key":"74_CR26","doi-asserted-by":"publisher","first-page":"1339","DOI":"10.1001\/jama.280.15.1339","volume":"280","author":"DL Hunt","year":"1998","unstructured":"Hunt DL, Haynes RB, Hanna SE, Smith K: Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA. 1998, 280: 1339-1346. 10.1001\/jama.280.15.1339.","journal-title":"JAMA"},{"key":"74_CR27","doi-asserted-by":"publisher","first-page":"104","DOI":"10.1136\/jamia.1999.0060104","volume":"6","author":"RN Shiffman","year":"1999","unstructured":"Shiffman RN, Liaw Y, Brandt CA, Corb GJ: Computer-based guideline implementation systems: a systematic review of functionality and effectiveness. J Am Med Inform Assoc. 1999, 6: 104-114.","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"74_CR28","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1016\/S1386-5056(01)00183-6","volume":"64","author":"B Kaplan","year":"2001","unstructured":"Kaplan B: Evaluating informatics applications--clinical decision support systems literature review. Int J Med Inform. 2001, 64 (1): 15-37. 10.1016\/S1386-5056(01)00183-6. Review","journal-title":"Int J Med Inform"},{"key":"74_CR29","doi-asserted-by":"publisher","first-page":"1024","DOI":"10.1017\/S0266462300103095","volume":"16","author":"ID Graham","year":"2000","unstructured":"Graham ID, Calder LA, Hebert PC, Carter AO, Tetroe JM: A comparison of clinical practice guideline appraisal instruments. Int J Tech Assess Health Care. 2000, 16: 1024-1038. 10.1017\/S0266462300103095.","journal-title":"Int J Tech Assess Health Care"},{"key":"74_CR30","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1136\/qshc.2003.009761","volume":"13","author":"G Ollenschlager","year":"2004","unstructured":"Ollenschlager G, Marshall C, Qureshi S, Rosenbrand K, Slutsky J, Burgers J, Makela M: Board of Trustees 2002, Guidelines International Network (G-I-N) Improving the quality of health care: using international collaboration to inform guideline programmes - by founding the Guidelines International Network (G-I-N). Qual Safe Health Care. 2004, 13: 455-460. 10.1136\/qshc.2003.009761.","journal-title":"Qual Safe Health Care"},{"issue":"5","key":"74_CR31","doi-asserted-by":"publisher","first-page":"382","DOI":"10.1136\/jamia.1997.0040382","volume":"4","author":"RN Shiffman","year":"1997","unstructured":"Shiffman RN: Representation of clinical practice guidelines in conventional and augmented decision tables. J Am Med Inform Assoc. 1997, 4 (5): 382-393.","journal-title":"J Am Med Inform Assoc"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/1472-6947-5-23.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/1472-6947-5-23\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/1472-6947-5-23","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1472-6947-5-23.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,1]],"date-time":"2021-09-01T01:46:46Z","timestamp":1630460806000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/1472-6947-5-23"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2005,7,27]]},"references-count":31,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2005,12]]}},"alternative-id":["74"],"URL":"https:\/\/doi.org\/10.1186\/1472-6947-5-23","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2005,7,27]]},"assertion":[{"value":"28 February 2005","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 July 2005","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 July 2005","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"23"}}