{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,14]],"date-time":"2025-05-14T03:51:07Z","timestamp":1747194667524,"version":"3.40.5"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,8,30]],"date-time":"2022-08-30T00:00:00Z","timestamp":1661817600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,8,30]],"date-time":"2022-08-30T00:00:00Z","timestamp":1661817600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Private Universit\u00e4t Witten\/Herdecke gGmbH"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Res Methodol"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Systematic reviews that synthesize safety outcomes pose challenges (e.g. rare events), which raise questions for grading the strength of the body of evidence. This is maybe one reason why in many potentially inappropriate medication (PIM) lists the recommendations are not based on formalized systems for assessing the quality of the body of evidence such as GRADE.<\/jats:p>\n                <jats:p>In this contribution, we describe specifications and suggest adaptions of the GRADE system for grading the quality of evidence on safety outcomes, which were developed in the context of preparing a PIM-list, namely PRISCUS.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>We systematically assessed each of the five GRADE domains for rating-down (study limitations, imprecision, inconsistency, indirectness, publication bias) and the criteria for rating-up, considering if special considerations or revisions of the original approach were indicated. The result was gathered in a written document and discussed in a group-meeting of five members with various background until consensus. Subsequently, we performed a proof-of-concept application using a convenience sample of systematic reviews and applied the approach to systematic reviews on 19 different clinical questions.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>We describe specifications and suggest adaptions for the criteria \u201cstudy limitations\u201d, imprecision, \u201cpublication bias\u201d and \u201crating-up for large effect\u201d. In addition, we suggest a new criterion to account for data from subgroup-analyses. The proof-of-concept application did not reveal a need for further revision and thus we used the approach for the systematic reviews that were prepared for the PRISCUS-list.<\/jats:p>\n                <jats:p>We assessed 51 outcomes. Each of the proposed adaptions was applied. There were neither an excessive number of low and very low ratings, nor an excessive number of high ratings, but the different methodological quality of the safety outcomes appeared to be well reflected.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>The suggestions appear to have the potential to overcome some of the challenges when grading the methodological quality of harms and thus may be helpful for producers of evidence syntheses considering safety.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12874-022-01715-5","type":"journal-article","created":{"date-parts":[[2022,8,30]],"date-time":"2022-08-30T05:02:38Z","timestamp":1661835758000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Assessing the quality of evidence on safety: specifications for application and suggestions for adaptions of the GRADE-criteria in the context of preparing a list of potentially inappropriate medications for older adults"],"prefix":"10.1186","volume":"22","author":[{"given":"Tim","family":"Mathes","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3511-9506","authenticated-orcid":false,"given":"Nina-Kristin","family":"Mann","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9724-1422","authenticated-orcid":false,"given":"Petra","family":"Th\u00fcrmann","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2733-4062","authenticated-orcid":false,"given":"Andreas","family":"S\u00f6nnichsen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0715-5182","authenticated-orcid":false,"given":"Dawid","family":"Pieper","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,8,30]]},"reference":[{"issue":"5","key":"1715_CR1","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1136\/qshc.2008.028043","volume":"18","author":"M Lugtenberg","year":"2009","unstructured":"Lugtenberg M, Burgers JS, Westert GP. Effects of evidence-based clinical practice guidelines on quality of care: a systematic review. Qual Saf Health Care. 2009;18(5):385.","journal-title":"Qual Saf Health Care"},{"issue":"3","key":"1715_CR2","doi-asserted-by":"publisher","first-page":"438","DOI":"10.1345\/aph.1H473","volume":"41","author":"E Jano","year":"2007","unstructured":"Jano E, Aparasu RR. Healthcare outcomes associated with beers' criteria: a systematic review. Ann Pharmacother. 2007;41(3):438\u201348.","journal-title":"Ann Pharmacother"},{"issue":"6","key":"1715_CR3","doi-asserted-by":"publisher","first-page":"679","DOI":"10.1007\/s00228-018-2446-0","volume":"74","author":"FR Motter","year":"2018","unstructured":"Motter FR, Fritzen JS, Hilmer SN, Paniz \u00c9V, Paniz VMV. Potentially inappropriate medication in the elderly: a systematic review of validated explicit criteria. Eur J Clin Pharmacol. 2018;74(6):679\u2013700.","journal-title":"Eur J Clin Pharmacol"},{"issue":"7","key":"1715_CR4","doi-asserted-by":"publisher","first-page":"861","DOI":"10.1007\/s00228-015-1860-9","volume":"71","author":"A Renom-Guiteras","year":"2015","unstructured":"Renom-Guiteras A, Meyer G, Th\u00fcrmann PA. The EU(7)-PIM list: a list of potentially inappropriate medications for older people consented by experts from seven European countries. Eur J Clin Pharmacol. 2015;71(7):861\u201375.","journal-title":"Eur J Clin Pharmacol"},{"key":"1715_CR5","unstructured":"OCEBM Levels of Evidence Working Group*. \u201cThe Oxford Levels of Evidence 2\u201d. Oxford Centre for Evidence-Based Medicine https:\/\/www.cebm.net\/index.aspx?o=5653."},{"issue":"4","key":"1715_CR6","doi-asserted-by":"publisher","first-page":"383","DOI":"10.1016\/j.jclinepi.2010.04.026","volume":"64","author":"G Guyatt","year":"2011","unstructured":"Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, et al. GRADE guidelines: 1. Introduction\u2014GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. 2011;64(4):383\u201394.","journal-title":"J Clin Epidemiol"},{"issue":"9","key":"1715_CR7","doi-asserted-by":"publisher","first-page":"e003436","DOI":"10.1136\/bmjopen-2013-003436","volume":"3","author":"A Hodkinson","year":"2013","unstructured":"Hodkinson A, Kirkham JJ, Tudur-Smith C, Gamble C. Reporting of harms data in RCTs: a systematic review of empirical assessments against the CONSORT harms extension. BMJ Open. 2013;3(9):e003436.","journal-title":"BMJ Open"},{"key":"1715_CR8","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1016\/j.jclinepi.2020.11.017","volume":"131","author":"P Jia","year":"2021","unstructured":"Jia P, Lin L, Kwong JSW, Xu C. Many meta-analyses of rare events in the Cochrane Database of Systematic Reviews were underpowered. J Clin Epidemiol. 2021;131:113\u201322.","journal-title":"J Clin Epidemiol"},{"issue":"1","key":"1715_CR9","doi-asserted-by":"publisher","first-page":"495","DOI":"10.1186\/s13063-015-1023-4","volume":"16","author":"T Kennedy-Martin","year":"2015","unstructured":"Kennedy-Martin T, Curtis S, Faries D, Robinson S, Johnston J. A literature review on the representativeness of randomized controlled trial samples and implications for the external validity of trial results. Trials. 2015;16(1):495.","journal-title":"Trials."},{"issue":"4","key":"1715_CR10","doi-asserted-by":"publisher","first-page":"e30","DOI":"10.2196\/medinform.6437","volume":"4","author":"J Luo","year":"2016","unstructured":"Luo J, Eldredge C, Cho CC, Cisler RA. Population Analysis of Adverse Events in Different Age Groups Using Big Clinical Trials Data. JMIR Med Inform. 2016;4(4):e30.","journal-title":"JMIR Med Inform"},{"key":"1715_CR11","volume-title":"Cochrane Handbook for Systematic Reviews of Interventions version 6.0 (updated July 2019)","author":"G Peryer","year":"2019","unstructured":"Peryer G, Golder S, Junqueira D, Vohra S, Loke YK. Chapter 19: Adverse effects. In: JPT H, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA, editors. Cochrane Handbook for Systematic Reviews of Interventions version 6.0 (updated July 2019): Cochrane; 2019. Available from."},{"issue":"31\u201332","key":"1715_CR12","first-page":"543","volume":"107","author":"S Holt","year":"2010","unstructured":"Holt S, Schmiedl S, Th\u00fcrmann PA. Potentially inappropriate medications in the elderly: the PRISCUS list. Dtsch Arztebl Int. 2010;107(31\u201332):543\u201351.","journal-title":"Dtsch Arztebl Int"},{"issue":"4","key":"1715_CR13","doi-asserted-by":"publisher","first-page":"401","DOI":"10.1016\/j.jclinepi.2010.07.015","volume":"64","author":"H Balshem","year":"2011","unstructured":"Balshem H, Helfand M, Sch\u00fcnemann HJ, Oxman AD, Kunz R, Brozek J, et al. GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol. 2011;64(4):401\u20136.","journal-title":"J Clin Epidemiol"},{"key":"1715_CR14","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1016\/j.jclinepi.2018.01.012","volume":"111","author":"HJ Sch\u00fcnemann","year":"2019","unstructured":"Sch\u00fcnemann HJ, Cuello C, Akl EA, Mustafa RA, Meerpohl JJ, Thayer K, et al. GRADE guidelines: 18. How ROBINS-I and other tools to assess risk of bias in nonrandomized studies should be used to rate the certainty of a body of evidence. J Clin Epidemiol. 2019;111:105\u201314.","journal-title":"J Clin Epidemiol"},{"issue":"4","key":"1715_CR15","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1016\/j.jclinepi.2010.07.017","volume":"64","author":"GH Guyatt","year":"2011","unstructured":"Guyatt GH, Oxman AD, Vist G, Kunz R, Brozek J, Alonso-Coello P, et al. GRADE guidelines: 4. Rating the quality of evidence--study limitations (risk of bias). J Clin Epidemiol. 2011;64(4):407\u201315.","journal-title":"J Clin Epidemiol"},{"key":"1715_CR16","doi-asserted-by":"crossref","unstructured":"Sterne JA, Hern\u00e1n MA, Reeves BC, Savovi\u0107 J, Berkman ND, Viswanathan M, Henry D, Altman DG, Ansari MT, Boutron I, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ. 2016;355:i4919.","DOI":"10.1136\/bmj.i4919"},{"issue":"1","key":"1715_CR17","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1111\/jep.12889","volume":"25","author":"JM Quigley","year":"2019","unstructured":"Quigley JM, Thompson JC, Halfpenny NJ, Scott DA. Critical appraisal of nonrandomized studies-A review of recommended and commonly used tools. J Eval Clin Pract. 2019;25(1):44\u201352.","journal-title":"J Eval Clin Pract"},{"issue":"3","key":"1715_CR18","doi-asserted-by":"publisher","first-page":"666","DOI":"10.1093\/ije\/dym018","volume":"36","author":"S Sanderson","year":"2007","unstructured":"Sanderson S, Tatt ID, Higgins JP. Tools for assessing quality and susceptibility to bias in observational studies in epidemiology: a systematic review and annotated bibliography. Int J Epidemiol. 2007;36(3):666\u201376.","journal-title":"Int J Epidemiol"},{"issue":"12","key":"1715_CR19","doi-asserted-by":"publisher","first-page":"1283","DOI":"10.1016\/j.jclinepi.2011.01.012","volume":"64","author":"GH Guyatt","year":"2011","unstructured":"Guyatt GH, Oxman AD, Kunz R, Brozek J, Alonso-Coello P, Rind D, et al. GRADE guidelines 6. Rating the quality of evidence--imprecision. J Clin Epidemiol. 2011;64(12):1283\u201393.","journal-title":"J Clin Epidemiol"},{"issue":"12","key":"1715_CR20","doi-asserted-by":"publisher","first-page":"1277","DOI":"10.1016\/j.jclinepi.2011.01.011","volume":"64","author":"GH Guyatt","year":"2011","unstructured":"Guyatt GH, Oxman AD, Montori V, Vist G, Kunz R, Brozek J, et al. GRADE guidelines: 5. Rating the quality of evidence--publication bias. J Clin Epidemiol. 2011;64(12):1277\u201382.","journal-title":"J Clin Epidemiol"},{"key":"1715_CR21","doi-asserted-by":"publisher","first-page":"g6501","DOI":"10.1136\/bmj.g6501","volume":"349","author":"P Saini","year":"2014","unstructured":"Saini P, Loke YK, Gamble C, Altman DG, Williamson PR, Kirkham JJ. Selective reporting bias of harm outcomes within studies: findings from a cohort of systematic reviews. BMJ. 2014;349:g6501.","journal-title":"BMJ"},{"key":"1715_CR22","doi-asserted-by":"publisher","first-page":"f3981","DOI":"10.1136\/bmj.f3981","volume":"346","author":"MA Rodgers","year":"2013","unstructured":"Rodgers MA, Brown JVE, Heirs MK, Higgins JPT, Mannion RJ, Simmonds MC, et al. Reporting of industry funded study outcome data: comparison of confidential and published data on the safety and effectiveness of rhBMP-2 for spinal fusion. BMJ. 2013;346:f3981.","journal-title":"BMJ"},{"issue":"12","key":"1715_CR23","doi-asserted-by":"publisher","first-page":"1311","DOI":"10.1016\/j.jclinepi.2011.06.004","volume":"64","author":"GH Guyatt","year":"2011","unstructured":"Guyatt GH, Oxman AD, Sultan S, Glasziou P, Akl EA, Alonso-Coello P, et al. GRADE guidelines: 9. Rating up the quality of evidence. J Clin Epidemiol. 2011;64(12):1311\u20136.","journal-title":"J Clin Epidemiol"},{"issue":"7","key":"1715_CR24","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1016\/0021-9681(67)90080-X","volume":"20","author":"ID Bross","year":"1967","unstructured":"Bross ID. Pertinency of an extraneous variable. J Chronic Dis. 1967;20(7):487\u201395.","journal-title":"J Chronic Dis"},{"issue":"6","key":"1715_CR25","doi-asserted-by":"publisher","first-page":"646","DOI":"10.1093\/aje\/kwm165","volume":"166","author":"Z Fewell","year":"2007","unstructured":"Fewell Z, Davey Smith G, Sterne JAC. The Impact of Residual and Unmeasured Confounding in Epidemiologic Studies: A Simulation Study. Am J Epidemiol. 2007;166(6):646\u201355.","journal-title":"Am J Epidemiol"},{"key":"1715_CR26","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1016\/j.jclinepi.2020.06.012","volume":"126","author":"O Kuss","year":"2020","unstructured":"Kuss O, Miller M. Unknown confounders did not bias the treatment effect when improving balance of known confounders in randomized trials. J Clin Epidemiol. 2020;126:9\u201316.","journal-title":"J Clin Epidemiol"},{"issue":"7589","key":"1715_CR27","doi-asserted-by":"publisher","first-page":"349","DOI":"10.1136\/bmj.39070.527986.68","volume":"334","author":"P Glasziou","year":"2007","unstructured":"Glasziou P, Chalmers I, Rawlins M, McCulloch P. When are randomised trials unnecessary? Picking signal from noise. BMJ. 2007;334(7589):349\u201351.","journal-title":"BMJ"},{"issue":"10","key":"1715_CR28","doi-asserted-by":"publisher","first-page":"999","DOI":"10.1007\/s40264-020-00957-w","volume":"43","author":"L Sandberg","year":"2020","unstructured":"Sandberg L, Taavola H, Aoki Y, Chandler R, Nor\u00e9n GN. Risk Factor Considerations in Statistical Signal Detection: Using Subgroup Disproportionality to Uncover Risk Groups for Adverse Drug Reactions in VigiBase. Drug Saf. 2020;43(10):999\u20131009.","journal-title":"Drug Saf"},{"issue":"12","key":"1715_CR29","doi-asserted-by":"publisher","first-page":"1294","DOI":"10.1016\/j.jclinepi.2011.03.017","volume":"64","author":"GH Guyatt","year":"2011","unstructured":"Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, et al. GRADE guidelines: 7. Rating the quality of evidence--inconsistency. J Clin Epidemiol. 2011;64(12):1294\u2013302.","journal-title":"J Clin Epidemiol"},{"issue":"32","key":"1715_CR30","doi-asserted-by":"publisher","first-page":"E901","DOI":"10.1503\/cmaj.200077","volume":"192","author":"S Schandelmaier","year":"2020","unstructured":"Schandelmaier S, Briel M, Varadhan R, Schmid CH, Devasenapathy N, Hayward RA, et al. Development of the Instrument to assess the Credibility of Effect Modification Analyses (ICEMAN) in randomized controlled trials and meta-analyses. Can Med Assoc J. 2020;192(32):E901\u2013E6.","journal-title":"Can Med Assoc J"},{"key":"1715_CR31","doi-asserted-by":"crossref","unstructured":"American Geriatrics Society 2019 Updated AGS Beers Criteria\u00ae for Potentially Inappropriate Medication Use in Older Adults. J Am Geriatr Soc. 2019;67(4):674\u201394.","DOI":"10.1111\/jgs.15767"},{"key":"1715_CR32","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1016\/j.jclinepi.2022.01.016","volume":"145","author":"I Hozo","year":"2022","unstructured":"Hozo I, Djulbegovic B, Parish AJ, Ioannidis JPA. Identification of threshold for large (dramatic) effects that would obviate randomized trials is not possible. J Clin Epidemiol. 2022;145:101\u201311.","journal-title":"J Clin Epidemiol"}],"container-title":["BMC Medical Research Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-022-01715-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12874-022-01715-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-022-01715-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,8,30]],"date-time":"2022-08-30T05:03:43Z","timestamp":1661835823000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedresmethodol.biomedcentral.com\/articles\/10.1186\/s12874-022-01715-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,30]]},"references-count":32,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["1715"],"URL":"https:\/\/doi.org\/10.1186\/s12874-022-01715-5","relation":{},"ISSN":["1471-2288"],"issn-type":[{"type":"electronic","value":"1471-2288"}],"subject":[],"published":{"date-parts":[[2022,8,30]]},"assertion":[{"value":"14 December 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 August 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 August 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"234"}}