{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T14:47:30Z","timestamp":1778856450922,"version":"3.51.4"},"reference-count":38,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,12,21]],"date-time":"2023-12-21T00:00:00Z","timestamp":1703116800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Res. Metr. Anal."],"abstract":"<jats:p>Systematic reviews play a crucial role in evidence-based practices as they consolidate research findings to inform decision-making. However, it is essential to assess the quality of systematic reviews to prevent biased or inaccurate conclusions. This paper underscores the importance of adhering to recognized guidelines, such as the PRISMA statement and Cochrane Handbook. These recommendations advocate for systematic approaches and emphasize the documentation of critical components, including the search strategy and study selection. A thorough evaluation of methodologies, research quality, and overall evidence strength is essential during the appraisal process. Identifying potential sources of bias and review limitations, such as selective reporting or trial heterogeneity, is facilitated by tools like the Cochrane Risk of Bias and the AMSTAR 2 checklist. The assessment of included studies emphasizes formulating clear research questions and employing appropriate search strategies to construct robust reviews. Relevance and bias reduction are ensured through meticulous selection of inclusion and exclusion criteria. Accurate data synthesis, including appropriate data extraction and analysis, is necessary for drawing reliable conclusions. Meta-analysis, a statistical method for aggregating trial findings, improves the precision of treatment impact estimates. Systematic reviews should consider crucial factors such as addressing biases, disclosing conflicts of interest, and acknowledging review and methodological limitations. This paper aims to enhance the reliability of systematic reviews, ultimately improving decision-making in healthcare, public policy, and other domains. It provides academics, practitioners, and policymakers with a comprehensive understanding of the evaluation process, empowering them to make well-informed decisions based on robust data.<\/jats:p>","DOI":"10.3389\/frma.2023.1268045","type":"journal-article","created":{"date-parts":[[2023,12,21]],"date-time":"2023-12-21T04:50:18Z","timestamp":1703134218000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":177,"title":["Appraising systematic reviews: a comprehensive guide to ensuring validity and reliability"],"prefix":"10.3389","volume":"8","author":[{"given":"Nour","family":"Shaheen","sequence":"first","affiliation":[]},{"given":"Ahmed","family":"Shaheen","sequence":"additional","affiliation":[]},{"given":"Alaa","family":"Ramadan","sequence":"additional","affiliation":[]},{"given":"Mahmoud Tarek","family":"Hefnawy","sequence":"additional","affiliation":[]},{"given":"Abdelraouf","family":"Ramadan","sequence":"additional","affiliation":[]},{"given":"Ismail A.","family":"Ibrahim","sequence":"additional","affiliation":[]},{"given":"Maged Elsayed","family":"Hassanein","sequence":"additional","affiliation":[]},{"given":"Mohamed E.","family":"Ashour","sequence":"additional","affiliation":[]},{"given":"Oliver","family":"Flouty","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2023,12,21]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"23","DOI":"10.4102\/curationis.v25i3.779","article-title":"Concept analysis Some limitations and possible solutions","volume":"25","year":"2002","journal-title":"Curationis"},{"key":"B2","doi-asserted-by":"publisher","first-page":"4","DOI":"10.5195\/jmla.2018.283","article-title":"A systematic approach to searching an efficient and complete method to develop literature searches","volume":"106","author":"Bramer","year":"2018","journal-title":"JMLA."},{"key":"B3","unstructured":"CASP- Critical Appraisal Skills Programme2023"},{"key":"B4","doi-asserted-by":"publisher","first-page":"1604","DOI":"10.1016\/j.ijnurstu.2009.04.003","article-title":"The effectiveness and active ingredients of mutual support groups for family caregivers of people with psychotic disorders a literature review","volume":"46","author":"Chien","year":"2009","journal-title":"Int. J. Nurs. Stud."},{"key":"B5","unstructured":"Rob 2 A Revised Cochrane Risk-of-Bias Tool for Randomized Trials2023"},{"key":"B6","unstructured":"2023"},{"key":"B7","doi-asserted-by":"publisher","first-page":"1435","DOI":"10.1177\/1049732312452938","article-title":"Beyond PICO the SPIDER tool for qualitative evidence synthesis","volume":"22","author":"Cooke","year":"2012","journal-title":"Qual Health Res"},{"key":"B8","doi-asserted-by":"publisher","first-page":"ED000142","DOI":"10.1002\/14651858.ED000142","article-title":"Updated guidance for trusted systematic reviews a new edition of the Cochrane Handbook for Systematic Reviews of Interventions","volume":"10","author":"Cumpston","year":"2019","journal-title":"Cochrane Database Syst. Rev"},{"key":"B9","doi-asserted-by":"publisher","first-page":"675071","DOI":"10.3389\/frma.2021.675071","article-title":"Development of a methodological quality criteria list for observational studies the observational study quality evaluation","volume":"6","author":"Drukker","year":"2021","journal-title":"Front. Res. Metr. Anal"},{"key":"B10","doi-asserted-by":"publisher","first-page":"2683","DOI":"10.1007\/s11192-022-04289-7","article-title":"Search where you will find most Comparing the disciplinary coverage of 56 bibliographic databases","volume":"127","author":"Gusenbauer","year":"2022","journal-title":"Scientometrics"},{"key":"B11","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1002\/jrsm.1378","article-title":"Which academic search systems are suitable for systematic reviews or meta-analyses? Evaluating retrieval qualities of Google Scholar, PubMed, and 26 other resources","volume":"11","author":"Gusenbauer","year":"2020","journal-title":"Res. Synth. Meth"},{"key":"B12","doi-asserted-by":"publisher","first-page":"924","DOI":"10.1136\/bmj.39489.470347.AD","article-title":"GRADE an emerging consensus on rating quality of evidence and strength of recommendations","volume":"7650","author":"Guyatt","year":"2008","journal-title":"BMJ."},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1002\/14651858.MR000047.pub2","article-title":"Financial conflicts of interest in systematic reviews associations with results, conclusions, methodological quality","author":"Hansen","year":"2019","journal-title":"Cochrane Database Syst. Rev"},{"key":"B14","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1258\/1355819021927674","article-title":"Statistical heterogeneity in systematic reviews of clinical trials a critical appraisal of guidelines and practice","volume":"7","author":"Higgins","year":"2002","journal-title":"J. Health Serv. Res. Policy"},{"key":"B15","unstructured":"\u201cDevelopment of harmonized outcome measures for use in patient registries and clinical practice methods and lessons learned.,\u201d\n            LeavyM. B.\n            SchurC.\n            KassamaliF. Q.\n            JohnsonM. E.\n            SabharwalR.\n            WallaceP.\n          31573773AHRQ Methods for Effective Health Care2019"},{"key":"B16","doi-asserted-by":"publisher","first-page":"b2700","DOI":"10.1136\/bmj.b2700","article-title":"The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions explanation and elaboration","volume":"339","author":"Liberati","year":"2009","journal-title":"BMJ"},{"key":"B17","doi-asserted-by":"publisher","first-page":"499","DOI":"10.1016\/j.acuro.2018.01.010","article-title":"Metodolog\u00eda de una revisi\u00f3n sistem\u00e1tica","volume":"42","author":"Linares-Espin\u00f3s","year":"2018","journal-title":"Actas Urol\u00f3gicas Espa\u00f1olas."},{"key":"B18","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1186\/1471-2288-14-45","article-title":"Newcastle-Ottawa Scale comparing reviewers' to authors' assessments","volume":"14","author":"Lo","year":"2014","journal-title":"BMC Med Res Methodol"},{"key":"B19","doi-asserted-by":"publisher","first-page":"192","DOI":"10.1186\/s13643-016-0366-6","article-title":"Meta-analysis, complexity, and heterogeneity a qualitative interview study of researchers' methodological values and practices","volume":"5","author":"Lorenc","year":"2016","journal-title":"Syst. Rev"},{"key":"B20","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1007\/s10654-019-00576-5","article-title":"A 24-step guide on how to design, conduct, and successfully publish a systematic review and meta-analysis in medical research","volume":"35","author":"Muka","year":"2020","journal-title":"Eur. J. Epidemiol."},{"key":"B21","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1097\/01.NAJ.0000451683.66447.89","article-title":"JBI's systematic reviews data extraction and synthesis","volume":"114","author":"Munn","year":"2014","journal-title":"AJN."},{"key":"B22","article-title":"\u201cUSA, Organisation f\u00fcr Sicherheit und Zusammenarbeit in Europa, OSZE Sekretariat. CSCE testimonies causes and consequences of the Helsinki Final Act; 1972 \u2013 1989,\u201d","volume-title":"CSCE Oral History Project","author":"N\u011bmcov\u00e1","year":"2013"},{"key":"B23","unstructured":"Levels of Evidence Explanation of the 20112023"},{"key":"B24","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1111\/zph.12125","article-title":"Conducting systematic reviews of intervention questions i writing the review protocol, formulating the question and searching the literature","volume":"61","author":"O'Connor","year":"2014","journal-title":"Zoonoses Public Health"},{"key":"B25","doi-asserted-by":"publisher","first-page":"n71","DOI":"10.1136\/bmj.n71","article-title":"The PRISMA 2020 statement an updated guideline for reporting systematic reviews","volume":"372","author":"Page","year":"2021","journal-title":"BMJ."},{"key":"B26","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1590\/s1806-37562018000000088","article-title":"Inclusion and exclusion criteria in research studies definitions and why they matter","volume":"44","author":"Patino","year":"2018","journal-title":"J. Bras. Pneumol"},{"key":"B27","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1007\/s11606-011-1873-8","article-title":"Chapter 4 effective search strategies for systematic reviews of medical tests","volume":"27","author":"Relevo","year":"2012","journal-title":"J Gen. Intern. Med"},{"key":"B28","doi-asserted-by":"publisher","first-page":"1168","DOI":"10.1016\/j.jclinepi.2010.11.022","article-title":"Finding evidence for comparing medical interventions AHRQ and the effective health care program","volume":"64","author":"Relevo","year":"2011","journal-title":"J. Clini. Epidemiol"},{"key":"B29","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1186\/s13643-020-01542-z","article-title":"PRISMA-S an extension to the PRISMA statement for reporting literature searches in systematic reviews","volume":"10","author":"Rethlefsen","year":"2021","journal-title":"Syst. Rev."},{"key":"B30","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1007\/S40037-019-00530-X","article-title":"Limited by our limitations","volume":"8","author":"Ross","year":"2019","journal-title":"Perspect Med Educ."},{"key":"B31","doi-asserted-by":"publisher","first-page":"2","DOI":"10.5195\/jmla.2019.567","article-title":"Errors in search strategies used in systematic reviews and their effects on information retrieval","volume":"107","author":"Salvador-Oliv\u00e1n JAco-Cuenca","year":"2019","journal-title":"JMLA"},{"key":"B32","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1186\/1472-6947-7-16","article-title":"Utilization of the PICO framework to improve searching PubMed for clinical questions","volume":"7","author":"Schardt","year":"2007","journal-title":"BMC Med. Inform. Decis. Mak."},{"key":"B33","doi-asserted-by":"publisher","first-page":"j4008","DOI":"10.1136\/bmj.j4008","article-title":"AMSTAR 2 a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both","volume":"358","author":"Shea","year":"2017","journal-title":"BMJ"},{"key":"B34","doi-asserted-by":"publisher","first-page":"747","DOI":"10.1146\/annurev-psych-010418-102803","article-title":"How to do a systematic review a best practice guide for conducting and reporting narrative reviews, meta-analyses, and meta-syntheses","volume":"70","author":"Siddaway","year":"2019","journal-title":"Annu. Rev. Psychol"},{"key":"B35","unstructured":"SkinnerJ.\n          LibGuides Doing a Systematic Review Step 3 Developing a Search Strategy2023"},{"key":"B36","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1186\/1471-2288-11-15","article-title":"Methodology in conducting a systematic review of systematic reviews of healthcare interventions","volume":"11","author":"Smith","year":"2011","journal-title":"BMC Med. Res. Methodol."},{"key":"B37","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1162\/qss_a_00112","article-title":"Large-scale comparison of bibliographic data sources scopus, web of science, dimensions, crossref, microsoft academic","volume":"2","author":"Visser","year":"2021","journal-title":"Quant. Sci. Stud."},{"key":"B38","doi-asserted-by":"publisher","first-page":"260","DOI":"10.1186\/s12874-020-01144-2","article-title":"Identifying competing interest disclosures in systematic reviews of surgical interventions and devices a cross-sectional survey","volume":"20","author":"Yu","year":"2020","journal-title":"BMC Med Res Methodol."}],"container-title":["Frontiers in Research Metrics and Analytics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frma.2023.1268045\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,21]],"date-time":"2023-12-21T04:50:22Z","timestamp":1703134222000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frma.2023.1268045\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,21]]},"references-count":38,"alternative-id":["10.3389\/frma.2023.1268045"],"URL":"https:\/\/doi.org\/10.3389\/frma.2023.1268045","relation":{},"ISSN":["2504-0537"],"issn-type":[{"value":"2504-0537","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,21]]},"article-number":"1268045"}}