{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,1]],"date-time":"2026-09-01T11:48:46Z","timestamp":1788263326647,"version":"build-2803163510"},"reference-count":40,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2026,4,7]],"date-time":"2026-04-07T00:00:00Z","timestamp":1775520000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Pathogens"],"abstract":"<jats:p>The assessment of risk of bias in systematic reviews and meta-analyses is crucial, as it indicates the accuracy of the synthesized and evaluated data and the validity of the presented results and conclusions. Until now, standardized tools for this purpose have been available only for clinical and animal studies, while adapted forms of these tools and novel ones have been proposed for in vitro and laboratory studies. However, none of them have been universally standardized so far. The apparent lack of a risk of bias assessment tool for systematic reviews of in vitro antimicrobial susceptibility testing studies constitutes a methodological flaw in these studies. To this end, we developed a risk of bias assessment tool for in vitro antimicrobial susceptibility testing studies. Our tool assesses the risk of bias across six domains: methodological bias, selection bias, preparation bias (including contamination\/cross-contamination bias), measurement\/observer bias, reporting and publication bias, and bias related to unreported funding and conflicts of interest. The tool evaluates a total of 16 specific criteria. The risk of bias is graded as low, moderate, or high for each evaluated criterion. The proposed risk of bias assessment tool was tested in a pilot validation study of ten relevant studies by two reviewers independently. We believe that the use of the proposed risk of bias assessment tool will increase the methodological strength of systematic reviews and meta-analyses of in vitro antimicrobial susceptibility testing studies.<\/jats:p>","DOI":"10.3390\/pathogens15040396","type":"journal-article","created":{"date-parts":[[2026,4,7]],"date-time":"2026-04-07T08:09:00Z","timestamp":1775549340000},"page":"396","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Proposed Risk of Bias Assessment Tool for In Vitro Antimicrobial Susceptibility Studies"],"prefix":"10.3390","volume":"15","author":[{"given":"Matthew E.","family":"Falagas","sequence":"first","affiliation":[{"name":"Alfa Institute of Biomedical Sciences (AIBS), Marousi, 151 23 Athens, Greece"},{"name":"School of Medicine, European University Cyprus, 2404 Nicosia, Cyprus"},{"name":"Department of Medicine, Tufts University School of Medicine, Boston, MA\u00a002111, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9047-7926","authenticated-orcid":false,"given":"Dimitrios","family":"Ragias","sequence":"additional","affiliation":[{"name":"Alfa Institute of Biomedical Sciences (AIBS), Marousi, 151 23 Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dimitrios S.","family":"Kontogiannis","sequence":"additional","affiliation":[{"name":"Alfa Institute of Biomedical Sciences (AIBS), Marousi, 151 23 Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura T.","family":"Romanos","sequence":"additional","affiliation":[{"name":"Alfa Institute of Biomedical Sciences (AIBS), Marousi, 151 23 Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4375-5812","authenticated-orcid":false,"given":"Paraskevi A.","family":"Farazi","sequence":"additional","affiliation":[{"name":"School of Medicine, European University Cyprus, 2404 Nicosia, Cyprus"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,4,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1102","DOI":"10.1093\/ejcts\/ezaa174","article-title":"The Importance of Risk of Bias Assessment in Meta-Analyses: Does Controlling Heterogeneity Suffice?","volume":"58","author":"Chan","year":"2020","journal-title":"Eur. J. Cardio-Thorac. Surg. Off. J. Eur. Assoc. Cardio-Thorac. Surg."},{"key":"ref_2","first-page":"16","article-title":"External Validity, Generalizability, and Knowledge Utilization","volume":"36","author":"Ferguson","year":"2004","journal-title":"J. Nurs. Scholarsh. Off. Publ. Sigma Theta Tau Int. Honor Soc. Nurs."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"100117","DOI":"10.1016\/j.esmoop.2021.100117","article-title":"Biases in Study Design, Implementation, and Data Analysis That Distort the Appraisal of Clinical Benefit and ESMO-Magnitude of Clinical Benefit Scale (ESMO-MCBS) Scoring","volume":"6","author":"Gyawali","year":"2021","journal-title":"ESMO Open"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1007\/978-1-0716-1138-8_22","article-title":"Evidence-Based Decision-Making 2: Systematic Reviews and Meta-Analysis","volume":"2249","author":"Bello","year":"2021","journal-title":"Methods Mol. Biol. Clifton NJ"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1038\/s41432-025-01186-9","article-title":"Mapping risk of bias criteria in systematic reviews of in vitro endodontic studies: An umbrella review","volume":"26","author":"Piva","year":"2025","journal-title":"Evid.-Based Dent."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"d5928","DOI":"10.1136\/bmj.d5928","article-title":"The Cochrane Collaboration\u2019s Tool for Assessing Risk of Bias in Randomised Trials","volume":"343","author":"Higgins","year":"2011","journal-title":"BMJ"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"l4898","DOI":"10.1136\/bmj.l4898","article-title":"RoB 2: A Revised Tool for Assessing Risk of Bias in Randomised Trials","volume":"366","author":"Sterne","year":"2019","journal-title":"BMJ"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"i4919","DOI":"10.1136\/bmj.i4919","article-title":"ROBINS-I: A Tool for Assessing Risk of Bias in Non-Randomised Studies of Interventions","volume":"355","author":"Sterne","year":"2016","journal-title":"BMJ"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"108602","DOI":"10.1016\/j.envint.2024.108602","article-title":"A Tool to Assess Risk of Bias in Non-Randomized Follow-up Studies of Exposure Effects (ROBINS-E)","volume":"186","author":"Higgins","year":"2024","journal-title":"Environ. Int."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3065","DOI":"10.1007\/s00204-025-03978-5","article-title":"Assessing Risk of Bias in Toxicological Studies in the Era of Artificial Intelligence","volume":"99","author":"Hartung","year":"2025","journal-title":"Arch. Toxicol."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Gajic, I., Kabic, J., Kekic, D., Jovicevic, M., Milenkovic, M., Mitic Culafic, D., Trudic, A., Ranin, L., and Opavski, N. (2022). Antimicrobial Susceptibility Testing: A Comprehensive Review of Currently Used Methods. Antibiotics, 11.","DOI":"10.3390\/antibiotics11040427"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Kohlmann, R., and Gatermann, S.G. (2016). Analysis and Presentation of Cumulative Antimicrobial Susceptibility Test Data--The Influence of Different Parameters in a Routine Clinical Microbiology Laboratory. PLoS ONE, 11.","DOI":"10.1371\/journal.pone.0147965"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wu, Y., Wang, Q., Zheng, F., Yu, T., Wang, Y., Fan, S., and Zhang, X. (2022). The Sample Error Pre-Antimicrobial Susceptibility Testing and Its Influencing Factors from the Perspective of Hospital Management: A Cross-Sectional Study. Antibiotics, 11.","DOI":"10.3390\/antibiotics11121715"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1016\/j.envint.2018.11.004","article-title":"A Risk of Bias Instrument for Non-Randomized Studies of Exposures: A Users\u2019 Guide to Its Application in the Context of GRADE","volume":"122","author":"Morgan","year":"2019","journal-title":"Environ. Int."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Hooijmans, C.R., Rovers, M.M., De Vries, R.B., Leenaars, M., Ritskes-Hoitinga, M., and Langendam, M.W. (2014). SYRCLE\u2019s Risk of Bias Tool for Animal Studies. BMC Med. Res. Methodol., 14.","DOI":"10.1186\/1471-2288-14-43"},{"key":"ref_16","unstructured":"Geneen, L. (2024). Development and Use of a New Risk of Bias (ROB) Tool for Use in Paired Sample (in-Vitro) Laboratory Studies. Proceedings of the 2024 Prague [Global Evidence Summit], Cochrane Colloquium Abstracts. Available online: https:\/\/abstracts.cochrane.org\/2024-prague-global-evidence-summit\/development-and-use-new-risk-bias-rob-tool-use-paired-sample."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2232415","DOI":"10.1080\/2833373X.2023.2232415","article-title":"Protocol for Designing INVITES-IN, a Tool for Assessing the Internal Validity of in Vitro Studies","volume":"1","author":"Svendsen","year":"2023","journal-title":"Evid.-Based Toxicol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"e12098","DOI":"10.1002\/cesm.12098","article-title":"Systematic Reviews of Clinical Laboratory Studies: Pilot Risk of Bias Tool Developed by Consensus","volume":"2","author":"Fox","year":"2024","journal-title":"Cochrane Evid. Synth. Methods"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"104350","DOI":"10.1016\/j.jdent.2022.104350","article-title":"RoBDEMAT: A Risk of Bias Tool and Guideline to Support Reporting of Pre-Clinical Dental Materials Research and Assessment of Systematic Reviews","volume":"127","author":"Delgado","year":"2022","journal-title":"J. Dent."},{"key":"ref_20","unstructured":"Wells, G.A., Shea, B., O\u2019Connell, D., Peterson, J., Welch, V., Losos, M., and Tugwell, P. (2025, August 16). The Newcastle\u2013Ottawa Scale (NOS) for Assessing the Quality of Nonrandomised Studies in Meta-Analyses. Available online: http:\/\/www.ohri.ca\/programs\/clinical_epidemiology\/oxford.asp."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"494","DOI":"10.11124\/JBIES-22-00430","article-title":"The Revised JBI Critical Appraisal Tool for the Assessment of Risk of Bias for Randomized Controlled Trials","volume":"21","author":"Barker","year":"2023","journal-title":"JBI Evid. Synth."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"378","DOI":"10.11124\/JBIES-23-00268","article-title":"The Revised JBI Critical Appraisal Tool for the Assessment of Risk of Bias for Quasi-Experimental Studies","volume":"22","author":"Barker","year":"2024","journal-title":"JBI Evid. Synth."},{"key":"ref_23","unstructured":"(2025, August 14). CASP Qualitative Studies Checklist. Available online: https:\/\/casp-uk.net\/casp-tools-checklists\/qualitative-studies-checklist\/."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1038","DOI":"10.1016\/j.prosdent.2022.05.019","article-title":"Development and Validation of a Risk-of-Bias Tool for Assessing in Vitro Studies Conducted in Dentistry: The QUIN","volume":"131","author":"Sheth","year":"2024","journal-title":"J. Prosthet. Dent."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Falagas, M.E., Romanos, L.T., Kontogiannis, D.S., Tsiara, K., and Kakoullis, S.A. (2025). Resistance of Gram-Negative Bacteria to Cefepime-Enmetazobactam: A Systematic Review. Pathogens, 14.","DOI":"10.3390\/pathogens14080777"},{"key":"ref_26","unstructured":"(2025, September 16). EUCAST: Definitions of S, I and R. Available online: https:\/\/www.eucast.org\/newsiandr."},{"key":"ref_27","unstructured":"(2025, September 16). Re-Exploring the Intermediate Interpretive Category|CLSI. Available online: https:\/\/clsi.org\/resources\/insights\/re-exploring-the-intermediate-interpretive-category\/."},{"key":"ref_28","unstructured":"CLSI (2025). \u201cPerformance Standards for Antimicrobial Susceptibility Testing\u201d (M100), CLSI. [35th ed.]. M100Ed35E."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"O255","DOI":"10.1111\/1469-0691.12373","article-title":"Development of the EUCAST Disk Diffusion Antimicrobial Susceptibility Testing Method and Its Implementation in Routine Microbiology Laboratories","volume":"20","author":"Matuschek","year":"2014","journal-title":"Clin. Microbiol. Infect."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"e01934-17","DOI":"10.1128\/JCM.01934-17","article-title":"CLSI Methods Development and Standardization Working Group Best Practices for Evaluation of Antimicrobial Susceptibility Tests","volume":"56","author":"Humphries","year":"2018","journal-title":"J. Clin. Microbiol."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Rollet, R., Vaustat, D., Litterio, M., Castello, L., Fern\u00e1ndez-Canigia, L., Barberis, C., Legaria, M.C., Azula, N., Maldonado, M.L., and Laube, G. (Rev. Argent. Microbiol., 2025). Antimicrobial Susceptibility of Clostridioides Difficile. An Argentinian Multicenter Study of Isolates from Human Patients, Rev. Argent. Microbiol., in press.","DOI":"10.1016\/j.ram.2025.09.006"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1177\/10766294251384459","article-title":"Clinical Epidemiology and Antimicrobial Susceptibility of Carbapenemase-Producing Enterobacterales from a German University Hospital During a 5-Year Period","volume":"31","author":"Sommer","year":"2025","journal-title":"Microb. Drug Resist."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"3147068","DOI":"10.1155\/ijm\/3147068","article-title":"Detection and Antimicrobial Susceptibility of Carbapenem-Resistant Organisms Isolated in the Center of Care and Protection of Orphan Children, Vietnam","volume":"2025","author":"Thang","year":"2025","journal-title":"Int. J. Microbiol."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Shi, H., Tu, Y., Li, H., Gao, H., Wang, F., Zhang, W., Jiang, M., Sun, Q., Bao, Z., and Yang, X. (2025). Molecular Characteristics and Antimicrobial Susceptibility of Carbapenem-Resistant Klebsiella Pneumoniae in a Multicenter Study in Ningbo, China. Front. Microbiol., 16.","DOI":"10.3389\/fmicb.2025.1628592"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Gahamanyi, N., Habimana, A.M., Harerimana, J.P., Mukayisenga, J., Ntwali, S., Umuhoza, A., Nsengiyumva, E., Irimaso, E., Bosco Shimirwa, J., and Pan, C.-H. (2025). Antimicrobial Susceptibility Profiles of Thermophilic Campylobacter Species from Human, Pig, and Chicken Feces in Rwanda. Front. Microbiol., 16.","DOI":"10.3389\/fmicb.2025.1570290"},{"key":"ref_36","first-page":"e184","article-title":"Antimicrobial Susceptibility Patterns of Escherichia Coli from Various Clinical Sources","volume":"5","author":"Zaghlol","year":"2025","journal-title":"Antimicrob. Steward. Healthc. Epidemiol. ASHE"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"780","DOI":"10.1016\/j.pathol.2025.05.006","article-title":"Antimicrobial Susceptibility Testing and Clinical Outcomes of Non-Cystic Fibrosis Burkholderia Cepacia Complex Infections","volume":"57","author":"Ngiam","year":"2025","journal-title":"Pathology"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Tafere, F.A., Fenta, M.D., Atanaw, M.B., Tsehay, E.M., Mengstu, Y.H., and Mebiratu, A.S. (2025). Prevalence and Antimicrobial Susceptibility Patterns of Salmonella from Apparently Healthy Slaughtered Cattle and Abattoir Workers at Gondar Elfora Abattoir, Central Gondar Zone, Ethiopia. BMC Microbiol., 25.","DOI":"10.1186\/s12866-025-04262-3"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"105552","DOI":"10.1016\/j.psj.2025.105552","article-title":"Prevalence and Antimicrobial Susceptibility of Mycoplasma Gallisepticum and Mycoplasma Synoviae Isolated from the Central Peninsular Malaysia","volume":"104","author":"Rufai","year":"2025","journal-title":"Poult. Sci."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"732","DOI":"10.3855\/jidc.20643","article-title":"In-Vitro Antimicrobial Susceptibility Results of Brucella Species; Single Center Study from Eastern T\u00fcrkiye","volume":"19","year":"2025","journal-title":"J. Infect. Dev. Ctries."}],"container-title":["Pathogens"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-0817\/15\/4\/396\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,7]],"date-time":"2026-04-07T08:32:49Z","timestamp":1775550769000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-0817\/15\/4\/396"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,7]]},"references-count":40,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2026,4]]}},"alternative-id":["pathogens15040396"],"URL":"https:\/\/doi.org\/10.3390\/pathogens15040396","relation":{},"ISSN":["2076-0817"],"issn-type":[{"value":"2076-0817","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,7]]}}}