{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"institution":[{"name":"Research Square"}],"indexed":{"date-parts":[[2024,12,13]],"date-time":"2024-12-13T05:20:36Z","timestamp":1734067236048,"version":"3.30.2"},"posted":{"date-parts":[[2024,2,26]]},"group-title":"In Review","reference-count":39,"publisher":"Springer Science and Business Media LLC","license":[{"start":{"date-parts":[[2024,2,26]],"date-time":"2024-02-26T00:00:00Z","timestamp":1708905600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"accepted":{"date-parts":[[2024,1,25]]},"abstract":"<title>Abstract<\/title>\n        <p>Background\n Preliminary studies (e.g., pilot\/feasibility studies) can result in misleading evidence that an intervention is ready to be evaluated in a large-scale trial when it is not. Risk of Generalizability Biases (RGBs, a set of external validity biases) represent study features that influence estimates of effectiveness, often inflating estimates in preliminary studies which are not replicated in larger-scale trials. While RGBs have been empirically established in interventions targeting obesity, the extent to which RGBs generalize to other health areas is unknown. Understanding the relevance of RGBs across health behavior intervention research can inform organized efforts to reduce their prevalence.\nPurpose\n The purpose of our study was to examine whether RGBs generalize outside of obesity-related interventions.\nMethods\n A systematic review identified health behavior interventions across four behaviors unrelated to obesity that follow a similar intervention development framework of preliminary studies informing larger-scale trials (i.e., tobacco use disorder, alcohol use disorder, interpersonal violence, and behaviors related to increased sexually transmitted infections). To be included, published interventions had to be tested in a preliminary study followed by testing in a larger trial (the two studies thus comprising a study pair). We extracted health-related outcomes and coded the presence\/absence of RGBs. We used meta-regression models to estimate the impact of RGBs on the change in standardized mean difference (\u0394SMD) between the preliminary study and larger trial.\nResults\n We identified sixty-nine study pairs, of which forty-seven were eligible for inclusion in the analysis (k\u2009=\u2009156 effects), with RGBs identified for each behavior. For pairs where the RGB was present in the preliminary study but removed in the larger trial the treatment effect decreased by an average of \u0394SMD=-0.38 (range \u2212\u20090.69 to -0.21). This provides evidence of larger drop in effectiveness for studies containing RGBs relative to study pairs with no RGBs present (treatment effect decreased by an average of \u0394SMD =-0.24, range \u2212\u20090.19 to -0.27).\nConclusion\n RGBs may be associated with higher effect estimates across diverse areas of health intervention research. These findings suggest commonalities shared across health behavior intervention fields may facilitate introduction of RGBs within preliminary studies, rather than RGBs being isolated to a single health behavior field.<\/p>","DOI":"10.21203\/rs.3.rs-3897976\/v1","type":"posted-content","created":{"date-parts":[[2024,2,26]],"date-time":"2024-02-26T09:41:29Z","timestamp":1708940489000},"source":"Crossref","is-referenced-by-count":0,"title":["Are the Risk of Generalizability Biases Generalizable? A Meta-Epidemiological Study"],"prefix":"10.21203","author":[{"given":"Lauren","family":"von Klinggraeff","sequence":"first","affiliation":[{"name":"Augusta University, Augusta University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chris D.","family":"Pfledderer","sequence":"additional","affiliation":[{"name":"University of Texas Health Science Center at Houston"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sarah","family":"Burkart","sequence":"additional","affiliation":[{"name":"University of South Carolina"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kaitlyn","family":"Ramey","sequence":"additional","affiliation":[{"name":"University of South Carolina"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michal","family":"Smith","sequence":"additional","affiliation":[{"name":"University of South Carolina"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexander C.","family":"McLain","sequence":"additional","affiliation":[{"name":"University of South Carolina"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bridget","family":"Armstrong","sequence":"additional","affiliation":[{"name":"University of South Carolina"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"R. Glenn","family":"Weaver","sequence":"additional","affiliation":[{"name":"University of South Carolina"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anthony","family":"Okely","sequence":"additional","affiliation":[{"name":"University of Wollongong"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Lubans","sequence":"additional","affiliation":[{"name":"University of Jyv\u00e4skyl\u00e4"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"John P.A.","family":"Ioannidis","sequence":"additional","affiliation":[{"name":"Stanford University, Meta-Research Innovation Center at Stanford (METRICS)"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Russell","family":"Jago","sequence":"additional","affiliation":[{"name":"University of Bristol"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gabrielle","family":"Turner-McGrievy","sequence":"additional","affiliation":[{"name":"University of South Carolina"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James","family":"Thrasher","sequence":"additional","affiliation":[{"name":"University of South Carolina"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaoming","family":"Li","sequence":"additional","affiliation":[{"name":"University of South Carolina"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael W.","family":"Beets","sequence":"additional","affiliation":[{"name":"University of South Carolina"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","reference":[{"issue":"Suppl 1","key":"ref1","doi-asserted-by":"crossref","first-page":"i20","DOI":"10.1093\/fampra\/cmn055","article-title":"Making research relevant: if it is an evidence-based practice, where's the practice-based evidence?","volume":"25","author":"Green LW","year":"2008","unstructured":"Green LW. Making research relevant: if it is an evidence-based practice, where's the practice-based evidence? Fam Pract. 2008;25(Suppl 1):i20\u20134.","journal-title":"Fam Pract"},{"issue":"8","key":"ref2","doi-asserted-by":"crossref","first-page":"e124","DOI":"10.1371\/journal.pmed.0020124","article-title":"Why most published research findings are false","volume":"2","author":"Ioannidis JP","year":"2005","unstructured":"Ioannidis JP. Why most published research findings are false. PLoS Med. 2005;2(8):e124.","journal-title":"PLoS Med"},{"key":"ref3","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1186\/1748-5908-8-117","article-title":"The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change","volume":"8","author":"Chambers DA","year":"2013","unstructured":"Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci. 2013;8:117.","journal-title":"Implement Sci"},{"issue":"7","key":"ref4","doi-asserted-by":"crossref","first-page":"964","DOI":"10.1111\/obr.12845","article-title":"Scaling-up evidence-based obesity interventions: A systematic review assessing intervention adaptations and effectiveness and quantifying the scale-up penalty","volume":"20","author":"McCrabb S","year":"2019","unstructured":"McCrabb S, Lane C, Hall A, Milat A, Bauman A, Sutherland R, et al. Scaling-up evidence-based obesity interventions: A systematic review assessing intervention adaptations and effectiveness and quantifying the scale-up penalty. Obes Rev. 2019;20(7):964\u201382.","journal-title":"Obes Rev"},{"issue":"1","key":"ref5","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1186\/s12966-020-0918-y","article-title":"Identification and evaluation of risk of generalizability biases in pilot versus efficacy\/effectiveness trials: a systematic review and meta-analysis","volume":"17","author":"Beets MW","year":"2020","unstructured":"Beets MW, Weaver RG, Ioannidis JPA, Geraci M, Brazendale K, Decker L, et al. Identification and evaluation of risk of generalizability biases in pilot versus efficacy\/effectiveness trials: a systematic review and meta-analysis. Int J Behav Nutr Phys Activity. 2020;17(1):19.","journal-title":"Int J Behav Nutr Phys Activity"},{"issue":"2","key":"ref6","doi-asserted-by":"crossref","first-page":"e13369","DOI":"10.1111\/obr.13369","article-title":"Impact of risk of generalizability biases in adult obesity interventions: A meta-epidemiological review and meta-analysis","volume":"23","author":"Beets MW","year":"2022","unstructured":"Beets MW, von Klinggraeff L, Burkart S, Jones A, Ioannidis JPA, Weaver RG, et al. Impact of risk of generalizability biases in adult obesity interventions: A meta-epidemiological review and meta-analysis. Obes Rev. 2022;23(2):e13369.","journal-title":"Obes Rev"},{"issue":"5","key":"ref7","doi-asserted-by":"crossref","first-page":"618","DOI":"10.1016\/j.jpeds.2004.12.019","article-title":"Two-year follow-up results for Hip-Hop to Health Jr.: a randomized controlled trial for overweight prevention in preschool minority children","volume":"146","author":"Fitzgibbon ML","year":"2005","unstructured":"Fitzgibbon ML, Stolley MR, Schiffer L, Van Horn L, KauferChristoffel K, Dyer A. Two-year follow-up results for Hip-Hop to Health Jr.: a randomized controlled trial for overweight prevention in preschool minority children. J Pediatr. 2005;146(5):618\u201325.","journal-title":"J Pediatr"},{"issue":"2","key":"ref8","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1016\/j.amepre.2015.07.008","article-title":"Hip-Hop to Health Jr. Randomized Effectiveness Trial: 1-Year Follow-up Results","volume":"50","author":"Kong A","year":"2016","unstructured":"Kong A, Buscemi J, Stolley MR, Schiffer LA, Kim Y, Braunschweig CL, et al. Hip-Hop to Health Jr. Randomized Effectiveness Trial: 1-Year Follow-up Results. Am J Prev Med. 2016;50(2):136\u201344.","journal-title":"Am J Prev Med"},{"issue":"1","key":"ref9","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1177\/2167702613497932","article-title":"Reenvisioning Clinical Science: Unifying the Discipline to Improve the Public Health","volume":"2","author":"Onken LS","year":"2014","unstructured":"Onken LS, Carroll KM, Shoham V, Cuthbert BN, Riddle M. Reenvisioning Clinical Science: Unifying the Discipline to Improve the Public Health. Clin Psychol Sci. 2014;2(1):22\u201334.","journal-title":"Clin Psychol Sci"},{"key":"ref10","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.brat.2017.07.002","article-title":"The NIH Science of Behavior Change Program: Transforming the science through a focus on mechanisms of change","volume":"101","author":"Nielsen L","year":"2018","unstructured":"Nielsen L, Riddle M, King JW, Aklin WM, Chen W, Clark D, et al. The NIH Science of Behavior Change Program: Transforming the science through a focus on mechanisms of change. Behav Res Ther. 2018;101:3\u201311.","journal-title":"Behav Res Ther"},{"issue":"6","key":"ref11","doi-asserted-by":"crossref","first-page":"328","DOI":"10.3322\/canjclin.34.6.328","article-title":"The scientific approach to cancer control","volume":"34","author":"Greenwald P","year":"1984","unstructured":"Greenwald P, Cullen JW. The scientific approach to cancer control. Cancer J Clin. 1984;34(6):328\u201332.","journal-title":"Cancer J Clin"},{"key":"ref12","article-title":"Impact of risk of generalizability biases in adult obesity interventions: A meta-epidemiological review and meta-analysis","author":"Beets MW","year":"2021","unstructured":"Beets MW, von Klinggraeff L, Burkart S, Jones A, Ioannidis JPA, Weaver RG et al. Impact of risk of generalizability biases in adult obesity interventions: A meta-epidemiological review and meta-analysis. Obes Rev. 2021;n\/a(n\/a):e13369.","journal-title":"Obes Rev"},{"key":"ref13","unstructured":"Cochrane Handbook for Systematic Reviews of Interventions. 2nd Edition ed: John Wiley & Son. ; 2019. Ed000142 p."},{"key":"ref14","doi-asserted-by":"crossref","first-page":"n71","DOI":"10.1136\/bmj.n71","article-title":"The PRISMA 2020 statement: an updated guideline for reporting systematic reviews","volume":"372","author":"Page MJ","year":"2021","unstructured":"Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71.","journal-title":"BMJ"},{"issue":"7","key":"ref15","doi-asserted-by":"crossref","first-page":"467","DOI":"10.7326\/M18-0850","article-title":"Checklist and Explanation","volume":"169","author":"PRISMA Extension for Scoping Reviews (PRISMA-ScR)","year":"2018","unstructured":"PRISMA Extension for Scoping Reviews (PRISMA-ScR). Checklist and Explanation. Ann Intern Med. 2018;169(7):467\u201373.","journal-title":"Ann Intern Med"},{"issue":"10","key":"ref16","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1037\/hea0000161","article-title":"From ideas to efficacy: The ORBIT model for developing behavioral treatments for chronic diseases","volume":"34","author":"Czajkowski SM","year":"2015","unstructured":"Czajkowski SM, Powell LH, Adler N, Naar-King S, Reynolds KD, Hunter CM, et al. From ideas to efficacy: The ORBIT model for developing behavioral treatments for chronic diseases. Health Psychol. 2015;34(10):971\u201382.","journal-title":"Health Psychol"},{"key":"ref17","doi-asserted-by":"crossref","first-page":"g1687","DOI":"10.1136\/bmj.g1687","article-title":"Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide","volume":"348","author":"Hoffmann TC","year":"2014","unstructured":"Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.","journal-title":"BMJ"},{"issue":"1","key":"ref18","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1027\/1016-9040\/a000330","article-title":"Developing Behavior Change Interventions for Self-Management in Chronic Illness: An Integrative Overview","volume":"24","author":"Ara\u00fajo-Soares V","year":"2019","unstructured":"Ara\u00fajo-Soares V, Hankonen N, Presseau J, Rodrigues A, Sniehotta FF. Developing Behavior Change Interventions for Self-Management in Chronic Illness: An Integrative Overview. Eur Psychol. 2019;24(1):7\u201325.","journal-title":"Eur Psychol"},{"year":"2015","author":"Sallis JF","key":"ref19","unstructured":"Sallis JF, Owen N, Fisher E. Ecological models of health behavior. Health behavior: Theory, research, and practice. 2015;5(43\u201364)."},{"issue":"7","key":"ref20","doi-asserted-by":"crossref","first-page":"497","DOI":"10.2217\/cer-2019-0201","article-title":"What is a meta-epidemiological study? Analysis of published literature indicated heterogeneous study designs and definitions","volume":"9","author":"Puljak L","year":"2020","unstructured":"Puljak L, Makaric ZL, Buljan I, Pieper D. What is a meta-epidemiological study? Analysis of published literature indicated heterogeneous study designs and definitions. J Comp Eff Res. 2020;9(7):497\u2013508.","journal-title":"J Comp Eff Res"},{"issue":"9","key":"ref21","doi-asserted-by":"crossref","first-page":"2163","DOI":"10.1038\/oby.2007.257","article-title":"Advances and controversies in the design of obesity prevention trials","volume":"15","author":"Stevens J","year":"2007","unstructured":"Stevens J, Taber DR, Murray DM, Ward DS. Advances and controversies in the design of obesity prevention trials. Obes (Silver Spring). 2007;15(9):2163\u201370.","journal-title":"Obes (Silver Spring)"},{"issue":"3","key":"ref22","doi-asserted-by":"crossref","first-page":"e0150205","DOI":"10.1371\/journal.pone.0150205","article-title":"Defining Feasibility and Pilot Studies in Preparation for Randomised Controlled Trials: Development of a Conceptual Framework","volume":"11","author":"Eldridge SM","year":"2016","unstructured":"Eldridge SM, Lancaster GA, Campbell MJ, Thabane L, Hopewell S, Coleman CL, et al. Defining Feasibility and Pilot Studies in Preparation for Randomised Controlled Trials: Development of a Conceptual Framework. PLoS ONE. 2016;11(3):e0150205.","journal-title":"PLoS ONE"},{"issue":"1","key":"ref23","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1186\/s12966-021-01080-4","article-title":"How effective are physical activity interventions when they are scaled-up: a systematic review","volume":"18","author":"Lane C","year":"2021","unstructured":"Lane C, McCrabb S, Nathan N, Naylor P-J, Bauman A, Milat A, et al. How effective are physical activity interventions when they are scaled-up: a systematic review. Int J Behav Nutr Phys Activity. 2021;18(1):16.","journal-title":"Int J Behav Nutr Phys Activity"},{"issue":"4","key":"ref24","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1007\/s40865-019-00128-1","article-title":"Understanding and Quantifying the Scale-Up Penalty: a Systematic Review of Early Developmental Preventive Interventions with Criminological Outcomes","volume":"5","author":"Yohros A","year":"2019","unstructured":"Yohros A, Welsh BC. Understanding and Quantifying the Scale-Up Penalty: a Systematic Review of Early Developmental Preventive Interventions with Criminological Outcomes. J Dev Life-Course Criminol. 2019;5(4):481\u201397.","journal-title":"J Dev Life-Course Criminol"},{"issue":"11","key":"ref25","doi-asserted-by":"crossref","first-page":"974","DOI":"10.1136\/jech-2013-203104","article-title":"Meta-analysis of prevalence","volume":"67","author":"Barendregt JJ","year":"2013","unstructured":"Barendregt JJ, Doi SA, Lee YY, Norman RE, Vos T. Meta-analysis of prevalence. J Epidemiol Commun Health. 2013;67(11):974\u20138.","journal-title":"J Epidemiol Commun Health"},{"author":"News NF","key":"ref26","unstructured":"News NF. Highlight Preliminary Data in Your Next Application [Available from: https:\/\/www.niaid.nih.gov\/grants-contracts\/highlight-preliminary-data-your-next-application."},{"year":"2013","author":"Craig P","key":"ref27","unstructured":"Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. 2013."},{"issue":"1","key":"ref28","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1177\/2515245919895419","article-title":"Metascience on Peer Review: Testing the Effects of a Study\u2019s Originality and Statistical Significance in a Field Experiment","volume":"3","author":"Elson M","year":"2020","unstructured":"Elson M, Huff M, Utz S. Metascience on Peer Review: Testing the Effects of a Study\u2019s Originality and Statistical Significance in a Field Experiment. Adv Methods Practices Psychol Sci. 2020;3(1):53\u201365.","journal-title":"Adv Methods Practices Psychol Sci"},{"key":"ref29","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.jclinepi.2023.05.011","article-title":"Scientists\u2019 perception of pilot study quality was influenced by statistical significance and study design","volume":"159","author":"Klinggraeff L","year":"2023","unstructured":"von Klinggraeff L, Burkart S, Pfledderer CD, Saba Nishat MN, Armstrong B, Weaver RG, et al. Scientists\u2019 perception of pilot study quality was influenced by statistical significance and study design. J Clin Epidemiol. 2023;159:70\u20138.","journal-title":"J Clin Epidemiol"},{"key":"ref30","article-title":"Scientists\u2019 Perception of Pilot Study Quality Was Influenced by Statistical Significance and Study Design","author":"Klinggraeff L","year":"2023","unstructured":"von Klinggraeff L, Burkart S, Pfledderer CD, Saba Nishat MN, Armstrong B, Weaver RG et al. Scientists\u2019 Perception of Pilot Study Quality Was Influenced by Statistical Significance and Study Design. J Clin Epidemiol. 2023.","journal-title":"J Clin Epidemiol"},{"volume-title":"Balancing Best Practice and Reality in Behavioral Intervention Development: A Survey of Principal Investigators Funded by the National Institutes of Health","author":"Klinggraeff L","key":"ref31","unstructured":"von Klinggraeff L, Burkart S, Pfledderer CD, McLain A, Armstrong B, Weaver RG et al. Balancing Best Practice and Reality in Behavioral Intervention Development: A Survey of Principal Investigators Funded by the National Institutes of Health. Under Review, Translational Behavioral Medicine."},{"issue":"4","key":"ref32","doi-asserted-by":"crossref","first-page":"566","DOI":"10.1016\/j.jhsa.2007.11.028","article-title":"Fundamental principles of writing a successful grant proposal","volume":"33","author":"Chung KC","year":"2008","unstructured":"Chung KC, Shauver MJ. Fundamental principles of writing a successful grant proposal. J Hand Surg Am. 2008;33(4):566\u201372.","journal-title":"J Hand Surg Am"},{"issue":"3","key":"ref33","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1037\/met0000011","article-title":"Small sample adjustments for robust variance estimation with meta-regression","volume":"20","author":"Tipton E","year":"2015","unstructured":"Tipton E. Small sample adjustments for robust variance estimation with meta-regression. Psychol Methods. 2015;20(3):375\u201393.","journal-title":"Psychol Methods"},{"issue":"1","key":"ref34","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1186\/s40814-023-01270-w","article-title":"Feasibility indicators in obesity-related behavioral intervention preliminary studies: a historical scoping review","volume":"9","author":"Pfledderer CD","year":"2023","unstructured":"Pfledderer CD, von Klinggraeff L, Burkart S, Wolfenden L, Ioannidis JPA, Beets MW. Feasibility indicators in obesity-related behavioral intervention preliminary studies: a historical scoping review. Pilot Feasibility Stud. 2023;9(1):46.","journal-title":"Pilot Feasibility Stud"},{"volume-title":"Pilot trials may improve the quality of full-scale trials: a meta-research study","author":"Ying X","key":"ref35","unstructured":"Ying X, Ehrhardt S. Pilot trials may improve the quality of full-scale trials: a meta-research study. Journal of Clinical Epidemiology."},{"issue":"2","key":"ref36","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1002\/oby.23054","article-title":"Completeness of Intervention Reporting of Clinical Trials Published in Highly Ranked Obesity Journals","volume":"29","author":"Rauh SL","year":"2021","unstructured":"Rauh SL, Turner D, Jellison S, Allison DB, Fugate C, Foote G, et al. Completeness of Intervention Reporting of Clinical Trials Published in Highly Ranked Obesity Journals. Obes (Silver Spring). 2021;29(2):285\u201393.","journal-title":"Obes (Silver Spring)"},{"issue":"12","key":"ref37","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1258\/jrsm.2011.11k042","article-title":"Recognizing, investigating and dealing with incomplete and biased reporting of clinical research: from Francis Bacon to the WHO","volume":"104","author":"Dickersin K","year":"2011","unstructured":"Dickersin K, Chalmers I. Recognizing, investigating and dealing with incomplete and biased reporting of clinical research: from Francis Bacon to the WHO. J R Soc Med. 2011;104(12):532\u20138.","journal-title":"J R Soc Med"},{"issue":"1","key":"ref38","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1186\/s13063-023-07215-1","article-title":"Incomplete reporting of complex interventions: a call to action for journal editors to review their submission guidelines","volume":"24","author":"Ryan M","year":"2023","unstructured":"Ryan M, Hoffmann T, Hofmann R, van Sluijs E. Incomplete reporting of complex interventions: a call to action for journal editors to review their submission guidelines. Trials. 2023;24(1):176.","journal-title":"Trials"},{"article-title":"Use of guidelines, checklists, frameworks, and recommendations in behavioral intervention preliminary studies: A","author":"Pfledderer C","key":"ref39","unstructured":"Pfledderer C, Klinggraeff L, Burkart S, Bandeira A, Armstrong B, Weaver R et al. Use of guidelines, checklists, frameworks, and recommendations in behavioral intervention preliminary studies: A scoping bibliometric review2022."}],"container-title":[],"original-title":[],"link":[{"URL":"https:\/\/www.researchsquare.com\/article\/rs-3897976\/v1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.researchsquare.com\/article\/rs-3897976\/v1.html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,12]],"date-time":"2024-12-12T07:56:03Z","timestamp":1733990163000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.researchsquare.com\/article\/rs-3897976\/v1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,26]]},"references-count":39,"URL":"https:\/\/doi.org\/10.21203\/rs.3.rs-3897976\/v1","relation":{},"subject":[],"published":{"date-parts":[[2024,2,26]]},"subtype":"preprint"}}