{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:23:59Z","timestamp":1750220639248,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":30,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,4,15]],"date-time":"2020-04-15T00:00:00Z","timestamp":1586908800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Ministerio de Econom\u00eda y Competitividad","award":["TIN2014-60490-P"],"award-info":[{"award-number":["TIN2014-60490-P"]}]},{"DOI":"10.13039\/501100008784","name":"Universidad de las Fuerzas Armadas ESPE","doi-asserted-by":"publisher","award":["Li2SE"],"award-info":[{"award-number":["Li2SE"]}],"id":[{"id":"10.13039\/501100008784","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,4,15]]},"DOI":"10.1145\/3383219.3383233","type":"proceedings-article","created":{"date-parts":[[2020,5,4]],"date-time":"2020-05-04T07:51:02Z","timestamp":1588578662000},"page":"130-139","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Publication Bias"],"prefix":"10.1145","author":[{"given":"Rolando P.","family":"Reyes","sequence":"first","affiliation":[{"name":"Universidad de las Fuerzas Armadas ESPE, Sangolqu\u00ed, Ecuador"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Oscar","family":"Dieste","sequence":"additional","affiliation":[{"name":"Universidad Polit\u00e9cnica de Madrid Madrid, Boadilla del Monte, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Efra\u00edn R. Fonseca","family":"C.","sequence":"additional","affiliation":[{"name":"Universidad de las Fuerzas Armadas ESPE Sangolqu\u00ed, Ecuador"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Natalia","family":"Juristo","sequence":"additional","affiliation":[{"name":"Universidad Polit\u00e9cnica de Madrid Madrid, Boadilla del Monte, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,4,17]]},"reference":[{"unstructured":"[n.d.]. http:\/\/eseiw2019.com\/call-for-papers\/  [n.d.]. http:\/\/eseiw2019.com\/call-for-papers\/","key":"e_1_3_2_1_1_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_2_1","DOI":"10.1016\/j.jbusres.2012.02.023"},{"key":"e_1_3_2_1_3_1","volume-title":"Research Design: Qualitative, Quantitative, and Mixed Methods Approaches","author":"Creswell J.W.","year":"2002","unstructured":"J.W. Creswell . 2002 . Research Design: Qualitative, Quantitative, and Mixed Methods Approaches . SAGE Publications . http:\/\/books.google.es\/books?id=nSVxmN2KWeYC J.W. Creswell. 2002. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. SAGE Publications. http:\/\/books.google.es\/books?id=nSVxmN2KWeYC"},{"unstructured":"Jose Luis de la Vara Markus Borg Krzysztof Wnuk and Leon Moonen. 2014. Survey on Safety Evidence Change Impact Analysis in Practice: Detailed Description and Analysis. (2014).  Jose Luis de la Vara Markus Borg Krzysztof Wnuk and Leon Moonen. 2014. Survey on Safety Evidence Change Impact Analysis in Practice: Detailed Description and Analysis. (2014).","key":"e_1_3_2_1_4_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_5_1","DOI":"10.1136\/bmjebm-2018-111107"},{"key":"e_1_3_2_1_6_1","volume-title":"Carrol Gamble, Davina Ghersi, John P. A. Ioannidis, John Simes, and Paula R. Williamson.","author":"Dwan Kerry","year":"2008","unstructured":"Kerry Dwan , Douglas G. Altman , Juan A. Arnaiz , Jill Bloom , An-Wen Chan , Eugenia Cronin , Evelyne Decullier , Philippa J. Easterbrook , Erik Von Elm , Carrol Gamble, Davina Ghersi, John P. A. Ioannidis, John Simes, and Paula R. Williamson. 2008 . Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias. PLOS ONE 3, 8 (08 2008), 1--31. https:\/\/doi.org\/10.1371\/journal.pone.0003081 10.1371\/journal.pone.0003081 Kerry Dwan, Douglas G. Altman, Juan A. Arnaiz, Jill Bloom, An-Wen Chan, Eugenia Cronin, Evelyne Decullier, Philippa J. Easterbrook, Erik Von Elm, Carrol Gamble, Davina Ghersi, John P. A. Ioannidis, John Simes, and Paula R. Williamson. 2008. Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias. PLOS ONE 3, 8 (08 2008), 1--31. https:\/\/doi.org\/10.1371\/journal.pone.0003081"},{"key":"e_1_3_2_1_7_1","volume-title":"Publication bias in clinical research. The Lancet 337, 8746","author":"Easterbrook Phillipa J","year":"1991","unstructured":"Phillipa J Easterbrook , Ramana Gopalan , JA Berlin , and David R Matthews . 1991. Publication bias in clinical research. The Lancet 337, 8746 ( 1991 ), 867--872. Phillipa J Easterbrook, Ramana Gopalan, JA Berlin, and David R Matthews. 1991. Publication bias in clinical research. The Lancet 337, 8746 (1991), 867--872."},{"volume-title":"Statistical methods for rates and proportions","author":"Fleiss Joseph L","unstructured":"Joseph L Fleiss , Bruce Levin , and Myunghee Cho Paik . 2013. Statistical methods for rates and proportions . John Wiley & Sons . Joseph L Fleiss, Bruce Levin, and Myunghee Cho Paik. 2013. Statistical methods for rates and proportions. John Wiley & Sons.","key":"e_1_3_2_1_8_1"},{"doi-asserted-by":"crossref","unstructured":"A. Indrayan and M.P. Holt. 2016. Concise Encyclopedia of Biostatistics for Medical Professionals. CRC Press. https:\/\/books.google.es\/books?id=mBkNDgAAQBAJ  A. Indrayan and M.P. Holt. 2016. Concise Encyclopedia of Biostatistics for Medical Professionals. CRC Press. https:\/\/books.google.es\/books?id=mBkNDgAAQBAJ","key":"e_1_3_2_1_9_1","DOI":"10.1201\/9781315372891"},{"key":"e_1_3_2_1_10_1","volume-title":"Why most published research findings are false. PLoS medicine 2, 8","author":"Ioannidis John PA","year":"2005","unstructured":"John PA Ioannidis . 2005. Why most published research findings are false. PLoS medicine 2, 8 ( 2005 ), e124. John PA Ioannidis. 2005. Why most published research findings are false. PLoS medicine 2, 8 (2005), e124."},{"key":"e_1_3_2_1_11_1","volume-title":"Reporting Guidelines for Controlled Experiments in Software Engineering. 4th International Symposium on Empirical Software Engineering (ISESE 2005)","author":"Jedlitschka Andreas","year":"2005","unstructured":"Andreas Jedlitschka and Dietmar Pfahl . 2005 . Reporting Guidelines for Controlled Experiments in Software Engineering. 4th International Symposium on Empirical Software Engineering (ISESE 2005) (November 2005), 95--104. Andreas Jedlitschka and Dietmar Pfahl. 2005. Reporting Guidelines for Controlled Experiments in Software Engineering. 4th International Symposium on Empirical Software Engineering (ISESE 2005) (November 2005), 95--104."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_12_1","DOI":"10.1016\/j.jss.2015.03.065"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_13_1","DOI":"10.1109\/ESEM.2013.59"},{"volume-title":"Basics of software engineering experimentation","author":"Juristo Natalia","unstructured":"Natalia Juristo and Ana M Moreno . 2013. Basics of software engineering experimentation . Springer Science & Business Media . Natalia Juristo and Ana M Moreno. 2013. Basics of software engineering experimentation. Springer Science & Business Media.","key":"e_1_3_2_1_14_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_15_1","DOI":"10.1207\/s15327957pspr0203_4"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_17_1","DOI":"10.1145\/3319008.3319009"},{"volume-title":"Guide to Advanced Empirical Software Engineering","author":"Kitchenham Barbara A","unstructured":"Barbara A Kitchenham and Shari L Pfleeger . 2008. Personal opinion surveys . In Guide to Advanced Empirical Software Engineering . Springer , 63--92. Barbara A Kitchenham and Shari L Pfleeger. 2008. Personal opinion surveys. In Guide to Advanced Empirical Software Engineering. Springer, 63--92.","key":"e_1_3_2_1_18_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_19_1","DOI":"10.2307\/4451093"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_20_1","DOI":"10.1038\/s41562-016-0021"},{"doi-asserted-by":"crossref","unstructured":"Regina Nuzzo et al. 2014. Statistical errors. Nature 506 7487 (2014) 150--152.  Regina Nuzzo et al. 2014. Statistical errors. Nature 506 7487 (2014) 150--152.","key":"e_1_3_2_1_21_1","DOI":"10.1038\/506150a"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_22_1","DOI":"10.1109\/ISESE.2003.1237967"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_23_1","DOI":"10.1145\/3180155.3180161"},{"unstructured":"J. Sayyad Shirabad and T.J. Menzies. 2005. The PROMISE Repository of Software Engineering Databases. School of Information Technology and Engineering University of Ottawa Canada. http:\/\/promise.site.uottawa.ca\/SERepository  J. Sayyad Shirabad and T.J. Menzies. 2005. The PROMISE Repository of Software Engineering Databases. School of Information Technology and Engineering University of Ottawa Canada. http:\/\/promise.site.uottawa.ca\/SERepository","key":"e_1_3_2_1_24_1"},{"key":"e_1_3_2_1_25_1","volume-title":"Hunter","author":"Schmidt Frank L.","year":"2015","unstructured":"Frank L. Schmidt and John E . Hunter . 2015 . Methods of Meta-Analysis (3rd ed.). SAGE Publications . Frank L. Schmidt and John E. Hunter. 2015. Methods of Meta-Analysis (3rd ed.). SAGE Publications."},{"unstructured":"W.R. Shadish T.D. Cook and D.T. Campbell. 2002. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Houghton Mifflin Company. 510 pages.  W.R. Shadish T.D. Cook and D.T. Campbell. 2002. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Houghton Mifflin Company. 510 pages.","key":"e_1_3_2_1_26_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_27_1","DOI":"10.2147\/OAJCT.S34419"},{"key":"e_1_3_2_1_28_1","first-page":"2","article-title":"Crossover Designs in Software Engineering Experiments","volume":"42","author":"Vegas S.","year":"2016","unstructured":"S. Vegas , C. Apa , and N. Juristo . 2016 . Crossover Designs in Software Engineering Experiments : Benefits and Perils. IEEE Transactions on Software Engineering 42 , 2 (February 2016), 120--135. https:\/\/doi.org\/10.1109\/TSE.2015.2467378 10.1109\/TSE.2015.2467378 S. Vegas, C. Apa, and N. Juristo. 2016. Crossover Designs in Software Engineering Experiments: Benefits and Perils. IEEE Transactions on Software Engineering 42, 2 (February 2016), 120--135. https:\/\/doi.org\/10.1109\/TSE.2015.2467378","journal-title":"Benefits and Perils. IEEE Transactions on Software Engineering"},{"volume-title":"What is a P-value anyway?: 34 stories to help you actually understand statistics","author":"Vickers Andrew","unstructured":"Andrew Vickers . 2010. What is a P-value anyway?: 34 stories to help you actually understand statistics . Addison-Wesley Longman . Andrew Vickers. 2010. What is a P-value anyway?: 34 stories to help you actually understand statistics. Addison-Wesley Longman.","key":"e_1_3_2_1_29_1"},{"volume-title":"Experimentation in software engineering","author":"Wohlin Claes","unstructured":"Claes Wohlin , Per Runeson , Martin H\u00f6st , Magnus C Ohlsson , Bj\u00f6rn Regnell , and Anders Wessl\u00e9n . 2012. Experimentation in software engineering . Springer Science & Business Media . Claes Wohlin, Per Runeson, Martin H\u00f6st, Magnus C Ohlsson, Bj\u00f6rn Regnell, and Anders Wessl\u00e9n. 2012. Experimentation in software engineering. Springer Science & Business Media.","key":"e_1_3_2_1_30_1"},{"volume-title":"Case study research: Design and methods","author":"Yin Robert K","unstructured":"Robert K Yin . 2013. Case study research: Design and methods . Sage publications. Robert K Yin. 2013. Case study research: Design and methods. Sage publications.","key":"e_1_3_2_1_31_1"}],"event":{"sponsor":["NTNU Norwegian University of Science and Technology"],"acronym":"EASE '20","name":"EASE '20: Evaluation and Assessment in Software Engineering","location":"Trondheim Norway"},"container-title":["Proceedings of the Evaluation and Assessment in Software Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3383219.3383233","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3383219.3383233","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:02:00Z","timestamp":1750197720000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3383219.3383233"}},"subtitle":["A Detailed Analysis of Experiments Published in ESEM"],"short-title":[],"issued":{"date-parts":[[2020,4,15]]},"references-count":30,"alternative-id":["10.1145\/3383219.3383233","10.1145\/3383219"],"URL":"https:\/\/doi.org\/10.1145\/3383219.3383233","relation":{},"subject":[],"published":{"date-parts":[[2020,4,15]]},"assertion":[{"value":"2020-04-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}