{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T15:32:13Z","timestamp":1774625533560,"version":"3.50.1"},"reference-count":39,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2010,5,5]],"date-time":"2010-05-05T00:00:00Z","timestamp":1273017600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2010,10]]},"DOI":"10.1007\/s11192-010-0233-5","type":"journal-article","created":{"date-parts":[[2010,5,4]],"date-time":"2010-05-04T08:49:53Z","timestamp":1272962993000},"page":"193-202","source":"Crossref","is-referenced-by-count":77,"title":["Worsening file-drawer problem in the abstracts of natural, medical and social science databases"],"prefix":"10.1007","volume":"85","author":[{"given":"Marco","family":"Pautasso","sequence":"first","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2010,5,5]]},"reference":[{"key":"233_CR1","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1007\/BF02051040","volume":"24","author":"HA Abt","year":"1992","unstructured":"Abt, H. A. (1992). Publication practices in various sciences. Scientometrics, 24, 441\u2013447.","journal-title":"Scientometrics"},{"key":"233_CR2","doi-asserted-by":"crossref","first-page":"419","DOI":"10.2307\/2982993","volume":"151","author":"CB Begg","year":"1988","unstructured":"Begg, C. B., & Berlin, J. A. (1988). Publication bias: A problem in interpreting medical data. Journal of the Royal Statistical Society A, 151, 419\u2013463.","journal-title":"Journal of the Royal Statistical Society A"},{"key":"233_CR3","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1002\/aris.2007.1440410110","volume":"41","author":"SJ Bensman","year":"2007","unstructured":"Bensman, S. J. (2007). Garfield and the impact factor. Annual Review of Information Science and Technology, 41, 93\u2013155.","journal-title":"Annual Review of Information Science and Technology"},{"key":"233_CR4","doi-asserted-by":"crossref","first-page":"e110","DOI":"10.1371\/journal.pcbi.0020110","volume":"2","author":"PE Bourne","year":"2006","unstructured":"Bourne, P. E., & Korngreen, A. (2006). Ten simple rules for reviewers. PLoS Computational Biology, 2, e110.","journal-title":"PLoS Computational Biology"},{"key":"233_CR5","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1017\/S0140525X00065675","volume":"14","author":"DV Cicchetti","year":"1991","unstructured":"Cicchetti, D. V. (1991). The reliability of peer-review for manuscript and grant submissions: A cross-disciplinary investigation. Behavioral and Brain Sciences, 14, 119\u2013134.","journal-title":"Behavioral and Brain Sciences"},{"key":"233_CR6","doi-asserted-by":"crossref","first-page":"591","DOI":"10.2307\/3546355","volume":"76","author":"RD Csada","year":"1996","unstructured":"Csada, R. D., James, P. C., & Espie, R. H. M. (1996). The \u201cfile drawer problem\u201d of non-significant results: Does it apply to biological research? Oikos, 76, 591\u2013593.","journal-title":"Oikos"},{"key":"233_CR7","doi-asserted-by":"crossref","unstructured":"de Mesnard, L. (2010). On Hochberg et al.\u2019s \u201cThe tragedy of the reviewer commons\u201d. Scientometrics, in press doi: 10.1007\/s11192-009-0141-8 .","DOI":"10.1007\/s11192-009-0141-8"},{"key":"233_CR8","first-page":"639","volume":"73","author":"E Garfield","year":"1997","unstructured":"Garfield, E. (1997). A statistically valid definition of bias is needed to determine whether the Science Citation Index(R) discriminates against third world journals. Current Science, 73, 639\u2013641.","journal-title":"Current Science"},{"key":"233_CR9","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1177\/0049124108318973","volume":"37","author":"AS Gerber","year":"2008","unstructured":"Gerber, A. S., & Malhotra, N. (2008). Publication bias in empirical sociological research: Do arbitrary significance levels distort published results? Sociological Methods & Research, 37, 3\u201330.","journal-title":"Sociological Methods & Research"},{"key":"233_CR10","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1034\/j.1600-0447.2000.102004241.x","volume":"102","author":"SM Gilbody","year":"2000","unstructured":"Gilbody, S. M., Song, F., Eastwood, A. J., & Sutton, A. (2000). The causes, consequences and detection of publication bias in psychiatry. Acta Psychiatrica Scandinavica, 102, 241\u2013249.","journal-title":"Acta Psychiatrica Scandinavica"},{"key":"233_CR11","doi-asserted-by":"crossref","first-page":"b2680","DOI":"10.1136\/bmj.b2680","volume":"339","author":"SA Greenberg","year":"2009","unstructured":"Greenberg, S. A. (2009). How citation distortions create unfounded authority: Analysis of a citation network. British Medical Journal, 339, b2680.","journal-title":"British Medical Journal"},{"key":"233_CR12","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1177\/000312240406900203","volume":"69","author":"J Guetzkow","year":"2004","unstructured":"Guetzkow, J., Lamont, M., & Mallard, G. (2004). What is originality in the humanities and the social sciences? American Sociological Review, 69, 190\u2013212.","journal-title":"American Sociological Review"},{"key":"233_CR13","doi-asserted-by":"crossref","first-page":"e107","DOI":"10.1371\/journal.pbio.0050107","volume":"5","author":"M Hauser","year":"2007","unstructured":"Hauser, M., & Fehr, E. (2007). An incentive solution to the peer review problem. PLoS Biology, 5, e107.","journal-title":"PLoS Biology"},{"key":"233_CR14","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1111\/j.1461-0248.2008.01276.x","volume":"12","author":"ME Hochberg","year":"2009","unstructured":"Hochberg, M. E., Chase, J. M., Gotelli, N. J., Hastings, A., & Naeem, S. (2009). The tragedy of the reviewer commons. Ecology Letters, 12, 2\u20134.","journal-title":"Ecology Letters"},{"key":"233_CR15","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1126\/science.305.5683.451","volume":"305","author":"D Kennedy","year":"2004","unstructured":"Kennedy, D. (2004). The old file-drawer problem. Science, 305, 451.","journal-title":"Science"},{"key":"233_CR16","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1093\/aje\/kwp119","volume":"170","author":"MJ Khoury","year":"2009","unstructured":"Khoury, M. J., Bertram, L., Boffetta, P., Butterworth, A. S., Chanock, S. J., Dolan, S. M., et al. (2009). Genome-wide association studies, field synopses, and the development of the knowledge base on genetic variation and human diseases. American Journal of Epidemiology, 170, 269\u2013279.","journal-title":"American Journal of Epidemiology"},{"key":"233_CR17","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1111\/j.0956-7976.2005.01538.x","volume":"16","author":"PR Killeen","year":"2005","unstructured":"Killeen, P. R. (2005). An alternative to null-hypothesis significance tests. Psychological Science, 16, 345\u2013353.","journal-title":"Psychological Science"},{"key":"233_CR18","doi-asserted-by":"crossref","first-page":"75","DOI":"10.3152\/147154406781776011","volume":"15","author":"JT Klein","year":"2006","unstructured":"Klein, J. T. (2006). Afterword: The emergent literature on interdisciplinary and transdisciplinary research evaluation. Research Evaluation, 15, 75\u201380.","journal-title":"Research Evaluation"},{"key":"233_CR19","first-page":"632e1","volume":"136","author":"D Koletsi","year":"2009","unstructured":"Koletsi, D., Karagianni, A., Pandis, N., Makou, M., Polychronopolou, A., & Eliades, T. (2009). Are studies reporting significant results more likely to be published? American Journal of Orthodontics and Dentofacial Orthopedics, 136, 632e1.","journal-title":"American Journal of Orthodontics and Dentofacial Orthopedics"},{"key":"233_CR20","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1001\/jama.290.4.495","volume":"290","author":"MK Krzyzanowska","year":"2003","unstructured":"Krzyzanowska, M. K., Pintilie, M., & Tannock, I. F. (2003). Factors associated with failure to publish large randomized trials presented at an oncology meeting. Journal of the American Medical Association, 290, 495\u2013501.","journal-title":"Journal of the American Medical Association"},{"key":"233_CR21","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1038\/422259a","volume":"422","author":"PA Lawrence","year":"2003","unstructured":"Lawrence, P. A. (2003). The politics of publication. Nature, 422, 259\u2013261.","journal-title":"Nature"},{"key":"233_CR22","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1080\/03637750903074685","volume":"76","author":"T Levine","year":"2009","unstructured":"Levine, T., Asada, K. J., & Carpenter, C. (2009). Sample sizes and effect sizes are negatively correlated in meta-analyses: Evidence and implications of a publication bias against non-significant findings. Communication Monographs, 76, 286\u2013302.","journal-title":"Communication Monographs"},{"key":"233_CR23","doi-asserted-by":"crossref","first-page":"1290","DOI":"10.3102\/0034654309334143","volume":"79","author":"HW Marsh","year":"2009","unstructured":"Marsh, H. W., Bornmann, L., Mutz, R., Daniel, H. D., & O\u2019Mara, A. (2009). Gender effects in the peer reviews of grant proposals: A comprehensive meta-analysis comparing traditional and multilevel approaches. Review of Educational Research, 79, 1290\u20131326.","journal-title":"Review of Educational Research"},{"key":"233_CR24","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1111\/j.1469-185X.2007.00027.x","volume":"82","author":"S Nakagawa","year":"2007","unstructured":"Nakagawa, S., & Cuthill, I. C. (2007). Effect size, confidence interval and statistical significance: A practical guide for biologists. Biological Reviews, 82, 591\u2013605.","journal-title":"Biological Reviews"},{"key":"233_CR25","doi-asserted-by":"crossref","first-page":"939","DOI":"10.1016\/j.jclinepi.2006.11.014","volume":"60","author":"P Nieminen","year":"2007","unstructured":"Nieminen, P., Rucker, G., Miettunen, J., Carpenter, J., & Schumacher, M. (2007). Statistically significant papers in psychiatry were cited more often than others. Journal of Clinical Epidemiology, 60, 939\u2013946.","journal-title":"Journal of Clinical Epidemiology"},{"key":"233_CR26","doi-asserted-by":"crossref","first-page":"6708","DOI":"10.1038\/24249","volume":"396","author":"G Paris","year":"1998","unstructured":"Paris, G., De Leo, G., Menozzi, P., & Gatto, M. (1998). Region-based citation bias in science. Nature, 396, 6708.","journal-title":"Nature"},{"key":"233_CR27","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1017\/S1062798709990275","volume":"18","author":"M Pautasso","year":"2010","unstructured":"Pautasso, M., & Pautasso, C. (2010). Peer reviewing interdisciplinary papers. European Review, 18, 227\u2013237.","journal-title":"European Review"},{"key":"233_CR28","doi-asserted-by":"crossref","unstructured":"Pautasso, M., & Sch\u00e4fer, H. (2010). Peer review delay and selectivity in ecology journals. Scientometrics, in press. doi: 10.1007\/s11192-009-0105-z .","DOI":"10.1007\/s11192-009-0105-z"},{"key":"233_CR29","doi-asserted-by":"crossref","first-page":"2919","DOI":"10.1016\/j.biocon.2008.09.016","volume":"141","author":"RB Primack","year":"2008","unstructured":"Primack, R. B., & Marrs, R. (2008). Bias in the review process. Biological Conservation, 141, 2919\u20132920.","journal-title":"Biological Conservation"},{"key":"233_CR30","first-page":"848","volume":"185","author":"JM Provenzale","year":"2005","unstructured":"Provenzale, J. M., & Stanley, R. J. (2005). A systematic guide to reviewing a manuscript. American Journal of Radiology, 185, 848\u2013854.","journal-title":"American Journal of Radiology"},{"key":"233_CR31","doi-asserted-by":"crossref","first-page":"789","DOI":"10.1007\/s11192-008-2220-7","volume":"81","author":"M Reinhart","year":"2009","unstructured":"Reinhart, M. (2009). Peer review of grant applications in biology and medicine. Reliability, fairness, and validity. Scientometrics, 81, 789\u2013809.","journal-title":"Scientometrics"},{"key":"233_CR32","doi-asserted-by":"crossref","first-page":"638","DOI":"10.1037\/0033-2909.86.3.638","volume":"86","author":"R Rosenthal","year":"1979","unstructured":"Rosenthal, R. (1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86, 638\u2013641.","journal-title":"Psychological Bulletin"},{"key":"233_CR33","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1111\/j.1745-6924.2009.01106.x","volume":"4","author":"SJ Schwartz","year":"2009","unstructured":"Schwartz, S. J., & Zamboanga, B. L. (2009). The peer-review and editorial system: Ways to fix something that might be broken. Perspectives in Psychological Science, 4, 54\u201361.","journal-title":"Perspectives in Psychological Science"},{"key":"233_CR34","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1109\/2.55470","volume":"23","author":"AJ Smith","year":"1990","unstructured":"Smith, A. J. (1990). The task of the referee. IEEE Computer, 23, 46\u201351.","journal-title":"IEEE Computer"},{"key":"233_CR35","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1186\/1471-2288-9-79","volume":"9","author":"FJ Song","year":"2009","unstructured":"Song, F. J., Parekh-Bhurke, S., Hooper, L., Loke, Y. K., Ryder, J. J., Sutton, A. J., et al. (2009). Extent of publication bias in different categories of research cohorts: A meta-analysis of empirical studies. BMC Medical Research Methodology, 9, 79.","journal-title":"BMC Medical Research Methodology"},{"key":"233_CR36","first-page":"30","volume":"54","author":"TD Sterling","year":"1959","unstructured":"Sterling, T. D. (1959). Publication decisions and their possible effects on inferences drawn from tests of significance\u2014Or vice versa. Journal of the American Statistical Association, 54, 30\u201334.","journal-title":"Journal of the American Statistical Association"},{"key":"233_CR37","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1111\/j.1439-0310.2009.01610.x","volume":"115","author":"M Taborsky","year":"2009","unstructured":"Taborsky, M. (2009). Biased citation practice and taxonomic parochialism. Ethology, 115, 105\u2013111.","journal-title":"Ethology"},{"key":"233_CR38","doi-asserted-by":"crossref","first-page":"380","DOI":"10.1016\/j.jclinepi.2008.08.008","volume":"62","author":"AC Tricco","year":"2009","unstructured":"Tricco, A. C., Tetzaff, J., Pham, B., Brehaut, J., & Moher, D. (2009). Non-Cochrane vs. Cochrane reviews were twice as likely to have positive conclusion statements: Cross-sectional study. Journal of Clinical Epidemiology, 62, 380\u2013386.","journal-title":"Journal of Clinical Epidemiology"},{"key":"233_CR39","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1186\/1471-2288-9-23","volume":"9","author":"S Vecchi","year":"2009","unstructured":"Vecchi, S., Belleudi, V., Amato, L., Davoli, M., & Peducci, C. A. (2009). Does direction of results of abstracts submitted to scientific conferences on drug addiction predict full publication? BMC Medical Research Methodology, 9, 23.","journal-title":"BMC Medical Research Methodology"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-010-0233-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11192-010-0233-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-010-0233-5","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,6,1]],"date-time":"2019-06-01T05:27:05Z","timestamp":1559366825000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11192-010-0233-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,5,5]]},"references-count":39,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2010,10]]}},"alternative-id":["233"],"URL":"https:\/\/doi.org\/10.1007\/s11192-010-0233-5","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,5,5]]}}}