{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,7]],"date-time":"2026-02-07T23:35:09Z","timestamp":1770507309250,"version":"3.49.0"},"reference-count":25,"publisher":"Springer Science and Business Media LLC","issue":"1-2","license":[{"start":{"date-parts":[[1988,7,1]],"date-time":"1988-07-01T00:00:00Z","timestamp":583718400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[1988,7]]},"DOI":"10.1007\/bf02020243","type":"journal-article","created":{"date-parts":[[2005,8,12]],"date-time":"2005-08-12T02:41:56Z","timestamp":1123814516000},"page":"75-82","source":"Crossref","is-referenced-by-count":72,"title":["Assessing precision in the manuscript review process: A little better than a dice roll"],"prefix":"10.1007","volume":"14","author":[{"given":"D.","family":"Lindsey","sequence":"first","affiliation":[]}],"member":"297","reference":[{"key":"BF02020243_CR1","volume-title":"Discrete Multivariate Analysis","author":"Y. M. M. Bishop","year":"1975","unstructured":"Y. M. M. BISHOP, S. E. FIENBERG, P. W. HOLLAND,Discrete Multivariate Analysis, Cambridge, Mass., The MIT Press, 1975."},{"key":"BF02020243_CR2","doi-asserted-by":"crossref","first-page":"480","DOI":"10.2307\/418821","volume":"10","author":"C. M. Bonjean","year":"1978","unstructured":"C. M. BONJEAN, J. HULLUM, Reasons for journal rejection: An analysis 600 manuscripts,PS, 10 (1978) 480.","journal-title":"PS"},{"key":"BF02020243_CR3","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1037\/h0033849","volume":"27","author":"D. D. Bowen","year":"1972","unstructured":"D. D. BOWEN, R. RERLOFF, J. JACOBY, Improving manuscript evaluation procedures,American Psychologist, 27 (1972) 22.","journal-title":"American Psychologist"},{"key":"BF02020243_CR4","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1037\/0003-066X.33.6.623","volume":"33","author":"R. Crandall","year":"1978","unstructured":"R. CRANDALL, Interrater agreement on manuscripts is not so bad!American Psychologist, 33, (1978) 623.","journal-title":"American Psychologist"},{"key":"BF02020243_CR5","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1007\/BF01096215","volume":"14","author":"A. Cournand","year":"1976","unstructured":"A. COURNAND, M. MEYER, The scientists code,Minerva, 14 (1976) 79.","journal-title":"Minerva"},{"key":"BF02020243_CR6","first-page":"179","volume":"11","author":"N. D. Glenn","year":"1976","unstructured":"N. D. GLENN, The journal article review process: Some proposals for change,American Sociologist, 11 (1976) 179.","journal-title":"American Sociologist"},{"key":"BF02020243_CR7","first-page":"109","volume":"63","author":"L. A. Goodman","year":"1968","unstructured":"L. A. GOODMAN, The analysis of cross-classified data: Independence, quasi-independence, and interactions in contigency tables with or without missing entries,Journal of the American Statistical Association 63 (1968) 109.","journal-title":"Journal of the American Statistical Association"},{"key":"BF02020243_CR8","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1177\/014616727600200301","volume":"2","author":"C. Hendrick","year":"1976","unstructured":"C. HENDRICK, Editorial comment,Personality and Social Psychology Bulletin, 2 (1976) 207.","journal-title":"Personality and Social Psychology Bulletin"},{"key":"BF02020243_CR9","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1037\/0003-066X.40.2.148","volume":"40","author":"D. Klahr","year":"1985","unstructured":"D. KLAHR, Insiders, outsiders, and efficiency in a National Science Foundation panel,American Psychologist 40 (1985) 148.","journal-title":"American Psychologist"},{"key":"BF02020243_CR10","unstructured":"M. KOCHEN, B. PERKEL Improving referee-33 selection and manuscript evaluation. In: J. McCARTNEY (Ed.), Proceedings of the First International Conference of Scientific Editors, April 24\u201329, 1977, Jerusalem, Dordrecht, Reidel, 1977."},{"key":"BF02020243_CR11","unstructured":"D. LINDSEY,The Scientific Publication System in Social Science, San Francisco, Jossey-Bass, 1978."},{"key":"BF02020243_CR12","doi-asserted-by":"crossref","first-page":"57","DOI":"10.2307\/2093493","volume":"35","author":"J. B. Lodahl","year":"1972","unstructured":"J. B. LODAHL, G. GORDON, The structure of scientific fields and the functioning of university graduate departments,American Sociological Review, 35 (1972) 57.","journal-title":"American Sociological Review"},{"key":"BF02020243_CR13","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1007\/BF01173636","volume":"1","author":"M. J. Mahoney","year":"1977","unstructured":"M. J. MAHONEY, Publication prejudices: An experimental study of confirmatory bias in the peer review system,Cognitive Therapy and Research, 1 (1977) 161.","journal-title":"Cognitive Therapy and Research"},{"key":"BF02020243_CR14","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1037\/0003-066X.40.1.29","volume":"40","author":"M. J. Mahoney","year":"1985","unstructured":"M. J. MAHONEY, Open exchange and epistemic progress,American Psychologist, 40 (1985) 29.","journal-title":"American Psychologist"},{"key":"BF02020243_CR15","doi-asserted-by":"crossref","first-page":"400","DOI":"10.1037\/h0037937","volume":"26","author":"P. McReynolds","year":"1971","unstructured":"P. McREYNOLDS, Reliability of ratings of research papers, American Psychologist, 26 (1971) 400.","journal-title":"American Psychologist"},{"key":"BF02020243_CR16","doi-asserted-by":"crossref","first-page":"673","DOI":"10.2307\/1981508","volume":"35","author":"A. C. Miller","year":"1984","unstructured":"A. C. MILLER, S. L. SERZAN, Criteria for identifying a refereed journal,Journal of Higher Education 35 (1984) 673.","journal-title":"Journal of Higher Education"},{"key":"BF02020243_CR17","doi-asserted-by":"crossref","first-page":"227","DOI":"10.2307\/2392044","volume":"21","author":"J. Pfeffer","year":"1976","unstructured":"J. PFEFFER, G. R. SALANCIK, H. LEBLEBICI, The effects of uncertainty on the use of social influence in organizational decision-making,Administrative Science Quarterly 21 (1976) 227.","journal-title":"Administrative Science Quarterly"},{"key":"BF02020243_CR18","doi-asserted-by":"crossref","first-page":"938","DOI":"10.1093\/sf\/55.4.938","volume":"55","author":"J. Pfeffer","year":"1977","unstructured":"J. PFEFFER, A. LEONG, K. STREHL, Paradigm development and particularism: Journal publication in three scientific disciplines,Social Forces, 55 (1977) 938.","journal-title":"Social Forces"},{"key":"BF02020243_CR19","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1177\/0001848184034002002","volume":"34","author":"I. Pipke","year":"1984","unstructured":"I. PIPKE, The gatekeepers A multivariate study of accepted and rejected adult-education research conference abstracts (1978\u201380),Adult Education Quarterly 34 (1984) 71.","journal-title":"Adult Education Quarterly"},{"key":"BF02020243_CR20","doi-asserted-by":"crossref","first-page":"935","DOI":"10.1037\/h0078544","volume":"33","author":"S. Scarr","year":"1978","unstructured":"S. SCARR, B. L. R. WEBER, The reliability of reviews for the American Psychologists,American Psychologist 33 (1978) 935.","journal-title":"American Psychologist"},{"key":"BF02020243_CR21","doi-asserted-by":"crossref","first-page":"698","DOI":"10.1037\/h0037631","volume":"29","author":"W. A. Scott","year":"1974","unstructured":"W. A. SCOTT, Interreferee agreement of some characteristics of manuscripts submitted to the Journal of Personality and Social Psychology, American Psychologist 29 (1974) 698.","journal-title":"American Psychologist"},{"key":"BF02020243_CR22","first-page":"21","volume":"1","author":"N. J. Spencer","year":"1986","unstructured":"N. J. SPENCER, J. HARTNETT, M. MAHONEY, Problems with reviews in the standard editorial practice,Journal of Social Behavior and Personality 1 (1986) 21.","journal-title":"Journal of Social Behavior and Personality"},{"key":"BF02020243_CR23","first-page":"116","volume":"4","author":"A. T. Stinchcombe","year":"1969","unstructured":"A. T. STINCHCOMBE, R. OFSHE, On journal editing as a probabilistic process,American Sociologist, 4 (1969) 116.","journal-title":"American Sociologist"},{"key":"BF02020243_CR24","doi-asserted-by":"crossref","first-page":"109","DOI":"10.3102\/00028312012002109","volume":"12","author":"A. W. Ward","year":"1975","unstructured":"A. W. WARD, B. W. HALL, C. F. SCHRAM, Evaluation of published educational research-national survey,American Educational Research Journal 12 (1975) 109.","journal-title":"American Educational Research Journal"},{"key":"BF02020243_CR25","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1037\/0003-066X.39.1.22","volume":"39","author":"G. J. Whitehurst","year":"1984","unstructured":"G. J. WHITEHURST, Interrater agreement for journal manuscript reviews,American Psychologist 39 (1984) 22.","journal-title":"American Psychologist"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/BF02020243.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/BF02020243\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/BF02020243","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,5,13]],"date-time":"2019-05-13T18:37:44Z","timestamp":1557772664000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/BF02020243"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[1988,7]]},"references-count":25,"journal-issue":{"issue":"1-2","published-print":{"date-parts":[[1988,7]]}},"alternative-id":["BF02020243"],"URL":"https:\/\/doi.org\/10.1007\/bf02020243","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[1988,7]]}}}