{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,19]],"date-time":"2025-11-19T06:51:06Z","timestamp":1763535066788,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":23,"publisher":"ACM","license":[{"start":{"date-parts":[[2010,9,16]],"date-time":"2010-09-16T00:00:00Z","timestamp":1284595200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2010,9,16]]},"DOI":"10.1145\/1852786.1852789","type":"proceedings-article","created":{"date-parts":[[2010,9,14]],"date-time":"2010-09-14T14:53:20Z","timestamp":1284476000000},"page":"1-8","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":46,"title":["Can we evaluate the quality of software engineering experiments?"],"prefix":"10.1145","author":[{"given":"Barbara","family":"Kitchenham","sequence":"first","affiliation":[{"name":"Keele University, Keele, Staffordshire, UK"}]},{"given":"Dag I. K.","family":"Sj\u00f8berg","sequence":"additional","affiliation":[{"name":"University of Oslo, Oslo, Norway"}]},{"given":"O. Pearl","family":"Brereton","sequence":"additional","affiliation":[{"name":"Keele University, Keele, Staffordshire, UK"}]},{"given":"David","family":"Budgen","sequence":"additional","affiliation":[{"name":"Durham University, Durham, UK"}]},{"given":"Tore","family":"Dyb\u00e5","sequence":"additional","affiliation":[{"name":"University of Oslo, Norway"}]},{"given":"Martin","family":"H\u00f6st","sequence":"additional","affiliation":[{"name":"Lund University, Lund, Sweden"}]},{"given":"Dietmar","family":"Pfahl","sequence":"additional","affiliation":[{"name":"University of Oslo, Norway and University of Calgary, Canada"}]},{"given":"Per","family":"Runeson","sequence":"additional","affiliation":[{"name":"Lund University, Lund, Sweden"}]}],"member":"320","published-online":{"date-parts":[[2010,9,16]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2006.06.001"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2008.12.005"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1002\/aris.2011.1440450112"},{"key":"e_1_3_2_1_4_1","unstructured":"Bornmann L. Mutz R. and Daniel D.-D. A reliability-generalization study of journal peer reviews -- a multi-level analysis of inter-rater reliability and its determinants submitted.  Bornmann L. Mutz R. and Daniel D.-D. A reliability-generalization study of journal peer reviews -- a multi-level analysis of inter-rater reliability and its determinants submitted."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1414004.1414034"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2008.01.006"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2005.6"},{"issue":"4","key":"e_1_3_2_1_8_1","first-page":"297","article-title":"Impact of effort estimates on software project work? A review of the 1994 Chaos report","volume":"48","author":"J\u00f8rgensen M.","year":"2000","unstructured":"J\u00f8rgensen , M. and Mol\u00f8kken-\u00d8stvold , K. 2000 . Impact of effort estimates on software project work? A review of the 1994 Chaos report . Information and Software Technology , 48 ( 4 ), pp 297 -- 301 . J\u00f8rgensen, M. and Mol\u00f8kken-\u00d8stvold, K. 2000. Impact of effort estimates on software project work? A review of the 1994 Chaos report. Information and Software Technology, 48(4), pp 297--301.","journal-title":"Information and Software Technology"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2006.10.041"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-006-7240-4"},{"volume-title":"EASE'09","author":"Kitchenham B. A.","key":"e_1_3_2_1_12_1","unstructured":"Kitchenham , B. A. , Brereton , O. P. , Budgen , D. and Li , Z . 2009. An evaluation of quality checklist proposals -- A participant observer case study . EASE'09 , BCS eWic. Kitchenham, B. A., Brereton, O. P., Budgen, D. and Li, Z. 2009. An evaluation of quality checklist proposals -- A participant observer case study. EASE'09, BCS eWic."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-010-9134-8"},{"key":"e_1_3_2_1_14_1","first-page":"273","volume-title":"Proceedings of the 26th International Conference on Software Engineering, (ICSE '04)","author":"Kitchenham B. A.","unstructured":"Kitchenham , B. A. , Dyb\u00e5 , T. and J\u00f8rgensen , M . 2004 Evidence-based Software Engineering . Proceedings of the 26th International Conference on Software Engineering, (ICSE '04) , IEEE Computer Society, Washington DC, USA , pp 273 -- 281 . Kitchenham, B. A., Dyb\u00e5, T. and J\u00f8rgensen, M. 2004 Evidence-based Software Engineering. Proceedings of the 26th International Conference on Software Engineering, (ICSE '04), IEEE Computer Society, Washington DC, USA, pp 273--281."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2007.05.007"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.63.3.160"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1641\/0006-3568(2006)56[333:IPRAGO]2.0.CO;2"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1080\/17453670710013807"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"crossref","unstructured":"Rowe B. H. Strome T. L. Spooner C. Blitz S. Grafstein E. and Worster A. 2006. Reviewer agreement trends from four years of electronic submissions of conference abstract. BMC Medical Research Methodology 6(14).  Rowe B. H. Strome T. L. Spooner C. Blitz S. Grafstein E. and Worster A. 2006. Reviewer agreement trends from four years of electronic submissions of conference abstract. BMC Medical Research Methodology 6(14).","DOI":"10.1186\/1471-2288-6-14"},{"volume-title":"Are three heads better than two? How the number of reviewers and editor","author":"Schultz D. M.","key":"e_1_3_2_1_20_1","unstructured":"Schultz , D. M. 2009. Are three heads better than two? How the number of reviewers and editor behaviour affect the rejection rate. Scientometrics, Springer. doi :10.1007\/s11192-009-0084-0. 10.1007\/s11192-009-0084-0 Schultz, D. M. 2009. Are three heads better than two? How the number of reviewers and editor behaviour affect the rejection rate. Scientometrics, Springer. doi:10.1007\/s11192-009-0084-0."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(05)67177-2"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/FOSE.2007.30"},{"volume-title":"Editor","author":"Weller A. C.","key":"e_1_3_2_1_23_1","unstructured":"Weller , A. C. 2002. Editor ial Peer Review : Its Strengths and Weaknesses. Medford, NJ, USA. Information Today, Inc . Weller, A. C. 2002. Editorial Peer Review: Its Strengths and Weaknesses. Medford, NJ, USA. Information Today, Inc."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1177\/0165551504041673"}],"event":{"name":"ESEM '10: 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","IEEE CS"],"location":"Bolzano-Bozen Italy","acronym":"ESEM '10"},"container-title":["Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1852786.1852789","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1852786.1852789","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T11:39:41Z","timestamp":1750246781000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1852786.1852789"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,9,16]]},"references-count":23,"alternative-id":["10.1145\/1852786.1852789","10.1145\/1852786"],"URL":"https:\/\/doi.org\/10.1145\/1852786.1852789","relation":{},"subject":[],"published":{"date-parts":[[2010,9,16]]},"assertion":[{"value":"2010-09-16","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}