{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:33:51Z","timestamp":1750221231857,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":54,"publisher":"ACM","license":[{"start":{"date-parts":[[2018,6,14]],"date-time":"2018-06-14T00:00:00Z","timestamp":1528934400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2018,6,14]]},"DOI":"10.1145\/3209087.3209099","type":"proceedings-article","created":{"date-parts":[[2018,6,12]],"date-time":"2018-06-12T12:16:01Z","timestamp":1528805761000},"page":"8-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Teaching students critical appraisal of scientific literature using checklists"],"prefix":"10.1145","author":[{"given":"Jefferson Seide","family":"Moll\u00e9ri","sequence":"first","affiliation":[{"name":"Department of Software Engineering, Blekinge Institute of Technology, Karlskrona, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nauman","family":"bin Ali","sequence":"additional","affiliation":[{"name":"Department of Software Engineering, Blekinge Institute of Technology, Karlskrona, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kai","family":"Petersen","sequence":"additional","affiliation":[{"name":"Department of Software Engineering, Blekinge Institute of Technology, Karlskrona, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nasir Mehmood","family":"Minhas","sequence":"additional","affiliation":[{"name":"Department of Software Engineering, Blekinge Institute of Technology, Karlskrona, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Panagiota","family":"Chatzipetrou","sequence":"additional","affiliation":[{"name":"Department of Software Engineering, Blekinge Institute of Technology, Karlskrona, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,6,14]]},"reference":[{"doi-asserted-by":"publisher","key":"e_1_3_2_1_1_1","DOI":"10.1016\/j.infsof.2006.06.001"},{"volume-title":"Rating scales and checklists:Evaluating behavior, personality, and attitudes","author":"Aiken Lewis R","unstructured":"Lewis R Aiken . 1996. Rating scales and checklists:Evaluating behavior, personality, and attitudes . John Wiley & Sons . Lewis R Aiken. 1996. Rating scales and checklists:Evaluating behavior, personality, and attitudes. John Wiley & Sons.","key":"e_1_3_2_1_2_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_3_1","DOI":"10.1145\/2652524.2652557"},{"key":"e_1_3_2_1_4_1","volume-title":"Proceedings of the European Conference Software Engineering Education (ECSEE). Shaker Verlag, 59--73","author":"Ali Nauman","year":"2014","unstructured":"Nauman bin Ali and Michael Unterkalmsteiner . 2014 . Use and evaluation of simulation for software process education: a case study . In Proceedings of the European Conference Software Engineering Education (ECSEE). Shaker Verlag, 59--73 . Nauman bin Ali and Michael Unterkalmsteiner. 2014. Use and evaluation of simulation for software process education: a case study. In Proceedings of the European Conference Software Engineering Education (ECSEE). Shaker Verlag, 59--73."},{"key":"e_1_3_2_1_5_1","volume-title":"A coefficient of agreement for nominal scales. Educational and psychological measurement 20, 1","author":"Cohen Jacob","year":"1960","unstructured":"Jacob Cohen . 1960. A coefficient of agreement for nominal scales. Educational and psychological measurement 20, 1 ( 1960 ), 37--46. Jacob Cohen. 1960. A coefficient of agreement for nominal scales. Educational and psychological measurement 20, 1 (1960), 37--46."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_7_1","DOI":"10.1016\/j.jss.2007.07.006"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_8_1","DOI":"10.1109\/ESEM.2011.37"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_9_1","DOI":"10.1145\/1414004.1414034"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_10_1","DOI":"10.1109\/MS.2014.97"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_11_1","DOI":"10.1016\/j.jss.2013.01.013"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_12_1","DOI":"10.1016\/j.jss.2008.07.046"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_13_1","DOI":"10.1007\/s10664-017-9523-3"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_14_1","DOI":"10.1016\/0895-4356(90)90158-L"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"crossref","DOI":"10.1002\/0471445428","volume-title":"The comparison of proportions from several independent samples. Statistical Methods for Rates and Proportions","author":"Fleiss Joseph L","year":"2003","unstructured":"Joseph L Fleiss , Bruce Levin , and Myunghee Cho Paik . 2003. The comparison of proportions from several independent samples. Statistical Methods for Rates and Proportions , Third Edition ( 2003 ), 187--233. Joseph L Fleiss, Bruce Levin, and Myunghee Cho Paik. 2003. The comparison of proportions from several independent samples. Statistical Methods for Rates and Proportions, Third Edition (2003), 187--233."},{"key":"e_1_3_2_1_16_1","first-page":"46","article-title":"Guide published for peer reviewers of research manuscripts","volume":"25","author":"Gastel Barbara","year":"2002","unstructured":"Barbara Gastel . 2002 . Guide published for peer reviewers of research manuscripts . Science Editor 25 , 2 (2002), 46 -- 48 . Barbara Gastel. 2002. Guide published for peer reviewers of research manuscripts. Science Editor 25, 2 (2002), 46--48.","journal-title":"Science Editor"},{"volume-title":"Peer review and manuscript management in scientific journals: guidelines for good practice","author":"Hames Irene","unstructured":"Irene Hames . 2008. Peer review and manuscript management in scientific journals: guidelines for good practice . John Wiley & Sons . Irene Hames. 2008. Peer review and manuscript management in scientific journals: guidelines for good practice. John Wiley & Sons.","key":"e_1_3_2_1_17_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_18_1","DOI":"10.1016\/S0164-1212(02)00012-2"},{"unstructured":"Mick Healey and Alan Jenkins. 2009. Developing undergraduate research and inquiry. https:\/\/www.heacademy.ac.uk\/system\/files\/developingundergraduate_final.pdf. (2009).  Mick Healey and Alan Jenkins. 2009. Developing undergraduate research and inquiry. https:\/\/www.heacademy.ac.uk\/system\/files\/developingundergraduate_final.pdf. (2009).","key":"e_1_3_2_1_19_1"},{"volume-title":"Guide to advanced empirical software engineering","author":"Jedlitschka Andreas","unstructured":"Andreas Jedlitschka , Marcus Ciolkowski , and Dietmar Pfahl . 2008. Reporting experiments in software engineering . In Guide to advanced empirical software engineering . Springer , 201--228. Andreas Jedlitschka, Marcus Ciolkowski, and Dietmar Pfahl. 2008. Reporting experiments in software engineering. In Guide to advanced empirical software engineering. Springer, 201--228.","key":"e_1_3_2_1_20_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_21_1","DOI":"10.1016\/j.jss.2006.10.041"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_22_1","DOI":"10.1145\/1159733.1159742"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_24_1","DOI":"10.1109\/52.391832"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_25_1","DOI":"10.1145\/1852786.1852789"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_26_1","DOI":"10.5555\/2227040.2227047"},{"volume-title":"Evidence-based software engineering and systematic reviews","author":"Kitchenham Barbara Ann","unstructured":"Barbara Ann Kitchenham , David Budgen , and Pearl Brereton . 2015. Evidence-based software engineering and systematic reviews . Vol. 4 . CRC Press . Barbara Ann Kitchenham, David Budgen, and Pearl Brereton. 2015. Evidence-based software engineering and systematic reviews. Vol. 4. CRC Press.","key":"e_1_3_2_1_27_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_28_1","DOI":"10.5555\/998675.999432"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_29_1","DOI":"10.1109\/ICCSE.2012.35"},{"volume-title":"15th Worshop on Software Engineering im Unterricht der Hochschulen. ceur workshop proceedings, 20--31.","author":"Kuhrmann Marco","unstructured":"Marco Kuhrmann . 2017. Teaching Empirical Software Engineering Using Expert Teams . In 15th Worshop on Software Engineering im Unterricht der Hochschulen. ceur workshop proceedings, 20--31. Marco Kuhrmann. 2017. Teaching Empirical Software Engineering Using Expert Teams. In 15th Worshop on Software Engineering im Unterricht der Hochschulen. ceur workshop proceedings, 20--31.","key":"e_1_3_2_1_30_1"},{"volume-title":"Successful research supervision: Advising students doing research","author":"Lee Anne","unstructured":"Anne Lee . 2011. Successful research supervision: Advising students doing research . Routledge . Anne Lee. 2011. Successful research supervision: Advising students doing research. Routledge.","key":"e_1_3_2_1_31_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_32_1","DOI":"10.1002\/asi.22784"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_33_1","DOI":"10.1016\/j.jss.2007.05.007"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_34_1","DOI":"10.1117\/1.JMM.14.2.020101"},{"key":"e_1_3_2_1_35_1","volume-title":"11th IEEE International Symposium on Software Metrics (METRICS 2005)","author":"Magne J\u00f8rgensen","year":"2005","unstructured":"J\u00f8rgensen Magne , Barbara Kitchenham , 2005 . Teaching evidence-based software engineering to university students . In 11th IEEE International Symposium on Software Metrics (METRICS 2005) , 19-22 September 2005, Como Italy. IEEE, 24. J\u00f8rgensen Magne, Barbara Kitchenham, et al. 2005. Teaching evidence-based software engineering to university students. In 11th IEEE International Symposium on Software Metrics (METRICS 2005), 19-22 September 2005, Como Italy. IEEE, 24."},{"key":"e_1_3_2_1_36_1","volume-title":"Interrater reliability: the kappa statistic. Biochemia medica: Biochemia medica 22, 3","author":"McHugh Mary L","year":"2012","unstructured":"Mary L McHugh . 2012. Interrater reliability: the kappa statistic. Biochemia medica: Biochemia medica 22, 3 ( 2012 ), 276--282. Mary L McHugh. 2012. Interrater reliability: the kappa statistic. Biochemia medica: Biochemia medica 22, 3 (2012), 276--282."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_37_1","DOI":"10.1504\/IJPQM.2007.013334"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_38_1","DOI":"10.1007\/s11192-015-1617-3"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_39_1","DOI":"10.1007\/s00766-015-0237-z"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_40_1","DOI":"10.1016\/0895-4356(91)90205-N"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_41_1","DOI":"10.1016\/j.infsof.2015.03.007"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_42_1","DOI":"10.1109\/ESEM.2009.5316010"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_43_1","DOI":"10.5555\/2227097.2227108"},{"volume-title":"Real world research","author":"Robson Colin","unstructured":"Colin Robson and Kieran McCartan . 2016. Real world research . John Wiley & Sons . Colin Robson and Kieran McCartan. 2016. Real world research. John Wiley & Sons.","key":"e_1_3_2_1_44_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_45_1","DOI":"10.1007\/s10664-008-9102-8"},{"key":"e_1_3_2_1_46_1","volume-title":"Manuscript peer review: a helpful checklist for students and novice referees. Advances in physiology education 23, 1","author":"Seals Douglas R","year":"2000","unstructured":"Douglas R Seals and Hirofumi Tanaka . 2000. Manuscript peer review: a helpful checklist for students and novice referees. Advances in physiology education 23, 1 ( 2000 ), S52--58. Douglas R Seals and Hirofumi Tanaka. 2000. Manuscript peer review: a helpful checklist for students and novice referees. Advances in physiology education 23, 1 (2000), S52--58."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_47_1","DOI":"10.2134\/jae1989.0105"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_48_1","DOI":"10.1177\/014107680609900414"},{"key":"e_1_3_2_1_49_1","volume-title":"How to review manuscripts -- Your ultimate checklist when reviewing a paper. (May","author":"Sugrue Darren","year":"2016","unstructured":"Darren Sugrue . 2016. How to review manuscripts -- Your ultimate checklist when reviewing a paper. (May 2016 ). https:\/\/www.elsevier.com\/reviewers-update\/story\/tutorials-and-resources\/how-to-review-manuscripts {Online; posted 25-May-2016}. Darren Sugrue. 2016. How to review manuscripts -- Your ultimate checklist when reviewing a paper. (May 2016). https:\/\/www.elsevier.com\/reviewers-update\/story\/tutorials-and-resources\/how-to-review-manuscripts {Online; posted 25-May-2016}."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_50_1","DOI":"10.1109\/TSE.2011.26"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_51_1","DOI":"10.1136\/bmj.305.6846.187-b"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_52_1","DOI":"10.12968\/bjon.2013.22.14.831"},{"doi-asserted-by":"crossref","unstructured":"Roel Wieringa. 2012. Towards a unified checklist for empirical research in software engineering: first proposal. (2012) 161--165.  Roel Wieringa. 2012. Towards a unified checklist for empirical research in software engineering: first proposal. (2012) 161--165.","key":"e_1_3_2_1_53_1","DOI":"10.1049\/ic.2012.0020"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_54_1","DOI":"10.1145\/2372251.2372279"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_55_1","DOI":"10.1145\/2652524.2652559"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_56_1","DOI":"10.5555\/2349018"}],"event":{"sponsor":["GI Gesellschaft f\u00fcr Informatik e.V.","SIGSOFT ACM Special Interest Group on Software Engineering"],"acronym":"ECSEE'18","name":"ECSEE'18: European Conference of Software Engineering Education 2018","location":"Seeon\/ Bavaria Germany"},"container-title":["Proceedings of the 3rd European Conference of Software Engineering Education"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3209087.3209099","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3209087.3209099","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:07:06Z","timestamp":1750212426000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3209087.3209099"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,14]]},"references-count":54,"alternative-id":["10.1145\/3209087.3209099","10.1145\/3209087"],"URL":"https:\/\/doi.org\/10.1145\/3209087.3209099","relation":{},"subject":[],"published":{"date-parts":[[2018,6,14]]},"assertion":[{"value":"2018-06-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}