{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T20:01:57Z","timestamp":1780516917596,"version":"3.54.1"},"reference-count":59,"publisher":"SAGE Publications","issue":"3","license":[{"start":{"date-parts":[[2021,4,28]],"date-time":"2021-04-28T00:00:00Z","timestamp":1619568000000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Information Technology"],"published-print":{"date-parts":[[2021,9]]},"abstract":"<jats:p>In design science research, two important challenges exist to achieve greater influence in research and practice: (1) foster frequent reuse of artifacts and design theories and (2) increase knowledge accumulation in the field. In this article, we argue that replication studies could support the accumulation and development of design theories to reach a state that encourages reuse of artifacts and design theories. However, it is unclear precisely how replication relates to design science research\u2014that is, what outcomes replication produces and how researchers should apply it within design science research. This study proposes three overarching research questions ( Does the artifact provide utility? Is the design theory complete? What design theory components fit a larger context?) and eight categories for replication studies in design science research (Test, Redesign, Justification, Adaptation, Explanation, Update, Recreation, and Meta-Replication). We offer guidance to researchers, editors, and reviewers on how to conduct replication studies in design science research and why such studies are so critical. Our goal is to provide \u201cfood for thought\u201d on the significance of design science research replication studies and, in turn, help facilitate their widespread implementation and publication. We conclude our study by highlighting areas for further discussion and investigation, such as defining replication procedures and conceptualizing genuine replication goals within design science research.<\/jats:p>","DOI":"10.1177\/02683962211006429","type":"journal-article","created":{"date-parts":[[2021,4,28]],"date-time":"2021-04-28T07:29:30Z","timestamp":1619594970000},"page":"198-215","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":17,"title":["Toward replication study types for design science research"],"prefix":"10.1177","volume":"36","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6511-221X","authenticated-orcid":false,"given":"Alfred Benedikt","family":"Brendel","sequence":"first","affiliation":[{"name":"Technische Universit\u00e4t Dresden, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3092-5277","authenticated-orcid":false,"given":"Tim-Benjamin","family":"Lembcke","sequence":"additional","affiliation":[{"name":"University of G\u00f6ttingen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jan","family":"Muntermann","sequence":"additional","affiliation":[{"name":"University of G\u00f6ttingen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lutz M","family":"Kolbe","sequence":"additional","affiliation":[{"name":"University of G\u00f6ttingen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2021,4,28]]},"reference":[{"key":"bibr1-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1057\/ejis.2010.22"},{"key":"bibr2-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1037\/met0000051"},{"key":"bibr3-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2575.2006.00208.x"},{"key":"bibr4-02683962211006429","doi-asserted-by":"publisher","DOI":"10.17705\/1jais.00315"},{"key":"bibr5-02683962211006429","doi-asserted-by":"crossref","unstructured":"Baker M (2015) Over half of psychology studies fail reproducibility test. Nature\u2014News. Available at: https:\/\/www.nature.com\/news\/over-half-of-psychology-studies-fail-reproducibility-test-1.18248 (accessed 2 April 2021).","DOI":"10.1038\/nature.2015.18248"},{"key":"bibr6-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1038\/533452a"},{"key":"bibr7-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1040.0206"},{"key":"bibr8-02683962211006429","doi-asserted-by":"publisher","DOI":"10.17705\/1jais.00495"},{"key":"bibr9-02683962211006429","first-page":"18","volume-title":"Proceedings of international conference on information systems","author":"Baskerville R","year":"2017"},{"key":"bibr10-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1007\/s10796-012-9342-4"},{"key":"bibr11-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1177\/0963721412459512"},{"issue":"1","key":"bibr12-02683962211006429","first-page":"20","volume":"6","author":"Brendel AB","year":"2020","journal-title":"AIS Transactions on Replication Research"},{"key":"bibr13-02683962211006429","first-page":"1","volume-title":"Proceedings of European conference on information systems","author":"Brendel AB","year":"2018"},{"issue":"6","key":"bibr14-02683962211006429","first-page":"84","volume":"86","author":"Brown T","year":"2008","journal-title":"Harvard Business Review"},{"key":"bibr15-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1287\/isre.1120.0423"},{"key":"bibr16-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1007\/BF03177550"},{"key":"bibr17-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1080\/00461520.1991.9653137"},{"key":"bibr18-02683962211006429","doi-asserted-by":"publisher","DOI":"10.17705\/1atrr.00001"},{"key":"bibr19-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1057\/ejis.2011.54"},{"key":"bibr20-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1145\/1852786.1852790"},{"key":"bibr21-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2014.04.004"},{"key":"bibr22-02683962211006429","doi-asserted-by":"publisher","DOI":"10.2307\/25148742"},{"key":"bibr23-02683962211006429","doi-asserted-by":"publisher","DOI":"10.25300\/MISQ\/2013\/37.2.01"},{"key":"bibr24-02683962211006429","doi-asserted-by":"publisher","DOI":"10.17705\/1jais.00129"},{"key":"bibr25-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1287\/isre.2014.0533"},{"key":"bibr26-02683962211006429","first-page":"10","volume-title":"Proceedings of Americas conference on information systems","author":"Greulich RS","year":"2019"},{"key":"bibr27-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-91800-6_4"},{"issue":"2","key":"bibr28-02683962211006429","first-page":"87","volume":"19","author":"Hevner AR","year":"2007","journal-title":"Scandinavian Journal of Information Systems"},{"key":"bibr29-02683962211006429","doi-asserted-by":"publisher","DOI":"10.2307\/25148625"},{"key":"bibr30-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1057\/ejis.2013.35"},{"key":"bibr31-02683962211006429","first-page":"1","volume-title":"Proceedings of international conference on design science research in information systems and technology","author":"Kruse LC","year":"2017"},{"key":"bibr32-02683962211006429","doi-asserted-by":"publisher","DOI":"10.17705\/1jais.00300"},{"key":"bibr33-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1109\/HICSS.2010.484"},{"key":"bibr34-02683962211006429","doi-asserted-by":"publisher","DOI":"10.2307\/20650291"},{"key":"bibr35-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-20633-7_1"},{"key":"bibr36-02683962211006429","first-page":"1","volume-title":"Proceedings of international conference on information systems","author":"Leukel J","year":"2014"},{"key":"bibr37-02683962211006429","doi-asserted-by":"publisher","DOI":"10.28945\/479"},{"key":"bibr38-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1016\/0167-9236(94)00041-2"},{"key":"bibr39-02683962211006429","doi-asserted-by":"publisher","DOI":"10.2307\/20721412"},{"key":"bibr40-02683962211006429","volume-title":"Reproducibility and Replicability in Science","author":"National Academies of Sciences, Engineering, and Medicine","year":"2019"},{"key":"bibr41-02683962211006429","doi-asserted-by":"crossref","first-page":"1","DOI":"10.17705\/1atrr.00001","volume":"1","author":"Niederman F","year":"2014","journal-title":"Transactions on Replication Research"},{"key":"bibr42-02683962211006429","doi-asserted-by":"publisher","DOI":"10.17705\/1atrr.00016"},{"key":"bibr43-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1007\/s12599-010-0119-3"},{"key":"bibr44-02683962211006429","doi-asserted-by":"publisher","DOI":"10.2753\/MIS0742-1222240302"},{"key":"bibr45-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1126\/science.1213847"},{"key":"bibr46-02683962211006429","volume-title":"The Logic of Scientific Discovery","author":"Popper KR","year":"1959"},{"key":"bibr47-02683962211006429","volume-title":"Conjectures and Refutations: The Growth of Scientific Knowledge","author":"Popper KR","year":"1963"},{"key":"bibr48-02683962211006429","first-page":"455","volume-title":"Handbook of Experimental Existential Psychology","author":"Ryan RM","year":"2004"},{"key":"bibr49-02683962211006429","first-page":"16","volume-title":"Proceedings of European conference on information systems","author":"Salovaara A","year":"2015"},{"key":"bibr50-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1037\/a0015108"},{"key":"bibr51-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1057\/s41303-017-0039-0"},{"key":"bibr52-02683962211006429","doi-asserted-by":"publisher","DOI":"10.2307\/23043488"},{"key":"bibr53-02683962211006429","first-page":"24","volume-title":"Proceedings of international conference on design science research in information systems and technology","author":"Venable J","year":"2006"},{"key":"bibr54-02683962211006429","volume":"21","author":"Vom Brocke J","year":"2017","journal-title":"Journal of the Association for Information Systems"},{"key":"bibr55-02683962211006429","first-page":"2206","author":"Vom Brocke J","year":"2009","journal-title":"Proceedings of European conference on information systems"},{"key":"bibr56-02683962211006429","doi-asserted-by":"publisher","DOI":"10.17705\/1jais.00611"},{"key":"bibr57-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1111\/j.1540-5915.1999.tb00912.x"},{"key":"bibr58-02683962211006429","doi-asserted-by":"publisher","DOI":"10.1057\/ejis.2008.44"},{"key":"bibr59-02683962211006429","doi-asserted-by":"publisher","DOI":"10.2307\/41703481"}],"container-title":["Journal of Information Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/02683962211006429","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/02683962211006429","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/02683962211006429","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T23:04:59Z","timestamp":1777503899000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/02683962211006429"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,28]]},"references-count":59,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,9]]}},"alternative-id":["10.1177\/02683962211006429"],"URL":"https:\/\/doi.org\/10.1177\/02683962211006429","relation":{},"ISSN":["0268-3962","1466-4437"],"issn-type":[{"value":"0268-3962","type":"print"},{"value":"1466-4437","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,28]]}}}