{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,9]],"date-time":"2026-08-09T02:54:51Z","timestamp":1786244091519,"version":"3.56.0"},"reference-count":55,"publisher":"Emerald","issue":"1","license":[{"start":{"date-parts":[[2020,10,16]],"date-time":"2020-10-16T00:00:00Z","timestamp":1602806400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IMDS"],"published-print":{"date-parts":[[2020,10,16]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title><jats:p>The use of meta-analysis in information systems (IS) research has increased. Because this research domain has matured and an increasing number of empirical studies have become available, meta-analysis is now perceived as a useful approach to synthesize an increasing body of empirical research. The present paper gives an overview of meta-analytical techniques, the evolution of meta-analysis in IS, the focus of these studies and method choices made by authors.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title><jats:p>This overview is based on 100 meta-analysis studies published in IS journals. These meta-analytical studies synthesize data from 6,262 empirical studies, and the meta-analyses were published between 1989 and 2020. The studies were coded with regard to 16 major method choices that IS researchers made when conducting meta-analyses.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Findings<\/jats:title><jats:p>This overview describes the key areas of meta-analysis (e.g. strategy and firm performance) and the journals that publish the meta-analysis. This overview also identifies method issues where meta-analyses have improved in recent years as well as issues that require some attention. Scholars receive guidance about good practices in terms of 16 major method choices related to (1) problem formulation, (2) literature search, (3) coding information, (4) analyzing and integrating effect sizes and (5) interpreting results and reporting findings.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title><jats:p>Addressing the identified method issues helps authors of future meta-analyses to increase the transparency of reporting and the likelihood of getting published. The substantive findings of a meta-analysis also often depend on researchers' method choices. Similar overviews exist for other disciplines, such as marketing and management.<\/jats:p><\/jats:sec>","DOI":"10.1108\/imds-08-2020-0495","type":"journal-article","created":{"date-parts":[[2020,10,16]],"date-time":"2020-10-16T03:45:08Z","timestamp":1602819908000},"page":"12-29","source":"Crossref","is-referenced-by-count":8,"title":["Meta-analysis in information systems research: method choices and recommendations for future research"],"prefix":"10.1108","volume":"121","author":[{"given":"Markus","family":"Blut","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"140","reference":[{"issue":"1","key":"key2021020414244824000_ref001","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1177\/0149206310377113","article-title":"Meta-analytic choices and judgment calls: implications for theory building and testing, obtained effect sizes, and scholarly impact","volume":"37","year":"2011","journal-title":"Journal of Management"},{"key":"key2021020414244824000_ref002","volume-title":"Publication Manual of the American Psychological Association","author":"American Psychological Association","year":"2020","edition":"7th ed."},{"issue":"4","key":"key2021020414244824000_ref003","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1007\/s11747-019-00680-8","article-title":"Technology readiness: a meta-analysis of conceptualizations of the construct and its impact on technology usage","volume":"48","year":"2020","journal-title":"Journal of the Academy of Marketing Science"},{"issue":"4","key":"key2021020414244824000_ref004","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1016\/j.jretai.2015.05.004","article-title":"E-Service quality: a meta-analytic review","volume":"91","year":"2015","journal-title":"Journal of Retailing"},{"issue":"4","key":"key2021020414244824000_ref005","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1177\/1094670516662352","article-title":"Factors influencing the acceptance of self-service technologies: a meta-analysis","volume":"19","year":"2016","journal-title":"Journal of Service Research"},{"issue":"4","key":"key2021020414244824000_ref006","doi-asserted-by":"crossref","first-page":"500","DOI":"10.1016\/j.jretai.2016.09.002","article-title":"E-service quality: development of a hierarchical model","volume":"92","year":"2016","journal-title":"Journal of Retailing"},{"key":"key2021020414244824000_ref007","volume-title":"Introduction to Meta-Analysis","year":"2009"},{"key":"key2021020414244824000_ref008","volume-title":"2018 Academic Journal Guide","author":"CABS","year":"2018"},{"issue":"4","key":"key2021020414244824000_ref009","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/S0378-7206(98)00089-5","article-title":"On the use of construct reliability in MIS research: a meta-analysis","volume":"35","year":"1999","journal-title":"Information and Management"},{"issue":"1","key":"key2021020414244824000_ref010","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1111\/bjet.12526","article-title":"The effectiveness of digital game\u2010based vocabulary learning: a framework\u2010based view of meta\u2010analysis","volume":"49","year":"2018","journal-title":"British Journal of Educational Technology"},{"key":"key2021020414244824000_ref011","volume-title":"Meta-analysis: A Structural Equation Modelling Approach","year":"2015"},{"key":"key2021020414244824000_ref012","volume-title":"Statistical Power Analysis for the Behavioral Sciences","year":"1988","edition":"2nd ed."},{"key":"key2021020414244824000_ref013","volume-title":"Research Synthesis and Meta-Analysis: A Step-by-step Approach","year":"2017","edition":"5th ed."},{"issue":"6","key":"key2021020414244824000_ref014","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1016\/j.im.2012.08.003","article-title":"A meta-analysis of the consequences of virtualness on team functioning","volume":"49","year":"2012","journal-title":"Information and Management"},{"issue":"3","key":"key2021020414244824000_ref015","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1080\/07421222.2002.11045696","article-title":"Investigating the moderators of the group support systems use with meta-analysis","volume":"18","year":"2002","journal-title":"Journal of Management Information Systems"},{"issue":"2","key":"key2021020414244824000_ref016","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1111\/j.0006-341X.2000.00455.x","article-title":"Trim and fill: a simple funnel\u2010plot\u2013based method of testing and adjusting for publication bias in meta\u2010analysis","volume":"56","year":"2000","journal-title":"Biometrics"},{"issue":"3","key":"key2021020414244824000_ref017","doi-asserted-by":"crossref","first-page":"719","DOI":"10.1007\/s10796-017-9774-y","article-title":"Re-examining the unified theory of acceptance and use of technology (UTAUT): towards a revised theoretical model","volume":"21","year":"2019","journal-title":"Information Systems Frontiers"},{"issue":"7109","key":"key2021020414244824000_ref018","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1136\/bmj.315.7109.629","article-title":"Bias in meta-analysis detected by a simple, graphical test","volume":"315","year":"1997","journal-title":"BMJ"},{"issue":"2","key":"key2021020414244824000_ref019","doi-asserted-by":"crossref","first-page":"636","DOI":"10.1287\/isre.2018.0821","article-title":"Explaining digital piracy: a meta-analysis","volume":"30","year":"2019","journal-title":"Information Systems Research"},{"key":"key2021020414244824000_ref020","doi-asserted-by":"crossref","first-page":"535","DOI":"10.1016\/j.chb.2017.02.014","article-title":"Why do people file share unlawfully? A systematic review, meta-analysis and panel study","volume":"72","year":"2017","journal-title":"Computers in Human Behavior"},{"key":"key2021020414244824000_ref021","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1016\/j.chb.2018.05.005","article-title":"Personal and social factors involved in internet addiction among adolescents: a meta-analysis","volume":"86","year":"2018","journal-title":"Computers in Human Behavior"},{"issue":"4","key":"key2021020414244824000_ref022","first-page":"1159","article-title":"Looking toward the future of IT\u2013business strategic alignment through the past","volume":"38","year":"2014","journal-title":"MIS Quarterly"},{"issue":"2","key":"key2021020414244824000_ref023","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1177\/0149206308328501","article-title":"A review and evaluation of meta-analysis practices in management research","volume":"35","year":"2009","journal-title":"Journal of Management"},{"key":"key2021020414244824000_ref024","volume-title":"Meta-Analysis in Social Research","year":"1981"},{"issue":"10","key":"key2021020414244824000_ref025","doi-asserted-by":"crossref","first-page":"3","DOI":"10.3102\/0013189X005010003","article-title":"Primary, secondary, and meta-analysis of research","volume":"5","year":"1976","journal-title":"Educational Researcher"},{"issue":"1","key":"key2021020414244824000_ref026","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1007\/s11747-017-0570-5","article-title":"Meta-analysis: integrating accumulated knowledge","volume":"46","year":"2018","journal-title":"Journal of the Academy of Marketing Science"},{"issue":"1","key":"key2021020414244824000_ref027","doi-asserted-by":"crossref","first-page":"301","DOI":"10.2753\/MIS0742-1222250111","article-title":"The role of user participation in information systems development: implications from a meta-analysis","volume":"25","year":"2008","journal-title":"Journal of Management Information Systems"},{"issue":"1","key":"key2021020414244824000_ref028","doi-asserted-by":"crossref","first-page":"1","DOI":"10.25300\/MISQ\/2014\/38.1.01","article-title":"Reliability generalization of perceived ease of use, perceived usefulness, and behavioral intentions","volume":"38","year":"2014","journal-title":"MIS Quarterly"},{"issue":"11","key":"key2021020414244824000_ref029","doi-asserted-by":"crossref","first-page":"1539","DOI":"10.1002\/sim.1186","article-title":"Quantifying heterogeneity in a meta\u2010analysis","volume":"21","year":"2002","journal-title":"Statistics in Medicine"},{"issue":"7414","key":"key2021020414244824000_ref030","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1136\/bmj.327.7414.557","article-title":"Measuring inconsistency in meta-analyses","volume":"327","year":"2003","journal-title":"BMJ"},{"key":"key2021020414244824000_ref031","volume-title":"Multilevel Analysis: Techniques and Applications","year":"2010"},{"key":"key2021020414244824000_ref032","doi-asserted-by":"crossref","first-page":"280","DOI":"10.1016\/j.chb.2019.03.009","article-title":"Social network site use and Big Five personality traits: a meta-analysis","volume":"97","year":"2019","journal-title":"Computers in Human Behavior"},{"key":"key2021020414244824000_ref033","volume-title":"Methods of Meta-Analysis: Correcting Error and Bias in Research Findings","year":"1990"},{"key":"key2021020414244824000_ref034","volume-title":"Methods of Meta-Analysis: Correcting Error and Bias in Research Findings","year":"2004","edition":"2nd ed."},{"issue":"6","key":"key2021020414244824000_ref035","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1057\/ejis.2011.12","article-title":"Assessing moderating effect in meta-analysis: a re-analysis of top management support studies and suggestions for researchers","volume":"20","year":"2011","journal-title":"European Journal of Information Systems"},{"issue":"1","key":"key2021020414244824000_ref036","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/00273171.2017.1375886","article-title":"Accounting for missing correlation coefficients in fixed-effects MASEM","volume":"53","year":"2018","journal-title":"Multivariate Behavioral Research"},{"issue":"4","key":"key2021020414244824000_ref037","doi-asserted-by":"crossref","first-page":"54","DOI":"10.4018\/joeuc.2012100104","article-title":"Computer self-efficacy: a meta-analysis","volume":"24","year":"2012","journal-title":"Journal of Organizational and End User Computing (JOEUC)"},{"issue":"1","key":"key2021020414244824000_ref038","first-page":"665","article-title":"Understanding the role and methods of meta-analysis in IS research","volume":"16","year":"2005","journal-title":"Communications of the Association for Information Systems"},{"issue":"6","key":"key2021020414244824000_ref039","doi-asserted-by":"crossref","first-page":"740","DOI":"10.1016\/j.im.2006.05.003","article-title":"A meta-analysis of the technology acceptance model","volume":"43","year":"2006","journal-title":"Information and Management"},{"key":"key2021020414244824000_ref040","doi-asserted-by":"crossref","first-page":"200","DOI":"10.1016\/j.chb.2018.03.041","article-title":"Social support and Internet addiction among mainland Chinese teenagers and young adults: a meta-analysis","volume":"85","year":"2018","journal-title":"Computers in Human Behavior"},{"issue":"8","key":"key2021020414244824000_ref041","doi-asserted-by":"crossref","first-page":"1138","DOI":"10.1108\/02635571011077807","article-title":"A resource\u2010based perspective on information technology and firm performance: a meta-analysis","volume":"110","year":"2010","journal-title":"Industrial Management and Data Systems"},{"issue":"4","key":"key2021020414244824000_ref042","doi-asserted-by":"crossref","first-page":"1031","DOI":"10.1016\/j.dss.2008.04.002","article-title":"A model to develop effective virtual teams","volume":"45","year":"2008","journal-title":"Decision Support Systems"},{"key":"key2021020414244824000_ref043","volume-title":"Practical Meta-Analysis","year":"2001"},{"issue":"2","key":"key2021020414244824000_ref044","first-page":"388","article-title":"Synthesizing and integrating research on IT-based value cocreation: a meta-analysis","volume":"21","year":"2020","journal-title":"Journal of the Association for Information Systems"},{"issue":"2","key":"key2021020414244824000_ref045","first-page":"157","article-title":"A fail-safe N for effect size in meta-analysis","volume":"8","year":"1983","journal-title":"Journal of Educational Statistics"},{"issue":"1","key":"key2021020414244824000_ref046","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1080\/08874417.2017.1300514","article-title":"Effects of perceived risk on intention to purchase: a meta-analysis","volume":"59","year":"2019","journal-title":"Journal of Computer Information Systems"},{"issue":"1","key":"key2021020414244824000_ref047","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1146\/annurev.psych.52.1.59","article-title":"Meta-analysis: recent developments in quantitative methods for literature reviews","volume":"52","year":"2001","journal-title":"Annual Review of Psychology"},{"issue":"5","key":"key2021020414244824000_ref048","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1111\/j.1559-1816.1979.tb02713.x","article-title":"A note on percent variance explained as a measure of the importance of effects","volume":"9","year":"1979","journal-title":"Journal of Applied Social Psychology"},{"issue":"3","key":"key2021020414244824000_ref049","doi-asserted-by":"crossref","first-page":"638","DOI":"10.1037\/0033-2909.86.3.638","article-title":"The \u2018file drawer problem\u2019 and tolerance for null results","volume":"86","year":"1979","journal-title":"Psychological Bulletin"},{"issue":"4","key":"key2021020414244824000_ref050","doi-asserted-by":"crossref","first-page":"809","DOI":"10.25300\/MISQ\/2015\/39.4.4","article-title":"Information technology impacts on firm performance: an extension of Kohli and Devaraj (2003)","volume":"39","year":"2015","journal-title":"MIS Quarterly"},{"key":"key2021020414244824000_ref051","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2020.106349","article-title":"A meta-analysis of teaching and learning computer programming: effective instructional approaches and conditions","year":"2020","journal-title":"Computers in Human Behavior"},{"key":"key2021020414244824000_ref052","doi-asserted-by":"crossref","first-page":"446","DOI":"10.1016\/j.chb.2014.04.011","article-title":"Does Facebook make you lonely? A meta-analysis","volume":"36","year":"2014","journal-title":"Computers in Human Behavior"},{"key":"key2021020414244824000_ref061","first-page":"51","article-title":"Scientific communication and literature retrieval","volume-title":"Handbook of Research Synthesis","year":"2009"},{"issue":"3","key":"key2021020414244824000_ref053","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1037\/0021-9010.75.3.315","article-title":"Confusion of confidence intervals and credibility intervals in meta-analysis","volume":"75","year":"1990","journal-title":"Journal of Applied Psychology"},{"key":"key2021020414244824000_ref054","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijinfomgt.2019.09.011","article-title":"A meta-analysis to explore privacy cognition and information disclosure of internet users","year":"2020","journal-title":"International Journal of Information Management"}],"container-title":["Industrial Management &amp; Data Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IMDS-08-2020-0495\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IMDS-08-2020-0495\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T21:53:09Z","timestamp":1753393989000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/imds\/article\/121\/1\/12-29\/187087"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,16]]},"references-count":55,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,10,16]]}},"alternative-id":["10.1108\/IMDS-08-2020-0495"],"URL":"https:\/\/doi.org\/10.1108\/imds-08-2020-0495","relation":{},"ISSN":["0263-5577"],"issn-type":[{"value":"0263-5577","type":"print"}],"subject":[],"published":{"date-parts":[[2020,10,16]]}}}