{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T01:48:26Z","timestamp":1775872106377,"version":"3.50.1"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2014,11,12]],"date-time":"2014-11-12T00:00:00Z","timestamp":1415750400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Comput High Educ"],"published-print":{"date-parts":[[2014,12]]},"DOI":"10.1007\/s12528-014-9084-z","type":"journal-article","created":{"date-parts":[[2014,11,14]],"date-time":"2014-11-14T21:27:13Z","timestamp":1416000433000},"page":"183-209","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["An exploration of bias in meta-analysis: the case of technology integration research in higher education"],"prefix":"10.1007","volume":"26","author":[{"given":"Robert M.","family":"Bernard","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eugene","family":"Borokhovski","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Richard F.","family":"Schmid","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rana M.","family":"Tamim","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2014,11,12]]},"reference":[{"issue":"3","key":"9084_CR1","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1332\/174426410X524866","volume":"6","author":"PC Abrami","year":"2010","unstructured":"Abrami, P. C., Borokhovski, E., Bernard, R. M., Wade, C. A., Tamim, R., Persson, T., et al. (2010). Issues in conducting and disseminating brief reviews. Evidence and Policy: A Journal of Research, Debate and Practice, 6(3), 371\u2013389. doi: 10.1332\/174426410X524866 .","journal-title":"Evidence and Policy: A Journal of Research, Debate and Practice"},{"key":"9084_CR69","unstructured":"*Bayraktar, S. (2000). A meta-analysis study of the effectiveness of computer assisted instruction in science education (Unpublished doctoral dissertation). Ohio State University, Columbus, OH (UMI Number: 9980398)."},{"key":"9084_CR3","unstructured":"Bernard, R. M. (2014). Things I have learned about meta-analysis since 1990: Reducing bias in search of \u201cThe Big Picture.\u201d Canadian Journal of Learning and Instruction, 40(3). http:\/\/www.cjlt.ca\/index.php\/cjlt\/article\/view\/870"},{"issue":"1","key":"9084_CR70","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1007\/s12528-013-9077-3","volume":"26","author":"RM Bernard","year":"2014","unstructured":"Bernard, R. M., Borokhovski, E., Schmid, R. F., Tamim, R. M., & Abrami, P. C. (2014). A meta-analysis of blended learning and technology use in higher education: From the general to the applied. Journal of Computing in Higher Education., 26(1), 87\u2013122. doi: 10.1007\/s12528-013-9077-3 .","journal-title":"Journal of Computing in Higher Education."},{"issue":"3","key":"9084_CR5","doi-asserted-by":"crossref","first-page":"1243","DOI":"10.3102\/0034654309333844","volume":"79","author":"RM Bernard","year":"2009","unstructured":"Bernard, R. M., Abrami, P. C., Borokhovski, E., Wade, A., Tamim, R., Surkes, M., et al. (2009). A meta-analysis of three interaction treatments in distance education. Review of Educational Research, 79(3), 1243\u20131289. doi: 10.3102\/0034654309333844 .","journal-title":"Review of Educational Research"},{"key":"9084_CR71","volume-title":"Comprehensive meta-analysis version 2","author":"M Borenstein","year":"2005","unstructured":"Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. (2005). Comprehensive meta-analysis version 2. Englewood, NJ: Biostat."},{"key":"9084_CR7","doi-asserted-by":"crossref","DOI":"10.1002\/9780470743386","volume-title":"Introduction to meta-analysis","author":"M Borenstein","year":"2009","unstructured":"Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. Chichester: Wiley."},{"key":"9084_CR72","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1002\/jrsm.12","volume":"1","author":"M Borenstein","year":"2010","unstructured":"Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010). A basic introduction to fixed effect and random effects models for meta-analysis. Research Synthesis Methodology, 1, 97\u2013111. doi: 10.1002\/jrsm.12 .","journal-title":"Research Synthesis Methodology"},{"issue":"2","key":"9084_CR9","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1007\/BF02940892","volume":"11","author":"EP Christmann","year":"2000","unstructured":"*Christmann, E. P., & Badgett, J. L. (2000). The comparative effectiveness of CAI on collegiate performance. Journal of Computing in Higher Education, 11(2), 91\u2013103.","journal-title":"Journal of Computing in Higher Education"},{"key":"9084_CR73","volume-title":"Statistical power analysis for the behavioral sciences","author":"J Cohen","year":"1988","unstructured":"Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.","edition":"2"},{"issue":"2","key":"9084_CR11","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1080\/01421590802691393","volume":"31","author":"DA Cook","year":"2009","unstructured":"Cook, D. A. (2009). The failure of e-learning research to inform educational practice, and what we can do about it. Medical Teacher, 31(2), 158\u2013162. doi: 10.1080\/01421590802691393 .","journal-title":"Medical Teacher"},{"key":"9084_CR74","volume-title":"Research synthesis and meta-analysis: A step-by-step approach","author":"HM Cooper","year":"2010","unstructured":"Cooper, H. M. (2010). Research synthesis and meta-analysis: A step-by-step approach (4th ed.). Thousand Oaks, CA: Sage.","edition":"4"},{"issue":"6","key":"9084_CR13","doi-asserted-by":"crossref","first-page":"446","DOI":"10.1037\/a0027119","volume":"67","author":"HM Cooper","year":"2012","unstructured":"Cooper, H. M., & Koenka, A. C. (2012). The overview of review: Unique challenges and opportunities when research syntheses are the principal elements of new integrative scholarship. American Psychologist, 67(6), 446\u2013462. doi: 10.1037\/a0027119 .","journal-title":"American Psychologist"},{"issue":"2","key":"9084_CR75","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1111\/j.0006-341X.2000.00455.x","volume":"56","author":"S Duval","year":"2000","unstructured":"Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56(2), 455\u2013463. doi: 10.1111\/j.0006-341X.2000.00455.x .","journal-title":"Biometrics"},{"issue":"10","key":"9084_CR15","doi-asserted-by":"crossref","first-page":"3","DOI":"10.3102\/0013189X005010003","volume":"5","author":"GV Glass","year":"1976","unstructured":"Glass, G. V. (1976). Primary, secondary and meta-analysis of research. Educational Researcher, 5(10), 3\u20138. doi: 10.3102\/0013189X005010003 .","journal-title":"Educational Researcher"},{"key":"9084_CR76","unstructured":"Hammerstr\u00f8m, K., Wade, A, & J\u00f8rgensen A. M. K. (2010) Searching for studies: A guide to information retrieval for Campbell Systematic Reviews, Supplement 1. Oslo, Norway: The Campbell Collaboration. doi: 10.4073\/csrs.2010.1 . http:\/\/www.campbellcollaboration.org\/resources\/research\/new_information_retrieval_guide.php )"},{"key":"9084_CR17","volume-title":"Visible learning: A synthesis of over 800 meta-analyses relating to achievement","author":"J Hattie","year":"2009","unstructured":"Hattie, J. (2009). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. New York, NY: Routledge."},{"key":"9084_CR77","volume-title":"Statistical aspects of meta-analysis","author":"LV Hedges","year":"1985","unstructured":"Hedges, L. V., & Olkin, I. (1985). Statistical aspects of meta-analysis. New York, NY: Academic Press."},{"key":"9084_CR55","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1002\/jrsm.1092","volume":"4","author":"JPT Higgins","year":"2012","unstructured":"Higgins, J. P. T., Land, P. W., Anagnostelis, J. A.-C., Baker, N. F., Cappelleri, S. H., Hollis, S., et al. (2012). A tool to assess the quality of a meta-analysis. Research Synthesis Methods, 4, 351\u2013366. doi: 10.1002\/jrsm.1092 .","journal-title":"Research Synthesis Methods"},{"key":"9084_CR78","doi-asserted-by":"crossref","DOI":"10.4135\/9781412985031","volume-title":"Methods of meta-Analysis: Correcting error and bias in research findings","author":"JE Hunter","year":"2004","unstructured":"Hunter, J. E., & Schmidt, F. L. (2004). Methods of meta-Analysis: Correcting error and bias in research findings (2nd ed.). Thousand Oaks, CA: Sage.","edition":"2"},{"key":"9084_CR56","unstructured":"*Hsu, Y.-c., (2003). The effectiveness of computer-assisted instruction in statistics education: A meta-analysis. (Unpublished doctoral dissertation). The University of Arizona, Tucson, AZ (UMI Number: 3089963)."},{"key":"9084_CR79","doi-asserted-by":"crossref","first-page":"438","DOI":"10.3102\/00346543050003438","volume":"50","author":"GB Jackson","year":"1980","unstructured":"Jackson, G. B. (1980). Methods for integrative reviews. Review of Educational Research, 50, 438\u2013460. doi: 10.3102\/00346543050003438 .","journal-title":"Review of Educational Research"},{"key":"9084_CR57","doi-asserted-by":"crossref","unstructured":"Karich, A. C., Burns, M. K., & Maki, K. E. (2014). Updated meta-analysis of learner control within educational technology. Review of Educational Research. OnlineFirst, March 10, 2014. doi: 10.3102\/0034654314526064","DOI":"10.3102\/0034654314526064"},{"issue":"3","key":"9084_CR80","doi-asserted-by":"crossref","first-page":"3","DOI":"10.18438\/B8MS3D","volume":"1","author":"D Koufogiannakis","year":"2006","unstructured":"*Koufogiannakis, D., & Wiebe, N. (2006). Effective methods for teaching information literacy skills to undergraduate students: A systematic review and meta-analysis. Evidence-Based Library and Information Practice, 1(3), 3\u201343.","journal-title":"Evidence-Based Library and Information Practice"},{"key":"9084_CR58","unstructured":"*Larwin, K., & Larwin, D. (2011). A meta-analysis examining the impact of computer-assisted instruction on postsecondary statistics education: 40\u00a0years of research, Journal of Research on Technology in Education, 43(3), 253\u2013278. http:\/\/www.editlib.org\/p\/54098\/"},{"key":"9084_CR81","unstructured":"Lefebvre, C., Manheimer, E., & Glanville J. (2011). Chapter 6: Searching for studies. In J. P. T. Higgins & Green, S. (Eds.), Cochrane handbook for systematic reviews of interventions version 5.1.0 (updated March 2011). http:\/\/www.cochrane-handbook.org"},{"key":"9084_CR59","volume-title":"Practical meta-analysis","author":"MW Lipsey","year":"2001","unstructured":"Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage."},{"key":"9084_CR82","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/j.compedu.2013.07.033","volume":"70","author":"Z Merchant","year":"2014","unstructured":"**Merchant, Z., Goetz, E. T., Cifuentes, L., Keeney-Kennicutt, W., & Davis, T. R. (2014). Effectiveness of virtual reality-based instruction on students\u2019 learning outcomes in K-12 and higher education: A meta-analysis. Computers & Education, 70, 29\u201340.","journal-title":"Computers & Education"},{"key":"9084_CR60","unstructured":"*Michko, G. M. (2007). A meta-analysis of the effects of teaching and learning with technology in undergraduate engineering education (Unpublished doctoral dissertation). University of Huston, Huston, TX (UMI Number: 3289807)."},{"key":"9084_CR83","unstructured":"**Rolfe, V., & Gray, D. (2011). Are multimedia resources effective in life science education? A meta-analysis. Bioscience Education, 18(December). www.bioscience.heacademy.ac.uk\/journal\/vol18\/beej-18-3.pdf"},{"key":"9084_CR61","volume-title":"Publication bias in meta-analysis\u2014Prevention, assessment and adjustments","year":"2005","unstructured":"Rothstein, H. R., Sutton, A. J., & Borenstein, M. (Eds.). (2005). Publication bias in meta-analysis\u2014Prevention, assessment and adjustments. Chichester: Wiley."},{"issue":"3","key":"9084_CR84","doi-asserted-by":"crossref","first-page":"328","DOI":"10.3102\/0034654313500826","volume":"84","author":"N Scammacca","year":"2013","unstructured":"Scammacca, N., Roberts, G., & Stuebing, K. K. (2013). Meta-analysis with complex research designs: Dealing with dependence from multiple measures and multiple group comparisons. Review of Educational Research, 84(3), 328\u2013364. doi: 10.3102\/0034654313500826 .","journal-title":"Review of Educational Research"},{"key":"9084_CR62","unstructured":"*Schenker, J. D. (2007). The effectiveness of technology use in statistics instruction in higher education: A meta-analysis using hierarchical linear modeling (Unpublished doctoral dissertation). Kent State University, Kent, OH."},{"issue":"4","key":"9084_CR85","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1080\/07434610500194813","volume":"21","author":"RW Schlosser","year":"2005","unstructured":"Schlosser, R. W., Wendt, O., Angermeier, K., & Shetty, M. (2005). Searching for and finding evidence in augmentative and alternative communication: Navigating a scattered literature. Augmentative and Alternative Communication, 21(4), 233\u2013255. doi: 10.1080\/07434610500194813 .","journal-title":"Augmentative and Alternative Communication"},{"key":"9084_CR63","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1016\/j.compedu.2013.11.002","volume":"72","author":"RF Schmid","year":"2014","unstructured":"Schmid, R. F., Bernard, R. M., Borokhovski, E., Tamim, R. M., Abrami, P. C., Surkes, M. A., et al. (2014). The effects of technology use in postsecondary education: A meta-analysis of classroom applications. Computers & Education, 72, 271\u2013291. doi: 10.1016\/j.compedu.2013.11.002 .","journal-title":"Computers & Education"},{"key":"9084_CR86","doi-asserted-by":"crossref","unstructured":"Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., et al. (2007). Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Medical Research Methodology, 7(10). doi: 10.1186\/1471-2288-7-10 .","DOI":"10.1186\/1471-2288-7-10"},{"key":"9084_CR64","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1111\/j.1744-6570.2011.01190.x","volume":"64","author":"T Sitzmann","year":"2011","unstructured":"*Sitzmann, T. (2011). A meta-analytic examination of the instructional effectiveness of computer-based simulation games. Personnel Psychology, 64, 489\u2013528. doi: 10.1111\/j.1744-6570.2011.01190.x .","journal-title":"Personnel Psychology"},{"issue":"1","key":"9084_CR87","doi-asserted-by":"crossref","first-page":"97","DOI":"10.3102\/0034654310378174","volume":"81","author":"GW Sosa","year":"2011","unstructured":"*Sosa, G. W., Berger, D. E., Shaw, A. T., & Mary, J. C. (2011). Effectiveness of computer-assisted instruction in statistics: A meta-analysis. Review of Educational Research, 81(1), 97\u2013128. doi: 10.3102\/0034654310378174 .","journal-title":"Review of Educational Research"},{"issue":"3","key":"9084_CR65","doi-asserted-by":"crossref","first-page":"4","DOI":"10.3102\/0034654310393361","volume":"81","author":"RM Tamim","year":"2011","unstructured":"Tamim, R. M., Bernard, R. M., Borokhovski, E., Abrami, P. C., & Schmid, R. F. (2011). What forty years of research says about the impact of technology on learning: A second-order meta-analysis and validation study. Review of Educational Research, 81(3), 4\u201328. doi: 10.3102\/0034654310393361 .","journal-title":"Review of Educational Research"},{"key":"9084_CR88","unstructured":"*Tekbiyik, A., & Akdeniz, A. R. (2010). A meta-analytical investigation of the influence of computer assisted instruction on achievement in science, Asia-Pacific Forum on Science Learning and Teaching, 11(2). http:\/\/www.ied.edu.hk\/apfslt\/v11_issue2\/tekbiyik\/index.htm"},{"issue":"1","key":"9084_CR66","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1080\/03634520500489666","volume":"55","author":"CE Timmerman","year":"2006","unstructured":"*Timmerman, C. E., & Kruepke, A. (2006). Computer-assisted instruction, media richness and college student performance. Communication Education, 55(1), 73\u2013104. doi: 10.1080\/03634520500489666 .","journal-title":"Communication Education"},{"issue":"2","key":"9084_CR89","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1037\/1082-989X.13.2.130","volume":"13","author":"JC Valentine","year":"2008","unstructured":"Valentine, J. C., & Cooper, H. M. (2008). A systematic and transparent approach for assessing the methodological quality of intervention effectiveness research: The Study Design and Implementation Assessment Device (Study DIAD). Psychological Methods, 13(2), 130\u2013149. doi: 10.1037\/1082-989X.13.2.130 .","journal-title":"Psychological Methods"},{"issue":"3","key":"9084_CR67","doi-asserted-by":"crossref","first-page":"229","DOI":"10.2190\/FLHV-K4WA-WPVQ-H0YM","volume":"34","author":"JJ Vogel","year":"2006","unstructured":"**Vogel, J. J., Vogel, D. S., Cannon-Bower, J., Bowers, C. A., Muse, K., & Wright, M. (2006). Computer gaming and interactive simulations for learning: A meta-analysis. Journal of Educational Computing Research, 34(3), 229\u2013243.","journal-title":"Journal of Educational Computing Research"},{"key":"9084_CR91","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1002\/jrsm.11","volume":"1","author":"W Viechbauer","year":"2010","unstructured":"Viechbauer, W., & Cheung, M.-L. (2010). Outlier and influence diagnostics for meta-analysis. Research Synthesis Methods, 1, 112\u2013125. doi: 10.1002\/jrsm.11 .","journal-title":"Research Synthesis Methods"},{"issue":"1","key":"9084_CR90","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1558\/cj.v21i1.7-27","volume":"21","author":"Y Zhao","year":"2003","unstructured":"*Zhao, Y. (2003). Recent developments in technology and language learning: A literature review and meta-analysis. CALICO Journal, 21(1), 7\u201327.","journal-title":"CALICO Journal"}],"container-title":["Journal of Computing in Higher Education"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s12528-014-9084-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s12528-014-9084-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s12528-014-9084-z","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,8,17]],"date-time":"2019-08-17T11:37:16Z","timestamp":1566041836000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s12528-014-9084-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,11,12]]},"references-count":45,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2014,12]]}},"alternative-id":["9084"],"URL":"https:\/\/doi.org\/10.1007\/s12528-014-9084-z","relation":{},"ISSN":["1042-1726","1867-1233"],"issn-type":[{"value":"1042-1726","type":"print"},{"value":"1867-1233","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,11,12]]}}}