{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,27]],"date-time":"2025-08-27T15:51:28Z","timestamp":1756309888711,"version":"3.37.3"},"reference-count":51,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2021,4,26]],"date-time":"2021-04-26T00:00:00Z","timestamp":1619395200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springer.com\/tdm"},{"start":{"date-parts":[[2021,4,26]],"date-time":"2021-04-26T00:00:00Z","timestamp":1619395200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springer.com\/tdm"}],"funder":[{"DOI":"10.13039\/501100008982","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1416781"],"award-info":[{"award-number":["1416781"]}],"id":[{"id":"10.13039\/501100008982","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Tech Know Learn"],"published-print":{"date-parts":[[2022,9]]},"DOI":"10.1007\/s10758-021-09513-6","type":"journal-article","created":{"date-parts":[[2021,4,26]],"date-time":"2021-04-26T11:03:10Z","timestamp":1619434990000},"page":"801-821","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Details Matter: How Contrasting Design Features in Two MUVEs Impact Learning Outcomes"],"prefix":"10.1007","volume":"27","author":[{"given":"Emily A.","family":"Gonzalez","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6596-4842","authenticated-orcid":false,"given":"Tina A.","family":"Grotzer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eileen","family":"McGivney","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joseph","family":"Reilly","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,4,26]]},"reference":[{"issue":"1","key":"9513_CR1","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1007\/s10956-006-9033-3","volume":"16","author":"SA Barab","year":"2007","unstructured":"Barab, S. A., Sadler, T. D., Heiselt, C., Hickey, D., & Zuiker, S. (2007). Relating narrative, inquiry, and inscriptions: Supporting consequential play. Journal of science education and technology, 16(1), 59\u201382","journal-title":"Journal of science education and technology"},{"issue":"7","key":"9513_CR3","doi-asserted-by":"publisher","first-page":"1082","DOI":"10.1002\/tea.21257","volume":"53","author":"LK Berland","year":"2015","unstructured":"Berland, L. K., Schwarz, C. V., Krist, C., Kenyon, L., Lo, A. S., & Reiser, B. J. (2015). Epistemologies in practice: Making scientific practices meaningful for students. Journal of Research in Science Teaching, 53(7), 1082\u20131112","journal-title":"Journal of Research in Science Teaching"},{"key":"9513_CR4","unstructured":"Carini P. F. (1982). Interpretation, Ambiguity and The Art of Observation. Unpublished manuscript. An Address to the Philosophical Division of the American Psychological Association."},{"key":"9513_CR5","volume-title":"The Art of Seeing and the Visibility of the Person","author":"PF Carini","year":"1979","unstructured":"Carini, P. F. (1979). The Art of Seeing and the Visibility of the Person. University of North Dakota Press."},{"key":"9513_CR6","unstructured":"Charmaz, K. (2006).\u00a0Constructing grounded theory: A practical guide through qualitative analysis. London; Thousand Oaks, Calif.: Sage Publications."},{"issue":"9","key":"9513_CR100","doi-asserted-by":"publisher","first-page":"1239","DOI":"10.1002\/tea.21450","volume":"55","author":"J Chen","year":"2018","unstructured":"Chen, J., Wang, M., Grotzer, T. A., & Dede, C. (2018). Using a three-dimensional thinking graph to support inquiry learning. Journal for Research in Science Teaching, 55(9), 1239\u20131263.","journal-title":"Journal for Research in Science Teaching."},{"key":"9513_CR7","first-page":"158","volume-title":"How much and what type of guidance is optimal for learning from instruction","author":"RE Clark","year":"2009","unstructured":"Clark, R. E. (2009). How much and what type of guidance is optimal for learning from instruction. (pp. 158\u2013183). Success or failure."},{"issue":"4","key":"9513_CR8","doi-asserted-by":"publisher","first-page":"353","DOI":"10.1007\/s10956-009-9156-4","volume":"18","author":"J Clarke-Midura","year":"2009","unstructured":"Clarke-Midura, J., & Dede, C. J. (2009). Design for scalability: A case study of the River City Curriculum. Journal of Science Education and Technology, 18(4), 353\u2013365","journal-title":"Journal of Science Education and Technology"},{"key":"9513_CR9","volume-title":"Qualitative inquiry & research design: Choosing among five approaches","author":"JW Creswell","year":"2012","unstructured":"Creswell, J. W. (2012). Qualitative inquiry & research design: Choosing among five approaches. (4th ed.). Sage.","edition":"4"},{"issue":"8","key":"9513_CR10","doi-asserted-by":"publisher","first-page":"1083","DOI":"10.1002\/tea.21549","volume":"56","author":"MP Cuzzolino","year":"2019","unstructured":"Cuzzolino, M. P., Grotzer, T. A., Tutwiler, M. S., & Torres, E. W. (2019). An agentive focus may limit learning about complex causality and systems dynamics: A study of seventh graders\u2019 explanations of ecosystems. Journal of Research in Science Teaching, 56(8), 1083\u20131105","journal-title":"Journal of Research in Science Teaching"},{"key":"9513_CR11","unstructured":"Dede, C., Ketelhut, D., & Ruess, K. (2004). Designing for motivation and usability in a museum-based multi-user virtual environment. Paper presented at the American Educational Research Association Conference."},{"issue":"4","key":"9513_CR12","doi-asserted-by":"publisher","first-page":"415","DOI":"10.1002\/tea.10083","volume":"40","author":"J Dodick","year":"2003","unstructured":"Dodick, J., & Orion, N. (2003). Cognitive factors affecting student understanding of geologic time. Journal of Research in Science Teaching, 40(4), 415\u2013442","journal-title":"Journal of Research in Science Teaching"},{"issue":"3","key":"9513_CR13","doi-asserted-by":"publisher","first-page":"719","DOI":"10.2307\/1163282","volume":"33","author":"PA Ertmer","year":"1996","unstructured":"Ertmer, P. A., Newby, T. J., & MacDougall, M. (1996). Students\u2019 responses and approaches to case-based instruction: The role of reflective self-regulation. American Educational Research Journal, 33(3), 719\u2013752. https:\/\/doi.org\/10.2307\/1163282","journal-title":"American Educational Research Journal"},{"issue":"1","key":"9513_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10758-019-09409-6","volume":"25","author":"E Fokides","year":"2020","unstructured":"Fokides, E., & Chachlaki, F. (2020). 3D multiuser virtual environments and environmental education: The virtual island of the mediterranean monk seal. Technology, Knowledge and Learning, 25(1), 1\u201324","journal-title":"Technology, Knowledge and Learning"},{"issue":"23","key":"9513_CR15","doi-asserted-by":"publisher","first-page":"8410","DOI":"10.1073\/pnas.1319030111","volume":"111","author":"S Freeman","year":"2014","unstructured":"Freeman, S., Eddy, S. L., McDonough, M., Smith, M. K., Okoroafor, N., Jordt, H., & Wenderoth, M. P. (2014). Active learning increases student performance in science, engineering, and mathematics. Proceedings of the National Academy of Sciences, 111(23), 8410\u20138415","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"4","key":"9513_CR16","doi-asserted-by":"publisher","first-page":"414","DOI":"10.1016\/S0010-0285(02)00519-4","volume":"46","author":"RL Goldstone","year":"2003","unstructured":"Goldstone, R. L., & Sakamoto, Y. (2003). The transfer of abstract principles governing complex adaptive systems. Cognitive psychology, 46(4), 414\u2013466","journal-title":"Cognitive psychology"},{"issue":"1","key":"9513_CR101","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1080\/00219266.2003.9655891","volume":"38","author":"TA Grotzer","year":"2003","unstructured":"Grotzer, T. A., & Basca, B. B. (2003). How does grasping the underlying causal structures of ecosystems impact students\u2019 understanding? Journal of Biological Education, 38(1), 16\u201329.","journal-title":"Journal of Biological Education"},{"issue":"4","key":"9513_CR102","doi-asserted-by":"publisher","first-page":"288","DOI":"10.1525\/bio.2013.63.4.9","volume":"63","author":"TA Grotzer","year":"2013","unstructured":"Grotzer, T. A., Kamarainen, A., Tutwiler, M. S., Metcalf, S., & Dede, C. (2013). Learning to reason about ecosystems dynamics over time: The challenges of an event-based causal focus. BioScience, 63(4), 288\u2013296.","journal-title":"BioScience"},{"key":"9513_CR103","unstructured":"Grotzer, T. A., Tutwiler, M. S. Kamarainen, A. M., Derbiszewska K. M., Metcalf, S. J., &  Dede, C. J. (2016) Students\u2019 Reasoning Tendencies about the Causal Dynamics of Ecosystems and the Impacts of MUVE vs. Non-MUVE Instructional Contexts, The Next Phase of Research in Complex Systems in Science Education, American Educational Research Association (AERA) Conference, Washington D.C."},{"key":"9513_CR104","unstructured":"Grotzer, T. A., Metcalf, S. J., Tutwiler, M. S., Kamarainen, A. M., Thompson, M. & Dede, C. (2017). Teaching the Systems Aspects of Epistemologically Authentic Experimentation in Ecosystems through Immersive Virtual Worlds, National Association for Research in Science Teaching (NARST), San Antonio, TX."},{"issue":"1","key":"9513_CR17","doi-asserted-by":"publisher","first-page":"81","DOI":"10.3102\/003465430298487","volume":"77","author":"J Hattie","year":"2007","unstructured":"Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81\u2013112","journal-title":"Review of Educational Research"},{"key":"9513_CR18","doi-asserted-by":"crossref","unstructured":"Herman, P., & Gomez, L. M. (2009). Taking guided learning theory to school: Reconciling the cognitive, motivational, and social contexts of instruction. Constructivist Instruction\u00a0(pp. 74\u201393). Routledge.","DOI":"10.4324\/9780203878842-11"},{"issue":"2","key":"9513_CR19","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1080\/00461520701263368","volume":"42","author":"CE Hmelo-Silver","year":"2007","unstructured":"Hmelo-Silver, C. E., Duncan, R. G., & Chinn, C. A. (2007). Scaffolding and achievement in problem-based and inquiry learning: A response to Kirschner, Sweller, and Clark. Educational Psychologist, 42(2), 99\u2013107","journal-title":"Educational Psychologist"},{"issue":"1","key":"9513_CR20","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1002\/sce.10106","volume":"88","author":"A Hofstein","year":"2004","unstructured":"Hofstein, A., & Lunetta, V. N. (2004). The laboratory in science education: Foundations for the twenty-first century. Science Education, 88(1), 28\u201354","journal-title":"Science Education"},{"key":"9513_CR21","doi-asserted-by":"publisher","first-page":"941","DOI":"10.1002\/(SICI)1098-2736(199611)33:9<941::AID-TEA1>3.0.CO;2-V","volume":"33","author":"K Hogan","year":"1996","unstructured":"Hogan, K., & Fishkeller, J. (1996). Representing students\u2019 thinking about nutrient cycling in ecosystems: Bi-dimensional coding of a complex topic. Journal of Research in Science Teaching, 33, 941\u2013970","journal-title":"Journal of Research in Science Teaching"},{"key":"9513_CR22","unstructured":"Horwitz, P., Lord, T., & Reichsman, F. (2020). Students learn genetics with Geniventure. @Concord 24(2)."},{"issue":"1","key":"9513_CR23","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1177\/1555412009351264","volume":"5","author":"YB Kafai","year":"2010","unstructured":"Kafai, Y. B. (2010). World of Whyville: An introduction to tween virtual life. Games and Culture, 5(1), 3\u201322","journal-title":"Games and Culture"},{"key":"9513_CR50","doi-asserted-by":"crossref","unstructured":"Kamarainen, A. M., & Grotzer, T. A. (2019). Constructing causal understanding in complex systems: Epistemic strategies used by ecosystem scientists. BioScience, 69(7), 533\u2013543.","DOI":"10.1093\/biosci\/biz053"},{"key":"9513_CR24","unstructured":"Ketelhut, D. J., Nelson, B., Bergey, B., & Ryu, M. (2014). Design and gender in immersive learning environments. In C. Busch (Ed.), Proceedings of the European Conference on Games-based Learning (pp. 265\u2013271). Dechema."},{"issue":"2","key":"9513_CR25","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1207\/s15326985ep4102_1","volume":"41","author":"PA Kirschner","year":"2006","unstructured":"Kirschner, P. A., Sweller, J., & Clark, R. E. (2006). Why minimal guidance during instruction does not work: An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching. Educational Psychologist, 41(2), 75\u201386. https:\/\/doi.org\/10.1207\/s15326985ep4102_1","journal-title":"Educational Psychologist"},{"issue":"6","key":"9513_CR26","doi-asserted-by":"publisher","first-page":"708","DOI":"10.1016\/j.learninstruc.2007.09.021","volume":"17","author":"I Kollar","year":"2007","unstructured":"Kollar, I., Fischer, F., & Slotta, J. D. (2007). Internal and external scripts in computer-supported collaborative inquiry learning. Learning and Instruction, 17(6), 708\u2013721. https:\/\/doi.org\/10.1016\/j.learninstruc.2007.09.021","journal-title":"Learning and Instruction"},{"issue":"3","key":"9513_CR27","first-page":"81","volume":"37","author":"A Lamb","year":"2010","unstructured":"Lamb, A., & Johnson, L. (2010). Virtual expeditions: Google earth, GIS, and geovisualization technologies in teaching and learning. Teacher Librarian (Vancouver), 37(3), 81","journal-title":"Teacher Librarian (Vancouver)"},{"issue":"3","key":"9513_CR28","doi-asserted-by":"publisher","first-page":"681","DOI":"10.3102\/0034654315627366","volume":"86","author":"AW Lazonder","year":"2016","unstructured":"Lazonder, A. W., & Harmsen, R. (2016). Meta-Analysis of Inquiry-Based Learning: Effects of Guidance. Review of Educational Research, 86(3), 681\u2013718. https:\/\/doi.org\/10.3102\/0034654315627366","journal-title":"Review of Educational Research"},{"key":"9513_CR29","doi-asserted-by":"publisher","first-page":"411","DOI":"10.1007\/s10648-008-9082-7","volume":"20","author":"SMM Loyens","year":"2008","unstructured":"Loyens, S. M. M., Magda, J., & Rikers, R. M. J. P. (2008). Self-Directed Learning in Problem-Based Learning and its Relationships with Self-Regulated Learning. Educational Psychology Review, 20, 411\u2013427. https:\/\/doi.org\/10.1007\/s10648-008-9082-7","journal-title":"Educational Psychology Review"},{"key":"9513_CR30","unstructured":"Manz, E. (2018). Designing for and analyzing productive uncertainty in science investigations. International Society of the Learning Sciences (ISLS)."},{"key":"9513_CR31","unstructured":"Massachusetts Department of Elementary and Secondary Education. (2018). School and District Profiles. Retrieved from: http:\/\/profiles.doe.mass.edu."},{"issue":"6","key":"9513_CR32","doi-asserted-by":"publisher","first-page":"475","DOI":"10.1177\/1077800410364740","volume":"16","author":"JA Maxwell","year":"2010","unstructured":"Maxwell, J. A. (2010). Using Numbers in Qualitative Research. Qualitative Inquiry, 16(6), 475\u2013482. https:\/\/doi.org\/10.1177\/1077800410364740","journal-title":"Qualitative Inquiry"},{"key":"9513_CR107","doi-asserted-by":"publisher","unstructured":"Metcalf, S., Kamarainen, A., Torres, E., Grotzer, T., & Dede, C. (2018). EcoMUVE: A case study on the affordances of MUVEs in ecosystem science education, In Y. Qian (Ed.) Integrating Multi-User Virtual Environments in Modern Classrooms (pp.1\u201325). Hershey, PA, IGI Global. https:\/\/doi.org\/10.4018\/978-1-5225-3719-9.","DOI":"10.4018\/978-1-5225-3719-9"},{"key":"9513_CR33","unstructured":"National Research Council. (2012). A framework for K-12 science education: Practices, crosscutting concepts, and core ideas. National Academies Press."},{"key":"9513_CR34","volume-title":"Next Generation Science Standards: For States, By States","author":"NGSS Lead States","year":"2013","unstructured":"NGSS Lead States. (2013). Next Generation Science Standards: For States, By States. The National Academies Press."},{"issue":"3","key":"9513_CR35","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1207\/s15327809jls1303_4","volume":"13","author":"C Quintana","year":"2004","unstructured":"Quintana, C., Reiser, B. J., Davis, E. A., Krajcik, J., Fretz, E., Duncan, R., Kyza, E., Edelson, D., & Soloway, E. (2004). A scaffolding design framework for software to support science inquiry. The Journal of the Learning Sciences, 13(3), 337\u2013386","journal-title":"The Journal of the Learning Sciences"},{"key":"9513_CR108","doi-asserted-by":"crossref","unstructured":"Reilly, C. M., Yang, S. Y., Grotzer, T. A., Joyal, J. A., & Oriol, N. E. (2019). Pedagogical moves and student thinking in technology-mediated medical problem-based learning: Supporting novice-expert shift. British Journal of Educational Technology, 50(5).","DOI":"10.1111\/bjet.12843"},{"issue":"3","key":"9513_CR36","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1207\/s15327809jls1303_2","volume":"13","author":"BJ Reiser","year":"2004","unstructured":"Reiser, B. J. (2004). Scaffolding complex learning: The mechanisms of structuring and problematizing student work. The Journal of the Learning Sciences, 13(3), 273\u2013304","journal-title":"The Journal of the Learning Sciences"},{"key":"9513_CR37","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1017\/CBO9781139519526.005","volume-title":"The Cambridge Handbook of the Learning Sciences","author":"BJ Reiser","year":"2014","unstructured":"Reiser, B. J., & Tabak, I. (2014). Scaffolding. In R. K. Sawyer (Ed.), The Cambridge Handbook of the Learning Sciences. (2nd ed., pp. 44\u201362). Cambridge University Press.","edition":"2"},{"key":"9513_CR38","doi-asserted-by":"publisher","unstructured":"Rubin, H. J., & Rubin, I. S. (2005). Qualitative interviewing (2nd ed.): The art of hearing data. Thousand Oaks, CA: SA GE Publications, Inc. DOI: https:\/\/doi.org\/10.4135\/9781452226651","DOI":"10.4135\/9781452226651"},{"key":"9513_CR39","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1017\/CBO9780511997105","volume-title":"Structure and Improvisation in Creative Teaching","author":"RK Sawyer","year":"2011","unstructured":"Sawyer, R. K. (2011). What makes good teachers great? The artful balance of structure and improvisation. In R. K. Sawyer (Ed.), Structure and Improvisation in Creative Teaching. (pp. 1\u201324). Cambridge University Press."},{"key":"9513_CR40","unstructured":"Schaller, D. T., Goldman, K.H., Spickelmier, G., Allison- Bunnell, S., & Koepfler, J. (2009). Learning in the wild: What Wolfquest taught developers and game players. Museums and the Web. http:\/\/www.archimuse.com\/ mw2009\/papers\/schaller\/schaller.html"},{"issue":"2","key":"9513_CR41","first-page":"195","volume":"10","author":"DW Shaffer","year":"1999","unstructured":"Shaffer, D. W., & Resnick, M. (1999). \u201c Thick\u201d authenticity: New media and authentic learning. Journal of Interactive Learning Research, 10(2), 195\u2013216","journal-title":"Journal of Interactive Learning Research"},{"issue":"1","key":"9513_CR42","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1007\/s10758-017-9324-1","volume":"24","author":"AA Tawfik","year":"2019","unstructured":"Tawfik, A. A., Gill, A., Hogan, M., York, C. S., & Keene, C. W. (2019). How novices use expert case libraries for problem solving. Technology, Knowledge and Learning, 24(1), 23\u201340","journal-title":"Technology, Knowledge and Learning"},{"key":"9513_CR43","unstructured":"Tutwiler, M.S., (2014). Trends in the salience of data collected in a Multi-User Virtual Environment: An exploratory study. Doctoral Dissertation, Harvard University."},{"key":"9513_CR44","doi-asserted-by":"crossref","unstructured":"Wise, A. F., & O\u2019Neill, K. (2009). Beyond more versus less: A reframing of the debate on instructional guidance. Constructivist Instruction\u00a0(pp. 94\u2013117). Routledge.","DOI":"10.4324\/9780203878842-12"}],"container-title":["Technology, Knowledge and Learning"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10758-021-09513-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10758-021-09513-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10758-021-09513-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,7,22]],"date-time":"2022-07-22T18:25:19Z","timestamp":1658514319000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10758-021-09513-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,26]]},"references-count":51,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,9]]}},"alternative-id":["9513"],"URL":"https:\/\/doi.org\/10.1007\/s10758-021-09513-6","relation":{},"ISSN":["2211-1662","2211-1670"],"issn-type":[{"type":"print","value":"2211-1662"},{"type":"electronic","value":"2211-1670"}],"subject":[],"published":{"date-parts":[[2021,4,26]]},"assertion":[{"value":"31 March 2021","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 April 2021","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}