{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T22:21:29Z","timestamp":1774304489148,"version":"3.50.1"},"reference-count":61,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2007,8,1]],"date-time":"2007-08-01T00:00:00Z","timestamp":1185926400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput.-Hum. Interact."],"published-print":{"date-parts":[[2007,8]]},"abstract":"<jats:p>Laboratories play a crucial role in the education of future scientists and engineers, yet there is disagreement among science and engineering educators about whether and which types of technology-enabled labs should be used. This debate could be advanced by large-scale randomized studies addressing the critical issue of whether remotely operated or simulation-based labs are as effective as the traditional hands-on lab format. The present article describes the results of a large-scale (N = 306) study comparing learning outcomes and student preferences for several different lab formats in an undergraduate engineering course. The lab formats that were evaluated included traditional hands-on labs, remotely operated labs, and simulations. Learning outcomes were assessed by a test of the specific concepts taught in each lab. These knowledge scores were as high or higher (depending on topic) after performing remote and simulated laboratories versus performing hands-on laboratories. In their responses to survey items, many students saw advantages to technology-enabled lab formats in terms of such attributes as convenience and reliability, but still expressed preference for hands-on labs. Also, differences in lab formats led to changes in group functions across the plan-experiment-analyze process: For example, students did less face-to-face work when engaged in remote or simulated laboratories, as opposed to hands-on laboratories.<\/jats:p>","DOI":"10.1145\/1275511.1275513","type":"journal-article","created":{"date-parts":[[2007,9,14]],"date-time":"2007-09-14T13:44:55Z","timestamp":1189777495000},"page":"7","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":154,"title":["Constructing reality"],"prefix":"10.1145","volume":"14","author":[{"given":"James E.","family":"Corter","sequence":"first","affiliation":[{"name":"Columbia University, New York, NY"}]},{"given":"Jeffrey V.","family":"Nickerson","sequence":"additional","affiliation":[{"name":"Stevens Institute of Technology, Hoboken, NJ"}]},{"given":"Sven K.","family":"Esche","sequence":"additional","affiliation":[{"name":"Stevens Institute of Technology, Hoboken, NJ"}]},{"given":"Constantin","family":"Chassapis","sequence":"additional","affiliation":[{"name":"Stevens Institute of Technology, Hoboken, NJ"}]},{"given":"Seongah","family":"Im","sequence":"additional","affiliation":[{"name":"Columbia University, New York, NY"}]},{"given":"Jing","family":"Ma","sequence":"additional","affiliation":[{"name":"Stevens Institute of Technology, Hoboken, NJ"}]}],"member":"320","published-online":{"date-parts":[[2007,8]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Abet. 2005. Criteria for accrediting engineering programs. http:\/\/www.abet.org\/Linked%20Documents-UPDATE\/Criteria%20and%20PP\/05-06-EAC%20Criteria.pdf.  Abet. 2005. Criteria for accrediting engineering programs. http:\/\/www.abet.org\/Linked%20Documents-UPDATE\/Criteria%20and%20PP\/05-06-EAC%20Criteria.pdf."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPWRS.2003.821020"},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the 32nd ASEE\/IEEE Frontiers in Education Conference","author":"Amigud Y.","unstructured":"Amigud , Y. , Archer , G. , Smith , J. , Szymanski , M. , and Servatius , B . 2002. Assessing the quality of web-enabled laboratories in undergraduate education . In Proceedings of the 32nd ASEE\/IEEE Frontiers in Education Conference ( Boston, MA), 12--16. Amigud, Y., Archer, G., Smith, J., Szymanski, M., and Servatius, B. 2002. Assessing the quality of web-enabled laboratories in undergraduate education. In Proceedings of the 32nd ASEE\/IEEE Frontiers in Education Conference (Boston, MA), 12--16."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/12.869333"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/268084.268160"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/587078.587110"},{"key":"e_1_2_1_7_1","unstructured":"Bransford J. D. Sherwood R. D. Hasselbring T. S. Kinzer C. K. and Williams S. M. 1990. Anchored instruction: Why we need it and how technology can help. In Cognition Education and Multimedia D. Nix and R. Sprio; eds. Erlbaum Hillsdale NJ. 115--141.  Bransford J. D. Sherwood R. D. Hasselbring T. S. Kinzer C. K. and Williams S. M. 1990. Anchored instruction: Why we need it and how technology can help. In Cognition Education and Multimedia D. Nix and R. Sprio; eds. Erlbaum Hillsdale NJ. 115--141."},{"key":"e_1_2_1_8_1","volume-title":"Similarity and Analogical Reasoning","author":"Brown A. L.","unstructured":"Brown , A. L. 1989. Similarity and Analogical Reasoning . Cambridge University Press , New York . Brown, A. L. 1989. Similarity and Analogical Reasoning. Cambridge University Press, New York."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/13.618025"},{"key":"e_1_2_1_10_1","unstructured":"Corter J. E. Nickerson J. V. Esche S. K. and Chassapis C. 2004. Remote vs. hands-on labs: Immersion learning modes and student preferences. Frontiers Edu. 17--21.  Corter J. E. Nickerson J. V. Esche S. K. and Chassapis C. 2004. Remote vs. hands-on labs: Immersion learning modes and student preferences. Frontiers Edu. 17--21."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1177\/0306312705055535"},{"key":"e_1_2_1_12_1","doi-asserted-by":"crossref","unstructured":"del Alamo J. A. Chang V. Brooks L. Mclean C. Hardison J. Mishuris G. and Hui L. 2003. MIT microelectronics weblab. In Lab on the Web : Running Real Electronics Experiments via the Internet T. A. Fjeldly and M. S. Shur Eds. John Wiley Hoboken NJ. 49--88.  del Alamo J. A. Chang V. Brooks L. Mclean C. Hardison J. Mishuris G. and Hui L. 2003. MIT microelectronics weblab. In Lab on the Web : Running Real Electronics Experiments via the Internet T. A. Fjeldly and M. S. Shur Eds. John Wiley Hoboken NJ. 49--88.","DOI":"10.1002\/0471727709.ch2"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327809jls0803&4_3"},{"key":"e_1_2_1_14_1","unstructured":"Ekstrom R. B. French J. W. and Harman H. H. 1976. Manual for Kit of Factor Referenced Cognitive Tests. Educational Testing Princeton NJ.  Ekstrom R. B. French J. W. and Harman H. H. 1976. Manual for Kit of Factor Referenced Cognitive Tests. Educational Testing Princeton NJ."},{"key":"e_1_2_1_15_1","unstructured":"Esche S. K. 2004. Remote dynamical systems laboratory website. http:\/\/dynamics.soe.stevens-tech.edu\/.  Esche S. K. 2004. Remote dynamical systems laboratory website. http:\/\/dynamics.soe.stevens-tech.edu\/."},{"key":"e_1_2_1_16_1","first-page":"4","article-title":"On the integration of remote experimentation into undergraduate laboratories---Technical implementation","volume":"32","author":"Esche S. K.","year":"2005","unstructured":"Esche , S. K. 2005 . On the integration of remote experimentation into undergraduate laboratories---Technical implementation . Int. J. Instruct. Media 32 , 4 . Esche, S. K. 2005. On the integration of remote experimentation into undergraduate laboratories---Technical implementation. Int. J. Instruct. Media 32, 4.","journal-title":"Int. J. Instruct. Media"},{"key":"e_1_2_1_17_1","first-page":"7","article-title":"An architecture for multi-user remote laboratories","volume":"2","author":"Esche S. K.","year":"2003","unstructured":"Esche , S. K. , Chassapis , C. , Nazalewicz , J. W. , and Hromin , D. J. 2003 . An architecture for multi-user remote laboratories . World Trans. Eng. Technol. Edu. 2 , 1, 7 -- 11 . Esche, S. K., Chassapis, C., Nazalewicz, J. W., and Hromin, D. J. 2003. An architecture for multi-user remote laboratories. World Trans. Eng. Technol. Edu. 2, 1, 7--11.","journal-title":"World Trans. Eng. Technol. Edu."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1080\/00219266.2002.9655826"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/2.809249"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1098-2736(199704)34:4<343::AID-TEA5>3.0.CO;2-R"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the IEEE American Control Conference, (Jun. 28--30)","author":"Gillet D.","unstructured":"Gillet , D. , Salzmann , C. , Latchman , H. A. , and Crisalle , O. D . 2000. Recent advances in remote experimentation . In Proceedings of the IEEE American Control Conference, (Jun. 28--30) , 2955--2956. Gillet, D., Salzmann, C., Latchman, H. A., and Crisalle, O. D. 2000. Recent advances in remote experimentation. In Proceedings of the IEEE American Control Conference, (Jun. 28--30), 2955--2956."},{"key":"e_1_2_1_22_1","volume-title":"Smalltalk-80: The Interactive Programming Environment","author":"Goldberg A.","unstructured":"Goldberg , A. 1984. Smalltalk-80: The Interactive Programming Environment . Addison-Wesley , Reading, MA . Goldberg, A. 1984. Smalltalk-80: The Interactive Programming Environment. Addison-Wesley, Reading, MA."},{"key":"e_1_2_1_23_1","volume-title":"Statistics for the Social Sciences","author":"Hays W. L.","unstructured":"Hays , W. L. 1973. Statistics for the Social Sciences , 2 nd ed. Holt, Rinehart , and Winston, New York . Hays, W. L. 1973. Statistics for the Social Sciences, 2nd ed. Holt, Rinehart, and Winston, New York.","edition":"2"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02558676"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the ASEE Annual Conference and Exposition (St","author":"Henry J.","year":"2000","unstructured":"Henry , J. 2000 . 24 hours, 7 days lab experiments access on the web all the time . In Proceedings of the ASEE Annual Conference and Exposition (St . Louis, MO), 1--8. Henry, J. 2000. 24 hours, 7 days lab experiments access on the web all the time. In Proceedings of the ASEE Annual Conference and Exposition (St. Louis, MO), 1--8."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00991653"},{"key":"e_1_2_1_27_1","first-page":"28","article-title":"The laboratory in science education: Foundations for the twenty-first century. Sci","volume":"88","author":"Hofstein A.","year":"2004","unstructured":"Hofstein , A. and Lunetta , V. N. 2004 . The laboratory in science education: Foundations for the twenty-first century. Sci . Edu. 88 , 1, 28 -- 54 . Hofstein, A. and Lunetta, V. N. 2004. The laboratory in science education: Foundations for the twenty-first century. Sci. Edu. 88, 1, 28--54.","journal-title":"Edu."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.3102\/00346543052002201"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TE.2003.822263"},{"key":"e_1_2_1_30_1","unstructured":"Johnson D. W. and Johnson R. 1999. Learning Together and Alone: Cooperative Competitive and Individualistic Learning. Allyn and Bacon Boston MA.  Johnson D. W. and Johnson R. 1999. Learning Together and Alone: Cooperative Competitive and Individualistic Learning. Allyn and Bacon Boston MA."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/0167-9236(95)00007-0"},{"key":"e_1_2_1_32_1","first-page":"230","article-title":"Microelectronics and the personal computer. Sci","volume":"237","author":"Kay A. C.","year":"1977","unstructured":"Kay , A. C. 1977 . Microelectronics and the personal computer. Sci . Amer. 237 , 3, 230 -- 244 . Kay, A. C. 1977. Microelectronics and the personal computer. Sci. Amer. 237, 3, 230--244.","journal-title":"Amer."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/C-M.1977.217672"},{"key":"e_1_2_1_34_1","first-page":"435","article-title":"Should we use cooperative learning in college chemistry","volume":"25","author":"Kerns T.","year":"1996","unstructured":"Kerns , T. 1996 . Should we use cooperative learning in college chemistry . J. College Sci. Teach. 25 , 6, 435 -- 438 . Kerns, T. 1996. Should we use cooperative learning in college chemistry. J. College Sci. Teach. 25, 6, 435--438.","journal-title":"J. College Sci. Teach."},{"key":"e_1_2_1_35_1","volume-title":"eds","author":"Kirshner D.","year":"1997","unstructured":"Kirshner , D. and Whitson , J. , eds . 1997 . Situated Cognition : Social, Semiotic, and Psychological Perspectives. Lawrence Erlbaum , Mahwah, NJ. Kirshner, D. and Whitson, J., eds. 1997. Situated Cognition: Social, Semiotic, and Psychological Perspectives. Lawrence Erlbaum, Mahwah, NJ."},{"key":"e_1_2_1_36_1","volume-title":"Situated Learning: Legitimate Peripheral Practice","author":"Lave J.","year":"1990","unstructured":"Lave , J. and Wenger . 1990 . Situated Learning: Legitimate Peripheral Practice . Cambridge University Press , New York . Lave, J. and Wenger. 1990. Situated Learning: Legitimate Peripheral Practice. Cambridge University Press, New York."},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of a Conference on Teaching Engineering Designers","author":"Magin D. J.","unstructured":"Magin , D. J. , Churches , A. E. , and Reizes , J. A . 1986. Design and experimentation in undergraduate mechanical engineering . In Proceedings of a Conference on Teaching Engineering Designers ( Sydney, Australia), 96--100. Magin, D. J., Churches, A. E., and Reizes, J. A. 1986. Design and experimentation in undergraduate mechanical engineering. In Proceedings of a Conference on Teaching Engineering Designers (Sydney, Australia), 96--100."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1002\/tea.20124"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1132960.1132961"},{"key":"e_1_2_1_40_1","volume-title":"Multi-Media Learning","author":"Mayer R. E.","unstructured":"Mayer , R. E. 2001. Multi-Media Learning . Cambridge University Press , New York . Mayer, R. E. 2001. Multi-Media Learning. Cambridge University Press, New York."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0737-6782(00)00073-4"},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the 33rd Annual Frontiers in Education Conference (Boulder, CO Nov.).","author":"Nedic Z.","unstructured":"Nedic , Z. , Machotka , J. , and Nafalski , A . 2003. Remote laboratories versus virtual and real laboratories . In Proceedings of the 33rd Annual Frontiers in Education Conference (Boulder, CO Nov.). Nedic, Z., Machotka, J., and Nafalski, A. 2003. Remote laboratories versus virtual and real laboratories. In Proceedings of the 33rd Annual Frontiers in Education Conference (Boulder, CO Nov.)."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2005.11.019"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1002\/j.2168-9830.2003.tb00738.x"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15327051HCI1523_4"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327809jls0303_4"},{"key":"e_1_2_1_47_1","first-page":"265","article-title":"Learning scientific concepts through material and social activities: Conversational analysis meets conceptual change. Edu","volume":"28","author":"Pea R. D.","year":"1993","unstructured":"Pea , R. D. 1993 . Learning scientific concepts through material and social activities: Conversational analysis meets conceptual change. Edu . Psychol. 28 , 3, 265 -- 277 . Pea, R. D. 1993. Learning scientific concepts through material and social activities: Conversational analysis meets conceptual change. Edu. Psychol. 28, 3, 265--277.","journal-title":"Psychol."},{"key":"e_1_2_1_48_1","volume-title":"Multiple Regression in Behavioral Research","author":"Pedhazur E. J.","unstructured":"Pedhazur , E. J. 1982. Multiple Regression in Behavioral Research , 2 nd ed. Holt, Rinehart and Winston, New York . Pedhazur, E. J. 1982. Multiple Regression in Behavioral Research, 2nd ed. Holt, Rinehart and Winston, New York.","edition":"2"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02211837"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1098-2736(199611)33:9<995::AID-TEA3>3.0.CO;2-Q"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1002\/tea.10129"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1540-5915.2001.tb00973.x"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog2004_1"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2003.12.010"},{"key":"e_1_2_1_55_1","volume-title":"Proceedings of the 35th ASEE\/IEEE Frontiers in Education Conference","author":"Sicker D. C.","unstructured":"Sicker , D. C. , Lookabaugh , T. , Santos , J. , and Barnes , F . 2005. Assessing the effectiveness of remote networking laboratories . In Proceedings of the 35th ASEE\/IEEE Frontiers in Education Conference ( Boulder, CO), 7--12. Sicker, D. C., Lookabaugh, T., Santos, J., and Barnes, F. 2005. Assessing the effectiveness of remote networking laboratories. In Proceedings of the 35th ASEE\/IEEE Frontiers in Education Conference (Boulder, CO), 7--12."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1006\/ceps.1996.0004"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/772047.772051"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1002\/tea.20134"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1098-2736(199802)35:2<145::AID-TEA5>3.0.CO;2-S"},{"key":"e_1_2_1_60_1","volume-title":"Designing Environments for Constructive Learning, T. M. Duffy et al., eds","author":"Winn W.","unstructured":"Winn , W. 1993. A constructivist critique of the assumptions of instructional design . In Designing Environments for Constructive Learning, T. M. Duffy et al., eds . Springer , Berlin , 189--212. Winn, W. 1993. A constructivist critique of the assumptions of instructional design. In Designing Environments for Constructive Learning, T. M. Duffy et al., eds. Springer, Berlin, 189--212."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1119\/1.1566427"}],"container-title":["ACM Transactions on Computer-Human Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1275511.1275513","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1275511.1275513","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T20:00:30Z","timestamp":1750276830000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1275511.1275513"}},"subtitle":["A study of remote, hands-on, and simulated laboratories"],"short-title":[],"issued":{"date-parts":[[2007,8]]},"references-count":61,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2007,8]]}},"alternative-id":["10.1145\/1275511.1275513"],"URL":"https:\/\/doi.org\/10.1145\/1275511.1275513","relation":{},"ISSN":["1073-0516","1557-7325"],"issn-type":[{"value":"1073-0516","type":"print"},{"value":"1557-7325","type":"electronic"}],"subject":[],"published":{"date-parts":[[2007,8]]},"assertion":[{"value":"2007-08-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}