{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,14]],"date-time":"2026-01-14T18:13:30Z","timestamp":1768414410913,"version":"3.49.0"},"reference-count":60,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2016,1,18]],"date-time":"2016-01-18T00:00:00Z","timestamp":1453075200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Educ."],"published-print":{"date-parts":[[2016,2,26]]},"abstract":"<jats:p>Learning to program, especially in the object-oriented paradigm, is a difficult undertaking for many students. As a result, computing educators have tried a variety of instructional methods to assist beginning programmers. These include developing approaches geared specifically toward novices and experimenting with different introductory programming languages. However, determining the effectiveness of these interventions poses a problem. The research presented here developed an instrument to assess student learning of fundamental and object-oriented programming concepts, then used that instrument to investigate the impact of different teaching approaches and languages on university students\u2019 ability to learn those concepts. Extensive data analysis showed that the instrument performed well overall. Reliability of the assessment tool was statistically satisfactory and content validity was supported by intrinsic characteristics, question response analysis, and expert review. Preliminary support for construct validity was provided through exploratory factor analysis. Three components that at least partly represented the construct \u201cunderstanding of fundamental programming concepts\u201d were identified: methods and functions, mathematical and logical expressions, and control structures. Analysis revealed significant differences in student performance based on instructional language and approach. The analyses showed differences on the overall score and questions involving assignment, mathematical and logical expressions, and code completion. Instructional language and approach did not appear to affect student performance on questions addressing object-oriented concepts.<\/jats:p>","DOI":"10.1145\/2785807","type":"journal-article","created":{"date-parts":[[2016,1,26]],"date-time":"2016-01-26T13:25:01Z","timestamp":1453814701000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":48,"title":["The Impact of Different Teaching Approaches and Languages on Student Learning of Introductory Programming Concepts"],"prefix":"10.1145","volume":"16","author":[{"given":"Wanda M.","family":"Kunkle","sequence":"first","affiliation":[{"name":"Penn State Harrisburg, Middletown, PA"}]},{"given":"Robert B.","family":"Allen","sequence":"additional","affiliation":[{"name":"Yonsei University, Seoul, Korea"}]}],"member":"320","published-online":{"date-parts":[[2016,1,18]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Retrieved","author":"Course Assessment Algebra","year":"2009"},{"key":"e_1_2_1_2_1","volume-title":"Retrieved","author":"Alice","year":"2010"},{"key":"e_1_2_1_3_1","unstructured":"Assessment Instruments and Tools. 2016. American Society for Biochemistry and Molecular Biology (ASBMB). Retrieved January 8 2016 from https:\/\/www.asbmb.org\/education\/teachingstrategies\/conceptinventory\/. Assessment Instruments and Tools. 2016. American Society for Biochemistry and Molecular Biology (ASBMB). Retrieved January 8 2016 from https:\/\/www.asbmb.org\/education\/teachingstrategies\/conceptinventory\/."},{"key":"e_1_2_1_4_1","unstructured":"L. W. Anderson D. R. Krathwohl P. W. Airasian K. A. Cruikshank R. E. Mayer P. R. Pintrich R. Raths and M. C. Wittrock (Eds.). 2001. A Taxonomy for Learning Teaching and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives. Addison Wesley Longman New York NY. L. W. Anderson D. R. Krathwohl P. W. Airasian K. A. Cruikshank R. E. Mayer P. R. Pintrich R. Raths and M. C. Wittrock (Eds.). 2001. A Taxonomy for Learning Teaching and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives. Addison Wesley Longman New York NY."},{"key":"e_1_2_1_5_1","volume-title":"Java","author":"Barnes D. J.","year":"2005"},{"key":"e_1_2_1_6_1","unstructured":"J. Bergin M. Stehlik J. Roberts and R. Pattis. 2005. Karel J Robot: A Gentle Introduction to the Art of Object-Oriented Programming in Java. Dream Songs Press. J. Bergin M. Stehlik J. Roberts and R. Pattis. 2005. Karel J Robot: A Gentle Introduction to the Art of Object-Oriented Programming in Java. Dream Songs Press."},{"key":"e_1_2_1_7_1","unstructured":"J. B. Biggs and K. F. Collis. 1982. Evaluating the Quality of Learning: The SOLO Taxonomy (Structure of the Observed Learning Outcome). Academic Press New York NY. J. B. Biggs and K. F. Collis. 1982. Evaluating the Quality of Learning: The SOLO Taxonomy (Structure of the Observed Learning Outcome). Academic Press New York NY."},{"key":"e_1_2_1_8_1","volume-title":"Retrieved","author":"J.","year":"2005"},{"key":"e_1_2_1_9_1","unstructured":"J. Bonar and E. Soloway. 1989. Preprogramming knowledge: A major source of misconceptions in novice programmers. In Studying the Novice Programmer E. Soloway and J. Spohrer (Eds.). Lawrence Erlbaum Associates Hillsdale NJ 325--353. J. Bonar and E. Soloway. 1989. Preprogramming knowledge: A major source of misconceptions in novice programmers. In Studying the Novice Programmer E. Soloway and J. Spohrer (Eds.). Lawrence Erlbaum Associates Hillsdale NJ 325--353."},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the International Conference on Frontiers in Education: Computer Science and Computer Engineering (FECS\u201912)","author":"Chen C.-L.","year":"2012"},{"key":"e_1_2_1_11_1","unstructured":"M. Clancy. 2004. Misconceptions and attitudes that interfere with learning to program. In Computer Science Education Research S. Fincher and M. Petre (Eds.). Taylor & Francis Group London UK 85--100. M. Clancy. 2004. Misconceptions and attitudes that interfere with learning to program. In Computer Science Education Research S. Fincher and M. Petre (Eds.). Taylor & Francis Group London UK 85--100."},{"key":"e_1_2_1_12_1","unstructured":"Concept Inventories. 2008. Foundation Coalition (FC). Retrieved January 8 2016 from http:\/\/www.foundationcoalition.org\/home\/keycomponents\/concept\/index.html. Concept Inventories. 2008. Foundation Coalition (FC). Retrieved January 8 2016 from http:\/\/www.foundationcoalition.org\/home\/keycomponents\/concept\/index.html."},{"key":"e_1_2_1_13_1","unstructured":"Concept Inventories for Computer Science. 2010. Retrieved December 17 2015 from http:\/\/zilles.cs.illinois.edu\/csci.html. Concept Inventories for Computer Science. 2010. Retrieved December 17 2015 from http:\/\/zilles.cs.illinois.edu\/csci.html."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/611892.611966"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1076\/csed.13.1.3.13540"},{"key":"e_1_2_1_16_1","unstructured":"CS2008 Review Taskforce. 2008. Computer Science Curriculum 2008: An Interim Revision of CS 2001. Association for Computing Machinery (ACM)\/IEEE Computer Society. http:\/\/www.acm.org\/education\/curricula\/ComputerScience2008.pdf. CS2008 Review Taskforce. 2008. Computer Science Curriculum 2008: An Interim Revision of CS 2001. Association for Computing Machinery (ACM)\/IEEE Computer Society. http:\/\/www.acm.org\/education\/curricula\/ComputerScience2008.pdf."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1113847.1113880"},{"key":"e_1_2_1_18_1","unstructured":"W. Dann S. Cooper and R. Pausch. 2006. Learning to Program with Alice. Pearson Prentice Hall Upper Saddle River NJ. W. Dann S. Cooper and R. Pausch. 2006. Learning to Program with Alice. Pearson Prentice Hall Upper Saddle River NJ."},{"key":"e_1_2_1_19_1","unstructured":"R. L. Ebel and D. A. Frisbie. 1991. Essentials of Educational Measurement. Prentice Hall Englewood Cliffs NJ. R. L. Ebel and D. A. Frisbie. 1991. Essentials of Educational Measurement. Prentice Hall Englewood Cliffs NJ."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/331795.331854"},{"key":"e_1_2_1_21_1","volume-title":"Retrieved","author":"Garson G. D.","year":"2010"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1352135.1352226"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 8th Australian Conference on Computing Education. 71--80","author":"Grandell L."},{"key":"e_1_2_1_24_1","doi-asserted-by":"crossref","unstructured":"T. M. Haladyna. 2004. Developing and Validating Multiple-Choice Test Items. Lawrence Erlbaum Associates Mahwah NJ. T. M. Haladyna. 2004. Developing and Validating Multiple-Choice Test Items. Lawrence Erlbaum Associates Mahwah NJ.","DOI":"10.4324\/9780203825945"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1734263.1734298"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1119\/1.2343497"},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the 39th ASEE\/IEEE Frontiers in Education Conference. IEEE","author":"Hoegh A."},{"key":"e_1_2_1_28_1","unstructured":"International Technology Education Association (ITEA). 2007. Standards for Technological Literacy: Content for the Study of Technology. ITEA Reston VA. International Technology Education Association (ITEA). 2007. Standards for Technological Literacy: Content for the Study of Technology. ITEA Reston VA."},{"key":"e_1_2_1_29_1","volume-title":"Retrieved","author":"Students ISTE","year":"2007"},{"key":"e_1_2_1_30_1","doi-asserted-by":"crossref","unstructured":"Joint Task Force on Computing Curricula. 2001. Computing Curricula 2001 Computer Science. IEEE Computer Society\/Association for Computing Machinery. http:\/\/www.acm.org\/education\/curric_vols\/cc2001.pdf. Joint Task Force on Computing Curricula. 2001. Computing Curricula 2001 Computer Science. IEEE Computer Society\/Association for Computing Machinery. http:\/\/www.acm.org\/education\/curric_vols\/cc2001.pdf.","DOI":"10.1145\/384274.384275"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1734263.1734299"},{"key":"e_1_2_1_32_1","unstructured":"C. M. Kessler and J. R. Anderson. 1989. Learning flow of control: Recursive and iterative procedures. In Studying the Novice Programmer E. Soloway and J. Spohrer (Eds.). Lawrence Erlbaum Associates Hillsdale NJ 229--260. C. M. Kessler and J. R. Anderson. 1989. Learning flow of control: Recursive and iterative procedures. In Studying the Novice Programmer E. Soloway and J. Spohrer (Eds.). Lawrence Erlbaum Associates Hillsdale NJ 229--260."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1076\/csed.13.4.249.17496"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02288391"},{"key":"e_1_2_1_35_1","unstructured":"W. M. Kunkle. 2010. The Impact of Different Teaching Approaches and Languages on Student Learning of Introductory Programming Concepts. Ph.D. Dissertation. Drexel University Philadelphia PA. W. M. Kunkle. 2010. The Impact of Different Teaching Approaches and Languages on Student Learning of Introductory Programming Concepts. Ph.D. Dissertation. Drexel University Philadelphia PA."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1041624.1041673"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1080\/13803610500298094"},{"key":"e_1_2_1_38_1","unstructured":"D. N. Perkins C. Hancock R. Hobbs F. Martin and R. Simmons. 1989. Conditions of learning in novice programmers. In Studying the Novice Programmer E. Soloway and J. Spohrer (Eds.). Lawrence Erlbaum Associates Hillsdale NJ 261--279. D. N. Perkins C. Hancock R. Hobbs F. Martin and R. Simmons. 1989. Conditions of learning in novice programmers. In Studying the Novice Programmer E. Soloway and J. Spohrer (Eds.). Lawrence Erlbaum Associates Hillsdale NJ 261--279."},{"key":"e_1_2_1_39_1","volume-title":"First Workshop, E. Soloway and S. Iyengar (Eds.). Ablex","author":"Perkins D. N."},{"key":"e_1_2_1_40_1","unstructured":"R. T. Putnam D. Sleeman J. A. Baxter and L. K. Kuspa. 1989. A summary of misconceptions of high-school BASIC programmers. In Studying the Novice Programmer E. Soloway and J. Spohrer (Eds.). Lawrence Erlbaum Associates Hillsdale NJ 301--314. R. T. Putnam D. Sleeman J. A. Baxter and L. K. Kuspa. 1989. A summary of misconceptions of high-school BASIC programmers. In Studying the Novice Programmer E. Soloway and J. Spohrer (Eds.). Lawrence Erlbaum Associates Hillsdale NJ 301--314."},{"key":"e_1_2_1_41_1","volume-title":"Retrieved","year":"2007"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993400500224310"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1076\/csed.13.2.137.14200"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1316450.1316453"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2016911.2016920"},{"key":"e_1_2_1_46_1","unstructured":"E. Soloway J. Bonar and K. Ehrlich. 1989. Cognitive strategies and looping constructs: An empirical study. In Studying the Novice Programmer E. Soloway and J. Spohrer (Eds.). Lawrence Erlbaum Associates Hillsdale NJ 191--207. E. Soloway J. Bonar and K. Ehrlich. 1989. Cognitive strategies and looping constructs: An empirical study. In Studying the Novice Programmer E. Soloway and J. Spohrer (Eds.). Lawrence Erlbaum Associates Hillsdale NJ 191--207."},{"key":"e_1_2_1_47_1","unstructured":"E. Soloway and J. C. Spohrer (Eds.). 1989. Studying the Novice Programmer. Lawrence Erlbaum Associates Hillsdale NJ. E. Soloway and J. C. Spohrer (Eds.). 1989. Studying the Novice Programmer. Lawrence Erlbaum Associates Hillsdale NJ."},{"key":"e_1_2_1_48_1","unstructured":"J. Sorva. 2012. Visual Program Simulation in Introductory Programming Education. Ph.D. Dissertation. Aalto University Helsinki Finland. J. Sorva. 2012. Visual Program Simulation in Introductory Programming Education. Ph.D. Dissertation. Aalto University Helsinki Finland."},{"key":"e_1_2_1_49_1","volume-title":"Retrieved","author":"Link Test","year":"2013"},{"key":"e_1_2_1_50_1","unstructured":"A. E. Tew. 2010. Assessing Fundamental Introductory Computing Concept Knowledge in a Language Independent Manner. Ph.D. Dissertation. Georgia Institute of Technology Atlanta GA. A. E. Tew. 2010. Assessing Fundamental Introductory Computing Concept Knowledge in a Language Independent Manner. Ph.D. Dissertation. Georgia Institute of Technology Atlanta GA."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/1734263.1734297"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1953163.1953200"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1089786.1089789"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2543882.2543884"},{"key":"e_1_2_1_55_1","unstructured":"V. Vainio. 2006. Opiskelijoiden Mentaaliset Mallit Ohjelmien Suorituksesta Ohjelmoinnin Peruskurssilla. Master's Thesis. University of Helsinki Helsinki Finland. V. Vainio. 2006. Opiskelijoiden Mentaaliset Mallit Ohjelmien Suorituksesta Ohjelmoinnin Peruskurssilla. Master's Thesis. University of Helsinki Helsinki Finland."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/1268784.1268835"},{"key":"e_1_2_1_57_1","volume-title":"Proceedings of the 8th Australasian Computing Education Conference (ACE\u201906)","author":"Whalley J. L."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1006\/ijhc.1999.0269"},{"key":"e_1_2_1_59_1","unstructured":"S. Zweben. 2009. Computing Degree and Enrollment Trends. Computing Research Association. Available at http:\/\/www.cra.org\/govaffairs\/blog\/archives\/CRATaulbeeReport-StudentEnrollment-07-08.pdf. S. Zweben. 2009. Computing Degree and Enrollment Trends. Computing Research Association. Available at http:\/\/www.cra.org\/govaffairs\/blog\/archives\/CRATaulbeeReport-StudentEnrollment-07-08.pdf."},{"key":"e_1_2_1_60_1","unstructured":"S. Zweben. 2013. Computing Degree and Enrollment Trends. Available at http:\/\/cra.org\/govaffairs\/blog\/wp-content\/uploads\/2013\/03\/CRA_Taulbee_CS_Degrees_and_Enrollment_2011-12.pdf. S. Zweben. 2013. Computing Degree and Enrollment Trends. Available at http:\/\/cra.org\/govaffairs\/blog\/wp-content\/uploads\/2013\/03\/CRA_Taulbee_CS_Degrees_and_Enrollment_2011-12.pdf."}],"container-title":["ACM Transactions on Computing Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2785807","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2785807","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T05:07:10Z","timestamp":1750223230000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2785807"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,1,18]]},"references-count":60,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2016,2,26]]}},"alternative-id":["10.1145\/2785807"],"URL":"https:\/\/doi.org\/10.1145\/2785807","relation":{},"ISSN":["1946-6226"],"issn-type":[{"value":"1946-6226","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,1,18]]},"assertion":[{"value":"2012-09-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-05-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-01-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}