{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T01:19:14Z","timestamp":1778635154902,"version":"3.51.4"},"reference-count":81,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2013,11,1]],"date-time":"2013-11-01T00:00:00Z","timestamp":1383264000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000144","name":"Division of Computer and Network Systems","doi-asserted-by":"publisher","award":["CNS-0940521"],"award-info":[{"award-number":["CNS-0940521"]}],"id":[{"id":"10.13039\/100000144","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Educ."],"published-print":{"date-parts":[[2013,11]]},"abstract":"<jats:p>Recent studies in the literature have shown that syntax remains a significant barrier to novice computer science students in the field. While this syntax barrier is known to exist, whether and how it varies across programming languages has not been carefully investigated. For this article, we conducted four empirical studies on programming language syntax as part of a larger analysis into the, so called, programming language wars. We first present two surveys conducted with students on the intuitiveness of syntax, which we used to garner formative clues on what words and symbols might be easy for novices to understand. We followed up with two studies on the accuracy rates of novices using a total of six programming languages: Ruby, Java, Perl, Python, Randomo, and Quorum. Randomo was designed by randomly choosing some keywords from the ASCII table (a metaphorical placebo). To our surprise, we found that languages using a more traditional C-style syntax (both Perl and Java) did not afford accuracy rates significantly higher than a language with randomly generated keywords, but that languages which deviate (Quorum, Python, and Ruby) did. These results, including the specifics of syntax that are particularly problematic for novices, may help teachers of introductory programming courses in choosing appropriate first languages and in helping students to overcome the challenges they face with syntax.<\/jats:p>","DOI":"10.1145\/2534973","type":"journal-article","created":{"date-parts":[[2013,11,15]],"date-time":"2013-11-15T19:22:39Z","timestamp":1384543359000},"page":"1-40","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":196,"title":["An Empirical Investigation into Programming Language Syntax"],"prefix":"10.1145","volume":"13","author":[{"given":"Andreas","family":"Stefik","sequence":"first","affiliation":[{"name":"University of Nevada, Las Vegas"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Susanna","family":"Siebert","sequence":"additional","affiliation":[{"name":"The Genome Institute, Washington University School of Medicine"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2013,11]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1083431.1083474"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2004.49"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1352135.1352287"},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the IEEE 17th International Conference on Program Comprehension (ICPC\u201909)","author":"Binkley D."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/567067.567069"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/646147.679038"},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the IEEE Workshop on Visual Languages (VL\u201991)","author":"Brown M. H."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-008-9095-3"},{"key":"e_1_2_1_9_1","first-page":"25","article-title":"Strategic software development: Productivity comparisons of general development programs","volume":"34","author":"Comstock C.","year":"2007","journal-title":"World Acad. Sci. Eng. Tech."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1868358.1868362"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2157136.2157180"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/WPC.2005.14"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/FLOSS.2007.5"},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the Psychology of Programming Interest Group Conference (PPIG","author":"Delorey D. P.","year":"2009"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2325296.2325318"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1999747.1999807"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2003.1214329"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1734263.1734437"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1508865.1508907"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPC.2011.46"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the IEEE 20th International Conference on Program Comprehension (ICPC\u201912)","author":"Feigenspan J."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0956796801004208"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1822090.1822138"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1006\/jvlc.1996.0009"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1869459.1869462"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1869459.1869536"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ESEM.2009.5316028"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1067445.1067498"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/53580.53581"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/359581.359586"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1297846.1297957"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/SCAM.2007.31"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.84.2.289"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1592440.1592442"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1353\/bhm.1998.0159"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1089733.1089734"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/242224.242420"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the IEEE 20th International Conference on Program Comprehension (ICPC\u201912)","author":"Kleinschmager S."},{"key":"e_1_2_1_39_1","doi-asserted-by":"crossref","volume-title":"An Easy Guide to Factor Analysis","author":"Kline P.","DOI":"10.4324\/9781315788135"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518942"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1922649.1922658"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/949344.949367"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1044550.1041673"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/949344.949400"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/800194.805908"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/1868358.1868363"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1937117.1937124"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2384616.2384666"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/266399.266414"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2384592.2384597"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015864.1015888"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1370847.1370854"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1006\/ijhc.2000.0410"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/1352135.1352137"},{"key":"e_1_2_1_56_1","volume-title":"Empirical Studies of Programmers: Second Workshop, G. M. Olson, S. Sheppard, E. Soloway, and B. Shneiderman Eds., Greenwood Publishing Group Inc., 100--113","author":"Pennington N.","year":"1987"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1016\/0010-0285(87)90007-7"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1857983"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/1297027.1297067"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/266399.266411"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/1592761.1592779"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/1837853.1693462"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/1056808.1057018"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/1089786.1089800"},{"key":"e_1_2_1_65_1","unstructured":"Science House of Commons and Technology Committee. 2010. Evidence check 2: Homeopathy fourth report of session 2009-10. http:\/\/www.publications.parliament.uk\/pa\/cm200910\/cmselect\/cmsctech\/45\/45.pdf.  Science House of Commons and Technology Committee. 2010. Evidence check 2: Homeopathy fourth report of session 2009-10. http:\/\/www.publications.parliament.uk\/pa\/cm200910\/cmselect\/cmsctech\/45\/45.pdf."},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/1028630.1028654"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/182.358436"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPC.2007.42"},{"key":"e_1_2_1_70_1","volume-title":"Proceedings of the 17th IEEE International Conference on Program Comprehension (ICPC\u201909)","author":"Stefik A."},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11219-010-9106-7"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2011.07.002"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/1953163.1953323"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/2089155.2089159"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/1167473.1167514"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2007.92"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/1453101.1453117"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00116442"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/358746.358755"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/1953163.1953200"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0953-5438(02)00026-7"},{"key":"e_1_2_1_82_1","volume-title":"Quantitative Research Methods for Professionals in Education and Other Fields","author":"Vogt W. P.","edition":"1"},{"key":"e_1_2_1_83_1","volume-title":"The Psychology of Language","author":"Whitney P."}],"container-title":["ACM Transactions on Computing Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2534973","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2534973","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T20:14:20Z","timestamp":1750277660000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2534973"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,11]]},"references-count":81,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2013,11]]}},"alternative-id":["10.1145\/2534973"],"URL":"https:\/\/doi.org\/10.1145\/2534973","relation":{},"ISSN":["1946-6226"],"issn-type":[{"value":"1946-6226","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,11]]},"assertion":[{"value":"2013-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2013-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2013-11-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}