{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T03:39:14Z","timestamp":1777606754029,"version":"3.51.4"},"reference-count":65,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2012,3,1]],"date-time":"2012-03-01T00:00:00Z","timestamp":1330560000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000172","name":"Division of Undergraduate Education","doi-asserted-by":"publisher","award":["DUE-0618589DUE-0943318"],"award-info":[{"award-number":["DUE-0618589DUE-0943318"]}],"id":[{"id":"10.13039\/100000172","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Educ."],"published-print":{"date-parts":[[2012,3]]},"abstract":"<jats:p>The ability to reason with formal logic is a foundational skill for computer scientists and computer engineers that scaffolds the abilities to design, debug, and optimize. By interviewing students about their understanding of propositional logic and their ability to translate from English specifications to Boolean expressions, we characterized common misconceptions and novice problem-solving processes of students who had recently completed a digital logic design class. We present these results and discuss their implications for instruction and the development of pedagogical assessment tools known as concept inventories.<\/jats:p>","DOI":"10.1145\/2133797.2133800","type":"journal-article","created":{"date-parts":[[2012,3,27]],"date-time":"2012-03-27T15:17:31Z","timestamp":1332861451000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":36,"title":["Describing the What and Why of Students\u2019 Difficulties in Boolean Logic"],"prefix":"10.1145","volume":"12","author":[{"given":"Geoffrey L.","family":"Herman","sequence":"first","affiliation":[{"name":"University of Illinois at Urbana--Champaign"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael C.","family":"Loui","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana--Champaign"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lisa","family":"Kaczmarczyk","sequence":"additional","affiliation":[{"name":"Educational Researcher and Consultant"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Craig","family":"Zilles","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana--Champaign"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2012,3]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/336019.336021"},{"key":"e_1_2_1_3_1","volume-title":"Investigating student difficulties with mathematical logic","author":"Almstrum V. L.","unstructured":"Almstrum , V. L. 1996. Investigating student difficulties with mathematical logic . In Teaching and Learning Formal Methods, C. N. Dean and M. G. Hinchey Eds., Academic Press , 131--160. Almstrum, V. L. 1996. Investigating student difficulties with mathematical logic. In Teaching and Learning Formal Methods, C. N. Dean and M. G. Hinchey Eds., Academic Press, 131--160."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1189215.1189182"},{"key":"e_1_2_1_5_1","unstructured":"Anderson J. R. Reder L. M. and Simon H. A. 1998. Radical constructivism and cognitive psychology. In Brookings Papers on Education Policy D. Ravitch Ed. Brookings Institution 227--255. (A more complete version is available online http:\/\/act.psy.cmu.edu\/ACT\/papers\/misapplied-abs-ja.html.) Anderson J. R. Reder L. M. and Simon H. A. 1998. Radical constructivism and cognitive psychology. In Brookings Papers on Education Policy D. Ravitch Ed. Brookings Institution 227--255. (A more complete version is available online http:\/\/act.psy.cmu.edu\/ACT\/papers\/misapplied-abs-ja.html.)"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1047344.1047354"},{"key":"e_1_2_1_7_1","unstructured":"Bransford J. D. Brown A. L. and Cocking R. R. 1999. How People Learn: Brain Mind Experience and School. National Academy Press Washington D.C. Bransford J. D. Brown A. L. and Cocking R. R. 1999. How People Learn: Brain Mind Experience and School. National Academy Press Washington D.C."},{"key":"e_1_2_1_8_1","volume-title":"Conceptual Development: Piaget\u2019s Legacy","author":"Carey S.","unstructured":"Carey , S. 1999. Sources of conceptual change . In Conceptual Development: Piaget\u2019s Legacy , E. K. Scholnick, K. Nelson, S. Gelman, and P. Miller Eds., Erlbaum , Manwah, NJ , 293--326. Carey, S. 1999. Sources of conceptual change. In Conceptual Development: Piaget\u2019s Legacy, E. K. Scholnick, K. Nelson, S. Gelman, and P. Miller Eds., Erlbaum, Manwah, NJ, 293--326."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/0010-0285(85)90014-3"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/0010-0285(86)90002-2"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog0502_2"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.2307\/748434"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1002\/tea.3660301007"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1080\/0899340042000303474"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/800176.810002"},{"key":"e_1_2_1_16_1","volume-title":"The effects of teaching an explicit unit in logic on students","author":"Deer G. W.","unstructured":"Deer , G. W. 1969. The effects of teaching an explicit unit in logic on students \u2019 ability to prove theorems in geometry. Ph.D. thesis, Florida State University . Deer, G. W. 1969. The effects of teaching an explicit unit in logic on students\u2019 ability to prove theorems in geometry. Ph.D. thesis, Florida State University."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog2806_1"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327809jls0203_3"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1080\/00029890.2003.11920029"},{"key":"e_1_2_1_20_1","volume-title":"Protocol Analysis: Verbal Reports as Data","author":"Ericsson K. A.","year":"1984","unstructured":"Ericsson , K. A. and Simon , H. A . 1984 . Protocol Analysis: Verbal Reports as Data . MIT Press , Cambridge, MA . Ericsson, K. A. and Simon, H. A. 1984. Protocol Analysis: Verbal Reports as Data. MIT Press, Cambridge, MA."},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the 33rd ASEE\/IEEE Frontiers in Education Conference (FIC\u201903)","author":"Evans D. L.","unstructured":"Evans , D. L. , Gray , G. L. , Krause , S. , Martin , J. , Midkiff , C. , Notaros , B. M. , Pavelich , M. , Roancour , D. , Reed-Rhoads , T. , Steif , P. , Streveler , R. , and Wage , K . 2003. Progress on concept inventory assessment tools . In Proceedings of the 33rd ASEE\/IEEE Frontiers in Education Conference (FIC\u201903) . Evans, D. L., Gray, G. L., Krause, S., Martin, J., Midkiff, C., Notaros, B. M., Pavelich, M., Roancour, D., Reed-Rhoads, T., Steif, P., Streveler, R., and Wage, K. 2003. Progress on concept inventory assessment tools. In Proceedings of the 33rd ASEE\/IEEE Frontiers in Education Conference (FIC\u201903)."},{"key":"e_1_2_1_22_1","doi-asserted-by":"crossref","unstructured":"Glaser B. and Strauss A. 1967. The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine Chicago IL. Glaser B. and Strauss A. 1967. The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine Chicago IL.","DOI":"10.1097\/00006199-196807000-00014"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1789934.1789935"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0020-7373(08)80005-3"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1119\/1.18809"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03197085"},{"key":"e_1_2_1_28_1","volume-title":"Research in Collegiate Mathtematics Education","author":"Harel G.","unstructured":"Harel , G. and Sowder , L . 1998. Students\u2019 proof scheme . In Research in Collegiate Mathtematics Education , Vol. III , E. Dubinsky, A. Schoenfeld, and J. Kaput Eds., American Mathematical Society, 234--283. Harel, G. and Sowder, L. 1998. Students\u2019 proof scheme. In Research in Collegiate Mathtematics Education, Vol. III, E. Dubinsky, A. Schoenfeld, and J. Kaput Eds., American Mathematical Society, 234--283."},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the 40th ASEE\/IEEE Frontiers in Education Conference (FIC\u201910)","author":"Herman G. L.","unstructured":"Herman , G. L. and Handzik , J . 2010. A preliminary pedagogical comparison study using the Digital Logic Concept Inventory . In Proceedings of the 40th ASEE\/IEEE Frontiers in Education Conference (FIC\u201910) . Herman, G. L. and Handzik, J. 2010. A preliminary pedagogical comparison study using the Digital Logic Concept Inventory. In Proceedings of the 40th ASEE\/IEEE Frontiers in Education Conference (FIC\u201910)."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1404520.1404527"},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the 39th ASEE\/IEEE Frontiers in Education Conference (FIC\u201909)","author":"Herman G. L.","unstructured":"Herman , G. L. , Zilles , C. , and Loui , M. C . 2009. Work in progress: Students\u2019 misconceptions about state in digital systems . In Proceedings of the 39th ASEE\/IEEE Frontiers in Education Conference (FIC\u201909) . Herman, G. L., Zilles, C., and Loui, M. C. 2009. Work in progress: Students\u2019 misconceptions about state in digital systems. In Proceedings of the 39th ASEE\/IEEE Frontiers in Education Conference (FIC\u201909)."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1734263.1734298"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TE.2011.2140372"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TE.2011.2104361"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the American Society for Engineering Education Annual Conference and Exposition (ASEE\u201911)","author":"Herman G. L.","unstructured":"Herman , G. L. , Zilles , C. , and Loui , M. C . 2011b. Administering a digital logic concept inventory at multiple institutions . In Proceedings of the American Society for Engineering Education Annual Conference and Exposition (ASEE\u201911) . Herman, G. L., Zilles, C., and Loui, M. C. 2011b. Administering a digital logic concept inventory at multiple institutions. In Proceedings of the American Society for Engineering Education Annual Conference and Exposition (ASEE\u201911)."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2011.611712"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1119\/1.2344278"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1119\/1.2343497"},{"key":"e_1_2_1_40_1","volume-title":"Studying the Novice Programmer","author":"Hoc J. M.","unstructured":"Hoc , J. M. 1989. Do we really have conditional statements in our brain . In Studying the Novice Programmer , E. Soloway and J. C. Spohrer Eds., Lawrence Erlbaum Associates , Hillsdale, NJ , 179--190. Hoc, J. M. 1989. Do we really have conditional statements in our brain. In Studying the Novice Programmer, E. Soloway and J. C. Spohrer Eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 179--190."},{"key":"e_1_2_1_41_1","first-page":"55","article-title":"Science teaching and pupil avoidance of logical fallacies","volume":"5","author":"Jungwirth E.","year":"1985","unstructured":"Jungwirth , E. 1985 . Science teaching and pupil avoidance of logical fallacies . South African J. Ed. 5 , 55 -- 60 . Jungwirth, E. 1985. Science teaching and pupil avoidance of logical fallacies. South African J. Ed. 5, 55--60.","journal-title":"South African J. Ed."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1080\/0263514870050106"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1080\/0263514900080203"},{"key":"e_1_2_1_45_1","volume-title":"Interviews: An Introduction to Qualitative Research Inquiry","author":"Kvale S.","year":"1996","unstructured":"Kvale , S. 1996 . Interviews: An Introduction to Qualitative Research Inquiry . Sage , Thousand Oaks, CA . Kvale, S. 1996. Interviews: An Introduction to Qualitative Research Inquiry. Sage, Thousand Oaks, CA."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1119\/1.18409"},{"key":"e_1_2_1_47_1","volume-title":"Proceedings of the American Society for Engineering Education Annual Conference and Exposition (ASEE\u201906)","author":"Longino J. T.","unstructured":"Longino , J. T. , Loui , M. C. , and Zilles , C . 2006. Student misconceptions in an introductory digital logic design course . In Proceedings of the American Society for Engineering Education Annual Conference and Exposition (ASEE\u201906) . Longino, J. T., Loui, M. C., and Zilles, C. 2006. Student misconceptions in an introductory digital logic design course. In Proceedings of the American Society for Engineering Education Annual Conference and Exposition (ASEE\u201906)."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/572133.572137"},{"key":"e_1_2_1_49_1","volume-title":"Qualitative Research: A Guide to Design and Implementation. Jossey-Bass.","author":"Merriam S. B.","year":"2009","unstructured":"Merriam , S. B. 2009 . Qualitative Research: A Guide to Design and Implementation. Jossey-Bass. Merriam, S. B. 2009. Qualitative Research: A Guide to Design and Implementation. Jossey-Bass."},{"key":"e_1_2_1_50_1","unstructured":"Miles M. B. and Huberman M. 1984. Qualitative Data Analysis: A Sourcebook of New Methods. Sage Publications Thousand Oaks CA. Miles M. B. and Huberman M. 1984. Qualitative Data Analysis: A Sourcebook of New Methods. Sage Publications Thousand Oaks CA."},{"key":"e_1_2_1_51_1","volume-title":"Rules for Reasoning","author":"Nisbett R. E.","unstructured":"Nisbett , R. E. 1993. Rules for Reasoning . Lawrence Erlbaum Associates , 1--12. Nisbett, R. E. 1993. Rules for Reasoning. Lawrence Erlbaum Associates, 1--12."},{"key":"e_1_2_1_52_1","first-page":"90","article-title":"A study of the relationship between performance in propositional logic and computer science","volume":"11","author":"Owens B. B.","year":"1996","unstructured":"Owens , B. B. and Seiler , J. 1996 . A study of the relationship between performance in propositional logic and computer science . J. Comput. Small Coll. 11 , 7, 90 -- 93 . Owens, B. B. and Seiler, J. 1996. A study of the relationship between performance in propositional logic and computer science. J. Comput. Small Coll. 11, 7, 90--93.","journal-title":"J. Comput. Small Coll."},{"key":"e_1_2_1_53_1","unstructured":"Pane J. and Myers B. 2000. Tabular and textual methods for selecting objects from a group in Institute for Software Research. Pane J. and Myers B. 2000. Tabular and textual methods for selecting objects from a group in Institute for Software Research."},{"key":"e_1_2_1_54_1","first-page":"6","article-title":"The many faces of constructivism","volume":"57","author":"Perkins D.","year":"1999","unstructured":"Perkins , D. 1999 . The many faces of constructivism . Ed. Lead. 57 , 3, 6 -- 11 . Perkins, D. 1999. The many faces of constructivism. Ed. Lead. 57, 3, 6--11.","journal-title":"Ed. Lead."},{"key":"e_1_2_1_55_1","volume-title":"Proceedings of the 1st Workshop on Empirical Studies of Programmers. E. Soloway and S. Iyengar Eds.","author":"Perkins D. N.","unstructured":"Perkins , D. N. and Martin , F . 1986. Fragile knowledge and neglected strategies in novice programmers . In Proceedings of the 1st Workshop on Empirical Studies of Programmers. E. Soloway and S. Iyengar Eds. , Norwood, NJ, 213--229. Perkins, D. N. and Martin, F. 1986. Fragile knowledge and neglected strategies in novice programmers. In Proceedings of the 1st Workshop on Empirical Studies of Programmers. E. Soloway and S. Iyengar Eds., Norwood, NJ, 213--229."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1177\/001316448904900320"},{"key":"e_1_2_1_58_1","first-page":"887","article-title":"Reasoning about logical propositions and success in science","volume":"27","author":"Piburn M. D.","year":"1990","unstructured":"Piburn , M. D. 1990 . Reasoning about logical propositions and success in science . J. Res. Sci. Ed. 27 , 9, 887 -- 900 . Piburn, M. D. 1990. Reasoning about logical propositions and success in science. J. Res. Sci. Ed. 27, 9, 887--900.","journal-title":"J. Res. Sci. Ed."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1002\/j.2168-9830.2010.tb01058.x"},{"key":"e_1_2_1_60_1","volume-title":"Handbook for Research on Mathematics Teaching and Learning","author":"Schoenfeld A. H.","unstructured":"Schoenfeld , A. H. 1992. Learning to think mathematically: Problem solving, metacognition, and sense-making in mathematics . In Handbook for Research on Mathematics Teaching and Learning . MacMillan , New York , 334--370. Schoenfeld, A. H. 1992. Learning to think mathematically: Problem solving, metacognition, and sense-making in mathematics. In Handbook for Research on Mathematics Teaching and Learning. MacMillan, New York, 334--370."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01274210"},{"key":"e_1_2_1_63_1","unstructured":"Strauss A. and Corbin J. 1998. Basics of Qualitative Research. Sage Thousand Oaks CA. Strauss A. and Corbin J. 1998. Basics of Qualitative Research . Sage Thousand Oaks CA."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/1734263.1734297"},{"key":"e_1_2_1_65_1","volume-title":"Computing Curricula","author":"The Computer Society of the Institute for Electrical and Electronic Engineers and Association for Computing Machinery. 2001.","year":"2001","unstructured":"The Computer Society of the Institute for Electrical and Electronic Engineers and Association for Computing Machinery. 2001. Computing Curricula 2001 , Computer Science Volume . http:\/\/www.sigcse.org\/cc2001\/index.html. The Computer Society of the Institute for Electrical and Electronic Engineers and Association for Computing Machinery. 2001. Computing Curricula 2001, Computer Science Volume. http:\/\/www.sigcse.org\/cc2001\/index.html."},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/1930464.1930479"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1016\/0959-4752(94)90002-7"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1016\/0010-0285(92)90018-W"},{"key":"e_1_2_1_69_1","volume-title":"New Horizons in Psychology I","author":"Wason P. C.","unstructured":"Wason , P. C. 1966. New Horizons in Psychology I . Penguin, Harmondsworth , UK. Wason, P. C. 1966. New Horizons in Psychology I. Penguin, Harmondsworth, UK."},{"key":"e_1_2_1_70_1","volume-title":"Learning from Strangers: The Art and Method of Qualitative Interview Studies","author":"Weiss R. S.","unstructured":"Weiss , R. S. 1994. Learning from Strangers: The Art and Method of Qualitative Interview Studies . The Free Press, New York , NY. Weiss, R. S. 1994. Learning from Strangers: The Art and Method of Qualitative Interview Studies. The Free Press, New York, NY."},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.2307\/748380"}],"container-title":["ACM Transactions on Computing Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2133797.2133800","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2133797.2133800","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T10:05:52Z","timestamp":1750241152000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2133797.2133800"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,3]]},"references-count":65,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2012,3]]}},"alternative-id":["10.1145\/2133797.2133800"],"URL":"https:\/\/doi.org\/10.1145\/2133797.2133800","relation":{},"ISSN":["1946-6226"],"issn-type":[{"value":"1946-6226","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,3]]},"assertion":[{"value":"2010-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2011-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2012-03-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}