{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T04:30:53Z","timestamp":1773030653616,"version":"3.50.1"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2006,6,26]],"date-time":"2006-06-26T00:00:00Z","timestamp":1151280000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGCSE Bull."],"published-print":{"date-parts":[[2006,12]]},"abstract":"<jats:p>This report describes concept inventories, specialized assessment instruments that enable educational researchers to investigate student (mis)understandings of concepts in a particular domain. While students experience a concept inventory as a set of multiple-choice items taken as a test, this belies its purpose, its careful development, and its validation. A concept inventory is not intended to be a comprehensive instrument, but rather a tool that probes student comprehension of a carefully selected subset of concepts that give rise to the most common and pervasive mismodelings. The report explains how concept inventories have been developed and used in other STEM fields, then outlines a project to explore the feasibility of concept inventories in the computing field. We use the domain of discrete mathematics to illustrate a suggested plan of action.<\/jats:p>","DOI":"10.1145\/1189136.1189182","type":"journal-article","created":{"date-parts":[[2007,1,17]],"date-time":"2007-01-17T18:32:02Z","timestamp":1169058722000},"page":"132-145","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":38,"title":["Concept inventories in computer science for the topic discrete mathematics"],"prefix":"10.1145","volume":"38","author":[{"given":"Vicki L.","family":"Almstrum","sequence":"first","affiliation":[{"name":"The University of Texas at Austin, Austin, TX"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter B.","family":"Henderson","sequence":"additional","affiliation":[{"name":"Butler University, Indianapolis, IN"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Valerie","family":"Harvey","sequence":"additional","affiliation":[{"name":"Robert Morris University, Moon Township, PA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cinda","family":"Heeren","sequence":"additional","affiliation":[{"name":"University of Illinois, Urbana, IL"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"William","family":"Marion","sequence":"additional","affiliation":[{"name":"Valparaiso University, Valparaiso, IN"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Charles","family":"Riedesel","sequence":"additional","affiliation":[{"name":"University of Nebraska - Lincoln, Lincoln, NE"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Leen-Kiat","family":"Soh","sequence":"additional","affiliation":[{"name":"University of Nebraska - Lincoln, Lincoln, NE"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Allison Elliott","family":"Tew","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2006,6,26]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"105","article-title":"A comparison of the difficulty, reliability and validity of complex multiple choice, multiple response and multiple true-false items","volume":"16","author":"Albanese M. A.","year":"1977","unstructured":"Albanese , M. A. , Kent , T. H. , & Whitney , D. R. ( 1977 ). A comparison of the difficulty, reliability and validity of complex multiple choice, multiple response and multiple true-false items ,\" Annual Conference on Research in Medical Education. 16 : 105 -- 110 . Albanese, M. A., Kent, T. H., & Whitney, D. R. (1977). A comparison of the difficulty, reliability and validity of complex multiple choice, multiple response and multiple true-false items,\" Annual Conference on Research in Medical Education. 16:105--110.","journal-title":"Annual Conference on Research in Medical Education."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1121341.1121402"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/971300.971367"},{"key":"e_1_2_1_4_1","volume-title":"Mind, Experience, and School (expanded edition). Washington","author":"Bransford J. D.","year":"2000","unstructured":"Bransford , J. D. , Brown , A. L. , & Cocking , R. R. ( 2000 ). How People Learn: Brain , Mind, Experience, and School (expanded edition). Washington , D.C. : National Academy Press . Bransford, J. D., Brown, A. L., & Cocking, R. R. (2000). How People Learn: Brain, Mind, Experience, and School (expanded edition). Washington, D.C.: National Academy Press."},{"key":"e_1_2_1_5_1","volume-title":"Knowing What Students Know: The Science and Design of Educational Assessment","author":"Center for Education","year":"2001","unstructured":"Center for Education ( 2001 ). Knowing What Students Know: The Science and Design of Educational Assessment . The National Academies Press . Available: www.nap.edu\/books\/0309072727\/html\/ Center for Education (2001). Knowing What Students Know: The Science and Design of Educational Assessment. The National Academies Press. Available: www.nap.edu\/books\/0309072727\/html\/"},{"key":"e_1_2_1_6_1","volume-title":"Developing an Outcomes Assessment Instrument for Identifying Engineering Student Misconceptions in Thermal and Transport Sciences. (NSF DUE - 0127806) {July 19","author":"Colorado School","year":"2006","unstructured":"Colorado School of Mines ( 2006 ). Developing an Outcomes Assessment Instrument for Identifying Engineering Student Misconceptions in Thermal and Transport Sciences. (NSF DUE - 0127806) {July 19 , 2006}. Available: www.mines.edu\/research\/cee\/Misconceptions.html Colorado School of Mines (2006). Developing an Outcomes Assessment Instrument for Identifying Engineering Student Misconceptions in Thermal and Transport Sciences. (NSF DUE - 0127806) {July 19, 2006}. Available: www.mines.edu\/research\/cee\/Misconceptions.html"},{"key":"e_1_2_1_7_1","volume-title":"Bioliteracy Project Home Page","author":"Doxas I.","year":"2006","unstructured":"Doxas , I. , Garvin-Doxas , K. , & Klymkowsky , M. W. ( 2006 ) Bioliteracy Project Home Page . July 2, 2006 {July 23, 2006}. Available: bioliteracy.net\/. Doxas, I., Garvin-Doxas, K., & Klymkowsky, M. W. (2006) Bioliteracy Project Home Page. July 2, 2006 {July 23, 2006}. Available: bioliteracy.net\/."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1080\/00029890.2003.11920029"},{"key":"e_1_2_1_9_1","volume-title":"Discrete Mathematics with Applications","author":"Epp S.","year":"2004","unstructured":"Epp , S. ( 2004 ). Discrete Mathematics with Applications , 3 rd Edition, Brooks\/Cole Publishing . Epp, S. (2004). Discrete Mathematics with Applications, 3rd Edition, Brooks\/Cole Publishing.","edition":"3"},{"key":"e_1_2_1_10_1","volume-title":"Protocol Analysis: Verbal Reports as Data","author":"Ericsson K. A.","year":"1984","unstructured":"Ericsson , K. A. & Simon , H. A. ( 1984 ). Protocol Analysis: Verbal Reports as Data , Cambridge, MA : MIT Press . Ericsson, K. A. & Simon, H. A. (1984). Protocol Analysis: Verbal Reports as Data, Cambridge, MA: MIT Press."},{"key":"e_1_2_1_11_1","first-page":"1","volume-title":"FIE'2003: Proceedings of the 33rd Annual Frontiers in Education","author":"Evans D. L.","year":"2003","unstructured":"Evans , D. L. , moderator ( 2003 ). Panel session: Progress on concept inventory assessment tools , FIE'2003: Proceedings of the 33rd Annual Frontiers in Education , pp. 1 -- 8 . Evans, D. L., moderator (2003). Panel session: Progress on concept inventory assessment tools, FIE'2003: Proceedings of the 33rd Annual Frontiers in Education, pp. 1--8."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1119\/1.1474140"},{"key":"e_1_2_1_13_1","volume-title":"The Foundation Coalition Home Page. {July 27","author":"The Foundation Coalition","year":"2006","unstructured":"The Foundation Coalition . ( 2006 ). The Foundation Coalition Home Page. {July 27 , 2006}. Available: www.foundationcoalition.org\/ The Foundation Coalition. (2006). The Foundation Coalition Home Page. {July 27, 2006}. Available: www.foundationcoalition.org\/"},{"key":"e_1_2_1_14_1","volume-title":"NJ: Prentice-Hall","author":"Gay L. R.","year":"2000","unstructured":"Gay , L. R. & Airasian , P. ( 2000 ). Educational Research : Competencies for Analysis and Application, 6 th Edition, Upper Saddle River , NJ: Prentice-Hall , Inc . Gay, L. R. & Airasian, P. (2000). Educational Research: Competencies for Analysis and Application, 6th Edition, Upper Saddle River, NJ: Prentice-Hall, Inc.","edition":"6"},{"key":"e_1_2_1_15_1","volume-title":"Mathematical Structures for Computer Science","author":"Gersting J.","year":"2007","unstructured":"Gersting , J. ( 2007 ). Mathematical Structures for Computer Science , 6 th Edition, W. H. Freeman Publishing . Gersting, J. (2007). Mathematical Structures for Computer Science, 6th Edition, W. H. Freeman Publishing.","edition":"6"},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the 2003 American Society for Engineering Education Annual Conference and Exposition","author":"Gray G. L.","year":"2003","unstructured":"Gray , G. L. , Evans , D. , Cornwell , P. , Costanzo , F. & Self , B. ( 2003 ). Towards a nationwide dynamics concept inventory assessment test , Proceedings of the 2003 American Society for Engineering Education Annual Conference and Exposition , Nashville, TN. Gray, G. L., Evans, D., Cornwell, P., Costanzo, F. & Self, B. (2003). Towards a nationwide dynamics concept inventory assessment test, Proceedings of the 2003 American Society for Engineering Education Annual Conference and Exposition, Nashville, TN."},{"key":"e_1_2_1_17_1","volume-title":"Measurement and Evaluation in Teaching","author":"Gronlund N. E.","year":"1990","unstructured":"Gronlund , N. E. & Linn , R. L. ( 1990 ). Measurement and Evaluation in Teaching , Sixth Edition, New York, NY : Macmillan Publishing Company . Gronlund, N. E. & Linn, R. L. (1990). Measurement and Evaluation in Teaching, Sixth Edition, New York, NY: Macmillan Publishing Company."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1119\/1.18809"},{"key":"e_1_2_1_19_1","doi-asserted-by":"crossref","DOI":"10.4324\/9780203825945","volume-title":"Developing and Validating Multiple-Choice Test Items","author":"Haladyna T. M.","year":"2004","unstructured":"Haladyna , T. M. ( 2004 ). Developing and Validating Multiple-Choice Test Items , 3 rd Edition, Mahwah, NJ : Lawrence Erlbaum Associates , Inc. Haladyna, T. M. (2004). Developing and Validating Multiple-Choice Test Items, 3rd Edition, Mahwah, NJ: Lawrence Erlbaum Associates, Inc.","edition":"3"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1119\/1.14031"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1119\/1.14030"},{"key":"e_1_2_1_22_1","volume-title":"Circuits Concept Inventory","author":"Helgeland B.","year":"2003","unstructured":"Helgeland , B. & Rancour , D. ( 2003 ). Circuits Concept Inventory , The Foundation Coalition , {July 19, 2006}. Available: www.foundationcoalition.org\/home\/keycomponents\/concept\/circuits.html Helgeland, B. & Rancour, D. (2003). Circuits Concept Inventory, The Foundation Coalition, {July 19, 2006}. Available: www.foundationcoalition.org\/home\/keycomponents\/concept\/circuits.html"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1119\/1.2343497"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1089786.1089791"},{"key":"e_1_2_1_25_1","volume-title":"Private Communication. September 6","author":"Jackson J.","year":"2006","unstructured":"Jackson , J. ( 2006 ). Private Communication. September 6 . Jackson, J. (2006). Private Communication. September 6."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.2003.1263338"},{"key":"e_1_2_1_27_1","volume-title":"Computing Curricula","author":"Joint Task Force on Computing Curricula","year":"2001","unstructured":"Joint Task Force on Computing Curricula , Computing Curricula 2001 , Journal on Educational Resources in Computing, 1(3es), ACM Press , New York, NY. Joint Task Force on Computing Curricula, Computing Curricula 2001, Journal on Educational Resources in Computing, 1(3es), ACM Press, New York, NY."},{"key":"e_1_2_1_28_1","volume-title":"Collaborative Research: Discrete Mathematics in Computing Education","author":"Klappholz A. D.","year":"2006","unstructured":"Klappholz , A. D. and Almstrum , V. L . ( 2006 ). Collaborative Research: Discrete Mathematics in Computing Education . National Science Foundation . Available: www.nsf.gov\/awardsearch\/showAward.do? AwardNumber=0536270 Klappholz, A. D. and Almstrum, V. L. (2006). Collaborative Research: Discrete Mathematics in Computing Education. National Science Foundation. Available: www.nsf.gov\/awardsearch\/showAward.do? AwardNumber=0536270"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.52.1.57"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.2003.1263337"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.2004.1408473"},{"key":"e_1_2_1_32_1","volume-title":"Inter Views: An Introduction to Qualitative Research Interviewing","author":"Kvale S.","year":"1996","unstructured":"Kvale , S. ( 1996 ). Inter Views: An Introduction to Qualitative Research Interviewing . Thousand Oaks, CA : Sage . Kvale, S. (1996). Inter Views: An Introduction to Qualitative Research Interviewing. Thousand Oaks, CA: Sage."},{"key":"e_1_2_1_33_1","volume":"24","author":"Lewis M.","year":"1999","unstructured":"Lewis , M. ( 1999 ). Focus Group Interviews in Qualitative Research: A Review of the Literature . August 24 , 1999 {July 19, 2006}. Available: www.scu.edu.au\/schools\/gcm\/ar\/arr\/arow\/rlewis.html Lewis, M. (1999). Focus Group Interviews in Qualitative Research: A Review of the Literature. August 24, 1999 {July 19, 2006}. Available: www.scu.edu.au\/schools\/gcm\/ar\/arr\/arow\/rlewis.html","journal-title":"Focus Group Interviews in Qualitative Research: A Review of the Literature"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.2004.1408578"},{"key":"e_1_2_1_36_1","volume-title":"Peer Instruction: A User's Manual","author":"Mazur E.","year":"1997","unstructured":"Mazur , E. ( 1997 ). Peer Instruction: A User's Manual , Prentice Hall . Mazur, E. (1997). Peer Instruction: A User's Manual, Prentice Hall."},{"key":"e_1_2_1_37_1","first-page":"2006","volume":"23","author":"Michel H.","year":"2006","unstructured":"Michel , H. , Jackson , J. , Fortier , P. , & Liu , H. ( 2006 ). Computer Engineering Concept Inventory. The Foundation Coalition . July 23 , 2006 . Available: www.foundationcoalition.org\/home\/keycomponents\/concept\/computer.html Michel, H., Jackson, J., Fortier, P., & Liu, H. (2006). Computer Engineering Concept Inventory. The Foundation Coalition. July 23, 2006. Available: www.foundationcoalition.org\/home\/keycomponents\/concept\/computer.html","journal-title":"Computer Engineering Concept Inventory. The Foundation Coalition"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.5555\/1253531.1254646"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/330908.331829"},{"key":"e_1_2_1_40_1","volume-title":"Committee on Undergraduate Science Education","author":"National Research Council","year":"1997","unstructured":"National Research Council , Committee on Undergraduate Science Education ( 1997 ). Science Teaching Reconsidered : A Handbook, Washington, D.C. : National Academy Press . National Research Council, Committee on Undergraduate Science Education (1997). Science Teaching Reconsidered: A Handbook, Washington, D.C.: National Academy Press."},{"key":"e_1_2_1_41_1","volume-title":"Mental Models","author":"Norman D. A.","year":"1983","unstructured":"Norman , D. A. ( 1983 ). Some Observations on Mental Models . In Gentner, D. R., Stevens, A. L. (Eds.) Mental Models . Lawrence Erlbaum Associates . Norman, D. A. (1983). Some Observations on Mental Models. In Gentner, D. R., Stevens, A. L. (Eds.) Mental Models. Lawrence Erlbaum Associates."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/APS.2002.1016436"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.2003.1263342"},{"key":"e_1_2_1_44_1","volume-title":"Technology, Engineering and Mathematics (STEM) Education. Available: www.aaas.org\/publications\/books_reports\/CCLI\/PDFs\/02_AER_Richardson.pdf","author":"Richardson J.","year":"2004","unstructured":"Richardson , J. ( 2004 ) Concept Inventories: Tools for uncovering STEM students' misconceptions. Invention and Impact: Building Excellence in Undergraduate Science , Technology, Engineering and Mathematics (STEM) Education. Available: www.aaas.org\/publications\/books_reports\/CCLI\/PDFs\/02_AER_Richardson.pdf Richardson, J. (2004) Concept Inventories: Tools for uncovering STEM students' misconceptions. Invention and Impact: Building Excellence in Undergraduate Science, Technology, Engineering and Mathematics (STEM) Education. Available: www.aaas.org\/publications\/books_reports\/CCLI\/PDFs\/02_AER_Richardson.pdf"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.1998.738761"},{"key":"e_1_2_1_46_1","volume-title":"Discrete Mathematics and Its Applications Student Solutions Guide","author":"Rosen K.","year":"2003","unstructured":"Rosen , K. ( 2003 ). Common Mistakes in Discrete Math . In Discrete Mathematics and Its Applications Student Solutions Guide , McGraw Hill Publishing . Available: www.mhhe.com\/math\/advmath\/rosen\/r5\/student\/mistakes .html Rosen, K. (2003). Common Mistakes in Discrete Math. In Discrete Mathematics and Its Applications Student Solutions Guide, McGraw Hill Publishing. Available: www.mhhe.com\/math\/advmath\/rosen\/r5\/student\/mistakes .html"},{"key":"e_1_2_1_47_1","volume-title":"Discrete Mathematics and Its Applications","author":"Rosen K.","year":"2007","unstructured":"Rosen , K. ( 2007 ). Discrete Mathematics and Its Applications , 6 th Edition, McGraw Hill Publishing . Rosen, K. (2007). Discrete Mathematics and Its Applications, 6th Edition, McGraw Hill Publishing.","edition":"6"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1140124.1140169"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.2003.1263336"},{"key":"e_1_2_1_50_1","volume-title":"Glossary of Assessment Terms. {July 27","author":"The Teaching Resources Compendium","year":"2002","unstructured":"The Teaching Resources Compendium for Higher Education ( 2002 ). Glossary of Assessment Terms. {July 27 , 2006}. Available: www.lmuaut.demon.co.uk\/trc\/edissues\/assgloss.htm The Teaching Resources Compendium for Higher Education (2002). Glossary of Assessment Terms. {July 27, 2006}. Available: www.lmuaut.demon.co.uk\/trc\/edissues\/assgloss.htm"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.5555\/1253531.1254645"},{"key":"e_1_2_1_52_1","unstructured":"Wikipedia \"Assessment\" July 10 2006 {July 19 2006}. Available: en.wikipedia.org\/wiki\/Assessment  Wikipedia \"Assessment\" July 10 2006 {July 19 2006}. Available: en.wikipedia.org\/wiki\/Assessment"},{"key":"e_1_2_1_53_1","unstructured":"Wikipedia \"Concept Inventory\" July 1 2006 {July 19 2006}. Available: en.wikipedia.org\/wiki\/Concept_inventory  Wikipedia \"Concept Inventory\" July 1 2006 {July 19 2006}. Available: en.wikipedia.org\/wiki\/Concept_inventory"},{"key":"e_1_2_1_54_1","unstructured":"Working Group on Integrating Mathematical Reasoning into Computer Science Curricula. {July 26 2006}. Available: www.math-in-cs.org\/  Working Group on Integrating Mathematical Reasoning into Computer Science Curricula. {July 26 2006}. Available: www.math-in-cs.org\/"},{"issue":"5","key":"e_1_2_1_55_1","first-page":"306","article-title":"Changing the culture of undergraduate science teaching","volume":"30","author":"Wyckoff S.","year":"2001","unstructured":"Wyckoff , S. ( 2001 ). Changing the culture of undergraduate science teaching . Journal of College Science Teaching. 30 ( 5 ), 306 -- 312 . Wyckoff, S. (2001). Changing the culture of undergraduate science teaching. Journal of College Science Teaching. 30(5), 306--312.","journal-title":"Journal of College Science Teaching."},{"key":"e_1_2_1_56_1","volume-title":"Proceedings of the 2006 ASEE Annual Conference and Exposition","author":"Zilles C.","year":"2006","unstructured":"Zilles , C. , Longino , J. , and Loui , M . ( 2006 ). Student misconceptions in an introductory digital logic design course . Proceedings of the 2006 ASEE Annual Conference and Exposition , Chicago, IL., June 18--21 , 2006, CD-ROM. Zilles, C., Longino, J., and Loui, M. (2006). Student misconceptions in an introductory digital logic design course. Proceedings of the 2006 ASEE Annual Conference and Exposition, Chicago, IL., June 18--21, 2006, CD-ROM."}],"container-title":["ACM SIGCSE Bulletin"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1189136.1189182","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1189136.1189182","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T15:06:21Z","timestamp":1750259181000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1189136.1189182"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2006,6,26]]},"references-count":55,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2006,12]]}},"alternative-id":["10.1145\/1189136.1189182"],"URL":"https:\/\/doi.org\/10.1145\/1189136.1189182","relation":{"is-identical-to":[{"id-type":"doi","id":"10.1145\/1189215.1189182","asserted-by":"subject"}]},"ISSN":["0097-8418"],"issn-type":[{"value":"0097-8418","type":"print"}],"subject":[],"published":{"date-parts":[[2006,6,26]]},"assertion":[{"value":"2006-06-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}