{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T06:59:03Z","timestamp":1775199543288,"version":"3.50.1"},"reference-count":61,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2012,3,1]],"date-time":"2012-03-01T00:00:00Z","timestamp":1330560000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["325273"],"award-info":[{"award-number":["325273"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["917366"],"award-info":[{"award-number":["917366"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000181","name":"Air Force Office of Scientific Research","doi-asserted-by":"publisher","award":["FA9550-09-1-0213"],"award-info":[{"award-number":["FA9550-09-1-0213"]}],"id":[{"id":"10.13039\/100000181","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput.-Hum. Interact."],"published-print":{"date-parts":[[2012,3]]},"abstract":"<jats:p>Despite decades of research into how professional programmers debug, only recently has work emerged about how end-user programmers attempt to debug programs. Without this knowledge, we cannot build tools to adequately support their needs. This article reports the results of a detailed qualitative empirical study of end-user programmers' sensemaking about a spreadsheet's correctness. Using our study's data, we derived a sensemaking model for end-user debugging and categorized participants' activities and verbalizations according to this model, allowing us to investigate how participants went about debugging. Among the results are identification of the prevalence of information foraging during end-user debugging, two successful strategies for traversing the sensemaking model, potential ties to gender differences in the literature, sensemaking sequences leading to debugging progress, and sequences tied with troublesome points in the debugging process. The results also reveal new implications for the design of spreadsheet tools to support end-user programmers' sensemaking during debugging.<\/jats:p>","DOI":"10.1145\/2147783.2147788","type":"journal-article","created":{"date-parts":[[2012,4,10]],"date-time":"2012-04-10T12:19:26Z","timestamp":1334060366000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":52,"title":["End-user debugging strategies"],"prefix":"10.1145","volume":"19","author":[{"given":"Valentina","family":"Grigoreanu","sequence":"first","affiliation":[{"name":"Microsoft Corporation and Oregon State University, Corvallis, OR"}]},{"given":"Margaret","family":"Burnett","sequence":"additional","affiliation":[{"name":"Oregon State University, Corvallis, OR"}]},{"given":"Susan","family":"Wiedenbeck","sequence":"additional","affiliation":[{"name":"Drexel University, PA"}]},{"given":"Jill","family":"Cao","sequence":"additional","affiliation":[{"name":"Oregon State University, Corvallis, OR"}]},{"given":"Kyle","family":"Rector","sequence":"additional","affiliation":[{"name":"Oregon State University, Corvallis, OR 97331"}]},{"given":"Irwin","family":"Kwan","sequence":"additional","affiliation":[{"name":"Oregon State University, Corvallis, OR 97331"}]}],"member":"320","published-online":{"date-parts":[[2012,5,4]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2007.6"},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the European Spreadsheet Risks Interest Group","author":"Ayalew Y."},{"key":"e_1_2_1_3_1","unstructured":"Bandura A. 1986. Social Foundations of Thought and Action. Prentice Hall.  Bandura A. 1986. Social Foundations of Thought and Action. Prentice Hall."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(90)90103-9"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1054972.1055094"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124772.1124808"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2007.42"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/2.962984"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the International Conference on Software Engineering. IEEE, 93--103","author":"Burnett M."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015864.1015889"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.2190\/H7E1-XMM7-GU9B-3HWR"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/795711.799150"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.125.3.367"},{"key":"e_1_2_1_14_1","first-page":"30","article-title":"A theoretic perspective and research approach for generating research helpful to communication practice","volume":"1","author":"Dervin B.","year":"1984","journal-title":"Public Relat. Res. Educ."},{"key":"e_1_2_1_15_1","unstructured":"Dervin B. Foreman-Wernet L. and Launterbach E. Eds. 2003. Sense-Making Methodology Reader: Selected Writings of Brenda Dervin. Hampton Press Cresskill NJ 215--231.  Dervin B. Foreman-Wernet L. and Launterbach E. Eds. 2003. Sense-Making Methodology Reader: Selected Writings of Brenda Dervin. Hampton Press Cresskill NJ 215--231."},{"key":"e_1_2_1_16_1","unstructured":"EUSPRIG 2009. Spreadsheet mistakes news stories european spreadsheet risks interests group site. http:\/\/www.eusprig.org\/stories.htm.  EUSPRIG 2009. Spreadsheet mistakes news stories european spreadsheet risks interests group site. http:\/\/www.eusprig.org\/stories.htm."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1721831.1721834"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1080\/713670162"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1083231.1083242"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1056808.1057113"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1006\/jecp.1999.2532"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2006.24"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2008.4639077"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/3093119.3093133"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/903893.903933"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2008.4639057"},{"key":"e_1_2_1_27_1","volume-title":"AERA Annual Meeting, Department of Psychology","author":"Jeffries R. A.","year":"1982"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518979"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1089733.1089734"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240844"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1133265.1133293"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2006.75"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985712"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2004.47"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357261"},{"key":"e_1_2_1_36_1","unstructured":"Leedom D. K. 2001. Final report: Sensemaking symposium. http:\/\/www.dodccrp.org\/events\/2001_sensemaking_symposium\/docs\/FinalReport\/Sensemaking_Final_Report.htm.  Leedom D. K. 2001. Final report: Sensemaking symposium. http:\/\/www.dodccrp.org\/events\/2001_sensemaking_symposium\/docs\/FinalReport\/Sensemaking_Final_Report.htm."},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the 1st Workshop on Empirical Studies of Programmers on Empirical Studies of Programmers. Ablex Publishing Corporation, 80--98","author":"Littman D. C."},{"key":"e_1_2_1_38_1","volume-title":"Cognitive and Affective Responses to Advertising","author":"Meyers-Levy J."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1125451.1125472"},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the 2nd Workshop on Empirical Studies of Programmers. Ablex Publishing Corporation, 172--184","author":"Nanja N."},{"key":"e_1_2_1_41_1","doi-asserted-by":"crossref","unstructured":"Nardi B. A. 1993. A Small Matter of Programming: Perspectives on End-User Computing. MIT Press MA.   Nardi B. A. 1993. A Small Matter of Programming: Perspectives on End-User Computing. MIT Press MA.","DOI":"10.7551\/mitpress\/1020.001.0001"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1099-1123.2001.00328.x"},{"key":"e_1_2_1_43_1","unstructured":"Pane J. and Myers B. 1996 Usability issues in the design of novice programming systems Tech. rep. CMU-CS-96-132 School of Computer Science Carnegie Mellon University.  Pane J. and Myers B. 1996 Usability issues in the design of novice programming systems Tech. rep. CMU-CS-96-132 School of Computer Science Carnegie Mellon University."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.5555\/287893.287899"},{"key":"e_1_2_1_45_1","unstructured":"Panko R. and Orday N. 2005. Sarbanes-Oxley: What about all the spreadsheets&quest; In Proceedings of the European Spreadsheet Research Information Group.  Panko R. and Orday N. 2005. Sarbanes-Oxley: What about all the spreadsheets&quest; In Proceedings of the European Spreadsheet Research Information Group."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2005.40"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.106.4.643"},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of the International Conference on Intelligence Analysis.","author":"Pirolli P."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-4870(97)00026-3"},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of Symposium on Human-Centric Computing Languages and Environments. IEEE, 15--22","author":"Prabhakararao S."},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of Symposium on Human-Centric Computing Languages and Environments. IEEE. 23--30","author":"Rode J."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2007.07.005"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2007.17"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/169059.169209"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2005.34"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0020-7373(86)80075-X"},{"key":"e_1_2_1_57_1","unstructured":"Stefik M. Baldonado M. Bobrow D. Card S. Everett J. Lavendel G. Marimont D. Newman P. Russell D. and Smoliar S. 2002. The knowledge sharing challenge: The sensemaking. White paper. http:\/\/www2.parc.com\/istl\/groups\/hdi\/papers\/sensemaking-whitepaper.pdf.  Stefik M. Baldonado M. Bobrow D. Card S. Everett J. Lavendel G. Marimont D. Newman P. Russell D. and Smoliar S. 2002. The knowledge sharing challenge: The sensemaking. White paper. http:\/\/www2.parc.com\/istl\/groups\/hdi\/papers\/sensemaking-whitepaper.pdf."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357153"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1177\/0013164494054003028"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/964442.964450"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/258549.258721"}],"container-title":["ACM Transactions on Computer-Human Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2147783.2147788","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2147783.2147788","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T10:52:03Z","timestamp":1750243923000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2147783.2147788"}},"subtitle":["A sensemaking perspective"],"short-title":[],"issued":{"date-parts":[[2012,3]]},"references-count":61,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2012,3]]}},"alternative-id":["10.1145\/2147783.2147788"],"URL":"https:\/\/doi.org\/10.1145\/2147783.2147788","relation":{},"ISSN":["1073-0516","1557-7325"],"issn-type":[{"value":"1073-0516","type":"print"},{"value":"1557-7325","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,3]]},"assertion":[{"value":"2009-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2011-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2012-05-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}