{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,23]],"date-time":"2026-08-23T11:21:12Z","timestamp":1787484072525,"version":"build-2736575974"},"reference-count":51,"publisher":"Association for Computing Machinery (ACM)","issue":"FSE","license":[{"start":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:00:00Z","timestamp":1750291200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"funder":[{"DOI":"10.13039\/501100000781","name":"European Research Council","doi-asserted-by":"publisher","award":["101052182"],"award-info":[{"award-number":["101052182"]}],"id":[{"id":"10.13039\/501100000781","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["390696704, 390729961, 389792660, SI 2171\/3-1, SI 2171\/2-2, AP 206\/11-1, AP 206\/11-2"],"award-info":[{"award-number":["390696704, 390729961, 389792660, SI 2171\/3-1, SI 2171\/2-2, AP 206\/11-1, AP 206\/11-2"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"name":"German Federal Ministry of Education and Research","award":["ScaDS.AI"],"award-info":[{"award-number":["ScaDS.AI"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Softw. Eng."],"published-print":{"date-parts":[[2025,6,19]]},"abstract":"<jats:p>Debugging performance bugs in configurable software systems is a complex and time-consuming task that requires not only fixing a bug, but also understanding its root cause. While there is a vast body of literature on debugging strategies, there is no consensus on general debugging. This makes it difficult to provide concrete guidance for developers, especially for configuration-dependent performance bugs.<\/jats:p>\n                  <jats:p>The goal of our work is to alleviate this situation by providing an framework to describe debugging strategies in a more general, unifying way.<\/jats:p>\n                  <jats:p>We conducted a user study with 12 professional developers who debugged a performance bug in a real-world configurable system. To observe developers in an unobstructive way, we provided an immersive virtual reality tool, SoftVR, giving them a large degree of freedom to choose the preferred debugging strategy.<\/jats:p>\n                  <jats:p>The results show that the existing documentation of strategies is too coarse-grained and intermixed to identify successful approaches. In a subsequent qualitative analysis, we devised a coding framework to reason about debugging approaches. With this framework, we identified five goal-oriented episodes that developers employ, which they also confirmed in subsequent interviews.<\/jats:p>\n                  <jats:p>Our work provides a unified description of debugging strategies, allowing researchers a common foundation to study debugging and practitioners and teachers guidance on successful debugging strategies.<\/jats:p>","DOI":"10.1145\/3717523","type":"journal-article","created":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T11:16:02Z","timestamp":1750331762000},"page":"1409-1431","source":"Crossref","is-referenced-by-count":2,"title":["Understanding Debugging as Episodes: A Case Study on Performance Bugs in Configurable Software Systems"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3454-4121","authenticated-orcid":false,"given":"Max","family":"Weber","sequence":"first","affiliation":[{"name":"Leipzig University, Leipzig, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6204-2095","authenticated-orcid":false,"given":"Alina","family":"Mailach","sequence":"additional","affiliation":[{"name":"ScaDS.AI Dresden-Leipzig, Leipzig, Germany"},{"name":"Leipzig University, Leipzig, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3687-2233","authenticated-orcid":false,"given":"Sven","family":"Apel","sequence":"additional","affiliation":[{"name":"Saarland Informatics Campus, Saarbr\u00fccken, Germany"},{"name":"Saarland University, Saarbr\u00fccken, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5815-266X","authenticated-orcid":false,"given":"Janet","family":"Siegmund","sequence":"additional","affiliation":[{"name":"Chemnitz University of Technology, Chemnitz, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2176-876X","authenticated-orcid":false,"given":"Raimund","family":"Dachselt","sequence":"additional","affiliation":[{"name":"ScaDS.AI Dresden-Leipzig, Dresden, Germany"},{"name":"Dresden University of Technology, Dresden, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7741-7777","authenticated-orcid":false,"given":"Norbert","family":"Siegmund","sequence":"additional","affiliation":[{"name":"ScaDS.AI Dresden-Leipzig, Leipzig, Germany"},{"name":"Leipzig University, Leipzig, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,6,19]]},"reference":[{"key":"e_1_3_1_2_1","doi-asserted-by":"publisher","unstructured":"Abdulaziz Alaboudi and Thomas D LaToza. 2020. Using Hypotheses as a Debugging Aid. In 2020 IEEE Symposium on Visual Languages and Human-Centric Computing (VL\/HCC). IEEE IEEE Dunedin New Zealand. https:\/\/doi.org\/10.1109\/VL\/HCC50065.2020.912727310.1109\/VL\/HCC50065.2020.9127273","DOI":"10.1109\/VL\/HCC50065.2020.9127273"},{"key":"e_1_3_1_3_1","doi-asserted-by":"publisher","unstructured":"Christopher Andrews Alex Endert and Chris North. 2010. Space to Think: Large High-resolution Displays for Sensemaking. In Proceedings of the SIGCHI conference on human factors in computing systems. Association for Computing Machinery New York NY USA 55\u201364. https:\/\/doi.org\/10.1109\/VL\/HCC50065.2020.912727310.1109\/VL\/HCC50065.2020.9127273","DOI":"10.1109\/VL\/HCC50065.2020.9127273"},{"key":"e_1_3_1_4_1","doi-asserted-by":"publisher","unstructured":"Ron Baecker Chris DiGiano and Aaron Marcus. 1997. Software Visualization for Debugging. Commun. ACM (1997) 44\u201354. https:\/\/doi.org\/10.1145\/248448.248458 10.1145\/248448.248458","DOI":"10.1145\/248448.248458"},{"key":"e_1_3_1_5_1","unstructured":"Payel Bandyopadhyay. 2020. Immersive Space to Think: the Role of 3D Immersive Space in Sensemaking of Textual Data. Ph. D. Dissertation. Virginia Tech."},{"key":"e_1_3_1_6_1","doi-asserted-by":"publisher","unstructured":"Aaron Bangor Philip T Kortum and James T Miller. 2008. An Empirical Evaluation of the System Usability Scale. Intl. Journal of Human\u2013Computer Interaction (2008). https:\/\/doi.org\/10.1080\/10447310802205776 10.1080\/10447310802205776","DOI":"10.1080\/10447310802205776"},{"key":"e_1_3_1_7_1","doi-asserted-by":"publisher","unstructured":"Marcel B\u00f6hme Ezekiel O Soremekun Sudipta Chattopadhyay Emamurho Ugherughe and Andreas Zeller. 2017. Where Is the Bug and How Is It Fixed? An Experiment with Practitioners. In Proceedings of the 2017 11th joint meeting on foundations of software engineering. 117\u2013128. https:\/\/doi.org\/10.1145\/3106237.3106255 10.1145\/3106237.3106255","DOI":"10.1145\/3106237.3106255"},{"key":"e_1_3_1_8_1","unstructured":"John Brooke. 1996. SUS - A quick and dirty usability scale. Usability evaluation in industry 189 3 (1996) 189\u2013194."},{"key":"e_1_3_1_9_1","doi-asserted-by":"publisher","unstructured":"Patrizio Campisi and Daria La Rocca. 2014. Brain Waves for Automatic Biometric-Based User Recognition. IEEE transactions on information forensics and security 9 5 (2014) 782\u2013800. https:\/\/doi.org\/10.1109\/TIFS.2014.2308640 10.1109\/TIFS.2014.2308640","DOI":"10.1109\/TIFS.2014.2308640"},{"key":"e_1_3_1_10_1","doi-asserted-by":"publisher","unstructured":"Eric Chi A Michael Salem R Iris Bahar and Richard Weiss. 2003. Combining Software and Hardware Monitoring for Improved Power and Performance Tuning. In Seventh Workshop on Interaction Between Compilers and Computer Architectures. IEEE. https:\/\/doi.org\/10.1109\/INTERA.2003.1192356 10.1109\/INTERA.2003.1192356","DOI":"10.1109\/INTERA.2003.1192356"},{"key":"e_1_3_1_11_1","doi-asserted-by":"publisher","unstructured":"Thippaya Chintakovid Susan Wiedenbeck Margaret Burnett and Valentina Grigoreanu. 2006. Pair Collaboration in End-User Debugging. In Visual Languages and Human-Centric Computing (VL\/HCC\u201906). IEEE 3\u201310. https:\/\/doi.org\/10.1109\/VLHCC.2006.36 10.1109\/VLHCC.2006.36","DOI":"10.1109\/VLHCC.2006.36"},{"key":"e_1_3_1_12_1","doi-asserted-by":"publisher","unstructured":"Andy Cockburn and Bruce McKenzie. 2002. Evaluating the Effectiveness of Spatial Memory in 2D and 3D Physical and Virtual Environments. In Proceedings of the SIGCHI conference on Human factors in computing systems. 203\u2013210. https:\/\/doi.org\/10.1145\/503376.503413 10.1145\/503376.503413","DOI":"10.1145\/503376.503413"},{"key":"e_1_3_1_13_1","doi-asserted-by":"publisher","unstructured":"Marc Eisenstadt. 1997. My Hairiest Bug War Stories. Commun. ACM 40 4 (1997) 30\u201337. https:\/\/doi.org\/10.1145\/248448.248456 10.1145\/248448.248456","DOI":"10.1145\/248448.248456"},{"key":"e_1_3_1_14_1","doi-asserted-by":"publisher","unstructured":"Natasa Gisev J Simon Bell and Timothy F Chen. 2013. Interrater Agreement and Interrater Reliability: Key Concepts Approaches and Applications. Research in Social and Administrative Pharmacy 9 3 (2013) 330\u2013338. https:\/\/doi.org\/10.1016\/j.sapharm.2012.04.004 10.1016\/j.sapharm.2012.04.004","DOI":"10.1016\/j.sapharm.2012.04.004"},{"key":"e_1_3_1_15_1","doi-asserted-by":"publisher","unstructured":"John D Gould. 1975. Some Psychological Evidence on How People Debug Computer Programs. International Journal of Man-Machine Studies 7 2 (1975) 151\u2013182. https:\/\/doi.org\/10.1016\/S0020-7373(75)80005-8 10.1016\/S0020-7373(75)80005-8","DOI":"10.1016\/S0020-7373(75)80005-8"},{"key":"e_1_3_1_16_1","doi-asserted-by":"publisher","unstructured":"Valentina Grigoreanu Laura Beckwith Xiaoli Fern Sherry Yang Chaitanya Komireddy Vaishnavi Narayanan Curtis Cook and Margaret Burnett. 2006. Gender Differences in End-User Debugging Revisited: What the Miners Found. In Visual Languages and Human-Centric Computing (VL\/HCC\u201906). IEEE 19\u201326. https:\/\/doi.org\/10.1109\/VLHCC.2006.24 10.1109\/VLHCC.2006.24","DOI":"10.1109\/VLHCC.2006.24"},{"key":"e_1_3_1_17_1","doi-asserted-by":"publisher","unstructured":"Brent Hailpern and Padmanabhan Santhanam. 2002. Software Debugging Testing and Verification. IBM Systems Journal (2002). https:\/\/doi.org\/10.1147\/sj.411.0004 10.1147\/sj.411.0004","DOI":"10.1147\/sj.411.0004"},{"key":"e_1_3_1_18_1","doi-asserted-by":"publisher","unstructured":"Xue Han and Tingting Yu. 2016. An Empirical Study on Performance Bugs for Highly Configurable Software Systems. In Proceedings of the 10th ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement. 1\u201310. https:\/\/doi.org\/10.1145\/2961111.2962602 10.1145\/2961111.2962602","DOI":"10.1145\/2961111.2962602"},{"key":"e_1_3_1_19_1","doi-asserted-by":"publisher","unstructured":"Xue Han Tingting Yu and David Lo. 2018. Perflearner: Learning From Bug Reports to Understand and Generate Performance Test Frames. In 02018 33rd IEEE\/ACM International Conference on Automated Software Engineering (ASE). IEEE 17\u201328. https:\/\/doi.org\/10.1145\/3238147.3238204 10.1145\/3238147.3238204","DOI":"10.1145\/3238147.3238204"},{"key":"e_1_3_1_20_1","doi-asserted-by":"publisher","unstructured":"Thomas Hirsch and Birgit Hofer. 2021. What we can learn from how programmers debug their code. In 2021 IEEE\/ACM 8th International Workshop on Software Engineering Research and Industrial Practice (SER&IP). IEEE 37\u201340. https:\/\/doi.org\/10.1109\/SER-IP52554.2021.00014 10.1109\/SER-IP52554.2021.00014","DOI":"10.1109\/SER-IP52554.2021.00014"},{"key":"e_1_3_1_21_1","doi-asserted-by":"publisher","unstructured":"Thomas Hirsch and Birgit Hofer. 2022. A systematic literature review on benchmarks for evaluating debugging approaches. Journal of Systems and Software 192 (2022) 111423. https:\/\/doi.org\/10.1016\/j.jss.2022.111423 10.1016\/j.jss.2022.111423","DOI":"10.1016\/j.jss.2022.111423"},{"key":"e_1_3_1_22_1","doi-asserted-by":"publisher","unstructured":"Md Shahriar Iqbal Rahul Krishna Mohammad Ali Javidian Baishakhi Ray and Pooyan Jamshidi. 2022. Unicorn: Reasoning about Configurable System Performance through the Lens of Causality. In Proceedings of the Seventeenth European Conference on Computer Systems. 199\u2013217. https:\/\/doi.org\/10.1145\/3492321.3519575 10.1145\/3492321.3519575","DOI":"10.1145\/3492321.3519575"},{"key":"e_1_3_1_23_1","doi-asserted-by":"publisher","unstructured":"Guoliang Jin Linhai Song Xiaoming Shi Joel Scherpelz and Shan Lu. 2012. Understanding and Detecting Real-World Performance Bugs. ACM SIGPLAN Notices 47 6 (2012) 77\u201388. https:\/\/doi.org\/10.1145\/2345156.225407510.1145\/2345156.2254075","DOI":"10.1145\/2345156.2254075"},{"key":"e_1_3_1_24_1","doi-asserted-by":"publisher","unstructured":"Paul E Johnson Frank Hassebrock Alicia S Duran and James H Moller. 1982. Multimethod Study of Clinical Judgment. Organizational behavior and human performance 30 2 (1982) 201\u2013230. https:\/\/doi.org\/10.1016\/0030-5073(82)90218-5 10.1016\/0030-5073(82)90218-5","DOI":"10.1016\/0030-5073(82)90218-5"},{"key":"e_1_3_1_25_1","doi-asserted-by":"publisher","unstructured":"Milan Jovic Andrea Adamoli and Matthias Hauswirth. 2011. Catch Me If You Can: Performance Bug Detection in the Wild. In Proceedings of the 2011 ACM international conference on Object oriented programming systems languages and applications. https:\/\/doi.org\/10.1145\/2048066.2048081 10.1145\/2048066.2048081","DOI":"10.1145\/2048066.2048081"},{"key":"e_1_3_1_26_1","doi-asserted-by":"publisher","unstructured":"Irvin R Katz and John R Anderson. 1987. Debugging: An Analysis of Bug-Location Strategies. Human-Computer Interaction 3 4 (1987) 351\u2013399. https:\/\/doi.org\/10.1207\/s15327051hci0304_2 10.1207\/s15327051hci0304_2","DOI":"10.1207\/s15327051hci0304_2"},{"key":"e_1_3_1_27_1","doi-asserted-by":"publisher","unstructured":"Sergiy Kolesnikov Norbert Siegmund Christian K\u00e4stner and Sven Apel. 2019. On the Relation of Control-flow and Performance Feature Interactions: A Case Study. Empirical Software Engineering 24 (2019) 2410\u20132437. https:\/\/doi.org\/10.1007\/s10664-019-09705-w 10.1007\/s10664-019-09705-w","DOI":"10.1007\/s10664-019-09705-w"},{"key":"e_1_3_1_28_1","unstructured":"Rahul Krishna Md Shahriar Iqbal Mohammad Ali Javidian Baishakhi Ray and Pooyan Jamshidi. 2020. Cadet: Debugging and Fixing Misconfigurations Using Counterfactual Reasoning. arXiv preprint arXiv:2010.06061 (2020)."},{"key":"e_1_3_1_29_1","doi-asserted-by":"publisher","unstructured":"J Richard Landis and Gary G Koch. 1977. The Measurement of Observer Agreement for Categorical Data. biometrics (1977). https:\/\/doi.org\/10.2307\/2529310 10.2307\/2529310","DOI":"10.2307\/2529310"},{"key":"e_1_3_1_30_1","doi-asserted-by":"publisher","unstructured":"Ding Li Yingjun Lyu Jiaping Gui and William GJ Halfond. 2016. Automated Energy Optimization of HTTP Requests for Mobile Applications. In 2016 IEEE\/ACM 38th International Conference on Software Engineering (ICSE). IEEE 249\u2013260. https:\/\/doi.org\/10.1145\/2884781.2884867 10.1145\/2884781.2884867","DOI":"10.1145\/2884781.2884867"},{"key":"e_1_3_1_31_1","doi-asserted-by":"publisher","unstructured":"Lee Lisle Kylie Davidson Edward JK Gitre Chris North and Doug A Bowman. 2021. Sensemaking Strategies with Immersive Space to Think. In 2021 IEEE virtual reality and 3D user interfaces (VR). https:\/\/doi.org\/10.1109\/VR50410.2021.00077 10.1109\/VR50410.2021.00077","DOI":"10.1109\/VR50410.2021.00077"},{"key":"e_1_3_1_32_1","doi-asserted-by":"publisher","unstructured":"Renee McCauley Sue Fitzgerald Gary Lewandowski Laurie Murphy Beth Simon Lynda Thomas and Carol Zander. 2008. Debugging: A Review of the Literature From an Educational Perspective. Computer Science Education 18 2 (2008) 67\u201392. https:\/\/doi.org\/10.1080\/08993400802114581 10.1080\/08993400802114581","DOI":"10.1080\/08993400802114581"},{"key":"e_1_3_1_33_1","doi-asserted-by":"publisher","unstructured":"David Moreno-Lumbreras Jesus M Gonz\u00e1lez Barahona Gregorio Robles et al. 2024. Diving into Software Evolution: Virtual Reality vs. On-Screen. International Conference on Software Maintenance and Evolution (ICSME) (2024). https:\/\/doi.org\/10.5281\/zenodo.13662379 10.5281\/zenodo.13662379","DOI":"10.5281\/zenodo.13662379"},{"key":"e_1_3_1_34_1","doi-asserted-by":"publisher","unstructured":"Stefan M\u00fchlbauer Florian Sattler Christian Kaltenecker Johannes Dorn Sven Apel and Norbert Siegmund. 2023. Analysing the Impact of Workloads on Modeling the Performance of Configurable Software Systems. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE). IEEE 2085\u20132097. https:\/\/doi.org\/10.1109\/ICSE48619.2023.00176 10.1109\/ICSE48619.2023.00176","DOI":"10.1109\/ICSE48619.2023.00176"},{"key":"e_1_3_1_35_1","doi-asserted-by":"publisher","unstructured":"Laurie Murphy Gary Lewandowski tRen\u00e9e McCauley Beth Simon Lynda Thomas and Carol Zander. 2008. Debugging: the Good the Bad and the Quirky\u2013a qualitative analysis of novices\u2019 strategies. ACM SIGCSE Bulletin 40 1 (2008) 163\u2013167. https:\/\/doi.org\/10.1145\/1352322.1352191 10.1145\/1352322.1352191","DOI":"10.1145\/1352322.1352191"},{"key":"e_1_3_1_36_1","doi-asserted-by":"publisher","unstructured":"Adrian Nistor Linhai Song Darko Marinov and Shan Lu. 2013. Toddler: Detecting Performance Problems Via Similar Memory-Access Patterns. In 2013 35th International Conference on Software Engineering (ICSE). IEEE 562\u2013571. https:\/\/doi.org\/10.1109\/ICSE.2013.6606602 10.1109\/ICSE.2013.6606602","DOI":"10.1109\/ICSE.2013.6606602"},{"key":"e_1_3_1_37_1","doi-asserted-by":"publisher","unstructured":"Chris Parnin and Alessandro Orso. 2011. Are Automated Debugging Techniques Actually Helping Programmers?. In Proceedings of the 2011 international symposium on software testing and analysis. 199\u2013209. https:\/\/doi.org\/10.1145\/2001420.2001445 10.1145\/2001420.2001445","DOI":"10.1145\/2001420.2001445"},{"key":"e_1_3_1_38_1","doi-asserted-by":"publisher","unstructured":"Norman Peitek Sven Apel Chris Parnin Andr\u00e9 Brechmann and Janet Siegmund. 2021. Program Comprehension and Code Complexity Metrics: An fMRI Study. In 2021 IEEE\/ACM 43rd International Conference on Software Engineering (ICSE). IEEE 524\u2013536. https:\/\/doi.org\/10.1109\/ICSE43902.2021.00056 10.1109\/ICSE43902.2021.00056","DOI":"10.1109\/ICSE43902.2021.00056"},{"key":"e_1_3_1_39_1","doi-asserted-by":"publisher","unstructured":"Norman Peitek Janet Siegmund Chris Parnin Sven Apel Johannes C Hofmeister and Andr\u00e9 Brechmann. 2018. Simultaneous Measurement of Program Comprehension with fMRI and Eye Tracking: A Case Study. In Proceedings of the 12th ACM\/IEEE international symposium on empirical software engineering and measurement. 1\u201310. https:\/\/doi.org\/10.1145\/3239235.3240495 10.1145\/3239235.3240495","DOI":"10.1145\/3239235.3240495"},{"key":"e_1_3_1_40_1","doi-asserted-by":"publisher","unstructured":"Fei Peng Chunyu Li Xiaohan Song Wei Hu and Guihuan Feng. 2016. An Eye Tracking Research on Debugging Strategies Towards Different Types of Bugs. In 2016 IEEE 40th Annual Computer Software and Applications Conference (COMPSAC) Vol. 2. IEEE 130\u2013134. https:\/\/doi.org\/10.1109\/COMPSAC.2016.57 10.1109\/COMPSAC.2016.57","DOI":"10.1109\/COMPSAC.2016.57"},{"key":"e_1_3_1_41_1","doi-asserted-by":"publisher","unstructured":"Michael Perscheid Benjamin Siegmund Marcel Taeumel and Robert Hirschfeld. 2017. Studying the Advancement in Debugging Practice of Professional Software Developers. Software Quality Journal 25 (2017) 83\u2013110. https:\/\/doi.org\/10.1007\/s11219-015-9294-2 10.1007\/s11219-015-9294-2","DOI":"10.1007\/s11219-015-9294-2"},{"key":"e_1_3_1_42_1","doi-asserted-by":"publisher","unstructured":"Shrinu Prabhakararao Curtis Cook J Ruthruff Eugene Creswick Martin Main Mike Durham and M Burnett. 2003. Strategies and Behaviors of End-User Programmers with Interactive Fault Localization. In IEEE Symposium on Human Centric Computing Languages and Environments 2003. Proceedings. 2003. IEEE 15\u201322. https:\/\/doi.org\/10.1109\/HCC.2003.1260197 10.1109\/HCC.2003.1260197","DOI":"10.1109\/HCC.2003.1260197"},{"key":"e_1_3_1_43_1","unstructured":"Alec Radford Jong Wook Kim Tao Xu Greg Brockman Christine McLeavey and Ilya Sutskever. 2023. Robust Speech Recognition via Large-Scale Weak Supervision. In International conference on machine learning. PMLR 28492\u201328518."},{"key":"e_1_3_1_44_1","doi-asserted-by":"publisher","unstructured":"Patrick Reipschl\u00e4ger Burcu Kulahcioglu Ozkan Aman Shankar Mathur Stefan Gumhold Rupak Majumdar and Raimund Dachselt. 2018. DebugAR: Mixed Dimensional Displays for Immersive Debugging of Distributed Systems. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC Canada) (CHI EA \u201818). Association for Computing Machinery New York NY USA 1\u20136. https:\/\/doi.org\/10.1145\/3170427.3188679 10.1145\/3170427.3188679","DOI":"10.1145\/3170427.3188679"},{"key":"e_1_3_1_45_1","doi-asserted-by":"publisher","unstructured":"Pablo Romero Benedict Du Boulay Richard Cox Rudi Lutz and Sallyann Bryant. 2007. Debugging Strategies and Tactics in a Multi-Representation Software Environment. International Journal of Human-Computer Studies 65 12 (2007) 992\u20131009. https:\/\/doi.org\/10.1016\/j.ijhcs.2007.07.005 10.1016\/j.ijhcs.2007.07.005","DOI":"10.1016\/j.ijhcs.2007.07.005"},{"key":"e_1_3_1_46_1","doi-asserted-by":"publisher","unstructured":"Neeraja Subrahmaniyan Laura Beckwith Valentina Grigoreanu Margaret Burnett Susan Wiedenbeck Vaishnavi Narayanan Karin Bucht Russell Drummond and Xiaoli Fern. 2008. Testing vs. Code Inspection vs. What Else? Male and Female End Users\u2019 Debugging Strategies. In Proceedings of the SIGCHI Conference on human factors in computing systems. 617\u2013626. https:\/\/doi.org\/10.1145\/1357054.1357153 10.1145\/1357054.1357153","DOI":"10.1145\/1357054.1357153"},{"key":"e_1_3_1_47_1","doi-asserted-by":"publisher","unstructured":"Monica Tavanti and Mats Lind. 2001. 2D vs 3D Implications on Spatial Memory. In IEEE Symposium on Information Visualization 2001. INFOVIS 2001. IEEE 139\u2013145. https:\/\/doi.org\/10.1145\/1753326.1753336 10.1145\/1753326.1753336","DOI":"10.1145\/1753326.1753336"},{"key":"e_1_3_1_48_1","doi-asserted-by":"publisher","unstructured":"Xiaolin Teng Hoang Pham and Daniel R Jeske. 2006. Reliability Modeling of Hardware and Software Interactions and Its Applications. IEEE Transactions on Reliability 55 4 (2006) 571\u2013577. https:\/\/doi.org\/10.1109\/TR.2006.884589 10.1109\/TR.2006.884589","DOI":"10.1109\/TR.2006.884589"},{"key":"e_1_3_1_49_1","unstructured":"Maarten Van Someren Yvonne F Barnard and J Sandberg. 1994. The Think Aloud Method: A Practical Approach to Modelling Cognitive Processes. London: AcademicPress 11 6 (1994)."},{"key":"e_1_3_1_50_1","doi-asserted-by":"publisher","unstructured":"Miguel Velez Pooyan Jamshidi Norbert Siegmund Sven Apel and Christian K\u00e4stner. 2022. On Debugging the Performance of Configurable Software Systems: Developer Needs and Tailored Tool Support. In Proceedings of the 44th International Conference on Software Engineering. Association for Computing Machinery. https:\/\/doi.org\/10.1145\/3510003.3510043 10.1145\/3510003.3510043","DOI":"10.1145\/3510003.3510043"},{"key":"e_1_3_1_51_1","doi-asserted-by":"publisher","unstructured":"Iris Vessey. 1985. Expertise in Debugging Computer Programs: A Process Analysis. International Journal of Man-Machine Studies 23 5 (1985) 459\u2013494. https:\/\/doi.org\/10.1016\/S0020-7373(85)80054-7 10.1016\/S0020-7373(85)80054-7","DOI":"10.1016\/S0020-7373(85)80054-7"},{"key":"e_1_3_1_52_1","doi-asserted-by":"publisher","unstructured":"Min Xie and Bo Yang. 2003. A Study of the Effect of Imperfect Debugging on Software Development Cost. IEEE Transactions on Software Engineering 29 5 (2003) 471\u2013473. https:\/\/doi.org\/10.1109\/TSE.2003.1199075 10.1109\/TSE.2003.1199075","DOI":"10.1109\/TSE.2003.1199075"}],"container-title":["Proceedings of the ACM on Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3717523","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,23]],"date-time":"2026-08-23T11:06:00Z","timestamp":1787483160000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3717523"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,19]]},"references-count":51,"journal-issue":{"issue":"FSE","published-print":{"date-parts":[[2025,6,19]]}},"alternative-id":["10.1145\/3717523"],"URL":"https:\/\/doi.org\/10.1145\/3717523","relation":{},"ISSN":["2994-970X"],"issn-type":[{"value":"2994-970X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,19]]}}}