{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T11:24:23Z","timestamp":1783596263927,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":51,"publisher":"ACM","license":[{"start":{"date-parts":[[2026,4,12]],"date-time":"2026-04-12T00:00:00Z","timestamp":1775952000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"funder":[{"DOI":"10.13039\/100000879","name":"Alfred P. Sloan Foundation","doi-asserted-by":"publisher","award":["G-2024-22484"],"award-info":[{"award-number":["G-2024-22484"]}],"id":[{"id":"10.13039\/100000879","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,4,12]]},"DOI":"10.1145\/3794860.3794914","type":"proceedings-article","created":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T10:48:58Z","timestamp":1783594138000},"page":"267-271","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Designing Tools to Enhance Best Practices in Research Software Engineering"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-5473-4293","authenticated-orcid":false,"given":"Minhyuk","family":"Ko","sequence":"first","affiliation":[{"name":"Department of Computer Science, Virginia Tech, Blacksburg, VA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6036-4733","authenticated-orcid":false,"given":"Chris","family":"Brown","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Virginia Tech, Blacksburg, VA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,7,9]]},"reference":[{"key":"e_1_3_3_2_2_2","unstructured":"Toufique Ahmed Premkumar Devanbu et\u00a0al. 2024. Can LLMs replace manual annotation of software engineering artifacts? arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2408.05534 (2024)."},{"key":"e_1_3_3_2_3_2","doi-asserted-by":"crossref","unstructured":"G\u00f6k\u00e7e Ak\u00e7ay\u0131r and Murat Ak\u00e7ay\u0131r. 2018. The flipped classroom: A review of its advantages and challenges. Computers & Education 126 (2018) 334\u2013345.","DOI":"10.1016\/j.compedu.2018.07.021"},{"key":"e_1_3_3_2_4_2","first-page":"1","volume-title":"2017 2nd International Conference on Computer and Communication Systems (ICCCS)","author":"Al-Saiyd Nedhal\u00a0A","year":"2017","unstructured":"Nedhal\u00a0A Al-Saiyd. 2017. Source code comprehension analysis in software maintenance. In 2017 2nd International Conference on Computer and Communication Systems (ICCCS). IEEE, 1\u20135."},{"key":"e_1_3_3_2_5_2","first-page":"472","volume-title":"International symposium on foundations of software engineering (FSE)","author":"Allamanis Miltiadis","year":"2014","unstructured":"Miltiadis Allamanis and Charles Sutton. 2014. Mining idioms from source code. In International symposium on foundations of software engineering (FSE). 472\u2013483."},{"key":"e_1_3_3_2_6_2","doi-asserted-by":"crossref","unstructured":"Elvira-Maria Arvanitou Apostolos Ampatzoglou et\u00a0al. 2021. Software engineering practices for scientific software development: A systematic mapping study. Journal of Systems and Software 172 (2021) 110848.","DOI":"10.1016\/j.jss.2020.110848"},{"key":"e_1_3_3_2_7_2","unstructured":"Simon Arvidsson and Johan Axell. 2023. Prompt engineering guidelines for LLMs in Requirements Engineering. (2023)."},{"key":"e_1_3_3_2_8_2","doi-asserted-by":"crossref","unstructured":"Laura Benton Piers Saunders Ivan Kalas Celia Hoyles and Richard Noss. 2018. Designing for learning mathematics through programming: A case study of pupils engaging with place value. International journal of child-computer interaction 16 (2018) 68\u201376.","DOI":"10.1016\/j.ijcci.2017.12.004"},{"key":"e_1_3_3_2_9_2","unstructured":"Ainhoa Berciano Astrid Cuida et\u00a0al. 2024. The importance of coding and translation between programming languages in sequential activities of pre-service teachers: an approach. Education and Information Technologies (2024) 1\u201325."},{"key":"e_1_3_3_2_10_2","doi-asserted-by":"crossref","unstructured":"Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3 2 (2006) 77\u2013101.","DOI":"10.1191\/1478088706qp063oa"},{"key":"e_1_3_3_2_11_2","first-page":"54","volume-title":"International Workshop on Bots in Software Engineering (BotSE)","author":"Brown Chris","year":"2019","unstructured":"Chris Brown and Chris Parnin. 2019. Sorry to bother you: Designing bots for effective recommendations. In International Workshop on Bots in Software Engineering (BotSE). IEEE, 54\u201358."},{"key":"e_1_3_3_2_12_2","first-page":"78","volume-title":"Cooperative and Human Aspects of Software Engineering (CHASE)","author":"Brown Chris","year":"2020","unstructured":"Chris Brown and Chris Parnin. 2020. Comparing different developer behavior recommendation styles. In Cooperative and Human Aspects of Software Engineering (CHASE). 78\u201385."},{"key":"e_1_3_3_2_13_2","first-page":"56","volume-title":"International Workshop on Bots in Software Engineering (BotSE)","author":"Brown Chris","year":"2020","unstructured":"Chris Brown and Chris Parnin. 2020. Sorry to bother you again: Developer recommendation choice architectures for designing effective bots. In International Workshop on Bots in Software Engineering (BotSE). 56\u201360."},{"key":"e_1_3_3_2_14_2","unstructured":"J Carver. 2019. URSSI conceptualization survey results."},{"key":"e_1_3_3_2_15_2","doi-asserted-by":"crossref","unstructured":"Jeffrey Carver Dustin Heaton Lorin Hochstein and Roscoe Bartlett. 2013. Self-perceptions about software engineering: A survey of scientists and engineers. Computing in Science & Engineering 15 1 (2013) 7\u201311.","DOI":"10.1109\/MCSE.2013.12"},{"key":"e_1_3_3_2_16_2","doi-asserted-by":"crossref","unstructured":"Ian\u00a0A Cosden Kenton McHenry and Daniel\u00a0S Katz. 2023. Research software engineers: Career entry points and training gaps. Computing in Science & Engineering 24 6 (2023) 14\u201321.","DOI":"10.1109\/MCSE.2023.3258630"},{"key":"e_1_3_3_2_17_2","first-page":"1345","volume-title":"International conference on Management of data","author":"Davidson Susan\u00a0B","year":"2008","unstructured":"Susan\u00a0B Davidson and Juliana Freire. 2008. Provenance and scientific workflows: challenges and opportunities. In International conference on Management of data. 1345\u20131350."},{"key":"e_1_3_3_2_18_2","first-page":"108","volume-title":"International conference on software engineering (ICSE)","author":"Devanbu Prem","year":"2016","unstructured":"Prem Devanbu, Thomas Zimmermann, and Christian Bird. 2016. Belief & evidence in empirical software engineering. In International conference on software engineering (ICSE). 108\u2013119."},{"key":"e_1_3_3_2_19_2","doi-asserted-by":"crossref","unstructured":"Nasir\u00a0U Eisty Upulee Kanewala and Jeffrey\u00a0C Carver. 2025. Testing research software: an in-depth survey of practices methods and tools. Empirical Software Engineering 30 3 (2025) 81.","DOI":"10.1007\/s10664-025-10620-6"},{"key":"e_1_3_3_2_20_2","doi-asserted-by":"crossref","unstructured":"Robert\u00a0L Glass. 1994. The software-research crisis. IEEE Software 11 6 (1994) 42\u201347.","DOI":"10.1109\/52.329400"},{"key":"e_1_3_3_2_21_2","doi-asserted-by":"crossref","unstructured":"Gagan Gurung Rahul Shah and Dhiraj\u00a0P Jaiswal. 2020. Software development life cycle models-A comparative study. International Journal of Scientific Research in Computer Science Engineering and Information Technology 6 4 (2020) 30\u201337.","DOI":"10.32628\/CSEIT206410"},{"key":"e_1_3_3_2_22_2","volume-title":"Handbook of inter-rater reliability: The definitive guide to measuring the extent of agreement among raters","author":"Gwet Kilem\u00a0L","year":"2014","unstructured":"Kilem\u00a0L Gwet. 2014. Handbook of inter-rater reliability: The definitive guide to measuring the extent of agreement among raters. Advanced Analytics, LLC."},{"key":"e_1_3_3_2_23_2","first-page":"1","volume-title":"ICSE workshop on software engineering for computational science and engineering","author":"Hannay Jo\u00a0Erskine","year":"2009","unstructured":"Jo\u00a0Erskine Hannay, Carolyn MacLeod, et\u00a0al. 2009. How do scientists develop and use scientific software?. In ICSE workshop on software engineering for computational science and engineering. Ieee, 1\u20138."},{"key":"e_1_3_3_2_24_2","unstructured":"Simon Hettrick. 2018. softwaresaved\/software_in_research_survey_2014: Software in research survey. Zenodo (2018)."},{"key":"e_1_3_3_2_25_2","unstructured":"Eric Horvitz Vincent Conitzer et\u00a0al. [n. d.]. Now Later and Lasting: 10 Priorities for AI Research Policy and Practice. Commun. ACM ([n. d.])."},{"key":"e_1_3_3_2_26_2","unstructured":"Juyong Jiang Fan Wang et\u00a0al. 2024. A survey on large language models for code generation. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2406.00515 (2024)."},{"key":"e_1_3_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.5555\/2486788.2486877"},{"key":"e_1_3_3_2_28_2","doi-asserted-by":"crossref","unstructured":"Upulee Kanewala and James\u00a0M Bieman. 2014. Testing scientific software: A systematic literature review. Information and software technology 56 10 (2014) 1219\u20131232.","DOI":"10.1016\/j.infsof.2014.05.006"},{"key":"e_1_3_3_2_29_2","first-page":"30","volume-title":"Conference of the Association for Software Testing (CAST)","author":"Kelly Diane","year":"2008","unstructured":"Diane Kelly and Rebecca Sanders. 2008. The challenge of testing scientific software. In Conference of the Association for Software Testing (CAST). Citeseer, 30\u201336."},{"key":"e_1_3_3_2_30_2","first-page":"168","volume-title":"2023 IEEE Symposium on Visual Languages and Human-Centric Computing (VL\/HCC)","author":"Ko Minhyuk","year":"2023","unstructured":"Minhyuk Ko, Dibyendu\u00a0Brinto Bose, et\u00a0al. 2023. Exploring the Barriers and Factors that Influence Debugger Usage for Students. In 2023 IEEE Symposium on Visual Languages and Human-Centric Computing (VL\/HCC). IEEE, 168\u2013172."},{"key":"e_1_3_3_2_31_2","first-page":"563","volume-title":"International conference on software analysis, evolution, and reengineering (SANER)","author":"Kochhar Pavneet\u00a0Singh","year":"2016","unstructured":"Pavneet\u00a0Singh Kochhar, Dinusha Wijedasa, and David Lo. 2016. A large scale study of multiple programming languages and code quality. In International conference on software analysis, evolution, and reengineering (SANER) , Vol.\u00a01. IEEE, 563\u2013573."},{"key":"e_1_3_3_2_32_2","unstructured":"Konstantin Kreyman and David\u00a0Lorge Parnas. 2002. On documenting the requirements for computer programs based on models of physical phenomena. SQRL Report 1 (2002)."},{"key":"e_1_3_3_2_33_2","first-page":"492","volume-title":"International conference on Software engineering (ICSE)","author":"LaToza Thomas\u00a0D","year":"2006","unstructured":"Thomas\u00a0D LaToza, Gina Venolia, and Robert DeLine. 2006. Maintaining mental models: a study of developer work habits. In International conference on Software engineering (ICSE). 492\u2013501."},{"key":"e_1_3_3_2_34_2","doi-asserted-by":"crossref","unstructured":"Rachael Luck. 2018. What is it that makes participation in design participatory design? Design studies 59 (2018) 1\u20138.","DOI":"10.1016\/j.destud.2018.10.002"},{"key":"e_1_3_3_2_35_2","unstructured":"K McCandless and H Lipmanowicz. [n. d.]. Liberating structures: 1\u20132\u20134\u2013all."},{"key":"e_1_3_3_2_36_2","doi-asserted-by":"crossref","unstructured":"Ian\u00a0R McChesney and Seamus Gallagher. 2004. Communication and co-ordination practices in software engineering projects. Information and Software Technology 46 7 (2004) 473\u2013489.","DOI":"10.1016\/j.infsof.2003.10.001"},{"key":"e_1_3_3_2_37_2","doi-asserted-by":"crossref","unstructured":"Reed Milewicz Jeffrey Carver et\u00a0al. 2022. A Secure Future for Open-Source Computational Science and Engineering. Computing in Science & Engineering 24 4 (2022) 65\u201369.","DOI":"10.1109\/MCSE.2022.3221877"},{"key":"e_1_3_3_2_38_2","volume-title":"The Living Review on Automated Program Repair","author":"Monperrus Martin","year":"2018","unstructured":"Martin Monperrus. 2018. The Living Review on Automated Program Repair. Technical Report hal-01956501. HAL\/archives-ouvertes.fr."},{"key":"e_1_3_3_2_39_2","unstructured":"Alan Peslak and Lisa Kovalchick. 2024. AI for coders: An analysis of the usage of ChatGPT and GitHub CoPilot. Issues in Information Systems 25 4 (2024) 252\u2013260."},{"key":"e_1_3_3_2_40_2","unstructured":"Roger\u00a0S Pressman. 2005. Software Engineering: a practitioner\u2019s approach. Pressman and Associates (2005)."},{"key":"e_1_3_3_2_41_2","doi-asserted-by":"crossref","unstructured":"Francisco Queiroz and Rejane Spitz. 2016. The lens of the lab: Design challenges in scientific software. International Journal of Design Management and Professional Practice 10 3 (2016) 17\u201345.","DOI":"10.18848\/2325-162X\/CGP\/v10i03\/17-45"},{"key":"e_1_3_3_2_42_2","doi-asserted-by":"crossref","unstructured":"Daniel Russo. 2024. Navigating the complexity of generative ai adoption in software engineering. ACM Transactions on Software Engineering and Methodology 33 5 (2024) 1\u201350.","DOI":"10.1145\/3652154"},{"key":"e_1_3_3_2_43_2","first-page":"9","volume-title":"ICSE workshop on software engineering for computational science and engineering","author":"Segal Judith","year":"2009","unstructured":"Judith Segal. 2009. Some challenges facing software engineers developing software for scientists. In ICSE workshop on software engineering for computational science and engineering. IEEE, 9\u201314."},{"key":"e_1_3_3_2_44_2","first-page":"221","volume-title":"Symposium on Usable Privacy and Security (SOUPS 2020)","author":"Smith Justin","year":"2020","unstructured":"Justin Smith, Lisa Nguyen\u00a0Quang Do, and Emerson Murphy-Hill. 2020. Why can\u2019t johnny fix vulnerabilities: A usability evaluation of static analysis tools for security. In Symposium on Usable Privacy and Security (SOUPS 2020). 221\u2013238."},{"key":"e_1_3_3_2_45_2","doi-asserted-by":"crossref","unstructured":"David\u00a0AW Soergel. 2015. Rampant software errors may undermine scientific results. F1000Research 3 (2015) 303.","DOI":"10.12688\/f1000research.5930.2"},{"key":"e_1_3_3_2_46_2","unstructured":"Clay Spinuzzi. 2005. The methodology of participatory design. Technical communication 52 2 (2005) 163\u2013174."},{"key":"e_1_3_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/3654777.3676368"},{"key":"e_1_3_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-55642-5_4"},{"key":"e_1_3_3_2_49_2","doi-asserted-by":"crossref","unstructured":"Igor Wiese Ivanilton Polato and Gustavo Pinto. 2019. Naming the pain in developing scientific software. IEEE Software 37 4 (2019) 75\u201382.","DOI":"10.1109\/MS.2019.2899838"},{"key":"e_1_3_3_2_50_2","doi-asserted-by":"crossref","unstructured":"Greg Wilson. 2006. Software carpentry: getting scientists to write better code by making them more productive. Computing in science & eng. 8 6 (2006) 66\u201369.","DOI":"10.1109\/MCSE.2006.122"},{"key":"e_1_3_3_2_51_2","first-page":"1","volume-title":"CHI conference on human factors in computing systems","author":"Zamfirescu-Pereira J\u00a0Diego","year":"2023","unstructured":"J\u00a0Diego Zamfirescu-Pereira, Richmond\u00a0Y Wong, et\u00a0al. 2023. Why Johnny can\u2019t prompt: how non-AI experts try (and fail) to design LLM prompts. In CHI conference on human factors in computing systems. 1\u201321."},{"key":"e_1_3_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/3672539.3686763"}],"event":{"name":"CHASE'26: 19th International Conference on Cooperative and Human Aspects of Software Engineering","location":"Rio de Janeiro Brazil","acronym":"CHASE'26","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering"]},"container-title":["Proceedings of the 19th International Conference on Cooperative and Human Aspects of Software Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3794860.3794914","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T10:50:59Z","timestamp":1783594259000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3794860.3794914"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,12]]},"references-count":51,"alternative-id":["10.1145\/3794860.3794914","10.1145\/3794860"],"URL":"https:\/\/doi.org\/10.1145\/3794860.3794914","relation":{},"subject":[],"published":{"date-parts":[[2026,4,12]]},"assertion":[{"value":"2026-07-09","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}