{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T23:52:40Z","timestamp":1781653960942,"version":"3.54.5"},"reference-count":92,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T00:00:00Z","timestamp":1777852800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T00:00:00Z","timestamp":1777852800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Autom Softw Eng"],"published-print":{"date-parts":[[2026,11]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Research software has become a central pillar of scientific discovery, yet its engineering quality, sustainability, and reproducibility vary widely across projects. At the same time, advances in artificial intelligence (AI), particularly generative AI (GenAI), are rapidly transforming how software is developed. While these tools promise productivity gains, their broader impact on research software engineering practices remains poorly understood at scale. In this study, we present a large-scale empirical analysis of AI-assisted research software engineering. We analyzed 1,510 open-source research software repositories retrieved from Zenodo using the IEEE Taxonomy 2025 top-level categories (598 query terms), restricted to records labeled Software and created after November 2022 (post-GenAI emergence), with duplicate and incomplete entries removed. To distinguish archival dissemination from active development, we separate Zenodo-only artifacts from records linked to evolving GitHub repositories and enrich the latter with repository-level development indicators. Our analysis integrates multiple dimensions, including software engineering maturity (e.g., documentation, automation, testing, and releases), FAIRness for research software (FAIR4RS metadata indicators), inferred AI and GenAI usage, and operational signals related to AIOps and MLOps practices. Based on these indicators, we propose and empirically ground a quadrant-based model that characterizes research software development modes along the axes of engineering maturity and AI integration. The results show that AI-assisted practices are increasingly present in research software, but their adoption remains uneven and often decoupled from established engineering disciplines. Repositories classified as AI4RSE exhibit longer active lifespans, stronger maintenance signals, and higher FAIR alignment than exploratory or informally developed projects. At the same time, a substantial fraction of Zenodo artifacts represent archival snapshots rather than evolving software, highlighting the importance of interpreting engineering indicators in light of dissemination intent. This work contributes (i) a large-scale empirical characterization based on 1,510 repositories of AI-assisted research software development, (ii) an integrated analytical framework combining software engineering, FAIRness, AI usage, and operational practices, and (iii) evidence-based insights into the opportunities and challenges of responsible and sustainable AI4RSE. Together, these contributions provide a foundation for future research and practical guidance on integrating AI into research software engineering.<\/jats:p>","DOI":"10.1007\/s10515-026-00621-0","type":"journal-article","created":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T03:39:47Z","timestamp":1777865987000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Advancing research software engineering with AI: a research framework"],"prefix":"10.1007","volume":"33","author":[{"given":"Siamak","family":"Farshidi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kwabena Ebo","family":"Bennin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"\u00d6nder","family":"Babur","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"June","family":"Sallou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ayalew","family":"Kassahun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bedir","family":"Tekinerdogan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,5,4]]},"reference":[{"key":"621_CR1","doi-asserted-by":"crossref","unstructured":"Aghili, R., Li, H., Khomh, F.: Studying the characteristics of aiops projects on github. Emp. Softw. Eng. 28(6) (2023)","DOI":"10.1007\/s10664-023-10382-z"},{"issue":"5","key":"621_CR2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3719006","volume":"34","author":"I Ahmed","year":"2025","unstructured":"Ahmed, I., Aleti, A., Cai, H., Chatzigeorgiou, A., He, P., Hu, X., Pezz\u00e8, M., Poshyvanyk, D., Xia, X.: Artificial intelligence for software engineering: The journey so far and the road ahead. ACM Trans. Softw. Eng. Methodol. 34(5), 1\u201327 (2025)","journal-title":"ACM Trans. Softw. Eng. Methodol."},{"key":"621_CR3","doi-asserted-by":"publisher","first-page":"101805","DOI":"10.1016\/j.inffus.2023.101805","volume":"99","author":"S Ali","year":"2023","unstructured":"Ali, S., Abuhmed, T., El-Sappagh, S., Muhammad, K., Alonso-Moral, J.M., Confalonieri, R., Guidotti, R., Del Ser, J., D\u00edaz-Rodr\u00edguez, N., Herrera, F.: Explainable artificial intelligence (xai): What we know and what is left to attain trustworthy artificial intelligence. Inf. Fus. 99, 101805 (2023)","journal-title":"Inf. Fus."},{"issue":"4","key":"621_CR4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3212695","volume":"51","author":"M Allamanis","year":"2018","unstructured":"Allamanis, M., Barr, E.T., Devanbu, P., Sutton, C.: A survey of machine learning for big code and naturalness. ACM Computing Surveys (CSUR). 51(4), 1\u201337 (2018)","journal-title":"ACM Computing Surveys (CSUR)."},{"key":"621_CR5","doi-asserted-by":"crossref","unstructured":"AlOmar, E.A., Venkatakrishnan, A., Mkaouer, M.W., Newman, C., Ouni, A.: How to refactor this code? an exploratory study on developer-chatgpt refactoring conversations. In: Proceedings of the 21st International Conference on Mining Software Repositories, pp. 202\u2013206 (2024)","DOI":"10.1145\/3643991.3645081"},{"key":"621_CR6","doi-asserted-by":"crossref","unstructured":"Amershi, S., Begel, A., Bird, C., DeLine, R., Gall, H., Kamar, E., Nagappan, N., Nushi, B., Zimmermann, T.: Software engineering for machine learning: A case study. In: 2019 IEEE\/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP), pp. 291\u2013300 (2019). IEEE","DOI":"10.1109\/ICSE-SEIP.2019.00042"},{"key":"621_CR7","unstructured":"Ariamajd, A., Castro, R.L.-R., Volkamer, A.: Pypackit: Automated research software engineering for scientific python applications on github (2025). arXiv preprint arXiv:2503.04921"},{"issue":"1","key":"621_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s42467-020-00005-4","volume":"2","author":"M Barenkamp","year":"2020","unstructured":"Barenkamp, M., Rebstadt, J., Thomas, O.: Applications of ai in classical software engineering. AI Perspectives. 2(1), 1 (2020)","journal-title":"AI Perspectives."},{"issue":"OOPSLA1","key":"621_CR9","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1145\/3586030","volume":"7","author":"S Barke","year":"2023","unstructured":"Barke, S., James, M.B., Polikarpova, N.: Grounded copilot: How programmers interact with code-generating models. Proceedings of the ACM on Programming Languages. 7(OOPSLA1), 85\u2013111 (2023)","journal-title":"Proceedings of the ACM on Programming Languages."},{"issue":"1","key":"621_CR10","doi-asserted-by":"publisher","first-page":"622","DOI":"10.1038\/s41597-022-01710-x","volume":"9","author":"M Barker","year":"2022","unstructured":"Barker, M., Chue Hong, N.P., Katz, D.S., Lamprecht, A.-L., Martinez-Ortiz, C., Psomopoulos, F., Harrow, J., Castro, L.J., Gruenpeter, M., Martinez, P.A., et al.: Introducing the fair principles for research software. Scientific Data. 9(1), 622 (2022)","journal-title":"Scientific Data."},{"key":"621_CR11","doi-asserted-by":"publisher","DOI":"10.1016\/j.softx.2025.102437","volume":"32","author":"KE Bennin","year":"2025","unstructured":"Bennin, K.E., Tekinerdogan, B., Farshidi, S.: Rsemm: A dashboard for evaluating research software maturity. SoftwareX. 32, 102437 (2025)","journal-title":"SoftwareX."},{"key":"621_CR12","unstructured":"Betz, S.: What is patch management? how software patching can protect you, your customers, and your organization. Built In. (2022)"},{"issue":"6","key":"621_CR13","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1145\/3582083","volume":"20","author":"C Bird","year":"2022","unstructured":"Bird, C., Ford, D., Zimmermann, T., Forsgren, N., Kalliamvakou, E., Lowdermilk, T., Gazit, I.: Taking flight with copilot: Early insights and opportunities of ai-powered pair-programming tools. Queue. 20(6), 35\u201357 (2022)","journal-title":"Queue."},{"key":"621_CR14","unstructured":"Cao, S., Sun, X., Widyasari, R., Lo, D., Wu, X., Bo, L., Zhang, J., Li, B., Liu, W., Wu, D., et al.: A systematic literature review on explainability for machine\/deep learning-based software engineering research (2024). arXiv preprint arXiv:2401.14617"},{"issue":"3","key":"621_CR15","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1109\/MCSE.2018.03221924","volume":"20","author":"JC Carver","year":"2018","unstructured":"Carver, J.C., Gesing, S., Katz, D.S., Ram, K., Weber, N.: Conceptualization of a us research software sustainability institute (urssi). Comput. Sci. Eng. 20(3), 4\u20139 (2018)","journal-title":"Comput. Sci. Eng."},{"key":"621_CR16","doi-asserted-by":"publisher","first-page":"963","DOI":"10.7717\/peerj-cs.963","volume":"8","author":"JC Carver","year":"2022","unstructured":"Carver, J.C., Weber, N., Ram, K., Gesing, S., Katz, D.S.: A survey of the state of the practice for research software in the united states. Peerj computer science. 8, 963 (2022)","journal-title":"Peerj computer science."},{"issue":"4","key":"621_CR17","doi-asserted-by":"publisher","first-page":"363","DOI":"10.1080\/019697298125641","volume":"29","author":"S-M Chen","year":"1998","unstructured":"Chen, S.-M.: Aggregating fuzzy opinions in the group decision-making environment. Cybernetics & Systems. 29(4), 363\u2013376 (1998)","journal-title":"Cybernetics & Systems."},{"key":"621_CR18","unstructured":"Chue\u00a0Hong, N.P., Katz, D.S., Barker, M., Lamprecht, A.-L., Martinez, C., Psomopoulos, F.E., Harrow, J., Castro, L.J., Gruenpeter, M., Martinez, P.A., et al.: Fair principles for research software (fair4rs principles). Zenodo. (2022)"},{"issue":"1","key":"621_CR19","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1109\/MS.2020.2973362","volume":"38","author":"J Cohen","year":"2020","unstructured":"Cohen, J., Katz, D.S., Barker, M., Hong, N.C., Haines, R., Jay, C.: The four pillars of research software engineering. IEEE Softw. 38(1), 97\u2013105 (2020)","journal-title":"IEEE Softw."},{"key":"621_CR20","unstructured":"Conover, W.J.: Practical Nonparametric Statistics, 3rd edn. John Wiley & Sons, New York, NY (1999)"},{"key":"621_CR21","unstructured":"Crawford, T., Duong, S., Fueston, R., Lawani, A., Owoade, S., Uzoka, A., Parizi, R.M., Yazdinejad, A.: Ai in software engineering: a survey on project management applications (2023). arXiv preprint arXiv:2307.15224"},{"key":"621_CR22","volume-title":"Introduction to Generative AI","author":"N Dhamani","year":"2026","unstructured":"Dhamani, N., Engler, M.: Introduction to Generative AI. Simon & Schuster, New York, NY (2026)"},{"issue":"3","key":"621_CR23","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1007\/s10664-025-10620-6","volume":"30","author":"NU Eisty","year":"2025","unstructured":"Eisty, N.U., Kanewala, U., Carver, J.C.: Testing research software: an in-depth survey of practices, methods, and tools. Empir. Softw. Eng. 30(3), 81 (2025)","journal-title":"Empir. Softw. Eng."},{"key":"621_CR24","doi-asserted-by":"crossref","unstructured":"Emerson, A., Meehan, T., Rogers, M., Cowen, W., Darabos, C.: Codedocs: Genai to generate documentation from git repositories. In: Practice and Experience in Advanced Research Computing 2025: The Power of Collaboration, pp. 1\u20134 (2025)","DOI":"10.1145\/3708035.3736102"},{"key":"621_CR25","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2020.110714","volume":"169","author":"S Farshidi","year":"2020","unstructured":"Farshidi, S., Jansen, S., Werf, J.M.: Capturing software architecture knowledge for pattern-driven design. J. Syst. Softw. 169, 110714 (2020)","journal-title":"J. Syst. Softw."},{"key":"621_CR26","doi-asserted-by":"crossref","unstructured":"Farshidi, S., Maassen, J., Bakhshi, R., Van\u00a0Nieuwpoort, R., Jansen, S., et al.: Fairseco: An extensible framework for impact measurement of research software. In: 2023 IEEE 19th International Conference on e-Science (e-Science), pp. 1\u201310 (2023). IEEE","DOI":"10.1109\/e-Science58273.2023.10254664"},{"key":"621_CR27","unstructured":"Felderer, M., Goedicke, M., Grunske, L., Hasselbring, W., Lamprecht, A.-L., Rumpe, B.: Toward research software engineering research. Zenodo. (2023)"},{"key":"621_CR28","doi-asserted-by":"crossref","unstructured":"Felderer, M., Goedicke, M., Grunske, L., Hasselbring, W., Lamprecht, A.-L., Rumpe, B.: Investigating research software engineering: Toward rse research. Communications of the ACM. (2025)","DOI":"10.1145\/3685265"},{"key":"621_CR29","doi-asserted-by":"publisher","DOI":"10.1201\/b21982","volume-title":"Risk Assessment and Decision Analysis with Bayesian Networks","author":"N Fenton","year":"2018","unstructured":"Fenton, N., Neil, M.: Risk Assessment and Decision Analysis with Bayesian Networks. CRC Press, Boca Raton, FL (2018)"},{"key":"621_CR30","doi-asserted-by":"publisher","first-page":"176","DOI":"10.1016\/j.jss.2015.06.063","volume":"123","author":"B Fitzgerald","year":"2017","unstructured":"Fitzgerald, B., Stol, K.-J.: Continuous software engineering: A roadmap and agenda. J. Syst. Softw. 123, 176\u2013189 (2017)","journal-title":"J. Syst. Softw."},{"key":"621_CR31","doi-asserted-by":"crossref","unstructured":"Gomez-Diaz, T., Recio, T.: On the evaluation of research software: the cdur procedure. F1000Research. 8, 1353 (2019)","DOI":"10.12688\/f1000research.19994.2"},{"key":"621_CR32","doi-asserted-by":"crossref","unstructured":"Hasselbring, W., Carr, L., Hettrick, S., Packer, H., Tiropanis, T.: From fair research data toward fair and open research software. it-Information Technology. 62(1), 39\u201347 (2020)","DOI":"10.1515\/itit-2019-0040"},{"key":"621_CR33","unstructured":"Hasselbring, W., Druskat, S., Bernoth, J., Betker, P., Felderer, M., Ferenz, S., Hermann, B., Lamprecht, A.-L., Linxweiler, J., Prat, A., et al.: Multi-dimensional categorization of research software with examples. (2024)"},{"issue":"6","key":"621_CR34","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1109\/MCSE.2023.3260475","volume":"24","author":"MA Heroux","year":"2023","unstructured":"Heroux, M.A.: Research software science: Expanding the impact of research software engineering. Comput. Sci. Eng. 24(6), 22\u201327 (2023)","journal-title":"Comput. Sci. Eng."},{"key":"621_CR35","doi-asserted-by":"crossref","unstructured":"Heroux, M.A., Bernholdt, D.E., McInnes, L.C., Cary, J.R., Katz, D.S., Raybourn, E.M., Rouson, D.: Basic research needs in the science of scientific software development and use: Investment in software is investment in science. Technical report, US Department of Energy (USDOE), Washington, DC (United States). Office of\u00a0... (2023)","DOI":"10.2172\/1846009"},{"key":"621_CR36","doi-asserted-by":"crossref","unstructured":"Howison, J., Herbsleb, J.D.: Scientific software production: incentives and collaboration. In: Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, pp. 513\u2013522 (2011)","DOI":"10.1145\/1958824.1958904"},{"issue":"1","key":"621_CR37","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1038\/s41597-023-02298-6","volume":"10","author":"E Huerta","year":"2023","unstructured":"Huerta, E., Blaiszik, B., Brinson, L.C., Bouchard, K.E., Diaz, D., Doglioni, C., Duarte, J.M., Emani, M., Foster, I., Fox, G., et al.: Fair for ai: An interdisciplinary and international community building perspective. Scientific data. 10(1), 487 (2023)","journal-title":"Scientific data."},{"key":"621_CR38","doi-asserted-by":"crossref","unstructured":"Hyrynsalmi, S.M., Liebel, G., Souza\u00a0Santos, R., Baltes, S.: Not real or too soft? on the challenges of publishing interdisciplinary software engineering research. In: 2025 IEEE\/ACM 47th International Conference on Software Engineering: Software Engineering in Society (ICSE-SEIS), pp. 106\u2013117 (2025). IEEE","DOI":"10.1109\/ICSE-SEIS66351.2025.00016"},{"issue":"1","key":"621_CR39","doi-asserted-by":"publisher","first-page":"627","DOI":"10.1038\/s41597-025-04820-4","volume":"12","author":"EA Jensen","year":"2025","unstructured":"Jensen, E.A., Katz, D.S.: Awareness of fair and fair4rs among international research software funders. Scientific Data. 12(1), 627 (2025)","journal-title":"Scientific Data."},{"key":"621_CR40","unstructured":"Jiang, J., Wang, F., Shen, J., Kim, S., Kim, S.: A survey on large language models for code generation (2024). arXiv preprint arXiv:2406.00515"},{"key":"621_CR41","doi-asserted-by":"crossref","unstructured":"Jim\u00e9nez, R.C., Kuzak, M., Alhamdoosh, M., Barker, M., Batut, B., Borg, M., Capella-Gutierrez, S., Hong, N.C., Cook, M., Corpas, M., et al.: Four simple recommendations to encourage best practices in research software. F1000Research. 6, 876 (2017)","DOI":"10.12688\/f1000research.11407.1"},{"issue":"2","key":"621_CR42","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1109\/MCSE.2018.021651343","volume":"20","author":"A Johanson","year":"2018","unstructured":"Johanson, A., Hasselbring, W.: Software engineering for computational science: Past, present, future. Comput. Sci. Eng. 20(2), 90\u2013109 (2018)","journal-title":"Comput. Sci. Eng."},{"key":"621_CR43","doi-asserted-by":"crossref","unstructured":"Kalliamvakou, E., Gousios, G., Blincoe, K., Singer, L., German, D.M., Damian, D.: The promises and perils of mining github. In: Proceedings of the 11th Working Conference on Mining Software Repositories, pp. 92\u2013101 (2014)","DOI":"10.1145\/2597073.2597074"},{"issue":"5","key":"621_CR44","doi-asserted-by":"publisher","first-page":"2035","DOI":"10.1007\/s10664-015-9393-5","volume":"21","author":"E Kalliamvakou","year":"2016","unstructured":"Kalliamvakou, E., Gousios, G., Blincoe, K., Singer, L., German, D.M., Damian, D.: An in-depth study of the promises and perils of mining github. Empir. Softw. Eng. 21(5), 2035\u20132071 (2016)","journal-title":"Empir. Softw. Eng."},{"key":"621_CR45","doi-asserted-by":"crossref","unstructured":"Kery, M.B., Myers, B.A.: Exploring exploratory programming. In: 2017 IEEE Symposium on Visual Languages and Human-Centric Computing (VL\/HCC), pp. 25\u201329 (2017). IEEE","DOI":"10.1109\/VLHCC.2017.8103446"},{"key":"621_CR46","doi-asserted-by":"crossref","unstructured":"Kery, M.B., Horvath, A., Myers, B.A.: Variolite: Supporting exploratory programming by data scientists. In: CHI, vol. 10, pp. 3025453\u20133025626 (2017)","DOI":"10.1145\/3025453.3025626"},{"key":"621_CR47","doi-asserted-by":"crossref","unstructured":"Kery, M.B., Radensky, M., Arya, M., John, B.E., Myers, B.A.: The story in the notebook: Exploratory data science using a literate programming tool. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1\u201311 (2018)","DOI":"10.1145\/3173574.3173748"},{"key":"621_CR48","doi-asserted-by":"publisher","unstructured":"Kitchenham, B.A., Pfleeger, S.L.: Personal opinion surveys. In: Guide to Advanced Empirical Software Engineering, pp. 63\u201392. Springer, London, UK (2008). https:\/\/doi.org\/10.1007\/978-1-84800-044-5_3","DOI":"10.1007\/978-1-84800-044-5_3"},{"key":"621_CR49","doi-asserted-by":"publisher","first-page":"31866","DOI":"10.1109\/ACCESS.2023.3262138","volume":"11","author":"D Kreuzberger","year":"2023","unstructured":"Kreuzberger, D., K\u00fchl, N., Hirschl, S.: Machine learning operations (mlops): Overview, definition, and architecture. IEEE access. 11, 31866\u201331879 (2023)","journal-title":"IEEE access."},{"issue":"1","key":"621_CR50","doi-asserted-by":"publisher","first-page":"37","DOI":"10.3233\/DS-190026","volume":"3","author":"A-L Lamprecht","year":"2020","unstructured":"Lamprecht, A.-L., Garcia, L., Kuzak, M., Martinez, C., Arcila, R., Martin Del Pico, E., Dominguez Del Angel, V., Van De Sandt, S., Ison, J., Martinez, P.A., et al.: Towards fair principles for research software. Data Science. 3(1), 37\u201359 (2020)","journal-title":"Data Science."},{"key":"621_CR51","doi-asserted-by":"crossref","unstructured":"Lamprecht, A.-L., Martinez-Ortiz, C., Barker, M., Bartholomew, S.L., Barton, J., Chue\u00a0Hong, N., Cohen, J., Druskat, S., Forest, J., Grad, J.-N., et al.: What do we (not) know about research software engineering? J. Open Res. Softw. 10(1) (2022)","DOI":"10.5334\/jors.384"},{"key":"621_CR52","doi-asserted-by":"crossref","unstructured":"Leng, J.: The development of research software engineering as a profession. Open Access Government, 278\u2013279 (2023)","DOI":"10.56367\/OAG-039-10687"},{"key":"621_CR53","doi-asserted-by":"crossref","unstructured":"Lu, Q., Zhu, L., Xu, X., Whittle, J., Douglas, D., Sanderson, C.: Software engineering for responsible ai: An empirical study and operationalised patterns. In: Proceedings of the 44th International Conference on Software Engineering: Software Engineering in Practice, pp. 241\u2013242 (2022)","DOI":"10.1145\/3510457.3513063"},{"issue":"5","key":"621_CR54","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1109\/MCSE.2023.3260211","volume":"24","author":"A Malviya-Thakur","year":"2023","unstructured":"Malviya-Thakur, A., Bernholdt, D.E., Godoy, W.F., Watson, G.R., Doucet, M., Coletti, M.A., Rogers, D.M., McDonnell, M., Billings, J.J., Maccabe, B.: Research software engineering at oak ridge national laboratory. Comput. Sci. Eng. 24(5), 14\u201323 (2023)","journal-title":"Comput. Sci. Eng."},{"issue":"2","key":"621_CR55","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3487043","volume":"31","author":"S Mart\u00ednez-Fern\u00e1ndez","year":"2022","unstructured":"Mart\u00ednez-Fern\u00e1ndez, S., Bogner, J., Franch, X., Oriol, M., Siebert, J., Trendowicz, A., Vollmer, A.M., Wagner, S.: Software engineering for ai-based systems: a survey. ACM Trans. Softw. Eng. Methodol. (TOSEM). 31(2), 1\u201359 (2022)","journal-title":"ACM Trans. Softw. Eng. Methodol. (TOSEM)."},{"key":"621_CR56","unstructured":"Milewicz, R., Bisila, J., Mundt, M., Teves, J.: Seeking enlightenment: Incorporating evidence-based practice techniques in a research software engineering team (2024). arXiv preprint arXiv:2403.16827"},{"issue":"4","key":"621_CR57","doi-asserted-by":"publisher","first-page":"1085","DOI":"10.1007\/s43681-023-00289-2","volume":"4","author":"J M\u00f6kander","year":"2024","unstructured":"M\u00f6kander, J., Schuett, J., Kirk, H.R., Floridi, L.: Auditing large language models: a three-layered approach. AI and Ethics. 4(4), 1085\u20131115 (2024)","journal-title":"AI and Ethics."},{"key":"621_CR58","doi-asserted-by":"publisher","first-page":"3219","DOI":"10.1007\/s10664-017-9512-6","volume":"22","author":"N Munaiah","year":"2017","unstructured":"Munaiah, N., Kroh, S., Cabrey, C., Nagappan, M.: Curating github for engineered software projects. Empir. Softw. Eng. 22, 3219\u20133253 (2017)","journal-title":"Empir. Softw. Eng."},{"key":"621_CR59","doi-asserted-by":"publisher","first-page":"1386720","DOI":"10.3389\/fdata.2024.1386720","volume":"7","author":"C Negri-Ribalta","year":"2024","unstructured":"Negri-Ribalta, C., Geraud-Stewart, R., Sergeeva, A., Lenzini, G.: A systematic literature review on the impact of ai models on the security of code generation. Front. Big Data. 7, 1386720 (2024)","journal-title":"Front. Big Data."},{"key":"621_CR60","unstructured":"Nijkamp, E., Pang, B., Hayashi, H., Tu, L., Wang, H., Zhou, Y., Savarese, S., Xiong, C.: Codegen: An open large language model for code with multi-turn program synthesis (2022). arXiv preprint arXiv:2203.13474"},{"issue":"6","key":"621_CR61","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3483424","volume":"12","author":"P Notaro","year":"2021","unstructured":"Notaro, P., Cardoso, J., Gerndt, M.: A survey of aiops methods for failure management. ACM Trans. Intell. Syst. Technol. (TIST). 12(6), 1\u201345 (2021)","journal-title":"ACM Trans. Intell. Syst. Technol. (TIST)."},{"issue":"6654","key":"621_CR62","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1126\/science.adh2586","volume":"381","author":"S Noy","year":"2023","unstructured":"Noy, S., Zhang, W.: Experimental evidence on the productivity effects of generative artificial intelligence. Science 381(6654), 187\u2013192 (2023)","journal-title":"Science"},{"key":"621_CR63","doi-asserted-by":"crossref","unstructured":"Odeh, A.: Exploring ai innovations in automated software source code generation: Progress, hurdles, and future paths. Informatica. 48(8) (2024)","DOI":"10.31449\/inf.v48i8.5291"},{"issue":"6060","key":"621_CR64","doi-asserted-by":"publisher","first-page":"1226","DOI":"10.1126\/science.1213847","volume":"334","author":"RD Peng","year":"2011","unstructured":"Peng, R.D.: Reproducible research in computational science. Science 334(6060), 1226\u20131227 (2011)","journal-title":"Science"},{"key":"621_CR65","doi-asserted-by":"crossref","unstructured":"Penzenstadler, B., Bauer, V., Calero, C., Franch, X.: Sustainability in software engineering: A systematic literature review. In: 16th International Conference on Evaluation & Assessment in Software Engineering (EASE 2012), pp. 32\u201341 (2012). IET","DOI":"10.1049\/ic.2012.0004"},{"key":"621_CR66","doi-asserted-by":"crossref","unstructured":"Perry, N., Srivastava, M., Kumar, D., Boneh, D.: Do users write more insecure code with ai assistants? In: Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security, pp. 2785\u20132799 (2023)","DOI":"10.1145\/3576915.3623157"},{"issue":"12","key":"621_CR67","doi-asserted-by":"publisher","first-page":"1002802","DOI":"10.1371\/journal.pcbi.1002802","volume":"8","author":"A Prli\u0107","year":"2012","unstructured":"Prli\u0107, A., Procter, J.B.: Ten simple rules for the open development of scientific software. PLoS Comput. Biol. 8(12), 1002802 (2012)","journal-title":"PLoS Comput. Biol."},{"key":"621_CR68","doi-asserted-by":"crossref","unstructured":"Ray, P.P.: A review on vibe coding: Fundamentals, state-of-the-art, challenges and future directions. Authorea Preprints. (2025)","DOI":"10.36227\/techrxiv.174681482.27435614\/v1"},{"key":"621_CR69","doi-asserted-by":"publisher","first-page":"42200","DOI":"10.1109\/ACCESS.2020.2976199","volume":"8","author":"R Roscher","year":"2020","unstructured":"Roscher, R., Bohn, B., Duarte, M.F., Garcke, J.: Explainable machine learning for scientific insights and discoveries. Ieee Access. 8, 42200\u201342216 (2020)","journal-title":"Ieee Access."},{"key":"621_CR70","unstructured":"Russell, S.J., Norvig, P.: Artificial intelligence: A modern approach, global edition 4e. (2021)"},{"issue":"5","key":"621_CR71","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3652154","volume":"33","author":"D Russo","year":"2024","unstructured":"Russo, D.: Navigating the complexity of generative ai adoption in software engineering. ACM Trans. Softw. Eng. Methodol. 33(5), 1\u201350 (2024)","journal-title":"ACM Trans. Softw. Eng. Methodol."},{"key":"621_CR72","unstructured":"Sculley, D., Holt, G., Golovin, D., Davydov, E., Phillips, T., Ebner, D., Chaudhary, V., Young, M., Crespo, J.-F., Dennison, D.: Hidden technical debt in machine learning systems. Adv. Neural Inf. Process. Syst. 28 (2015)"},{"issue":"6","key":"621_CR73","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1109\/MS.2022.3196208","volume":"39","author":"A Serebrenik","year":"2022","unstructured":"Serebrenik, A., Staron, M., Cabot, J., Penzenstadler, B., Hochstein, L., Carver, J.C.: Ai engineering research in software engineering venues. IEEE Softw. 39(6), 105\u2013108 (2022)","journal-title":"IEEE Softw."},{"key":"621_CR74","doi-asserted-by":"publisher","first-page":"86","DOI":"10.7717\/peerj-cs.86","volume":"2","author":"AM Smith","year":"2016","unstructured":"Smith, A.M., Katz, D.S., Niemeyer, K.E.: Software citation principles. PeerJ Comput. Sci. 2, 86 (2016)","journal-title":"PeerJ Comput. Sci."},{"key":"621_CR75","doi-asserted-by":"publisher","first-page":"147","DOI":"10.7717\/peerj-cs.147","volume":"4","author":"AM Smith","year":"2018","unstructured":"Smith, A.M., Niemeyer, K.E., Katz, D.S., Barba, L.A., Githinji, G., Gymrek, M., Huff, K.D., Madan, C.R., Mayes, A.C., Moerman, K.M., et al.: Journal of open source software (joss): design and first-year review. PeerJ Comput. Sci. 4, 147 (2018)","journal-title":"PeerJ Comput. Sci."},{"key":"621_CR76","doi-asserted-by":"crossref","unstructured":"Sochat, V., May, N., Cosden, I., Martinez-Ortiz, C., Bartholomew, S.: The research software encyclopedia: a community framework to define research software. J. Open Res. Softw. (2022)","DOI":"10.5334\/jors.359"},{"key":"621_CR77","unstructured":"Sommerville, I.: Software engineering (ed.). America: Pearson Education Inc. (2011)"},{"key":"621_CR78","doi-asserted-by":"crossref","unstructured":"Souza, M.R., Haines, R., Vigo, M., Jay, C.: What makes research software sustainable? an interview study with research software engineers. In: 2019 IEEE\/ACM 12th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE), pp. 135\u2013138 (2019). IEEE","DOI":"10.1109\/CHASE.2019.00039"},{"key":"621_CR79","doi-asserted-by":"crossref","unstructured":"Spearman, C.: The proof and measurement of association between two things. (1961)","DOI":"10.1037\/11491-005"},{"key":"621_CR80","volume-title":"AI-Assisted Programming: Better Planning, Coding, Testing, and Deployment","author":"T Taulli","year":"2024","unstructured":"Taulli, T.: AI-Assisted Programming: Better Planning, Coding, Testing, and Deployment. O\u2019Reilly Media Inc, Sebastopol, CA (2024)"},{"key":"621_CR81","doi-asserted-by":"crossref","unstructured":"Tenquist, M., Azman, A., Meaden, R., Onikan, A., Jay, C., Banerji, A.: Recommendations for developing effective inclusivity initiatives in research software engineering. Comput. Sci. Eng. (2025)","DOI":"10.1109\/MCSE.2025.3539076"},{"key":"621_CR82","unstructured":"The Institute of Electrical and Electronics Engineers (IEEE): IEEE Taxonomy for 2025. Version 2025 \u2013 IEEE Taxonomy; available from IEEE Standards Association (2025)"},{"key":"621_CR83","unstructured":"Tistelgr\u00e9n, S.: Artificial intelligence in software development: Exploring utilisation, tools, and value creation. (2024)"},{"issue":"1","key":"621_CR84","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1038\/s41597-022-01143-6","volume":"9","author":"A Trisovic","year":"2022","unstructured":"Trisovic, A., Lau, M.K., Pasquier, T., Crosas, M.: A large-scale study on research code quality and execution. Scientific Data. 9(1), 60 (2022)","journal-title":"Scientific Data."},{"issue":"1","key":"621_CR85","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/sdata.2016.18","volume":"3","author":"MD Wilkinson","year":"2016","unstructured":"Wilkinson, M.D., Dumontier, M., Aalbersberg, I.J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., Silva Santos, L.B., Bourne, P.E., et al.: The fair guiding principles for scientific data management and stewardship. Scientific data. 3(1), 1\u20139 (2016)","journal-title":"Scientific data."},{"issue":"1","key":"621_CR86","doi-asserted-by":"publisher","first-page":"1001745","DOI":"10.1371\/journal.pbio.1001745","volume":"12","author":"G Wilson","year":"2014","unstructured":"Wilson, G., Aruliah, D.A., Brown, C.T., Chue Hong, N.P., Davis, M., Guy, R.T., Haddock, S.H., Huff, K.D., Mitchell, I.M., Plumbley, M.D., et al.: Best practices for scientific computing. PLoS Biol. 12(1), 1001745 (2014)","journal-title":"PLoS Biol."},{"issue":"6","key":"621_CR87","doi-asserted-by":"publisher","first-page":"1005510","DOI":"10.1371\/journal.pcbi.1005510","volume":"13","author":"G Wilson","year":"2017","unstructured":"Wilson, G., Bryan, J., Cranston, K., Kitzes, J., Nederbragt, L., Teal, T.K.: Good enough practices in scientific computing. PLoS Comput. Biol. 13(6), 1005510 (2017)","journal-title":"PLoS Comput. Biol."},{"issue":"6","key":"621_CR88","doi-asserted-by":"publisher","first-page":"888","DOI":"10.3390\/e25060888","volume":"25","author":"M-F Wong","year":"2023","unstructured":"Wong, M.-F., Guo, S., Hang, C.-N., Ho, S.-W., Tan, C.-W.: Natural language generation and understanding of big code for ai-assisted programming: A review. Entropy 25(6), 888 (2023)","journal-title":"Entropy"},{"key":"621_CR89","unstructured":"Yang, X., Zhang, K., Chen, H., Petzold, L., Wang, W.Y., Cheng, W.: Zero-shot detection of machine-generated codes (2023). arXiv preprint arXiv:2310.05103"},{"key":"621_CR90","doi-asserted-by":"crossref","unstructured":"Ye, T., Du, Y., Ma, T., Wu, L., Zhang, X., Ji, S., Wang, W.: Uncovering llm-generated code: A zero-shot synthetic code detector via code rewriting. In: AAAI Conference on Artificial Intelligence, vol. 39, pp. 968\u2013976 (2025)","DOI":"10.1609\/aaai.v39i1.32082"},{"key":"621_CR91","doi-asserted-by":"crossref","unstructured":"Zhao, Z., Koulouzis, S., Bianchi, R., Farshidi, S., Shi, Z., Xin, R., Wang, Y., Li, N., Shi, Y., Timmermans, J., et al.: Notebook-as-a-vre (naavre): From private notebooks to a collaborative cloud virtual research environment. Software: Practice and Experience. 52(9), 1947\u20131966 (2022)","DOI":"10.1002\/spe.3098"},{"key":"621_CR92","doi-asserted-by":"crossref","unstructured":"Zhou, Y., Yu, Y., Ding, B.: Towards mlops: A case study of ml pipeline platform. In: International Conference on Artificial Intelligence and Computer Engineering (ICAICE), pp. 494\u2013500 (2020). IEEE","DOI":"10.1109\/ICAICE51518.2020.00102"}],"container-title":["Automated Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10515-026-00621-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10515-026-00621-0","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10515-026-00621-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T22:59:32Z","timestamp":1781650772000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10515-026-00621-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,4]]},"references-count":92,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,11]]}},"alternative-id":["621"],"URL":"https:\/\/doi.org\/10.1007\/s10515-026-00621-0","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-7178452\/v1","asserted-by":"object"}]},"ISSN":["0928-8910","1573-7535"],"issn-type":[{"value":"0928-8910","type":"print"},{"value":"1573-7535","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,4]]},"assertion":[{"value":"21 July 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 April 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 May 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"79"}}