{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,27]],"date-time":"2026-06-27T02:36:29Z","timestamp":1782527789512,"version":"3.54.5"},"publisher-location":"Gdansk, Poland; Belgrade, Serbia","reference-count":47,"publisher":"University of Gdansk, Department of Business Informatics & University of Belgrade, Faculty of Organizational Sciences","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"DOI":"10.62036\/isd.2025.25","type":"proceedings-article","created":{"date-parts":[[2025,11,19]],"date-time":"2025-11-19T00:45:28Z","timestamp":1763513128000},"source":"Crossref","is-referenced-by-count":2,"title":["How did the Emergence of ChatGPT Impact Stack Overflow? \ufffd A Literature Review"],"prefix":"10.62036","author":[{"given":"Daniel","family":"Staegemann","sequence":"first","affiliation":[{"name":"Otto-von-Guericke University Magdeburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mariia","family":"Rizun","sequence":"additional","affiliation":[{"name":"University of Economics in Katowice, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christian","family":"Haertel","sequence":"additional","affiliation":[{"name":"Otto-von-Guericke University Magdeburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthias","family":"Pohl","sequence":"additional","affiliation":[{"name":"German Aerospace Center (DLR), Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christian","family":"Daase","sequence":"additional","affiliation":[{"name":"Otto-von-Guericke University Magdeburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Klaus","family":"Turowski","sequence":"additional","affiliation":[{"name":"Otto-von-Guericke University Magdeburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"48375","published-online":{"date-parts":[[2025,11,17]]},"reference":[{"key":"ref0","doi-asserted-by":"publisher","unstructured":"1. Adarkwah, M.A., Islam, A.Y.M.A., Schneider, K., Luckin, R., Thomas, M., Spector, J.M.: Are Preprints a Threat to the Credibility and Quality of Artificial Intelligence Literature in the ChatGPT Era? A Scoping Review and Qualitative Study. International Journal of Human- Computer Interaction, 1-14 (2024)","DOI":"10.1080\/10447318.2024.2364140"},{"key":"ref1","doi-asserted-by":"publisher","first-page":"58364","DOI":"10.1109\/ACCESS.2025.3554627","article-title":"A Bibliometric Exposition and Review on Leveraging LLMs for Programming Education","volume":"13","author":"Amos","year":"2025","unstructured":"2. Amos, J.P., Amodu, O.A., Raja Mahmood, R.A., Abdulqudus, A.B., Zakaria, A.F., Iyanda, A.R., Bukar, U.A., Hanapi, Z.M.: A Bibliometric Exposition and Review on Leveraging LLMs for Programming Education. IEEE Access 13, 58364-58393 (2025)","journal-title":"IEEE Access"},{"key":"ref2","unstructured":"3. Association for Information Systems: AIS eLibrary, https:\/\/aisel.aisnet.org\/ [27.04.2025] (2025)"},{"key":"ref3","doi-asserted-by":"publisher","unstructured":"4. Bappon, S.D., Mondal, S., Roy, B.: AUTOGENICS: Automated Generation of Context-Aware Inline Comments for Code Snippets on Programming Q&A Sites Using LLM. In: 2024 IEEE International Conference on Source Code Analysis and Manipulation (SCAM), pp. 24-35. IEEE (2024)","DOI":"10.1109\/SCAM63643.2024.00013"},{"key":"ref4","doi-asserted-by":"publisher","unstructured":"5. Beau, N., Crabb\u00e9, B.: CodeInsight: A Curated Dataset of Practical Coding Solutions from Stack Overflow. In: Findings of the Association for Computational Linguistics ACL 2024, pp. 5935-5947. Association for Computational Linguistics, Stroudsburg, PA, USA (2024)","DOI":"10.18653\/v1\/2024.findings-acl.354"},{"key":"ref5","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1108\/ILS-10-2023-0163","article-title":"Programming education and learner motivation in the age of generative AI: student and educator perspectives","volume":"126","author":"Boguslawski","year":"2025","unstructured":"6. Boguslawski, S., Deer, R., Dawson, M.G.: Programming education and learner motivation in the age of generative AI: student and educator perspectives. ILS 126, 91-109 (2025)","journal-title":"ILS"},{"key":"ref6","unstructured":"7. Brendel, A.B., Trang, S.T.N., Marrone, M., Lichtenberg, S., Kolbe, L.: What to do for a Literature Review? -A Synthesis of Literature Review Practices. In: Proceedings of the AMCIS 2020 (2020)"},{"key":"ref7","doi-asserted-by":"publisher","unstructured":"8. Brynjolfsson, E., Li, D., Raymond, L.: Generative AI at Work. National Bureau of Economic Research, Cambridge, MA (2023)","DOI":"10.3386\/w31161"},{"key":"ref8","unstructured":"9. Bui, Q.N., Tu, Qiang (John), Liu, H., Aube, J., Chen, H., Song, Y., Hu, J., Lv, Y., Li, L.: Adoption of Artificial Intelligence in Online Communities: A Socio-Technical Perspective. In: Proceedings of the Twenty-Ninth DIGIT Workshop (2024)"},{"key":"ref9","doi-asserted-by":"publisher","unstructured":"10. Burtch, G., Lee, D., Chen, Z.: The consequences of generative AI for online knowledge communities. Scientific reports 14, 10413 (2024)","DOI":"10.1038\/s41598-024-61221-0"},{"key":"ref10","doi-asserted-by":"publisher","unstructured":"11. Chang, Y., Wang, X., Wang, J., Wu, Y., Yang, L., Zhu, K., Chen, H., Yi, X., Wang, C., Wang, Y., et al.: A Survey on Evaluation of Large Language Models. ACM Trans. Intell. Syst. Technol. 15, 1-45 (2024)","DOI":"10.1145\/3641289"},{"key":"ref11","unstructured":"12. Clarivate: Web of Science, https:\/\/www.webofscience.com [27.04.2025] (2025)"},{"key":"ref12","unstructured":"13. Cornell Tech: arXiv, https:\/\/arxiv.org\/ [27.04.2025] (2025)"},{"key":"ref13","doi-asserted-by":"publisher","unstructured":"14. Danescu-Niculescu-Mizil, C., West, R., Jurafsky, D., Leskovec, J., Potts, C.: No country for old members. In: Proceedings of the 22nd international conference on World Wide Web, pp. 307- 318. ACM, New York, NY, USA (2013)","DOI":"10.1145\/2488388.2488416"},{"key":"ref14","doi-asserted-by":"publisher","unstructured":"15. Del Rio-Chanona, R.M., Laurentsyeva, N., Wachs, J.: Large language models reduce public knowledge sharing on online Q&A platforms. PNAS nexus 3, pgae400 (2024)","DOI":"10.1093\/pnasnexus\/pgae400"},{"key":"ref15","unstructured":"16. Elsevier: Scopus, https:\/\/www.scopus.com [27.04.2025] (2025)"},{"key":"ref16","doi-asserted-by":"publisher","unstructured":"17. Fang, Z., Huang, Y.: \"Math is a pain!\": Understanding challenges and needs of the Machine Learning community on Stack Overflow. Proc. ACM Hum.-Comput. Interact. 8, 1-35 (2024)","DOI":"10.1145\/3686990"},{"key":"ref17","unstructured":"18. Filippucci, F., Gal, P., Jona-Lasinio, C., Leandro, A., Nicoletti, G.: The impact of Artificial Intelligence on productivity, distribution and growth: Key mechanisms, initial evidence and policy challenges (2024)"},{"key":"ref18","doi-asserted-by":"publisher","unstructured":"19. Garcia, M.B., Revano, T.F., Maaliw, R.R., Lagrazon, P.G.G., Valderama, A.M.C., Happonen, A., Qureshi, B., Yilmaz, R.: Exploring Student Preference between AI-Powered ChatGPT and Human-Curated Stack Overflow in Resolving Programming Problems and Queries. In: 2023 IEEE 15th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment, and Management (HNICEM), pp. 1-6. IEEE (2023)","DOI":"10.1109\/HNICEM60674.2023.10589162"},{"key":"ref19","unstructured":"20. Guo, B., Zhang, X., Wang, Z., Jiang, M., Nie, J., Ding, Y., Yue, J., Wu, Y.: How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detection. arXiv preprint arXiv:2301.07597 (2023)"},{"key":"ref20","doi-asserted-by":"publisher","unstructured":"21. Huang, L., Yu, W., Ma, W., Zhong, W., Feng, Z., Wang, H., Chen, Q., Peng, W., Feng, X., Qin, B., et al.: A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions. ACM Trans. Inf. Syst. (2024)","DOI":"10.1145\/3703155"},{"key":"ref21","unstructured":"22. Institute of Electrical and Electronics Engineers: IEEE Xplore, https:\/\/ieeexplore.ieee.org [27.04.2025] (2025)"},{"key":"ref22","doi-asserted-by":"publisher","unstructured":"23. Jahi\u0107, J., Sami, A.: State of Practice: LLMs in Software Engineering and Software Architecture. In: 2024 IEEE 21st International Conference on Software Architecture Companion (ICSA-C), pp. 311-318. IEEE (2024)","DOI":"10.1109\/ICSA-C63560.2024.00059"},{"key":"ref23","doi-asserted-by":"publisher","unstructured":"24. Kabir, S., Udo-Imeh, D.N., Kou, B., Zhang, T.: Is Stack Overflow Obsolete? An Empirical Study of the Characteristics of ChatGPT Answers to Stack Overflow Questions. In: Proceedings of the CHI Conference on Human Factors in Computing Systems, pp. 1-17. ACM, New York, NY, USA (2024)","DOI":"10.1145\/3613904.3642596"},{"key":"ref24","doi-asserted-by":"publisher","first-page":"2577","DOI":"10.1007\/s11846-022-00588-8","article-title":"Literature reviews as independent studies: guidelines for academic practice","volume":"16","author":"Kraus","year":"2022","unstructured":"25. Kraus, S., Breier, M., Lim, W.M., Dabi\u0107, M., Kumar, S., Kanbach, D., Mukherjee, D., Corvello, V., Pi\u00f1eiro-Chousa, J., Liguori, E., et al.: Literature reviews as independent studies: guidelines for academic practice. Rev Manag Sci 16, 2577-2595 (2022)","journal-title":"Rev Manag Sci"},{"key":"ref25","doi-asserted-by":"publisher","unstructured":"26. Li, X., Kim, K.: Impacts of generative AI on user contributions: evidence from a coding Q &A platform. Mark Lett (2024)","DOI":"10.1007\/s11002-024-09747-1"},{"key":"ref26","doi-asserted-by":"publisher","unstructured":"27. Liu, J., Tang, X., Li, L., Chen, P., Liu, Y.: ChatGPT vs. Stack Overflow: An Exploratory Comparison of Programming Assistance Tools. In: 2023 IEEE 23rd International Conference on Software Quality, Reliability, and Security Companion (QRS-C), pp. 364-373. IEEE (2023)","DOI":"10.1109\/QRS-C60940.2023.00105"},{"key":"ref27","doi-asserted-by":"publisher","unstructured":"28. Lomshakov, V., Kovalchuk, S., Omelchenko, M., Nikolenko, S., Aliev, A.: Fine-Tuning Large Language Models for Answering Programming Questions with Code Snippets. In: Miky\u0161ka, J., Mulatier, C. de, Paszynski, M., Krzhizhanovskaya, V.V., Dongarra, J.J., Sloot, P.M. (eds.) Computational Science - ICCS 2023, vol. 14074, pp. 171-179. Springer Nature Switzerland, Cham (2023)","DOI":"10.1007\/978-3-031-36021-3_15"},{"key":"ref28","doi-asserted-by":"publisher","unstructured":"29. Moutidis, I., Williams, H.T.P.: Community evolution on Stack Overflow. PloS one 16, e0253010 (2021)","DOI":"10.1371\/journal.pone.0253010"},{"key":"ref29","doi-asserted-by":"publisher","unstructured":"30. Mustafa, S., Zhang, W., Naveed, M.M.: What motivates online community contributors to contribute consistently? A case study on Stackoverflow netizens. Current psychology (New Brunswick, N.J.) 42, 10468-10481 (2023)","DOI":"10.1007\/s12144-022-03307-4"},{"key":"ref30","doi-asserted-by":"publisher","first-page":"879","DOI":"10.17705\/1CAIS.03743","article-title":"A Guide to Conducting a Standalone Systematic Literature Review","volume":"37","author":"Okoli","year":"2015","unstructured":"31. Okoli, C.: A Guide to Conducting a Standalone Systematic Literature Review. CAIS 37, 879- 910 (2015)","journal-title":"CAIS"},{"key":"ref31","doi-asserted-by":"publisher","unstructured":"32. Page, M.J., Moher, D., Bossuyt, P.M., Boutron, I., Hoffmann, T.C., Mulrow, C.D., Shamseer, L., Tetzlaff, J.M., Akl, E.A., Brennan, S.E., et al.: PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews. BMJ (Clinical research ed.) 372, n160 (2021)","DOI":"10.1136\/bmj.n160"},{"key":"ref32","doi-asserted-by":"publisher","unstructured":"33. Park, A., Kim, T.: Code suggestions and explanations in programming learning: Use of ChatGPT and performance. The International Journal of Management Education 23, 101119 (2025)","DOI":"10.1016\/j.ijme.2024.101119"},{"key":"ref33","doi-asserted-by":"publisher","unstructured":"34. Perkovi\u0107, G., Drobnjak, A., Boti\u010dki, I.: Hallucinations in LLMs: Understanding and Addressing Challenges. In: 2024 47th MIPRO ICT and Electronics Convention (MIPRO), pp. 2084-2088. IEEE (2024)","DOI":"10.1109\/MIPRO60963.2024.10569238"},{"key":"ref34","doi-asserted-by":"publisher","unstructured":"35. Pudari, R., Zhou, S., Ahmed, I., Dai, Z., Zhou, S.: Aligning Documentation and Q&A Forum through Constrained Decoding with Weak Supervision. In: 2023 IEEE International Conference on Software Maintenance and Evolution (ICSME), pp. 346-351. IEEE (2023)","DOI":"10.1109\/ICSME58846.2023.00043"},{"key":"ref35","doi-asserted-by":"publisher","first-page":"26839","DOI":"10.1109\/ACCESS.2024.3365742","article-title":"A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges","volume":"12","author":"Raiaan","year":"2024","unstructured":"36. Raiaan, M.A.K., Mukta, M.S.H., Fatema, K., Fahad, N.M., Sakib, S., Mim, M.M.J., Ahmad, J., Ali, M.E., Azam, S.: A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges. IEEE Access 12, 26839-26874 (2024)","journal-title":"IEEE Access"},{"key":"ref36","doi-asserted-by":"publisher","unstructured":"37. Rasnayaka, S., Wang, G., Shariffdeen, R., Iyer, G.N.: An Empirical Study on Usage and Perceptions of LLMs in a Software Engineering Project. In: Proceedings of the 1st International Workshop on Large Language Models for Code, pp. 111-118. ACM, New York (2024) 38. Shan, G., Pienta, D., Thatcher, J.B.: Investigating the Relative Impact of Generative AI vs. Humans on Voluntary Knowledge Contributions. In: Proceedings of the 57th Hawaii International Conference on System Sciences, pp. 7490-7499 (2024)","DOI":"10.1145\/3643795.3648379"},{"key":"ref37","unstructured":"39. Simons, W., Turrini, A., Vivian, L.: Artificial Intelligence: Economic Impact, Opportunities, Challenges, Implications for Policy (2024)"},{"key":"ref38","unstructured":"40. Springer Nature: Springer Nature Link, https:\/\/link.springer.com\/ [27.04.2025] (2025)"},{"key":"ref39","unstructured":"41. Stack Overflow: Stack Overflow, https:\/\/stackoverflow.com [26.04.2025] (2025)"},{"key":"ref40","doi-asserted-by":"publisher","unstructured":"42. Tayeb, A., Alahmadi, M., Tajik, E., Haiduc, S.: Investigating Developers' Preferences for Learning and Issue Resolution Resources in the ChatGPT Era. In: 2024 IEEE International Conference on Software Maintenance and Evolution (ICSME), pp. 413-425. IEEE (2024)","DOI":"10.1109\/ICSME58944.2024.00045"},{"key":"ref41","doi-asserted-by":"publisher","unstructured":"43. Tona, C., Ju\u00e1rez-Ram\u00edrez, R., Jim\u00e9nez, S., Dur\u00e1n, M.: Exploring LLM Tools Through the Eyes of Industry Experts and Novice Programmers. In: 2024 12th International Conference in Software Engineering Research and Innovation (CONISOFT), pp. 313-321. IEEE (2024)","DOI":"10.1109\/CONISOFT63288.2024.00048"},{"key":"ref42","unstructured":"44. vom Brocke, J., Simons, A., Niehaves, B., Reimer, K., Plattfaut, R., Cleven, A.: Reconstructing the Giant: On the Importance of Rigour in Documenting the Literature Search Process. In: Proceedings of the ECIS 2009 (2009)"},{"key":"ref43","doi-asserted-by":"publisher","unstructured":"45. vom Brocke, J., Simons, A., Riemer, K., Niehaves, B., Plattfaut, R., Cleven, A.: Standing on the Shoulders of Giants: Challenges and Recommendations of Literature Search in Information Systems Research. CAIS 37 (2015)","DOI":"10.17705\/1CAIS.03709"},{"key":"ref44","unstructured":"46. Xiao, X., Chen, K., Yan, Z.: Human Reaction to GenAI Threats: A Perspective of Protection Motivation Theory. In: PACIS 2024 Proceedings (2024)"},{"key":"ref45","doi-asserted-by":"publisher","unstructured":"47. Xu, B., Nguyen, T.-D., Le-Cong, T., Hoang, T., Liu, J., Kim, K., Gong, C., Niu, C., Wang, C., Le, B., et al.: Are We Ready to Embrace Generative AI for Software Q&A? In: 2023 38th IEEE\/ACM International Conference on Automated Software Engineering (ASE), pp. 1713- 1717. IEEE (2023)","DOI":"10.1109\/ASE56229.2023.00023"},{"key":"ref46","unstructured":"48. Xue, J., Wang, L., Zheng, J., Li, Y., Tan, Y.: ChatGPT Is A User-Generated Knowledge-Sharing Killer. In: Proceedings of the Forty-Fourth International Conference on Information Systems (2023)"}],"event":{"name":"33rd International Conference on Information Systems Development","location":"Belgrade, Serbia","acronym":"ISD 2025","start":{"date-parts":[[2025,9,3]]},"end":{"date-parts":[[2025,9,5]]}},"container-title":["International Conference on Information Systems Development","Proceedings of the 33rd International Conference on Information Systems Development"],"original-title":[],"link":[{"URL":"https:\/\/aisel.aisnet.org\/cgi\/viewcontent.cgi?article=1666&context=isd2014&unstamped=1","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,19]],"date-time":"2025-11-19T17:53:43Z","timestamp":1763574823000},"score":1,"resource":{"primary":{"URL":"https:\/\/aisel.aisnet.org\/isd2014\/proceedings2025\/agile\/10"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,17]]},"references-count":47,"URL":"https:\/\/doi.org\/10.62036\/isd.2025.25","relation":{},"ISSN":["2938-5202"],"issn-type":[{"value":"2938-5202","type":"print"}],"subject":[],"published":{"date-parts":[[2025,11,17]]}}}