{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T15:15:11Z","timestamp":1783782911682,"version":"3.55.0"},"reference-count":57,"publisher":"Association for Computing Machinery (ACM)","issue":"7","license":[{"start":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T00:00:00Z","timestamp":1783728000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"funder":[{"name":"Electronic Components and Systems for European Leadership Joint Undertaking (ECSEL-JU) through the project AIDOaRt","award":["grant agreement No. 101007350"],"award-info":[{"award-number":["grant agreement No. 101007350"]}]},{"name":"Key Digital Technologies Joint Undertaking (KDT-JU) through the project MATISSE","award":["grant agreement No. 101140216"],"award-info":[{"award-number":["grant agreement No. 101140216"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2026,7,31]]},"abstract":"<jats:p>In recent years, the growing complexity of ICT projects and the increasing need for effective multi-stakeholder collaboration have prompted the search for innovative methods to enhance project outcomes. This article proposes a structured methodology for integrating hackathons into the lifecycle of ICT collaborative multi-partner research projects. Drawing on our experience with the ECSEL Joint Undertaking AIDOaRt project, we demonstrate how a series of internally organized hackathons can serve as effective tools for fostering stakeholder engagement, accelerating innovation, and aligning project activities with strategic objectives. Our approach involves a clearly defined process comprising a pre-hackathon phase for challenge definition, intensive hackathon sessions for collaborative solution development, and a post-hackathon phase for iterative refinement. Quantitative analysis of challenge evolution and participant engagement, together with qualitative feedback from a questionnaire survey, reveals that iterative hackathon cycles not only enhance technical outcomes, such as rapid prototyping and tool integration, but also promote sustained collaboration among industry and academic partners. The article concludes with risks, lessons learned, and practical guidelines to support the adoption of our hackathon-based methodology in multi-partner research projects, highlighting their potential to manage complexity, drive innovation in the ICT ecosystem, and foster continuous and effective collaboration among stakeholders.<\/jats:p>","DOI":"10.1145\/3771552","type":"journal-article","created":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T14:51:19Z","timestamp":1760367079000},"page":"1-49","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Foster the Use of Hackathons in Collaborative Research Projects: Methodology, Experience Report, and Lesson Learned"],"prefix":"10.1145","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9872-9542","authenticated-orcid":false,"given":"Claudio","family":"Di Sipio","sequence":"first","affiliation":[{"name":"University of L\u2019Aquila, L'Aquila, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3572-5875","authenticated-orcid":false,"given":"Romina","family":"Eramo","sequence":"additional","affiliation":[{"name":"University of Teramo, Teramo, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2220-8326","authenticated-orcid":false,"given":"Vittoriano","family":"Muttillo","sequence":"additional","affiliation":[{"name":"Department of Communication Science, Universit\u00e0 degli Studi di Teramo, Teramo, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9622-5949","authenticated-orcid":false,"given":"Riccardo","family":"Rubei","sequence":"additional","affiliation":[{"name":"University of L\u2019Aquila, L'Aquila, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,7,11]]},"reference":[{"key":"e_1_3_3_2_2","unstructured":"Empirical Standards for Software Engineering Research. Retrieved May 25 2024 from https:\/\/www2.sigsoft.org\/EmpiricalStandards\/form_generator\/Checklist.html"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.micpro.2018.05.010"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.5555\/3103551"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.micpro.2022.104672"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-25264-3_23"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.23919\/DATE64628.2025.10993046"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/SysCon61195.2024.10553610"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/SysCon61195.2024.10553610"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1108\/10650751111106528"},{"key":"e_1_3_3_11_2","author":"Ganguli Sanjit","year":"2019","unstructured":"Sanjit Ganguli, Charley Rich, and Pankaj Prasad. 2019. Market Guide for AIOps Platforms. ID G00378587.","journal-title":"Market Guide for AIOps Platforms"},{"key":"e_1_3_3_12_2","unstructured":"Henry William Chesbrough. 2003. Open Innovation: The New Imperative for Creating and Profiting from Technology. Harvard Business School Press Boston 222 + xxxi."},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2007.08.020"},{"key":"e_1_3_3_14_2","volume-title":"Quasi-Experimentation: Design and Analysis Issues for Field Settings","author":"Cook Thomas D.","year":"1979","unstructured":"Thomas D. Cook and D. T. Campbell. 1979. Quasi-Experimentation: Design and Analysis Issues for Field Settings. Houghton Mifflin."},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/MODELS-C59198.2023.00146"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-023-01102-8"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/DCIS.2014.7035584"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/3585059.3611440"},{"issue":"4","key":"e_1_3_3_19_2","first-page":"37","article-title":"Agile management for software engineering","volume":"6","author":"Duncan Scott","year":"2004","unstructured":"Scott Duncan. 2004. Agile management for software engineering. Software Quality Professional 6, 4 (2004), 37.","journal-title":"Software Quality Professional"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1093\/scipol\/scab010"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2016.68"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2024.107500"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/J.JSS.2024.112180"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445198"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2024.3455092"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","unstructured":"Anna Filippova Erik Trainer and James Herbsleb. 2017. From Diversity by Numbers to Diversity as Process: Supporting Inclusiveness in Software Development Teams with Brainstorming. DOI: 10.1184\/R1\/6622319.v1","DOI":"10.1184\/R1\/6622319.v1"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2015.06.063"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/3431806"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2022.2075601arXiv:2206.04744"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-32584-7_3"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/DCIS62603.2024.10769196"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1186\/s13731-023-00269-0"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSR52588.2021.00020"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/2962695.2962707"},{"key":"e_1_3_3_35_2","volume-title":"Time Series Anomaly Detection for DevOpsTest Systems","author":"K\u00e5n\u00e5hols Gustav","year":"2024","unstructured":"Gustav K\u00e5n\u00e5hols. 2024. Time Series Anomaly Detection for DevOpsTest Systems. Bachelor\u2019s Thesis. M\u00e4lardalen University."},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-26619-6_23"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2014.78"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2025.3550665"},{"key":"e_1_3_3_39_2","volume-title":"Augment Decision Making in DevOps Using AI Techniques, ID G00383246","author":"Bhat Charley Rich Manjunath","year":"2019","unstructured":"Charley Rich Manjunath Bhat. 2019. Augment Decision Making in DevOps Using AI Techniques, ID G00383246. Technical Report. Gartner Research."},{"key":"e_1_3_3_40_2","volume-title":"REFSQ Workshops","author":"Mennig Patrick","year":"2020","unstructured":"Patrick Mennig and Frank Elberzhager. 2020. How to gather requirements from the crowd with hackathons\u2014Challenges, experiences and opportunities. In REFSQ Workshops."},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-020-00814-5"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2025.107806"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3691620.3695058"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compeleceng.2023.108803"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/3274398"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2019.01.012"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.micpro.2019.05.013"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/3450329.3476861"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.scico.2023.103047"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/RE51729.2021.00040"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.23919\/DATE.2019.8715247"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2851384"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2006.58"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1186\/s13012-020-01041-8"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/3697789.3697797"},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2014.03.041"},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/3644032.3644452"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2025.107681"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3771552","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T15:04:26Z","timestamp":1783782266000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3771552"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,11]]},"references-count":57,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2026,7,31]]}},"alternative-id":["10.1145\/3771552"],"URL":"https:\/\/doi.org\/10.1145\/3771552","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,11]]},"assertion":[{"value":"2025-04-11","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-10-06","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-07-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}