{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:27:22Z","timestamp":1750220842922,"version":"3.41.0"},"reference-count":20,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2019,11,14]],"date-time":"2019-11-14T00:00:00Z","timestamp":1573689600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGSOFT Softw. Eng. Notes"],"published-print":{"date-parts":[[2019,11,14]]},"abstract":"<jats:p>The rapid pace with which software needs to be built, together with the increasing need to evaluate changes for end users both quantitatively and qualitatively calls for novel software engineering approaches that focus on short release cycles, continuous deployment and delivery, experiment-driven feature development, feedback from users, and rapid tool-assisted feedback to developers. To realize these approaches there is a need for research and innovation with respect to automation and tooling, and furthermore for research into the organizational changes that support flexible data-driven decision-making in the development lifecycle. Most importantly, deep synergies are needed between software engineers, managers, and data scientists. This paper reports on the results of the joint 5th International Workshop on Rapid Continuous Software Engineering (RCoSE 2019) and the 1st International Workshop on Data-Driven Decisions, Experimentation and Evolution (DDrEE 2019), which focuses on the challenges and potential solutions in the area of continuous data-driven software engineering.<\/jats:p>","DOI":"10.1145\/3356773.3356811","type":"journal-article","created":{"date-parts":[[2019,11,14]],"date-time":"2019-11-14T22:07:36Z","timestamp":1573769256000},"page":"60-64","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Continuous Data-driven Software Engineering - Towards a Research Agenda"],"prefix":"10.1145","volume":"44","author":[{"given":"Ilias","family":"Gerostathopoulos","sequence":"first","affiliation":[{"name":"Technical University Munich, Munich, Germany"}]},{"given":"Marco","family":"Konersmann","sequence":"additional","affiliation":[{"name":"University of Koblenz-Landau, Mainz, Germany"}]},{"given":"Stephan","family":"Krusche","sequence":"additional","affiliation":[{"name":"Technical University Munich, Munich, Germany"}]},{"given":"David I.","family":"Mattos","sequence":"additional","affiliation":[{"name":"Chalmers University of Technology, Goteborg, Sweden"}]},{"given":"Jan","family":"Bosch","sequence":"additional","affiliation":[{"name":"Chalmers University of Technology, Goteborg, Sweden"}]},{"given":"Tomas","family":"Bures","sequence":"additional","affiliation":[{"name":"Charles University in Prague, , Czech Rep"}]},{"given":"Brian","family":"Fitzgerald","sequence":"additional","affiliation":[{"name":"University of Limerick, Limerick , Ireland"}]},{"given":"Michael","family":"Goedicke","sequence":"additional","affiliation":[{"name":"University of Duisburg-Essen, Duisburg, Germany"}]},{"given":"Henry","family":"Muccini","sequence":"additional","affiliation":[{"name":"University of L'Aquila, L'Aquila, Italy"}]},{"given":"Helena H.","family":"Olsson","sequence":"additional","affiliation":[{"name":"Malm\u00f6 University, Malm\u00f6, Sweden"}]},{"given":"Thomas","family":"Brand","sequence":"additional","affiliation":[{"name":"University of Potsdam, Potsdam, Germany"}]},{"given":"Robert","family":"Chatley","sequence":"additional","affiliation":[{"name":"Imperial College London, London, England UK"}]},{"given":"Nikolaos","family":"Diamantopoulos","sequence":"additional","affiliation":[{"name":"Independent"}]},{"given":"Arik","family":"Friedman","sequence":"additional","affiliation":[{"name":"Atlassian, Sydney, Australia"}]},{"given":"Miguel","family":"Jim\u00e9nez","sequence":"additional","affiliation":[{"name":"University of Victoria, Victoria, Canada"}]},{"given":"Jan Ole","family":"Johanssen","sequence":"additional","affiliation":[{"name":"Technical University Munich, Munich, Germany"}]},{"given":"Putra","family":"Manggala","sequence":"additional","affiliation":[{"name":"Shopify, Canada"}]},{"given":"Masumi","family":"Koseki","sequence":"additional","affiliation":[{"name":"Hitachi, Tokyo, Japan"}]},{"given":"Jorge","family":"Melegati","sequence":"additional","affiliation":[{"name":"Free University of Bozen-Bolzano, Bolzano, Italy"}]},{"given":"Nuthan","family":"Munaiah","sequence":"additional","affiliation":[{"name":"Rochester Institute of Technology, Rochester, NY, USA"}]},{"given":"Gabriel","family":"Tamura","sequence":"additional","affiliation":[{"name":"Universidad Icesi, Cauca, Colombia"}]},{"given":"Vasileios","family":"Theodorou","sequence":"additional","affiliation":[{"name":"Intracom Telecom, Athens, Greece"}]},{"given":"Jeffrey","family":"Wong","sequence":"additional","affiliation":[{"name":"Netflix, Los Gatos, CA, USA"}]},{"given":"Iris","family":"Figalist","sequence":"additional","affiliation":[{"name":"Siemens, Munich, Germany"}]}],"member":"320","published-online":{"date-parts":[[2020,10,22]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Current State of Research on Continuous Experimentation: A Systematic Mapping Study. SEAA'18","author":"Auer F.","year":"2018","unstructured":"Auer , F. and Felderer , M . 2018 . Current State of Research on Continuous Experimentation: A Systematic Mapping Study. SEAA'18 ( 2018 ), 11. Auer, F. and Felderer, M. 2018. Current State of Research on Continuous Experimentation: A Systematic Mapping Study. SEAA'18 (2018), 11."},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of InternationalWorkshop on Software-intensive Business: Start-ups, Ecosystems and Platforms (SiBW 2018)","author":"Bosch J.","year":"2018","unstructured":"Bosch , J. et al. 2018. It Takes Three to Tango: Requirement, Outcome\/data, and AI Driven Development . Proceedings of InternationalWorkshop on Software-intensive Business: Start-ups, Ecosystems and Platforms (SiBW 2018) ( 2018 ), 16. Bosch, J. et al. 2018. It Takes Three to Tango: Requirement, Outcome\/data, and AI Driven Development. Proceedings of InternationalWorkshop on Software-intensive Business: Start-ups, Ecosystems and Platforms (SiBW 2018) (2018), 16."},{"key":"e_1_2_1_3_1","volume-title":"USA","author":"Chatley R.","year":"2019","unstructured":"Chatley , R. 2019 . Supporting the Developer Experience with Production Metrics. RCoSE\/DDrEE 2019 (Piscataway, NJ , USA , 2019), 8--11. Chatley, R. 2019. Supporting the Developer Experience with Production Metrics. RCoSE\/DDrEE 2019 (Piscataway, NJ, USA, 2019), 8--11."},{"key":"e_1_2_1_4_1","volume-title":"Proc. of ICSE 2017 (IEEE","author":"Fabijan A.","year":"2017","unstructured":"Fabijan , A. et al. 2017. The evolution of continuous experimentation in software product development: from data to a data-driven organization at scale . Proc. of ICSE 2017 (IEEE , 2017 ), 770--780. Fabijan, A. et al. 2017. The evolution of continuous experimentation in software product development: from data to a data-driven organization at scale. Proc. of ICSE 2017 (IEEE, 2017), 770--780."},{"key":"e_1_2_1_5_1","unstructured":"Fabijan A. et al. Three Key Checklists and Remedies for Trustworthy Analysis of Online Controlled Experiments at Scale. 10.  Fabijan A. et al. Three Key Checklists and Remedies for Trustworthy Analysis of Online Controlled Experiments at Scale. 10."},{"key":"e_1_2_1_6_1","unstructured":"Feature Toggles (aka Feature Flags): https:\/\/martinfowler.com\/articles\/feature-toggles.html. Accessed: 2019-08--30.  Feature Toggles (aka Feature Flags): https:\/\/martinfowler.com\/articles\/feature-toggles.html. Accessed: 2019-08--30."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2015.06.063"},{"key":"e_1_2_1_8_1","volume-title":"Design and Product Metrics. Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems","author":"Flaounas I.","year":"2019","unstructured":"Flaounas , I. and Friedman , A . 2019. Bridging the Gap Between Business , Design and Product Metrics. Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems ( New York, NY, USA , 2019 ), LBW0274:1--LBW0274:6. Flaounas, I. and Friedman, A. 2019. Bridging the Gap Between Business, Design and Product Metrics. Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2019), LBW0274:1--LBW0274:6."},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the 30th Australian Conference on Computer- Human Interaction","author":"Friedman A.","year":"2018","unstructured":"Friedman , A. and Flaounas , I . 2018. The Right Metric for the Right Stakeholder: A Case Study of Improving Product Usability . Proceedings of the 30th Australian Conference on Computer- Human Interaction ( New York, NY, USA , 2018 ), 602--606. Friedman, A. and Flaounas, I. 2018. The Right Metric for the Right Stakeholder: A Case Study of Improving Product Usability. Proceedings of the 30th Australian Conference on Computer- Human Interaction (New York, NY, USA, 2018), 602--606."},{"key":"e_1_2_1_10_1","volume-title":"USA","author":"Jim\u00e9nez M.","year":"2019","unstructured":"Jim\u00e9nez , M. et al. 2019. An Architectural Framework for Qualitydriven Adaptive Continuous Experimentation. RCoSE\/DDrEE 2019 (Piscataway, NJ , USA , 2019 ), 20--23. Jim\u00e9nez, M. et al. 2019. An Architectural Framework for Qualitydriven Adaptive Continuous Experimentation. RCoSE\/DDrEE 2019 (Piscataway, NJ, USA, 2019), 20--23."},{"key":"e_1_2_1_11_1","volume-title":"USA","author":"Johanssen J.O.","year":"2019","unstructured":"Johanssen , J.O. et al. 2019. Continuous Thinking Aloud. RCoSE\/DDrEE 2019 (Piscataway, NJ , USA , 2019 ), 12--15. Johanssen, J.O. et al. 2019. Continuous Thinking Aloud. RCoSE\/DDrEE 2019 (Piscataway, NJ, USA, 2019), 12--15."},{"key":"e_1_2_1_12_1","volume-title":"et al","author":"Kaufman R.L.","year":"2017","unstructured":"Kaufman , R.L. et al . 2017 . Democratizing online controlled experiments at Booking .com. arXiv:1710.08217 [cs]. (Oct. 2017). Kaufman, R.L. et al. 2017. Democratizing online controlled experiments at Booking.com. arXiv:1710.08217 [cs]. (Oct. 2017)."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-008-0114-1"},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '14","author":"Kohavi R.","year":"2014","unstructured":"Kohavi , R. et al. 2014. Seven rules of thumb for web site experimenters . Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '14 ( New York, New York, USA , 2014 ), 1857--1866. Kohavi, R. et al. 2014. Seven rules of thumb for web site experimenters. Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '14 (New York, New York, USA, 2014), 1857--1866."},{"key":"e_1_2_1_15_1","volume-title":"USA","author":"Melegati J.","year":"2019","unstructured":"Melegati , J. et al. 2019. Hypotheses Engineering: First Essential Steps of Experiment-driven Software Development. RCoSE\/DDrEE 2019 (Piscataway, NJ , USA , 2019 ), 16--19. Melegati, J. et al. 2019. Hypotheses Engineering: First Essential Steps of Experiment-driven Software Development. RCoSE\/DDrEE 2019 (Piscataway, NJ, USA, 2019), 16--19."},{"key":"e_1_2_1_16_1","first-page":"1","article-title":"Data-driven Insights from Vulnerability Discovery Metrics","volume":"2019","author":"Munaiah N.","year":"2019","unstructured":"Munaiah , N. and Meneely , A. 2019 . Data-driven Insights from Vulnerability Discovery Metrics . RCoSE\/DDrEE 2019 (2019), 1 -- 7 . Munaiah, N. and Meneely, A. 2019. Data-driven Insights from Vulnerability Discovery Metrics. RCoSE\/DDrEE 2019 (2019), 1-- 7.","journal-title":"RCoSE\/DDrEE"},{"key":"e_1_2_1_17_1","volume-title":"2012 38th Euromicro Conference on Software Engineering and Advanced Applications (Sep.","author":"Olsson H.H.","year":"2012","unstructured":"Olsson , H.H. et al. 2012. Climbing the \"Stairway to Heaven\" -- A Mulitiple-Case Study Exploring Barriers in the Transition from Agile Development towards Continuous Deployment of Software . 2012 38th Euromicro Conference on Software Engineering and Advanced Applications (Sep. 2012 ), 392--399. Olsson, H.H. et al. 2012. Climbing the \"Stairway to Heaven\" -- A Mulitiple-Case Study Exploring Barriers in the Transition from Agile Development towards Continuous Deployment of Software. 2012 38th Euromicro Conference on Software Engineering and Advanced Applications (Sep. 2012), 392--399."},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","unstructured":"Olsson H.H. and Bosch J. 2014. The HYPEX Model: From Opinions to Data-Driven Software Development. Continuous Software Engineering. J. Bosch ed. Springer International Publishing. 155--164.  Olsson H.H. and Bosch J. 2014. The HYPEX Model: From Opinions to Data-Driven Software Development. Continuous Software Engineering. J. Bosch ed. Springer International Publishing. 155--164.","DOI":"10.1007\/978-3-319-11283-1_13"},{"key":"e_1_2_1_19_1","volume-title":"USA","author":"Theodorou V.","year":"2019","unstructured":"Theodorou , V. and Diamantopoulos , N . 2019. GLT: Edge Gateway ELT for Data-driven Intelligence Placement. RCoSE\/DDrEE 2019 (Piscataway, NJ , USA , 2019 ), 24--27. Theodorou, V. and Diamantopoulos, N. 2019. GLT: Edge Gateway ELT for Data-driven Intelligence Placement. RCoSE\/DDrEE 2019 (Piscataway, NJ, USA, 2019), 24--27."},{"key":"e_1_2_1_20_1","volume-title":"et al","author":"Villegas N.M.","year":"2013","unstructured":"Villegas , N.M. et al . 2013 . DYNAMICO : A reference model for governing control objectives and context relevance in self-adaptive software systems. Software Engineering for Self-Adaptive Systems II. Springer . 265--293. Villegas, N.M. et al. 2013. DYNAMICO: A reference model for governing control objectives and context relevance in self-adaptive software systems. Software Engineering for Self-Adaptive Systems II. Springer. 265--293."}],"container-title":["ACM SIGSOFT Software Engineering Notes"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3356773.3356811","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3356773.3356811","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:22:55Z","timestamp":1750202575000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3356773.3356811"}},"subtitle":["Report on the Joint 5th International Workshop on Rapid Continuous Software Engineering (RCoSE 2019) and 1st International Works"],"short-title":[],"issued":{"date-parts":[[2019,11,14]]},"references-count":20,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2019,11,14]]}},"alternative-id":["10.1145\/3356773.3356811"],"URL":"https:\/\/doi.org\/10.1145\/3356773.3356811","relation":{},"ISSN":["0163-5948"],"issn-type":[{"type":"print","value":"0163-5948"}],"subject":[],"published":{"date-parts":[[2019,11,14]]},"assertion":[{"value":"2020-10-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}