{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,20]],"date-time":"2025-06-20T15:04:07Z","timestamp":1750431847879,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":43,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,5,29]],"date-time":"2023-05-29T00:00:00Z","timestamp":1685318400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,5,29]]},"DOI":"10.1145\/3592813.3592927","type":"proceedings-article","created":{"date-parts":[[2023,6,26]],"date-time":"2023-06-26T22:18:05Z","timestamp":1687817885000},"page":"372-379","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["On Challenges and Opportunities of Using Continuous Experimentation in the Engineering of Contemporary Software Systems"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1502-7703","authenticated-orcid":false,"given":"Bruno Pedra\u00e7a","family":"Souza","sequence":"first","affiliation":[{"name":"COPPE\/UFRJ, Federal University of Rio de Janeiro, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9502-1362","authenticated-orcid":false,"given":"Paulo S\u00e9rgio Medeiros","family":"Santos","sequence":"additional","affiliation":[{"name":"Federal University of the State of Rio de Janeiro, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4258-0424","authenticated-orcid":false,"given":"Guilherme Horta","family":"Travassos","sequence":"additional","affiliation":[{"name":"Federal University of Rio de Janeiro, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,6,26]]},"reference":[{"volume-title":"Travassos, 2018. On challenges in engineering IoT software systems. Proceedings of the XXXII Brazilian Symposium on Software Engineering.","author":"Motta Rebeca C.","key":"e_1_3_2_1_1_1","unstructured":"Rebeca C. Motta , K\u00e1thia M. de Oliveira and Guilherme H . Travassos, 2018. On challenges in engineering IoT software systems. Proceedings of the XXXII Brazilian Symposium on Software Engineering. Rebeca C. Motta, K\u00e1thia M. de Oliveira and Guilherme H. Travassos, 2018. On challenges in engineering IoT software systems. Proceedings of the XXXII Brazilian Symposium on Software Engineering."},{"volume-title":"Travassos, 2019. Towards the description and representation of smartness in IoT scenarios specification. Proceedings of the XXXIII Brazilian Symposium on Software Engineering.","author":"de Souza Bruno P.","key":"e_1_3_2_1_2_1","unstructured":"Bruno P. de Souza , Rebeca C. Motta and Guilherme H . Travassos, 2019. Towards the description and representation of smartness in IoT scenarios specification. Proceedings of the XXXIII Brazilian Symposium on Software Engineering. Bruno P. de Souza, Rebeca C. Motta and Guilherme H. Travassos, 2019. Towards the description and representation of smartness in IoT scenarios specification. Proceedings of the XXXIII Brazilian Symposium on Software Engineering."},{"key":"e_1_3_2_1_3_1","volume-title":"Travassos","author":"Matalonga Santiago","year":"2022","unstructured":"Santiago Matalonga , Domenico Amalfitano , Andrea Doreste , Anna R. Fasolino and Guilherme H . Travassos , 2022 . Alternatives for testing context-aware software systems in non-academic settings: results from a Rapid Review. Information and Software Technology. Santiago Matalonga, Domenico Amalfitano, Andrea Doreste, Anna R. Fasolino and Guilherme H. Travassos, 2022. Alternatives for testing context-aware software systems in non-academic settings: results from a Rapid Review. Information and Software Technology."},{"volume-title":"Travassos, 2019. An IoT-based scenario description inspection technique. Proceedings of the XXXIII Brazilian Symposium on Software Quality.","author":"de Souza Bruno P.","key":"e_1_3_2_1_4_1","unstructured":"Bruno P. de Souza , Rebeca C. Motta and Guilherme H . Travassos, 2019. An IoT-based scenario description inspection technique. Proceedings of the XXXIII Brazilian Symposium on Software Quality. Bruno P. de Souza, Rebeca C. Motta and Guilherme H. Travassos, 2019. An IoT-based scenario description inspection technique. Proceedings of the XXXIII Brazilian Symposium on Software Quality."},{"key":"e_1_3_2_1_5_1","volume-title":"Frank Schnicke Thomas Kuhn and Peter Liggesmeyer","author":"Nakagawa Elisa Y.","year":"2022","unstructured":"Elisa Y. Nakagawa , Pablo O. Antonino , Frank Schnicke Thomas Kuhn and Peter Liggesmeyer , 2022 . Continuous Systems and Software Engineering for Industry 4.0: A disruptive view. Information and Software Technology . Elisa Y. Nakagawa, Pablo O. Antonino, Frank Schnicke Thomas Kuhn and Peter Liggesmeyer, 2022. Continuous Systems and Software Engineering for Industry 4.0: A disruptive view. Information and Software Technology."},{"key":"e_1_3_2_1_6_1","volume-title":"International Conference on Product-Focused Software Process Improvement. Springer","author":"Helena","year":"2019","unstructured":"Helena H. Olsson and Jan Bosch, 2019. Data-driven development: Challenges in online, embedded, and on-premise software . International Conference on Product-Focused Software Process Improvement. Springer , Cham , 2019 . Helena H. Olsson and Jan Bosch, 2019. Data-driven development: Challenges in online, embedded, and on-premise software. International Conference on Product-Focused Software Process Improvement. Springer, Cham, 2019."},{"key":"e_1_3_2_1_7_1","first-page":"140","volume-title":"Henne","author":"Kohavi Ron","year":"2009","unstructured":"Ron Kohavi , Roger Longbotham , Dan Sommerfield , and Randal M . Henne , 2009 . Controlled experiments on the web: survey and practical guide.\" Data mining and knowledge discovery, pp. 140 - 181 . Ron Kohavi, Roger Longbotham, Dan Sommerfield, and Randal M. Henne, 2009. Controlled experiments on the web: survey and practical guide.\" Data mining and knowledge discovery, pp. 140-181."},{"key":"e_1_3_2_1_8_1","first-page":"26","volume-title":"Hanna M\u00e4enp\u00e4\u00e4 and J\u00fcrgen M\u00fcnch","author":"Fagerholm Fabian","year":"2014","unstructured":"Fabian Fagerholm , Alejandro S. Guinea , Hanna M\u00e4enp\u00e4\u00e4 and J\u00fcrgen M\u00fcnch , 2014 . Building blocks for continuous experimentation. RCoSE 2014: Proceedings of the 1st International Workshop on Rapid Continuous Software Engineering , pp. 26 \u2013 35. Fabian Fagerholm, Alejandro S. Guinea, Hanna M\u00e4enp\u00e4\u00e4 and J\u00fcrgen M\u00fcnch, 2014. Building blocks for continuous experimentation. RCoSE 2014: Proceedings of the 1st International Workshop on Rapid Continuous Software Engineering, pp. 26 \u2013 35."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2016.03.034"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/SEAA.2012.54"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/SEAA.2015.63"},{"key":"e_1_3_2_1_12_1","volume-title":"Bj\u00f6rn Regnell and Anders Wessl\u00e9n","author":"Wohlin Claes","year":"2012","unstructured":"Claes Wohlin , Per Runeson , Martin H\u00f6st , Magnus C. Ohlsson , Bj\u00f6rn Regnell and Anders Wessl\u00e9n , 2012 . Experimentation in Software Engineering. Springer Science & Business Media . Claes Wohlin, Per Runeson, Martin H\u00f6st, Magnus C. Ohlsson, Bj\u00f6rn Regnell and Anders Wessl\u00e9n, 2012. Experimentation in Software Engineering. Springer Science & Business Media."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.5753\/jserd.2019.14"},{"key":"e_1_3_2_1_14_1","volume-title":"Travassos","author":"Biolchini Jorge","year":"2005","unstructured":"Jorge Biolchini , Paula G. Mian , Ana C. C. Natali and Guilherme H . Travassos , 2005 . Systematic Review in Software Engineering. System Engineering and Computer Science Department COPPE\/UFRJ , Technical Report. Jorge Biolchini, Paula G. Mian, Ana C. C. Natali and Guilherme H. Travassos, 2005. Systematic Review in Software Engineering. System Engineering and Computer Science Department COPPE\/UFRJ, Technical Report."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.14236\/ewic\/EASE2008.8"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/SEAA.2018.00062"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2020.110781"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2018.111094748"},{"volume-title":"Trustworthy online controlled experiments: A practical guide to a\/b testing","author":"Tang Diane","key":"e_1_3_2_1_19_1","unstructured":"Kohavi, Ron, Diane Tang , and Ya Xu , 2020. Trustworthy online controlled experiments: A practical guide to a\/b testing . Cambridge University Press . Kohavi, Ron, Diane Tang, and Ya Xu, 2020. Trustworthy online controlled experiments: A practical guide to a\/b testing. Cambridge University Press."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2017.86"},{"key":"e_1_3_2_1_21_1","first-page":"1","volume-title":"G\u00f3mez-Uribe and Neil Hunt","author":"Carlos","year":"2016","unstructured":"Carlos A. G\u00f3mez-Uribe and Neil Hunt , 2016 . The Netflix recommender system: Algorithms, business value, and innovation. ACM Transactions on Management Information Systems (TMIS) , pp. 1 - 19 . Carlos A. G\u00f3mez-Uribe and Neil Hunt, 2016. The Netflix recommender system: Algorithms, business value, and innovation. ACM Transactions on Management Information Systems (TMIS), pp.1-19."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487575.2488217"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2012.01.009"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmsy.2015.04.008"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2022.3184710"},{"key":"e_1_3_2_1_26_1","first-page":"254","volume-title":"Testing context-aware software systems: Unchain the context, set it free! Proceedings of the XXXI Brazilian Symposium on Software Engineering","author":"Matalonga Santiago","unstructured":"Santiago Matalonga , Guilherme H. Travassos , 2017. Testing context-aware software systems: Unchain the context, set it free! Proceedings of the XXXI Brazilian Symposium on Software Engineering , pp. 250\u2013 254 . Santiago Matalonga, Guilherme H. Travassos, 2017. Testing context-aware software systems: Unchain the context, set it free! Proceedings of the XXXI Brazilian Symposium on Software Engineering, pp. 250\u2013254."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-34026-0_3"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2962695.2962709"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2017.07.009"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3194760.3194766"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601248.2601268"},{"key":"e_1_3_2_1_32_1","first-page":"528","volume-title":"Rombach","author":"Victor","year":"1994","unstructured":"Victor R. Basili and Dieter H . Rombach , 1994 . The goal question metric approach. Encyclopedia of software engineering , pp. 528 - 532 . Victor R. Basili and Dieter H. Rombach, 1994. The goal question metric approach. Encyclopedia of software engineering, pp. 528-532."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2021.3066330"},{"key":"e_1_3_2_1_34_1","volume-title":"Intelligent transportation systems for smart cities: a progress review.\u00a0Science China Information Sciences,\u00a055(12), 2908-2914","author":"D.","year":"2012","unstructured":"Xiong, Z., Sheng, H., Rong, W., & Cooper, D. E. ( 2012 ). Intelligent transportation systems for smart cities: a progress review.\u00a0Science China Information Sciences,\u00a055(12), 2908-2914 . Xiong, Z., Sheng, H., Rong, W., & Cooper, D. E. (2012). Intelligent transportation systems for smart cities: a progress review.\u00a0Science China Information Sciences,\u00a055(12), 2908-2914."},{"key":"e_1_3_2_1_35_1","first-page":"1","volume-title":"Proceedings of XXV Congresso Ibero-Americano em Engenharia de Software (CIbSE)","author":"Erthal Vladimir","unstructured":"Vladimir Erthal , Bruno P. de Souza , Paulo S. M. Santos and Guilherme Horta Travassos, 2022. A Literature Study to Characterize Continuous Experimentation in Software Engineering . Proceedings of XXV Congresso Ibero-Americano em Engenharia de Software (CIbSE) , pp. 1 - 15 . Vladimir Erthal, Bruno P. de Souza, Paulo S. M. Santos and Guilherme Horta Travassos, 2022. A Literature Study to Characterize Continuous Experimentation in Software Engineering. Proceedings of XXV Congresso Ibero-Americano em Engenharia de Software (CIbSE), pp. 1-15."},{"key":"e_1_3_2_1_36_1","volume-title":"On the pragmatic design of literature studies in software engineering: an experience-based guideline. Empir Software Eng 22, 2852\u20132891","author":"Daneva D.M.","year":"2017","unstructured":"Kuhrmann, M., Fern\u00e1ndez, D.M. & Daneva , M. On the pragmatic design of literature studies in software engineering: an experience-based guideline. Empir Software Eng 22, 2852\u20132891 ( 2017 ). Kuhrmann, M., Fern\u00e1ndez, D.M. & Daneva, M. On the pragmatic design of literature studies in software engineering: an experience-based guideline. Empir Software Eng 22, 2852\u20132891 (2017)."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/ITSC.2016.7795942"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSA.2017.36"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/SEAA.2017.15"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-65831-5_6"},{"key":"e_1_3_2_1_41_1","first-page":"292","volume-title":"Agile Processes in Software Engineering and Extreme Programming","author":"Olsson Helena H.","year":"2018","unstructured":"S5 - Helena H. Olsson , 2018 . Challenges and strategies for undertaking continuous experimentation to embedded systems: Industry and research perspectives . Agile Processes in Software Engineering and Extreme Programming , pp. 277\u2013 292 . S5 - Helena H. Olsson, 2018. Challenges and strategies for undertaking continuous experimentation to embedded systems: Industry and research perspectives. Agile Processes in Software Engineering and Extreme Programming, pp. 277\u2013292."},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/SEAA.2019.00028"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/SEAA51224.2020.00026"}],"event":{"name":"SBSI '23: XIX Brazilian Symposium on Information Systems","acronym":"SBSI '23","location":"Macei\u00f3 Brazil"},"container-title":["Proceedings of the XIX Brazilian Symposium on Information Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3592813.3592927","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3592813.3592927","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:17Z","timestamp":1750182557000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3592813.3592927"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,29]]},"references-count":43,"alternative-id":["10.1145\/3592813.3592927","10.1145\/3592813"],"URL":"https:\/\/doi.org\/10.1145\/3592813.3592927","relation":{},"subject":[],"published":{"date-parts":[[2023,5,29]]},"assertion":[{"value":"2023-06-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}