{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,26]],"date-time":"2025-03-26T17:52:33Z","timestamp":1743011553957,"version":"3.40.3"},"publisher-location":"Cham","reference-count":26,"publisher":"Springer International Publishing","isbn-type":[{"type":"print","value":"9783030588571"},{"type":"electronic","value":"9783030588588"}],"license":[{"start":{"date-parts":[[2020,1,1]],"date-time":"2020-01-01T00:00:00Z","timestamp":1577836800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,9,24]],"date-time":"2020-09-24T00:00:00Z","timestamp":1600905600000},"content-version":"vor","delay-in-days":267,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020]]},"abstract":"<jats:title>Abstract<\/jats:title>\n<jats:p><jats:bold>Context:<\/jats:bold> DevOps is an increasingly popular approach to software development and software operations. Being understood as mutually integrated, both activities have been re-united under one single label. In contrast to traditional software development activities, DevOps promotes numerous fundamental changes, and the area of software testing is not an exception. Yet, the exact appearance of software testing within DevOps is poorly understood, so is the notion of TestOps. <jats:bold>Objective:<\/jats:bold> This paper explores TestOps as a concept rooted in industrial practice. <jats:bold>Method:<\/jats:bold> To provide a pluralist outline of practitioners\u2019 views on <jats:italic>What is TestOps<\/jats:italic>, the YouTube platform was searched for digital content containing either \u201cTestOps\u201d or \u201cDevTestOps\u201d in the content title. Through a qualitative lens, the resulting set was systematically annotated and thematically analyzed in an inductive manner. <jats:bold>Results:<\/jats:bold> Referring to DevOps, practitioners use the notion of TestOps when characterizing a conceptual shift that occurs within the area of software testing. As a matter of fact, two dominant categories were found in the data: (i) TestOps as a new organizational philosophy; (ii) TestOps as an innovative software technique (i.e. process supported by technology). A set of high-level themes within each of these categories was identified and described. <jats:bold>Conclusion:<\/jats:bold> The study outlines an inconsistency in practitioner perspectives on the nature of TestOps. To decrease the identified conceptual ambiguity, the proposed model posits two complementary meanings of TestOps.<\/jats:p>","DOI":"10.1007\/978-3-030-58858-8_26","type":"book-chapter","created":{"date-parts":[[2020,9,23]],"date-time":"2020-09-23T18:02:34Z","timestamp":1600884154000},"page":"253-261","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Defining TestOps: Collaborative Behaviors and Technology-Driven Workflows Seen as Enablers of Effective Software Testing in DevOps"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5963-5145","authenticated-orcid":false,"given":"Michal","family":"Dole\u017eel","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,9,24]]},"reference":[{"key":"26_CR1","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1007\/978-3-030-06019-0_7","volume-title":"Software Engineering Aspects of Continuous Development and New Paradigms of Software Production and Deployment","author":"F Erich","year":"2019","unstructured":"Erich, F.: DevOps is simply interaction between development and operations. In: Bruel, J.-M., Mazzara, M., Meyer, B. (eds.) DEVOPS 2018. LNCS, vol. 11350, pp. 89\u201399. Springer, Cham (2019). \nhttps:\/\/doi.org\/10.1007\/978-3-030-06019-0_7"},{"key":"26_CR2","doi-asserted-by":"crossref","unstructured":"Stahl, D., Martensson, T., Bosch, J.: Continuous practices and DevOps: beyond the buzz, what does it all mean? In: SEAA, pp. 440\u2013448 (2017)","DOI":"10.1109\/SEAA.2017.8114695"},{"key":"26_CR3","series-title":"Lecture Notes in Business Information Processing","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1007\/978-3-319-18612-2_19","volume-title":"Agile Processes, in Software Engineering, and Extreme Programming","author":"LE Lwakatare","year":"2015","unstructured":"Lwakatare, L.E., Kuvaja, P., Oivo, M.: Dimensions of DevOps. In: Lassenius, C., Dings\u00f8yr, T., Paasivaara, M. (eds.) XP 2015. LNBIP, vol. 212, pp. 212\u2013217. Springer, Cham (2015). \nhttps:\/\/doi.org\/10.1007\/978-3-319-18612-2_19"},{"key":"26_CR4","doi-asserted-by":"publisher","first-page":"176","DOI":"10.1016\/j.jss.2015.06.063","volume":"123","author":"B Fitzgerald","year":"2017","unstructured":"Fitzgerald, B., Stol, K.-J.: Continuous software engineering: a roadmap and agenda. J. Syst. Softw. 123, 176\u2013189 (2017)","journal-title":"J. Syst. Softw."},{"key":"26_CR5","series-title":"Lecture Notes in Business Information Processing","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1007\/978-3-030-30126-2_2","volume-title":"Agile Processes in Software Engineering and Extreme Programming \u2013 Workshops","author":"NB Moe","year":"2019","unstructured":"Moe, N.B., Stray, V., Hoda, R.: Trends and updated research agenda for autonomous agile teams: a summary of the second international workshop at XP2019. In: Hoda, R. (ed.) XP 2019. LNBIP, vol. 364, pp. 13\u201319. Springer, Cham (2019). \nhttps:\/\/doi.org\/10.1007\/978-3-030-30126-2_2"},{"key":"26_CR6","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1145\/2524713.2524721","volume":"56","author":"J Roche","year":"2013","unstructured":"Roche, J.: Adopting DevOps practices in quality assurance. Commun. ACM 56, 38\u201343 (2013)","journal-title":"Commun. ACM"},{"key":"26_CR7","doi-asserted-by":"crossref","unstructured":"Cruzes, D.S., Moe, N.B., Dyba, T.: Communication between developers and testers in distributed continuous agile testing. In: ICGSE, pp. 59\u201368 (2016)","DOI":"10.1109\/ICGSE.2016.27"},{"issue":"4","key":"26_CR8","doi-asserted-by":"publisher","first-page":"1449","DOI":"10.1007\/s11219-019-09462-5","volume":"27","author":"R Florea","year":"2019","unstructured":"Florea, R., Stray, V.: The skills that employers look for in software testers. Softw. Qual. J. 27(4), 1449\u20131479 (2019). \nhttps:\/\/doi.org\/10.1007\/s11219-019-09462-5","journal-title":"Softw. Qual. J."},{"key":"26_CR9","doi-asserted-by":"crossref","unstructured":"Zimmerer, P.: Strategy for continuous testing in iDevOps. In: ICSE, pp. 532\u2013533 (2018)","DOI":"10.1145\/3183440.3183465"},{"key":"26_CR10","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"442","DOI":"10.1007\/978-3-030-24305-0_33","volume-title":"Computational Science and Its Applications \u2013 ICCSA 2019","author":"DS Cruzes","year":"2019","unstructured":"Cruzes, D.S., Melsnes, K., Marczak, S.: Testing in a DevOps era: perceptions of testers in Norwegian organisations. In: Misra, S., et al. (eds.) ICCSA 2019. LNCS, vol. 11622, pp. 442\u2013455. Springer, Cham (2019). \nhttps:\/\/doi.org\/10.1007\/978-3-030-24305-0_33"},{"key":"26_CR11","first-page":"56","volume":"26","author":"L Smith","year":"2001","unstructured":"Smith, L.: Shift-Left Testing. Dr. Dobb\u2019s\u00a0J. 26, 56 (2001)","journal-title":"Shift-Left Testing. Dr. Dobb\u2019s\u00a0J."},{"key":"26_CR12","first-page":"1","volume":"3","author":"S Eliot","year":"2012","unstructured":"Eliot, S.: The future of software testing. Part Two - TestOps. Test. Planet. 3, 1\u20135 (2012)","journal-title":"Part Two - TestOps. Test. Planet."},{"key":"26_CR13","unstructured":"Dracup, B.: DevOps and the emergence of TestOps! \nhttps:\/\/www.devopsonline.co.uk\/devops-and-the-emergence-of-testops\/"},{"key":"26_CR14","doi-asserted-by":"crossref","unstructured":"MacLeod, L., Storey, M.A., Bergen, A.: Code, camera, action: how software developers document and share program knowledge using YouTube. In: ICPC, pp. 104\u2013114 (2015)","DOI":"10.1109\/ICPC.2015.19"},{"key":"26_CR15","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1016\/j.infsof.2018.09.006","volume":"106","author":"V Garousi","year":"2019","unstructured":"Garousi, V., Felderer, M., M\u00e4ntyl\u00e4, M.V.: Guidelines for including grey literature and conducting multivocal literature reviews in software engineering. Inf. Softw. Technol. 106, 101\u2013121 (2019)","journal-title":"Inf. Softw. Technol."},{"key":"26_CR16","doi-asserted-by":"publisher","first-page":"e2197","DOI":"10.1002\/smr.2197","volume":"31","author":"A Rainer","year":"2019","unstructured":"Rainer, A., Williams, A.: Using blog-like documents to investigate software practice: benefits, challenges, and research directions. J. Softw. Evol. Process. 31, e2197 (2019)","journal-title":"J. Softw. Evol. Process."},{"key":"26_CR17","doi-asserted-by":"publisher","first-page":"274","DOI":"10.1177\/0009922809339203","volume":"49","author":"M Linkletter","year":"2010","unstructured":"Linkletter, M., Gordon, K., Dooley, J.: The choking game and YouTube: a dangerous combination. Clin. Pediatr. 49, 274\u2013279 (2010). (Phila)","journal-title":"Clin. Pediatr."},{"key":"26_CR18","first-page":"1","volume":"6","author":"A Kallur","year":"2020","unstructured":"Kallur, A., et al.: Doctor YouTube\u2019s opinion on seasonal influenza: a critical appraisal of the information available to patients. Digit. Health 6, 1\u20136 (2020)","journal-title":"Digit. Health"},{"key":"26_CR19","first-page":"10","volume":"13","author":"TA Cestare","year":"2019","unstructured":"Cestare, T.A., Ipshita, R.: The tribes we lead: understanding the antecedents and consequences of brand evangelism within the context of social communities. J. Mark. Dev. Compet. 13, 10\u201326 (2019)","journal-title":"J. Mark. Dev. Compet."},{"key":"26_CR20","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1109\/MS.2017.3641116","volume":"34","author":"V Garousi","year":"2017","unstructured":"Garousi, V., Felderer, M.: Worlds apart: industrial and academic focus areas in software testing. IEEE Softw. 34, 38\u201345 (2017)","journal-title":"IEEE Softw."},{"key":"26_CR21","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1109\/MAHC.2006.75","volume":"28","author":"E Bride","year":"2006","unstructured":"Bride, E.: The media are the message: \u201cthe influencers\u201d. IEEE Ann. Hist. Comput. 28, 74\u201379 (2006)","journal-title":"IEEE Ann. Hist. Comput."},{"key":"26_CR22","doi-asserted-by":"crossref","unstructured":"Stol, K.-J., Ralph, P., Fitzgerald, B.: Grounded theory in software engineering research: a critical review and guidelines. In: ICSE, pp. 120\u2013131 (2016)","DOI":"10.1145\/2884781.2884833"},{"key":"26_CR23","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1191\/1478088706qp063oa","volume":"3","author":"V Braun","year":"2006","unstructured":"Braun, V., Clarke, V.: Using thematic analysis in psychology. Qual. Res. Psychol. 3, 77\u2013101 (2006)","journal-title":"Qual. Res. Psychol."},{"key":"26_CR24","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1049\/sej.1986.0003","volume":"1","author":"PE Rook","year":"1986","unstructured":"Rook, P.E.: Controlling software projects. Softw. Eng. J. 1, 7\u201316 (1986)","journal-title":"Softw. Eng. J."},{"key":"26_CR25","doi-asserted-by":"publisher","first-page":"110384","DOI":"10.1016\/j.jss.2019.07.083","volume":"157","author":"WP Luz","year":"2019","unstructured":"Luz, W.P., Pinto, G., Bonif\u00e1cio, R.: Adopting DevOps in the real world: a theory, a model, and a case study. J. Syst. Softw. 157, 110384 (2019)","journal-title":"J. Syst. Softw."},{"key":"26_CR26","doi-asserted-by":"crossref","unstructured":"Stray, V., Moe, N.B., Hoda, R.: Autonomous agile teams: challenges and future directions for research. In: XP Companion (2018)","DOI":"10.1145\/3234152.3234182"}],"container-title":["Lecture Notes in Business Information Processing","Agile Processes in Software Engineering and Extreme Programming \u2013 Workshops"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-030-58858-8_26","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,9,23]],"date-time":"2020-09-23T18:05:39Z","timestamp":1600884339000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/978-3-030-58858-8_26"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020]]},"ISBN":["9783030588571","9783030588588"],"references-count":26,"URL":"https:\/\/doi.org\/10.1007\/978-3-030-58858-8_26","relation":{},"ISSN":["1865-1348","1865-1356"],"issn-type":[{"type":"print","value":"1865-1348"},{"type":"electronic","value":"1865-1356"}],"subject":[],"published":{"date-parts":[[2020]]},"assertion":[{"value":"24 September 2020","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"XP","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"International Conference on Agile Software Development","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Copenhagen","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Denmark","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2020","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"8 June 2020","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"12 June 2020","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"21","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"xpu2020","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/www.agilealliance.org\/xp2020\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Single-blind","order":1,"name":"type","label":"Type","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"EasyChair","order":2,"name":"conference_management_system","label":"Conference Management System","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"79","order":3,"name":"number_of_submissions_sent_for_review","label":"Number of Submissions Sent for Review","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"14","order":4,"name":"number_of_full_papers_accepted","label":"Number of Full Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"2","order":5,"name":"number_of_short_papers_accepted","label":"Number of Short Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"18% - The value is computed by the equation \"Number of Full Papers Accepted \/ Number of Submissions Sent for Review * 100\" and then rounded to a whole number.","order":6,"name":"acceptance_rate_of_full_papers","label":"Acceptance Rate of Full Papers","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"3","order":7,"name":"average_number_of_reviews_per_paper","label":"Average Number of Reviews per Paper","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"3,2","order":8,"name":"average_number_of_papers_per_reviewer","label":"Average Number of Papers per Reviewer","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"Yes","order":9,"name":"external_reviewers_involved","label":"External Reviewers Involved","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"The conference was held online due to the Coronavirus pandemic. In addition to the main conference papers, 26 revised workshop papers,  2 Agile Education and Training Track papers, and 3 Doctoral Symposium papers were published.","order":10,"name":"additional_info_on_review_process","label":"Additional Info on Review Process","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}}]}}