{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,19]],"date-time":"2025-09-19T09:23:32Z","timestamp":1758273812575,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":60,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,11,5]],"date-time":"2024-11-05T00:00:00Z","timestamp":1730764800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100003593","name":"Conselho Nacional de Desenvolvimento Cient\u00edfico e Tecnol\u00f3gico","doi-asserted-by":"publisher","award":["404825\/2023-0"],"award-info":[{"award-number":["404825\/2023-0"]}],"id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,11,5]]},"DOI":"10.1145\/3701625.3701699","type":"proceedings-article","created":{"date-parts":[[2024,12,21]],"date-time":"2024-12-21T11:39:16Z","timestamp":1734781156000},"page":"676-686","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["A Multimethod Study of Test Smells: Cataloging Removal and New Types"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7593-0147","authenticated-orcid":false,"given":"Elvys","family":"Soares","sequence":"first","affiliation":[{"name":"Universidade Federal de Pernambuco, Recife, Pernambuco, Brazil and Federal Institute of Alagoas, Macei\u00f3, Alagoas, Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4293-4261","authenticated-orcid":false,"given":"M\u00e1rcio","family":"Ribeiro","sequence":"additional","affiliation":[{"name":"Federal University of Alagoas, Macei\u00f3, Alagoas, Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6661-5970","authenticated-orcid":false,"given":"Andr\u00e9","family":"Santos","sequence":"additional","affiliation":[{"name":"Universidade Federal de Pernambuco, Recife, Pernambuco, Brazil"}]}],"member":"320","published-online":{"date-parts":[[2024,12,21]]},"reference":[{"key":"e_1_3_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3463274.3463335"},{"key":"e_1_3_3_2_3_2","unstructured":"Marko Anastasov\u00a0A. 2014. TDD Antipatterns: The Free Ride. https:\/\/semaphoreci.com\/blog\/2014\/06\/24\/tdd-antipatterns-the-free-ride.html"},{"key":"e_1_3_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/3661167.3661225"},{"key":"e_1_3_3_2_5_2","unstructured":"James\u00a0E. Bartlett\u00a0II Joe\u00a0W. Kotrlik and Chadwick\u00a0C. Higgins. 2001. Organizational research: Determining appropriate sample size in survey research appropriate sample size in survey research. Information Technology Learning and Performance Journal 19 1 (2001) 43\u201350."},{"key":"e_1_3_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.2012.6405253"},{"key":"e_1_3_3_2_7_2","doi-asserted-by":"crossref","unstructured":"Gabriele Bavota Abdallah Qusef Rocco Oliveto Andrea De\u00a0Lucia and Dave Binkley. 2015. Are test smells really harmful? an empirical study. Empir. Softw. Eng. 20 4 (2015) 1052\u20131094.","DOI":"10.1007\/s10664-014-9313-0"},{"key":"e_1_3_3_2_8_2","series-title":"(WASDeTT)","first-page":"1","volume-title":"WASDeTT-1: 1st International Workshop on Advanced Software Development Tools and Techniques","author":"Breugelmans Manuel","year":"2008","unstructured":"Manuel Breugelmans and Bart Van\u00a0Rompaey. 2008. Testq: Exploring structural and maintenance characteristics of unit test suites. In WASDeTT-1: 1st International Workshop on Advanced Software Development Tools and Techniques(WASDeTT). 1\u201316."},{"key":"e_1_3_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSR.2019.00072"},{"key":"e_1_3_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3337932.3338815"},{"key":"e_1_3_3_2_11_2","volume-title":"Software testing: principles and practice","author":"Desikan Srinivasan","year":"2006","unstructured":"Srinivasan Desikan. 2006. Software testing: principles and practice. Pearson Education India."},{"key":"e_1_3_3_2_12_2","volume-title":"Automated software testing: introduction, management, and performance","author":"Dustin Elfriede","year":"1999","unstructured":"Elfriede Dustin, Jeff Rashka, and John Paul. 1999. Automated software testing: introduction, management, and performance. Addison-Wesley Professional. https:\/\/dl.acm.org\/doi\/10.5555\/310674"},{"key":"e_1_3_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/2593812.2593817"},{"key":"e_1_3_3_2_14_2","doi-asserted-by":"crossref","unstructured":"Henning Femmer Daniel\u00a0M\u00e9ndez Fern\u00e1ndez Stefan Wagner and Sebastian Eder. 2017. Rapid quality assurance with requirements smells. Journal of Systems and Software 123 (2017) 190\u2013213.","DOI":"10.1016\/j.jss.2016.02.047"},{"key":"e_1_3_3_2_15_2","volume-title":"Refactoring: improving the design of existing code, 2nd edition","author":"Fowler Martin","year":"2018","unstructured":"Martin Fowler. 2018. Refactoring: improving the design of existing code, 2nd edition. Addison-Wesley Professional."},{"key":"e_1_3_3_2_16_2","unstructured":"Ashley Frieze. 2018. Test Smells - The Coding Craftsman. https:\/\/codingcraftsman.wordpress.com\/2018\/09\/27\/test-smells\/"},{"key":"e_1_3_3_2_17_2","volume-title":"Elements of Reusable Object-Oriented Software","author":"Gamma Erich","year":"1994","unstructured":"Erich Gamma, Richard Helm, Ralph Johnson, and John Vlissides. 1994. Elements of Reusable Object-Oriented Software. Addison-Wesley Professional. https:\/\/dl.acm.org\/doi\/10.5555\/186897"},{"key":"e_1_3_3_2_18_2","doi-asserted-by":"crossref","unstructured":"Vahid Garousi Michael Felderer and Mika\u00a0V M\u00e4ntyl\u00e4. 2019. Guidelines for including grey literature and conducting multivocal literature reviews in software engineering. Information and Software Technology 106 (2019) 101\u2013121.","DOI":"10.1016\/j.infsof.2018.09.006"},{"key":"e_1_3_3_2_19_2","doi-asserted-by":"crossref","unstructured":"Vahid Garousi and Bar\u0131\u015f K\u00fc\u00e7\u00fck. 2018. Smells in software test code: A survey of knowledge in industry and academia. J. Syst. Softw. 138 (2018) 52\u201381.","DOI":"10.1016\/j.jss.2017.12.013"},{"key":"e_1_3_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2013.45"},{"key":"e_1_3_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSR.2013.6624053"},{"key":"e_1_3_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.5555\/2486788.2486966"},{"key":"e_1_3_3_2_23_2","unstructured":"Matthew Honnibal and Ines Montani. 2023. spaCy \u2013 Industrial-strength Natural Language Processing in Python. https:\/\/spacy.io\/"},{"key":"e_1_3_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3482909.3482915"},{"key":"e_1_3_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2009.16"},{"key":"e_1_3_3_2_26_2","unstructured":"Lasse Koskela. 2015. Developer Test Anti-Patterns. https:\/\/www.youtube.com\/watch?v=3Fa69eQ6XgM"},{"key":"e_1_3_3_2_27_2","series-title":"ISPC","first-page":"138","volume-title":"Proceedings of the International Scientific and Practical Conference","volume":"3","author":"Kulesovs Ivans","year":"2015","unstructured":"Ivans Kulesovs. 2015. iOS applications testing. In Proceedings of the International Scientific and Practical Conference(ISPC, Vol.\u00a03). 138\u2013150."},{"key":"e_1_3_3_2_28_2","unstructured":"Maudlin Kummer. 2015. Categorising Test Smells. Master\u2019s thesis. University of Bern Switzerland."},{"key":"e_1_3_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3387904.3389296"},{"key":"e_1_3_3_2_30_2","unstructured":"Canonical Ltd.2023. Ubuntu Operational System. https:\/\/ubuntu.com\/download"},{"key":"e_1_3_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/3377812.3382151"},{"key":"e_1_3_3_2_32_2","doi-asserted-by":"crossref","unstructured":"Luana Martins Heitor Costa and Ivan Machado. 2023. On the diffusion of test smells and their relationship with test code quality of Java projects. Journal of Software: Evolution and Process (2023) e2532.","DOI":"10.1002\/smr.2532"},{"key":"e_1_3_3_2_33_2","volume-title":"xUnit test patterns: Refactoring test code","author":"Meszaros Gerard","year":"2007","unstructured":"Gerard Meszaros. 2007. xUnit test patterns: Refactoring test code. Pearson Education. https:\/\/dl.acm.org\/doi\/10.5555\/1076526"},{"key":"e_1_3_3_2_34_2","doi-asserted-by":"publisher","unstructured":"Bertrand Meyer. 2008. Seven Principles of Software Testing. Computer 41 8 (2008) 99\u2013101. 10.1109\/MC.2008.306 https:\/\/dl.acm.org\/doi\/10.1109\/MC.2008.306","DOI":"10.1109\/MC.2008.306"},{"key":"e_1_3_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2009.34"},{"key":"e_1_3_3_2_36_2","doi-asserted-by":"crossref","unstructured":"Rodney\u00a0T Ogawa and Betty Malen. 1991. Towards rigor in reviews of multivocal literatures: Applying the exploratory case study method. Rev. Educ. Res. 61 3 (1991) 265\u2013286.","DOI":"10.3102\/00346543061003265"},{"key":"e_1_3_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2014.32"},{"key":"e_1_3_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/2897010.2897016"},{"key":"e_1_3_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.5753\/cbsoft_estendido.2022.227655"},{"key":"e_1_3_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.5555\/3370272.3370293"},{"key":"e_1_3_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3417921"},{"key":"e_1_3_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3387940.3392189"},{"key":"e_1_3_3_2_43_2","unstructured":"Kostadin Rajkovic and Eduard\u00a0Paul Enoiu. 2022. NALABS: Detecting Bad Smells in Natural Language Requirements and Test Specifications. http:\/\/www.es.mdu.se\/publications\/6382-"},{"key":"e_1_3_3_2_44_2","doi-asserted-by":"crossref","unstructured":"Stefan Reichhart Tudor G\u00eerba and St\u00e9phane Ducasse. 2007. Rule-based Assessment of Test Quality. J. Object Technol. 6 9 (2007) 231\u2013251.","DOI":"10.5381\/jot.2007.6.9.a12"},{"key":"e_1_3_3_2_45_2","doi-asserted-by":"crossref","unstructured":"Jerome\u00a0H Saltzer. 2020. The origin of the \u201cMIT license\u201d. IEEE Annals of the History of Computing 42 4 (2020) 94\u201398.","DOI":"10.1109\/MAHC.2020.3020234"},{"key":"e_1_3_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3422392.3422510"},{"key":"e_1_3_3_2_47_2","unstructured":"Joe Schmetzer. 2005. JUnit Anti-patterns. https:\/\/exubero.com\/junit\/anti-patterns\/"},{"key":"e_1_3_3_2_48_2","unstructured":"Jake Scruggs. 2009. Smells of Testing (signs your tests are bad). https:\/\/jakescruggs.blogspot.com\/2009\/04\/smells-of-testing-signs-your-tests-are.html"},{"key":"e_1_3_3_2_49_2","doi-asserted-by":"crossref","unstructured":"BS\u00a0Everitt\u00a0A Skrondal and A Everitt. 2010. The Cambridge Dictionary of Statistics.","DOI":"10.1017\/CBO9780511779633"},{"key":"e_1_3_3_2_50_2","doi-asserted-by":"publisher","unstructured":"Quadri S.M.K and Sheikh\u00a0Umar Farooq. 2010. Software Testing \u2013 Goals Principles and Limitations. International Journal of Computer Applications 6 9 (2010) 7\u201310. 10.5120\/1343-1448","DOI":"10.5120\/1343-1448"},{"key":"e_1_3_3_2_51_2","unstructured":"Elvys Soares. 2023. A multimethod study of test smells: cataloging removal and new types. Ph.\u00a0D. Dissertation. Universidade Federal de Pernambuco Recife PE Brazil. Advisor(s) Ribeiro M\u00e1rcio and Santos Andr\u00e9."},{"key":"e_1_3_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/ESEM56168.2023.10304800"},{"key":"e_1_3_3_2_53_2","unstructured":"Elvys Soares Manoel Aranda Naelson Oliveira M\u00e1rcio Ribeiro Emerson Souza Ivan Machado Andr\u00e9 Santos Baldoino Fonseca and Rodrigo Bonif\u00e1cio. 2022. Do They Smell the Same? Cataloging Natural Language Test Smells in Open-Source Government and Industry Systems - Files. https:\/\/figshare.com\/s\/5661004111cbdcb785d3"},{"key":"e_1_3_3_2_54_2","doi-asserted-by":"publisher","unstructured":"Elvys Soares Jos\u00e9\u00a0Aldo da Costa Manoel Terceiro Davi Rom\u00e3o M\u00e1rcio Ribeiro Rohit Gheyi Fabiano Ferrari Andr\u00e9 Santos Ivan Machado Rodrigo Bonif\u00e1cio and Baldoino Fonseca. 2022. A Multivocal Literature Review of Test Smells - Replication Package. 10.6084\/m9.figshare.22806092","DOI":"10.6084\/m9.figshare.22806092"},{"key":"e_1_3_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/3425174.3425212"},{"key":"e_1_3_3_2_56_2","doi-asserted-by":"crossref","unstructured":"Elvys Soares M\u00e1rcio Ribeiro Rohit Gheyi Guilherme Amaral and Andr\u00e9 Santos. 2023. Refactoring Test Smells With JUnit 5: Why Should Developers Keep Up-to-Date? IEEE Transactions on Software Engineering 49 3 (2023) 1152\u20131170.","DOI":"10.1109\/TSE.2022.3172654"},{"key":"e_1_3_3_2_57_2","doi-asserted-by":"crossref","unstructured":"Edith Tom Ayb\u00fcke Aurum and Richard Vidgen. 2013. An exploration of technical debt. Journal of Systems and Software 86 6 (2013) 1498\u20131516.","DOI":"10.1016\/j.jss.2012.12.052"},{"key":"e_1_3_3_2_58_2","series-title":"(XP)","first-page":"92","volume-title":"Proceedings of the 2nd international conference on extreme programming and flexible processes in software engineering (XP2001)","author":"Deursen Arie van","year":"2001","unstructured":"Arie van Deursen, Leon Moonen, Alex van Den\u00a0Bergh, and Gerard Kok. 2001. Refactoring test code. In Proceedings of the 2nd international conference on extreme programming and flexible processes in software engineering (XP2001)(XP). 92\u201395."},{"key":"e_1_3_3_2_59_2","doi-asserted-by":"crossref","unstructured":"Bart Van\u00a0Rompaey Bart Du\u00a0Bois Serge Demeyer and Matthias Rieger. 2007. On the detection of test smells: A metrics-based approach for general fixture and eager test. IEEE Transactions on Software Engineering 33 12 (2007) 800\u2013817.","DOI":"10.1109\/TSE.2007.70745"},{"key":"e_1_3_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE51524.2021.9678615"},{"key":"e_1_3_3_2_61_2","unstructured":"RJ Williams and Erik Dietrich. 2017. Unit Testing Smells: What Are Your Tests Telling You?https:\/\/dzone.com\/articles\/unit-testing-smells-what-are-your-tests-telling-yo"}],"event":{"name":"SBQS 2024: XXIII Brazilian Symposium on Software Quality","acronym":"SBQS 2024","location":"Salvador Bahia Brazil"},"container-title":["Proceedings of the XXIII Brazilian Symposium on Software Quality"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3701625.3701699","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3701625.3701699","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:18:44Z","timestamp":1750295924000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3701625.3701699"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,5]]},"references-count":60,"alternative-id":["10.1145\/3701625.3701699","10.1145\/3701625"],"URL":"https:\/\/doi.org\/10.1145\/3701625.3701699","relation":{},"subject":[],"published":{"date-parts":[[2024,11,5]]},"assertion":[{"value":"2024-12-21","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}