{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T19:01:28Z","timestamp":1754161288581,"version":"3.41.2"},"publisher-location":"New York, NY, USA","reference-count":26,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,6,23]]},"DOI":"10.1145\/3696630.3728527","type":"proceedings-article","created":{"date-parts":[[2025,7,28]],"date-time":"2025-07-28T19:08:09Z","timestamp":1753729689000},"page":"701-705","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Missing Threats: Dealing with the Treatment-sensitive Factorial Structure Bias in Empirical Software Engineering"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0589-2349","authenticated-orcid":false,"given":"Sabato","family":"Nocera","sequence":"first","affiliation":[{"name":"University of Salerno, Fisciano, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0024-7508","authenticated-orcid":false,"given":"Giuseppe","family":"Scanniello","sequence":"additional","affiliation":[{"name":"Universit\u00e0 degli Studi di Salerno, Fisciano, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,7,28]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"categorizing and mitigating threats to validity in software engineering secondary studies. Information and software technology 106","author":"Ampatzoglou Apostolos","year":"2019","unstructured":"Apostolos Ampatzoglou, Stamatia Bibi, Paris Avgeriou, Marijn Verbeek, and Alexander Chatzigeorgiou. 2019. Identifying, categorizing and mitigating threats to validity in software engineering secondary studies. Information and software technology 106 (2019), 201\u2013230."},{"key":"e_1_3_2_1_2_1","volume-title":"Do I really need all this work to find vulnerabilities? Empir. Softw. Eng. 27, 6","author":"Elder Sarah","year":"2022","unstructured":"Sarah Elder, Nusrat Zahan, Rui Shu, Monica Metro, Valeri Kozarev, Tim Menzies, and Laurie Williams. 2022. Do I really need all this work to find vulnerabilities? Empir. Softw. Eng. 27, 6 (2022), 154:1\u2013154:78."},{"key":"e_1_3_2_1_3_1","unstructured":"Robert Feldt and Ana Magazinius. 2010. Validity threats in empirical software engineering research - An initial survey. In SEKE 2010 - Proceedings of the 22nd International Conference on Software Engineering and Knowledge Engineering. 374 \u2013 379. https:\/\/www.scopus.com\/inward\/record.uri?eid=2-s2.0-79952377068&partnerID=40&md5=f20a6b12d07dac26c66c13a5d815b5e6 Cited by: 210; Conference name: 22nd International Conference on Software Engineering and Knowledge Engineering SEKE 2010; Conference date: 1 July 2010 through 3 July 2010; Conference code: 84044."},{"key":"e_1_3_2_1_4_1","volume-title":"Burak Turhan, and Natalia Juristo.","author":"Karac Itir","year":"2024","unstructured":"Itir Karac, Jose Ignacio Panach, Burak Turhan, and Natalia Juristo. 2024. Does Treatment Adherence Impact Experiment Results in TDD? IEEE Transactions on Software Engineering (2024)."},{"key":"e_1_3_2_1_5_1","volume-title":"Proceedings of the 18th ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement. 314\u2013324","author":"Lago Patricia","year":"2024","unstructured":"Patricia Lago, Per Runeson, Qunying Song, and Roberto Verdecchia. 2024. Threats to Validity in Software Engineering-hypocritical paper section or essential analysis?. In Proceedings of the 18th ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement. 314\u2013324."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"crossref","first-page":"111575","DOI":"10.1016\/j.jss.2022.111575","article-title":"A critical comparison on six static analysis tools: Detection, agreement, and precision","volume":"198","author":"Lenarduzzi Valentina","year":"2023","unstructured":"Valentina Lenarduzzi, Fabiano Pecorelli, Nyyti Saarimaki, Savanna Lujan, and Fabio Palomba. 2023. A critical comparison on six static analysis tools: Detection, agreement, and precision. Journal of Systems and Software 198 (2023), 111575.","journal-title":"Journal of Systems and Software"},{"key":"e_1_3_2_1_7_1","volume-title":"Susan Elliott Sim, and Janice Singer","author":"Lethbridge Timothy C","year":"2005","unstructured":"Timothy C Lethbridge, Susan Elliott Sim, and Janice Singer. 2005. Studying software engineers: Data collection techniques for software field studies. Empirical software engineering 10 (2005), 311\u2013341."},{"volume-title":"Qualitative research design: An interactive approach","author":"Maxwell Joseph A","key":"e_1_3_2_1_8_1","unstructured":"Joseph A Maxwell. 2013. Qualitative research design: An interactive approach. Sage Publications Inc."},{"key":"e_1_3_2_1_9_1","volume-title":"Proceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering","author":"Nocera Sabato","year":"2023","unstructured":"Sabato Nocera, Rita Francese, and Giuseppe Scanniello. 2023. Training Bachelor Students to Design Better Quality Web Apps: Preliminary Results from a Prospective Empirical Investigation. In Proceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering (Oulu, Finland) (EASE '23). Association for Computing Machinery, New York, NY, USA, 465\u2013469. 10.1145\/3593434.3593957"},{"key":"e_1_3_2_1_10_1","volume-title":"International Conference on the Quality of Information and Communications Technology. Springer Nature Switzerland, Cham, 399\u2013407","author":"Nocera Sabato","year":"2024","unstructured":"Sabato Nocera, Simone Romano, Dario Di Nucci, Rita Francese, Fabio Palomba, and Giuseppe Scanniello. 2024. Do Static Analysis Tools Improve Awareness and Attitude Toward Secure Software Development?. In International Conference on the Quality of Information and Communications Technology. Springer Nature Switzerland, Cham, 399\u2013407. 10.1007\/978-3-031-70245-7_28"},{"key":"e_1_3_2_1_11_1","volume-title":"Managing Vulnerabilities in Software Projects: the Case of NTT Data. In 2023 49th Euromicro Conference on Software Engineering and Advanced Applications (SEAA). IEEE, 247\u2013253","author":"Nocera Sabato","year":"2023","unstructured":"Sabato Nocera, Simone Romano, Rita Francese, Riccardo Burlon, and Giuseppe Scanniello. 2023. Managing Vulnerabilities in Software Projects: the Case of NTT Data. In 2023 49th Euromicro Conference on Software Engineering and Advanced Applications (SEAA). IEEE, 247\u2013253. 10.1109\/SEAA60479.2023.00046"},{"key":"e_1_3_2_1_12_1","volume-title":"2023 IEEE\/ACM 45th International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET). IEEE, 40\u201345","author":"Nocera Sabato","year":"2023","unstructured":"Sabato Nocera, Simone Romano, Rita Francese, and Giuseppe Scanniello. 2023. Training for Security: Planning the Use of a SAT in the Development Pipeline of Web Apps. In 2023 IEEE\/ACM 45th International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET). IEEE, 40\u201345. 10.1109\/ICSE-SEET58685.2023.00010"},{"key":"e_1_3_2_1_13_1","volume-title":"Proceedings of the 46th International Conference on Software Engineering: Software Engineering Education and Training","author":"Nocera Sabato","year":"2024","unstructured":"Sabato Nocera, Simone Romano, Rita Francese, and Giuseppe Scanniello. 2024. Training for Security: Results from Using a Static Analysis Tool in the Development Pipeline of Web Apps. In Proceedings of the 46th International Conference on Software Engineering: Software Engineering Education and Training (Lisbon, Portugal) (ICSE-SEET '24). Association for Computing Machinery, New York, NY, USA, 253\u2013263. 10.1145\/3639474.3640073"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2024.112308"},{"key":"e_1_3_2_1_15_1","volume-title":"2025 IEEE\/ACM 22nd International Conference on Mining Software Repositories (MSR). IEEE.","author":"Nocera Sabato","year":"2025","unstructured":"Sabato Nocera, Sira Vegas, Giuseppe Scanniello, and Natalia Juristo. 2025. Software Composition Analysis and Supply Chain Security in Apache Projects: an Empirical Study. In 2025 IEEE\/ACM 22nd International Conference on Mining Software Repositories (MSR). IEEE."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3649598"},{"key":"e_1_3_2_1_17_1","volume-title":"Campbell","author":"Shadish William R.","year":"2002","unstructured":"William R. Shadish, Thomas D. Cook, and Donald T. Campbell. 2002. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Wadsworth, Cengage Learning."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"crossref","first-page":"1374","DOI":"10.1109\/TSE.2022.3176725","article-title":"Construct validity in software engineering","volume":"49","author":"Sj\u00f8berg Dag IK","year":"2022","unstructured":"Dag IK Sj\u00f8berg and Gunnar Rye Bergersen. 2022. Construct validity in software engineering. IEEE Transactions on Software Engineering 49, 3 (2022), 1374\u20131396.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_2_1_19_1","unstructured":"SonarSource. 2024. Clean Code | Developer First | Sonar. https:\/\/www.sonarsource.com\/"},{"key":"e_1_3_2_1_20_1","unstructured":"SonarSource. 2024. Code Quality Tool Secure Analysis with SonarQube. https:\/\/www.sonarsource.com\/products\/sonarqube\/"},{"key":"e_1_3_2_1_21_1","unstructured":"SonarSource. 2024. Home | SonarCloud Docs. https:\/\/docs.sonarcloud.io\/"},{"volume-title":"Neuropsychological rehabilitation","author":"Tate Robyn","key":"e_1_3_2_1_22_1","unstructured":"Robyn Tate and Michael Perdices. 2017. Avoiding bias in evaluating rehabilitation. In Neuropsychological rehabilitation. Routledge, 547\u2013558."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"crossref","first-page":"1419","DOI":"10.1007\/s10664-019-09750-5","article-title":"How developers engage with static analysis tools in different contexts","volume":"25","author":"Vassallo Carmine","year":"2020","unstructured":"Carmine Vassallo, Sebastiano Panichella, Fabio Palomba, Sebastian Proksch, Harald C Gall, and Andy Zaidman. 2020. How developers engage with static analysis tools in different contexts. Empirical Software Engineering 25 (2020), 1419\u20131457.","journal-title":"Empirical Software Engineering"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"crossref","first-page":"107329","DOI":"10.1016\/j.infsof.2023.107329","article-title":"Threats to validity in software engineering research: A critical reflection","volume":"164","author":"Verdecchia Roberto","year":"2023","unstructured":"Roberto Verdecchia, Emelie Engstr\u00f6m, Patricia Lago, Per Runeson, and Qunying Song. 2023. Threats to validity in software engineering research: A critical reflection. Information and Software Technology 164 (2023), 107329.","journal-title":"Information and Software Technology"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Claes Wohlin Per Runeson Martin H\u00f6st Magnus C Ohlsson Bj\u00f6rn Regnell Anders Wessl\u00e9n et al. 2012. Experimentation in software engineering. Vol. 236. Springer.","DOI":"10.1007\/978-3-642-29044-2"},{"key":"e_1_3_2_1_26_1","volume-title":"Proceedings of the 1st IEEE\/ACM International Workshop on Methodological Issues with Empirical Studies in Software Engineering. 13\u201316","author":"Wyrich Marvin","year":"2024","unstructured":"Marvin Wyrich and Sven Apel. 2024. Evidence Tetris in the Pixelated World of Validity Threats. In Proceedings of the 1st IEEE\/ACM International Workshop on Methodological Issues with Empirical Studies in Software Engineering. 13\u201316."}],"event":{"name":"FSE Companion '25: 33rd ACM International Conference on the Foundations of Software Engineering","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering"],"location":"Clarion Hotel Trondheim Trondheim Norway","acronym":"FSE Companion '25"},"container-title":["Proceedings of the 33rd ACM International Conference on the Foundations of Software Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3696630.3728527","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,28]],"date-time":"2025-07-28T19:12:35Z","timestamp":1753729955000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3696630.3728527"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,23]]},"references-count":26,"alternative-id":["10.1145\/3696630.3728527","10.1145\/3696630"],"URL":"https:\/\/doi.org\/10.1145\/3696630.3728527","relation":{},"subject":[],"published":{"date-parts":[[2025,6,23]]},"assertion":[{"value":"2025-07-28","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}