{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T06:15:51Z","timestamp":1773900951105,"version":"3.50.1"},"reference-count":116,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,11,22]],"date-time":"2024-11-22T00:00:00Z","timestamp":1732233600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,11,22]],"date-time":"2024-11-22T00:00:00Z","timestamp":1732233600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100006359","name":"Blekinge Institute of Technology","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006359","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2025,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>It is commonly accepted that the quality of requirements specifications impacts subsequent software engineering activities. However, we still lack empirical evidence to support organizations in deciding whether their requirements are good enough or impede subsequent activities. We aim to contribute empirical evidence to the effect that requirements quality defects have on a software engineering activity that depends on this requirement. We conduct a controlled experiment in which 25 participants from industry and university generate domain models from four natural language requirements containing different quality defects. We evaluate the resulting models using both frequentist and Bayesian data analysis. Contrary to our expectations, our results show that the use of passive voice only has a minor impact on the resulting domain models. The use of ambiguous pronouns, however, shows a strong effect on various properties of the resulting domain models. Most notably, ambiguous pronouns lead to incorrect associations in domain models. Despite being equally advised against by literature and frequentist methods, the Bayesian data analysis shows that the two investigated quality defects have vastly different impacts on software engineering activities and, hence, deserve different levels of attention. Our employed method can be further utilized by researchers to improve reliable, detailed empirical evidence on requirements quality.<\/jats:p>","DOI":"10.1007\/s10664-024-10582-1","type":"journal-article","created":{"date-parts":[[2024,11,22]],"date-time":"2024-11-22T06:03:08Z","timestamp":1732255388000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Applying bayesian data analysis for causal inference about requirements quality: a controlled experiment"],"prefix":"10.1007","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3995-6125","authenticated-orcid":false,"given":"Julian","family":"Frattini","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0679-4361","authenticated-orcid":false,"given":"Davide","family":"Fucci","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0118-8143","authenticated-orcid":false,"given":"Richard","family":"Torkar","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8249-1418","authenticated-orcid":false,"given":"Lloyd","family":"Montgomery","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4118-0952","authenticated-orcid":false,"given":"Michael","family":"Unterkalmsteiner","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4361-6118","authenticated-orcid":false,"given":"Jannik","family":"Fischbach","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0619-6027","authenticated-orcid":false,"given":"Daniel","family":"Mendez","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,11,22]]},"reference":[{"key":"10582_CR1","doi-asserted-by":"crossref","unstructured":"Badampudi D, Wohlin C, Gorschek T (2019) Contextualizing research evidence through knowledge translation in software engineering. In: Proceedings of the 23rd international conference on evaluation and assessment in software engineering, pp 306\u2013311","DOI":"10.1145\/3319008.3319358"},{"key":"10582_CR2","doi-asserted-by":"crossref","unstructured":"Baldassarre MT, Carver J, Dieste O, Juristo, N (2014) Replication types: towards a shared taxonomy. In: Proceedings of the 18th international conference on evaluation and assessment in software engineering, pp 1\u20134","DOI":"10.1145\/2601248.2601299"},{"issue":"4","key":"10582_CR3","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1007\/s10664-021-10072-8","volume":"27","author":"S Baltes","year":"2022","unstructured":"Baltes S, Ralph P (2022) Sampling in software engineering research: a critical review and guidelines. Empir Softw Eng 27(4):94","journal-title":"Empir Softw Eng"},{"key":"10582_CR4","doi-asserted-by":"crossref","unstructured":"Bano M (2015) Addressing the challenges of requirements ambiguity: a review of empirical literature. In: 2015 IEEE fifth international workshop on empirical requirements engineering (EmpiRE), pp 21\u201324. IEEE","DOI":"10.1109\/EmpiRE.2015.7431303"},{"key":"10582_CR5","doi-asserted-by":"crossref","unstructured":"Belev G (1989) Guidelines for specification development. In: Proceedings., annual reliability and maintainability symposium, pp 15\u201321. IEEE","DOI":"10.1109\/ARMS.1989.49565"},{"issue":"1","key":"10582_CR6","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","volume":"57","author":"Y Benjamini","year":"1995","unstructured":"Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc: Ser B (Methodological) 57(1):289\u2013300","journal-title":"J R Stat Soc: Ser B (Methodological)"},{"key":"10582_CR7","doi-asserted-by":"publisher","first-page":"111909","DOI":"10.1016\/j.jss.2023.111909","volume":"209","author":"R Berntsson Svensson","year":"2024","unstructured":"Berntsson Svensson R, Torkar R (2024) Not all requirements prioritization criteria are equal at all times: a quantitative analysis. J Syst Softw 209:111909. https:\/\/doi.org\/10.1016\/j.jss.2023.111909","journal-title":"J Syst Softw"},{"key":"10582_CR8","doi-asserted-by":"crossref","unstructured":"Berry DM, Kamsties E (2004) Ambiguity in requirements specification. In: Perspectives on software requirements, pp 7\u201344. Springer","DOI":"10.1007\/978-1-4615-0465-8_2"},{"issue":"1","key":"10582_CR9","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1109\/TSE.1984.5010193","volume":"SE\u201310","author":"BW Boehm","year":"1984","unstructured":"Boehm BW (1984) Software engineering economics. IEEE Trans Softw Eng SE\u201310(1):4\u201321","journal-title":"IEEE Trans Softw Eng"},{"issue":"6","key":"10582_CR10","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1007\/s10664-023-10367-y","volume":"28","author":"J Bogner","year":"2023","unstructured":"Bogner J, Kotstein S, Pfaff T (2023) Do restful api design rules have an impact on the understandability of web apis? Empir Softw Eng 28(6):132","journal-title":"Empir Softw Eng"},{"key":"10582_CR11","doi-asserted-by":"crossref","unstructured":"Boyd S, Zowghi D, Farroukh A (2005) Measuring the expressiveness of a constrained natural language: an empirical study. In: 13th IEEE international conference on requirements engineering (RE\u201905), pp 339\u2013349. IEEE","DOI":"10.1109\/RE.2005.39"},{"issue":"5","key":"10582_CR12","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1109\/MS.2017.3571562","volume":"34","author":"L Briand","year":"2017","unstructured":"Briand L, Bianculli D, Nejati S, Pastore F, Sabetzadeh M (2017) The case for context-driven software engineering research: generalizability is overrated. IEEE Softw 34(5):72\u201375","journal-title":"IEEE Softw"},{"key":"10582_CR13","doi-asserted-by":"crossref","unstructured":"Brooks S, Gelman A, Jones G, Meng XL (2011) Handbook of Markov Chain Monte Carlo. CRC press","DOI":"10.1201\/b10905"},{"key":"10582_CR14","doi-asserted-by":"crossref","unstructured":"Brown\u00a0Jr BW (1980) The crossover experiment for clinical trials. Biometrics 69\u201379","DOI":"10.2307\/2530496"},{"key":"10582_CR15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v080.i01","volume":"80","author":"PC B\u00fcrkner","year":"2017","unstructured":"B\u00fcrkner PC (2017) brms: An R package for Bayesian multilevel models using Stan. J Stat Softw 80:1\u201328","journal-title":"J Stat Softw"},{"key":"10582_CR16","doi-asserted-by":"crossref","unstructured":"Carpenter B, Gelman A, Hoffman MD, Lee D, Goodrich B, Betancourt M, Brubaker M, Guo J, Li P, Riddell A (2017) Stan: a probabilistic programming language. J Stat Softw 76(1)","DOI":"10.18637\/jss.v076.i01"},{"key":"10582_CR17","unstructured":"Carver JC (2010) Towards reporting guidelines for experimental replications: a proposal. In: 1st International workshop on replication in empirical software engineering, vol 1, pp 1\u20134"},{"key":"10582_CR18","doi-asserted-by":"crossref","unstructured":"Carver J, Jaccheri L, Morasca S, Shull F (2004) Issues in using students in empirical studies in software engineering education. In: Proceedings. 5th international workshop on enterprise networking and computing in healthcare industry (IEEE Cat. No. 03EX717), pp 239\u2013249. IEEE","DOI":"10.1109\/METRIC.2003.1232471"},{"key":"10582_CR19","doi-asserted-by":"crossref","unstructured":"Chantree F, Nuseibeh B, De Roeck A, Willis A (2006) Identifying nocuous ambiguities in natural language requirements. In: 14th IEEE international requirements engineering conference (RE\u201906), pp 59\u201368. IEEE","DOI":"10.1109\/RE.2006.31"},{"key":"10582_CR20","doi-asserted-by":"crossref","unstructured":"Christel MG, Kang KC (1992) Issues in requirements elicitation","DOI":"10.21236\/ADA258932"},{"issue":"4","key":"10582_CR21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/1082983.1083178","volume":"30","author":"M Ciolkowski","year":"2005","unstructured":"Ciolkowski M, M\u00fcnch J (2005) Accumulation and presentation of empirical evidence: problems and challenges. ACM SIGSOFT Softw Eng Notes 30(4):1\u20133","journal-title":"ACM SIGSOFT Softw Eng Notes"},{"key":"10582_CR22","unstructured":"Cohen BH (2008) Explaining psychological statistics. John Wiley & Sons"},{"key":"10582_CR23","unstructured":"Cohen J (1969) Statistical power analysis for the behavioral sciences. Academic press"},{"key":"10582_CR24","doi-asserted-by":"crossref","unstructured":"de Bruijn F, Dekkers HL (2010) Ambiguity in natural language software requirements: a case study. In: Requirements engineering: foundation for software quality: 16th international working conference, REFSQ 2010, Essen, Germany, June 30\u2013July 2, 2010. Proceedings 16, pp 233\u2013247. Springer","DOI":"10.1007\/978-3-642-14192-8_21"},{"key":"10582_CR25","doi-asserted-by":"crossref","unstructured":"Deissenboeck F, Wagner S, Pizka M, Teuchert S, Girard JF (2007) An activity-based quality model for maintainability. In: 2007 IEEE international conference on software maintenance, pp 184\u2013193. IEEE","DOI":"10.1109\/ICSM.2007.4362631"},{"key":"10582_CR26","doi-asserted-by":"crossref","unstructured":"Demaris A (1992) Logit modeling: practical applications. 86. Sage","DOI":"10.4135\/9781412984836"},{"key":"10582_CR27","doi-asserted-by":"crossref","unstructured":"Drechsler R, Soeken M, Wille R (2014) Automated and quality-driven requirements engineering. In: 2014 IEEE\/ACM international conference on computer-aided design (ICCAD), pp 586\u2013590. IEEE","DOI":"10.1109\/ICCAD.2014.7001410"},{"issue":"8","key":"10582_CR28","doi-asserted-by":"publisher","first-page":"745","DOI":"10.1016\/j.infsof.2005.08.009","volume":"48","author":"T Dyb\u00e5","year":"2006","unstructured":"Dyb\u00e5 T, Kampenes VB, Sj\u00f8berg DI (2006) A systematic review of statistical power in software engineering experiments. Inf Softw Technol 48(8):745\u2013755","journal-title":"Inf Softw Technol"},{"key":"10582_CR29","doi-asserted-by":"crossref","unstructured":"Elwert F (2013) Graphical causal models. In: Handbook of causal analysis for social research, pp 245\u2013273. Springer","DOI":"10.1007\/978-94-007-6094-3_13"},{"key":"10582_CR30","doi-asserted-by":"publisher","unstructured":"Ernst NA (2018) Bayesian hierarchical modelling for tailoring metric thresholds. In: Proceedings of the 15th international conference on mining software repositories, pp 587\u2013591. https:\/\/doi.org\/10.1145\/3196398.3196443","DOI":"10.1145\/3196398.3196443"},{"key":"10582_CR31","doi-asserted-by":"crossref","unstructured":"Ezzini S, Abualhaija S, Arora C, Sabetzadeh M (2022) Automated handling of anaphoric ambiguity in requirements: a multi-solution study. In: Proceedings of the 44th international conference on software engineering, pp 187\u2013199","DOI":"10.1145\/3510003.3510157"},{"key":"10582_CR32","doi-asserted-by":"crossref","unstructured":"Ezzini S, Abualhaija S, Arora C, Sabetzadeh M (2022) TAPHSIR: towards AnaPHoric ambiguity detection and resolution in requirements. In: Proceedings of the 30th ACM joint european software engineering conference and symposium on the foundations of software engineering, pp 1677\u20131681","DOI":"10.1145\/3540250.3558928"},{"key":"10582_CR33","doi-asserted-by":"crossref","unstructured":"Ezzini S, Abualhaija S, Arora C, Sabetzadeh M, Briand LC (2021) Using domain-specific corpora for improved handling of ambiguity in requirements. In: 2021 IEEE\/ACM 43rd International Conference on Software Engineering (ICSE), pp 1485\u20131497. IEEE","DOI":"10.1109\/ICSE43902.2021.00133"},{"key":"10582_CR34","unstructured":"Femmer H (2018) Requirements quality defect detection with the qualicen requirements scout. In: REFSQ Workshops"},{"issue":"3","key":"10582_CR35","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1109\/MS.2018.110161823","volume":"36","author":"H Femmer","year":"2018","unstructured":"Femmer H, Vogelsang A (2018) Requirements quality is quality in use. IEEE Softw 36(3):83\u201391","journal-title":"IEEE Softw"},{"key":"10582_CR36","doi-asserted-by":"publisher","first-page":"190","DOI":"10.1016\/j.jss.2016.02.047","volume":"123","author":"H Femmer","year":"2017","unstructured":"Femmer H, Fern\u00e1ndez DM, Wagner S, Eder S (2017) Rapid quality assurance with requirements smells. J Syst Softw 123:190\u2013213","journal-title":"J Syst Softw"},{"key":"10582_CR37","doi-asserted-by":"crossref","unstructured":"Femmer H, Ku\u010dera J, Vetr\u00f2 A (2014) On the impact of passive voice requirements on domain modelling. In: Proceedings of the 8th ACM\/IEEE international symposium on empirical software engineering and measurement, pp 1\u20134","DOI":"10.1145\/2652524.2652554"},{"key":"10582_CR38","doi-asserted-by":"crossref","unstructured":"Femmer H, Mund J, Fern\u00e1ndez DM (2015) It\u2019s the activities, stupid! A new perspective on re quality. In: 2015 IEEE\/ACM 2nd international workshop on requirements engineering and testing, pp 13\u201319. IEEE","DOI":"10.1109\/RET.2015.11"},{"issue":"3","key":"10582_CR39","doi-asserted-by":"publisher","first-page":"559","DOI":"10.1007\/s10515-019-00261-7","volume":"26","author":"A Ferrari","year":"2019","unstructured":"Ferrari A, Esuli A (2019) An NLP approach for cross-domain ambiguity detection in requirements engineering. Autom Softw Eng 26(3):559\u2013598","journal-title":"Autom Softw Eng"},{"key":"10582_CR40","doi-asserted-by":"publisher","first-page":"3684","DOI":"10.1007\/s10664-018-9596-7","volume":"23","author":"A Ferrari","year":"2018","unstructured":"Ferrari A, Gori G, Rosadini B, Trotta I, Bacherini S, Fantechi A, Gnesi S (2018) Detecting requirements defects with NLP patterns: an industrial experience in the railway domain. Empir Softw Eng 23:3684\u20133733","journal-title":"Empir Softw Eng"},{"key":"10582_CR41","doi-asserted-by":"crossref","unstructured":"Ferrari A, Spagnolo GO, Gnesi S (2017) Pure: a dataset of public requirements documents. In: 2017 IEEE 25th international requirements engineering conference (RE), pp 502\u2013505. IEEE","DOI":"10.1109\/RE.2017.29"},{"issue":"1","key":"10582_CR42","doi-asserted-by":"publisher","first-page":"17","DOI":"10.5381\/jot.2007.6.1.c2","volume":"6","author":"D Firesmith","year":"2007","unstructured":"Firesmith D (2007) Common requirements problems, their negative consequences, and the industry best practices to help solve them. J Object Technol 6(1):17\u201333","journal-title":"J Object Technol"},{"key":"10582_CR43","doi-asserted-by":"crossref","unstructured":"Franch X, Fern\u00e1ndez DM, Oriol M, Vogelsang A, Heldal R, Knauss E, Travassos GH, Carver JC, Dieste O, Zimmermann T (2017) How do practitioners perceive the relevance of requirements engineering research? An ongoing study. In: 2017 IEEE 25th international requirements engineering conference (RE), pp 382\u2013387. IEEE","DOI":"10.1109\/RE.2017.17"},{"key":"10582_CR44","unstructured":"Franch X, Mendez D, Vogelsang A, Heldal R, Knauss E, Oriol M, Travassos G, Carver JC, Zimmermann T (2020) How do practitioners perceive the relevance of requirements engineering research? IEEE Trans Softw Eng"},{"key":"10582_CR45","doi-asserted-by":"publisher","unstructured":"Franch X, Palomares C, Quer C, Chatzipetrou P, Gorschek T (2023) The state-of-practice in requirements specification: an extended interview study at 12 companies. Requir Eng 1\u201333. https:\/\/doi.org\/10.1007\/s00766-023-00399-7","DOI":"10.1007\/s00766-023-00399-7"},{"key":"10582_CR46","doi-asserted-by":"crossref","unstructured":"Frattini J (2024) Replication package for the applying bayesian data analysis for causal inference about requirements quality: a controlled experiment. https:\/\/zenodo.org\/doi\/10.5281\/zenodo.10423665 Accessed: 21-June-2024","DOI":"10.1007\/s10664-024-10582-1"},{"key":"10582_CR47","doi-asserted-by":"crossref","unstructured":"Frattini J, Fucci D, Torkar R, Mendez D (2024) A second look at the impact of passive voice requirements on domain modeling: Bayesian reanalysis of an experiment. In: International workshop on methodological issues with empirical studies in software engineering (WSESE\u201924)","DOI":"10.1145\/3643664.3648211"},{"key":"10582_CR48","doi-asserted-by":"crossref","unstructured":"Frattini J, Montgomery L, Fischbach J, Mendez D, Fucci D, Unterkalmsteiner M (2023) Requirements quality research: a harmonized theory, evaluation, and roadmap. Requir Eng 1\u201314","DOI":"10.1007\/s00766-023-00405-y"},{"key":"10582_CR49","doi-asserted-by":"crossref","unstructured":"Frattini J, Montgomery L, Fischbach J, Unterkalmsteiner M, Mendez D, Fucci D (2022) A live extensible ontology of quality factors for textual requirements. In: 2022 IEEE 30th international requirements engineering conference (RE), pp 274\u2013280. IEEE","DOI":"10.1109\/RE54965.2022.00041"},{"key":"10582_CR50","unstructured":"Frattini J, Unterkalmsteiner M, Fucci D, Mendez D (2024) NLP4RE Tools: classification, overview, and management. Springer International Publishing"},{"key":"10582_CR51","doi-asserted-by":"publisher","unstructured":"Fucci D, Scanniello G, Romano S, Shepperd M, Sigweni B, Uyaguari F, Turhan B, Juristo N, Oivo M (2016) An external replication on the effects of test-driven development using a multi-site blind analysis approach. In: Proceedings of the 10th ACM\/IEEE international symposium on empirical software engineering and measurement, ESEM \u201916. Association for Computing Machinery, New York, NY, USA. https:\/\/doi.org\/10.1145\/2961111.2962592","DOI":"10.1145\/2961111.2962592"},{"key":"10582_CR52","doi-asserted-by":"publisher","unstructured":"Furia CA, Torkar R, Feldt R (2023) Towards causal analysis of empirical software engineering data: the impact of programming languages on coding competitions. ACM Trans Softw Eng Methodol 33(1). https:\/\/doi.org\/10.1145\/3611667","DOI":"10.1145\/3611667"},{"issue":"9","key":"10582_CR53","first-page":"1786","volume":"47","author":"CA Furia","year":"2019","unstructured":"Furia CA, Feldt R, Torkar R (2019) Bayesian data analysis in empirical software engineering research. IEEE Trans Softw Eng 47(9):1786\u20131810","journal-title":"IEEE Trans Softw Eng"},{"issue":"3","key":"10582_CR54","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3490953","volume":"31","author":"CA Furia","year":"2022","unstructured":"Furia CA, Torkar R, Feldt R (2022) Applying Bayesian analysis guidelines to empirical software engineering data: The case of programming languages and code quality. ACM Trans Softw Eng Methodol (TOSEM) 31(3):1\u201338","journal-title":"ACM Trans Softw Eng Methodol (TOSEM)"},{"key":"10582_CR55","unstructured":"Gelman A (2018) You need 16 times the sample size to estimate an interaction than to estimate a main effect. https:\/\/statmodeling.stat.columbia.edu\/2018\/03\/15\/need16\/. Accessed 24-Nov-2023"},{"key":"10582_CR56","unstructured":"Gelman A, Vehtari A, Simpson D, Margossian CC, Carpenter B, Yao Y, Kennedy L, Gabry J, B\u00fcrkner PC, Modr\u00e1k M (2020) Bayesian workflow. arXiv:2011.01808"},{"key":"10582_CR57","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1007\/s00766-011-0134-z","volume":"18","author":"G G\u00e9nova","year":"2013","unstructured":"G\u00e9nova G, Fuentes JM, Llorens J, Hurtado O, Moreno V (2013) A framework to measure and improve the quality of textual requirements. Requir Eng 18:25\u201341","journal-title":"Requir Eng"},{"key":"10582_CR58","doi-asserted-by":"crossref","unstructured":"Gleich B, Creighton O, Kof L (2010) Ambiguity detection: towards a tool explaining ambiguity sources. In: Requirements engineering: foundation for software quality: 16th international working conference, REFSQ 2010, Essen, Germany, June 30\u2013July 2, 2010. Proceedings 16, pp 218\u2013232. Springer","DOI":"10.1007\/978-3-642-14192-8_20"},{"key":"10582_CR59","doi-asserted-by":"crossref","unstructured":"G\u00f3mez OS, Juristo N, Vegas S (2010) Replications types in experimental disciplines. In: Proceedings of the 2010 ACM-IEEE international symposium on empirical software engineering and measurement, pp 1\u201310","DOI":"10.1145\/1852786.1852790"},{"issue":"3","key":"10582_CR60","doi-asserted-by":"publisher","first-page":"459","DOI":"10.1007\/s00766-021-00351-7","volume":"26","author":"L Gren","year":"2021","unstructured":"Gren L, Berntsson Svensson R (2021) Is it possible to disregard obsolete requirements? a family of experiments in software effort estimation. Requir Eng 26(3):459\u2013480","journal-title":"Requir Eng"},{"key":"10582_CR61","unstructured":"Hasso H, Dembach M, Geppert H, Toews D (2019) Detection of defective requirements using rule-based scripts. In: REFSQ workshops"},{"key":"10582_CR62","unstructured":"Hsu H, Lachenbruch PA (2014) Paired $$t$$ test. Wiley StatsRef: statistics reference online"},{"key":"10582_CR63","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511790423","volume-title":"Probability theory: the logic of science","author":"ET Jaynes","year":"2003","unstructured":"Jaynes ET (2003) Probability theory: the logic of science. Cambridge University Press, Cambridge"},{"key":"10582_CR64","doi-asserted-by":"crossref","unstructured":"Jedlitschka A, Ciolkowski M, Pfahl D (2008) Reporting experiments in software engineering. Guide Adv Empir Softw Eng 201\u2013228","DOI":"10.1007\/978-1-84800-044-5_8"},{"key":"10582_CR65","unstructured":"Juergens E, Deissenboeck F (2010) How much is a clone. In: Proceedings of the 4th international workshop on software quality and maintainability, pp 79\u201388"},{"key":"10582_CR66","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1007\/s10664-010-9141-9","volume":"16","author":"N Juristo","year":"2011","unstructured":"Juristo N, Vegas S (2011) The role of non-exact replications in software engineering experiments. Empir Softw Eng 16:295\u2013324","journal-title":"Empir Softw Eng"},{"key":"10582_CR67","unstructured":"Kamsties E, Peach B (2000) Taming ambiguity in natural language requirements. In: Proceedings of the thirteenth international conference on software and systems engineering and applications, vol 1315"},{"key":"10582_CR68","doi-asserted-by":"crossref","unstructured":"Kamsties E, von Knethen A, Philipps J (2005) An empirical investigation of requirements specification languages: detecting defects while formalizing requirements. In: Information modeling methods and methodologies: advanced topics in database research, pp 125\u2013147. IGI Global","DOI":"10.4018\/978-1-59140-375-3.ch007"},{"key":"10582_CR69","unstructured":"King BM, Rosopa PJ, Minium EW (2018) Statistical reasoning in the behavioral sciences. John Wiley & Sons"},{"key":"10582_CR70","doi-asserted-by":"crossref","unstructured":"Kitchenham B, Fry J, Linkman S (2003) The case against cross-over designs in software engineering. In: Eleventh annual international workshop on software technology and engineering practice, pp 65\u201367. IEEE","DOI":"10.1109\/STEP.2003.32"},{"key":"10582_CR71","doi-asserted-by":"crossref","unstructured":"Knauss E, Schneider K, Stapel K (2009) Learning to write better requirements through heuristic critiques. In: 2009 17th IEEE international requirements engineering conference, pp 387\u2013388. IEEE","DOI":"10.1109\/RE.2009.58"},{"key":"10582_CR72","doi-asserted-by":"crossref","unstructured":"Kof L (2007) Treatment of passive voice and conjunctions in use case documents. In: Natural language processing and information systems: 12th international conference on applications of natural language to information systems, NLDB 2007, Paris, France, June 27-29, 2007. Proceedings 12, pp 181\u2013192. Springer","DOI":"10.1007\/978-3-540-73351-5_16"},{"key":"10582_CR73","doi-asserted-by":"crossref","unstructured":"Krisch J, Houdek F (2015) The myth of bad passive voice and weak words an empirical investigation in the automotive industry. In: 2015 IEEE 23rd international requirements engineering conference (RE), pp 344\u2013351. IEEE","DOI":"10.1109\/RE.2015.7320451"},{"key":"10582_CR74","unstructured":"Lev\u00e9n W, Broman H, Besker T, Torkar R (2022) The broken windows theory applies to technical debt. arXiv:2209.01549"},{"key":"10582_CR75","unstructured":"Martyniuk W (2006) Common european framework of reference for languages: learning, teaching, assessment (cefr)\u2013a synopsis. In: Annual meeting of the consortium for language teaching and learning cornell university. Concil of Europe, Language policy division. https:\/\/rm.coe.int\/16802fc1bf"},{"key":"10582_CR76","doi-asserted-by":"crossref","unstructured":"McElreath R (2020) Statistical rethinking: a Bayesian course with examples in R and Stan. CRC press","DOI":"10.1201\/9780429029608"},{"key":"10582_CR77","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1007\/s00766-014-0206-y","volume":"20","author":"D M\u00e9ndez Fern\u00e1ndez","year":"2015","unstructured":"M\u00e9ndez Fern\u00e1ndez D, Penzenstadler B (2015) Artefact-based requirements engineering: the AMDiRE approach. Requir Eng 20:405\u2013434","journal-title":"Requir Eng"},{"key":"10582_CR78","doi-asserted-by":"publisher","first-page":"2777","DOI":"10.1007\/s10270-019-00714-3","volume":"18","author":"D M\u00e9ndez Fern\u00e1ndez","year":"2019","unstructured":"M\u00e9ndez Fern\u00e1ndez D, B\u00f6hm W, Vogelsang A, Mund J, Broy M, Kuhrmann M, Weyer T (2019) Artefacts in software engineering: a fundamental positioning. Softw Syst Model 18:2777\u20132786","journal-title":"Softw Syst Model"},{"key":"10582_CR79","doi-asserted-by":"publisher","first-page":"2298","DOI":"10.1007\/s10664-016-9451-7","volume":"22","author":"D M\u00e9ndez","year":"2017","unstructured":"M\u00e9ndez D, Wagner S, Kalinowski M, Felderer M, Mafra P, Vetr\u00f2 A, Conte T, Christiansson MT, Greer D, Lassenius C et al (2017) Naming the pain in requirements engineering: contemporary problems, causes, and effects in practice. Empir Softw Eng 22:2298\u20132338","journal-title":"Empir Softw Eng"},{"issue":"2","key":"10582_CR80","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1007\/s00766-021-00367-z","volume":"27","author":"L Montgomery","year":"2022","unstructured":"Montgomery L, Fucci D, Bouraffa A, Scholz L, Maalej W (2022) Empirical research on requirements quality: a systematic mapping study. Requir Eng 27(2):183\u2013209","journal-title":"Requir Eng"},{"key":"10582_CR81","doi-asserted-by":"crossref","unstructured":"Mund J, Fernandez DM, Femmer H, Eckhardt J (2015) Does quality of requirements specifications matter? Combined results of two empirical studies. In: 2015 ACM\/IEEE international symposium on Empirical Software Engineering and Measurement (ESEM), pp 1\u201310. IEEE","DOI":"10.1109\/ESEM.2015.7321195"},{"issue":"2","key":"10582_CR82","doi-asserted-by":"publisher","first-page":"613","DOI":"10.1093\/ije\/dyaa211","volume":"50","author":"A Nilsson","year":"2021","unstructured":"Nilsson A, Bonander C, Str\u00f6mberg U, Bj\u00f6rk J (2021) A directed acyclic graph for interactions. Int J Epidemiol 50(2):613\u2013619","journal-title":"Int J Epidemiol"},{"issue":"3","key":"10582_CR83","doi-asserted-by":"publisher","first-page":"e3000691","DOI":"10.1371\/journal.pbio.3000691","volume":"18","author":"BA Nosek","year":"2020","unstructured":"Nosek BA, Errington TM (2020) What is replication? PLoS Biol 18(3):e3000691","journal-title":"PLoS Biol"},{"key":"10582_CR84","doi-asserted-by":"crossref","unstructured":"Nuseibeh B, Easterbrook S (2000) Requirements engineering: a roadmap. In: Proceedings of the conference on the future of software engineering, pp 35\u201346","DOI":"10.1145\/336512.336523"},{"key":"10582_CR85","volume-title":"Contemporary linguistics: an introduction","author":"W O\u2019Grady","year":"2001","unstructured":"O\u2019Grady W, Archibald J, Aronoff M, Rees-Miller J (2001) Contemporary linguistics: an introduction. Bedford\/St. Martin\u2019s, Boston"},{"key":"10582_CR86","doi-asserted-by":"publisher","first-page":"180","DOI":"10.1016\/j.infsof.2015.07.006","volume":"67","author":"E Parra","year":"2015","unstructured":"Parra E, Dimou C, Llorens J, Moreno V, Fraga A (2015) A methodology for the classification of quality of requirements using machine learning techniques. Inf Softw Technol 67:180\u2013195","journal-title":"Inf Softw Technol"},{"key":"10582_CR87","doi-asserted-by":"crossref","unstructured":"Pearl J (1995) From Bayesian networks to causal networks. In: Mathematical models for handling partial knowledge in artificial intelligence, pp 157\u2013182. Springer","DOI":"10.1007\/978-1-4899-1424-8_9"},{"key":"10582_CR88","unstructured":"Pearl J, Glymour M, Jewell NP (2016) Causal inference in statistics: a primer. John Wiley & Sons"},{"key":"10582_CR89","doi-asserted-by":"crossref","unstructured":"Petersen K, Wohlin C (2009) Context in industrial software engineering research. In: 2009 3rd International symposium on empirical software engineering and measurement, pp 401\u2013404. IEEE","DOI":"10.1109\/ESEM.2009.5316010"},{"issue":"1","key":"10582_CR90","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1007\/s11219-006-9006-z","volume":"15","author":"KT Phalp","year":"2007","unstructured":"Phalp KT, Vincent J, Cox K (2007) Assessing the quality of use case descriptions. Software Qual J 15(1):69\u201397","journal-title":"Software Qual J"},{"key":"10582_CR91","doi-asserted-by":"crossref","unstructured":"Philippo EJ, Heijstek W, Kruiswijk B, Chaudron MR, Berry DM (2013) Requirement ambiguity not as important as expected-results of an empirical evaluation. In: Requirements engineering: foundation for software quality: 19th international working conference, REFSQ 2013, Essen, Germany, April 8-11, 2013. Proceedings 19, pp 65\u201379. Springer","DOI":"10.1007\/978-3-642-37422-7_5"},{"issue":"14","key":"10582_CR92","doi-asserted-by":"publisher","first-page":"811","DOI":"10.1016\/S0950-5849(98)00101-3","volume":"40","author":"LM Pickard","year":"1998","unstructured":"Pickard LM, Kitchenham BA, Jones PW (1998) Combining empirical results in software engineering. Inf Softw Technol 40(14):811\u2013821","journal-title":"Inf Softw Technol"},{"key":"10582_CR93","doi-asserted-by":"publisher","unstructured":"Poesio M (1996) Semantic ambiguity and perceived ambiguity. In: van Deemter K, Peters S (eds) Semantic ambiguity and underspecification. Center for the study of language and Inf, United Kingdom. https:\/\/doi.org\/10.48550\/arXiv.cmp-lg\/9505034","DOI":"10.48550\/arXiv.cmp-lg\/9505034"},{"key":"10582_CR94","unstructured":"Pohl K (2016) Requirements engineering fundamentals: a study guide for the certified professional for requirements engineering exam-foundation level-IREB compliant. Rocky Nook, Inc"},{"key":"10582_CR95","doi-asserted-by":"crossref","unstructured":"Rosadini B, Ferrari A, Gori G, Fantechi A, Gnesi S, Trotta I, Bacherini S (2017) Using NLP to detect requirements defects: an industrial experience in the railway domain. In: Requirements engineering: foundation for software quality: 23rd international working conference, REFSQ 2017, Essen, Germany, February 27\u2013March 2, 2017, Proceedings 23, pp 344\u2013360. Springer","DOI":"10.1007\/978-3-319-54045-0_24"},{"issue":"3","key":"10582_CR96","doi-asserted-by":"publisher","first-page":"819","DOI":"10.1109\/TSE.2020.3003413","volume":"48","author":"D Russo","year":"2020","unstructured":"Russo D, Stol KJ (2020) Gender differences in personality traits of software engineers. IEEE Trans Softw Eng 48(3):819\u2013834","journal-title":"IEEE Trans Softw Eng"},{"key":"10582_CR97","doi-asserted-by":"crossref","unstructured":"Salman I, Misirli AT, Juristo N (2015) Are students representatives of professionals in software engineering experiments? In: 2015 IEEE\/ACM 37th IEEE international conference on software engineering, vol 1, pp 666\u2013676. IEEE","DOI":"10.1109\/ICSE.2015.82"},{"issue":"2\u20134","key":"10582_CR98","first-page":"308","volume":"1","author":"US Shah","year":"2015","unstructured":"Shah US, Jinwala DC (2015) Resolving ambiguity in natural language specification to generate UML diagrams for requirements specification. Int J Softw Eng Technol Appl 1(2\u20134):308\u2013334","journal-title":"Int J Softw Eng Technol Appl"},{"issue":"3\/4","key":"10582_CR99","doi-asserted-by":"publisher","first-page":"591","DOI":"10.2307\/2333709","volume":"52","author":"SS Shapiro","year":"1965","unstructured":"Shapiro SS, Wilk MB (1965) An analysis of variance test for normality (complete samples). Biometrika 52(3\/4):591\u2013611","journal-title":"Biometrika"},{"key":"10582_CR100","doi-asserted-by":"crossref","unstructured":"Sharma R, Sharma N, Biswas K (2016) Machine learning for detecting pronominal anaphora ambiguity in NL requirements. In: 2016 4th Intl conf on applied computing and information technology\/3rd intl conf on computational science\/intelligence and applied informatics\/1st intl conf on big data, cloud computing, data science & engineering (ACIT-CSII-BCD), pp 177\u2013182. IEEE","DOI":"10.1109\/ACIT-CSII-BCD.2016.043"},{"key":"10582_CR101","doi-asserted-by":"crossref","unstructured":"Siebert J (2023) Applications of statistical causal inference in software engineering. Inf Softw Technol 107198","DOI":"10.1016\/j.infsof.2023.107198"},{"key":"10582_CR102","doi-asserted-by":"publisher","unstructured":"Sj\u00f8berg DI, Anda B, Arisholm E, Dyb\u00e5 T, J\u00f8rgensen M, Karahasanovi\u0107 A, Vok\u00e1\u010d M (2003) Challenges and recommendations when increasing the realism of controlled software engineering experiments. In: Empirical methods and studies in software engineering: Experiences from ESERNET, pp. 24\u201338. Springer. https:\/\/doi.org\/10.1007\/978-3-540-45143-3_3","DOI":"10.1007\/978-3-540-45143-3_3"},{"key":"10582_CR103","unstructured":"Soeken M, Abdessaied N, Allahyari-Abhari A, Buzo A, Musat L, Pelz G, Drechsler R (2014) Quality assessment for requirements based on natural language processing. In: Forum on specification and design languages. Proceedings. Citeseer"},{"issue":"3","key":"10582_CR104","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3241743","volume":"27","author":"KJ Stol","year":"2018","unstructured":"Stol KJ, Fitzgerald B (2018) The ABC of software engineering research. ACM Trans Softw Eng Methodol (TOSEM) 27(3):1\u201351","journal-title":"ACM Trans Softw Eng Methodol (TOSEM)"},{"key":"10582_CR105","doi-asserted-by":"crossref","unstructured":"Svensson RB, Feldt R, Torkar R (2019) The unfulfilled potential of data-driven decision making in agile software development. In: Agile processes in software engineering and extreme programming: 20th international conference, XP 2019, Montr\u00e9al, QC, Canada, May 21\u201325, 2019, Proceedings 20, pp 69\u201385. Springer","DOI":"10.1007\/978-3-030-19034-7_5"},{"key":"10582_CR106","doi-asserted-by":"publisher","unstructured":"Torkar R, Feldt R, Furia CA (2020) Bayesian data analysis in empirical software engineering: the case of missing data, pp 289\u2013324. Springer International Publishing, Cham. https:\/\/doi.org\/10.1007\/978-3-030-32489-6_11","DOI":"10.1007\/978-3-030-32489-6_11"},{"issue":"2","key":"10582_CR107","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1109\/TSE.2015.2467378","volume":"42","author":"S Vegas","year":"2015","unstructured":"Vegas S, Apa C, Juristo N (2015) Crossover designs in software engineering experiments: benefits and perils. IEEE Trans Softw Eng 42(2):120\u2013135. https:\/\/doi.org\/10.1109\/TSE.2015.2467378","journal-title":"IEEE Trans Softw Eng"},{"key":"10582_CR108","doi-asserted-by":"crossref","unstructured":"Vieira R, Mesquita D, Mattos CL, Britto R, Rocha L, Gomes J (2022) Bayesian analysis of bug-fixing time using report data. In: Proceedings of the 16th ACM\/IEEE international symposium on empirical software engineering and measurement, pp 57\u201368","DOI":"10.1145\/3544902.3546256"},{"issue":"2","key":"10582_CR109","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3306607","volume":"28","author":"S Wagner","year":"2019","unstructured":"Wagner S, Fern\u00e1ndez DM, Felderer M, Vetr\u00f2 A, Kalinowski M, Wieringa R, Pfahl D, Conte T, Christiansson MT, Greer D et al (2019) Status quo in requirements engineering: a theory and a global family of surveys. ACM Trans Softw Eng Methodol (TOSEM) 28(2):1\u201348","journal-title":"ACM Trans Softw Eng Methodol (TOSEM)"},{"key":"10582_CR110","doi-asserted-by":"crossref","unstructured":"Wagner S, Lochmann K, Heinemann L, Kl\u00e4s M, Trendowicz A, Pl\u00f6sch R, Seidi A, Goeb A, Streit J (2012) The Quamoco product quality modelling and assessment approach. In: 2012 34th International Conference on Software Engineering (ICSE), pp 1133\u20131142. IEEE","DOI":"10.1109\/ICSE.2012.6227106"},{"issue":"9","key":"10582_CR111","doi-asserted-by":"publisher","DOI":"10.1002\/ecs2.3739","volume":"12","author":"JS Wesner","year":"2021","unstructured":"Wesner JS, Pomeranz JP (2021) Choosing priors in Bayesian ecological models by simulating from the prior predictive distribution. Ecosphere 12(9):e03739","journal-title":"Ecosphere"},{"issue":"6","key":"10582_CR112","doi-asserted-by":"publisher","first-page":"80","DOI":"10.2307\/3001968","volume":"1","author":"F Wilcoxon","year":"1945","unstructured":"Wilcoxon F (1945) Individual comparisons by ranking methods. Biom Bull 1(6):80\u201383","journal-title":"Biom Bull"},{"key":"10582_CR113","doi-asserted-by":"crossref","unstructured":"Wohlin C, Runeson P, H\u00f6st M, Ohlsson MC, Regnell B, Wessl\u00e9n A (2012) Experimentation in software engineering. Springer Science & Business Media","DOI":"10.1007\/978-3-642-29044-2"},{"key":"10582_CR114","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1007\/s00766-011-0119-y","volume":"16","author":"H Yang","year":"2011","unstructured":"Yang H, De Roeck A, Gervasi V, Willis A, Nuseibeh B (2011) Analysing anaphoric ambiguity in natural language requirements. Requir Eng 16:163\u2013189","journal-title":"Requir Eng"},{"key":"10582_CR115","doi-asserted-by":"crossref","unstructured":"Yang H, De\u00a0Roeck A, Gervasi V, Willis A, Nuseibeh B (2010) Extending nocuous ambiguity analysis for anaphora in natural language requirements. In: 2010 18th IEEE international requirements engineering conference, pp 25\u201334. IEEE","DOI":"10.1109\/RE.2010.14"},{"issue":"3","key":"10582_CR116","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3444689","volume":"54","author":"L Zhao","year":"2021","unstructured":"Zhao L, Alhoshan W, Ferrari A, Letsholo KJ, Ajagbe MA, Chioasca EV, Batista-Navarro RT (2021) Natural language processing for requirements engineering: a systematic mapping study. ACM Comput Surv (CSUR) 54(3):1\u201341","journal-title":"ACM Comput Surv (CSUR)"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-024-10582-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-024-10582-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-024-10582-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,7]],"date-time":"2025-01-07T14:15:36Z","timestamp":1736259336000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-024-10582-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,22]]},"references-count":116,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,1]]}},"alternative-id":["10582"],"URL":"https:\/\/doi.org\/10.1007\/s10664-024-10582-1","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,22]]},"assertion":[{"value":"24 October 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 November 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of Interest"}}],"article-number":"29"}}