{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T04:28:12Z","timestamp":1772252892615,"version":"3.50.1"},"reference-count":41,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2022,10,27]],"date-time":"2022-10-27T00:00:00Z","timestamp":1666828800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministry of Education, Culture, Research and Technology Republic of Indonesia","award":["084\/E5\/PG.02.00.PT\/2022"],"award-info":[{"award-number":["084\/E5\/PG.02.00.PT\/2022"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Informatics"],"abstract":"<jats:p>Noise in requirements has been known to be a defect in software requirements specifications (SRS). Detecting defects at an early stage is crucial in the process of software development. Noise can be in the form of irrelevant requirements that are included within an SRS. A previous study had attempted to detect noise in SRS, in which noise was considered as an outlier. However, the resulting method only demonstrated a moderate reliability due to the overshadowing of unique actor words by unique action words in the topic\u2013word distribution. In this study, we propose a framework to identify irrelevant requirements based on the MultiPhiLDA method. The proposed framework distinguishes the topic\u2013word distribution of actor words and action words as two separate topic\u2013word distributions with two multinomial probability functions. Weights are used to maintain a proportional contribution of actor and action words. We also explore the use of two outlier detection methods, namely percentile-based outlier detection (PBOD) and angle-based outlier detection (ABOD), to distinguish irrelevant requirements from relevant requirements. The experimental results show that the proposed framework was able to exhibit better performance than previous methods. Furthermore, the use of the combination of ABOD as the outlier detection method and topic coherence as the estimation approach to determine the optimal number of topics and iterations in the proposed framework outperformed the other combinations and obtained sensitivity, specificity, F1-score, and G-mean values of 0.59, 0.65, 0.62, and 0.62, respectively.<\/jats:p>","DOI":"10.3390\/informatics9040087","type":"journal-article","created":{"date-parts":[[2022,10,27]],"date-time":"2022-10-27T04:35:17Z","timestamp":1666845317000},"page":"87","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A Novel Framework to Detect Irrelevant Software Requirements Based on MultiPhiLDA as the Topic Model"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6560-2975","authenticated-orcid":false,"given":"Daniel","family":"Siahaan","sequence":"first","affiliation":[{"name":"Informatics Department, Institut Teknologi Sepuluh Nopember, Surabaya 60111, Indonesia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2597-5165","authenticated-orcid":false,"given":"Brian Rizqi Paradisiaca","family":"Darnoto","sequence":"additional","affiliation":[{"name":"Informatics Department, Institut Teknologi Sepuluh Nopember, Surabaya 60111, Indonesia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,10,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Iqbal, J., Ahmad, R.B., Khan, M., Alyahya, S., Nasir, M.H.N., Akhunzada, A., and Shoaib, M. (2020). Requirements engineering issues causing software development outsourcing failure. PLoS ONE, 15.","DOI":"10.1371\/journal.pone.0229785"},{"key":"ref_2","first-page":"118","article-title":"Identifying the Reasons for Software Project Failure and Some of their Proposed Remedial through BRIDGE Process Models","volume":"3","author":"Mandal","year":"2015","journal-title":"Int. J. Comput. Sci. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1007\/s11219-017-9362-x","article-title":"Stability prediction of the software requirements specification","volume":"26","year":"2018","journal-title":"Softw. Qual. J."},{"key":"ref_4","first-page":"341","article-title":"Case studies of most common and severe types of software system failure","volume":"2","author":"Dalal","year":"2012","journal-title":"Int. J. Adv. Res. Comput. Sci. Softw. Eng."},{"key":"ref_5","unstructured":"Wiegers, K.E., and Beatty, J. (2013). Software Requirements, Microsoft Press. [3rd ed.]."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.18517\/ijaseit.10.3.10164","article-title":"An ontology framework for generating requirements specification","volume":"10","author":"Yanuarifiani","year":"2020","journal-title":"Int. J. Adv. Sci. Eng. Inf. Technol."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zheng, L. (2015, January 23\u201325). Effective information elicit for software quality specification based on ontology. Proceedings of the IEEE International Conference on Software Engineering and Service Sciences ICSESS, IEEE Computer Society, Beijing, China.","DOI":"10.1109\/ICSESS.2015.7339148"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/MS.1985.229776","article-title":"On Formalism in Specification","volume":"2","author":"Meyer","year":"1985","journal-title":"IEEE Softw."},{"key":"ref_9","first-page":"1","article-title":"Algorithms Comparison For Non- Requirements Classification Using The Semantic Feature of Software","volume":"31","author":"Fahmi","year":"2020","journal-title":"IPTEK J. Technol. Sci."},{"key":"ref_10","first-page":"30","article-title":"Noise Detection In Software Requirements Specification Document Using Spectral Clustering","volume":"17","author":"Manek","year":"2019","journal-title":"JUTI J. Ilm. Teknol. Inf."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"46335","DOI":"10.1109\/ACCESS.2020.2974101","article-title":"Feature extraction and analysis of natural language processing for deep learning english language","volume":"8","author":"Wang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"15169","DOI":"10.1007\/s11042-018-6894-4","article-title":"Latent Dirichlet allocation (LDA) and topic modeling: Models, applications, a survey","volume":"78","author":"Jelodar","year":"2019","journal-title":"Multimed. Tools Appl."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.knosys.2018.08.011","article-title":"Experimental explorations on short text topic mining between LDA and NMF based Schemes","volume":"163","author":"Chen","year":"2019","journal-title":"Knowl.-Based Syst."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Chen, Y.H., and Li, S.F. (2016, January 24\u201329). Using latent Dirichlet allocation to improve text classification performance of support vector machine. Proceedings of the 2016 IEEE Congress on Evolutionary Computation, CEC, Vancouver, BC, Canada.","DOI":"10.1109\/CEC.2016.7743935"},{"key":"ref_15","unstructured":"Schr\u00f6der, K. (2018). Hierarchical Multiclass Topic Modelling with Prior Knowledge. [Master\u2019s Thesis, Humboldt\u2014Universit\u00e4t zu Berlin]."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Suri, P., and Roy, N.R. (2017, January 9\u201310). Comparison between LDA & NMF for event-detection from large text stream data. Proceedings of the 3rd IEEE International Conference on \u201cComputational Intelligence and Communication Technology\u201d, Ghaziabad, India.","DOI":"10.1109\/CIACT.2017.7977281"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Kriegel, H.P., Schubert, M., and Zimek, A. (2008, January 24\u201327). Angle-based outlier detection in high-dimensional data. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Las Vegas, NV, USA.","DOI":"10.1145\/1401890.1401946"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"107400","DOI":"10.1016\/j.knosys.2021.107400","article-title":"EBOD: An ensemble-based outlier detection algorithm for noisy datasets","volume":"231","author":"Ouyang","year":"2021","journal-title":"Knowl.-Based Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"101034","DOI":"10.1016\/j.retrec.2021.101034","article-title":"Machine learning methods for commercial vehicle wait time prediction at a border crossing","volume":"89","author":"Sharma","year":"2021","journal-title":"Res. Transp. Econ."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"106417","DOI":"10.1016\/j.knosys.2020.106417","article-title":"A hybrid neural network for predicting Days on Market a measure of liquidity in real estate industry","volume":"208","author":"Kamara","year":"2020","journal-title":"Knowl.-Based Syst."},{"key":"ref_21","unstructured":"Darnoto, B.R.P., and Siahaan, D. (2021, January 27\u201328). MultiPhiLDA for Detection Irrelevant Software Requirement Specification. Proceedings of the 2021 International Conference on Computer Science, Information Technology and Electrical Engineering, Banyuwangi, Indonesia."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1007\/s00766-016-0258-2","article-title":"Empirical research in requirements engineering: Trends and opportunities","volume":"23","author":"Ambreen","year":"2018","journal-title":"Requir. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Romano, S., Scanniello, G., Fucci, D., Juristo, N., and Turhan, B. (2018, January 23\u201329). Poster: The effect of noise on requirements comprehension. Proceedings of the International Conference on Software Engineering, Madrid, Spain.","DOI":"10.1145\/3183440.3194984"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1109\/TSE.2010.78","article-title":"The impact of irrelevant and misleading information on software development effort estimates: A randomized controlled field experiment","volume":"37","author":"Grimstad","year":"2011","journal-title":"IEEE Trans. Softw. Eng."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3684","DOI":"10.1007\/s10664-018-9596-7","article-title":"Detecting requirements defects with NLP patterns: An industrial experience in the railway domain","volume":"23","author":"Ferrari","year":"2018","journal-title":"Empir. Softw. Eng."},{"key":"ref_26","first-page":"47","article-title":"Requirements defects techniques in requirements analysis: A review","volume":"10","author":"Kamalrudin","year":"2018","journal-title":"J. Telecommun. Electron. Comput. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1007\/978-3-319-17398-6_9","article-title":"The relevance of software requirement defect management to improve requirements and product quality: A systematic literature review","volume":"355","author":"Rosmadi","year":"2015","journal-title":"Adv. Intell. Syst. Comput."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1016\/j.aej.2014.06.001","article-title":"Detecting defects in software requirements specification","volume":"53","author":"Alshazly","year":"2014","journal-title":"Alex. Eng. J."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1007\/s10664-017-9506-4","article-title":"Impact of incorrect and new requirements on waterfall software project outcomes","volume":"23","author":"Chari","year":"2018","journal-title":"Empir. Softw. Eng."},{"key":"ref_30","unstructured":"Mart\u00ednez, A.B.B., Arias, J.J.P., and Vilas, A.F. (April, January 29). Merging requirements views with incompleteness and inconsistency. Proceedings of the Australian Software Engineering Conference, ASWEC, Brisbane, Australia."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1016\/j.procir.2017.03.132","article-title":"Design for Customization: A New Paradigm for Product-Service System Development","volume":"64","author":"Elgammal","year":"2017","journal-title":"Procedia CIRP"},{"key":"ref_32","unstructured":"\u00d6zlem, A., Kurto\u01e7lu, H., and Bi\u00e7ak\u00e7i, M. (2009, January 1\u20133). Incomplete software requirements and assumptions made by software engineers. Proceedings of the Asia-Pacific Software Engineering Conference, APSEC, Penang, Malaysia."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/j.ins.2018.04.071","article-title":"Filtering out the noise in short text topic modeling","volume":"456","author":"Li","year":"2018","journal-title":"Inf. Sci."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"99141","DOI":"10.1109\/ACCESS.2020.2997973","article-title":"Collaboratively Modeling and Embedding of Latent Topics for Short Texts","volume":"8","author":"Liu","year":"2020","journal-title":"IEEE Access"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1684","DOI":"10.1016\/j.eswa.2014.09.031","article-title":"Learning to classify short text from scientific documents using topic models with various types of knowledge","volume":"42","author":"Vo","year":"2015","journal-title":"Expert Syst. Appl."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"42","DOI":"10.3389\/frai.2020.00042","article-title":"Using Topic Modeling Methods for Short-Text Data: A Comparative Analysis","volume":"3","author":"Albalawi","year":"2020","journal-title":"Front. Artif. Intell."},{"key":"ref_37","first-page":"426","article-title":"Topic discovery of online course reviews using LDA with leveraging reviews helpfulness","volume":"9","author":"Lubis","year":"2019","journal-title":"Int. J. Electr. Comput. Eng."},{"key":"ref_38","first-page":"158","article-title":"The use of percentiles and percentile rank classes in the analysis of bibliometric data: Opportunities and limits","volume":"7","author":"Bornmann","year":"2013","journal-title":"J. Inf."},{"key":"ref_39","unstructured":"Siahaan, D. (2022, June 13). Irrelevant Requirements. Available online: http:\/\/dx.doi.org\/10.6084\/m9.figshare.19380545.v1."},{"key":"ref_40","unstructured":"Tang, J., Meng, Z., Nguyen, X.L., Mel, Q., and Zhang, M. (2014, January 21\u201326). Understanding the limiting factors of topic modeling via posterior contraction analysis. Proceedings of the 31st International Conference on Machine Learning, International Machine Learning Society (IMLS) 2014, Beijing, China."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Netemeyer, R.G., Bearden, W.O., and Sharma, S. (2003). Scaling Procedures: Issues and Applications, SAGE. [1st ed.].","DOI":"10.4135\/9781412985772"}],"container-title":["Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9709\/9\/4\/87\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:03:48Z","timestamp":1760144628000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9709\/9\/4\/87"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,27]]},"references-count":41,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["informatics9040087"],"URL":"https:\/\/doi.org\/10.3390\/informatics9040087","relation":{"has-preprint":[{"id-type":"doi","id":"10.20944\/preprints202208.0523.v1","asserted-by":"object"}]},"ISSN":["2227-9709"],"issn-type":[{"value":"2227-9709","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,27]]}}}