{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T12:48:26Z","timestamp":1763038106041,"version":"build-2065373602"},"reference-count":49,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2025,9,3]],"date-time":"2025-09-03T00:00:00Z","timestamp":1756857600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Scientific Fund of the Paisii Hilendarski University of Plovdiv","award":["FP25-FMI-010"],"award-info":[{"award-number":["FP25-FMI-010"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computation"],"abstract":"<jats:p>One of the key components of the software quality model is reliability. Its importance has grown with the increasing use and reuse of open-source components in software development. Software reliability growth models are commonly employed to address this aspect by predicting future failure rates and estimating the number of remaining defects throughout the development process. This paper investigates two software reliability growth models derived from the Verhulst model, with a particular focus on a structural property known as Hausdorff saturation. We provide analytical estimates for this characteristic and propose it as an additional criterion for model selection. The models are evaluated using four open-source datasets, where the Hausdorff saturation metric supports the conclusions drawn from standard goodness-of-fit measures. Furthermore, we introduce an interactive software reliability assessment tool that integrates with GitHub, enabling expert users to analyze real-time issue-tracking data from open-source repositories. The tool facilitates model comparison and enhances practical applicability. Overall, the proposed approach contributes to more robust reliability assessment by combining theoretical insights with actionable diagnostics.<\/jats:p>","DOI":"10.3390\/computation13090214","type":"journal-article","created":{"date-parts":[[2025,9,3]],"date-time":"2025-09-03T15:15:57Z","timestamp":1756912557000},"page":"214","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Modeling and Assessing Software Reliability in Open-Source Projects"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2194-6391","authenticated-orcid":false,"given":"Maria T.","family":"Vasileva","sequence":"first","affiliation":[{"name":"Faculty of Mathematics and Informatics, University of Plovdiv Paisii Hilendarski, 24 Tzar Asen, 4000 Plovdiv, Bulgaria"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0834-6463","authenticated-orcid":false,"given":"Georgi","family":"Penchev","sequence":"additional","affiliation":[{"name":"Faculty of Mathematics and Informatics, University of Plovdiv Paisii Hilendarski, 24 Tzar Asen, 4000 Plovdiv, Bulgaria"}]}],"member":"1968","published-online":{"date-parts":[[2025,9,3]]},"reference":[{"key":"ref_1","unstructured":"(2023). Systems and Software Engineering\u2014Systems and Software Quality Requirements and Evaluation (SQuaRE)\u2014Product Quality Model (Standard No. ISO\/IEC 25010:2023)."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"111267","DOI":"10.1016\/j.jss.2022.111267","article-title":"A software reliability growth model for imperfect debugging","volume":"188","author":"Huang","year":"2022","journal-title":"J. Syst. Softw."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Tian, Q., Yeh, C.W., and Fang, C.C. (2022). Bayesian decision making of an imperfect debugging software reliability growth model with consideration of debuggers\u2019 learning and negligence factors. Mathematics, 10.","DOI":"10.3390\/math10101689"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"71573","DOI":"10.1109\/ACCESS.2023.3292301","article-title":"A novel software reliability growth model based on generalized imperfect debugging NHPP framework","volume":"11","author":"Luo","year":"2023","journal-title":"IEEE Access"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Lee, D., Chang, I., and Pham, H. (2023). Study of a new software reliability growth model under uncertain operating environments and dependent failures. Mathematics, 11.","DOI":"10.3390\/math11183810"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2450017","DOI":"10.1142\/S0218539324500177","article-title":"Developing an innovative imperfect debugging software reliability growth model with enhanced testing coverage strategies","volume":"31","author":"Nazir","year":"2024","journal-title":"Int. J. Reliab. Qual. Saf. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1268","DOI":"10.1002\/qre.3716","article-title":"Software reliability growth model considering imperfect debugging and fault removal efficiency","volume":"41","author":"Samal","year":"2025","journal-title":"Qual. Reliab. Eng. Int."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Yamada, S., and Tamura, Y. (2016). OSS Reliability Measurement and Assessment, Springer.","DOI":"10.1007\/978-3-319-31818-9"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2350021","DOI":"10.1142\/S0218539323500213","article-title":"A Method of OSS Reliability Assessment Based on Public Repository Analysis","volume":"30","author":"Miyamoto","year":"2023","journal-title":"Int. J. Reliab. Qual. Saf. Eng."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Tamura, Y., and Yamada, S. (2024). Applied OSS Reliability Assessment Modeling, AI and Tools, Springer.","DOI":"10.1007\/978-3-031-64803-8"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2668","DOI":"10.1007\/s13198-024-02288-w","article-title":"OSS reliability assessment method based on deep learning and independent Wiener data preprocessing","volume":"15","author":"Tamura","year":"2024","journal-title":"Int. J. Syst. Assur. Eng. Manag."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2450004","DOI":"10.1142\/S0218539324500049","article-title":"A Method of Reliability Assessment Based on Trend Analysis for Open Source Software","volume":"31","author":"Miyamoto","year":"2024","journal-title":"Int. J. Reliab. Qual. Saf. Eng."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1109\/TR.1979.5220566","article-title":"Time-dependent error-detection rate model for software reliability and other performance measures","volume":"28","author":"Goel","year":"1979","journal-title":"IEEE Trans. Reliab."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1109\/TR.1983.5221735","article-title":"S-shaped reliability growth modeling for software error detection","volume":"32","author":"Yamada","year":"1983","journal-title":"IEEE Trans. Reliab."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Osaki, S., and Hatoyama, Y. (1984). Inflexion S-shaped software reliability growth models. Stochastic Models in Reliability Theory, Springer.","DOI":"10.1007\/978-3-642-45587-2"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2241","DOI":"10.1080\/00207729208949452","article-title":"Imperfect debugging models with fault introduction rate for software reliability assessment","volume":"23","author":"Yamada","year":"1992","journal-title":"Int. J. Syst. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1109\/24.784276","article-title":"A general imperfect software debugging model with S-shaped fault detection rate","volume":"48","author":"Pham","year":"1999","journal-title":"IEEE Trans. Reliab."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1142\/S0218539397000199","article-title":"An NHPP Software Reliability Model and Its Comparison","volume":"4","author":"Pham","year":"1997","journal-title":"Int. J. Reliab. Qual. Saf. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1007\/s11633-007-0325-8","article-title":"An imperfect-debugging fault-detection dependent-parameter software","volume":"4","author":"Pham","year":"2007","journal-title":"Int. J. Automat. Comput."},{"key":"ref_20","first-page":"1717","article-title":"A Logistic fault-dependent detection software reliability model","volume":"24","author":"Pham","year":"2018","journal-title":"J. Univers. Comput. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1080\/09617353.2021.1921547","article-title":"An effective software reliability growth model","volume":"40","author":"Haque","year":"2021","journal-title":"Saf. Reliab."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"11785","DOI":"10.3934\/mbe.2023524","article-title":"Software reliability model for open-source software that considers the number of finite faults and dependent faults","volume":"20","author":"Song","year":"2023","journal-title":"Math. Biosci. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2150032","DOI":"10.1142\/S0218539321500327","article-title":"A logistic growth model for software reliability estimation considering uncertain factors","volume":"28","author":"Haque","year":"2021","journal-title":"Int. J. Reliab. Qual. Saf. Eng."},{"key":"ref_24","first-page":"459","article-title":"A software reliability model using fault removal efficiency","volume":"15","author":"Haque","year":"2022","journal-title":"J. Reliab. Stat. Stud."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s42044-024-00192-x","article-title":"A logistic software reliability model with Loglog fault detection rate","volume":"8","author":"Haque","year":"2025","journal-title":"Iran J. Comput. Sci."},{"key":"ref_26","unstructured":"Kyurkchiev, N. (2020). Selected Topics in Mathematical Modeling: Some New Trends. Dedicated to Academician Blagovest Sendov (1932\u20132020), LAP LAMBERT Academic Publishing."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Kyurkchiev, N. (2020). Some intrinsic properties of Tadmor\u2013Tanner functions: Related problems and possible applications. Mathematics, 8.","DOI":"10.3390\/math8111963"},{"key":"ref_28","first-page":"757","article-title":"Some nonstandard differential models with applications to the population dynamics and computer viruses propagation","volume":"28","author":"Kyurkchiev","year":"2019","journal-title":"Dyn. Syst. Appl."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Pavlov, N., Iliev, A., Rahnev, A., and Kyurkchiev, N. (2018). Some Software Reliability Models: Approximation and Modeling Aspects, LAP LAMBERT Academic Publishing.","DOI":"10.12732\/dsa.v27i4.5"},{"key":"ref_30","unstructured":"Pavlov, N., Iliev, A., Rahnev, A., and Kyurkchiev, N. (2018). Nontrivial Models in Debugging Theory (Part 2), LAP LAMBERT Academic Publishing."},{"key":"ref_31","first-page":"37","article-title":"Analysis of the Chen\u2019s and Pham\u2019s software reliability models","volume":"18","author":"Pavlov","year":"2018","journal-title":"Cybern. Inf. Technol."},{"key":"ref_32","unstructured":"Rahneva, O., Golev, A., and Spasov, G. (2020). Investigations on Some New Models in Debugging and Growth Theory (Part 3), LAP LAMBERT Academic Publishing."},{"key":"ref_33","unstructured":"Kyurkchiev, N., Iliev, A., Golev, A., and Rahnev, A. (2020). Some Non-Standard Models in \u201cDebugging and Test Theory\u201d (Part 4), Plovdiv University Press."},{"key":"ref_34","unstructured":"Hausdorff, F. (1962). Set Theory, Chelsea Publication. [2nd ed.]."},{"key":"ref_35","first-page":"1","article-title":"Hausdorff approximations","volume":"Volume 50","author":"Sendov","year":"1990","journal-title":"Mathematics and Its Applications"},{"key":"ref_36","unstructured":"(2025, July 27). Wolfram Research, NonlinearModelFit (2008), Wolfram Language Function, (Updated 2025). Available online: https:\/\/reference.wolfram.com\/language\/ref\/NonlinearModelFit.html."},{"key":"ref_37","first-page":"1","article-title":"Reliability assessment for open-source software using deterministic and probabilistic models","volume":"14","author":"Ramadan","year":"2022","journal-title":"Int. J. Inf. Technol. Comput. Sci."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Micko, R., Chren, S., and Rossi, B. (September, January 31). Applicability of software reliability growth models to open source software. Proceedings of the 2022 48th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), Gran Canaria, Spain.","DOI":"10.1109\/SEAA56994.2022.00047"},{"key":"ref_39","unstructured":"Ram, M. (2024). Survey of software reliability assessment tools. Advances in Reliability Science, Developments in Reliability Engineering, Elsevier Inc."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Lu, S., Li, H., and Jiang, Z. (2020, January 20\u201322). Comparative study of open source software reliability assessment tools. Proceedings of the 2020 IEEE International Conference on Artificial Intelligence and Information Systems (ICAIIS), Dalian, China.","DOI":"10.1109\/ICAIIS49377.2020.9194946"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"100357","DOI":"10.1016\/j.softx.2019.100357","article-title":"Practical software reliability engineering with the Software Failure and Reliability Assessment Tool (SFRAT)","volume":"10","author":"Nagaraju","year":"2019","journal-title":"SoftwareX"},{"key":"ref_42","unstructured":"Aubertine, J., Nagaraju, V., and Fiondella, L. (2021, January 19\u201322). The Covariate Software Failure and Reliability Assessment Tool (C-SFRAT). Proceedings of the International Conference on Reliability and Quality in Design, Online."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"100909","DOI":"10.1016\/j.softx.2021.100909","article-title":"A covariate software tool to guide test activity allocation","volume":"17","author":"Aubertine","year":"2022","journal-title":"SoftwareX"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Chren, S., Micko, R., Buhnova, B., and Rossi, B. (2019, January 25\u201331). STRAIT: A tool for automated software reliability growth analysis. Proceedings of the 2019 IEEE\/ACM 16th International Conference on Mining Software Repositories (MSR), Montreal, QC, Canada.","DOI":"10.1109\/MSR.2019.00025"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Wang, Q., Zhang, W., Jiang, J., and Li, L. (2020, January 18\u201321). A reliability automatic assessment framework of open source software based on JIRA. Proceedings of the 2020 9th International Conference on Software and Computer Applications, Langkawi, Malaysia.","DOI":"10.1145\/3384544.3384554"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Pena, G., Barraza, N.R., and Anand, A. (2020). Increasing failure rate software reliability models for agile projects: A comparative study. System Performance Modeling, De Gruyter.","DOI":"10.1515\/9783110619058-004"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"111249","DOI":"10.1016\/j.jss.2022.111249","article-title":"Analysis and assessment of software reliability modeling with preemptive priority queueing policy","volume":"187","author":"Lin","year":"2022","journal-title":"J. Syst. Softw."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"110861","DOI":"10.1016\/j.comnet.2024.110861","article-title":"Component-based modeling of cascading failure propagation in directed dual-weight software networks","volume":"255","author":"Li","year":"2024","journal-title":"Comput. Netw."},{"key":"ref_49","unstructured":"Lyu, M.R. (1996). Handbook of Software Reliability Engineering, IEEE Computer Society Press."}],"container-title":["Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-3197\/13\/9\/214\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T18:38:56Z","timestamp":1760035136000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-3197\/13\/9\/214"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,3]]},"references-count":49,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2025,9]]}},"alternative-id":["computation13090214"],"URL":"https:\/\/doi.org\/10.3390\/computation13090214","relation":{},"ISSN":["2079-3197"],"issn-type":[{"type":"electronic","value":"2079-3197"}],"subject":[],"published":{"date-parts":[[2025,9,3]]}}}