{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,13]],"date-time":"2025-12-13T07:20:35Z","timestamp":1765610435695,"version":"build-2065373602"},"reference-count":51,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2024,2,14]],"date-time":"2024-02-14T00:00:00Z","timestamp":1707868800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JTAER"],"abstract":"<jats:p>Meeting customer requirements in software project management, even for large digital enterprises, proves challenging due to unpredictable human factors. It involves meticulous planning and environmental factor analysis, ultimately benefiting both companies and customers. This paper came as a natural extension of our previous work where we left ourselves curious about what impact environmental complexity factors (ECFs) have in a use case point (UCP) approach. Additionally, we wanted to possibly decrease the mean magnitude relative error (MMRE) with deep learning models such as long-short-term-memory (LSTM) and gradient recurrent unit (GRU). The data augmentation technique was used to artificially increase the number of projects, since in the industry world, digital enterprises are not keen to share their data. The LSTM model outperformed the GRU and XGBoost models, while the average MMRE in all phases of the experiment for all models achieved 4.8%. Moreover, the post-agnostic models showed the overall and individual impact of eight ECFs, where the third ECF \u201cteam experience\u201d on a new project has been shown as the most influential one. Finally, it is important to emphasize that effectively managing human factors within ECFs in UCPs can have a significant impact on the successful completion of a project.<\/jats:p>","DOI":"10.3390\/jtaer19010020","type":"journal-article","created":{"date-parts":[[2024,2,14]],"date-time":"2024-02-14T09:30:18Z","timestamp":1707903018000},"page":"381-395","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Delving into Human Factors through LSTM by Navigating Environmental Complexity Factors within Use Case Points for Digital Enterprises"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9910-5886","authenticated-orcid":false,"given":"Nevena","family":"Rankovic","sequence":"first","affiliation":[{"name":"Department of Cognitive Science and Artificial Intelligence, Tilburg University, 5037 AB Tilburg, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dragica","family":"Rankovic","sequence":"additional","affiliation":[{"name":"Department of Mathematics, Informatics and Statistics, Union University \u201cNikola Tesla\u201d, 18000 Nis, Serbia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,2,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Vavpoti\u010d, D., Kalibatiene, D., Vasilecas, O., and Hovelja, T. (2022). Identifying key characteristics of business rules that affect software project success. Appl. Sci., 12.","DOI":"10.3390\/app12020762"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Khan, J., Jaafar, M., Mubarak, N., and Khan, A.K. (2022). Employee mindfulness, innovative work behaviour, and IT project success: The role of inclusive leadership. Inf. Technol. Manag., 1\u201315.","DOI":"10.1007\/s10799-022-00369-5"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Marapelli, B., Carie, A., and Islam, S.M. (2021, January 9\u201310). Software effort estimation with use case points using ensemble machine learning models. Proceedings of the 2021 International Conference on Electrical, Computer and Energy Technologies (ICECET), Cape Town, South Africa.","DOI":"10.1109\/ICECET52533.2021.9698548"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Rankovic, N., Rankovic, D., Ivanovic, M., and Lazic, L. (2021). A novel UCP model based on artificial neural networks and orthogonal arrays. Appl. Sci., 11.","DOI":"10.3390\/app11198799"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"26926","DOI":"10.1109\/ACCESS.2021.3057807","article-title":"A new approach to software effort estimation using different artificial neural network architectures and Taguchi orthogonal arrays","volume":"9","author":"Rankovic","year":"2021","journal-title":"IEEE Access"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Nhung, H.L.T.K., Van Hai, V., Silhavy, P., Prokopova, Z., and Silhavy, R. (2023). Incorporating statistical and machine learning techniques into the optimization of correction factors for software development effort estimation. J. Softw. Evol. Process, e2611.","DOI":"10.1002\/smr.2611"},{"key":"ref_7","unstructured":"Silhavy, R. (2021, February 01). Use Case Points Benchmark Dataset. Mendeley Data V1. Available online: https:\/\/data.mendeley.com\/datasets\/2rfkjhx3cn\/1."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Carroll, E.R. (2005, January 16\u201320). Estimating software based on use case points. Proceedings of the 20th Annual ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications\u2014OOPSLA \u201905, San Diego, CA, USA.","DOI":"10.1145\/1094855.1094960"},{"key":"ref_9","first-page":"12","article-title":"Enhancing Use Case Points Estimation Method using Soft Computing Techniques","volume":"1","author":"Nassif","year":"2010","journal-title":"J. Glob. Res. Comput. Sci."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Azzeh, M. (2013, January 4\u20137). Fuzzy Model Tree for Early Effort Estimation Machine Learning and Applications. Proceedings of the 12th International Conference on Machine Learning and Applications, Miami, FL, USA.","DOI":"10.1109\/ICMLA.2013.115"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"571","DOI":"10.1007\/978-3-319-06740-7_49","article-title":"Using Analytical Programming and UCP Method for Effort Estimation","volume":"Volume 285","author":"Urbanek","year":"2014","journal-title":"Proceedings of the Modern Trends and Techniques in Computer Science"},{"key":"ref_12","unstructured":"Kaur, A., and Kaur, K. (2019). Smart Innovations in Communication and Computational Sciences, Springer."},{"key":"ref_13","first-page":"111","article-title":"Reusability assessment of UCP-based effort estimation framework using object-oriented approach","volume":"9","author":"Ani","year":"2017","journal-title":"J. Telecommun. Electron. Comput. Eng."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"e2245","DOI":"10.1002\/smr.2245","article-title":"Systematic review of studies on use case points and expert-based estimation of software development effort","volume":"32","author":"Mahmood","year":"2020","journal-title":"J. Softw. Evol. Process."},{"key":"ref_15","first-page":"6","article-title":"Designing Machine Learning Method for Software Project Effort Prediction","volume":"9","author":"Gebretsadik","year":"2019","journal-title":"Comput. Sci. Eng."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Alves, R., Valente, P., and Nunes, N.J. (2013, January 24\u201327). Improving software effort estimation with human-centric models: A comparison of UCP and iUCP accuracy. Proceedings of the 5th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, London, UK.","DOI":"10.1145\/2494603.2480300"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"19312","DOI":"10.1109\/JIOT.2023.3281614","article-title":"More Accurate Cost Estimation for Internet of Things Projects by Adaptation of Use Case Points Methodology","volume":"10","author":"Silhavy","year":"2023","journal-title":"IEEE Internet Things J."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1007\/s11219-021-09547-0","article-title":"Empirical analysis on productivity prediction and locality for use case points method","volume":"29","author":"Azzeh","year":"2021","journal-title":"Softw. Qual. J."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1212","DOI":"10.1007\/s40815-020-00815-y","article-title":"Fuzzy Cognitive Mapping Analysis to Recommend Machine Learning-Based Effort Estimation Technique for Web Applications","volume":"22","author":"Pandey","year":"2020","journal-title":"Int. J. Fuzzy Syst."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2405","DOI":"10.1007\/s13204-021-02204-9","article-title":"Evaluation of estimation in software development using deep learning-modified neural network","volume":"13","author":"Sreekanth","year":"2023","journal-title":"Appl. Nanosci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"58402","DOI":"10.1109\/ACCESS.2020.2980236","article-title":"Ensembling Artificial Bee Colony with Analogy-Based Estimation to Improve Software Development Effort Prediction","volume":"8","author":"Shah","year":"2020","journal-title":"IEEE Access"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1007\/s11121-021-01246-3","article-title":"Meta-analysis with Robust Variance Estimation: Expanding the Range of Working Models","volume":"23","author":"Pustejovsky","year":"2022","journal-title":"Prev. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"60309","DOI":"10.1109\/ACCESS.2021.3072380","article-title":"Metaheuristic Algorithms in Optimizing Deep Neural Network Model for Software Effort Estimation","volume":"9","author":"Khan","year":"2021","journal-title":"IEEE Access"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e2019013","DOI":"10.4178\/epih.e2019013","article-title":"Network meta-analysis: Application and practice using R software","volume":"41","author":"Shim","year":"2019","journal-title":"Epidemiol. Health"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1002\/spe.3009","article-title":"Software effort estimation accuracy prediction of machine learning techniques: A systematic performance evaluation","volume":"52","author":"Mahmood","year":"2022","journal-title":"Softw. Pract. Exper."},{"key":"ref_26","unstructured":"Gustav, K. (1993). Resource Estimation for Objectory Projects, Objective Systems SF AB."},{"key":"ref_27","first-page":"100270","article-title":"Towards a data-driven technology roadmap for the bank of the future: Exploring big data analytics to support technology roadmapping","volume":"6","author":"Maja","year":"2022","journal-title":"Soc. Sci. Humanit. Open"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.gltp.2022.04.020","article-title":"A review: Data pre-processing and data augmentation techniques","volume":"3","author":"Maharana","year":"2022","journal-title":"Glob. Transit. Proc."},{"key":"ref_29","unstructured":"Chen, D., Liu, Y., Huang, L., Wang, B., and Pan, P. (2022). European Conference on Computer Vision, Springer."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Nielsen, F. (2022). Statistical divergences between densities of truncated exponential families with nested supports: Duo Bregman and duo Jensen divergences. Entropy, 24.","DOI":"10.3390\/e24030421"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"112086","DOI":"10.1016\/j.matdes.2023.112086","article-title":"Robustness of machine learning to color, size change, normalization, and image enhancement on micrograph datasets with large sample differences","volume":"232","author":"Pei","year":"2023","journal-title":"Mater. Des."},{"key":"ref_32","first-page":"1","article-title":"Application of min-max normalization on subject-invariant EMG pattern recognition","volume":"71","author":"Islam","year":"2022","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhang, C., Zou, X., and Lin, C. (2022). Fusing XGBoost and SHAP models for maritime accident prediction and causality interpretability analysis. J. Mar. Sci. Eng., 10.","DOI":"10.3390\/jmse10081154"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"15501329221106935","DOI":"10.1177\/15501329221106935","article-title":"Research and application of XGBoost in imbalanced data","volume":"18","author":"Zhang","year":"2022","journal-title":"Int. J. Distrib. Sens. Netw."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"715","DOI":"10.1007\/s10614-021-10227-1","article-title":"Bankruptcy prediction using the XGBoost algorithm and variable importance feature engineering","volume":"61","author":"Stef","year":"2023","journal-title":"Comput. Econ."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"47881","DOI":"10.1109\/ACCESS.2022.3171247","article-title":"Macroscopic big data analysis and prediction of driving behavior with an adaptive fuzzy recurrent neural network on the internet of vehicles","volume":"10","author":"Li","year":"2022","journal-title":"IEEE Access"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"21517","DOI":"10.1109\/ACCESS.2022.3152828","article-title":"RoBERTa-LSTM: A hybrid model for sentiment analysis with transformer and recurrent neural network","volume":"10","author":"Tan","year":"2022","journal-title":"IEEE Access"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Ariza-Colpas, P.P., Vicario, E., Oviedo-Carrascal, A.I., Butt Aziz, S., Pi\u00f1eres-Melo, M.A., Quintero-Linero, A., and Patara, F. (2022). Human activity recognition data analysis: History, evolutions, and new trends. Sensors, 22.","DOI":"10.3390\/s22093401"},{"key":"ref_39","first-page":"7974","article-title":"Sentence subjectivity analysis of a political and ideological debate dataset using LSTM and BiLSTM with attention and GRU models","volume":"34","author":"Hoenig","year":"2022","journal-title":"J. King Saud Univ.-Comput. Inf. Sci."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1912","DOI":"10.1109\/TII.2022.3199268","article-title":"Trust Evaluation for Service Composition in Cloud Manufacturing Using GRU and Association Analysis","volume":"19","author":"Wang","year":"2022","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_41","unstructured":"Rankovic, D., Rankovic, N., Ivanovic, M., and Lazic, L. (2022). IFIP International Conference on Artificial Intelligence Applications and Innovations, Springer International Publishing."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"106627","DOI":"10.1016\/j.infsof.2021.106627","article-title":"Convergence rate of Artificial Neural Networks for estimation in software development projects","volume":"138","author":"Rankovic","year":"2021","journal-title":"Inf. Softw. Technol."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Slack, D., Hilgard, S., Jia, E., Singh, S., and Lakkaraju, H. (2020, January 7\u20138). Fooling lime and shap: Adversarial attacks on post hoc explanation methods. Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society, New York, NY, USA.","DOI":"10.1145\/3375627.3375830"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Panati, C., Wagner, S., and Br\u00fcggenwirth, S. (2022, January 12\u201314). Feature relevance evaluation using grad-CAM, LIME and SHAP for deep learning SAR data classification. Proceedings of the 2022 23rd International Radar Symposium (IRS), Gdansk, Poland.","DOI":"10.23919\/IRS54158.2022.9904989"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"752558","DOI":"10.3389\/frai.2021.752558","article-title":"SHAP and LIME: An evaluation of discriminative power in credit risk","volume":"4","author":"Gramegna","year":"2021","journal-title":"Front. Artif. Intell."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Holzinger, A., Saranti, A., Molnar, C., Biecek, P., and Samek, W. (2022). xxAI-Beyond Explainable AI: International Workshop, Held in Conjunction with ICML 2020, Vienna, Austria, 18 July 2020, Revised and Extended Papers, Springer International Publishing.","DOI":"10.1007\/978-3-031-04083-2"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Sahay, S., Omare, N., and Shukla, K.K. (2021, January 19\u201320). An Approach to identify Captioning Keywords in an Image using LIME. Proceedings of the 2021 International Conference on Computing, Communication, and Intelligent Systems (ICCCIS), Greater Noida, India.","DOI":"10.1109\/ICCCIS51004.2021.9397159"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Ye, X., Fang, F., Wu, J., Bunescu, R., and Liu, C. (2018, January 17\u201320). Bug Report Classification Using LSTM Architecture for More Accurate Software Defect Locating. Proceedings of the 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA), Orlando, FL, USA.","DOI":"10.1109\/ICMLA.2018.00234"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1109\/TSE.2018.2881961","article-title":"Automatic Feature Learning for Predicting Vulnerable Software Components","volume":"47","author":"Dam","year":"2021","journal-title":"IEEE Trans. Softw. Eng."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"900","DOI":"10.1109\/TSMCB.2011.2182646","article-title":"Learning of Fuzzy Cognitive Maps Using Density Estimate","volume":"42","author":"Stach","year":"2012","journal-title":"IEEE Trans. Syst. Man Cybern. Part B Cybern."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Singh, P.K., Wierzcho\u0144, S.T., Tanwar, S., Rodrigues, J.J.P.C., and Ganzha, M. (2023). Proceedings of Third International Conference on Computing, Communications, and Cyber-Security, Springer. Lecture Notes in Networks and Systems.","DOI":"10.1007\/978-981-19-1142-2"}],"container-title":["Journal of Theoretical and Applied Electronic Commerce Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/0718-1876\/19\/1\/20\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T13:59:42Z","timestamp":1760104782000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/0718-1876\/19\/1\/20"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,14]]},"references-count":51,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,3]]}},"alternative-id":["jtaer19010020"],"URL":"https:\/\/doi.org\/10.3390\/jtaer19010020","relation":{},"ISSN":["0718-1876"],"issn-type":[{"type":"electronic","value":"0718-1876"}],"subject":[],"published":{"date-parts":[[2024,2,14]]}}}