{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,31]],"date-time":"2025-10-31T08:01:12Z","timestamp":1761897672121,"version":"build-2065373602"},"reference-count":54,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,1,16]],"date-time":"2022-01-16T00:00:00Z","timestamp":1642291200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Software is a very important part to implement advanced information systems, such as AI and IoT based on the latest hardware equipment of the fourth Industrial Revolution. In particular, decision making for software upgrade is one of the essential processes that can solve problems for upgrading the information systems. However, most of the decision-making studies for this purpose have been conducted only from the perspective of the IT professional and management position. Moreover, software upgrade can be influenced by various layers of decision makers, so further research is needed. Therefore, it is necessary to conduct research on what factors are required and affect the decision making of software upgrade at various layers of organization. For this purpose, decision factors of software upgrade are identified by literature review in this study. Additionally, the priority, degree of influence and relationship between the factors are analyzed by using the AHP and DEMATEL techniques at the organizational level of users, managers and IT professionals. The results show that the priority, weight value, causal relationship of decision factors of users, managers and IT professionals who constitute the organizational level were very different. The managers first considered the benefits, such as ROI, for organization as a leader. The users tended to consider their work efficiency and changes due to the software upgrade first. Finally, the IT professionals considered ROI, budget and compatibility for the aspect of the managers and users. Therefore, the related information of each organizational level can be presented more clearly for the systematic and symmetrical decision making of software upgrade based on the results of this study.<\/jats:p>","DOI":"10.3390\/sym14010172","type":"journal-article","created":{"date-parts":[[2022,1,16]],"date-time":"2022-01-16T20:46:06Z","timestamp":1642365966000},"page":"172","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Hybrid Analysis of the Decision-Making Factors for Software Upgrade Based on the Integration of AHP and DEMATEL"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2039-5295","authenticated-orcid":false,"given":"Dosung","family":"Kim","sequence":"first","affiliation":[{"name":"Department of Computer Science, Graduate School, Soongsil University, Seoul 06978, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9649-8365","authenticated-orcid":false,"given":"Mi","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Graduate School, Soongsil University, Seoul 06978, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1016\/j.jss.2016.12.007","article-title":"A study of value in agile software development organizations","volume":"125","author":"Alahyari","year":"2017","journal-title":"J. Syst. Softw."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1016\/j.jss.2017.12.011","article-title":"Reusing empirical knowledge during cloud computing adoption","volume":"138","author":"Fahmideh","year":"2018","journal-title":"J. Syst. Softw."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1108\/17410391211272829","article-title":"A model of critical success factors for software projects","volume":"25","author":"Sudhakar","year":"2012","journal-title":"J. Enterp. Inf. Manag."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/S0164-1212(01)00114-5","article-title":"An estimation of the decision models of senior IS managers when evaluating the external quality of organizational software","volume":"61","author":"Anderson","year":"2002","journal-title":"J. Syst. Softw."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1797","DOI":"10.1016\/j.jss.2007.02.047","article-title":"A Component Composition Model Providing Dynamic, Flexible, and Hierarchical Com-position of Components for Supporting Software Evolution","volume":"80","author":"Kim","year":"2007","journal-title":"J. Syst. Softw."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/j.jss.2014.05.076","article-title":"A component-based process with separation of concerns for the development of embedded real-time software systems","volume":"96","author":"Panunzio","year":"2014","journal-title":"J. Syst. Softw."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"972","DOI":"10.1016\/j.jss.2007.08.032","article-title":"A practitioner\u2019s guide to light weight software process assessment and improvement planning","volume":"81","author":"Pettersson","year":"2008","journal-title":"J. Syst. Softw."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/0164-1212(94)00115-4","article-title":"An architectural basis for evolving software systems","volume":"30","author":"Leary","year":"1995","journal-title":"J. Syst. Softw."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1394","DOI":"10.1016\/j.jss.2011.03.034","article-title":"Framework for evaluation and selection of the software packages: A hybrid knowledge based system approach","volume":"84","author":"Jadhav","year":"2011","journal-title":"J. Syst. Softw."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1016\/j.elerap.2018.02.004","article-title":"Optimal Software Upgrade Strategy: Should We Sell Products or Premium Services in the Presence of Piracy?","volume":"28","author":"Wu","year":"2018","journal-title":"Electron. Commer. Res. Appl."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1287\/isre.1040.0037","article-title":"A Decision Model for Software Maintenance","volume":"15","author":"Krishnan","year":"2004","journal-title":"Inf. Syst. Res."},{"key":"ref_12","unstructured":"Linger, R. (1993, January 17\u201321). Cleanroom software engineering for zero-defect software. Proceedings of the 1993 15th International Conference on Software Engineering, Baltimore, MD, USA."},{"key":"ref_13","unstructured":"Gao, K., Wen, H., and Chen, T. (1994, January 19\u201323). Change Impact Identification in Object Oriented Software Maintenance. Proceedings of the International Conference on Software Maintenance ICSM-94, Victoria, BC, Canada."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1016\/j.jss.2015.12.015","article-title":"Continuous deployment of software intensive products and services: A systematic mapping study","volume":"123","author":"Haghighatkhah","year":"2017","journal-title":"J. Syst. Softw."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/j.jss.2018.12.002","article-title":"An empirical study on decision making for quality requirements","volume":"149","author":"Olsson","year":"2019","journal-title":"J. Syst. Softw."},{"key":"ref_16","unstructured":"Wnuk, K., and Kollu, R.K. (April, January 29). A systematic mapping study on requirements scoping. Proceedings of the 20th International Conference on Intelligent User Interfaces Companion, Atlanta, GA, USA."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/52.765782","article-title":"Critical success factors in software projects","volume":"16","author":"Reel","year":"1999","journal-title":"IEEE Softw."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1016\/j.jss.2014.05.019","article-title":"Recommending software upgrades with Mojave","volume":"96","author":"Bachwani","year":"2014","journal-title":"J. Syst. Softw."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/S0164-1212(99)00141-7","article-title":"An evaluation of the business object approach to software development","volume":"52","author":"Tsagias","year":"2000","journal-title":"J. Syst. Softw."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1016\/0164-1212(94)00139-E","article-title":"Modeling reuse across the software life cycle","volume":"30","author":"Frakes","year":"1995","journal-title":"J. Syst. Softw."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1517","DOI":"10.1016\/j.jss.2007.01.011","article-title":"Empirical study of the effects of open source adoption on software development economics","volume":"80","author":"Ajila","year":"2007","journal-title":"J. Syst. Softw."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1109\/MS.1998.646878","article-title":"Software\u2019s future: Managing evolution","volume":"15","author":"Lehman","year":"1998","journal-title":"IEEE Softw."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1016\/j.ijpe.2015.06.028","article-title":"Real options, learning cost and timing software upgrades: Towards an integrative model for enterprise software upgrade decision analysis","volume":"168","author":"Morgan","year":"2015","journal-title":"Int. J. Prod. Econ."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Kim, D., Kim, Y., and Lee, N. (2018). A Study on the Interrelations of Decision-Making Factors of Information System (IS) Upgrades for Sustainable Business Using Interpretive Structural Modeling and MICMAC Analysis. Sustainability, 10.","DOI":"10.3390\/su10030872"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/S0377-2217(02)00547-7","article-title":"Enterprise resource planning: Implementation procedures and critical success factors","volume":"146","author":"Umble","year":"2003","journal-title":"Eur. J. Oper. Res."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1684","DOI":"10.1016\/j.dss.2006.02.013","article-title":"A decision support model for optimal timing of investments in information technology upgrades","volume":"42","author":"Mukherji","year":"2006","journal-title":"Decis. Support Syst."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1145\/163359.163375","article-title":"Software complexity and maintenance costs","volume":"36","author":"Banker","year":"1993","journal-title":"Commun. ACM"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1016\/j.ijinfomgt.2017.07.003","article-title":"Developing and Validating a Technology Upgrade Model","volume":"38","author":"Wang","year":"2018","journal-title":"Int. J. Inf. Manag."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1517","DOI":"10.37727\/jkdas.2021.23.4.1517","article-title":"Selection of Functional Logistics Service Providers: AHP and DEMATEL Application","volume":"23","author":"Ly","year":"2021","journal-title":"Korean Data Anal. Soc."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"863","DOI":"10.1016\/j.envpol.2019.05.059","article-title":"An Integrated Approach Using AHP and DEMATEL for Evaluating Climate Change Mitigation Strategies of the Indian Cement Manufacturing Industry","volume":"252","author":"Balsara","year":"2019","journal-title":"Environ. Pollut."},{"key":"ref_31","unstructured":"Ayouni, S., Menzli, L.J., Hajjej, F., and Maddeh, M. (2019, January 7\u20138). A Hybrid Fuzzy DEMATEL-AHP\/VIKOR Method for LMS Selection. Proceedings of the 18th European Conference on e-Learning, Copenhagen, Denmark."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1528","DOI":"10.1108\/BIJ-01-2017-0005","article-title":"Construction of capital procurement decision making model to optimize supplier selection using Fuzzy Delphi and AHP-DEMATEL","volume":"25","author":"Kumar","year":"2018","journal-title":"Benchmarking Int. J."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"683","DOI":"10.1007\/s11277-019-06424-9","article-title":"Identifying Causal Relationships in Mobile App Issues: An Interval Type-2 Fuzzy DE-MATEL Approach","volume":"108","author":"Pandey","year":"2019","journal-title":"Wirel. Pers. Commun."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/S0164-1212(99)00099-0","article-title":"The impact of software architecture reuse on development processes and standards","volume":"50","author":"Cioch","year":"2000","journal-title":"J. Syst. Softw."},{"key":"ref_35","unstructured":"Chris, F.K. (1987). Measurement of Software Development Productivity. [Ph.D. Dissertation, Carnegie Mellon University]."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1287\/mnsc.37.1.1","article-title":"A Model to Evaluate Variables Impacting the Productivity of software maintenance projects","volume":"37","author":"Banker","year":"1991","journal-title":"Manag. Sci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1016\/j.aej.2014.06.001","article-title":"Detecting defects in software requirements specification","volume":"53","author":"Alshazly","year":"2014","journal-title":"Alex. Eng. J."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"494","DOI":"10.1016\/j.dss.2012.11.006","article-title":"Experience Information Goods: \u201cVersion-to-Upgrade\u201d","volume":"56","author":"Wei","year":"2013","journal-title":"Decis. Support Syst."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1016\/j.dss.2013.09.002","article-title":"Consuming information systems: An economic model of user satisfaction","volume":"57","author":"Sun","year":"2014","journal-title":"Decis. Support Syst."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1494","DOI":"10.1016\/j.jss.2007.01.013","article-title":"A three-tier knowledge management scheme for software engineering support and innovation","volume":"80","author":"Corbin","year":"2007","journal-title":"J. Syst. Softw."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1016\/j.jss.2016.07.016","article-title":"Using contextual information to predict co-changes","volume":"128","author":"Wiese","year":"2017","journal-title":"J. Syst. Softw."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.jss.2013.10.010","article-title":"Evolving feature model configurations in software product lines","volume":"87","author":"White","year":"2014","journal-title":"J. Syst. Softw."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/S0165-0114(83)80022-0","article-title":"The Analytic Hierarchy Process-Planning, Priority Setting, Resource Allocation","volume":"9","author":"Saaty","year":"1983","journal-title":"Fuzzy Sets Syst."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1016\/j.cie.2016.07.019","article-title":"DEMATEL-modified ANP to evaluate internal hospital supply chain performance","volume":"102","author":"Supeekit","year":"2016","journal-title":"Comput. Ind. Eng."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1016\/j.jenvman.2018.07.081","article-title":"Exploring the Critical Determinants of Environmentally Oriented Public Procurement Using the DEMATEL Method","volume":"225","author":"Bakir","year":"2018","journal-title":"J. Environ. Manag."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1016\/j.cie.2018.02.020","article-title":"Identifying causal relationships in strategy maps using ANP and DEMATEL","volume":"118","author":"Quezada","year":"2018","journal-title":"Comput. Ind. Eng."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.eswa.2018.01.045","article-title":"Analyzing the impact of industry sectors on the composition of business ecosystem: A combined approach using ARM and DEMATEL","volume":"100","author":"Aaldering","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"9683","DOI":"10.1016\/j.eswa.2008.11.040","article-title":"A value-created system of science (technology) park by using DEMATEL","volume":"36","author":"Lin","year":"2009","journal-title":"Expert Syst. Appl."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.eswa.2015.10.041","article-title":"An analysis of DEMATEL approaches for criteria interaction handling within ANP","volume":"46","year":"2016","journal-title":"Expert Syst. Appl."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.asoc.2018.01.018","article-title":"A new approach to DEMATEL based on interval-valued hesitant fuzzy sets","volume":"66","author":"Asan","year":"2018","journal-title":"Appl. Soft Comput."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"6746","DOI":"10.1016\/j.apm.2013.01.016","article-title":"Revised DEMATEL: Resolving the Infeasibility of DEMATEL","volume":"37","author":"Lee","year":"2013","journal-title":"Appl. Math. Model."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"9050","DOI":"10.1016\/j.eswa.2011.01.080","article-title":"A Note on \u201cDeveloping Global Manager\u2019s Competencies Using the Fuzzy DEMATEL Method\u201d","volume":"38","author":"Mokhtarian","year":"2011","journal-title":"Expert Syst. Appl."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1016\/j.compind.2014.12.005","article-title":"A step-by-step performance assessment and improvement method for ERP implementation: Action case studies in Chinese companies","volume":"68","author":"Sun","year":"2015","journal-title":"Comput. Ind."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1016\/j.procs.2018.10.079","article-title":"Do Cloud ERP Systems Retire? An ERP Lifecycle Perspective","volume":"138","author":"Demi","year":"2018","journal-title":"Procedia Comput. Sci."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/14\/1\/172\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T14:15:09Z","timestamp":1760364909000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/14\/1\/172"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,16]]},"references-count":54,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["sym14010172"],"URL":"https:\/\/doi.org\/10.3390\/sym14010172","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2022,1,16]]}}}