{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,26]],"date-time":"2025-10-26T14:20:13Z","timestamp":1761488413022,"version":"3.41.2"},"reference-count":98,"publisher":"Emerald","issue":"1","license":[{"start":{"date-parts":[[2010,2,2]],"date-time":"2010-02-02T00:00:00Z","timestamp":1265068800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2010,2,2]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-heading\">Purpose<\/jats:title><jats:p>To justify an increase in information technology (IT) spending and to understand utilization of limited organizational resources on IT, the correlation between IT and business performance has been of great interest to business managers. However, business managers face issues and challenges in finding out how and to what extent IT is able to deliver the intended benefits. The purpose of this paper is to examine IT evaluation issues and challenges faced by information systems (IS) researchers, IS specialists, and business managers.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Design\/methodology\/approach<\/jats:title><jats:p>This paper begins by reviewing the disparate discussions in past literature on IT evaluation issues and challenges. It then provides a synthesis of the disparate discussions by identifying eight issues and challenges in IT evaluation.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Findings<\/jats:title><jats:p>The eight issues and challenges identified are: evaluation scope, evaluation timing, unit of analysis, level of analysis, different perspectives, different dimensions, different measures, and underpinning theoretical frameworks. It concludes with some suggestions on ways to improve IT evaluation practices.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Originality\/value<\/jats:title><jats:p>This paper posits that before a pragmatic IT evaluation approach can be developed, it is necessary to first understand the issues and challenges faced by IS researchers, IS specialists, and business managers in IT evaluation. Having identified the eight issues and challenges, this paper provides pointers on what needs to be considered when conducting IT evaluation.<\/jats:p><\/jats:sec>","DOI":"10.1108\/13287261011032643","type":"journal-article","created":{"date-parts":[[2010,3,13]],"date-time":"2010-03-13T07:04:48Z","timestamp":1268463888000},"page":"37-55","source":"Crossref","is-referenced-by-count":14,"title":["Information technology evaluation: issues and challenges"],"prefix":"10.1108","volume":"12","author":[{"given":"Govindan","family":"Marthandan","sequence":"first","affiliation":[]},{"given":"Chun","family":"Meng Tang","sequence":"additional","affiliation":[]}],"member":"140","reference":[{"key":"key2022032120225033600_b1","doi-asserted-by":"crossref","unstructured":"Agourram, H. (2009), \u201cDefining information system success in Germany\u201d, International Journal of Information Management, Vol. 29 No. 2, pp. 129\u201037.","DOI":"10.1016\/j.ijinfomgt.2008.05.007"},{"key":"key2022032120225033600_b2","doi-asserted-by":"crossref","unstructured":"Ammenwerth, E., Graber, S., Herrmann, G., Burkle, T. and Konig, J. (2003), \u201cEvaluation of health information systems \u2013 problems and challenges\u201d, International Journal of Medical Informatics, Vol. 71 Nos 2\/3, pp. 125\u201035.","DOI":"10.1016\/S1386-5056(03)00131-X"},{"key":"key2022032120225033600_b3","doi-asserted-by":"crossref","unstructured":"Anandarajan, A. and Wen, H. (1999), \u201cEvaluation of information technology investments\u201d, Management Decision, Vol. 37 No. 4, pp. 329\u201037.","DOI":"10.1108\/00251749910269375"},{"key":"key2022032120225033600_b4","unstructured":"Arnold, V. (1995), \u201cDiscussion of an experimental evaluation of measurements of information system effectiveness\u201d, Journal of Information Systems, Vol. 9 No. 2, pp. 85\u201091."},{"key":"key2022032120225033600_b5","doi-asserted-by":"crossref","unstructured":"Bajwa, D.S., Rai, A. and Brennan, I. (1998), \u201cKey antecedents of executive information system success: a path analytic approach\u201d, Decision Support Systems, Vol. 22 No. 1, pp. 31\u201043.","DOI":"10.1016\/S0167-9236(97)00032-8"},{"key":"key2022032120225033600_b6","doi-asserted-by":"crossref","unstructured":"Ballantine, J. and Stray, S. (1998), \u201cFinancial appraisal and the IS\/IT investment decision making process\u201d, Journal of Information Technology, Vol. 13 No. 1, pp. 3\u201014.","DOI":"10.1177\/026839629801300101"},{"key":"key2022032120225033600_b7","doi-asserted-by":"crossref","unstructured":"Bannister, F. and Remenyi, D. (2000), \u201cActs of faith: instinct, value and IT investment decisions\u201d, Journal of Information Technology, Vol. 15 No. 3, pp. 231\u201041.","DOI":"10.1177\/026839620001500305"},{"key":"key2022032120225033600_b8","unstructured":"Bannister, F. and Remenyi, D. (2003), \u201cThe societal value of ICT: first steps towards an evaluation framework\u201d, Electronic Journal of Information Systems Evaluation, Vol. 6 No. 2, pp. 197\u2010206."},{"key":"key2022032120225033600_b9","doi-asserted-by":"crossref","unstructured":"Barua, A., Kriebel, C.H. and Mukhopadhyay, T. (1995), \u201cInformation technologies and business value: an analytic and empirical investigation\u201d, Information Systems Research, Vol. 6 No. 1, pp. 3\u201023.","DOI":"10.1287\/isre.6.1.3"},{"key":"key2022032120225033600_b10","doi-asserted-by":"crossref","unstructured":"Beamon, B.M. (1999), \u201cMeasuring supply chain performance\u201d, International Journal of Operations & Production Management, Vol. 19 No. 3, pp. 275\u201092.","DOI":"10.1108\/01443579910249714"},{"key":"key2022032120225033600_b11","unstructured":"Berghout, E. and Remenyi, D. (2005), \u201cThe eleven years of the European conference on IT evaluation: retrospectives and perspectives for possible future research\u201d, Electronic Journal of Information Systems Evaluation, Vol. 8 No. 2, pp. 81\u201098."},{"key":"key2022032120225033600_b12","doi-asserted-by":"crossref","unstructured":"Bernroider, E.W.N. (2008), \u201cIT governance for enterprise resource planning supported by the DeLone\u2010McLean model of information systems success\u201d, Information & Management, Vol. 45 No. 5, pp. 257\u201069.","DOI":"10.1016\/j.im.2007.11.004"},{"key":"key2022032120225033600_b13","doi-asserted-by":"crossref","unstructured":"Brady, M., Saren, M. and Tzokas, N. (1999), \u201cThe impact of IT on marketing: an evaluation\u201d, Management Decision, Vol. 37 No. 10, pp. 758\u201067.","DOI":"10.1108\/00251749910302854"},{"key":"key2022032120225033600_b14","doi-asserted-by":"crossref","unstructured":"Brignall, S. and Ballantine, J. (1996), \u201cPerformance measurement in service businesses revisited\u201d, International Journal of Service Industry Management, Vol. 7 No. 1, pp. 6\u201031.","DOI":"10.1108\/09564239610109393"},{"key":"key2022032120225033600_b15","doi-asserted-by":"crossref","unstructured":"Brynjolfsson, E. and Hitt, L.M. (2000), \u201cBeyond computation: information technology, organizational transformation and business performance\u201d, The Journal of Economic Perspectives, Vol. 14 No. 4, pp. 23\u201048.","DOI":"10.1257\/jep.14.4.23"},{"key":"key2022032120225033600_b16","doi-asserted-by":"crossref","unstructured":"Brynjolfsson, E. and Yang, S. (1996), \u201cInformation technology and productivity: a review of the literature\u201d, Advances in Computers, Vol. 43 No. 1, pp. 179\u2010214.","DOI":"10.1016\/S0065-2458(08)60644-0"},{"key":"key2022032120225033600_b17","doi-asserted-by":"crossref","unstructured":"Chan, Y. (2000), \u201cIT value: the great divide between qualitative and quantitative and individual and organizational measures\u201d, Journal of Management Information Systems, Vol. 16 No. 4, pp. 225\u201061.","DOI":"10.1080\/07421222.2000.11518272"},{"key":"key2022032120225033600_b18","doi-asserted-by":"crossref","unstructured":"Chou, T.Y., Chou, S.T. and Tzeng, G.H. (2006), \u201cEvaluating IT\/IS investments: A fuzzy multi\u2010criteria decision model approach\u201d, European Journal of Operational Research, Vol. 173 No. 3, pp. 1026\u201046.","DOI":"10.1016\/j.ejor.2005.07.003"},{"key":"key2022032120225033600_b19","doi-asserted-by":"crossref","unstructured":"Cooper, R.B. and Quinn, R.E. (1993), \u201cImplications of the competing values framework for management information systems\u201d, Human Resource Management, Vol. 32 No. 1, pp. 175\u2010201.","DOI":"10.1002\/hrm.3930320109"},{"key":"key2022032120225033600_b20","unstructured":"Cronholm, S. and Goldkuhl, G. (2003), \u201cStrategies for information systems evaluation: six generic types\u201d, Electronic Journal of Information Systems Evaluation, Vol. 6 No. 2, pp. 65\u201074."},{"key":"key2022032120225033600_b21","doi-asserted-by":"crossref","unstructured":"Cronk, M.C. and Fitzgerald, E.P. (1999), \u201cUnderstanding IS business value: derivation of dimensions\u201d, Logistics Information Management, Vol. 12 Nos 1\/2, pp. 40\u20109.","DOI":"10.1108\/09576059910256240"},{"key":"key2022032120225033600_b22","doi-asserted-by":"crossref","unstructured":"Davern, M.J. and Kauffman, R.J. (2000), \u201cDiscovering potential and realizing value from information technology investments\u201d, Journal of Management Information Systems, Vol. 16 No. 4, pp. 121\u201043.","DOI":"10.1080\/07421222.2000.11518268"},{"key":"key2022032120225033600_b23","doi-asserted-by":"crossref","unstructured":"DeLone, W. and McLean, E. (1992), \u201cInformation systems success: the quest for the dependent variable\u201d, Information Systems Research, Vol. 3 No. 1, pp. 60\u201095.","DOI":"10.1287\/isre.3.1.60"},{"key":"key2022032120225033600_b24","doi-asserted-by":"crossref","unstructured":"Devaraj, S. and Kohli, R. (2000), \u201cInformation technology payoff in the health\u2010care industry: a longitudinal study\u201d, Journal of Management Information Systems, Vol. 16 No. 4, pp. 41\u201067.","DOI":"10.1080\/07421222.2000.11518265"},{"key":"key2022032120225033600_b25","doi-asserted-by":"crossref","unstructured":"Devaraj, S. and Kohli, R. (2003), \u201cPerformance impacts of information technology: is actual usage the missing link?\u201d, Management Science, Vol. 49 No. 3, pp. 273\u201089.","DOI":"10.1287\/mnsc.49.3.273.12736"},{"key":"key2022032120225033600_b26","doi-asserted-by":"crossref","unstructured":"Doll, W.J. and Torkzadeh, G. (1998), \u201cDeveloping a multidimensional measure of system\u2010use in an organizational context\u201d, Information & Management, Vol. 33 No. 4, pp. 171\u201085.","DOI":"10.1016\/S0378-7206(98)00028-7"},{"key":"key2022032120225033600_b27","doi-asserted-by":"crossref","unstructured":"Edwards, P., Peters, M. and Sharman, G. (2001), \u201cThe effectiveness of information systems in supporting the extended supply chain\u201d, Journal of Business Logistics, Vol. 22 No. 1, pp. 1\u201028.","DOI":"10.1002\/j.2158-1592.2001.tb00157.x"},{"key":"key2022032120225033600_b28","unstructured":"Eskow, D. (1990), \u201cMeasuring performance is key to finding value of IS\u201d, PC Week, Vol. 7 No. 22, p. 160."},{"key":"key2022032120225033600_b29","doi-asserted-by":"crossref","unstructured":"Farbey, B., Land, F. and Targett, D. (1992), \u201cEvaluating investments in IT\u201d, Journal of Information Technology, Vol. 7 No. 2, pp. 109\u201022.","DOI":"10.1177\/026839629200700207"},{"key":"key2022032120225033600_b30","doi-asserted-by":"crossref","unstructured":"Fearon, C. and Philip, G. (1999), \u201cAn empirical study of the use of EDI in supermarket chains using a new conceptual framework\u201d, Journal of Information Technology, Vol. 14 No. 1, pp. 3\u201021.","DOI":"10.1177\/026839629901400102"},{"key":"key2022032120225033600_b31","doi-asserted-by":"crossref","unstructured":"Fitzgerald, G. (1998), \u201cEvaluating information systems projects: a multidimensional approach\u201d, Journal of Information Technology, Vol. 13 No. 1, pp. 15\u201027.","DOI":"10.1177\/026839629801300102"},{"key":"key2022032120225033600_b32","doi-asserted-by":"crossref","unstructured":"Gable, G.G., Sedera, D. and Chan, T. (2008), \u201cRe\u2010conceptualizing information system success: the IS\u2010impact measurement model\u201d, Journal of the Association for Information Systems, Vol. 9 No. 7, pp. 377\u2010408.","DOI":"10.17705\/1jais.00164"},{"key":"key2022032120225033600_b33","doi-asserted-by":"crossref","unstructured":"Grover, V. and Segars, A.H. (1996), \u201cThe relationship between organizational characteristics and information system structure: an international survey\u201d, International Journal of Information Management, Vol. 16 No. 1, pp. 9\u201025.","DOI":"10.1016\/0268-4012(95)00058-5"},{"key":"key2022032120225033600_b34","doi-asserted-by":"crossref","unstructured":"Grover, V., Jeong, S.R. and Segars, A.H. (1996), \u201cInformation systems effectiveness: the construct space and patterns of application\u201d, Information & Management, Vol. 31 No. 4, pp. 177\u201091.","DOI":"10.1016\/S0378-7206(96)01079-8"},{"key":"key2022032120225033600_b35","doi-asserted-by":"crossref","unstructured":"Gunasekaran, A., Ngai, E.W.T. and McGaughey, R.E. (2006), \u201cInformation technology and systems justification: a review for research and applications\u201d, European Journal of Operational Research, Vol. 173 No. 3, pp. 957\u201083.","DOI":"10.1016\/j.ejor.2005.06.002"},{"key":"key2022032120225033600_b36","doi-asserted-by":"crossref","unstructured":"H\u00e4kkinen, L. and Hilmola, O. (2008), \u201cERP evaluation during the shakedown phase: lessons from an after\u2010sales division\u201d, Information Systems Journal, Vol. 18 No. 1, pp. 73\u2010100.","DOI":"10.1111\/j.1365-2575.2007.00261.x"},{"key":"key2022032120225033600_b37","unstructured":"Hallikainen, P., Kivij\u00e4rvi, H. and Nurmim\u00e4ki, K. (2002), \u201cEvaluating strategic IT investments: an assessment of investment alternatives for a web content management system\u201d, Proceedings of the 35th Annual Hawaii International Conference on System Sciences (HICSS'02) in Big Island, HI, pp. 2977\u201086."},{"key":"key2022032120225033600_b38","doi-asserted-by":"crossref","unstructured":"Hamilton, S. and Chervany, N. (1981a), \u201cEvaluating information system effectiveness \u2013 part I: comparing evaluation approaches\u201d, MIS Quarterly, Vol. 5 No. 3, pp. 55\u201069.","DOI":"10.2307\/249291"},{"key":"key2022032120225033600_b39","doi-asserted-by":"crossref","unstructured":"Hamilton, S. and Chervany, N. (1981b), \u201cEvaluating information system effectiveness \u2013 part II: comparing evaluator viewpoints\u201d, MIS Quarterly, Vol. 5 No. 4, pp. 79\u201086.","DOI":"10.2307\/249329"},{"key":"key2022032120225033600_b40","doi-asserted-by":"crossref","unstructured":"Hitt, L.M. and Brynjolfsson, E. (1996), \u201cProductivity, business profitability, and consumer surplus: three different measures of information technology value\u201d, MIS Quarterly, Vol. 20 No. 2, pp. 121\u201042.","DOI":"10.2307\/249475"},{"key":"key2022032120225033600_b41","doi-asserted-by":"crossref","unstructured":"Irani, Z. (2002), \u201cInformation systems evaluation: navigating through the problem domain\u201d, Information & Management, Vol. 40 No. 1, pp. 11\u201024.","DOI":"10.1016\/S0378-7206(01)00128-8"},{"key":"key2022032120225033600_b42","doi-asserted-by":"crossref","unstructured":"Irani, Z. and Love, P.E.D. (2000\/2001), \u201cThe propagation of technology management taxonomies for evaluating investments in information systems\u201d, Journal of Management Information Systems, Vol. 17 No. 3, pp. 161\u201077.","DOI":"10.1080\/07421222.2000.11045650"},{"key":"key2022032120225033600_b43","doi-asserted-by":"crossref","unstructured":"Irani, Z., Ezingeard, J.N. and Grieve, R.J. (1997), \u201cIntegrating the costs of a manufacturing IT\/IS infrastructure into the investment decision\u2010making process\u201d, Technovation, Vol. 17 Nos 11\/12, pp. 695\u2010706.","DOI":"10.1016\/S0166-4972(97)00060-6"},{"key":"key2022032120225033600_b44","doi-asserted-by":"crossref","unstructured":"Irani, Z., Ghoneim, A. and Love, P.E.D. (2006), \u201cEvaluating cost taxonomies for information systems management\u201d, European Journal of Operational Research, Vol. 173 No. 3, pp. 1103\u201022.","DOI":"10.1016\/j.ejor.2005.07.007"},{"key":"key2022032120225033600_b45","doi-asserted-by":"crossref","unstructured":"Irani, Z., Sharif, A., Love, P.E.D. and Kahraman, C. (2002), \u201cApplying concepts of fuzzy cognitive mapping to model: the IT\/IS investment evaluation process\u201d, International Journal of Production Economics, Vol. 75 Nos 1\/2, pp. 199\u2010211.","DOI":"10.1016\/S0925-5273(01)00192-X"},{"key":"key2022032120225033600_b46","doi-asserted-by":"crossref","unstructured":"Jurison, J. (1996), \u201cThe temporal nature of is benefits: a longitudinal study\u201d, Information & Management, Vol. 30 No. 2, pp. 75\u20109.","DOI":"10.1016\/0378-7206(95)00050-X"},{"key":"key2022032120225033600_b47","doi-asserted-by":"crossref","unstructured":"Kanungo, S., Duda, S. and Srinivas, Y. (1999), \u201cA structured model for evaluating information systems effectiveness\u201d, Systems Research and Behavioral Science, Vol. 16 No. 6, pp. 495\u2010518.","DOI":"10.1002\/(SICI)1099-1743(199911\/12)16:6<495::AID-SRES238>3.0.CO;2-R"},{"key":"key2022032120225033600_b48","unstructured":"Kim, C.S., Peterson, D. and Meinert, D. (1999), \u201cStudents' perceptions on information systems success\u201d, The Journal of Computer Information Systems, Vol. 39 No. 3, pp. 68\u201072."},{"key":"key2022032120225033600_b49","doi-asserted-by":"crossref","unstructured":"Klecun, E. and Cornford, T. (2005), \u201cA critical approach to evaluation\u201d, European Journal of Information Systems, Vol. 14 No. 3, pp. 229\u201043.","DOI":"10.1057\/palgrave.ejis.3000540"},{"key":"key2022032120225033600_b50","doi-asserted-by":"crossref","unstructured":"Klein, G., Jiang, J.J. and Balloun, J. (1997), \u201cInformation system evaluation by system typology\u201d, Journal of Systems and Software, Vol. 37 No. 3, pp. 181\u20106.","DOI":"10.1016\/S0164-1212(96)00014-3"},{"key":"key2022032120225033600_b51","doi-asserted-by":"crossref","unstructured":"Kohli, R. and Grover, V. (2008), \u201cBusiness value of IT: an essay on expanding research directions to keep up with the times\u201d, Journal of the Association for Information Systems, Vol. 9 No. 1, pp. 23\u201039.","DOI":"10.17705\/1jais.00147"},{"key":"key2022032120225033600_b52","doi-asserted-by":"crossref","unstructured":"Kraemer, K.L., Danziger, J.N., Dunkle, D.E. and King, J.L. (1993), \u201cThe usefulness of computer\u2010based information to public managers\u201d, MIS Quarterly, Vol. 17 No. 2, pp. 129\u201048.","DOI":"10.2307\/249798"},{"key":"key2022032120225033600_b53","doi-asserted-by":"crossref","unstructured":"Kumar, R.L. (2004), \u201cA framework for assessing the business value of information technology infrastructures\u201d, Journal of Management Information Systems, Vol. 21 No. 2, pp. 11\u201032.","DOI":"10.1080\/07421222.2004.11045801"},{"key":"key2022032120225033600_b54","doi-asserted-by":"crossref","unstructured":"Larsen, K.R.T. (2003), \u201cA taxonomy of antecedents of information systems success: variable analysis studies\u201d, Journal of Management Information Systems, Vol. 20 No. 2, pp. 169\u2010246.","DOI":"10.1080\/07421222.2003.11045768"},{"key":"key2022032120225033600_b55","doi-asserted-by":"crossref","unstructured":"Law, C.C.H. and Ngai, E.W.T. (2005), \u201cIT business value research: a critical review and research agenda\u201d, International Journal of Enterprise Information Systems, Vol. 1 No. 3, pp. 35\u201055.","DOI":"10.4018\/jeis.2005070103"},{"key":"key2022032120225033600_b56","doi-asserted-by":"crossref","unstructured":"Lee, S. and Kim, S. (2006), \u201cA lag effect of IT investment on firm performance\u201d, Information Resources Management Journal, Vol. 19 No. 1, pp. 43\u201069.","DOI":"10.4018\/irmj.2006010103"},{"key":"key2022032120225033600_b57","doi-asserted-by":"crossref","unstructured":"Leem, C.S. and Kim, I. (2004), \u201cAn integrated evaluation system based on the continuous improvement model of IS performance\u201d, Industrial Management\u2009&\u2009Data Systems, Vol. 104 Nos 1\/2, pp. 115\u201028.","DOI":"10.1108\/02635570410522080"},{"key":"key2022032120225033600_b58","doi-asserted-by":"crossref","unstructured":"Love, P.E.D., Ghoneim, A. and Irani, Z. (2004), \u201cInformation technology evaluation: classifying indirect costs using the structured case method\u201d, Journal of Enterprise Information Management, Vol. 17 No. 4, pp. 312\u201025.","DOI":"10.1108\/17410390410548724"},{"key":"key2022032120225033600_b59","doi-asserted-by":"crossref","unstructured":"Love, P.E.D., Irani, Z. and Edwards, D.J. (2005), \u201cResearching the investment of information technology in construction: an examination of evaluation practices\u201d, Automation in Construction, Vol. 14 No. 4, pp. 569\u201082.","DOI":"10.1016\/j.autcon.2004.12.005"},{"key":"key2022032120225033600_b60","doi-asserted-by":"crossref","unstructured":"Lubbe, S. and Remenyi, D. (1999), \u201cManagement of information technology evaluation \u2013 the development of a managerial thesis\u201d, Logistics Information Management, Vol. 12 Nos 1\/2, pp. 145\u201056.","DOI":"10.1108\/09576059910256600"},{"key":"key2022032120225033600_b61","unstructured":"Lyytinen, K. and Hirschheim, R. (1987), \u201cInformation systems failures: a survey and classification of the empirical literature\u201d, Oxford Surveys in Information Technology, Vol. 4, pp. 257\u2010309."},{"key":"key2022032120225033600_b62","doi-asserted-by":"crossref","unstructured":"McAfee, A. (2002), \u201cThe impact of enterprise information technology adoption on operational performance: an empirical investigation\u201d, Production and Operations Management, Vol. 11 No. 1, pp. 33\u201053.","DOI":"10.1111\/j.1937-5956.2002.tb00183.x"},{"key":"key2022032120225033600_b63","doi-asserted-by":"crossref","unstructured":"McAulay, L., Doherty, N. and Keval, N. (2002), \u201cThe stakeholder dimension in information systems evaluation\u201d, Journal of Information Technology, Vol. 17 No. 4, pp. 241\u201055.","DOI":"10.1080\/0268396022000017734"},{"key":"key2022032120225033600_b64","doi-asserted-by":"crossref","unstructured":"Mahmood, M.A. and Mann, G.J. (1993), \u201cMeasuring the organizational impact of information technology investment: an exploratory study\u201d, Journal of Management Information Systems, Vol. 10 No. 1, pp. 97\u2010122.","DOI":"10.1080\/07421222.1993.11517992"},{"key":"key2022032120225033600_b65","doi-asserted-by":"crossref","unstructured":"Marsh, L. and Flanagan, R. (2000), \u201cMeasuring the costs and benefits of information technology in construction\u201d, Engineering Construction & Architectural Management, Vol. 7 No. 4, pp. 423\u201035.","DOI":"10.1108\/eb021164"},{"key":"key2022032120225033600_b66","doi-asserted-by":"crossref","unstructured":"Melville, N., Kraemer, K. and Gurbaxani, V. (2004), \u201cReview: information technology and organizational performance: an integrative model of IT business value\u201d, MIS Quarterly, Vol. 28 No. 2, pp. 283\u2010322.","DOI":"10.2307\/25148636"},{"key":"key2022032120225033600_b67","doi-asserted-by":"crossref","unstructured":"Mirani, R. and Lederer, A. (1998), \u201cAn instrument for assessing the organizational benefits of IS projects\u201d, Decision Sciences, Vol. 29 No. 4, pp. 803\u201038.","DOI":"10.1111\/j.1540-5915.1998.tb00878.x"},{"key":"key2022032120225033600_b68","doi-asserted-by":"crossref","unstructured":"Mohd. Yusof, M., Papazafeiropoulou, A., Paul, R.J. and Stergioulas, L.K. (2008), \u201cInvestigating evaluation frameworks for health information systems\u201d, International Journal of Medical Informatics, Vol. 77 No. 6, pp. 377\u201085.","DOI":"10.1016\/j.ijmedinf.2007.08.004"},{"key":"key2022032120225033600_b69","doi-asserted-by":"crossref","unstructured":"Mukhopadhyay, T. and Cooper, R.B. (1993), \u201cA microeconomic production assessment of the business value of management information systems: the case of inventory control\u201d, Journal of Management Information Systems, Vol. 10 No. 1, pp. 33\u201056.","DOI":"10.1080\/07421222.1993.11517989"},{"key":"key2022032120225033600_b70","doi-asserted-by":"crossref","unstructured":"Mukhopadhyay, T., Kekre, S. and Kalathur, S. (1995), \u201cBusiness value of information technology: a study of electronic data interchange\u201d, MIS Quarterly, Vol. 19 No. 2, pp. 137\u201056.","DOI":"10.2307\/249685"},{"key":"key2022032120225033600_b71","doi-asserted-by":"crossref","unstructured":"Oz, E. (2005), \u201cInformation technology productivity: in search of a definite observation\u201d, Information & Management, Vol. 42 No. 6, pp. 789\u201098.","DOI":"10.1016\/j.im.2004.08.003"},{"key":"key2022032120225033600_b72","doi-asserted-by":"crossref","unstructured":"Palvia, P., Perkins, J. and Zeltmann, S. (1992), \u201cThe PRISM system: a key to organizational effectiveness at Federal Express Corporation\u201d, MIS Quarterly, Vol. 16 No. 3, pp. 277\u201092.","DOI":"10.2307\/249529"},{"key":"key2022032120225033600_b73","doi-asserted-by":"crossref","unstructured":"Palvia, S.C., Sharma, R.S. and Conrath, D.W. (2001), \u201cA socio\u2010technical framework for quality assessment of computer information systems\u201d, Industrial Management\u2009&\u2009Data Systems, Vol. 101 Nos 5\/6, pp. 237\u201051.","DOI":"10.1108\/02635570110394635"},{"key":"key2022032120225033600_b74","doi-asserted-by":"crossref","unstructured":"Pitt, L.F., Watson, R.T. and Kavan, C.B. (1995), \u201cService quality: a measure of information systems effectiveness\u201d, MIS Quarterly, Vol. 19 No. 2, pp. 173\u201085.","DOI":"10.2307\/249687"},{"key":"key2022032120225033600_b75","doi-asserted-by":"crossref","unstructured":"Premkumar, G. and King, W.R. (1992), \u201cAn empirical assessment of information systems planning and the role of information systems in organizations\u201d, Journal of Management Information Systems, Vol. 9 No. 2, pp. 99\u2010126.","DOI":"10.1080\/07421222.1992.11517960"},{"key":"key2022032120225033600_b76","doi-asserted-by":"crossref","unstructured":"Ragowsky, A., Ahituv, N. and Neumann, S. (2000), \u201cThe benefits of using information systems\u201d, Communications of the ACM, Vol. 43 No. 11es, pp. 303\u201011.","DOI":"10.1145\/352515.352532"},{"key":"key2022032120225033600_b77","doi-asserted-by":"crossref","unstructured":"Rai, A., Lang, S.S. and Welker, R.B. (2002), \u201cAssessing the validity of IS success models: an empirical test and theoretical analysis\u201d, Information Systems Research, Vol. 13 No. 1, pp. 50\u201069.","DOI":"10.1287\/isre.13.1.50.96"},{"key":"key2022032120225033600_b78","doi-asserted-by":"crossref","unstructured":"Remenyi, D. and Sherwood\u2010Smith, M. (1999), \u201cMaximise information systems value by continuous participative evaluation\u201d, Logistics Information Management, Vol. 12 Nos 1\/2, pp. 14\u201031.","DOI":"10.1108\/09576059910256222"},{"key":"key2022032120225033600_b79","doi-asserted-by":"crossref","unstructured":"Renkema, T.J.W. and Berghout, E.W. (1997), \u201cMethodologies for information systems investment evaluation at the proposal stage: a comparative review\u201d, Information and Software Technology, Vol. 39 No. 1, pp. 1\u201013.","DOI":"10.1016\/0950-5849(96)85006-3"},{"key":"key2022032120225033600_b80","doi-asserted-by":"crossref","unstructured":"Scott, J.E. (1995), \u201cThe measurement of information systems effectiveness: evaluating a measuring instrument\u201d, ACM SIGMIS Database, Vol. 26 No. 1, pp. 43\u201061.","DOI":"10.1145\/206476.206484"},{"key":"key2022032120225033600_b81","doi-asserted-by":"crossref","unstructured":"Seddon, P., Staples, S., Patnayakuni, R. and Bowtell, M. (1999), \u201cDimensions of information systems success\u201d, Communications of the AIS, Vol. 2 No. 20, pp. 1\u201039.","DOI":"10.17705\/1CAIS.00220"},{"key":"key2022032120225033600_b82","doi-asserted-by":"crossref","unstructured":"Seddon, P.B., Graeser, V. and Willcocks, L.P. (2002), \u201cMeasuring organizational IS effectiveness: an overview and update of senior management perspectives\u201d, Database for Advances in Information Systems, Vol. 33 No. 2, pp. 11\u201028.","DOI":"10.1145\/513264.513270"},{"key":"key2022032120225033600_b83","doi-asserted-by":"crossref","unstructured":"Serafeimidis, V. and Smithson, S. (1996), \u201cThe management of change for information systems evaluation practice: experience from a case study\u201d, International Journal of Information Management, Vol. 16 No. 3, pp. 205\u201017.","DOI":"10.1016\/0268-4012(96)00005-9"},{"key":"key2022032120225033600_b84","doi-asserted-by":"crossref","unstructured":"Shayo, C., Guthrie, R. and Igbaria, M. (1999), \u201cExploring the measurement of end user computing success\u201d, Journal of End User Computing, Vol. 11 No. 1, pp. 5\u201014.","DOI":"10.4018\/joeuc.1999010101"},{"key":"key2022032120225033600_b85","doi-asserted-by":"crossref","unstructured":"Skok, W., Kophamel, A. and Richardson, I. (2001), \u201cDiagnosing information systems success: importance\u2010performance maps in the health club industry\u201d, Information & Management, Vol. 38 No. 7, pp. 409\u201019.","DOI":"10.1016\/S0378-7206(00)00076-8"},{"key":"key2022032120225033600_b86","doi-asserted-by":"crossref","unstructured":"Sohal, A.S., Moss, S. and Ng, L. (2001), \u201cComparing IT success in manufacturing and service industries\u201d, International Journal of Operations & Production Management, Vol. 21 Nos 1\/2, pp. 30\u201045.","DOI":"10.1108\/01443570110358440"},{"key":"key2022032120225033600_b87","unstructured":"Stivers, B.P. and Joyce, T. (2000), \u201cBuilding a balanced performance management system\u201d, SAM Advanced Management Journal, Vol. 65 No. 2, pp. 22\u20109."},{"key":"key2022032120225033600_b88","doi-asserted-by":"crossref","unstructured":"Stockdale, R. and Standing, C. (2006), \u201cAn interpretive approach to evaluating information systems: a content, context, process framework\u201d, European Journal of Operational Research, Vol. 173 No. 3, pp. 1090\u2010102.","DOI":"10.1016\/j.ejor.2005.07.006"},{"key":"key2022032120225033600_b89","doi-asserted-by":"crossref","unstructured":"Stockdale, R., Standing, C. and Love, P.E.D. (2006), \u201cPropagation of a parsimonious framework for evaluating information systems in construction\u201d, Automation in Construction, Vol. 15 No. 6, pp. 729\u201036.","DOI":"10.1016\/j.autcon.2005.09.005"},{"key":"key2022032120225033600_b90","unstructured":"Sugumaran, V. and Arogyaswamy, B. (2003\/2004), \u201cMeasuring IT performance: contingency variables and value modes\u201d, The Journal of Computer Information Systems, Vol. 44 No. 2, pp. 79\u201086."},{"key":"key2022032120225033600_b91","unstructured":"Tangpong, C. (2008), \u201cIT\u2010performance paradox revisited: resource\u2010based and prisoner's dilemma perspectives\u201d, Journal of Applied Management and Entrepreneurship, Vol. 13 No. 1, pp. 35\u201049."},{"key":"key2022032120225033600_b92","unstructured":"Webster, J. and Watson, R.T. (2002), \u201cAnalyzing the past to prepare for the future: writing a literature review\u201d, MIS Quarterly, Vol. 26 No. 2, pp. xiii\u2010xxiii."},{"key":"key2022032120225033600_b93","doi-asserted-by":"crossref","unstructured":"Weill, P. (1992), \u201cThe relationship between investment in information technology and firm performance: a study of the valve manufacturing sector\u201d, Information Systems Research, Vol. 3 No. 4, pp. 307\u201033.","DOI":"10.1287\/isre.3.4.307"},{"key":"key2022032120225033600_b94","doi-asserted-by":"crossref","unstructured":"Weill, P. and Olson, M.H. (1989), \u201cManaging investment in information technology: mini case examples and implications\u201d, MIS Quarterly, Vol. 13 No. 1, pp. 3\u201017.","DOI":"10.2307\/248694"},{"key":"key2022032120225033600_b95","doi-asserted-by":"crossref","unstructured":"Willcocks, L. and Lester, S. (1996), \u201cBeyond the IT productivity paradox\u201d, European Management Journal, Vol. 14 No. 3, pp. 279\u201090.","DOI":"10.1016\/0263-2373(96)00007-2"},{"key":"key2022032120225033600_b96","doi-asserted-by":"crossref","unstructured":"Dasgupta, S., Sarkis, J. and Talluri, S. (1999), \u201cInfluence of information technology investment on firm productivity: a cross\u2010sectional study\u201d, Logistics Information Management, Vol. 12 Nos 1\/2, pp. 120\u20109.","DOI":"10.1108\/09576059910256493"},{"key":"key2022032120225033600_b97","doi-asserted-by":"crossref","unstructured":"Schniederjans, M.J. and Hamaker, J.L. (2003), \u201cA new strategic information technology investment model\u201d, Management Decision, Vol. 41 Nos 1\/2, pp. 8\u201017.","DOI":"10.1108\/00251740310445527"},{"key":"key2022032120225033600_b98","doi-asserted-by":"crossref","unstructured":"Thong, J.Y.L. and Yap, C.S. (1996), \u201cInformation systems effectiveness: a user satisfaction approach\u201d, Information Processing & Management, Vol. 32 No. 5, pp. 601\u201010.","DOI":"10.1016\/0306-4573(96)00004-0"}],"container-title":["Journal of Systems and Information Technology"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.emeraldinsight.com\/doi\/full-xml\/10.1108\/13287261011032643","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/13287261011032643\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/13287261011032643\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,25]],"date-time":"2025-07-25T00:24:17Z","timestamp":1753403057000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/jsit\/article\/12\/1\/37-55\/254614"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,2,2]]},"references-count":98,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2010,2,2]]}},"alternative-id":["10.1108\/13287261011032643"],"URL":"https:\/\/doi.org\/10.1108\/13287261011032643","relation":{},"ISSN":["1328-7265"],"issn-type":[{"type":"print","value":"1328-7265"}],"subject":[],"published":{"date-parts":[[2010,2,2]]}}}