{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T03:07:13Z","timestamp":1777691233508,"version":"3.51.4"},"reference-count":50,"publisher":"Emerald","issue":"5","license":[{"start":{"date-parts":[[2001,7,1]],"date-time":"2001-07-01T00:00:00Z","timestamp":993945600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2001,7,1]]},"abstract":"<jats:p>The emergence of total quality management and the ISO 9000 suite of standards has allowed a re\u2010think of how (and why) the post\u2010implementation evaluation of computer systems is to be carried out. Traditional performance measurement, modeling and analysis techniques \u2013 while not discredited \u2013 have been tempered with a more holistic ideology. This article recommends a socio\u2010technical approach to determining the quality of a computer information system. In this context, two postulates have been proposed and tested by field survey of expert systems in the insurance industry in North America. Postulate one focuses on a multidimensional concept of IS quality comprising the characteristics of task, technology, people and organization. Postulate two deals with differences in assessments of these characteristics according to stakeholder groups: managers, developers, and users. Summarizes the key findings of these postulates in the context of the TQM and ISO 9000 philosophies.<\/jats:p>","DOI":"10.1108\/02635570110394635","type":"journal-article","created":{"date-parts":[[2007,4,13]],"date-time":"2007-04-13T09:53:40Z","timestamp":1176458020000},"page":"237-251","source":"Crossref","is-referenced-by-count":53,"title":["A socio\u2010technical framework for quality assessment of computer information systems"],"prefix":"10.1108","volume":"101","author":[{"given":"Shailendra C.","family":"Palvia","sequence":"first","affiliation":[]},{"given":"Ravi S.","family":"Sharma","sequence":"additional","affiliation":[]},{"given":"David W.","family":"Conrath","sequence":"additional","affiliation":[]}],"member":"140","reference":[{"key":"key2022031520235471800_B1","doi-asserted-by":"crossref","unstructured":"Bailey, J.E. and Pearson, S.W. (1983), \u201cDevelopment of a tool for measuring and analysing computer user satisfaction\u201d, Management Science, Vol. 29 No. 5, pp. 530\u201045.","DOI":"10.1287\/mnsc.29.5.530"},{"key":"key2022031520235471800_B2","doi-asserted-by":"crossref","unstructured":"Baroudi, J.J. and Orlikowski, W.J. (1988), \u201cA short\u2010form measure of user information satisfaction: a psychometric evaluation and notes on use\u201d, Journal of Management Information Systems, Vol. 4 No. 4, Spring, pp. 44\u201059.","DOI":"10.1080\/07421222.1988.11517807"},{"key":"key2022031520235471800_B3","unstructured":"Conrath, D.W. and Dumas, P. (Eds) (1989), Office Support Systems Analysis and Design, a Manual, IOT, Munich."},{"key":"key2022031520235471800_B4","unstructured":"Conrath, D.W. and Sharma, R.S. (1992), \u201cExpert system evaluation: a model and a method\u201d, working paper, \u201cInformation Management Research Centre\u201d, Nanyang Technological University (translated into German and appeared in Lehner, F. (Ed.), Maintenance of Knowledge\u2010based Systems, Koblenz School of Corporate Management, Germany)."},{"key":"key2022031520235471800_B5","unstructured":"Coopers & Lybrand (1990), \u201cExpert systems in the insurance industry\u201d, Survey Report co\u2010sponsored by AICorp."},{"key":"key2022031520235471800_B6","doi-asserted-by":"crossref","unstructured":"DeLone, W.H. and McLean, E.R. (1992), \u201cInformation systems success: the quest for the dependent variable\u201d, Information Systems Research, Vol. 3 No. 1, March, pp. 60\u201095.","DOI":"10.1287\/isre.3.1.60"},{"key":"key2022031520235471800_B7","unstructured":"Deming, W.E. (1982), Quality, Productivity and the Competitive Position, MIT Press, Cambridge, MA."},{"key":"key2022031520235471800_B8","doi-asserted-by":"crossref","unstructured":"Ginzberg, M.J. (1981), \u201cEarly diagnosis of MIS implementation failure\u201d, Management Science, Vol. 27, pp. 459\u201078.","DOI":"10.1287\/mnsc.27.4.459"},{"key":"key2022031520235471800_B9","doi-asserted-by":"crossref","unstructured":"Goodhue, D.L. (1988), \u201cIS attitudes: toward theoretical and definitional clarity\u201d, DataBase, Vol. 19 Nos 3\/4, Fall\/Winter, pp. 6\u201015.","DOI":"10.1145\/65766.65768"},{"key":"key2022031520235471800_B10","doi-asserted-by":"crossref","unstructured":"Goodhue, D.L. (1995), \u201cUnderstanding user evaluations of information systems\u201d, Management Science, Vol. 41, pp. 1827\u201044.","DOI":"10.1287\/mnsc.41.12.1827"},{"key":"key2022031520235471800_B11","doi-asserted-by":"crossref","unstructured":"Goodhue, D.L. and Thompson, R.L. (1995), \u201cTask\u2010technology fit and individual performance\u201d, MIS Quarterly, Vol. 19 No. 2, pp. 213\u201036.","DOI":"10.2307\/249689"},{"key":"key2022031520235471800_B12","doi-asserted-by":"crossref","unstructured":"Grady, R.B. (1993), \u201cPractical results from measuring software quality\u201d, Communications of the ACM, Vol. 36 No. 11, November, pp. 62\u20108.","DOI":"10.1145\/163359.163369"},{"key":"key2022031520235471800_B13","doi-asserted-by":"crossref","unstructured":"Guimaraes, T. and Gupta, Y.P. (1988), \u201cMeasuring top management satisfaction with the MIS department\u201d, OMEGA, Vol. 16 No. 1, pp 17\u201024.","DOI":"10.1016\/0305-0483(88)90004-7"},{"key":"key2022031520235471800_B14","unstructured":"Ishikawa, K. (1985), What is Total Quality Control?: The Japanese Way, Prentice\u2010Hall, Englewood Cliffs, NJ."},{"key":"key2022031520235471800_B15","doi-asserted-by":"crossref","unstructured":"Ives, B., Olson, M.H. and Baroudi, J.J. (1983), \u2018The measurement of user information satisfaction\u201d, Communications of the ACM, Vol. 26 No. 10, pp. 785\u201093.","DOI":"10.1145\/358413.358430"},{"key":"key2022031520235471800_B16","unstructured":"Juran, J.M. (1993), Quality Planning and Analysis: From Product Development Through Use, McGraw\u2010Hill, New York, NY."},{"key":"key2022031520235471800_B17","doi-asserted-by":"crossref","unstructured":"Keil, M. (1995), \u201cPulling the plug: software project management and the problem of project escalation\u201d, MIS Quarterly, Vol. 19 No. 4, pp. 421\u201048.","DOI":"10.2307\/249627"},{"key":"key2022031520235471800_B18","doi-asserted-by":"crossref","unstructured":"Kling, R. and Scacchi, W. (1980), \u201cComputers as social action: social dynamics of computing in organizations\u201d, Advances in Computers, Vol. 19, pp. 250\u2010319.","DOI":"10.1016\/S0065-2458(08)60036-4"},{"key":"key2022031520235471800_B19","doi-asserted-by":"crossref","unstructured":"Kumar, \u201cPost implementation evaluation of computer\u2010based information systems: current practices\u201d, Communications of the ACM, Vol. 33 No. 2, February, pp. 203\u201012.","DOI":"10.1145\/75577.75585"},{"key":"key2022031520235471800_B20","unstructured":"Leavitt, H.J. (1965), \u201cApplied organizational change in industry: structural, technological and humanistic approaches\u201d, in March, J.G. (Ed.), Handbook of Organizations, Rand McNally, Chicago, IL, pp. 1144\u201070."},{"key":"key2022031520235471800_B21","unstructured":"Leonard\u2010Barton, D. and Sviokla, J.J. (1988), \u201cPutting expert systems to work\u201d, Harvard Business Review, Vol. 66 No. 2, March\/April, pp. 91\u20108."},{"key":"key2022031520235471800_B22","doi-asserted-by":"crossref","unstructured":"Mahmood, M.A. and Sniezek, J.A. (1989), \u201cDefining decision support systems: an empirical assessment of end\u2010user satisfaction\u201d, INFOR, Vol. 27 No. 3, August, pp. 253\u201071.","DOI":"10.1080\/03155986.1989.11732097"},{"key":"key2022031520235471800_B23","unstructured":"Markus, M.L. and Keil, M. (1994), \u201cIf we build it they will come: designing information systems that people want to use\u201d, Sloan Management Review, Vol. 35 No. 4, pp. 11\u201025."},{"key":"key2022031520235471800_B24","unstructured":"McLeod, R. Jr and Bender, D.H. (1988), \u201cPerceptions of system effectiveness as viewed by executives, users, and information specialists\u201d, Proceedings of the Hawaii International Conference on Systems Sciences, Vol. 3, Honolulu."},{"key":"key2022031520235471800_B25","doi-asserted-by":"crossref","unstructured":"Melone, N.P. (1990), \u201cA theoretical assessment of the user\u2010satisfaction construct in information systems research\u201d, Management Science, Vol. 36 No. 1, January, pp. 76\u201091.","DOI":"10.1287\/mnsc.36.1.76"},{"key":"key2022031520235471800_B26","unstructured":"Mumford, E. and Weir, M. (1979), Computer Systems in Work Design: The ETHICS Method, Associated Business Press, London."},{"key":"key2022031520235471800_B27","unstructured":"Nunnally, J.C. (1978), Psychometric Theory, 2nd ed., McGraw\u2010Hill, New York, NY."},{"key":"key2022031520235471800_B28","doi-asserted-by":"crossref","unstructured":"O\u2019Keefe, R.M. \u2018(1989), \u2018The evaluation of decision\u2010aiding systems: guidelines and methods\u201d, Information & Management, Vol. 17 No. 11, November, pp. 217\u201026.","DOI":"10.1016\/0378-7206(89)90045-1"},{"key":"key2022031520235471800_B29","doi-asserted-by":"crossref","unstructured":"O\u2019Leary, T.J., Goul, M., Moffitt, K.E. and Radwan, A.E. (1990), \u201cValidating expert systems\u201d, IEEE Expert, Vol. 5 No. 3, June, pp. 51\u20108.","DOI":"10.1109\/64.54673"},{"key":"key2022031520235471800_B30","doi-asserted-by":"crossref","unstructured":"Orlikowski, W.J. (1992), \u201cLearning from notes: organizational issues in groupware implementation\u201d, in Turner, J. and Kraut, R. (Eds), Conference on Computer\u2010Supported Cooperative Work, Toronto, pp. 362\u20109.","DOI":"10.1145\/143457.143549"},{"key":"key2022031520235471800_B31","doi-asserted-by":"crossref","unstructured":"Orlikowski, W.J. and Gash, D. (1994), \u201cTechnological frames: making sense of information technology in organizations\u201d, ACM Transactions on Information Systems, Vol. 12 No. 2, pp. 174\u201096.","DOI":"10.1145\/196734.196745"},{"key":"key2022031520235471800_B32","unstructured":"Pava, C.H. (1983), \u201cSociotechnical design: its contribution to office work\u201d, in Managing New Office Technology, The Free Press, New York, NY, pp. 13\u201043."},{"key":"key2022031520235471800_B33","unstructured":"Perrow, C. (1992), \u201cAnalysis of the disaster at Three Mile Island\u201d, J. Social Issues."},{"key":"key2022031520235471800_B34","unstructured":"Rai, A. and Mendelow, A. (1989), \u201cEffectiveness of information systems revisited\u201d, Proceedings of the 20th Annual Meeting of the Decision Sciences Institute, New Orleans, LA, November, pp. 578\u201080."},{"key":"key2022031520235471800_B35","doi-asserted-by":"crossref","unstructured":"Saraph, J.V., Benson P.G. and Schroeder, R.G. (1989), \u201cAn instrument for measuring the critical factors of quality management\u201d, Decision Sciences, Vol. 20 No. 4, Fall, pp. 810\u201029.","DOI":"10.1111\/j.1540-5915.1989.tb01421.x"},{"key":"key2022031520235471800_B36","doi-asserted-by":"crossref","unstructured":"Scott Morton, M.S. (1991), The Corporation of the 1990s: Information Technology and Organizational Transformation, Oxford University Press, New York, NY.","DOI":"10.1093\/oso\/9780195063585.001.0001"},{"key":"key2022031520235471800_B37","doi-asserted-by":"crossref","unstructured":"Srinivasan (1985), \u201cAlternative measures of systems effectiveness: associations and implications\u201d, MIS Quarterly, Vol. 9 No. 3, September, pp. 243\u201053.","DOI":"10.2307\/248951"},{"key":"key2022031520235471800_B38","doi-asserted-by":"crossref","unstructured":"Straub, D.W. (1989), \u201cValidating instruments in MIS research\u201d, MIS Quarterly, Vol. 13 No. 2, June, pp. 147\u201070.","DOI":"10.2307\/248922"},{"key":"key2022031520235471800_B39","unstructured":"Tobin (1990), \u201cThe new quality landscape: total quality management\u201d, Journal of Systems Management, Vol. 41 No. 11, November, pp. 10\u201014."},{"key":"key2022031520235471800_B40","unstructured":"Trist, E. (1981), \u201cThe evolution of socio\u2010technical systems: a conceptual framework and an action research program\u201d, Issues in the Quality of Working Life Occasional Paper No. 2, Ontario Ministry of Labour, Toronto, June."},{"key":"key2022031520235471800_B41","doi-asserted-by":"crossref","unstructured":"Weick, K.E. (1988), \u201cEnacted sensemaking in crisis situations\u201d, Journal of Management Studies, Vol. 25 No. 4, pp. 305\u201017.","DOI":"10.1111\/j.1467-6486.1988.tb00039.x"},{"key":"key2022031520235471800_B42","unstructured":"Weick, K.E. (1990), \u201cTechnology as Equivoque\u201d, in Goodman, P.S. and Sproull, L.S. (Eds), Technology and Organizations, Jossey\u2010Bass, San Francisco, CA."},{"key":"key2022031520235471800_B43","unstructured":"Zadronzny, M.A. and Tumanic, R.R. (1992), \u201cZero\u2010defects software: the total quality approach to software engineering\u201d, Chief Information Officer, Vol. 4 No. 4, Spring."},{"key":"key2022031520235471800_B44","doi-asserted-by":"crossref","unstructured":"Agarwal, R. and Prasad, J. (1998), \u201cThe antecedents and consequences of user perceptions in information technology adoption\u201d, Decision Support Systems, Vol. 22 No. 1, January, pp. 15\u201029.","DOI":"10.1016\/S0167-9236(97)00006-7"},{"key":"key2022031520235471800_B45","unstructured":"Conrath, D.W. and Sharma, R.S. (1994), \u201cExpert system evaluation: a model and a method\u201d, in Lehner, F. (Ed.), Die Wartung von wissensbasierten Systemen, Haensel\u2010Hohenhausen, Egelsbach, pp. 98\u2010142."},{"key":"key2022031520235471800_B46","unstructured":"Lucas, H.C. Jr, Ginsberg, M.J. and Schultz, R.L. (1990), Information Systems Implementation: Testing a Structural Model, Ablex, Norwood, NJ."},{"key":"key2022031520235471800_B47","doi-asserted-by":"crossref","unstructured":"Moore, G.C. and Benbasat, I. (1991), \u201cDevelopment of an instrument to measure the perceptions of adopting an information technology innovation, Information Systems Research, Vol. 2 No. 3, September, pp. 192\u2010222.","DOI":"10.1287\/isre.2.3.192"},{"key":"key2022031520235471800_B48","doi-asserted-by":"crossref","unstructured":"Sharma, R.S. and Conrath, D.W. (1992), \u201cEvaluating expert systems: the socio\u2010technical dimensions of quality\u201d, Expert Systems, Vol. 9 No. 3, August, pp. 125\u201038.","DOI":"10.1111\/j.1468-0394.1992.tb00393.x"},{"key":"key2022031520235471800_B49","unstructured":"Sharma, R.S. and Conrath, D.W. (1995), \u201cExpert systems and their post\u2010implementation evaluation\u201d, in Kent, A. (Ed.), Encyclopedia of Library and Information Science, Vol. 55 No. 18, Marcel Dekker, New York, NY."},{"key":"key2022031520235471800_B50","unstructured":"Sviokla, J.J. (1996), \u201cKnowledge workers and radically new technology\u201d, Sloan Management Review, Vol. 37 No. 4, Summer, pp. 25\u201035."}],"container-title":["Industrial Management &amp; Data Systems"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.emeraldinsight.com\/doi\/full-xml\/10.1108\/02635570110394635","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/02635570110394635\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/02635570110394635\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T23:37:00Z","timestamp":1753400220000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/imds\/article\/101\/5\/237-251\/181924"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2001,7,1]]},"references-count":50,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2001,7,1]]}},"alternative-id":["10.1108\/02635570110394635"],"URL":"https:\/\/doi.org\/10.1108\/02635570110394635","relation":{},"ISSN":["0263-5577"],"issn-type":[{"value":"0263-5577","type":"print"}],"subject":[],"published":{"date-parts":[[2001,7,1]]}}}