{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T18:08:23Z","timestamp":1754158103120,"version":"3.41.2"},"reference-count":35,"publisher":"Emerald","issue":"3","license":[{"start":{"date-parts":[[1999,9,1]],"date-time":"1999-09-01T00:00:00Z","timestamp":936144000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[1999,9,1]]},"abstract":"<jats:p>Considers the problems of a multi\u2010disciplinary team working together to understand and evaluate a healthcare information system, which itself is situated in a complex organisational and political environment. Provides general discussion of problems faced by evaluators of such systems. Describes this specific evaluation project (Electronic Patient Records in the UK National Health Service), gives an account of the evaluation process as it occurred, highlights some of the problems encountered, and discusses attempts to overcome these. Suggests that social, organisational and political factors are inherent in all such research enterprises, and that in order to facilitate a rich understanding of complex systems, these factors must also be considered as part of the research data.<\/jats:p>","DOI":"10.1108\/09593849910278277","type":"journal-article","created":{"date-parts":[[2002,7,28]],"date-time":"2002-07-28T18:52:06Z","timestamp":1027882326000},"page":"253-275","source":"Crossref","is-referenced-by-count":14,"title":["Issues in the multi\u2010disciplinary assessment of healthcare information systems"],"prefix":"10.1108","volume":"12","author":[{"given":"Heather","family":"Heathfield","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter","family":"Hudson","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stephen","family":"Kay","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lesley","family":"Mackay","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tom","family":"Marley","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lorraine","family":"Nicholson","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Victor","family":"Peel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ruth","family":"Roberts","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"John","family":"Williams","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","reference":[{"key":"key2022021019520690200_b1","unstructured":"Anderson, J.G., Aydin, C.E. and Jay, S.J. (Eds) (1994), Evaluating Health Care Information Systems, Methods and Applications, (1st ed.), Sage Publications, London."},{"key":"key2022021019520690200_b2","unstructured":"Audit Commission (1987), Use of Operating Theatres in the National Health Service, HMSO, London."},{"key":"key2022021019520690200_b3","unstructured":"Audit Commission (1995a), For Your Information \u2013 A Study of Information Management and Systems in the Acute Hospital, HMSO, London."},{"key":"key2022021019520690200_b4","unstructured":"Audit Commission (1995b), Setting the Records Straight \u2013 A Study of Hospital Medical Records, HMSO, London."},{"key":"key2022021019520690200_b5","unstructured":"Barber, B., Abbot, W. and Peel, V. (1994), Information Management in Health Care, IHSM\/Longmans, London."},{"key":"key2022021019520690200_b6","doi-asserted-by":"crossref","unstructured":"Barnett, G.O., Justice, N.S., Somand, M.E., Adams, J.B., Waxman, B.D., Beaman, P.D., Parent, M.S., Van Deusen, F.R. and Greenlie, J.K. (1979), \u201cCOSTAR \u2013 a computer\u2010based medical information system for ambulatory care\u2019, IEEE, Vol.  67, pp. 1222\u201037.","DOI":"10.1109\/PROC.1979.11438"},{"key":"key2022021019520690200_b7","doi-asserted-by":"crossref","unstructured":"Boloix, G. and Robillard, P.N. (1995), \u201cA software system evaluation framework\u201d, ACM, Vol. 28 No. 12, pp. 17\u201026.","DOI":"10.1109\/2.476196"},{"key":"key2022021019520690200_b8","doi-asserted-by":"crossref","unstructured":"Carpenter, P.C. (1994), \u201cThe electronic medical record: perspective from Mayo Clinic\u201d, Int J Biomed Comp, Vol. 34, pp. 159\u201071.","DOI":"10.1016\/0020-7101(94)90019-1"},{"key":"key2022021019520690200_b9","unstructured":"Churgin, P.G. (1994), \u2018Introduction of an automated medical record at an HMO clinic\u201d, MD Computing, Vol. 11, pp. 293\u2010300."},{"key":"key2022021019520690200_b10","unstructured":"Davies, D. and Nicholas, E. (1995), \u201cCPR recognition program\u201d, in Steen, E.B. (Ed.), Proceedings, Computer\u2010based Patient Record Institute Inc., Bethesda, MD."},{"key":"key2022021019520690200_b11","doi-asserted-by":"crossref","unstructured":"de Dombal, F.T., Leaper, D.J., Staniland, J.R. and McCann, A.P. (1974), \u201cHuman and computer\u2010aided diagnosis of abdominal pain: further report with emphasis on performance of clinicians\u201d, Br J Med, Vol. 1 pp. 376\u201080.","DOI":"10.1136\/bmj.1.5904.376"},{"key":"key2022021019520690200_b12","doi-asserted-by":"crossref","unstructured":"Detmer, D.E. and Steen, E.B. (1995), \u201cCountdown to 2001: the computer\u2010based patient record after the institute of medicine report\u201d, IMIA Yearbook of Medical Informatics 1995; F.K. Schattauer Verlagsgesellschaft mbH, Stuttgart, pp. 55\u201060.","DOI":"10.1055\/s-0038-1638020"},{"key":"key2022021019520690200_b13","unstructured":"Dick, R.S. and Steen, B. (Eds) (1991), The Computer\u2010based Patient Record, An Essential Technology for Healthcare, National Academy Press, Washington, DC."},{"key":"key2022021019520690200_b14","doi-asserted-by":"crossref","unstructured":"Donabedian, A. (1966, \u201cEvaluating the quality of medical care\u201d, Milbank Memorial Fund Quarterly, Vol. 44, p. 166.","DOI":"10.2307\/3348969"},{"key":"key2022021019520690200_b15","doi-asserted-by":"crossref","unstructured":"Donaldson, L.J. (1996), \u201cFrom black bag to black box: will computers improve the NHS\u201d, BMJ, Vol. 312, pp. 1371\u20102.","DOI":"10.1136\/bmj.312.7043.1371a"},{"key":"key2022021019520690200_b16","unstructured":"EPR and ICWS Evaluation (1996), 1st Interim Report, NHS Executive Report, Leeds, February."},{"key":"key2022021019520690200_b17","unstructured":"Heathfield, H.A. et al. (1996), \u201cEvaluating EPR and CWS \u2013 integrating technical and organisational factors\u201d, Health Care Computing 96, BJHC Limited, Weybridge."},{"key":"key2022021019520690200_b18","unstructured":"HISS Evaluation Programme (1996), First Report of PROBE Reviews and Other Focused Studies, NHSE(IMG), Leeds, March."},{"key":"key2022021019520690200_b19","unstructured":"Kaplan, B. (1995), \u201cA model comprehensive evaluation plan for complex information systems: Clinical imaging systems as an example\u201d, Conference Proceedings, Information Technology Conference 1995, Henley Management College, Henley on Thames."},{"key":"key2022021019520690200_b20","doi-asserted-by":"crossref","unstructured":"Locke, C. (1996), \u201cWhat value do computers provide to NHS hospitals\u2019, BMJ, 312, pp. 1407\u201010.","DOI":"10.1136\/bmj.312.7043.1407a"},{"key":"key2022021019520690200_b21","unstructured":"Lorenzi, N.M. (1996), Integrated Academic Information Management System, To Manage the Knowledge of Medicine More Effectively, University of Cincinnati Medical Center Report, Cincinnati, OH."},{"key":"key2022021019520690200_b22","unstructured":"NHS Executive (1994a), Electronic Patient Record Initiation Document, NHSE, Leeds."},{"key":"key2022021019520690200_b23","unstructured":"NHS Executive (1994b), Integrated Clinical Workstation Initiation Document, NHSE, Leeds."},{"key":"key2022021019520690200_b24","doi-asserted-by":"crossref","unstructured":"Nygren, E. and Henriksson, P. (1992), \u201cReading the medical record. I\u201d, Computer Methods and Programs in Biomedicine, Vol. 39, pp. 1\u201012.","DOI":"10.1016\/0169-2607(92)90053-A"},{"key":"key2022021019520690200_b25","doi-asserted-by":"crossref","unstructured":"Pope, C. and Mays, N. (1995), \u201cReaching the parts other methods cannot reach: an introduction to qualitative methods in health and health services research\u201d, BMJ, Vol. 311, pp. 42\u20105.","DOI":"10.1136\/bmj.311.6996.42"},{"key":"key2022021019520690200_b26","unstructured":"Protti, D.J. and Haskell, A.R. (1992), \u201cManaging information in hospitals: 60 per cent social, 40 per cent technical\u201d, in: Ehlers, C. Bakker, A. Bryant, J.Hammond, W. (Eds), Proceedings of IMIA Working Conference on Trends in Hospital Information Systems, North Holland Publishings, Amsterdam, April 1992."},{"key":"key2022021019520690200_b27","doi-asserted-by":"crossref","unstructured":"Pryor, T.A. et al. (1983), \u201cThe HELP system\u201d, Journal of Medical Systems, Vol. 7, p. 87.","DOI":"10.1007\/BF00995116"},{"key":"key2022021019520690200_b28","doi-asserted-by":"crossref","unstructured":"Rotman, B.L., Sullivan, A.N., McDonald, T.W. et al. (1996, \u201cA randomised controlled trial of a computer\u2010based physician workstation in an outpatient setting: Implementation barriers to overcome evaluation\u201d, JAMIA, Vol. 3, pp. 340\u20108.","DOI":"10.1136\/jamia.1996.97035025"},{"key":"key2022021019520690200_b29","unstructured":"Weed, D. (1969), Medical Records, Medical Education and Patient Care, The Press of Case Western Reserve University, Cleveland, OH."},{"key":"key2022021019520690200_b30","unstructured":"Welsh Office (1993), Evaluation of the Clwyd Resource Management Project, Third Report, NHS Cymru Wales."},{"key":"key2022021019520690200_b31","unstructured":"Welsh Office (1996), Project Clwyd \u2013 Five years on. Clinicians in Management, Information Systems and Benefits, NHS Cymru Wales."},{"key":"key2022021019520690200_b32","doi-asserted-by":"crossref","unstructured":"Wyatt, J. and Spiegelhalter, D. (1990), \u201cEvaluating medical expert systems: what to test and how?\u201d, Meth Inform, Vol. 15, pp. 205\u201017.","DOI":"10.3109\/14639239009025268"},{"key":"key2022021019520690200_b33","doi-asserted-by":"crossref","unstructured":"van der Lei, J., Duisterhour J.S., Westerhof, H.P., van der Does, E., Cromme, P.V.M., Boon, W.M. and van Bemmel, J.H. (1993), \u201cThe introduction of computer\u2010based patient records in the Netherlands\u201d, Ann Intern Med, Vol. 19, pp. 1036\u201041.","DOI":"10.7326\/0003-4819-119-10-199311150-00011"},{"key":"key2022021019520690200_b34","unstructured":"Van der Loo, J. (1995), \u201cOverview of published assessment and evaluation studies (1995)\u201d, in von Gennip, E.M.S.J. and Talmon, J.L. (Eds), Assessment and Evaluation of Information Technologies, IOS Press, Amsterdam."},{"key":"key2022021019520690200_b35","unstructured":"Von Gennip, E. Talmon, J.L. (Eds) (1995), Assessment and Evaluation of Information Technologies in Medicine, IOS Press, Amsterdam."}],"container-title":["Information Technology &amp; People"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.emeraldinsight.com\/doi\/full-xml\/10.1108\/09593849910278277","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/09593849910278277\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/09593849910278277\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,25]],"date-time":"2025-07-25T00:37:31Z","timestamp":1753403851000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/itp\/article\/12\/3\/253-275\/174752"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[1999,9,1]]},"references-count":35,"journal-issue":{"issue":"3","published-print":{"date-parts":[[1999,9,1]]}},"alternative-id":["10.1108\/09593849910278277"],"URL":"https:\/\/doi.org\/10.1108\/09593849910278277","relation":{},"ISSN":["0959-3845"],"issn-type":[{"type":"print","value":"0959-3845"}],"subject":[],"published":{"date-parts":[[1999,9,1]]}}}