A critical approach to evaluation

European Journal of Information Systems

Volumn 14, Issue 3, 2005, Pages 229-243

  Klecun, Ela ^a   Cornford, Tony ^a  

^a LONDON SCHOOL OF ECONOMICS   (United Kingdom)

Author keywords

Critical theory; Evaluation; Health information systems

Indexed keywords

EID: 30744462352     PISSN: 0960085X     EISSN: 14769344     Source Type: Journal    
DOI: 10.1057/palgrave.ejis.3000540     Document Type: Article

References (90)

1. ABDULRASUL S (2001) An evaluation of the use of the NHSnet in GP surgeries in terms of user satisfaction. Department of Information Systems and Computing. Brunel University, London.
2. ALVESSON M and WILLMOTT H (Eds) (1992) Critical Management Studies. Sage Publications, London.
3. AMMENWERTH E, GRABER S, HERRMANN G, BURKLE T and KONIG J (2003) Evaluation of health information systems - problems and challenges. International Journal of Medical Informatics 71, 125-135.
4. ANDERSON JD and AYDIN CE (1994) Overview: Theoretical perspectives and methodologies for the evaluation of health care information systems. In Evaluaing Health Care Information Systems (ANDERSON JD, AYDIN CE and JAY JS, Eds), pp 5-29, Sage Publications, Thousands Oaks, CA.
5. AVGEROU C (1995) Evaluating information systems by consultation and negotiation. International Journal of Information Management 15(6), 427-436.
6. BANNISTER F (1999) What did we pay for it? The awkward problem of IT costs. In Sixth European Conference on Information Technology Evaluation (Brown A and Remenyi D, Eds), pp 55-64, Uxbridge, London.
7. BANTA D (2001) The management of health technology from a national perspective. International Journal of Healthcare Technology and Management 3(2/3/4), 177-190.
8. BERG M (1999) Patient care information systems and health care work: a sociotechnical approach. International Journal of Medical Informatics 55, 87-101.
9. BIJKER WE (1997) Of Bicycles, Bakelites, and Bulbs: Toward a Theory of Sociotechnical Change. MIT Press, Cambridge, MA.
10. BLOOMFIELD BP and BEST A (1992) Management consultants: systems development, power and the translation of problems. Sociological Review 40, 533-560.
11. BOWLING A (1997) Research Methods in Health: Investigating Health and Health Services. Open University Press, Buckingham.
12. BRYANS P, WILLIAMSON B, STALKER B and GORMLEY N (1999) Evaluation as learning and dialogue: towards an open model of evaluation. In Critical Management Studies Conference. Manchester.
13. BURRELL G and MORGAN G (1985) Sociological Paradigms and Organizational Analysis: Elements of the Sociology of Corporate Life. Gower, Aldershot.
14. CORNFORD T, DOUKIDIS GI and FORSTER D (1994) Experience with structure, process and outcome framework for evaluating an information system. Omega International Journal of Management Science 22(5), 491-504.
15. CORNFORD T and KLECUN-DABROWSKA E (2001) Ethical perspectives in evaluation of telehealth. Cambridge Quarterly of Healthcare Ethics (Special Issue on New Information Technologies in Healthcare) 10(2), 161-169.
16. CRIBB A and BARBER N (1997) Prescribes, patients and policy: towards the limits of technique. Health Care Analysis 5(4), 292-298.
17. DABROWSKA E (1999) The evaluation of the deployment of Intranet facilities within primary care. In Second Oxford Clinical Intranet and Internet Conference. Oxford.
18. DAVIS GB, LEE AS, NICKLES KR, CHATERJEE S, HARTUNG R and WU Y (1992) Diagnosis of an information system failure: a framework and interpretive process. Information Management 23(5), 293-318.
19. DELONE WH and MCLEAN ER (1992) Information systems success: the quest for the dependent variable. Information Systems Research 3(1), 60-95.
20. DENZIN NK and LINCOLN YS (Eds) (1994) The Handbook of Qualitative Research. Sage Publications, London.
21. DOH (1997) The New NHS: Modern.Dependable. HMSO, London.
22. DOH (2002) Delivering the 21st Century IT Support for the NHS: National Strategic Programme. HMSO, London.
23. DONABEDIAN A (1966) Evaluating the quality of medical care. Milbank Medical Fund Quarterly 44, 166.
24. DONABEDIAN A (1978) The quality of medical care - methods for assessing and monitoring the quality of care for research and for quality assurance programs. Science 200, 856-864.
25. DOOLIN B (1998) Information technology as disciplinary technology: being critical in interpretive research on information systems, Journal of Information Technology 13, 301-311.
26. FARBEY B, LAND F and TARGETT D (1999) The moving staircase: problems of appraisal and evaluation in a turbulent environment. Information Technology & People 12(3), 238-252.
27. FARBEY B, LAND F and TARGETT D (1995) A taxonomy of information systems applications: the benefits' evaluation ladder. European Journal of Information Systems 4, 41-50.
28. FARBEY B, TARGETT D and LAND F (1993) How to Evaluate IT Investment: A Study of Methods and Practices. Butterworth Heinemann, Oxford.
29. FEENBERG A (1991) Critical Theory of Technology. Oxford University Press, New York.
30. FIELD MJ (Ed) (1996) Telemedicine: A Guide to Assessing Telecommunications in Health Care Institute of Medicine National Academy Press, Washington, D.C.
31. FRIEDMAN CP and WYATT JC (1996) Evaluation Methods in Medical Informatics. Springer-Verlag, New York.
32. GADAMER H-G (1976) Philosophical Hermeneutics. University of California Press, Berkeley.
33. GINZBERG MJ (1978) Finding an adequate measure of OR/MS effectiveness, Interfaces 8(4), 59-62.
34. HABERMAS J (1979) Communication and the Evolution of Society. Beacon Press, Boston.
35. HABERMAS J (1987) The Theory of Communicative Action - The Critique of Functionalist Reason. Beacon Press, Boston, MA.
36. HEATHFIELD H, HUDSON P, KAY S, MACKAY L, MARLEY T, NICHOLSON L, PEEL V, ROBERTS R and WILLIAMS J (1999) Issues in the multi-disciplinary assessment of healthcare information systems. Information Technology & People 12(3), 253-275.
37. HEATHFIELD H, PITTY D and HANKA R (1998) Evaluating information technology in health care: barriers and challenges. British Medical Journal 316, 1959-1961.
38. HILLIER S (1987) Rationalism, bureaucracy, and the organization of the health services: Max Weber's contribution to understanding modern health care systems. In Sociological Theory and Medical Sociology (Scambler G, Ed), pp 194-220, Tavistock, London.
39. HORKHEIMER M (1972) Traditional and Critical Theory. In Critical Theory: Selected Essays (Matthew J. O'Connell et al. Transls), pp 188-243, Herder and Herder, New York.
40. HORKHEIMER M and ADORNO TW (1972 [1944]) Dialectic of Enlightenment. Herder, New York.
41. HOWCROFT D and MITEV N (2000) An empirical study of internet usage and difficulties amongst medical practice management in the UK. Internet Research 10(2), 170-181.
42. IMG (1996) Project review: objective evaluation - guidance for NHS managers on evaluating information systems projects. Information Management Group, NHS Executive Volume 2000, host accessed 22/05/2000. host updated 13/07/1998. http://www.doh.gov.uk/nhsexipu/resource/itinvest/pdfword/probe.pdf.
43. INTRONA LD (1997) Management, Information and Power: A Narrative of the Involved Manager. Macmillan, Basingstoke.
44. INTRONA LD and WHITTAKER L (2002) The phenomenology of information systems evaluation: Overcoming the subject/object dualism. In Global and Organizational Discourse about Information Technology (WYNN EH, WHITLEY EA, MYERS MD and DEGROSS Jl, Eds), pp 155-175, Kluwer Academic Publishers, Boston.
45. IVES B, OLSON MH and BAROUDI JJ (1983) The measurement of user information satisfaction. Communication of the ACM 26(10), 785-793.
46. JONES S and HUCHES J (2001) Understanding IS evaluation as a complex social process: a case study of a UK local authority. European Journal of Information Systems 10(4), 189-203.
47. KAPLAN B (1997) Addressing the organisational issues into the evaluation of medical systems, Journal of the American Medical Informatics Association 4(2), 94-101.
48. KAPLAN B (1998) Social interactionist framework for information systems studies; the 4Cs. In IFIP WG8.2 St WG8.6 Joint Working Conference on Information Systems: Current Issues and Future Changes, pp 327-340, Helsinki.
49. KAPLAN B (2001 a) Evaluating informatics applications - clinical decision support systems literature review. International Journal of Medical Informatics 64, 15-37.
50. KAPLAN B (2001 b) Evaluating informatics applications - some alternative approaches: theory, social interactionism, and call for methodological pluralism. International Journal of Medical Informatics 64, 39-56.
51. KAPLAN B and SHAW NT (2004) Future directions in evaluation research: people, organizational, and social issues. Methods of Information in Medicine 43(3), 215-231.
52. KAPLAN R and NORTON D (1992) The balanced score card: measures that drive performance. Harvard Business Review 70(1), 71-79.
53. KLECUN E and CORNFORD T (2003) An interpretative evaluation of a health care intranet. International Journal of Healthcare Technology and Management 5(6), 407-421.
54. KLECUN-DABROWSKA E and CORNFORD T (2000) Telehealth acquires meanings: information and communication technologies within health policy. Information Systems Journal 10(1), 41-63.
55. KLING R (1996) Beyond outlaws, hackers, and pirates: ethical issues in the work of information and computer science professionals. In Computerization and Controversy: Value Conflicts and Social Choices (Kling R, Ed), Academic Press, San Diego.
56. LAND F (2000) Evaluation in a socio-technical context. In Organizational and Social Perspectives on Information Technology (BAKERVILLE R, STAGE J and DEGROSS JI, Eds), pp 115-126, Kluwer Academic Publishers, Boston.
57. LAU F, DOZE S, VINCENT D, WILSON D, NOSEWORTHY T, HAYWARD R and PENN A (1999) Patterns of improvisation for evidence-based practices in clinical settings. Information, Technology & People 12(3), 287-303.
58. LITTLEJOHNS P, WYATT J and CARVICAN L (2003) Evaluating computerised health information systems: hard lessons still to be learned. British Medical Journal 326, 860-863.
59. LOBLEY D (1997) The economics of telemedicine. Journal of Telemedicine and Telecare 3, 117-125.
60. MACKENZIE D and WAJCMAN J (Eds) (1985) The Social Shaping of Technology: How the Refrigerator Got Its Hum. Open University Press, Milton Keynes.
61. MARCUSE H (1970) One-Dimensional Man. Sphere Books Ltd, London.
62. MAY C and ELUS NT (2001) When protocols fail: technical evaluation, biomedical knowledge, and a social production of 'facts' about a telemedicine clinic. Social Science & Medicine 53, 989-1002.
63. MAY C, MORT M, WILLIAMS T, MAIR F and GASK L (2003) Health technology assessment in its local contexts: studies of telehealthcare. Social Science & Medicine 57, 697-710.
64. MCAULAY L, DOHERTY N and KEVAL N (2002) The stakeholder dimension in information systems evaluation. Journal of Information Technology 17(4), 241-255.
65. MILLER J (1993) Measuring and aligning information systems with the organization. Information and Management 25(4), 217-228.
66. MINGERS J (2000) The contribution of critical realism as an underpinning philosophy for OR/MS and systems, Journal of Operational Research 51(11), 1256-1270.
67. MORROW RD and BROWN DD (1994) Critical Theory and Methodology. Sage Publications, London.
68. MUMFORD E (1983) Designing Human Systems for New Technology: The ETHICS Method. Manchester Business School, Manchester.
69. O'DONNELL D and HENRIKSEN LB (2002) Philosophical foundations for a critical evaluation of the social impact of ICT. Journal of Information Technology 17, 89-99.
70. O'KEEFE RM (1989) The evaluation of decision-aiding systems: guidelines and methods. Information and Management 17(4), 217-226.
71. ORLIKOWSKI WJ (2000) Using technology and constituting structures: a practice lens for studying technology in organizations. Organization Science 11(4), 404-428.
72. ORLIKOWSKI WJ and HOFMAN JD (1997) An improvisational model for change management: the case of groupware technologies. Sloan Management Review 38(2), 11-21.
73. POWELL P (1992) Information technology evaluation: is it different? Journal of Operational Research Society 43(1), 29-42.
74. REMENYI DSJ and MONEY A (1991) A user-satisfaction approach to IS effectiveness measurement, Journal of Information Technology 6, 162-175.
75. SMITHSON S and HIRSCHHEIM RA (1998) Analysing information systems evaluation: another look at an old problem. European Journal of Information Systems 7(3), 155-174.
76. SOUTHON G (1999) IT, change and evaluation: an overview of the role of evaluation in health services. International Journal of Medical Informatics 56, 125-133.
77. SRINIVASAN A (1985) Alternative measures of system effectiveness: associations and implications. MIS Quarterly September, pp 243-253.
78. STOOP AP and BERG M (2003) Integrating quantitative and qualitative methods in patient care information system evaluation. Methods of Information In Medicine 42(4), 458-462.
79. SYMONS VJ (1991) A review of information systems evaluation: content, context and process. European Journal of Information Systems 1 (3), 205-212.
80. TALMON J, ENNING J, CASTANEDA G, EURLINCS F, HOYER D, NYKANEN P, SANZ F, THAYER C and VISSERS M (1999) The VATAM guidelines. International Journal of Medical Informatics 56, 107-155.
81. TAYLOR P (1999) Evaluating telemedicine systems and services. In Introduction to Telemedicine (CRAIG J and WOOTTON R, Eds), pp 105-120, Royal Society of Medicine Press, London.
82. VAN GENNIP EMSJ and LORENZI NM (1999) Results of discussions at the IMIA WG 13 and 15 working conference. International Journal of Medical Informatics 56, 177-180.
83. WALLACE S (1998) Telemedicine in the NHS for the millennium and beyond. In Rethinking IT and Health (LENACHAN J, Ed), pp 55-99, Institute for Public Policy Research, London.
84. WALSHAM G (1993) Interpreting Information Systems in Organizations. Wiley, Chichester, England.
85. WILLCOCKS L and LESTER S (1999) Information technology: transformer or sink hole. In Beyond the IT Productivity Paradox (WILLCOCKS L and LESTER S, Eds), Chichester, Wiley.
86. WILLIAMS R and EDGE D (1996) The social shaping of technology. In Information and Communication Technologies: Visions and Realities (DUTTON WH and PELTU M, Eds), Oxford University Press, Oxford (England) New York.
87. WILSON M and HOWCROFT D (2000) Power, politics and persuasion: a social shaping perspective on IS evaluation. In 23rd IRIS Conference (SVENSSON L, SNIS U, SORENSEN C, FACERLIND H, LlNDROTH T, MACNUSSON M and OSTLUND C, Eds), pp 725-739.
88. WINNER L (1977) Autonomous Technology: Technics-out-of-Control as a Theme in Political Thought. MIT Press, Cambridge, MA; London.
89. WOOLGAR S (1996) Technologies as cultural artefacts. In Information and Communication Technologies: Visions and Realities (DUTTON WH and PELTU M, Eds), Oxford University Press, Oxford.
90. WYATT JC and WYATT SM (2003) When and how to evaluate health information systems? International Journal of Medical Informatics 69, 251-259.