Analysing information systems evaluation: Another look at an old problem

European Journal of Information Systems

Volumn 7, Issue 3, 1998, Pages 158-174

  Smithson, S ^a   Hirschheim, R ^b  

^a LONDON SCHOOL OF ECONOMICS   (United Kingdom)

^b UNIVERSITY OF HOUSTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 22444452011     PISSN: 0960085X     EISSN: 14769344     Source Type: Journal    
DOI: 10.1057/palgrave.ejis.3000304     Document Type: Article

References (119)

1. Agarwal R, Tanniru MR and Dacruz M (1992) Knowledge-based support for combining qualitative and quantitative judgements. Jour¬nal of Management Information Systems 9(1), 165-184.
2. Angell IO and Smithson S (1991) Information Systems Manage¬ment: Opportunities and Risks. Macmillan, Basingstoke.
3. Applegate LM (1994) Managing in an information age: Transforming the organization for the 1990s. In Transforming Organizations with Information Technology. (Baskerville R, Smithson S, Ngweny- amaand DeGross JI, Eds), North Holland, Amsterdam.
4. Apte U (1990) Global outsourcing of information systems and Pro¬cessing services. The Information Society 7, 287-303.
5. Ashby WR (1956) An Introduction to Cybernetics. Methuen, London.
6. Ballantine J, Galliers R and Stray S (1994) Information systems/technology investment decisions: The use of capital invest¬ment appraisal techniques in organizations. In Proc. of First Euro¬pean Conference on Information Technology Investment Evaluation (Brown A and Remenyi D, Eds), Henley on Thames, UK, 13¬14 September.
7. Baskerville R (1991) Risk analysis: An interpretive feasibility tool in justifying information systems security. European Journal of Information Systems 1(2), 121-130.
8. Belcher LW and Watson HJ (1993) Assessing the value of Conoco’s EIS. MIS Quarterly 17(3), 239-253.
9. Bendell A, Boulter L and Kelly J (1993) Benchmarking for Com- petitive Advantage. Pitman, London.
10. Bennett JL (1984) Managing to meet usability requirements. In Vis¬ual Display Terminals: Usability Issues and Health Concerns (Bennett JL, Case D, Sandelin J and Smith M, Eds), Prentice- Hall, Englewood Cliffs, NJ.
11. Best E (1994) Capitalism in Competition: A Global Driving Force in the Twenty-First Century. Vol. 5. Global Business Networks, Emeryville, CA.
12. Blackler F and Brown C (1988) Theory and practice in evaluation: The case of the new information technologies. In Information Sys¬tems Assessment: Issues and Challenges (Bjorn-Andersen N and Davis GB, Eds), North Holland, Amsterdam
13. Boddy D and Buchanan DA (1984) Information technology and pro- ductivity: Myths and realities. Omega 12(3), 233-240.
14. Boehm BW (1988) A spiral model of software development and enhancement. IEEE Computer May, 61-72.
15. Brown A (1994) Appraising intangible benefits from information technology investment. In Proceedings of the First European Con¬ference on IT Investment Evaluation Henley on Thames, UK, 13¬14 September.
16. Brynjolfsson E (1993) The productivity paradox of information tech¬nology. Communications of the ACM 36(12), 67-77.
17. Brynjolfsson E and Hitt L (1996) Paradox lost? Evidence on the returns to information systems spending. Management Science 42(4), 541-558.
18. Bullard KM (1994) The contribution of benchmarking to the prob¬lem of assessing the value of information technology. In Proceed- ings of the First European Conference on IT Investment Evaluation, Henley on Thames, UK, 13-14 September.
19. Canevet S and Smithson S (1994) A Survey of Evaluation Practice in the UK. Working Paper, Information Systems Department, Lon¬don School of Economics.
20. Clemons E (1991) Evaluation of strategic investments in information technology. Communications of the ACM 34(1) 22-36.
21. Coleman T and Jamieson M (1994) Beyond return on investment: The case of the new information technologies. In Information Management: The Evaluation of Information Systems (Willcocks L, Ed), pp 189-205.
22. Conrath D and DuRoare G (1978) Organisational implications of comprehensive communication information systems—Some conjec- tures. Working Paper, Institute D’administration Des Enterprises, Centre d’Etude et de Recherche Sur les Organisations et la Gestion, Aix-en-Provence.
23. Currie WL (1989) The art of justifying new technology to top man¬agement. Omega 17(5), 409-418.
24. Davenport TH (1993) Process Innovation: Reengineering Work Through Information Technology. Harvard Business School Press, Cambridge, MA.
25. Davenport TH and Short JE (1990) The new industrial engineering: Information technology and business process redesign. Sloan Man¬agement Review Summer, 11-27.
26. Davenport TH, Eccles RG and Prusak L (1992) Information poli- tics. Sloan Management Review 34(1), 53-65.
27. DeLone WH and McLean ER (1992) Information systems success: The quest for the dependent variable. Information Systems Research 3(1), 60-95.
28. Dickson GW, Weels CE and Wilkers RB (1988) Toward a derived set of measures for assessing IS organizations. In Information Sys¬tems Assessment: Issues and Challenges (Bjorn-Andersen N and Davis GB, Eds), North Holland, Amsterdam, 129-147.
29. Doll WJ and Torkzadeh G (1988) The measurement of end user computing satisfaction. MIS Quarterly 12(2), 259-273.
30. Dos Santos BL (1994) Assessing the value of strategic information technology investments. In Information Management: The Evalu¬ation of Information Systems Investment (Willcocks L, Ed), pp 133-148, Chapman and Hall, London.
31. Drucker P (1971) Entrepreneurship in Business Enterprise. Journal of Business Policy 1 .
32. Earl M (1992) Putting IT in its place: A polemic for the nineties. Journal of Information Technology 7, 100-108.
33. Etzerodt P and Madsen KH (1988) Information systems assessment as a learning process. In Information Systems Assessment: Issues and Challenges (Bjorn-Andersen N and Davis GB, Eds), pp 333-345. North Holland, Amsterdam.
34. Fagan M (1976) Design and code inspections to reduce errors in pro¬gram development. IBM Systems Journal 15(3), 182-211.
35. Farbey B, Land F and Targett D (1993) How to Assess Your IT Investment: A Study of Methods and Practice. Butterworth Heinem¬ann, Oxford.
36. Finkelstein C (1989) An Introduction to Information Engineering: From Strategic Planning to Information System. Addison Wesley, Reading, MA.
37. Galletta DF and Lederer AL (1989) Some cautions on the measurement of user information satisfaction. Decision Sciences 20(3), 419-438.
38. Gilb T (1988) Principles of Software Engineering Management. Addison Wesley.
39. Gilbert DR et al (1988) A Logic for Strategy. Ballinger Publishing Co, Cambridge, Ma.
40. Goddard A (1989) Are three ’E’s enough: Assessing value for money in the public sector. OR Insight 2(3), 16-19.
41. Goldkuhl G and Lyytinen K (1982) A language action view of information systems. In Proceedings of the 3rd International Con¬ference on Information Systems (Ginzberg M and Ross C, Eds), Ann Arbor, MI, 13-30.
42. Gould JD and Lewis C (1985) Designing for usability: Key principles and what designers think. Communications of the ACM 28(3), 300-311.
43. Grady RB (1993) Practical results from measuring software quality. Communications of the ACM 36(11), 62-68.
44. Green C (1993) Strategic Choice and Institutional Isomorphism in the Diffusion of Innovations: An Investigation of EDI Adoption Rationale. PhD dissertation, College of Business Administration, University of Houston.
45. Gregory AJ and Jackson MC (1992) Evaluation methodologies: A system for use. Journal of the Operational Research Society 43(1), 19-28.
46. Grindley K (1991) Managing IT at Board Level: The Hidden Agenda Exposed. Pitman, London.
47. Hammer M (1990) Reengineering work: Don’t automate, obliterate. Harvard Business Review July-August, 104-112.
48. Handy C (1989) The Age of Unreason. Harvard Business School Press, Boston.
49. Hawgood J and Land F (1988) A multivalent approach to information systems assessment. In Information Systems Assessment: Issues and Challenges (Bjorn-Andersen N and Davis GB, Eds), pp 103-124, North Holland, Amsterdam.
50. Hirschheim R and Smithson S (1988) A critical analysis of infor¬mation systems evaluation. In Information Systems Assessment: Issues and Challenges (Bjorn-Andersen N and Davis GB, Eds), pp 17-37, North Holland, Amsterdam.
51. Hochstrasser B (1990) Evaluating IT investments: Matching tech- niques to projects. Journal of Information Technology 5(4), 215-221.
52. Hochstrasser B and Griffiths C (1991) Controlling IT Investments: Strategy and Management. Chapman and Hall.
53. Huber R (1993) How Continental Bank outsourced its crown jewels. Harvard Business Review 71(1), 121-129.
54. Ives B, Olson MH and Baroudi JJ (1983) The measurement of user information satisfaction. Communications of the ACM 26(10), 785-793.
55. Ives B and Learmonth GP (1984) The information system as a com- petitive weapon. Communications of the ACM 27(12), 1193-1201.
56. Kambil A, Henderson J and Mohsenzadeh H (1993) Strategic man¬agement of information technology investments: An options per¬spective. In Strategic Information Technology Management: Per¬spectives on Organizational Growth and Competitive Advantage. (Banker RD, Kauffman RJ and Mahmood Ma, Eds), pp 161-178, Idea Group Pub., Harrisburg, PA.
57. Kleinschrod WA (1986) Critical Issues in Office Automation. McGraw Hill.
58. Knight JC and Myers EA (1993) An improved inspection technique. Communications of the ACM 36(11), 50-61.
59. Kumar K (1990) Post-implementation evaluation of computer-based information systems: Current practices. Communications of the ACM 33(2), 203-212.
60. Kumar RL (1996) A note on project risk and option values of invest¬ments in information technology. Journal of Management Infor¬mation Systems 13(1), 187-193.
61. Lacity M and Hirschheim R (1993) Information Systems Outsourc- ing: Myths, Metaphors and Realities. John Wiley and Sons, Chiches- ter.
62. Lacity M and Hirschheim R (1997) Information systems outsourcing: What problems are we really trying to solve? In Re-Thinking Man¬agement Information Systems (Galliers R and Currie W, Eds), John Wiley and Sons, Chichester.
63. Land F (1976) Evaluation of systems goals in determining a design strategy for a computer-based information system. Computer Jour¬nal 19(4), 290-294.
64. Land F and Hirschheim R (1983) Participative systems design: Rationale, tools and techniques. Journal of Applied Systems Analysis 10, 91-107.
65. Landauer (1995) The Trouble with Computers: Usefulness, Usability and Productivity. MIT Press, Cambridge, MA.
66. Lederer AL and Prasad J (1993) Information systems software cost estimating: A current assessment. Journal of Information Tech¬nology 8(1), 22-33.
67. Lederer AL et al (1990) Information system cost estimating: A man¬agement perspective. MIS Quarterly 14(2), 159-176.
68. Lee GG and Gough T (1993) An integrated framework for infor¬mation systems planning and its final application. Journal of Infor¬mation Technology 8(4), 227-240.
69. Lincoln T (1988) Retrospective appraisal of information technology using SESAME. In Information Systems Assessment: Issues and Challenges (Bjorn-Andersen N and Davis GB, Eds), North Hol¬land, Amsterdam.
70. Lincoln T (1990) Managing Information Systems for Profit. John Wiley and Sons, Chichester.
71. Loveman G (1994) An assessment of the productivity impact of infor¬mation technologies. In Information Technology and the Corpor¬ation of the 1990s (Allen TJ and Scott Morton MS, Eds), Oxford University Press.
72. Lyytinen K, Klein H and Hirschheim R (1991) The effectiveness of office information systems: A social action perspective. Journal of Information Systems 1(1), 41-60.
73. McFarlan FW (1984) Information technology changes the way you compete. Harvard Business Review July-August, 98-103.
74. Markus ML (1983) Power, politics and MIS implementation. Com¬munications of the ACM 26(6), 430-444.
75. Mason RO and Swanson EB (1981) Measurement for Management Decision. Addison Wesley, Reading, MA.
76. Melone NP (1990) A theoretical assessment of the user satisfaction construct in information systems research. Management Science 36(1), 76-91.
77. Mills HD, Dyer M and Linger R (1987) Cleanroom software engin¬eering. IEEE Software September, 19-24.
78. Morrow M (Ed) (1992) Activity Based Management: New Approaches to Measuring Performance and Managing Costs. Woodhead-Faulkner, New York.
79. Mukhopadhyay T, Kekre S and Kalathur S (1995) Business value of information technology: A study of electronic data interchange. MIS Quarterly 19(2), 137-156.
80. Oakland JS (1989) Total Quality Management. Heinemann, Oxford.
81. Panko RR (1991) Is office productivity stagnant? MIS Quarterly 15(2), 190-203.
82. Parasuraman A, Zeithini VA and Berry LL (1985) A conceptual model of service quality and its implications for future research. Journal ofMarketing Fall, 41-50.
83. Parker MM, Benson RJ and Trainor HE (1988) Information Eco¬nomics: Linking Business Performance to Information Technology. Prentice Hall, Englewood Cliffs, NJ.
84. Peters G (1990) Beyond strategy: Benefits identification and manage¬ment of specific IT investments. Journal of Information Technology 5(4), 205-214.
85. Pettigrew AM (1985) The Awakening Giant: Continuity and Change in ICI. Blackwell, Oxford.
86. Pitt LF, Watson RT and Kaven CB (1995) Service quality: A meas- ure of information systems effectiveness. MIS Quarterly 19(2), 173-187.
87. Poore HH, Mills HD and Mutchler D (1993) Planning and certify- ing software system reliability. IEEE Software January, 88-99.
88. Porter ME and Millar VE (1985) How information gives you com- petitive advantage. Harvard Business Review July-August, 149-160.
89. Powell P (1992a) Information technology evaluation: Is it different? Journal of the Operational Research Society 43(1), 29-42.
90. Powell P (1992b) Information technology and business strategy: A synthesis of the case for reverse causality. In 13th International Con¬ference on Information Systems, Dallas, Texas, December.
91. Prahalad CK and Hamel G (1990) The core competence of the cor¬poration. Harvard Business Review 68(3), 79-93.
92. Price Waterhouse (1990) Information Technology Review 1990/91. Price Waterhouse, London.
93. Price Waterhouse (1994) Information Technology Review 1993/94. Price Waterhouse, London.
94. Roach SS (1991) Services under siege: The restructuring imperative. Harvard Business Review September-October, 82-92.
95. Reekers N and Smithson S (1996) The role of EDI in interorganiza- tional coordination in the European automotive industry. European Journal of Information Systems 5(2), 120-130.
96. Rossi PH and Williams W (Eds) (1972) Evaluating Social Programs: Theory, Practice and Politics. Seminar Press, New York.
97. Santhanam R and Schniederjans MJ (1993) A model formulation system for information systems project selection. Computers and Operational Research 20(7), 679-690.
98. Sassone PG (1988) A survey of cost-benefit methodologies for infor¬mation systems. Project Appraisal 3(2), 73-84.
99. Sassone PG and Schwartz AP (1986) Cost-justifying OA; A straightforward method for quantifying the benefits of automated office systems. Datamation 32(4), 83-88.
100. Schäfer G (1988) Benefit analysis of office system: Concepts for a method. In Information Systems Assessment: Issues and Challenges (Bjorn-Andersen N and Davis GB, Eds), North Holland, Amsterd¬am.
101. Schafer G et al (1988) Functional Analysis of Office Requirements: A Multiperspective Approach. Wiley, Chichester.
102. Scott Morton M (1991) The Corporation of the 1990s: Information Technology and Organizational Transformation, Oxford University Press, New York.
103. Serafeimidis V and Smithson S (1994) Evaluation of IS/IT invest¬ments: Understanding and support. In Proceedings of the First Euro¬pean Conference on Information Technology Investment Evaluation. (Brown A and Remenyi D, Eds), Henley on Thames, UK, 13-14 September.
104. Shackel B (1990) Human factors and usability. In Human-Computer Interaction (Preece, J and Keller L, Eds), Prentice-Hall, Hemel Hempstead.
105. Sivula C (1990) The white-collar productivity push. Datamation, 15 January, 52-56.
106. Strassman P (1990) The Business Value of Computers. Information Economics Press, New Cannan, CN.
107. Swanson K et al (1991) The application software factory: Applying total quality techniques to systems development. MIS Quarterly 15(4), 567-579.
108. Symons VJ (1991) A review of information systems evaluation: Con¬tent, context and process. European Journal ofInformation Systems 1(3), 205-212.
109. Symons VJ and Walsham G (1991) The evaluation of information systems: A critique. In The Economics of Information Systems and Software, (Veryard R Ed), pp 71-88. Butterworth-Heinemann.
110. Tyldesley DA (1988) Employing usability engineering in the devel¬opment of office products. Computer Journal 31(5), 431-436.
111. Walsham G (1993) Interpreting Information Systems in Organizations. Wiley, Chichester, UK.
112. Ward JM (1990) A portfolio approach into evaluating evaluation sys¬tems investments and setting priorities. Journal of Information Tech¬nology 5(4), 222-231.
113. Ward J, Taylor P and Bond P (1996) Evaluation and realisation of IS/IT benefits: An empirical study of current practice. European Journal of Information Systems 4(4), 214-225.
114. Weill P (1992) The relationship between investment in information technology and firm performance: A study of the valve manufactur¬ing sector. Information Systems Research 3(4), 307-333.
115. Willcocks L (1994) Introduction: Of capital importance. In Infor¬mation Management: The Evaluation of Information Systems Invest¬ments (Willcocks L, Ed), pp 1-27. Chapman and Hall.
116. Willcocks L and Fitzgerald G (1994) A Business Guide to Out- sourcing Information Technology, Business Intelligence, London.
117. Willcocks L and Lester S (1993) Evaluating the Feasibility ofInfor- mation Technology Investment. Oxford Institute of Information Management, Research and Discussion Paper, RDP93/1.
118. Willcocks L and Margetts H (1994) Risk assessment and infor¬mation systems. European Journal of Information Systems 3(2), 127-138.
119. Zultner RA (1993) TQM for technical teams. Communications of the ACM 36(10), 78-91.