Measuring information systems success: Models, dimensions, measures, and interrelationships

European Journal of Information Systems

Volumn 17, Issue 3, 2008, Pages 236-263

  Petter, Stacie ^a   DeLone, William ^b   McLean, Ephraim ^c  

^a UNIVERSITY OF NEBRASKA AT OMAHA   (United States)

^b AMERICAN UNIVERSITY   (United States)

^c GEORGIA STATE UNIVERSITY   (United States)

Author keywords

Information systems success; IS effectiveness; IT performance; Literature review; Measurement; Organizational and individual use of IS

Indexed keywords

EID: 48849096944     PISSN: 0960085X     EISSN: 14769344     Source Type: Journal    
DOI: 10.1057/ejis.2008.15     Document Type: Article

References (139)

1. ABDUL-GADER AH (1997) Determinants of computer-mediated communication success among knowledge workers in Saudi Arabia. Journal of Computer Information Systems 38(1), 55-66.
2. ADAMS DA, NELSON RR and TODD PA (1992) Perceived usefulness, ease of use, and usage of information technology: a replication. MIS Quarterly 16(2), 227-247.
3. AGARWAL R and PRASAD J (1997) The role of innovation characteristics and perceived voluntariness in the acceptance of information technologies. Decision Sciences 28(3), 557-582.
4. AGARWAL R and PRASAD J (1999) Are individual differences germane to the acceptance of new information technologies?. Decision Sciences 30(2), 361-391.
5. ALADWANI AM (2002) Organizational actions, computer attitudes, and end-user satisfaction in public organizations: an empirical study. Journal of End User Computing 14(1), 42-49.
6. ALMUTAIRI H and SUBRAMANIAN GH (2005) An empirical application of the DeLone and McLean model in the Kuwaiti private sector. Journal of Computer Information Systems 45(3), 113-122.
7. ANG S and SOH C (1997) User information satisfaction, job satisfaction, and computer background: an exploratory study. Information & Management 32(5), 255-266.
8. AU N, NGAI EWT and CHENG TCE (2002) A critical review of end-user information system satisfaction research and a new research framework. Omega 30(6), 451-478.
9. BALLANTINE J, BONNER M, LEVY M, MARTIN AIM and POWELL PL (1996) The 3-D model of information systems success: the search for the dependent variable continues. Information Resources Management Journal 9(4), 5-14.
10. BAROUDI JJ and ORLIKOWSKI WJ (1988) A short-form measure of user information satisfaction: a psychometric evaluation and notes on use. Journal of Management Information Systems 4(4), 44-59.
11. BELCHER LW and WATSON HJ (1993) Assessing the value of Conoco's EIS. MIS Quarterly 17(3), 239-254.
12. BENARD R and SATIR A (1993) User satisfaction with EISs - meeting the needs of executive users. Information Systems Management 10(4), 21-29.
13. BHARATI P (2002) People and information matter: task support satisfaction from the other side. Journal of Computer Information Systems 43(2), 93-102.
14. BHARATI P and CHAUDHURY A (2006) Product customization on the web: an empirical study of factors impacting choiceboard user satisfaction. Information Resources Management Journal 19(2), 69-81.
15. BLANTON JE, WATSON HJ and MOODY J (1992) Toward a better understanding of information technology organization: a comparative case study. MIS Quarterly 16(4), 531-555.
16. BOKHARI RH (2005) The relationship between system usage and user satisfaction: a meta-analysis. The Journal of Enterprise Information Management 18(2), 211-234.
17. BRADLEY RV, PRIDMORE JL and BYRD TA (2006) Information systems success in the context of different corporate culture types: an empirical investigation. Journal of Management Information Systems 23(2), 267-294.
18. BRYNJOLFSSON E, HITT LM and YANG S (2002) Intangible assets: how computers and organizational structure affect stock market valuations. Brookings Papers on Economic Activity 1, 137.
19. BURTON-JONES A and GALLIVAN MJ (2007) Toward a deeper understanding of system usage in organizations: a multilevel perspective. MIS Quarterly 31(4), 657-680.
20. BURTON-JONES A and STRAUB D (2006) Reconceptualizing system usage: an approach and empirical test. Information Systems Research 17(3), 220-246.
21. CALDEIRA MM and WARD JM (2002) Understanding the successful adoption and use of IS/IT in SMEs: an explanation from Portuguese manufacturing industries. Information Systems Journal 12(2), 121-152.
22. CHAU PYK and HU PJ (2002) Examining a model of information technology acceptance by individual professionals: an exploratory study. Journal of Management Information Systems 18(4), 191-230.
23. CHIU CM, CHIU CS and CHANG HC (2007) Examining the integrated influence of fairness and quality on learners' satisfaction and Web-based learning continuance intention. Information Systems Journal 17(3), 271-287.
24. CHOE JM (1996) The relationships among performance of accounting information systems, influence factors, and evolution level of information systems. Journal of Management Information Systems 12(4), 215-239.
25. COLLOPY F (1996) Biases in retrospective self-reports on time use: an empirical study of computer users. Management Science 42(5), 758-767.
26. COMPEAU D, HIGGINS CA and HUFF S (1999) Social cognitive theory and individual reactions to computing technology: a longitudinal study. MIS Quarterly 23(2), 145-158.
27. COOMBS CR, DOHERTY NF and LOAN-CLARKE J (2001) The importance of user ownership and positive user attitudes in the successful adoption of community information systems. Journal of End User Computing 13(4), 5-16.
28. D'AMBRA J and RICE RE (2001) Emerging factors in user evaluation of the World Wide Web. Information & Management 38(6), 373-384.
29. DAVIS FD (1989) Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly 13(3), 318-346.
30. DELONE WH and MCLEAN ER (1992) Information systems success: the quest for the dependent variable. Information Systems Research 3(1), 60-95.
31. DELONE WH and MCLEAN ER (2002) Information systems success revisited. In Proceedings of the 35th Hawaii International Conference on System Sciences (SPRAGUE JR RH, Ed) p 238, IEEE Computer Society, Hawaii, US.
32. DELONE WH and MCLEAN ER (2003) The DeLone and McLean model of information systems success: a ten-year update. Journal of Management Information Systems 19(4), 9-30.
33. DELONE WH and MCLEAN ER (2004) Measuring e-commerce success: applying the DeLone & McLean information systems success model. International Journal of Electronic Commerce 9(1), 31-47.
34. DEVARAJ S, FAN M and KOHLI R (2002) Antecedents of B2C channel satisfaction and preference: validating e-commerce metrics. Information Systems Research 13(3), 316-333.
35. DEVARAJ S and KOHLI R (2003) Performance impacts of information technology: is actual usage the missing link?. Management Science 49(3), 273-289.
36. DOLL WJ and TORKZADEH G (1998) Developing a multidimensional measure of system-use in an organizational context. Information & Management 33(4), 171-185.
37. DOLL WJ, XIA W and TORKZADEH G (1994) A confirmatory factor analysis of the end-user computing satisfaction instrument. MIS Quarterly 18(4), 453-461.
38. FARHOOMAND AF and DRURY DH (1996) Factors influencing electronic data interchange success. The DATA BASE for Advances in Information Systems 27(1), 45-57.
39. FISHBEIN M and AJZEN I (1975) Belief, Attitude, Intention and Behavior: An Introduction to Theory and Research. Addison-Wesley, Reading.
40. FITZGERALD G and RUSSO NL (2005) The turnaround of the London ambulance service computer-aided dispatch system (LASCAD). European Journal of Information Systems 14(3), 244-257.
41. FRASER SG and SALTER G (1995) A motivational view of information systems success: a reinterpretation of DeLone & McLean's model. In Proceedings of the Sixth Australasian Conference on Information Systems (PERVAN G and NEWBY M, Eds), p 119, Curtin University of Technology, Perth, Australia.
42. GABLE G, SEDERA D and CHAN T (2003) Enterprise systems success: a measurement model. In Proceedings of the Twenty-Fourth International Conference on Information Systems (MARCH S, MASSEY A and DEGROSS JI, Eds), p. 576, Association for Information Systems, Seattle, Washington, USA.
43. GATIAN AW (1994) Is user satisfaction a valid measure of system effectiveness? Information & Management 26(3), 119-131.
44. GEFEN D (2000) It is not enough to be responsive: the role of cooperative intentions in MRP II adoption. The DATA BASE for Advances in Information Systems 31(2), 65-79.
45. GEFEN D and KEIL M (1998) The impact of developer responsiveness on perceptions of usefulness and ease of use: an extension of the technology of the technology acceptance model. The DATA BASE for Advances in Information Systems 29(2), 35-49.
46. GELDERMAN M (1998) The relation between user satisfaction, usage of information systems and performance. Information & Management 34(1), 11-18.
47. GELDERMAN M (2002) Task difficulty, task variability and satisfaction with management support systems. Information & Management 39(7), 593-604.
48. GILL TG (1995) Early expert systems: where are they now?. MIS Quarterly 19(1), 51-81.
49. GILL TG (1996) Expert systems usage: task change and intrinsic motivation. MIS Quarterly 20(3), 301-329.
50. GOODHUE DL and THOMPSON R (1995) Task-technology fit and individual performance. MIS Quarterly 19(2), 213-236.
51. GROVER V, PURVIS R and COFFEY J (2003) Information systems effectiveness. In IsWorld.org, URL: http://business.clemson.edu/ISE/index.html.
52. GUIMARAES T and IGBARIA M (1997) Client/server system success: exploring the human side. Decision Sciences 28(4), 851-876.
53. GUIMARAES T, YOON Y and CLEVENSON A (1996) Factors important to expert system success: a field test. Information & Management 30(3), 119-130.
54. HALAWI LA, MCCARTHY RV and ARONSON JE (2007) An empirical investigation of knowledge-management systems' success. The Journal of Computer Information Systems 48(2), 121-135.
55. HEDGES LV and OLKIN I (1980) Vote-counting methods in research synthesis. Psychological Bulletin 88(2), 359-369.
56. HEO J and HAN I (2003) Performance measure of information systems (IS) in evolving computing environments: an empirical investigation. Information & Management 40(4), 243-256.
57. HONG W, THONG JYL, WONG W-M and TAM K-Y (2001/2002) Determinants of user acceptance of digital libraries: an empirical examination of individual differences and system characteristics. Journal of Management Information Systems 18(3), 97-124.
58. HSIEH JJPA and WANG W (2007) Explaining employees' extended use of complex information systems. European Journal of Information Systems 16(3), 216-227.
59. HWANG MI, WINDSOR JC and PRYOR A (2000) Building a knowledge base for MIS research: a meta-analysis of a systems success model. Information Resources Management Journal 13(2), 26-32.
60. IGBARIA M and TAN M (1997) The consequences of information technology acceptance on subsequent individual performance. Information & Management 32(3), 113-121.
61. IGBARIA M, ZINATELLI N, CRAGG P and CAVAYE ALM (1997) Personal computing acceptance factors in small firms: a structural equation model. MIS Quarterly 21(3), 279-305.
62. IIVARI J (2005) An empirical test of DeLone-McLean model of information systems success. The DATA BASE for Advances in Information Systems 36(2), 8-27.
63. IVES B, OLSON M and BAROUDI JJ (1983) The measurement of user information satisfaction. Communications of the ACM 26(10), 785-793.
64. JENNEX ME and OLFMAN L (2002) Organizational memory/knowledge effects on productivity: a longitudinal study. In Proceedings of the Thirty-Fifth Hawaii International Conference on System Sciences (SPRAGUE JR RH, Ed), p 109, IEEE Computer Society Press, Big Island, Hawaii, USA.
65. JIANG JJ, KLEIN G and CARR CL (2002) Measuring information system service quality: SERVQUAL from the other side. MIS Quarterly 26(2), 145-166.
66. JONES MC and BEATTY RC (2001) User satisfaction with EDI: an empirical investigation. Information Resources Management Journal 14(2), 17-26.
67. KANARACUS C (2008) Gartner: global IT spending growth stable. InfoWorld April 3, 2008.
68. KAPLAN RS and NORTON DP (1996) Translating Strategy into Action: The Balanced Scorecard. Harvard Business School Press, Boston.
69. KETTINGER WJ and LEE CC (1994) Perceived service quality and user satisfaction with the information services function. Decision Sciences 25(5), 737-766.
70. KETTINGER WJ and LEE CC (1997) Pragmatic perspectives on the measurement of information systems service quality. MIS Quarterly 21(2), 223-240.
71. KHALIL OEM and ELKORDY MM (1999) The relationship between user satisfaction and systems usage: empirical evidence from Egypt. Journal of End User Computing 11(2), 21-28.
72. KIM J, LEE J, HAN K and LEE M (2002) Business as buildings: metrics for the architectural quality of internet businesses. Information Systems Research 13(3), 239-254.
73. KLEIN R (2007) An empirical examination of patient-physician portal acceptance. European Journal of Information Systems 16(6), 751-760.
74. KOSITANURIT B, NGWENYAMA O and OSEI- BRYSON Kweku (2006) An exploration of factors that impact individual performance in an ERP environment: an analysis using multiple analytical techniques. European Journal of Information Systems 15(6), 556-568.
75. KRAEMER KL, DANZINGER JN, DUNKLE DE and KING JL (1993) The usefulness of computer-based information to public managers. MIS Quarterly 17(2), 129-148.
76. KULKARNI UR, RAVINDRAN S and FREEZE R (2006) A knowledge management success model: theoretical development and empirical validation. Journal of Management Information Systems 23(3), 309-347.
77. LASSILA KS and BRANCHEAU JC (1999) Adoption and utilization of commercial software packages: exploring utilization equilibria, transitions, triggers and tracks. Journal of Management Information Systems 16(2), 63-80.
78. LAW CCH and NGAI EWT (2007) ERP systems adoption: an exploratory study of the organizational factors and impacts of ERP success. Information & Management 44(4), 418-432.
79. LECLERCQ A (2007) The perceptual evaluation of information systems using the construct of user satisfaction: case study of a large French group. The DATABASE for Advances in Information Systems 38(2), 27-60.
80. LEONARD-BARTON D and SINHA DK (1993) Developer-user interaction and user satisfaction in internal technology transfer. Academy of Management Journal 36(5), 1125-1139.
81. LI EY (1997) Perceived importance of information system success factors: a meta-analysis of group differences. Information & Management 32(1), 15-28.
82. LUCAS HC and SPITLER VK (1999) Technology use and performance: a field study of broker workstations. Decision Sciences 30(2), 291-311.
83. MAHMOOD MA, HALL L and SWANBERG DL (2001) Factors affecting information technology usage: a meta-analysis of the empirical literature. Journal of Organizational Computing & Electronic Commerce 11(2), 107-130.
84. MALHOTRA Y and GALLETTA D (2005) Model of volitional systems adoption and usage behavior. Journal of Management Information Systems 22(1), 117-151.
85. MARBLE RP (2003) A system implementation study: management commitment to projectmanagement. Information & Management 41(1), 111-123.
86. MARKUS ML and KEIL M (1994) If we build it, they will come: designing information systems that people want to use. Sloan Management Review 35(4), 11-25.
87. MARTINSONS M, DAVISON MR and TSE D (1999) The balanced scorecard: a foundation for the strategic management of information systems. Decision Support Systems 25(1), 71-88.
88. MCGILL T, HOBBS V and KLOBAS J (2003) User-developed applications and information systems success: a test of DeLone and McLean's model. Information Resources Management Journal 16(1), 24-45.
89. MCGILL TJ and KLOBAS JE (2005) The role of spreadsheet knowledge in user-developed application success. Decision Support Systems 39(3), 355-369.
90. MOLLA A and LICKER PS (2001) E-commerce systems success: an attempt to extend and respecify the DeLone and McLean model of IS success. Journal of Electronic Commerce Research 2(4), 131-141.
91. MORRIS SA, MARSHALL TE and RAINER Jr RK (2002) Impact of user satisfaction and trust on virtual team members. Information Resources Management Journal 15(2), 22-30.
92. MYERS BL, KAPPELMAN LA and PRYBUTOK VRA (1997) Comprehensive model for assessing the quality and productivity of the information systems function: toward a contingency theory for information systems assessment. Information Resources Management Journal 10(1), 6-25.
93. NOLAN RL (1973) Managing the computer resource: a stage hypothesis. Communications of the ACM 16(7), 399-405.
94. OLIVER LW (1987) Research integration for psychologists: an overview of approaches. Journal of Applied Social Psychology 17(10), 860-874.
95. PALMER J (2002) Web site usability, design and performance metrics. Information Systems Research 13(1), 151-167.
96. PAYTON FC and BRENNAN PF (1999) How a community health information network is really used. Communications of the ACM 42(12), 85-89.
97. PITT LF, WATSON RT and KAVAN CB (1995) Service quality: a measure of information systems effectiveness. MIS Quarterly 19(2), 173-187.
98. PREMKUMAR G, RAMAMURTHY K and NILAKANTA S (1994) Implementation of electronic data interchange: an innovation diffusion perspective. Journal of Management Information Systems 11(2), 157.
99. RAI A, LANG SS and WELKER RB (2002) Assessing the validity of IS success models: an empirical test and theoretical analysis. Information Systems Research 13(1), 5-69.
100. RAINER RKJ and WATSON HJ (1995) The keys to executive information system success. Journal of Management Information Systems 12(2), 83.
101. RIVARD S, POIRIER G, RAYMOND L and BERGERON F (1997) Development of a measure to assess the quality of user-developed applications. The DATA BASE for Advances in Information Systems 28(3), 44-58.
102. RUBIN H (2004) Into the light. In CIO Magazine. http://www.cio.com.au/index.php/id;1718970659, accessed on July 2004.
103. SABHERWAL R, JEYARAJ A and CHOWA C (2006) Information systems success: individual and organizational determinants. Management Science 52(12), 1849-1864.
104. SCHEEPERS R, SCHEEPERS H and NGWENYAMA OK (2004) Contextual influences on user satisfaction with mobile computing: findings from two healthcare organizations. European Journal of Information Systems 15(3), 261-268.
105. SEDDON PB (1997) A respecification and extension of the DeLone and McLean model of IS success. Information Systems Research 8(3), 240-253.
106. SEDDON PB and KIEW M-Y (1996) A partial test and development of DeLone and McLean's model of IS success. Australian Journal of Information Systems 4(1), 90-109.
107. SEDDON PB, STAPLES S, PATNAYAKUNI R and BOWTELL M (1999) Dimensions of information systems success. Communications of the Association for Information Systems 2, 2-39.
108. SEDDON P, GRAESER V and WILCOCKS LP (2002) Measuring organizational IS effectiveness: an overview and update of senior management perspectives. The DATA BASE for Advances in Information Systems 33(2), 11-28.
109. SEDDON P and YIP S-K (1992) An empirical evaluation of user information satisfaction (UIS) measures for use with general ledger accounting software. Journal of Information Systems 6(1), 75-98.
110. SEDERA D, GABLE G and CHAN T (2004) A factor and structural equation analysis of the enterprise systems success measurement model. In Proceedings of the Twenty-Fifth International Conference on Information Systems (APPELGATE L, GALLIERS R and DEGROSS JI, Eds), p 449, Association for Information Systems, Washington, DC, USA.
111. SEGARS AH and GROVER V (1993) Re-examining perceived ease of use and usefulness: a confirmatory factor analysis. MIS Quarterly 17, 517-522.
112. SHAW NC, DELONE WH and NIEDERMAN F (2002) Sources of dissatisfaction in end-user support: an empirical study. The DATA BASE for Advances in Information Systems 33(2), 41-56.
113. SHIH HP (2004) Extended technology acceptance model of internet utilization behavior. Information & Management 41(6), 719-729.
114. SKOK W, KOPHAMEL A and RICHARDSON I (2001) Diagnosing information systems success: importance-performance maps in the health club industry. Information & Management 38(7), 409-419.
115. STRAUB DW, LIMAYEN M and KARAHANNA- EVARISTO E (1995) Measuring system usage: implications for IS theory testing. Management Science 41(8), 1328-1342.
116. SUBRAMANIAN GH (1994) A replication of perceived usefulness and perceived ease-of-use measurement. Decision Sciences 25(5/6), 863-874.
117. SUH K, KIM S and LEE J (1994) End-user's disconfirmed expectations and the success of information systems. Information Resources Management Journal 7(4), 30-39.
118. TENG JTC and CALHOUN KJ (1996) Organizational computing as a facilitator of operational and managerial decision making. Decision Sciences 6(2), 673-710.
119. TEO TSH and WONG I (1998) An empirical study of the performance impact of computerization in the retail industry. Omega 26(5), 611-621.
120. THONG JYL, YAP C-S and RAMAN KS (1994) Engagement of external expertise in information systems implementations. Journal of Management Information Systems 11(2), 209-231.
121. THONG JYL, YAP C-S and RAMAN KS (1996) Top management support, external expertise and information systems implementation in small businesses. Information Systems Research 7(2), 248-267.
122. TORKZADEH G and DOLL WJ (1999) The development of a tool for measuring the perceived impact of information technology on work. Omega 27(3), 327-339.
123. VAN DER HEIJDEN H (2004) User acceptance of hedonic information systems. MIS Quarterly 28(4), 695-704.
124. VAN DYKE TP, KAPPELMAN LA and PRYBUTOK VR (1997) Measuring information systems service quality: concerns on the use of the SERVQUAL questionnaire. MIS Quarterly 21(2), 195-208.
125. VENKATESH V and DAVIS FD (2000) A theoretical extension of the technology acceptance model: four longitudinal field studies. Management Science 46(2), 186-204.
126. VENKATESH V and MORRIS MG (2000) Why don't men ever stop to ask for directions? Gender, social influence, and their role in technology acceptance and usage behavior. MIS Quarterly 24(1), 115-149.
127. VENKATESH V, MORRIS MG, DAVIS GB and DAVIS FD (2003) User acceptance of information technology: toward a unified view. MIS Quarterly 27(3), 425-478.
128. VLAHOS GE and FERRATT TW (1995) Information technology use by managers in Greece to support decision making: amount, perceived value, and satisfaction. Information & Management 29(6), 305-315.
129. VLAHOS GE, FERRATT TW and KNOEPFLE G (2004) The use of computer-based information systems by German managers to support decision making. Information & Management 41(6), 763-779.
130. WEILL P and VITALE M (1999) Assessing the health of an information systems portfolio: an example from process engineering. MIS Quarterly 23(4), 601-624.
131. WINTER SJ, CHUDOBA KM and GUTEK BA (1998) Attitudes toward computers: when do they predict computer use?. Information & Management 34(5), 275-284.
132. WIXOM BH and TODD PA (2005) A theoretical integration of user satisfaction and technology acceptance. Information Systems Research 16(1), 85-102.
133. WIXOM BH and WATSON HJ (2001) An empirical investigation of the factors affecting data warehousing success. MIS Quarterly 25(1), 17-41.
134. WU J-H and WANG Y-M (2006) Measuring KMS success: a respecification of the DeLone and McLean model. Information & Management 43(6), 728-739.
135. YANG HD and YOO Y (2004) It's all about attitude: revisiting the technology acceptance model. Decision Support Systems 38(1), 19-31.
136. YOON Y and GUIMARAES T (1995) Assessing expert systems impact on users' jobs. Journal of Management Information Systems 12(1), 225-249.
137. YOON Y, GUIMARAES T and O'NEAI Q (1995) Exploring the factors associated with expert system success. MIS Quarterly 19(1), 83-106.
138. YUTHAS K and YOUNG ST (1998) Material matters: assessing the effectiveness of materials management IS. Information & Management 33(3), 115-124.
139. ZHU K and KRAEMER KL (2005) Post-adoption variations in usage and value of e-business by organizations: cross-country evidence from the retail industry. Information Systems Research 16(1), 61-84.