Fact or fiction? A sensemaking perspective on the reality behind executives' perceptions of IT business value

Journal of Management Information Systems

Volumn 24, Issue 1, 2007, Pages 13-54

  Tallon, Paul P ^a   Kraemer, Kenneth L ^b  

^a BOSTON COLLEGE   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Executive perceptions; IT business value; IT organizational impacts; IT value measurement; Objective measures; Perceptual measures; PLSGraph; Process orientation; Sensemaking; Value chain

Indexed keywords

COMPUTER SIMULATION; ECONOMIC ANALYSIS; ENGINEERING RESEARCH; INDUSTRY; SURVEYS;

OBJECTIVE MEASURE; PERCEPTUAL MEASURE; PROCESS ORIENTATION;

INFORMATION TECHNOLOGY;

EID: 34548116260     PISSN: 07421222     EISSN: None     Source Type: Journal    
DOI: 10.2753/MIS0742-1222240101     Document Type: Article

References (89)

1. Alpar, P., and Kim, M. A microeconomic approach to the measurement of information technology value. Journal of Management Information Systems, 7, 2 (Fall 1990), 55-69.
2. Bagozzi, R.P., and Yi, Y. On the evaluation of structural equation models. Journal of the Academy of Marketing Science, 16, 1 (1988), 74-94.
3. Bakos, J.Y. Dependent variables for the study of firm and industry-level impacts of information technology. In J.I. DeGross and C.H. Kriebel (eds.), Proceedings of the Eighth International Conference on Information Systems. Atlanta: Association for Information Systems, 1987, pp. 10-23.
4. Banker, R.D.; Kauffman, R.J.; and Morey, R.C. Measuring gains in operational efficiency from information technology: A study of the Positran deployment at Hardee's Inc. Journal of Management Information Systems, 7, 2 (Fall 1990), 29-54.
5. Bannister, F., and Remenyi, D. Acts of faith: Instinct, value and IT investment decisions. Journal of Information Technology, 15, 3 (2000), 231-241.
6. Baron, R.M., and Kenny, D.A. The moderator-mediator variable distinction in social psychological research: Conceptual, strategic and statistical considerations. Journal of Personality and Social Psychology, 51, 6 (1986), 1173-1182.
7. Barua, A., and Mukhopadhyay, T. Information technology and business performance: Past, present and future. In R.W. Zmud (ed.), Framing the Domains of IT Management: Projecting the Future Through the Past. Cincinnati: Pinnaflex Educational Resources, 2000, pp. 65-84.
8. Barua, A.; Kriebel, C.H.; and Mukhopadhyay, T. Information technologies and business value: An analytic and empirical investigation. Information Systems Research, 6, 1 (1995), 3-23.
9. Bharadwaj, A. A resource-based perspective on information technology capability and firm performance: An empirical investigation. MIS Quarterly, 24, 1 (2000), 169-196.
10. Bharadwaj, A.S., and Konsynski, B.R. Capturing the intangibles. InformationWeek, 649 (September 22, 1997), 71-74.
11. Boynton, A.C.; Zmud, R.W.; and Jacobs, G.C. The influence of IT management practice on IT use in large organizations. MIS Quarterly, 18, 3 (1994), 299-318.
12. Bresnahan, T.; Brynjolfsson, E.; and Hitt, L. Information technology, workplace organization, and the demand for skilled labor: Firm-level evidence. Quarterly Journal of Economics, 117, 1 (2002), 339-376.
13. Broadbent, M., and Weill, P. Improving business and information strategy alignment: Learning from the banking industry. IBM Systems Journal, 32, 1 (1993), 162-179.
14. Brynjolfsson, E. The productivity paradox of information technology. Communications of the ACM, 36, 12 (1993), 66-77.
15. Brynjolfsson, E., and Hitt, L. Paradox lost? Firm-level evidence on the returns to information systems spending. Management Science, 42, 4 (1996), 541-558.
16. Brynjolfsson, E.; Hitt, L.; and Yang, S. Intangible assets: Computers and organizational capital. Brookings Papers on Economic Activity, 1 (2002), 137-171.
17. Brynjolfsson, E.; Malone, T.W.; Gurbaxani, V.; and Kambil, A. Does information technology lead to smaller firms? Management Science, 40, 12 (1994), 1628-1644.
18. Busch, E.A.; Jarvenpaa, S.L.; Tractinsky, N.; and Glick, W.H. External versus internal perspectives in determining a firm's progressive use of information technology. In J.I. DeGross, I. Benbasat, G. DeSanctis, and C.M. Beath (eds.), Proceedings of the Twelfth International Conference on Information Systems. Atlanta: Association for Information Systems, 1991, pp. 239-250.
19. Carr, N. IT doesn't matter. Harvard Business Review, 81, 5 (2003), 41-49.
20. Chan, Y.E. IT value: The great divide between qualitative and quantitative and individual and organizational measures. Journal of Management Information Systems, 16, 4 (Spring 2000), 225-261.
21. Chin, W.C., and Newsted, P.R. Structural equation modeling analysis with small samples using partial least squares. In R.H. Hoyle (ed.), Statistical Strategies for Small Sample Research. Thousand Oaks, CA: Sage, 1999, pp. 307-341.
22. Cohen, J. Statistical Power Analysis for the Behavioral Sciences, 2d ed. Hillsdale, NJ: Lawrence Erlbaum, 1988.
23. Costabile, K.A., and Klein, S.B. Finishing strong: Recency effects in juror judgments. Basic and Applied Social Psychology, 27, 1 (2005), 47-58.
24. Davis, F. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13, 3 (1989), 319-340.
25. Dehning, B., and Richardson, V.J. Returns on investments in information technology: A research synthesis. Journal of Information Systems, 16, 1 (2002), 7-30.
26. Dess, G.G., and Robinson, R.B. Measuring organizational performance in the absence of objective measures: The case of the privately-held firm and conglomerate business unit. Strategic Management Journal, 5, 3 (1984), 265-273.
27. Devaraj, S., and Kohli, R. Information technology payoff in the health-care industry: A longitudinal study. Journal of Management Information Systems, 16, 4 (Spring 2000), 41-67.
28. Devaraj, S., and Kohli, R. The IT Payoff. Upper Saddle River, NJ: Prentice Hall, 2002.
29. Devaraj, S., and Kohli, R. Performance impacts of information technology: Is actual usage the missing link? Management Science, 49, 3 (2003), 273-289.
30. Dewan, S., and Min, C.K. The substitution of information technology for other factors of production: A firm-level analysis. Management Science, 43, 12 (1997), 1660-1675.
31. Doll, W.J.; Xia, W.; and Torkzadeh, R. A confirmatory factor analysis of the end-user computing satisfaction index. MIS Quarterly, 18, 4 (1994), 453-461.
32. Feeny, D.F., and Willcocks, L.P. Core IS capabilities or exploiting information technology. Sloan Management Review, 39, 2 (1998), 9-21.
33. Fornell, C., and Larcker, D.F. Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18, 1 (1981), 39-50.
34. Griffith, T.L. Technology features as triggers for sensemaking. Academy of Management Review, 24, 3 (1999), 472-488.
35. Grover, V.; Teng, J.; and Fiedler, K. IS investment priorities in contemporary organizations. Communications of the ACM, 41, 2 (1997), 40-48.
36. Hitt, L., and Brynjolfsson, E. Productivity, business profitability, and consumer surplus: Three different measures of information technology value. MIS Quarterly, 20, 2 (1996), 121-142.
37. Jarvenpaa, S.L., and Ives, B. Executive involvement and participation in the management of IT. MIS Quarterly, 15, 2 (1991), 205-227.
38. Jeffrey, M. IT portfolio management: Challenges and best practices. Diamond Cluster, Chicago, 2003 (available at www.diamondconsultants.com/PublicSite/ideas/perspectives/downloads/ ITPM_Study_single.pdf).
39. Karimi, J.; Somers, T.M.; and Gupta, Y.P. Impact of environmental uncertainty and task characteristics on user satisfaction with data. Information Systems Research, 15, 2 (2004), 175-193.
40. Kauffman, R.J., and Kriebel, C.H. Modeling and measuring the business value of information technologies. In P.A. Strassmann, P. Berger, E.B. Swanson, C.H. Kriebel, and R.J. Kauffman (eds.), Measuring the Business Value of Information Technologies. Washington, DC: ICIT Press, 1988, 97-119.
41. Kauffman, R.J., and Weill, P. An evaluative framework for research on the performance effects of information technology investment. In J.I. DeGross and C.H. Kriebel (eds.), Proceedings of the Tenth International Conference on Information Systems. Atlanta: Association for Information Systems, 1989, pp. 377-388.
42. Kearns, G.S., and Lederer, A. A resource-based view of strategic IT alignment: How knowledge sharing creates competitive advantage. Decision Sciences, 34, 1 (2003), 1-29.
43. Kenny, D.A. Mediation. Tutorial on Structural Equation Modeling. University of Connecticut, 2006 (available at http://davidakenny.net/cm/ mediate.htm).
44. Ketokivi, M.A., and Schroeder, R.G. Perceptual measures of performance: Fact or fiction? Journal of Operations Management, 22, 3 (2004), 247-264.
45. Kettinger, W.J., and Lee, C.C. Zones of tolerance: Alternative scales for measuring information systems service quality. MIS Quarterly, 29, 4 (2005), 607-623.
46. Kirsch, L.J. Deploying common systems globally: The dynamics of control. Information Systems Research, 15, 4 (2004), 374-395.
47. Kohli, R. In search of the locus of information technology business value: Do measurement levels make a difference? Working Paper, Department of Information Systems, University of Notre Dame, 2004.
48. Kohli, R., and Devaraj, S. Measuring information technology payoff: A meta-analysis of structural variables in firm-level empirical research. Information Systems Research, 14, 2 (2003), 127-145.
49. Kudyba, S., and Diwan, R. Increasing returns to information technology. Information Systems Research, 13, 1 (2002), 104-111.
50. Lehr, B., and Lichtenberg, F.R. Information technology and its impact on productivity: Firm-level evidence from government and private-data sources: 1977-1993. Canadian Journal of Economics, 32, 2 (1999), 335-362.
51. Mahmood, M.A., and Soon, S.K. A comprehensive model for measuring the potential impact of information technology on organizational strategic variables. Decision Sciences, 22, 4 (1991), 869-897.
52. Mahmood, M.A., and Mann, G.J. Measuring the organizational impact of IT investment. Journal of Management Information Systems, 10, 1 (Summer 1993), 97-122.
53. Maule, A.J., and Hodgkinson, G.P. Re-appraising managers' perceptual errors: A behavioral decision-making perspective. British Journal of Management, 14, 1 (2003), 33-37.
54. McFarlan, F.W. Information technology changes the way you compete. Harvard Business Review, 62, 3 (1984), 98-103.
55. McLean, E.R. End users as application developers. MIS Quarterly, 3, 1 (1979), 37-46.
56. Melville, N.; Gurbaxani, V.; and Kraemer, K.L. Information technology and organizational performance: An integrative model of IT business value. MIS Quarterly, 28, 2 (2004), 283-322.
57. Mezias, J.M., and Starbuck, W.H. Studying the accuracy of managers' perceptions: A research odyssey. British Journal of Management, 14, 1 (2003), 3-17.
58. Miller, C.C.; Cardinal, L.B.; and Glick, W.H. Retrospective reports in organizational research: A reexamination of recent evidence. Academy of Management Journal, 40, 1 (1997), 189-204.
59. Mitra, S., and Chaya, A.K. Analyzing cost-effectiveness of organizations: The impact of information technology spending. Journal of Management Information Systems, 13, 2 (Fall 1996), 29-57.
60. Mooney, J.G.; Gurbaxani, V.; and Kraemer, K.L. A process oriented framework for assessing the business value of information technology. In J.I. DeGross, G. Ariav, G.M. Beath, R. Hoyer, and C. Kemerer (eds.), Proceedings of the Sixteenth International Conference on Information Systems. Atlanta: Association for Information Systems, 1995, pp. 17-27.
61. Parsons, G.L. Information technology: A new competitive weapon. Sloan Management Review, 25, 1 (1983), 3-14.
62. Podsakoff, P.M.; MacKenzie, S.B.; Lee, J.Y.; and Podsakoff, N.P. Common method bias in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 5 (2003), 879-903.
63. Porter, M.E. Competitive Advantage. New York: Free Press, 1985.
64. Porter, M.E., and Millar, V.E. How information gives you competitive advantage. Harvard Business Review, 63, 4 (1985), 149-160.
65. Rai, A.; Patnayakuni, R.; and Patnayakuni, N. Technology investment and business performance. Communications of the ACM, 40, 7 (1997), 89-97.
66. Reich, B.H., and Benbasat, I. Measuring the linkage between business and information technology objectives. MIS Quarterly, 20, 1 (1996), 55-81.
67. Rockart, J.F., and Scott-Morton, M.S. Implications of changes in information technology for corporate strategy. Interfaces, 14, 1 (1984), 84-95.
68. Roese, N.J. Counterfactual thinking and marketing: Introduction to the special issue. Psychology and Marketing, 17, 4 (2000), 227-230.
69. Seddon, P.B.; Graeser, V.; and Willcocks, L.P. Measuring organizational IS effectiveness: An overview and update of senior management perspectives. Database for Advances in Information Systems, 33, 2 (2002), 11-28.
70. Seligman, L. Adoption as sensemaking: Toward an adopter-centered process model of IT adoption. In W.J. Orlikowski, S. Ang, P. Weill, H.C. Krcmar, and J.I. DeGross (eds.), Proceedings of the Twenty-First International Conference on Information Systems. Atlanta: Association for Information Systems, 2000, 361-370.
71. Sethi, V., and King, W.R. Development of measures to assess the extent to which an information technology application provides competitive advantage. Management Science, 40, 12 (1994), 1601-1627.
72. Shin, N. The impact of information technology on coordination costs: Implications for firm productivity. In J.I. DeGross and K. Kumar (eds.), Proceedings of the Eighteenth International Conference on Information Systems. Atlanta: Association for Information Systems, 1997, pp. 133-146.
73. Shrout, P.E., and Fleiss, J.L. Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 2 (1979), 420-428.
74. Sircar, S.; Turnbow, J.L.; and Bordoloi, B. A framework for assessing the relationship between information technology investments and firm performance. Journal of Management Information Systems, 16, 4 (Spring 2000), 69-97.
75. Smith, H.J.; Keil, M., and Depledge, G. Keeping mum as the project goes under: Towards an explanatory model. Journal of Management Information Systems, 18, 2 (Fall 2001), 189-228.
76. Stapel, D.A., and Koomen, A.W. Interpretation versus reference framing: Assimilation and contrast effects in the organizational domain. Organizational Behavior and Human Decision Processes, 76, 2 (1998), 132-148.
77. Starbuck, W.H., and Milliken, F.J. Executives' perceptual filters: What they notice and how they make sense. In D.C. Hambrick and G.L. Brandon (eds.), The Executive Effect: Concepts and Methods for Studying Top Managers. Greenwich, CT: JAI Press, 1988.
78. Starbuck, W.H., and Mezias, J.M. Opening Pandora's box: Studying the accuracy of managers' perceptions. Journal of Organizational Behavior, 17, 2 (1996), 99-117.
79. Straub, D.; Limayem, M.; and Karahanna, E. Measuring system usage: Implications for IS theory testing. Management Science, 41, 8 (1995), 1328-1342.
80. Sutcliffe, K.M., and Weber, K. The high cost of accurate knowledge. Harvard Business Review, 81, 5 (2003), 75-82.
81. Tallon, P.P., and Kraemer, K.L. The development and application of a process-oriented thermometer of IT business value. Communications of the AIS, 17, 45 (2006), 1-52.
82. Tallon, P.P.; Kraemer, K.L.; and Gurbaxani, V. Executives' perceptions of the business value of information technology: A process-oriented approach. Journal of Management Information Systems, 16, 4 (Spring 2000), 145-173.
83. Thomas, J.B.; Clark, S.M.; and Gioia, D.A. Strategic sensemaking and organizational performance: Linkages among scanning, interpretation, action and outcomes. Academy of Management Journal, 36, 2 (1993), 239-270.
84. Venkatraman, N. IT-enabled business transformation: From automation to business scope redefinition. Sloan Management Review, 35, 2 (1994), 73-87.
85. Venkatraman, N., and Ramanujam, V. Measurement of business economic performance: An examination of method convergence. Journal of Management, 13, 1 (1987), 109-122.
86. Watson, R.T. Influences on the IS manager's perceptions of key issues: Information scanning and the relationship with the CEO. MIS Quarterly, 14, 2 (1990), 217-231.
87. Weick, K.E. Sensemaking in organizations. Thousand Oaks, CA: Sage, 1995.
88. Werts, C.E.; Linn, R.; and Jöreskog, K. A general method of estimating the reliability of a composite. Educational and Psychological Measurement, 38, 2 (1978), 933-938.
89. Winter, S.J., and Taylor, S.L. The role of IT in the transformation of work: A comparison of post-industrial, industrial, and proto-industrial organizations. Information Systems Research, 7, 1 (1996), 5-21.