The performance effects of using business intelligence systems for exploitation and exploration learning

Journal of Information Systems

Volumn 30, Issue 3, 2016, Pages 1-31

  Lee, Michael T ^a   Widener, Sally K ^b  

^a WASHINGTON AND LEE UNIVERSITY   (United States)

^b CLEMSON UNIVERSITY   (United States)

Author keywords

Agenda setting; Analysis and reporting; Budget; Business intelligence; Dashboards and visualization; Exploitation; Exploration; Framing; Management control; Organizational learning; Performance measures; Query

Indexed keywords

EID: 84991042658     PISSN: 08887985     EISSN: 15587959     Source Type: Journal    
DOI: 10.2308/isys-51298     Document Type: Article

References (116)

1. Argyris, C. 1976. Single-loop and double-loop models in research on decision making. Administrative Science Quarterly 21 (3): 363-375.
2. Argyris, C. 1977. Double loop learning in organizations. Harvard Business Review (September/October): 59-72.
3. Argyris, C., and D. Schon. 1978. Organizational Learning: A Theory of Action Approach. Reading, MA: Addison Wesley.
4. Attewell, P. 1992. Technology diffusion and organizational learning: The case of business computing. Organization Science 3 (1): 1-19.
5. Baker, W. E., and J. M. Sinkula. 2007. Does market orientation facilitate balanced innovation programs? An organizational learning perspective. The JournalofProduct Innovation Management 24: 316-334.
6. Baron, R. M., and D. A. Kenny. 1986. The moderator-mediator variable distinction in social psychological research: Conceptual, strategic and statistical considerations. Journal of Personality and Social Psychology 51 (6): 1173-1182.
7. Barua, A., C. H. Kriebel, and T. Mukhopadhyay. 1995. Information technologies and business value: An analytic and empirical investigation. Information Systems Research 6 (1): 3-23.
8. Beck, G. M., R. Limor, V. Arunachalam, and P. R. Wheeler. 2014. The effect of changes in decision aid bias on learning: Evidence of functional fixation. JournalofInformation Systems 28: 19-42.
9. Beckerle, M. 2008. How business intelligence systems deliver value—Interview with Mike Beckerle of Oco, Inc. Journal of Digital Asset Management 4: 277-290.
10. Bharadwaj, A. S. 2000. A resource-based perspective on information technology capability and firm performance: An empirical investigation. MIS Quarterly 24 (1): 169-196.
11. Briers, M., and M. Hirst. 1990. The role of budgetary information in performance evaluation. Accounting, Organizations and Society 15 (4): 373-398.
12. Bryant, L., D. A. Jones, and S. K. Widener. 2004. Managing value creation within the firm: An examination of multiple performance measures. JournalofManagement Accounting Research 16: 107-131.
13. Byrne, B. M. 2010. Structural Equation Modeling with AMOS: Basic Concepts, Applications and Programming. 2nd edition. New York, NY: Routledge.
14. Chapman, C. S. 2005. Not because they are new: Developing the contribution of enterprise resource planning systems to management control research. Accounting, Organizations and Society 30: 685-689.
15. Chapman, C. S., and L.-A. Kihn. 2009. Information systems integration, enabling control and performance. Accounting, Organizations and Society 34: 151-169.
16. Churchill, G. A. 1979. A paradigm for developing better measures of marketing constructs. Journal of Marketing Research 16: 64-73.
17. Crossan, M. M., H. W. Lane, and R. E. White. 1999. An organizational learning framework: From intuition to institution. Academy of Management Review 24 (3): 522-537.
18. Davern, M. J., and C. L. Wilkin. 2010. Toward an integrated view of IT value measurement. International Journal of Accounting Information Systems 11: 42-60.
19. Dechow, N., and J. Mouritsen. 2005. Enterprise resource planning systems, management control and the quest for integration. Accounting, Organizations and Society 30: 691-733.
20. Dillman, D. A., J. D. Smyth, and L. M. Christian. 2009. Internet, Mail, and Mixed-Mode Survey: The Tailored Design Method. Hoboken, NJ: John Wiley & Sons, Inc.
21. Eining, M. M., and P. B. Dorr. 1991. The impact of expert system usage on experiential learning in an auditing setting. Journal of Information Systems 5 (1): 1-16.
22. Eisenhardt, K., and J. Martin. 2000. Dynamic capabilities: What are they? Strategic Management Journal 21 (October/November Special Issue): 1105-1121.
23. Elbashir, M. Z., P. A. Collier, and M. J. Davern. 2008. Measuring the effects of business intelligence systems: The relationship between business process and organizational performance. International Journal of Accounting Information Systems 9 (3): 135-153.
24. Elbashir, M. Z., P. A. Collier, and S. G. Sutton. 2011. The role of organizational absorptive capacity in strategic use of business intelligence to support integrated management control systems. The Accounting Review 86 (1): 155-184.
25. Elbashir, M. Z., P. A. Collier, S. G. Sutton, M. J. Davern, and S. A. Leech. 2013. Enhancing the business value of business intelligence: The role of shared knowledge and assimilation. Journal of Information Systems 27 (2): 87-105.
26. Entman, R. M. 1993. Framing: Toward clarification of a fractured paradigm. Journal of Communication 43 (4): 51-58.
27. Fiol, C. M., and M. A. Lyles. 1985. Organizational learning. Academy of Management Review 10 (4): 803-813.
28. Fornell, C., and D. F. Larcker. 1981. Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research 18 (1): 39-50.
29. Ghosh, D., and M. N. Boldt. 2006. The effect of framing and compensation structure on seller’s negotiated transfer price. Journal of Managerial Issues 18 (4): 453-467.
30. Gibson, C. B., and J. Birkinshaw. 2004. The antecedents, consequences, and mediating role of organizational ambidexterity. Academy of Management Journal 47 (2): 209-226.
31. Gill, T. G. 1995. High-tech hidebound: Case studies of information technologies that inhibited organizational learning. Accounting, Management and Information Technologies 5 (1): 41-60.
32. Goffman, E. 1974. Frame Analysis: An Essay on the Organization of Experience. Cambridge, MA: Harvard University Press.
33. Goodman, P. S., and E. D. Darr. 1998. Computer-aided systems and communities: Mechanisms for organizational learning in distributed environments. MIS Quarterly 22 (4): 417-440.
34. Graber, D. A. 1988. Process the News: How People Tame the Information Tide. 2nd edition. New York, NY: Longman.
35. Grafton, J., A. M. Lillis, and S. K. Widener. 2010. The role of performance measurement and evaluation in building organizational capabilities and performance. Accounting, Organizations and Society 35: 689-706.
36. Größler, A. 2007. A dynamic view on strategic resources and capabilities applied to an example from the manufacturing strategy literature. Journal of Manufacturing Technology Management 18 (3): 250-266.
37. Gupta, A. K., K. G. Smith, and C. E. Shalley. 2006. The interplay between exploration and exploitation. Academy of Management Journal 49 (4): 693-706.
38. Hair, J. F., W. C. Black, B. J. Babin, R. E. Anderson, and R. L. Tatham. 2006. Multivariate Data Analysis. 6th edition. Englewood Cliffs, NJ: Pearson Prentice Hall.
39. Hall, M. 2011. Do comprehensive performance measurement systems help or hinder managers’ mental model development? Management Accounting Research 22: 68-83.
40. Hastie, R., and B. Park. 1986. The relationship between memory and judgment depends on whether the judgment task is memory-based or on-line. Psychological Review 93 (3): 258-268.
41. Hayes, A. F. 2009. Beyond Baron and Kenny: Statistical mediation analysis in the new millennium. Communication Monographs 76 (4): 408-420.
42. He, Z. L., and P. K. Wong. 2004. Exploration versus exploitation: An empirical test of the ambidexterity hypothesis. Organization Science 15 (4): 481-494.
43. Henri, J.-F. 2006. Management control systems and strategy: A resource-based perspective. Accounting, Organizations and Society 31: 529-558.
44. Henschen, D. 2008. Smart Stuff: The State of Business Intelligence 2008. Available at: http://www.informationweek.com/news/software/bi/210300402
45. Henson, R. K., and J. K. Roberts. 2006. Use of exploratory factor analysis in published research: Common errors and some comment on improved practice. Educational and Psychological Measurement 66: 393-416.
46. Huber, G. P. 1991. Organizational learning: The contributing processes and the literatures. Organization Science 2 (1): 88-115.
47. Jöreskog, K. G., and D. Sörbom. 1993. LISREL 8 User’s Reference Guide. Chicago, IL: Scientific Software International.
48. Kahneman, D., and A. Tversky. 1984. Choice, values, and frames. American Psychologist 39: 341-350.
49. Kane, G. C., and M. Alavi. 2007. Information technology and organizational learning: An investigation of exploration and exploitation processes. Organization Science 18 (5): 796-812.
50. Kaplan, R. S. 1990. Measures for Manufacturing Excellence. Boston, MA: Harvard Business School Press.
51. Kaplan, R. S., and D. P. Norton. 1996. Using the balanced scorecard as a strategic management system. Harvard Business Review (January/February): 75-85.
52. Kaplan, R. S., and D. P. Norton. 2001. Transforming the balanced scorecard from performance measurement to strategic management: Part 1. Accounting Horizons 15 (1): 87-104.
53. Kline, R. B. 2005. Principles and Practice of Structural Equation Modeling. 2nd edition. New York, NY: Guilford Publications.
54. Kloot, L. 1997. Organizational learning and management control systems: Responding to environmental change. Management Accounting Research 8: 47-73.
55. Kogut, B., and U. Zander. 1992. Knowledge of the firm, combinative capabilities, and the replication of technology. Organization Science 3: 383-397.
56. Lavie, D., U. Stettner, and M. L. Tushman. 2010. Exploration and exploitation within and across organizations. The Academy of Management Annals 4 (1): 109-155.
57. Lawrence, P. R., and D. Dyer. 1983. Renewing American Industry. New York, NY: Free Press.
58. Lee, M. T., and S. K. Widener. 2011. How Firms Learn from the Uses of Different Types of Management Control Systems. IMA Executive White Paper. Montvale, NJ: Institute of Management Accountants.
59. Levinthal, D. A. 1997. Adaptation on rugged landscapes. Management Science 43: 934-950.
60. Levinthal, D. A., and J. G. March. 1993. The myopia of learning. Strategic Management Journal 14 (S2): 95-112.
61. Little, R. J. A. 1988. Missing-data adjustments in large surveys. Journal of Business & Economic Statistics 6 (3): 287-296.
62. March, J. G. 1991. Exploration and exploitation in organizational learning. Organization Science 2: 71-87.
63. Marengo, L., and C. Pasquali. 2012. How to get what you want when you do not know what you want: A model of incentives, organizational structure, and learning. Organization Science 23: 1298-1310.
64. Matsunaga, M. 2010. How to factor-analyze your data right: Do’s, don’ts, and how-to’s. International Journal of Psychological Research 3 (1): 97-110.
65. McCombs, M. E., and D. L. Shaw. 1972. The agenda-setting function of mass media. Public Opinion Quarterly 36 (2): 176-187.
66. McKee, D. 1992. An organizational learning approach to product innovation. Journal of Product Innovation Management 9 (3): 232-245.
67. Melville, N., K. Kraemer, and V. Gurbaxani. 2004. Review: Information technology and organizational performance: An integrative model of IT business value. MIS Quarterly 28 (2): 283-322.
68. Moore, C., B. Rowe, and S. K. Widener. 2001. HCS: Designing a balanced scorecard in a knowledge-based firm. Issues in Accounting Education 16: 569-601.
69. Murthy, U., and B. A. Schafer. 2011. The effects of relative performance information and framed information systems feedback on performance in a production task. Journal of Information Systems 25 (1): 159-184.
70. Nicolaou, A. I. 2004. Firm performance effects in relation to the implementation and use of enterprise resource planning systems. Journal ofInformation Systems 18 (2): 79-105.
71. Nicolaou, A. I., and S. Bhattacharya. 2006. Organizational performance effects of ERP systems usage: The impact of post-implementation changes. International Journal of Accounting Information Systems 7 (1): 18-35.
72. Nunnally, J. C. 1978. Psychometric Theory. 2nd edition. New York, NY: McGraw-Hill Book Company.
73. Orlikowski, W. J. 1996. Improvising organizational transformation over time: A situated change perspective. Information Systems Research 7 (1): 63-92.
74. Otley, D. 1999. Performance management: A framework for management control systems research. Management Accounting Research 10 (4): 363-382.
75. Pan, Z., and G. M. Kosicki. 1993. Framing analysis: An approach to news discourse. Political Communication 10 (1): 55-75.
76. Pentland, B. T. 1995. Information systems and organizational learning: The social epistemology of organizational knowledge systems. Accounting, Management and Information Technologies 5 (1): 1-21.
77. Petrini, M., and M. Pozzebon. 2009. Managing sustainability with the support of business intelligence: Integrating socio-environmental indicators and organisational context. Journal of Strategic Information Systems 18: 178-191.
78. Pettey, C., and L. Goasduff. 2011. Gartner Says Worldwide Business Intelligence, Analytics and Performance Management Software Market Surpassed the $10 Billion Mark in 2010. Available at: http://www.gartner.com/newsroom/id/1642714
79. Podsakoff, P. M., and D. W. Organ. 1986. Self-reports in organizational research: Problems and prospects. Journal of Management 12: 69-82.
80. Podsakoff, P. M., S. B. MacKenzie, J.-Y. Lee, and N. P. Podsakoff. 2003. Common methods biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology 88 (5): 879-903.
81. Preacher, K. J., and A. F. Hayes. 2008. Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behavior Research Methods 40 (3): 879-891.
82. Price, V., and D. Tewksbury. 1997. News values and public opinion: A theoretical account of media priming and framing. In Progress in Communication Sciences: Advances in Persuasion, edited by Barett, G. A., and F. J. Boster, 173-212.
83. Greenwich, CT, Ablex Raisch, S., and J. Birkinshaw. 2008. Organizational ambidexterity: Antecedents, outcomes, and moderators. Journal of Management 34 (3): 375-409.
84. Raisch, S., J. Birkinshaw, G. Probst, and M. L. Tushman. 2009. Organizational ambidexterity: Balancing exploitation and exploration for sustained performance. Organization Science 20 (4): 685-695.
85. Real, J. C., A. Leal, and J. L. Roldan. 2006. Information technology as a determinant of organizational learning and technological distinctive competencies. Industrial Marketing Management 35: 505-521.
86. Reid, N., and M.-J. Yang. 2002. The solving of problems in chemistry: The more open-ended problems. Research in Science & Technological Education 20 (1): 83-98.
87. Ringle, C. M., S. Wende, and A. Will. 2005. SmartPLS 2. Available at: http://www.smartpls.com
88. Robey, D., M.-C. Boudreau, and G. M. Rose. 2000. Information technology and organizational learning: A review and assessment of research. Accounting, Management and Information Technologies 10: 125-155.
89. Rutledge, R. W. 1995. The ability to moderate recency effects through framing of management accounting information. Journal of Managerial Issues 7 (1): 27-40.
90. SAP. 2016. SAP Crystal Reports. Available at: http://www.sap.com/solutions/sap-crystal-solutions/query-reporting-analysis/index.epx
91. Scheufele, D. A., and D. Tewksbury. 2007. Framing, agenda setting, and priming: The evolution of three media effects model. Journal of Communication 57: 9-20.
92. Schryen, G. 2013. Revisiting IS business value research: What we already know, what we still need to know, and how we can get there. European JournalofInformation Systems 22: 139-169.
93. Senge, P. 1990. The Fifth Discipline: The Art & Practice of the Learning Organization. New York, NY: Currency Doubleday.
94. Shrivastava, P. 1983. A typology of organizational learning systems. Journal of Management Studies 20 (1): 7-28.
95. Shrout, P. E., and J. L. Fleiss. 1979. Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin 86 (2): 420-428.
96. Simons, R. 1995. Levers of Control: How Managers Use Innovative Control Systems to Drive Strategic Renewal. Boston, MA: Harvard Business School Press.
97. Simons, R. 2000. Performance Measurement & Control Systems for Implementing Strategy. Upper Saddle River, NJ: Prentice Hall.
98. Simsek, Z. 2009. Organizational ambidexterity: Toward a multilevel understanding. Journal of Management Studies 46 (4): 597-624.
99. Simsek, Z., C. Heavey, J. F. Veiga, and D. Souder. 2009. A typology for aligning organizational ambidexterity’s conceptualizations, antecedents, and outcomes. Journal of Management Studies 46 (5): 864-894.
100. Sobel, M. E. 1982. Asymptotic confidence intervals for indirect effects in structural equation models. In Social Methodology, edited by S. Leinhardt, 290-313. San Francisco, CA: Jossey-Bass.
101. Sobel, M. E. 1986. Some new results on indirect effects and their standard errors in covariance structure analysis. In Social Methodology, edited by N. B. Tuma, 159-186. San Francisco, CA: Jossey-Bass.
102. Stein, E. W., and B. Vandenbosch. 1996. Organizational learning during advanced system development: Opportunities and obstacles. Journal of Management Information Systems 13 (2): 115-136.
103. Sweller, J., J. J. G. van Merrienboer, and F. G. W. C. Pass. 1998. Cognitive architecture and instructional design. Educational Psychology Review 10 (3): 251-296.
104. Teece, D. J. 2007. Explicating dynamic capabilities: The nature and micro foundations of (sustainable) enterprise performance. Strategic Management Journal 28: 1319-1350.
105. Templeton, G. F., B. R. Lewis, and C. A. Snyder. 2002. Development of a measure for the organizational learning construct. Journal of Management Information Systems 19 (2): 175-218.
106. Tippins, M. J., and R. S. Sohi. 2003. IT competency and firm performance: Is organizational learning a missing link? Strategic Management Journal 24 (8): 745-761.
107. Tuomela, T.-S. 2005. The interplay of different levers of control: A case study of introducing a new performance measurement system. Management Accounting Research 16 (3): 293-320.
108. Tversky, A., and D. Kahneman. 1981. The framing of decision and the psychology of choice. Science 211: 453-458.
109. Tversky, A., and D. Kahneman. 1987. Rational choice and the framing of decisions. In Rational Choice: The Contrast between Economics and Psychology, edited by Hogarth, R. M., and M. W. Reder, 67-94. Chicago, IL: The University of Chicago Press.
110. van der Heijden, H. 2013. Evaluating dual performance measures on information dashboards: Effects of anchoring and presentation format. JournalofInformation Systems 27 (2): 21-34.
111. Vandenbosch, B., and C. Higgins. 1996. Information acquisition and mental models: An investigation into the relationship between behavior and learning. Information Systems Research 7 (2): 198-214.
112. Vertegaal, R. 2003. Attentive user interfaces. Communications of the ACM 46 (3): 30-33.
113. Vijayan, J. 2012. Finding the Business Value in Big Data Is a Big Problem. Available at: http://www.cio.com/article/2392325/business-intelligence/finding-the-business-value-in-big-data-is-a-big-problem.html
114. Vollmer, H. 2007. How to do more with numbers: Elementary stakes, framing, keying, and the three-dimensional character of numerical signs. Accounting, Organizations and Society 32 (6): 577-600.
115. Widener, S. K. 2007. An empirical analysis of the levers of control framework. Accounting, Organizations and Society 32: 757-788.
116. Zhao, X., J. G. Lynch, and Q. Chen. 2010. Reconsidering Baron and Kenny: Myths and truths about mediation analysis. The Journal of Consumer Research 37 (2): 197-206.