Measuring organizational performance: Towards methodological best practice

Journal of Management

Volumn 35, Issue 3, 2009, Pages 718-804

  Richard, Pierre J ^a   Devinney, Timothy M ^a   Yip, George S ^b   Johnson, Gerry ^c  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

^b ERASMUS UNIVERSITY   (Netherlands)

^c LANCASTER UNIVERSITY MANAGEMENT SCHOOL   (United Kingdom)

Author keywords

Construct validity; Empirical measurement; Organizational effectiveness; Performance; Profitability

Indexed keywords

EID: 67149119441     PISSN: 01492063     EISSN: 15571211     Source Type: Journal    
DOI: 10.1177/0149206308330560     Document Type: Review

References (141)

1. Ailawadi, K.L., Dant, R.P., & Grewal, D. 2004. The difference between perceptual and objective performance measures: An empirical analysis (Marketing Science Institute Working Paper No. 04-001). Cambridge, MA: Marketing Science Institute.
2. Altman, E. 1968. Financial ratios, discriminant analysis and the prediction of corporate bankruptcy. Journal of Finance, 23: 589-609.
3. Arnold, V., Collier, P.A., Leech, S.A., & Sutton, S.G. 2000. The effect of experience and complexity on order and recency bias in decision-making by professional accountants. Accounting & Finance, 40: 109-134.
4. Aupperle, K.E., Acar, W., & Booth, D.E. 1986. An empirical critique of In Search of Excellence: How excellent are the excellent companies? Journal of Management, 12: 499-512.
5. Baker, G.P., & Kennedy, R.E. 2002. Survivorship and the economic grim reaper. Journal of Law, Economics and Organization, 18: 324-361.
6. Barney, J. 1991. Firm resources and sustained competitive advantage. Journal of Management, 17: 99-120.
7. Baum, J.R., & Wally, S. 2003. Strategic decision speed and firm performance. Strategic Management Journal, 24: 1107-1130.
8. Benston, G.J. 1985. The market for public accounting services: Demand, supply and regulation. Journal of Accounting and Public Policy, 4: 33-79.
9. Biddle, G.C., Bowen, R.M., & Wallace, J.S. 1997. Does EVA beat earnings? Evidence on associations with stock returns and firm values. Journal of Accounting and Economics, 24: 301-336.
10. Blattberg, C. 2000. From pluralist to patriotic politics: Putting practice first. Oxford, UK: Oxford University Press.
11. Bond, S.R., & Cummins, J.G. 2000. The stock market and investment in the new economy: Some tangible facts and intangible fictions. Brookings Papers on Economic Activity, 1: 61-108.
12. Boulding, W. 1990. Unobservable effects and business performance: Do fixed effects matter? Marketing Science, 9: 88-91.
13. Bowen, H., & Wiersema, M. 1999. Matching method to paradigm in strategy research: Limitations of cross-sectional analysis and some methodological alternatives. Strategic Management Journal, 20: 625-636.
14. Boyd, B.K., Gove, S., & Hitt, M.A. 2005. Construct measurement in strategic management research: Illusion or reality? Strategic Management Journal, 26: 239-257.
15. Bryant, L., Jones, D.A., & Widener, S.K. 2004. Managing value creation within the firm: An examination of multiple performance measures. Journal of Management Accounting Research, 16: 107-132.
16. Bulow, J.I., Geanakoplos, J.D., & Klemperer, P.D. 1985. Multimarket oligopoly: Strategic substitutes and complements. Journal of Political Economy, 93: 488-511.
17. Business schools and research: Practically irrelevant? 2007, August 28. Economist.com. Retreived from http://www.economist.com/business/ globalexecutive/displaystory.cfm?story_id=E1_JSDSQJR,
18. Callen, J.L. 1991. Data envelope analysis: Partial survey and applications for management accounting. Journal of Accounting Management Research, 3: 35-56.
19. Cameron, K., & Whetten, D. 1983. Organizational effectiveness: One model or several? In K. Cameron & D. Whetten (Eds.), Organizational effectiveness: A comparison of multiple methods: 1-24. New York: Academic Press.
20. Campbell, D.T., & Fiske, D.W. 1959. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56: 81-105.
21. Campbell, W., & Sedikides, C. 1999. Self-threat magnifies the self-serving bias: A meta-analytic integration. Review of General Psychology, 3: 23-43.
22. Capon, N., Farley, J.U., & Hoenig, S. 1990. Determinants of financial performance: A meta-analysis. Management Science, 36: 1143-1159.
23. Casciaro, T., & Piskorski, M.J. 2005. Power imbalance, mutual dependence, and constraint absorption: A closer look at resource dependence theory. Administrative Science Quarterly, 50: 167-199.
24. Chakravarthy, B.S. 1986. Measuring strategic performance. Strategic Management Journal, 7: 437-458.
25. Chan, L.K.C., Megadeath, N., & Lakonishok, J. 1996. Momentum strategies. Journal of Finance, 51: 1681-1713.
26. Chaney, P., & Philipich, K. 2002. Shredded reputation: The cost of audit failure. Journal of Accounting Research, 40: 1221-1245.
27. Charnes, A., Cooper, W.W., & Rhodes, E. 1978. Measuring the efficiency of decision making units. European Journal of Operations Research, 2: 429-444.
28. Chen, S., & Dodd, J.L. 1997. Economic value added (EVA): An empirical examination of a new corporate performance measure. Journal of Managerial Issues, 9: 319-333.
29. Chen, S., & Dodd, J.L. 2001. Operating income, residual income and EVA: Which metric is more value relevant? Journal of Managerial Issues, 13: 65-86.
30. Chenhall, R.H., & Langfield-Smith, K. 2007. Multiple perspectives of performance measures. European Management Journal, 25: 266-282.
31. Cho, H.J., & Pucik, V. 2005. Relationship between innovativeness, quality, growth, profitability and market value. Strategic Management Journal, 26: 555-576.
32. Clarkson, M.B.E. 1995. A stakeholder framework for analyzing and evaluating corporate social performance. Academy of Management Review, 20: 92-117.
33. Collins, J.C., & Porras, J.I. 1994. Built to last: Successful habits of visionary companies. New York: Harper Business.
34. Contractor, F.J., Kundu, S.K., & Hsu, C.C. 2003. A three-stage theory of international expansion: The link between multinationality and performance in the service sector. Journal of International Business Studies, 34: 5-18.
35. Cook, W.D., & Bala, K. 2007. Performance measurement and classification data in DEA: Input-oriented model. Omega, 35: 39-52.
36. Cutler, D.M., Poterba, J.M., & Summers, L.H. 1989. What moves stock prices? Journal of Portfolio Management, 15: 4-12.
37. Danielson, M., & Press, E. 2003. Accounting returns revisited: Evidence of their usefulness in estimating economic returns. Review of Accounting Studies, 8: 493-530.
38. Davig, W., Elbert, N., & Brown, S. 2004. Implementing a strategic planning model for small manufacturing companies: An adaptation of the balanced scorecard. S. A.M. Advanced Management Journal, 69: 18-25.
39. Davis, P.S., & Pett, T.L. 2002. Measuring organizational efficiency and effectiveness. Journal of Management Research, 2: 87-98.
40. Denrell, J. 2004. Random walks and sustained competitive advantage. Management Science, 50: 922-934.
41. Dess, G.G., & Robinson, R.B., Jr. 1984. Measuring organizational performance in the absence of objective measures: The case of the privately-held firm and conglomerate business unit. Strategic Management Journal, 5: 265-273.
42. Devinney, T.M., Midgley, D.F., & Venaik, S. 2001. The organizational imperative and the optimal performance of the global firm. Organization Science, 11: 674-695.
43. Devinney, T.M., & Milde, H. 1990. Agency contracting and inside debt. Die Schweizerische Zeitschrift für Volkswirtschaft und Statistik, 126, 97-111.
44. Devinney, T.M., & Stewart, D.W. 1988. Rethinking the product portfolio: A generalized investment model. Management Science, 34: 1080-1095.
45. Devinney, T.M., Yip, G.S., & Johnson, G. 2009. Using frontier analysis to evaluate company performance. British Journal of Management, forthcoming.
46. Dore, R. 2000. Stock market capitalism: Welfare capitalism. Japan and Germany versus Anglo-Saxons. New York: Oxford University Press.
47. Dunne, T., Roberts, J.M., & Samuelson, L. 1988. Patterns of firm entry and exit in U.S. manufacturing industries. RAND Journal of Economics, 19: 495-515.
48. Dutta, S., & Reichelstein, S. 2005. Stock price, earnings, and book value in managerial performance measures. The Accounting Review, 80: 1069-1100.
49. Edvinsson, L., & Malone, M.S. 1997. Intellectual capital: Realizing your company's true value by finding its hidden brainpower. New York: Harper Business.
50. Edwards, J.R., & Bagozzi, R.P. 2000. On the nature and direction of relationships between constructs and measures. Psychological Methods, 5: 155-174.
51. Feroz, E.H., Kim, S., & Raab, R.L. 2003. Financial statement analysis: A data envelopment approach. Journal of the Operational Research Society, 44: 48-58.
52. Fisher, F.M., & McGowan, J.J. 1983. On the misuse of accounting rates of return to infer monopoly profits. American Economic Review, 73: 82-97.
53. Fitzgerald, L., & Storbeck, J. 2003. Pluralistic views of performance. Management Decision, 41: 741-750.
54. Fombrun, C., & Shanley, M. 1990. What's in a name? Reputation building and corporate strategy. Academy of Management Journal, 33: 233-258.
55. Foster, R., & Kaplan, S. 2001. Creative destruction: Why companies that are built to last underperform the market-and how to transform them. New York: Currency/Doubleday.
56. Freeman, R.E. 1984. Strategic management: A stakeholder approach. Boston: Pitman.
57. Fryxell, G.E., & Barton, S.L. 1990. Temporal and contextual change in the measurement structure of financial performance: Implications for strategy research. Journal of Management, 16: 553-569.
58. Gilovich, T., Griffin, D., & Kahneman, D. (Eds.). 2002. Heuristics and biases: The psychology of intuitive judgment. New York: Cambridge University Press.
59. Goerzen, A., & Beamish, P.W. 2003. Geographic scope and multinational enterprise performance. Strategic Management Journal, 24: 1289-1306.
60. Graham, J.R. 1999. Herding among investment newsletters: Theory and evidence. Journal of Finance, 59: 237-269.
61. Grinblatt, M., Titman, S., & Wermers, R. 1995. Momentum investment strategies, portfolio performance, and herding: A study of mutual fund behavior. American Economic Review, 85: 1088-1105.
62. Gupta, A.K., & Govindarajan, V. 1986. Resource sharing among SBUs: Strategic antecedents and administrative implications. Academy of Management Journal, 29: 695-714.
63. Guthrie, J. 2001. High-involvement work practices, turnover, and productivity: Evidence from New Zealand. Academy of Management Journal, 44: 180-190.
64. Hall, B., Jaffe, A., & Trajtenberg, M. 2005. Market value and patent citations. Rand Journal of Economics, 36: 16-38.
65. Hannan, M.T., & Freeman, J. 1977. The population ecology of organizations. American Journal of Sociology, 82: 929-964.
66. Hawawini, G., Subramanian, V., & Verdin, P. 2003. Is performance driven by industry-or firm-specific factors? A new look at the evidence. Strategic Management Journal, 24: 1-16.
67. Henri, J.F. 2004. Performance measurement and organizational effectiveness: Bridging the gap. Managerial Finance, 30: 93-123.
68. Hillman, A.J., & Keim, G.D. 2001. Shareholder value, stakeholder management, and social issues. What's the bottom line? Strategic Management Journal, 22: 125-140.
69. Hofer, C.W. 1983. ROVA: A new measure for assessing organizational performance. In R. Lamb (Ed.), Advances in strategic management: Vol. 2, 43-55. New York: JAI Press.
70. Ittner, C.D., & Larcker, D.F. 1998. Innovations in performance measurement: Trends and research implications. Journal of Management Accounting Research, 10: 205-238.
71. Jacobson, R. 1987. The validity of ROI as a measure of business performance. American Economic Review, 77: 470-478.
72. Jacobson, R. 1988. The persistence of abnormal returns. Strategic Management Journal, 9: 415-430.
73. Jarrell, G.A., & Poulsen, A.B. 1987. Shark repellents and stock prices: The effects of anti-takeover amendments since 1980. Journal of Financial Economics, 19: 127-168.
74. Jensen, M.C., & Meckling, W.H. 1976. Theory of the firm: Managerial behavior, agency costs and ownership structure. Journal of Financial Economics, 3: 305-360.
75. Jusoh, R., & Parnell, J.A. 2008. Competitive strategy and performance measurement in the Malaysian context: An exploratory study. Management Decision, 46: 5-31.
76. Kahneman, D., & Riepe, M.W. 1998. Aspects of investor psychology. Journal of Portfolio Management, 24: 52-65.
77. Kahneman, D., & Tversky, A. 2000. Choices, values and frames. New York: Cambridge University Press.
78. Kaplan, R.S., & Norton, D.P. 1996. The balanced scorecard: Translating strategy into action. Boston: Harvard Business School Press.
79. Keats, B.W. 1988. The vertical construct validity of business economic performance measures. Journal of Applied Behavioral Science, 24: 151-160.
80. Kirby, J. 2005. Toward a theory of high performance. Harvard Business Review, 83: 30-39.
81. Laitinen, E.K., & Chong, G. 2006. How do small companies measure their performance? Problems and Perspectives in Management, 4: 49-68.
82. Lehn, K., & Makhija, A.K. 1997. EVA, accounting profits, and CEO turnover: An empirical examination 1985-1994. Journal of Applied Corporate Finance, 10: 90-97.
83. Lenz, R.T. 1981. Determinants of organizational performance: An interdisciplinary review. Strategic Management Journal, 2: 131-154.
84. Lev, B. 2001. Intangibles: Management, measurement and reporting. Washington, DC: Brookings Institution.
85. Levenson, A.R., Van der Stede, W.A., & Cohen, S.G. 2006. Measuring the relationship between managerial competencies and performance. Journal of Management, 32: 360-380.
86. Luu, T., Kim, S., Cao, H., & Park, Y. 2008. Performance measurement of construction firms in developing countries. Construction Management and Economics, 26: 373-386.
87. Malina, M.A., & Selto, F.H. 2004. Choice and change of measures in performance measurement models. Management Accounting Research, 15: 441-469.
88. Malkiel, B.G. 2003. The efficient market hypothesis and its critics. Journal of Economic Perspectives, 17: 59-82.
89. March, J.G., & Sutton, R.I. 1997. Organizational performance as a dependent variable. Organization Science, 8: 698-706.
90. Margolis, J.D., Elfenbein, H.A., & Walsh, J.P. 2007. Does it pay to be good? A meta-analysis and redirection of research on the relationship between corporate social and financial performance. Unpublished working paper.
91. McGahan, A.M. 2004. How industries evolve: Principles for achieving and sustaining superior performance. Boston: Harvard Business School Press.
92. McGahan, A.M., & Porter, M.E. 1997. How much does industry matter, really? Strategic Management Journal, 18: 15-30.
93. McGahan, A.M., & Porter, M.E. 1999. The persistence of shocks to profitability. Review of Economics and Statistics, 81: 143-153.
94. McGahan, A.M., & Porter, M.E. 2003. The emergence and sustainability of abnormal profits. Strategic Organization, 1: 79-108.
95. McGuire, J.B., Schneeweis, T., & Branch, B. 1990. Perceptions of firm quality: A cause or result of firm performance. Journal of Management, 16: 167-180.
96. Mezias, J.M., & Starbuck, W.H. 2003. Studying the accuracy of managers' perceptions: A research odyssey. British Journal of Management, 14: 3-17.
97. Miles, R., & Snow, C.C. 1978. Organizational strategy, structure, and process. New York: McGraw-Hill.
98. Miller, D.J. 2004. Firms' technological resources and the performance effects of diversification: A longitudinal study. Strategic Management Journal, 25: 1097-1120.
99. Milunovich, S., & Tseui, A. 1996. EVA in the computer industry. Journal of Applied Corporate Finance, 9: 104-115.
100. Mitchell, R.K., Agle, B.R., & Wood, D.J. 1997. Toward a theory of stakeholder identification and salience: Defining the principle of who and what really counts. Academy of Management Review, 22: 853-886.
101. Nadkarni, S., & Narayanan, V.K. 2007. Strategic schemas, strategic flexibility, and firm performance: The moderating role of industry clock speed. Strategic Management Journal, 28: 243-270.
102. Neely, A., & Bourne, M. 2000. Why measurement initiatives fail. Measuring Business Excellence, 4: 3-6.
103. Orlitzky, M., Schmidt, F.L., & Rynes, S.L. 2003. Corporate social and financial performance: A meta-analysis. Organization Studies, 24: 403-441.
104. Peng, M.W. 2004. Outside directors and firm performance during institutional transitions. Strategic Management Journal, 25: 453-472.
105. Perfect, S.B., & Wiles, K.W. 1994. Alternative constructions of Tobin's q: An empirical comparison. Journal of Empirical Finance, 1: 313-341.
106. Peters, T.J., & Waterman, R.H. 1982. In search of excellence: Lessons from America's best run companies. New York: Harper & Row.
107. Powell, T. 2003. Varieties of competitive parity. Strategic Management Journal, 24: 61-86.
108. Ramanujam, V., & Venkatraman, N. 1988. Excellence, planning and performance. Interfaces, 18: 23-31.
109. Rappaport, A. 1978. Executive incentives vs. corporate growth. Harvard Business Review, 56: 81-88.
110. Rappaport, A. 1986. Creating shareholder value: The new standard for business performance. New York: Free Press.
111. Roberts, P.W., & Dowling, G.R. 2002. Corporate reputation and sustained superior performance. Strategic Management Journal, 23: 1077-1094.
112. Robinson, R.A. 2000. Tracking stocks. Computerworld, February 21: 52.
113. Roll, R. 1988. R2. Journal of Finance, 43: 541-566.
114. Rosenzweig, P. 2007. Misunderstanding the nature of company performance: The halo effect and other business delusions. California Management Review, 49: 6-20.
115. Rowe, W.G., Cannella, A.A., Jr., Harris, I.C., & Francolini, T. 2003. In search of meaning: Does the Fortune reputation survey alter performance expectations? Canadian Journal of Administrative Sciences, 20: 187-195.
116. Rowe, W.G., & Morrow, J.L., Jr. 1999. A note on the dimensionality of the firm financial performance construct using accounting, market, and subjective measures. Revue Canadienne des Sciences de l'Administration, 16: 58-70.
117. Rumelt, R.P. 1991. How much does industry matter? Strategic Management Journal, 12: 167-185.
118. Schneiderman, A.M. 1999. Why balanced scorecards fail. Journal of Strategic Performance Measurement, 3: 6-11.
119. Schriesheim, C.A., Powers, K.J., Scandura, T.A., Gardiner, C.C., & Lankau, M.J. 1993. Improving construct measurement in management research: Comments and a quantitative approach for assessing the theoretical content adequacy of paper-and-pencil survey type instruments. Journal of Management, 19: 385-417.
120. Shiller, R.L. 1989. Market volatility. Cambridge, MA: MIT Press.
121. Spanos, Y.E., Zaralis, G., & Lioukas, S. 2004. Strategy and industry effects on profitability: Evidence from Greece. Strategic Management Journal, 25: 139-166.
122. Stajkovic, A.D., & Sommer, S. 2000. Self-efficacy and causal attributions: Direct and reciprocal links. Journal of Applied Social Psychology, 30: 707-737.
123. Steers, R.M. 1975. Problems in the measurement of organizational effectiveness. Administrative Science Quarterly, 20: 546-558.
124. Stern, J.M., Stewart, G.B., III, & Chew, D.R., Jr. 1995. The EVA financial management system. Journal of Applied Corporate Finance, 8: 32-46.
125. Sveiby, K.E. 1997. The new organizational wealth: Managing and measuring knowledge based assets. San Francisco: Berrett Koehler.
126. Taylor, S., & Brown, J. 1988. Illusion and well-being: A social psychological perspective on mental health. Psychological Bulletin, 103: 193-210.
127. Thanassoulis, E. 1993. A comparison of regression analysis and data envelopment approaches as alternative methods of performance assessment. Journal of the Operational Research Society, 44: 1129-1144.
128. Tobin, J. 1969. A general equilibrium approach to monetary theory. Journal of Money, Credit and Banking, 1: 15-29.
129. Tversky, A., & Kahneman, D. 1973. Availability: A heuristic for judging frequency and probability. Cognitive Psychology, 5: 207-232.
130. United Nations. 2007. UN Global Compact: Annual review. New York: United Nations Global Compact Office.
131. Van der Laan, G., Van Ees, H., & Van Witteloostuijn, A. 2008. Corporate social and financial performance: An extended stakeholder theory, and empirical test with accounting measures. Journal of Business Ethics, 79: 299-310.
132. Varadarajan, P.R., & Ramanujam, V. 1990. The corporate performance conundrum: A synthesis of contemporary views and an extension. Journal of Management Studies, 27: 463-483.
133. Varaiya, N., Kerin, R.A., & Weeks, D. 1987. The relationship between growth, profitability, and firm value. Strategic Management Journal, 8: 487-497.
134. Venkatraman, N., & Ramanujam, V. 1986. Measurement of business performance in strategy research: A comparison of approaches. Academy of Management Review, 11: 801-814.
135. Venkatraman, N., & Ramanujam, V. 1987. Measurement of business economic performance: An examination of method convergence. Journal of Management, 13: 109-122.
136. Wall, T., Michie, J., Patterson, M., Wood, S., Sheehan, M., Clegg, C., & West, M. 2004. On the validity of subjective measures of company performance. Personnel Psychology, 57: 95-118.
137. Wallace, J.S. 1997. Adopting residual income-based compensation plans: Do you get what you pay for? Journal of Accounting and Economics, 23: 275-300.
138. Waring, G.F. 1996. Industry difference in the persistence of firm-specific returns. American Economic Review, 86: 1253-1265.
139. Who's excellent now? 1984. Business Week, November 5: 76-86.
140. Winter, S.G. 2003. Mistaken perceptions: Cases and consequences. British Journal of Management, 14: 39-44.
141. Yip, G.S., Devinney, T.M., & Johnson, G. 2008, September 19. Measuring long term superior performance: The UK's long-term superior performers 1984-2003 (SSRN Working Paper). Retrieved from http://ssrn.com/abstract=1270438