Techniques for impact evaluation of performance measurement systems

International Journal of Quality and Reliability Management

Volumn 30, Issue 2, 2013, Pages 197-220

  Franceschini, F ^a   Galetto, M ^a   Turina, E ^a  

^a POLITECNICO DI TORINO   (Italy)

Author keywords

Balanced scorecard; BSC; Impact assessment; Performance management; Performance measurement system; PMS; Quality management; Quality performance indicators

Indexed keywords

EID: 84872342179     PISSN: 0265671X     EISSN: None     Source Type: Journal    
DOI: 10.1108/02656711311293599     Document Type: Article

References (82)

1. Abdullah, F., Suhaimi, R., Saban, G. and Hamali, J. (2011), "Bank service quality (BSQ) index: an indicator of service performance" in International Journal of Quality & Reliability Management, Vol. 28, No. 5, pp. 542-55.
2. Andersen, E.S. and Jessen, S.A. (2003), "Project maturity in organizations" in International Journal of Project Management, Vol. 21, pp. 457-61.
3. Atkinsons, A. (1998), "Strategic performance measurement and compensation" in European Management Journal, Vol. 16, No. 5, pp. 552-61.
4. Azadeh, A., Ghaderi, S.F., Partovi Miran, Y., Ebrahimipour, V. and Suzuki, K. (2007), "An integrated framework for continuous assessment and improvement of manufacturing systems" in Applied Mathematics and Computation, No. 186, pp. 1216-33.
5. Barnetson, B. and Cutright, M. (2000), "Performance indicators as conceptual technologies" in Higher Education, Vol. 40, pp. 277-92.
6. Biazzo, S. and Garengo, P. (2012), Performance Measurement with the Balanced Scorecard: A Practical Approach to Implementation Within SMEs, Springer, Berlin.
7. Bititci, U.S., Turner, U.T. and Beemann, C. (2000), "Dynamics of performance measurement systems" in International Journal of Operations & Production Management, Vol. 20, No. 6, pp. 692-704.
8. Bourne, M., Kennerly, M. and Franco-Santos, M. (2005), "Managing through measures: a study of impact on performance" in Journal of Manufacturing Technology Management, Vol. 16, No. 4, pp. 373-95.
9. Cameron, K.S. and Quinn, R.E. (1999), Diagnosis and Changing Organizational Culture: Based on the Competing Values Framework, Addison-Wesley, Reading, MA.
10. Caplice, C. and Sheffi, Y. (1994), "A review and evaluation of logistics metrics" in The International Journal of Logistics Management, Vol. 5, No. 2, pp. 11-28.
11. Chenhall, R.H. (2005), "Integrative strategic performance measurement systems, strategic alignment of manufacturing, learning and strategic outcomes: an exploratory study" in Accounting, Organizations and Society, Vol. 30, pp. 395-422.
12. Dossi, A. and Patelli, L. (2008), "The decision-influencing use of performance measurement systems in relationships between headquarters and subsidiaries" in Management Accounting Research, Vol. 19, pp. 126-48.
13. EFQM (2010), Introducing the EFQM Model 2010, available at: www.efqm.org/en/PdfResources/EFQMModel_Presentation.pdf (accessed 1 March).
14. Ehrgott, M. (2010), Multicriteria Optimization, Springer, Berlin.
15. Evans, J.R. (2004), "An exploratory study of performance measurement systems and relationship with performance results" in Journal of Operations Management, No. 22, pp. 219-32.
16. Finkelstein, L. (1982) Sydenham, P.H. (Ed.), Handbook of Measurement Science, Theoretical Fundamentals, Vol. 1, Wiley, New York, NY.
17. Flynn, B.B., Schroeder, R.G. and Sakakibara, S. (1995), "The impact of quality management practices on performance and competitive advantage" in Decision Sciences, Vol. 26, pp. 659-91.
18. Forslund, H. (2007), "The impact of performance management on customers' expected logistics performance" in International Journal of Operations & Production Management, Vol. 27, No. 8, pp. 901-18.
19. Franceschini, F. (2001), Advanced Quality Function Deployment, CRC Press, Boca Raton, FL.
20. Franceschini, F. and Rossetto, S. (1998), "QFD: how to improve its use" in Total Quality Management, Vol. 9, No. 6, pp. 491-500.
21. Franceschini, F., Galetto, M. and Maisano, D. (2007), Management by Measurement: Designing Key Indicators and Performance Measurements, Springer, Berlin.
22. Franceschini, F., Galetto, M. and Turina, E. (2012), "Impact of performance indicators on organizations: proposal for an evaluation model", Production Planning & Control.
23. Franceschini, F., Galetto, M. and Varetto, M. (2005), "Ordered samples control charts for ordinal variables" in Quality & Reliability Engineering International, Vol. 21, No. 2, pp. 177-95.
24. Franceschini, F., Brondino, G., Galetto, M. and Vicario, G. (2006a), "Synthesis maps for multivariate ordinal variables in manufacturing" in International Journal of Production Research, Vol. 44, No. 20, pp. 4241-55.
25. Franceschini, F., Galetto, M., Maisano, D. and Viticchiè, L. (2006b), "The condition of uniqueness in manufacturing process representation by performance/quality indicators" in Quality & Reliability Engineering International, No. 22, pp. 567-80.
26. Franco-Santos, M., Lucianetti, L. and Bourne, M. (2012), "Contemporary performance measurement systems: a review of their consequences and a framework for research", Management Accounting Research, available at: http://dx.doi.org/10.1016/j.mar.2012.04.001.
27. Franco-Santos, M., Kennerley, M., Micheli, P., Martinez, V., Mason, S., Marr, B., Gray, D. and Neely, A. (2007), "Towards a definition of a business performance measurement system" in International Journal of Operations & Production Management, Vol. 27, No. 8, pp. 784-801.
28. Garengo, P. and Bititci, U. (2007), "Towards a contingency approach to performance measurement: an empirical study in Scottish SMEs" in International Journal of Operations & Production Management, Vol. 27, No. 8, pp. 802-25.
29. Ghalayini, A.M., Noble, J.S. and Crowe, T. (1997), "An integrated dynamic performance measurement system for improving manufacturing competitiveness" in International Journal of Production Economics, No. 48, pp. 207-25.
30. Gosselin, M. (2005), "An empirical study of performance measurement in manufacturing firms" in International Journal of Productivity and Performance Management, Vol. 54, Nos 5/6, pp. 419-37.
31. Greatbanks, R. and Tapp, D. (2007), "The impact of balanced scorecards in a public sector environment: empirical evidence from Dunedin City Council, New Zealand" in International Journal of Operations & Production Management, Vol. 27, No. 8, pp. 846-73.
32. Hauser, J. and Katz, G. (1998), "Metrics: you are what you measure!" in European Management Journal, Vol. 16, No. 5, pp. 517-28.
33. Henry, J.F. (2006), "Organizational culture and performance measurement systems" in Accounting Organizations and Society, No. 31, pp. 77-103.
34. Heo, J. and Han, I. (2003), "Performance measure of information systems (IS) in evolving computing environments: an empirical investigation" in Information & Management, No. 40, pp. 243-56.
35. Hill, T. (1999), Manufacturing Strategy: Text and Cases, McGraw-Hill, Burr Ridge, IL.
36. Hoque, Z. and James, W. (2000), "Linking balanced scorecard measures to size and market factors: impact on organizational performance" in Journal of Management Accounting Research, No. 12, pp. 1-17.
37. Hudson, M., Bourne, M. and Smart, A. (2001), "Theory and practice in SME performance measurement systems" in International Journal of Operations & Production Management, Vol. 21, No. 8, pp. 1096-115.
38. Hulme, D. (2000), "Impact assessment methodologies for microfinance: theory, experience and better practice" in World Development, Vol. 28, No. 1, pp. 79-98.
39. Ijas, A., Kuitunen, M.T. and Jalava, K. (2010), "Developing the RIAM method (rapid impact assessment matrix) in the context of impact significance assessment" in Environmental Impact Assessment Review, Vol. 30, pp. 82-9.
40. Jacob, R.A., Madu, C.N. and Tang, C. (2012), "Financial performance of Baldrige Award winners: a review and synthesis" in International Journal of Quality & Reliability Management, Vol. 29, No. 2, pp. 233-40.
41. Kaplan, R.S. and Norton, D.P. (1992), "The balanced scorecard-measures that drive performance" in Harvard Business Review, No. 70, pp. 71-9.
42. Kaplan, R.S. and Norton, D.P. (1996), The Balanced Scorecard, Harvard Business School Press, Cambridge, MA.
43. Kaplan, R.S. and Norton, D.P. (2001), The Strategy Focused Organisation: How Balanced Scorecard Companies Thrive in the New Business Environment, Harvard Business School Press, Boston, MA.
44. Kennerly, M. and Neely, A. (2002), "A framework of the factors affecting the evolution of performance measurement system" in International Journal of Operations and Management, Vol. 22, No. 11, pp. 1222-45.
45. Kennerly, M. and Neely, A. (2003), "Measuring performance in a changing business environment" in International Journal of Operations & Production Management, Vol. 23, No. 2, pp. 213-29.
46. Kerssens-van Drongelen, I.C. and Fisscher, O.A.M. (2003), "Ethical dilemmas in performance measurement" in Journal of Business Ethics, No. 45, pp. 51-63.
47. Lipe, M.G. and Salterio, S. (2002), "A note on judgmental effects of the balanced scorecard's information organization" in Accounting Organization and Society, No. 27, pp. 531-40.
48. McGrath, M.E. and Romeri, M.N. (1994), "The R&D effectiveness index: a metric for product development performance" in Journal of Product Innovation Management, Vol. 11, No. 3, pp. 213-20.
49. Marín, L.M. and Ruiz-Olalla, M.C. (2011), "ISO 9000:2000 certification and business results" in International Journal of Quality & Reliability Management, Vol. 28, No. 6, pp. 649-61.
50. Mehra, S., Joyal, A.D. and Rhee, M. (2011), "On adopting quality orientation as an operations philosophy to improve business performance in banking services" in International Journal of Quality & Reliability Management, Vol. 28, No. 9, pp. 951-68.
51. Micheli, P., Mura, M. and Agliati, M. (2011), "Exploring the roles of performance measurement systems in strategy implementation: the case of a highly diversified group of firms" in International Journal of Operations & Production Management, Vol. 31, No. 10, pp. 1115-39.
52. Mohrman, S.A., Tenkasi, R.V., Lawler, E.E. III and Ledford, G.G. Jr (1995), "Total quality management: practice and outcomes in the largest US firms" in Employee Relations, Vol. 17, No. 3, pp. 26-41.
53. Morris, P. and Therivel, R. (2009), Methods of Environmental Impact Assessment, 3rd ed., Routledge, New York, NY.
54. Moxham, C. and Boaden, R. (2007), "The impact of performance measurement in the voluntary sector: identification of contextual and processual factors" in International Journal of Operations & Production Management, Vol. 27, No. 8, pp. 826-45.
55. Nahm, A., Vonderembse, M.A. and Koufteros, X.A. (2003), "The impact of organizational structure on time-based manufacturing and plant performance" in Journal of Operations Management, No. 21, pp. 281-306.
56. Neely, A. (2005), "The evolution of performance measurement research: developments in the last decade and a research agenda for the next" in International Journal of Operations & Production Management, Vol. 25, No. 12, pp. 1264-77.
57. Norreklit, H. (2000), "The balance on the balanced scorecard - a critical analysis of some of its assumptions" in Management Accounting Research, Vol. 11, pp. 65-88.
58. Nudurupati, S.S., Bititci, U.S., Kumar, V. and Chan, F.T.S. (2011), "State of the art literature review on performance measurement" in Computers & Industrial Engineering, Vol. 60, pp. 279-90.
59. Oakes, D. (2008), "Driven by metrics", Quality Progress, September.
60. Parast, M.M., Adams, S.G. and Jones, E.C. (2011), "Improving operational and business performance in the petroleum industry through quality management" in International Journal of Quality & Reliability Management, Vol. 28, pp. 426-50.
61. Pastakia, C.M.R. and Jensen, A. (1998), "The rapid impact assessment matrix (RIAM) for EIA" in Environ Impact Assessment Review, Vol. 18, pp. 461-82.
62. Pedrycz, W., Ekel, P. and Parreiras, R. (2011), Fuzzy Multicriteria Decision-making: Models, Methods and Applications, Wiley, New York, NY.
63. Pennington, D.W., Potting, J., Finnveden, G., Lindeijerd, E., Jolliet, O., Rydberg, T. and Rebitzer, G. (2004), "Life cycle assessment part 2: current impact assessment practice" in Environment International, Vol. 30, pp. 721-39.
64. Performance Management Special Interest Group (PMB SIG) (2001), The Performance-based Management Handbook: Establishing an Integrated Performance Measurement System, Vol. 2, PMB SIG, Oak Ridge Institute for Science and Education (ORISE), US Department of Energy, Oak Ridge, TN.
65. Powell, T.C. (1995), "Total quality management as competitive advantage: a review and empirical study" in Strategic Management Journal, Vol. 16, pp. 15-37.
66. Rau, J.G. and Wooten, D.C. (1980), Environmental Impact Analysis Handbook, McGraw-Hill, New York, NY.
67. Roberts, F.S. (1979), Measurement Theory, Addison-Wesley, Reading, MA.
68. Roy, B. (1996), Multicriteria Methodology for Decision Aiding, Kluwer Academic, Dordrecht.
69. Sampaio, P., Saraiva, P. and Guimarães Rodrigues, A. (2011), "The economic impact of quality management systems in Portuguese certified companies: empirical evidence" in International Journal of Quality & Reliability Management, Vol. 28, No. 9, pp. 929-50.
70. Schein, E.H. (2004), Organizational Culture and Leadership, Jossey-Bass, San Francisco, CA.
71. Skinner, W. (1974), "The decline, fall, and renewal of manufacturing plants", Harvard Business Review, May/June.
72. Tung, A., Baird, K. and Schoch, H.P. (2011), "Factors influencing the effectiveness of performance measurement systems" in International Journal of Operations & Production Management, Vol. 31, No. 12, pp. 1287-310.
73. Ukko, J., Tenhunen, J. and Rantanen, H. (2007), "Performance measurement impacts on management and leadership: perspectives of management and employees" in International Journal of Production Economics, Vol. 110, Nos 1/2, pp. 39-51.
74. University of California, Laboratory Administration Office (2010), Objective Standards of Performance, (Appendix F), available at: www.ucop.edu/labs/labprimecontracts/LBNL/appendices/archives/apndx_f_lbnl_m345.pdf (accessed 1 September).
75. US Department of the Treasury (1994), Criteria for Developing Performance Measurement Systems in the Public Sector, US Department of the Treasury, Washington, DC.
76. Vincke, P. (1992), Multicriteria Decision Aid, Wiley, Chichester.
77. Wainwright, S. (2002), Measuring Impact: A Guide to Resources, NCVO Publications, London.
78. Wu, S.-I. and Chen, J.-H. (2012), "The performance evaluation and comparison based on enterprises passed or not passed with ISO accreditation: an appliance of BSC and ABC methods" in International Journal of Quality & Reliability Management, Vol. 29, No. 3, pp. 295-319.
79. Yager, R. (2004), "Modeling prioritized multicriteria decision making" in IEEE Transactions on Systems, Man, Cybernetics - Part B: Cybernetics, Vol. 34, No. 6, pp. 2369-404.
80. Yager, R. and Filev, D.P. (1994), Essentials in Fuzzy Modeling and Control, 4th ed., Wiley, New York, NY.
81. Yager, R., Kacprzyk, J. and Beliakov, G. (2011), Recent Developments in the Ordered Weighted Averaging Operators: Theory and Practice, Springer, Berlin, Studies in Fuzziness and Soft Computing.
82. Zhou, X. and Schoenung, J.M. (2007), "An integrated impact assessment and weighting methodology: evaluation of the environmental consequences of computer display technology substitution" in Journal of Environmental Management, Vol. 83, pp. 1-24.