The effectiveness of multi-criteria decision aid methodology: A case study of R&D management

European Journal of Innovation Management

Volumn 18, Issue 1, 2015, Pages 86-109

  Marafon, Alysson Diego ^a   Ensslin, Leonardo ^b   de Oliveira Lacerda, Rogério Tadeu ^a   Ensslin, Sandra Rolim ^a  

^a FEDERAL UNIVERSITY OF SANTA CATARINA   (Brazil)

^b South State of Santa Catarina University (UNISUL)   (Brazil)

Author keywords

Decision aiding; Multi criteria methodology; Performance evaluation; R D management

Indexed keywords

EID: 84921835275     PISSN: 14601060     EISSN: None     Source Type: Journal    
DOI: 10.1108/EJIM-10-2013-0106     Document Type: Article

References (69)

1. Adams, R., Bessant, J. and Phelps, R. (2006), “Innovation management measurement: a review”, International Journal of Management Reviews, Vol. 8 No. 1, pp. 21-47.
2. Alegre, J., Lapiedra, R. and Chiva, R., (2006), “A measurement scale for product innovation performance”, European Journal of Innovation Management, Vol. 9 No. 4, pp. 333-346.
3. Bana e Costa, C.A. and Vansnick, J.-C. (1994), “MACBETH-an interactive path towards the construction of cardinal value functions”, International Transactions in Operational Research, Vol. 1 No. 4, pp. 489-500.
4. Bana e Costa, C.A., Ensslin, L., Corrêa, É.C. and Vansnick, J.C. (1999), “Decision support systems in action: integrated application in a multicriteria decision aid process”, European Journal of Operational Research, Vol. 113 No. 2, pp. 315-335.
5. Barzilai, J. (2001), “On the foundations of measurement”, Systems, Man, and Cybernetics, 2001 IEEE International Conference on. IEEE, Vol. 1, pp. 401-406.
6. Bortoluzzi, S.C., Ensslin, S.R. and Ensslin, L. (2011), “Avaliação de desempenho multicritério como apoio à gestão de empresas: aplicação em uma empresa de serviços”, Gestão & Produção, Vol. 18 No. 3, pp. 633-650.
7. Bremser, W.G. and Barsky, N.P. (2004), “Utilizing the balanced scorecard for R&D performance measurement”, R&D Management, Vol. 34 No. 3, pp. 229-238.
8. Calantone, R.J., Chan, K. and Cui, A.S. (2006), “Decomposing product innovativeness and its effects on new product success”, Journal of Product Innovation Management, Vol. 23 No. 5, pp. 408-421.
9. Cedergren, S., Wall, A. and Norstrm, C. (2010), “Evaluation of performance in a product development context. [Feature]”, Business Horizons, Vol. 53 No. 4, pp. 359-369.
10. Chen, M.Y., Huang, M.J. and Cheng, Y.-C. (2009), “Measuring knowledge management performance using a competitive perspective: an empirical study”, Expert Systems with Applications, Vol. 36 No. 4, pp. 8449-8459.
11. Chiesa, V., Frattini, F., Lazzarotti, V. and Manzini, R. (2009), “Performance measurement in R&D: exploring the interplay between measurement objectives, dimensions of performance and contextual factors”, R&D Management, Vol. 39 No. 5, pp. 487-519.
12. Cooper, R., Edgett, S. and Kleinschmidt, E.J. (2001), “Portfolio management for new product development: results of an industry practices study”, R&D Management, Vol. 31 No. 4, pp. 361-380.
13. Cormican, K. and O’Sullivan, D. (2004), “Auditing best practice for effective product innovation management”, Technovation, Vol. 24 No. 10, pp. 819-829.
14. De Azevedo, R.C., Lacerda, R.T.O., Ensslin, L., Jungles, A.E. and Ensslin, S.R. (2012), “Performance measurement to aid decision making in the budgeting process for apartment-building construction: case study using MCDA-C”, Journal of Construction Engineering and Management, Vol. 139 No. 2, pp. 225-235.
15. De Moraes, L., Garcia, R., Ensslin, L., Da Conceição, M. and De Carvalho, S. (2010), “The multicriteria analysis for construction of bench markers to support the clinical engineering in the healthcare technology management”, European Journal of Operational Research, Vol. 200, pp. 607-615.
16. Della Bruna, E. Jr, Ensslin, L. and Ensslin, S.R. (2011), “Supply chain performance evaluation: a case study in a company of equipment for refrigeration”, paper presented at the 2011 IEEE International Technology Management Conference, San Jose, CA, June.
17. Eilat, H., Golany, B. and Shtub, A. (2008), “R&D project evaluation: an integrated DEA and balanced scorecard approach”, Omega-International Journal of Management Science, Vol. 36 No. 5, pp. 895-912.
18. Elmquist, M. and Le Masson, P. (2009), “The value of a ‘failed’ R&D project: an emerging evaluation framework for building innovative capabilities”, R&D Management, Vol. 39 No. 2, pp. 136-152.
19. Ensslin, L., Dutra, A. and Ensslin, S.R. (2000), “MCDA: a constructivist approach to the management of human resources at a governmental agency”, International Transactions in Operational Research, Vol. 7 No. 1, pp. 79-100.
20. Ensslin, L., Montibeller, G.N. and Noronha, S.M. (2001), Apoio à Decisão: Metodologia para Estruturação de Problemas e Avaliação Multicritério de Alternativas, Insular, Florianópolis.
21. Ensslin, L., Scheid, L.C.M., Ensslin, S.R. and Lacerda, R.T.O. (2012), “Software process assessment and improvement using multicriteria decision aiding-constructivist”, JISTEM-Journal of Information Systems and Technology Management, Vol. 9 No. 3, pp. 473-496.
22. Ensslin, L., Giffhorn, E., Ensslin, S.R., Petri, S.M. and Vianna, W.B. (2010), “Avaliação do desempenho de empresas terceirizadas com o uso da metodologia multicritério em apoio à decisão-Construtivista”, Pesquisa Operacional (Impresso), Vol. 30, pp. 125-152.
23. Ensslin, S.R., Ensslin, L., Back, F. and Lacerda, R.T.O. (2013), “Improved decision aiding in human resource management: a case using constructivistmulti-criteria decision aiding”, International Journal of Productivity and Performance Management, Vol. 62 No. 7, pp. 735-757.
24. Franco, L.A. and Montibeller, G. (2010), “Facilitated modelling in operational research”, European Journal of Operational Research, Vol. 205 No. 3, pp. 489-500.
25. García-Valderrama, T. and Mulero-Mendigorri, E. (2005), “Content validation of a measure of R&D effectiveness”, R&D Management, Vol. 35 No. 3, pp. 311-331.
26. García-Valderrama, T., Mulero-Mendigorri, E. and Revuelta-Bordoy, D. (2008), “A balanced scorecard framework for R&D”, European Journal of Innovation Management, Vol. 11 No. 2, pp. 241-281.
27. Hagedoorn, J. and Cloodt, M. (2003), “Measuring innovative performance: is there an advantage in using multiple indicators?”, Research Policy, Vol. 32 No. 8, pp. 1365-1379.
28. Hart, S., Hultink, E.J., Tzokas, N. and Commandeur, H.R. (2003), “Industrial companies’ evaluation criteria in new product development gates”, Journal of Product Innovation Management, Vol. 20 No. 1, pp. 22-36.
29. Kandampully, J. (2002), “Innovation as the core competency of a service organisation: the role of technology, knowledge and networks”, European Journal of Innovation Management, Vol. 5 No. 1, pp. 18-26.
30. Kaplan, R.S. and Norton, D.P. (1992), “The balanced scorecard measures that drive performance”, Harvard Business Review., Vol. 70 No. 1, pp. 71-79.
31. Keeney, R.L. (1992), Value Focused-Thinking: A Path to Creative Decision-making, Harvard University Press, Cambridge.
32. Keeney, R.L. (1996), “Value-focused thinking: identifying decision opportunities and creating alternatives”, European Journal of Operational Research, Vol. 92 No. 3, pp. 537-549.
33. Keeney, R.L. and Raiffa, H. (1976), “Decisions with Multiple Objectives: Preferences and Value Trade-offs”, Wiley, New York, NY.
34. Kerssens-van Drongelen, I., Nixon, B. and Pearson, A. (2000), “Performance measurement in industrial R&D”, International Journal of Management Reviews, Vol. 2 No. 2, pp. 111-143.
35. Lacerda, R.T.O., Ensslin, L. and Ensslin, S.R. (2011a), “A performance measurement framework in portfolio management: a constructivist case”, Management Decision, Vol. 49 No. 4, pp. 1-15.
36. Lacerda, R.T.O., Ensslin, L. and Ensslin, S.R. (2011b), “A performance measurement view of it project management”, The International Journal of Productivity and PerformanceManagement, Vol. 60 No. 2, pp. 132-151.
37. Lacerda, R.T.O., Ensslin, L. and Ensslin, S.R. (2012), “A bibliometric analysis of strategy and performance measurement”, Gestão & Produção, Vol. 19 No. 1, pp. 59-78.
38. Lacerda, R.T.O., Ensslin, L. and Ensslin, S.R. (2014a), “Research opportunities in strategic management field: a performance measurement approach”, International Journal of Business Performance Management, Vol. 15 No. 2, pp. 158-174.
39. Lacerda, R.T.O., Ensslin, L., Ensslin, S.R. and Dutra, A. (2014b), “A constructivist approach to manage business process as a dynamic capability”, Knowledge and Process Management, Vol. 21 No. 1, pp. 54-66.
40. Lin, B.W. and Chen, J.S. (2005), “Corporate technology portfolios and R&D performance measures: a study of technology intensive firms”, R&D Management, Vol. 35 No. 2, pp. 157-170.
41. Mallick, D.N. and Schroeder, R.G. (2005), “An integrated framework for measuring product development performance in high technology industries”, Production and Operations Management, Vol. 14 No. 2, pp. 142-158.
42. Marafon, A., Ensslin, L., Lacerda, R.T.O. and Ensslin, S.R. (2012a), “Apoio à Decisão na Gestão de P&D: O Estado da Arte”, paper presented at the XXVII Simpósio de Gestão da Inovação Tecnológica, Salvador, BA, Brazil, 18-20 November.
43. Marafon, A., Ensslin, L., Lacerda, R.T.O. and Ensslin, S. R. (2012b), “The implications Of R & D management for organisational effectiveness a literature review”, paper presented at the IEEE International Technology Management Conference, Dallas, TX, 25-27 June.
44. Marafon, A., Ensslin, L., Lacerda, R.T.O. and Ensslin, S.R. (2012c), “Revisão sistêmica da literatura internacional sobre avaliação de desempenho na gestão de P&D”, Revista Gestão Industrial, Vol. 8 No. 3, pp. 1-43.
45. Mikkola, J.H. (2001), “Portfolio management of R&D projects: implications for innovation management”, Technovation, Vol. 21 No. 7, pp. 423-435.
46. Montibeller, G. and Belton, V. (2009), “Qualitative operators for reasoning maps: evaluating multi-criteria options with networks of reasons”, European Journal of Operational Research, Vol. 195 No. 3, pp. 829-840.
47. Neely, A. (2005), “The evolution of performance measurement research: developments in the last decade and a research agenda for the next”, International Journal of Operations & Production Management, Vol. 25 No. 12, pp. 1264-1277.
48. Ojanen, V. and Vuola, O. (2003), Categorizing the Measures and Evaluation Methods of R&D Performance-A State-of-the-art Review on R&D Performance Analysis, Telecom Business Research Center Lappeenranta, Lappeenranta.
49. Ojasalo, J. (2008), “Management of innovation networks: a case study of different approaches”, European Journal of Innovation Management, Vol. 11 No. 1, pp. 51-86.
50. Panizzolo, R., Biazzo, S. and Garengo, P. (2010), “New product development assessment: towards a normative-contingent audit”, Benchmarking, Vol. 17 No. 2, pp. 173-194.
51. Pillai, A.S., Joshi, A. and Rao, K.S. (2002), “Performance measurement of R&D projects in a multi-project, concurrent engineering environment”, International Journal of Project Management, Vol. 20 No. 2, pp. 165-177.
52. Roy, B. (1994), “On operational research and decision aid”, European Journal of Operational Research, Vol. 73 No. 1, pp. 23-26.
53. Roy, B. and Daniel, V. (1996), “The European school of MCDA: Emergence, basic features and current works”, Journal of Multi-Criteria Decision Analysis, Vol. 5 No. 1, available at: http://dx.doi.org/10.1002/(SICI)1099-1360(199603)5:1o22::AID-MCDA93W3.0.CO;2-F
54. Saaty, T.L. (1990), “How to make a decision: the analytic hierarchy process”, European Journal of Operational Research, Vol. 48 No. 1, pp. 9-26.
55. Santiago, L.P. and Bifano, T.G. (2005), “Management of R&D projects under uncertainty: a multidimensional approach to managerial flexibility”, IEEE Transactions on Engineering Management, Vol. 52 No. 2, pp. 269-280.
56. Schmidt, J.B., Sarangee, K.R. and Montoya, M.M. (2009), “Exploring new product development project review practices”, Journal of Product Innovation Management, Vol. 26 No. 5, pp. 520-535.
57. Skinner, W. (1986), “The productivity paradox”, Management Review, Vol. 75 No. 9, pp. 41-45.
58. Tasca, J.E., Ensslin, L., Ensslin, S.R. and Alves, M.B.M. (2010), “An approach for selecting a theoretical framework for the evaluation of training programs”, Journal of European Industrial Training, Vol. 34, pp. 631-655.
59. Teece, D.J. (2007), “Explicating dynamic capabilities: the nature and microfoundations of (sustainable) enterprise performance”, Strategic Management Journal, Vol. 28 No. 13, pp. 1319-1350.
60. Thamhain, H.J. (2003), “Managing innovative R&D teams”, R&D Management, Vol. 33 No. 3, pp. 297-311.
61. Tsoukiàs, A. (2008), “From decision theory to decision aiding methodology”, European Journal of Operational Research, Vol. 187 No. 1, pp. 138-161.
62. Verma, D. and Sinha, K.K. (2002), “Toward a theory of project interdependencies in high tech R & D environments”, Journal of Operations Management, Vol. 20 No. 5, pp. 451-468.
63. von Zedtwitz, M., Gassmann, O. and Boutellier, R. (2004), “Organizing global R&D: challenges and dilemmas”, Journal of International Management, Vol. 10 No. 1, pp. 21-49.
64. Vuolle, M., Lönnqvist, A. and van der Meer, J. (2009), “Measuring the intangible aspects of an R&D project”, Measuring Business Excellence, Vol. 13 No. 2, pp. 25-33.
65. Wang, J., Lin, W. and Huang, Y.H. (2010), “A performance-oriented risk management framework for innovative R&D projects”, Technovation, Vol. 30 Nos 11-12, pp. 601-611.
66. Dvir, D., Lipovetsky, S., Shenhar, A. and Tishler, A. (1998), “In search of project classification: a non-universal approach to project success factors”, Research Policy, Vol. 27 No. 9, pp. 915-935.
67. Landry, M. (1995), A Note on the Concept of Problem, Maurice Landry Faculty of Administrative Sciences, Laval University, Quebec.
68. Roy, B. (2005), “Paradigms and challenges, multiple criteria decision analysis-state of the art survey”, International Series in Operations Research & Management Science, Vol. 78, pp. 3-24.
69. Vincke, P. (1992), Multicriteria Decision-Aid, Wiley, New York, NY.