Evaluating performance of national R and D organizations using integrated DEA-AHP technique

International Journal of Productivity and Performance Management

Volumn 57, Issue 5, 2008, Pages 370-388

  Jyoti, ^a   Banwet, D K ^a   Deshmukh, S G ^a  

^a INDIAN INSTITUTE OF TECHNOLOGY DELHI   (India)

Author keywords

Analytical hierarchy process; Data analysis; India; Performance measurement (quality); Process efficiency; Research and development

Indexed keywords

EID: 46749105998     PISSN: 17410401     EISSN: None     Source Type: Journal    
DOI: 10.1108/17410400810881836     Document Type: Article

References (51)

1. Azadeh, A., Ghaderi, S.F. and Izadbakhsh, H. (2007), "Integration of DEA and AHP with computer simulation for railway system improvement and optimization", Applied Mathematics and Computation, Vol. 195, pp. 775-85.
2. Barua, A., Brockett, P.L., Cooper, W.W., Deng, H., Parker, B.R., Ruefli, T.W. and Whinston, A. (2004), "DEA evaluations of long- and short-run efficiencies of digital, vs. physical product 'dot com' companies", Socio-economic Planning Sciences, Vol. 38, pp. 233-53.
3. Bremser, W.G. and Barsky, N.P. (2004), "Utilizing the balanced scorecard for R&D performance measurement", R&D Management, Vol. 34 No. 3, pp. 229-37.
4. Brown, M.G. and Svenson, R.A. (1998), "Measuring R&D productivity", Research and Technology Management, Vol. 41 No. 6, pp. 30-5.
5. Brown, W.B. and Gobeli, D. (1992), "Observations on the measurement of R&D productivity: a case study", IEEE Transactions on Engineering Management, Vol. 39 No. 4, pp. 325-31.
6. Calantone, R.J., Benedetto, C.A.D. and Schmidt, J.B. (1999), "Using the analytic hierarchy process in new product screening", Journal of Product Innovation Management, Vol. 16 No. 1, pp. 65-76.
7. Charnes, A., Cooper, W.W. and Rhodes, E. (1978), "Measuring the efficiency of decision making units", European Journal of Operational Research, Vol. 2 No. 6, pp. 429-44.
8. Chen, A., Hwang, Y. and Shao, B. (2005), "Measurement and sources of overall and input inefficiencies: evidences and implications in hospital services", European Journal of Operational Research, Vol. 161, pp. 447-68.
9. Chen, T., Chien, C.F., Wang, J.T. and Lin, M.H. (2004), "Using DEA to evaluate R&D performance of the computers and peripherals firms in Taiwan", International Journal of Business, Vol. 9 No. 3.
10. Chen, T.Y. and Chen, L.H. (2007), "DEA performance evaluation based on BSC indicators incorporated: the case of semiconductors industry", International Journal of Productivity and Performance Management, Vol. 56 No. 4, pp. 335-57.
11. Chien, C.F., Lo, F.Y. and Lin, J.T. (2003), "Using DEA to measure the relative efficiency of the service center and improve operation efficiency through reorganization", IEEE Transactions on Power Systems, Vol. 18 No. 1, pp. 366-73.
12. Chiesa, V. and Masella, C. (1996), "Searching for an effective measure of R&D performance", Management Decision, Vol. 34 No. 7, pp. 49-57.
13. Chiesa, V., Frattini, F., Lazzarotti, V. and Manzini, R. (2007), "How do measurement objectives influence the R&D performance measurement system design? Evidence from a multiple case study'", Management Research News, Vol. 30 No. 3, pp. 187-202.
14. Coccia, M. (2001), "A basic model for evaluating R&D performance: theory and application in Italy", R&D Management, Vol. 31 No. 4, pp. 453-64.
15. Coccia, M. (2004), "New models for measuring the R&D performance and identifying the productivity of public research institutes", R&D Management, Vol. 34 No. 3, pp. 267-80.
16. Cook, T.J., Vansant, J., Stewart, L. and Adrian, J. (1995), "Performance measurement: lessons learned for development management", World Development, Vol. 23 No. 8, pp. 1303-15.
17. CSIR Vision (2001), available at: www.csir.res.in.
18. Devila, T. (2000), "An empirical study on the drivers of management control systems design in new product development", Accounting, Organizations and Society, Vol. 25, p. 383.
19. Easton, L., Murphy, D.J. and Pearson, J.N. (2002), "Purchasing performance evaluation: with data envelopment analysis", European Journal of Purchasing & Supply Management, Vol. 8, pp. 123-34.
20. Ertay, T., Ruan, D. and Tuzkaya, U.R. (2006), "Integrating data envelopment analysis and analytic hierarchy for the facility layout design in manufacturing systems", Information Sciences, Vol. 176, pp. 237-62.
21. Globerson, S. (1985), "Issues in developing a performance criteria system for an organization", International Journal of Production Research, Vol. 23 No. 4, pp. 639-49.
22. Guo, J.Y., Liu, J. and Qiu, L. (2006), "Research on supply chain performance evaluation: based on DEA/AHP model", Proceedings of the IEEE Asia-Pacific Conference on Services Computing (APSCC'02).
23. Hauser, J.R. and Zettelmeyer, F. (1997), "Metrics to evaluate R, D & E", Research-technology Management, July-August, pp. 32-8.
24. Hegde, G.G. and Tadikamalla, P.R. (1990), "Site selection for a sure service terminal", European Journal of Operation Research, Vol. 48, pp. 77-80.
25. Ho, W. (2008), "Integrated analytic hierarchy process and its applications - a literature review", European Journal of Operational Research, Vol. 186, pp. 211-28.
26. Hsu, K.H. (2005), "Using balanced scorecard and fuzzy data envelopment analysis for multinational R&D project performance assessment", Journal of America Academy of Business, Vol. 7 No. 1, pp. 189-96.
27. Hwang, S.N. and Chang, T.Y. (2003), "Using data envelopment analysis to measure hotel managerial efficiency change in Taiwan", Tourism Management, Vol. 24, pp. 357-69.
28. India Vision 2020 (2002), Planning Commission, Government of India, December 2002, available at: http://planningcommission.nic.in/reports/genrep/ plvsn2020.pdf.
29. Jain, R.K. and Triandis, H.C. (1997), Management of Research and Development Organizations: Managing the Unmanageable, 2nd ed., John Wiley & Sons, New York, NY.
30. Jing-yuan, G., Jia, L. and Li, Q. (2006), "Research on supply chain performance evaluation based on DEA/AHP model", Proceedings of the 2006 IEEE Asia-Pacific Conference on Services Computing (APSCC'06).
31. Karlsson, M., Trygg, L. and Elfstrom, B.O. (2004), "Measuring R&D productivity: complementing the picture by focusing on research activities", Technovation, Vol. 24, pp. 179-86.
32. Kerssen-van Drongelen, I.C. and Cook, A. (1997), "Design principles for the development of measurement systems for research and development processes", R&D Management, Vol. 27 No. 4, pp. 345-57.
33. Kim, B. and Oh, H. (2002), "An effective R&D performance measurement system: survey of Korean R&D researchers", Omega, Vol. 30, pp. 19-31.
34. Kocher, M.G., Luptacik, M. and Sutter, M. (2006), "Measuring productivity of research in economics: a cross-country study using DEA", Socio-Economic Planning Sciences, Vol. 40, pp. 314-32.
35. Korhonen, P.J. and Luptacik, M. (2004), "Eco-efficiency analysis of power plants: an extension of data envelopment analysis", European Journal of Operational Research, Vol. 154, pp. 437-46.
36. Korpela, J., Lehmusvaara, A. and Nisonen, J. (2007), "Warehouse operator selection by combining AHP and DEA methodologies", International Journal of Production Economics, Vol. 108, pp. 135-42.
37. Leitner, K.H., Linzatti, M.S., Stowasser, R. and Wagner, K. (2005), "Data envelopment analysis as method for evaluating intellectual capital", Journal of Intellectual Capital, Vol. 6 No. 4, pp. 528-43.
38. Liberatore, M.J. (1987), "An extension of the analytic hierarchy process for industrial R&D project selection and resource allocation", IEEE Transaction on Engineering Management, Vol. 34 No. 1, pp. 12-18.
39. Loch, C.H. and Tapper, U.A.S. (2001), "Implementing a strategy-driven performance measurement system for an applied research group", The Journal of Product Innovation Management, Vol. 19, pp. 185-98.
40. Lozano, S. and Villa, G. (2007), "Multiobjective target setting in data envelopment analysis using AHP", Computers & Operations Research, in press.
41. Pappas, R.A. and Remer, D.S. (1985), "Measuring R&D productivity", Research Technology Management, May-June.
42. Paradi, J.C. and Schaffnit, C. (2004), "Commercial branch performance evaluation, and results communication in a Canadian bank - a DEA application", European Journal of Operational Research, Vol. 156, pp. 719-35.
43. Ramanathan, R. (2006), "Data envelopment analysis for weight derivation and aggregation in the analytic hierarchy process", Computers & Operations Research, Vol. 33, pp. 1289-307.
44. Roy, S., Nagpaul, P.S. and Mohapatra, K.J. (2003), "Developing a model to measure the effectiveness of research units", International Journal of Operations & Production Management, Vol. 23 No. 12, pp. 1514-29.
45. Saaty, T.L. (1990), "How to make a decision: the analytic hierarchy process", European Journal of Operational Research, Vol. 48, pp. 9-26.
46. Wang, K., Wang, C.K. and Hu, C. (2005), "Analytic hierarchy process with fuzzy scoring in evaluating multidisciplinary R&D projects in China'", IEEE Transactions on Engineering Management, Vol. 52 No. 1, pp. 119-29.
47. Wang, Y.M., Liu, J. and Elhag, M.S. (2007), "An integrated AHP-DEA methodology for bridge risk assessment", Computer & Industrial Engineering, in press.
48. Werner, B. and Souder, W.E. (1997), "Measuring R&D performance - US and German practices", Research Technology Management, Vol. 40 No. 2, pp. 28-32.
49. Yang, J., Lee, H. and An, A.H.P. (1997), "decision model for facility location selection", Facilities, Vol. 15 Nos 9/10.
50. Yang, T. and Kuo, C. (2003), "A hierarchical AHP/DEA methodology for facilities layout design problem", European Journal of Operational Research, Vol. 147, pp. 128-36.
51. Cooper, W.W., Seiford, L.M. and Tone, K. (2004), Data Envelopment Analysis A Comprehensive Text with Models, Applications, References and DEA-Solver Software, Kluwer Academic Publishers, Boston, MA.