Why impact analysis should not be used for research evaluation and what the alternatives are

Agricultural Systems

Volumn 78, Issue 2, 2003, Pages 166-184

  Ekboir, Javier ^a  

^a INTERNATIONAL MAIZE AND WHEAT IMPROVEMENT CENTER CIMMYT   (Mexico)

Author keywords

Complexity; Random processes; Research policy

Indexed keywords

AGRICULTURAL RESEARCH; INTELLECTUAL PROPERTY RIGHTS; SOCIOECONOMIC IMPACT;

EID: 0142059796     PISSN: 0308521X     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0308-521X(03)00125-2     Document Type: Article

References (48)

1. Alston, J., Norton, G., Pardey, P., 1995. Science under Scarcity: Principles and Practice for Agricultural Research Evaluation and Priority Setting. Cornell University Press.
2. Anderson, J., Hardaker, J.B., 1992. Efficacy and efficiency in agricultural research: a systems view. Agricultural Systems 40, 105-123.
3. Archibugi, D., Howells, J., Michie, J., 1999. Innovation systems and policy in a global economy. In: Archibugi, D., Howells, J., Michie, J. (Eds.), Innovation Policy in a Global Economy. Cambridge University Press, UK.
4. Arthur, W.B, Durlauf, S.N., Lane, D.A., 1997. Introduction. In: Arthur, W.B, Durlauf, S.N., Lane, D.A. (Eds.), The Economy as an Evolving Complex System II. Santa Fe Institute in the Sciences of Complexity, Addison Weasley Longman, Inc, MA USA.
5. Branson, I., Foster, P., 1987. Economies of size of USDA agricultural research stations. IEEE Transactions on Engineering Management 34 (3), 156-160.
6. Brennan, J.P., 1999. Efficiency in wheat improvement research: a case study of Australia. In: Maredia, M.K., Byerlee, D. (Eds.), The Global Wheat Improvement System: Prospects for Enhancing Efficiency in the Presence of Spillovers. CIMMYT Research Report No. 5, Mexico, D.F.
7. Byerlee, D., Alex, G., 1998. Strengthening National Agricultural Research Systems. Policy Issues and Good Practice, World Bank, Washington, DC.
8. Byerlee, D., Traxler, G., 1996. The role of technology spillovers and economies of size in the efficient design of agricultural research systems. In: Proceedings of the Conference Global Agricultural Science Policy for the Twenty-First Century, Melbourne, Australia, pp. 392-429.
9. Chess, C., Hance, B., Gibson, G., 2000. Adaptive participation in Watershed Management. Journal of Soil and Water Conservation 55 (3), 248-270.
10. Collins, R.A., Yeager, J.L., 1988. Staff evaluation and incentive practices utilized by behavioral science research organizations: a pilot study. Journal of the Society of Research Administrators 119-134.
11. Davis, J.S., 1994. Spillover effects of agricultural research: importance for research policy and incorporation in research evaluation models. In: Anderson, J.R. (Ed.), Agricultural Technology: Policy Issues for the International Community. CAB International, Wallingford, UK.
12. Dixit, A.K., Pindyck, R.S., 1994. Investment under Uncertainty. Princeton University Press.
13. Echeverría, R.G., 1998. Agricultural policy issues in Latin America: an overview. World Development 26 (6), 1103-1111.
14. Ekboir, J.M., 2002. Developing no-till packages for small-scale farmers. In: Ekboir, J. (Ed.), World Wheat Overview and Outlook. CIMMYT, Mexico, DF.
15. Ekboir, J.M., 2001. Sistemas de Innovación y Política Tecnológica: Siembra Directa en el MERCOSUR. In: Díaz Roselló, R. (Ed.), Siembra Directa en el Cono Sur. Uruguay, PROCISUR.
16. FAO, 2001. FAOSTAT, www.fao.org.
17. Gallagher, R., Appenzeller, T., 1999. Beyond reductionism. Science 284 (April 2), 79.
18. Geroski, P., 1995. Markets for technology: knowledge, innovation and appropriability. In: Stoneman, P. (Ed.), Handbook of the Economics of Innovation and Technological Change. Blackwell Publishers Inc, UK.
19. Hare, P., Wyatt, G., 1988. Modeling the determination of research output in British universities. Research Policy 17, 315-328.
20. Henderson, R., Cockburn, I., 1996. Scale, scope, and spillovers: the determinants of research productivity in drug discovery. RAND Journal of Economics 27 (1), 32-59.
21. Holmstrong, B., 1989. Agency cost and innovation. Journal of Economic Behavior and Organization 12, 305-327.
22. Huffman, W.E., Just, R., 2000. Setting efficient incentives for agricultural research: lessons from principal-agent theory. American Journal of Agricultural Economics 82 (4), 828-841.
23. IDRC, 1997 A Decade of Reform, www.idrc.ca.
24. Jain, K.B.L., Byerlee, D., 1999, Investment efficiency at the national level: wheat improvement research in India. In: Maredia, M.K. and Byerlee, D. (Eds.), The Global Wheat Improvement System: Prospects for Enhancing Efficiency in the Presence of Spillovers, CIMMYT Research Report No. 5, Mexico, D.F.
25. Kauffman, S., 1995. At Home in the Universe: The Search for the Laws of Self-Organization and Complexity. Oxford University Press, NY.
26. Klette, J., 1996. R&D, Scope economies, and plant performance. RAND Journal of Economics 27 (3), 502-522.
27. Malerba, F., 1993. The national system of innovation: Italy. In: Nelson, R. (Ed.), National Innovation Systems, A Comparative Analysis. Oxford University Press, NY.
28. Maredia, M.K., Byerlee, D., 1999, Toward efficient allocation of research resources in the presence of spillovers: lessons from wheat improvement research. In: Maredia, M.K. and Byerlee, D. (Eds.), The Global Wheat Improvement System: Prospects for Enhancing Efficiency in the Presence of Spillovers. CIMMYT Research Report No. 5, Mexico, D.F., Mexico.
29. McClellan III, J.E., Dorn, H., 1999. Science and Technology in World History. The John Hopkins University Press, Baltimore MD.
30. Morris, M.L., Risopoulos, J., Bak, D.L. 1999, Genetic Change in Farmer-Recycled Maize Seed: A Review of the Evidence, CIMMYT Economics Working Paper No. 99-07, CIMMYT, Mexico, D.F., Mexico.
31. Nelson, R., Rosenberg, N., 1993. Technical Innovation and National Systems. In: Nelson, R. (Ed.), National Innovation Systems, A Comparative Analysis. Oxford University Press, NY.
32. North, D.C., 1991. Institutions, Institutional Change and Economic Performance. Cambridge University Press, New York, NY.
33. OECD. 1999, Managing National Innovation Systems, France.
34. OECD. 1997, The Evaluation of Scientific Research: Selected Experiences, OCDE/GD(97) 194, France.
35. OECD. 1996, STI Review, Special Issue on Government Technology Foresight. No. 17, March 12, 1996, France.
36. Okubo, Y., 1997, Bibliometric Indicators and Analysis of Research Systems: Methods and Examples, STI working paper 1997/1, OCDE/GD(97)41, OCDE, France.
37. Phelan, E.E. 1995. From chaos to complexity in strategic planning. Presented at the 55th Annual Meeting of the Academy of Management, 6-9 August, Vancouver, Canada.
38. Pulwarty, R.S., Melis, T.S., 2001. Climate extremes and adaptive management on the Colorado River: lessons from the 1997-1998 ENSO Event. Journal of Environmental Management 63 (3), 307-325.
39. Rozelle, S., Pray, C., Huang, J., 1997. Agricultural research policy in China: testing the limits of comercialization-led reform. Comparative Economic Studies 39 (2), 37-71.
40. Rycroft, R.W., Kash, D.E. 1999, The Complexity Challenge: Technological Innovation for the 21st Century. Science, Technology and the International Political Economy Series, A Cassell Imprint, NY.
41. Salter, A.J., Martin, B.R., 2001. The economic benefits of publicly funded basic research: a critical review. Research Policy 30, 509-532.
42. Smale, M., Aguirre, A., Bellón, M.R., Mendoza, J., Rosas, I.M. 1999, Farmer Management of Maize Diversity in the Central Valleys of Oaxaca, 1998 Baseline Socioeconomic Survey, CIMMYT Economics Working Paper No. 99-09, CIMMYT INIFAP, Mexico, D.F., Mexico.
43. Schmookler, J., 1972. The size of firm and the growth of knowledge. In: Schmookler, J. (Ed.), Patents, Invention, and Economic Change. Harvard University Press, Cambridge, MA.
44. Stacey, R.D., Griffin, D., Shaw, P., 2000. Complexity and Management. Fad or Radical Challenge to Systems Thinking?. Routledge, NY.
45. Stoneman, P., 1995. Introduction. In: Stoneman, P. (Ed.), Handbook of the Economics of Innovation and Technological Change. Blackwell Publishers Inc, UK.
46. Traxler, G., Byerlee, D., Jain, K.B.L., 1995, The Downsizing of Agricultural Research: Incorporating Scale Economies and Spillovers in the Research Evaluation. Presented at the Meeting of the American Agricultural Economics Association, 6-9 August 1995, Indianapolis, Indiana.
47. Von Krogh, G., Ichijo, K., Nonaka, I., 2000. Enabling Knowledge Creation, How to Unlock the Mystery of Tacit Knowledge and Release the Power of Innovation. Oxford University Press, NY.
48. Zenger, T., 1994. Explaining organizational diseconomies of scale in R-D: agency problems and the allocation of engineering talent, ideas and effort by firm size. Management Science 40 (6), 708-729.