Approaches to research and development performance assessment in the United States: An analysis of recent evaluation trends

Science and Public Policy

Volumn 33, Issue 8, 2006, Pages 546-560

  Michelson, Evan S ^a  

^a WOODROW WILSON INTERNATIONAL CENTER FOR SCHOLARS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

PERFORMANCE ASSESSMENT; RESEARCH AND DEVELOPMENT; STANDARDIZATION;

NORTH AMERICA; UNITED STATES;

EID: 33845342904     PISSN: 03023427     EISSN: None     Source Type: Journal    
DOI: 10.3152/147154306781778704     Document Type: Article

References (42)

1. Ailes, Catherine P and Susan H Russell 1998. Evaluation of NSF Programs for Research Improvement in Minority Institutions (RIMI) and Centers for Research Excellence in Science and Technology (CREST). Arlington VA: SRI International. Available at , last accessed 24 July 2006.
2. Ailes, Catherine P, Irwin Feller and H Roberts Coward 2001. The Impact of Engineering Research Centers on Institutional and Cultural Change in Participating Universities. Arlington VA: SRI International, Available at , last accessed 24 July 2006.
3. Ailes, Catherine P, J David Roessner and H Roberts Coward 2000. Documenting Center Graduation Paths. Arlington VA: SRI International. Available at , last accessed 24 July 2006.
4. Branch, K M, M S Peffers, R T Ruegg and R W Vallario 2001. The Science Manager's Resource Guide to Case Studies, PNNL-13668. Seattle WA: Department of Energy. Available at , last accessed 19 July 2006.
5. Bush, Vannevar 1945. Science: The Endless Frontier. Washington DC: United States Government Printing Office. Available at , last accessed 19 July 2006.
6. DHHS, Department of Health and Human Services 2005. Performance Improvement: Evaluation Activities of the U.S. Department of Health and Human Services. Washington DC: Department of Health and Human Services. Available at , last accessed 20 July 2006.
7. DOE, Department of Energy undated. Program Assessment Rating Tool performance measures. Washington DC: Department of Energy. Available at , last accessed 20 July 2006.
8. Energy Citations Database 2006. Energy and energy-related bibliographic citations. Washington DC: United States Department of Energy. Available at , last accessed 19 July 2006.
9. Feller, Irwin and George Gamota 2004. Measurement with theory. Presentation at American Association for the Advancement of Science Annual Meeting, 14 February. Available at , last accessed 19 July 2006.
10. Hicks, Diana, Hiroyuki Tomizawa, Yoshiko Saitoh and Shinichi Kobayahi 2004. Bibliometric techniques in the evaluation of federally funded research in the United States. Research Evaluation, 13(2), August, 76-86.
11. Jordan, Gretchen B and Elizabeth L Malone 2002. Performance assessment. In Management Benchmarking Study, pp. 1-24. Washington DC: Washington Research Evaluation Network. Available at , last accessed 19 July 2006.
12. Lawrence, Peter A 2003. The politics of publication. Nature, 422(20), March, 259-261.
13. Marburger III, John H 2005. Wanted: better benchmarks. Science, 308(20), May, 1087.
14. NIH, National Institutes of Health 2003. NIH Grants Policy Statement. Rockville MD: National Institutes of Health. Available at , last accessed 20 July 2006.
15. NIH, National Institutes of Health 2005. Performance budget overview. Rockville MD: National Institutes of Health. Available at , last accessed 19 July 2006.
16. NIH, National Institutes of Health 2006. Evaluation Branch (EB). Rockville MD: National Institutes of Health. Available at , last accessed 20 July 2006.
17. NIST, National Institute of Standards and Technology 2006. General information. Gaithersburg MD: National Institute of Standards and Technology. Available at , last accessed 19 July 2006.
18. Noonan, Norine E 2004. Report of the Advisory Committee for GPRA Performance Assessment (AC/GPA). Arlington VA: National Science Foundation. Available at , last accessed 19 July 2006.
19. NSF, National Science Foundation 2002. The 2002 User-Friendly Handbook for Project Evaluation. Arlington VA: National Science Foundation. Available at , last accessed 20 July 2006.
20. NSF, National Science Foundation 2003. National Science Foundation Strategic Plan FY 2003-2008. Arlington VA: National Science Foundation. Available at , last accessed 19 July 2006.
21. NSF, National Science Foundation 2005. Grant Policy Manual. Arlington VA: National Science Foundation, 1 July. Available at , last accessed 20 July 2006.
22. NSF, National Science Foundation 2006. Performance assessment information. Arlington VA: National Science Foundation. Available at , last accessed 20 July 2006.
23. NSF, National Science Foundation undated. Online Evaluation Resource Library. Arlington VA: National Science Foundation. Available at , last accessed 20 July 2006.
24. OMB, Office of Management and Budget 2002. The President's Management Agenda. Washington, DC: OMB. Available at http://www.whitehouse.gov/omb/ budget/fy2002/mgmt.pdf, last accessed 19 July 2006.
25. OMB, Office of Management and Budget 2003. Budget of the United States Government, Fiscal Year 2004. Washington DC: OMB. Available at , last accessed 19 July 2006.
26. OMB, Office of Management and Budget 2004. The Federal Government is Results Oriented: a Report to Federal Employees. Washington DC: OMB. Available at , last accessed 19 July 2006.
27. OMB, Office of Management and Budget 2005. The Government Reorganization and Program Performance Improvement Act of 2005. Washington DC: United States Congress, S. 1399, 109th Congress, 1st Session. Available at , last accessed 19 July 2006.
28. OMB, Office of Management and Budget 2006a. The President's management agenda the scorecard. Washington DC: Office of Management and Budget. Available at , last accessed 24 July 2006.
29. OMB, Office of Management and Budget 2006b. Government Efficiency Act of 2006. Washington DC: United States Congress, H.R. 5766, 109th Congress, 2nd Session. Available at , last accessed 20 July 2006.
30. OTA, Office of Technology Assessment 1986. Research Funding as an Investment: Can We Measure the Returns? A Technical Memorandum. Washington DC: United States Congress, OTA-TM-SET-36. ota/disk2/1986/ 8622/8622.PDF>, last accessed 19 July 2006.
31. Roessner, David 2000. Outcomes and Impacts of the State/ Industry-University Cooperative Research Centers (S/IUCRC) Program. Arlington VA: SRI International. Available at , last accessed 24 July 2006.
32. Roessner, David, Robert Carr, Irwin Feller, Michael McGeary and Nils Newman 1998. The Role of NSFs Support of Engineering in Enabling Technological Innovation - Phase II. Arlington VA: SRI International. Available at , last accessed 19 July 2006.
33. Roessner, J David, David W Cheney, and H R Coward 2004. Impact on Industry of Interaction with Engineering Research Centers - Repeat Study. Arlington VA: SRI International. Available at , last accessed 24 July 2006.
34. Ruegg, Rosalie 2003. Benchmarking Evaluation of Public Science and Technology Programs in the United States, Canada, Israel, and Finland Proceedings of a Workshop Sponsored by Tekes - National Technology Agency of Finland. Emerald Isle NC: TIA Consulting Inc. Available at , last accessed 19 July 2006.
35. Ruegg, Rosalie and Irwin Feller 2003. A Toolkit for Evaluating Public R&D Investment. Models, Methods, and Findings from ATP's First Decade. Gaithersburg MD: National Institute of Standards and Technology, NIST GCP 03-857. Available at , last accessed 19 July 2006.
36. SRI International 1997. The Impact on Industry of Interaction with Engineering Research. Arlington VA: SRI International. Available at , last accessed 24 July 2006.
37. The National Academies 1999. Evaluating Federal Research Programs: Research and the Government Performance and Results Act. Washington DC: National Academy Press.
38. The National Academies 2001. Implementing the Government Performance and Results Act for Research: a Status Report. Washington DC: National Academy Press.
39. Thomas, Patrick 2004. Demonstrating the link between scientific papers and technology hot spots. Presentation at the American Evaluation Association, November, Atlanta GA. Available at , last accessed 20 July 2006.
40. Valdez, Bill 2004. DOE-SC evaluation, research, and policy development. Presentation at the American Evaluation Association, November, Atlanta GA. Available at , accessed 20 July 2006.
41. Valdez, Bill 2005. DOE's-SC evaluation, research, and policy development. Presentation at KISTEP-WREN Work-shop/international Symposium, May, Seoul, South Korea. Available at , last accessed 20 July 2006.
42. Weingart, Peter 2005. Impact of bibliometrics upon the science system: inadvertent consequences?. Scientometrics, 62(1), January, 117-131.