Bibliometric techniques in the evaluation of federally funded research in the United States

Research Evaluation

Volumn 13, Issue 2, 2004, Pages 78-86

  Hicks, Diana ^a,b   Tomizawa, Hiroyuki ^c   Saitoh, Yoshiko ^c   Kobayashi, Shinichi ^c  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^b CHI Research Inc   (United States)

^c NATIONAL INSTITUTE OF SCIENCE AND TECHNOLOGY POLICY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 7444260164     PISSN: 09582029     EISSN: None     Source Type: Journal    
DOI: 10.3152/147154404781776446     Document Type: Article

References (23)

1. Advisory Board for the Research Councils (1996), Evaluation of National Performance in Basic Research (Department of Education and Science, London).
2. M Albert (1996), Association between NIST's REFPROP Database and Innovativeness in CFC-Replacement Technology, Final Report to NIST on CHI-9621 (CHI Research Inc., Haddon Heights, NJ), December.
3. H Averch (1993), 'Annotated bibliography on evaluation of research, 1985-1990', in B Bozeman and J Melkers, Evaluating R&D Impacts: Methods and Practice (Kluwer, Dordrecht), pages 279-300.
4. K W Boyack and K Borner (2003), 'Indicator-assisted evaluation and funding of research: visualizing the influence of grants on the number and citation counts of research papers', Journal of the American Society for Information Science and Technology, 54(5), pages 447-461.
5. Committee on Science, Engineering, and Public Policy (COSEPUP) (2000), Experiments in International Benchmarking of US Research Fields, (National Academy Press, Washington DC). 〈http://books.nap.edu/html/exp_in_bench/pdf/〉
6. S Cozzens, S Popper, J Bonomo, K Koizumi and A Flanagan (1994), Methods for Evaluating Fundamental Science, RAND/CTI DRU-875/2-CTI, Washington, DC.
7. Department of Defense (1969), Project Hindsight, Office of the Director of Defense Research and Engineering, DTIC Report No. AD495905, October. See also C W Sherwin and R S Isenson (1967), 'Project hindsight: defense department study of the utility of research', Science, 156, pages 1571-1577.
8. L Georghiou and D Roessner (2000), 'Evaluating technology programs: tools and methods', Research Policy, 29, pages 657-678.
9. D Hicks (2000), Final report to Abt Associates, CHI-9912 (CHI Research, Inc., Haddon Heights, NJ), January.
10. D Hicks, P Kroll, F Narin, P Thomas, R Ruegg, H Tomizawa, Y Saitoh and S Kobayashi (2002), Quantitative Methods of Research Evaluation Used by the US Federal Government, NISTEP Study Material No. 86, Second Theory-Oriented Research Group, National Institute of Science and Technology Policy (NISTEP) (Ministry of Education, Culture, Sports, Science and Technology, Japan), 153 pages, May. Also annotated and translated into Japanese. Available at: 〈http://www.nistep.go.jp/achiev/ftx/eng/mat086e/idx086e.html〉
11. Illinois Institute of Technology Research Institute (IITRI) (1968), Technology in Retrospect and Critical Events in Science (National Science Foundation, Washington DC).
12. R N Kostoff (1997), The Handbook of Research Impact Assessment, Seventh Edition, DTIC Report Number ADA296021 (Office of Naval Research: Arlington, VA), summer. Available at 〈http://www.dtic.mil/dtic/kostoff/index.html〉
13. R N Kostoff (2000), Implementation of Textual Data Mining in Government Organizations, presented at the Federal Data Mining Symposium and Exposition, Washington DC, March.
14. J M Logsdon and C B Rubin (1988), 'Research evaluation activities of ten federal agencies', Evaluation and Program Planning, 11, pages 1-11.
15. J Melkers and D Roessner (1997), 'Politics and the political setting as an influence on evaluation activities: national research and technology policy programs in the United States and Canada', Evaluation and Program Planning, 20(1), pages 57-75.
16. F Narin and E Noma (1985), 'Is technology becoming science?', Scientometrics, 7(3), pages 369-381.
17. Office of Technology Assessment (1986), Research Funding as an Investment: Can We Measure the Returns? - A Technical Memorandum (Washington, DC, US Congress, Office of Technology Assessment, OTA-TM-SET-36), April. Available at: 〈http://www.wws.princeton.edu/~ota/disk2/1986/8622_n.html〉
18. Office of Technology Assessment (1991), Federally Funded Research: Decisions for a Decade, OTA-SET-490 (Washington, DC, US Government Printing Office), May. Available at: 〈http://www.wws.princeton.edu/~ota/〉
19. G Pinski and F Narin (1976), 'Citation influence for journal aggregates of scientific publications: theory, with application to the literature of physics', Information Processing and Management, 12(5), pages 297-312.
20. D Roessner, B Bozeman, I Feller, C Hill and N Newman (1997), The Role of NSF's Support of Engineering in Enabling Technological Innovation, first year final report for National Science Foundation (SRI International, Arlington, VA), January. Available at: 〈http://www.sri.com/policy/stp/techin/〉
21. D Roessner, R Carr, I Feller, M McGeary and N Newman (1998), The Role of NSF's Support of Engineering in Enabling Technological Innovation: Phase II, final report to National Science Foundation (SRI International, Arlington, VA) May. Available at: 〈http://www.sri.com/policy/stp/techin2/〉
22. D Stokes (1997), Pasteur's Quadrant: Basic Science and Technological Innovation (Brookings Institution Press, Washington DC).
23. P Thomas (1999), Bibliometric Evaluation of the Research Centers in Minority Institutions (RCMI) Program, report to Quantum Research Corporation, CHI-9814 (CHI Research, Inc., Haddon Heights, NJ), November.