Charting the Impact of Federal Spending for Education Research: A Bibliometric Approach

Educational Researcher

Volumn 43, Issue 7, 2014, Pages 361-370

  Milesi, Carolina ^a   Brown, Kevin L ^a   Hawkley, Louise ^a   Dropkin, Eric ^a   Schneider, Barbara L ^b  

^a UNIVERSITY OF CHICAGO   (United States)

^b MICHIGAN STATE UNIVERSITY   (United States)

Author keywords

educational policy; evaluation; faculty careers; higher education; mixed methods; policy analysis; program evaluation; quasi experimental analysis; regression discontinuity

Indexed keywords

EID: 84908595981     PISSN: 0013189X     EISSN: 1935102X     Source Type: Journal    
DOI: 10.3102/0013189X14554002     Document Type: Article

References (39)

1. Althouse B. M.,West J. D.,Bergstrom C. T.,Bergstrom T.Differences in impact factor across fields and over time.Journal of the American Society for Information Science and Technology. 2009;60:27-34
2. ArendtJ. (2010). Are article influence scores comparable across scientific fields?Issues in Science and Technology Librarianship. Retrieved from http://www.istl.org/10-winter/refereed2.html.
3. Bloom H. S.Using “short” interrupted time-series analysis to measure the impacts of whole-school reforms: With applications to a study of accelerated schools.Evaluation Review. 2003;27:3-49
4. Borgman C. L.,Furner J.Scholarly communication and bibliometrics.Annual Review of Information Science and Technology. 2002;36:3-72
5. Dietz J. S.Scientists and engineers in academic research centers: An examination of career patterns and productivity. Atlanta: Georgia Institute of Technology; 2004:
6. Dietz J. S.,Bozeman B.Academic careers, patents, and productivity: Industry experience as scientific and technical human capital.Research Policy. 2005;34:349-367
7. Dietz J. S.,Chompalov I.,Bozeman B.,Lane E. O.,Park J.Using the curriculum vita to study the career paths of scientists and engineers: An exploratory assessment.Scientometrics. 2000;49:419-442
8. Gaughan M.,Bozeman B.Using curriculum vitae to compare some impacts of NSF research grants with research center funding.Research Evaluation. 2002;11:17-26
9. Program evaluation: Experienced agencies follow a similar model for prioritizing research. Washington, DC: Accountability Office; 2011:
10. Designing evaluations, 2012 revision. Washington, DC: Author; 2012:
11. Hedges L. V.,Hanis-Martin J.Education research on trial: Policy reform and the call for scientific rigor. Walters P. B.Lareau A.Ranis S. H., ed. New York, NY: Routledge; 2009:105-124.
12. NIH Extramural Center programs. Washington, DC: National Academies Press; 2004:
13. Kostoff R. N.Research requirements for research impact assessment.Research Policy. 1995;24:869-882
14. Kroc R. J.Using citation analysis to assess scholarly productivity.Educational Researcher. 1984;13 (6): 17-22
15. Larivière V.,Archambault E.,Gingras Y.,Vignola-Gagné E.The place of serials in referencing practices: Comparing natural sciences and engineering with social sciences and humanities.Journal of the American Society for Information Science and Technology. 2006;57:997-1004
16. McVeigh M. E.,Mann S. J.The journal impact factor denominator: Defining citable (counted) items.Journal of the American Medical Association. 2009;302:1107-1109
17. MervisJ. (2013). A U.S. makeover for STEM education: What it means for NSF and the Education Department. ScienceInsider. Retrieved from http://news.sciencemag.org/scienceinsider/2013/04/a-us-makeover-for-stem-education.html
18. Moffitt R.Program evaluation with nonexperimental data.Evaluation Review. 1991;15:291-314
19. Rising above the gathering storm: Energizing and employing America for a brighter economic future. Washington, DC: National Academies Press; 2007:
20. A national action plan for addressing the critical needs of the U.S. science, technology, engineering, and mathematics education system. Arlington, VA: National Science Foundation; 2007:
21. National Science Foundation. (2010). Research and evaluation on education in science and engineering (REESE). NSF 10-586. Retrieved from http://www.nsf.gov/pubs/2010/nsf10586/nsf10586.htm
22. Ramsden P.Describing and explaining research productivity.Higher Education. 1994;28:207-226
23. Rosas S. R.,Kagan J. M.,Schouten J. T.,Slack P. A.,Trochim W. M. K.Evaluating research and impact: A bibliometric analysis of research by the NIH/NIAID HIV/AIDS clinical trials networks.PLoS ONE. 2011;6:e17428
24. Sabharwal M.Comparing research productivity across disciplines and career stages.Journal of Comparative Policy Analysis: Research and Practice. 2013;:
25. Sabharwal M.,Hu Q.Participation in university-based research centers: Is it helping or hurting researchers?.Research Policy. 2013;42:1301-1311
26. San Francisco Declaration on Research Assessment. (2013). Home page. Retrieved from http://www.ascb.org/dora/.
27. Schneider B.Education research on trial: Policy reform and the call for scientific rigor. Walters P. B.Lareau A.Ranis S. H., ed. New York, NY: Routledge; 2009:
28. Schneider B.,Carnoy M.,Kilpatrick J.,Schmidt W. H.,Shavelson R. J.Estimating causal effects using experimental and observational designs. Washington, DC: American Educational Research Association; 2007:
29. Schoepflin U.,Glänzel W.Two decades of “scientometrics”: An interdisciplinary field represented by its leading journal.Scientometrics. 2001;50:301-312
30. Seglen P. O.Why the impact factor of journals should not be used for evaluating research.British Medical Journal. 1997;314:498-502
31. Shadish W. R.,Cook T. D.,Campbell D. T.Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin; 2002:
32. Skoie H.Bibliometrics: Some warnings from the north.Scientometrics. 1999;45:433-437
33. Steiner P. M.,Wroblewski A.,Cook T. D.The Sage international handbook of educational evaluation. Ryan K.Cousins J. B., ed. Thousand Oaks, CA: Sage; 2009:75-96.
34. Thomson Reuters. (2008). Using bibliometrics: A guide to evaluating research performance with citation data. Alexandria, VA: Author. Retrieved http://ip-science.thomsonreuters.com/m/pdfs/325133_thomson.pdf
35. Thomson Reuters. (2012). The Thomson Reuters journal selection process. Retrieved from http://thomsonreuters.com/products_services/science/free/essays/journal_selection_process/.
36. Trochim W. M.,Marcus S. E.,Mâsse L. C.,Moser R. P.,Weld P. C.The evaluation of large research initiatives: A participatory integrative mixed- methods approach.American Journal of Evaluation. 2008;29:08-28
37. Van BarneveldA.ArnoldK. E.CampbellJ. P. (2012). Analytics in higher education: Establishing a common language. EDUCAUSE Learning Initiative. Retrieved from http://sites.ewu.edu/elearningservices/files/2012/06/Analytics-in-Higher-Education-Establishing-a-Common-Language-ELI3026.pdf
38. Vinkler P.Evaluation of the publication activity of research teams by means of scientometric indicators.Current Science. 2000;79:602-612
39. Vinkler P.Correlation between the structure of scientific research, scientometric indicators and GDP in EU and non-EU countries.Scientometrics. 2008;74:237-254