How criterion scores predict the overall impact score and funding outcomes for national institutes of health peer-reviewed applications

PLoS ONE

Volumn 11, Issue 6, 2016, Pages

  Eblen, Matthew K ^a,b   Wagner, Robin M ^a,b   RoyChowdhury, Deepshikha ^a   Patel, Katherine C ^a   Pearson, Katrina ^a  

^a NATIONAL INSTITUTES OF HEALTH   (United States)

^b CENTERS FOR DISEASE CONTROL AND PREVENTION   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FUNDING; GENETIC POLYMORPHISM; NATIONAL HEALTH ORGANIZATION; ECONOMICS; MEDICAL RESEARCH; PEER REVIEW; STANDARDS; UNITED STATES;

BIOMEDICAL RESEARCH; NATIONAL INSTITUTES OF HEALTH (U.S.); PEER REVIEW, RESEARCH; UNITED STATES;

EID: 84973865976     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0155060     Document Type: Article

References (21)

1. NIH Budget History, NIH Extramural & Intramural Funding: FY 2014 Enacted 2014 [cited 2015]. Available from: http://report.nih.gov/NIHDatabook/Charts/Default.aspx?showm=Y&chartId=283&catId=1.
2. NIH Peer Review: Grants and Cooperative Agreements. 2013. Available from: http://grants.nih.gov/ grants/PeerReview22713webv2.pdf.
3. Enhancing Peer Review at NIH 2011. Available from: http://enhancing-peer-review.nih.gov/index.html.
4. Enhancing Peer Review: The NIH Announces Updated Implementation Timeline NIH Guide2008 [cited 2014 November 20]. Available from: http://grants.nih.gov/grants/guide/notice-files/NOT-OD-09-023. html.
5. Graves N, Barnett AG, Clarke P. Funding grant proposals for scientific research: retrospective analysis of scores by members of grant review panel. British Medical Journal. 2011; 343. doi: 10.1136/bmj. d4797
6. Viner N, Powell P, Green R. Institutionalized biases in the award of research grants: a preliminary analysis revisiting the principle of accumulative advantage. Research Policy. 2004; 33:443-54.
7. Jayasinghe UW, Marsh HW, Bond N. Peer Review in the Funding of Research in Higher Education: The Australian Experience. Educational Evaluation and Policy Analysis. 2001; 23:343-64. doi: 10. 3102/01623737023004343
8. Jayasinghe UW, Marsh HW, Bond N. A multilevel cross-classified modelling approach to peer review of grant proposals: the effects of assessor and researcher attributes on assessor ratings. Journal of the Royal Statistical Society: Series A (Statistics in Society). 2003; 166(3):22. Epub 9/4/2003. doi: 10.1111/ 1467-985X.00278
9. Marsh HW, Jayasinghe UW, Bond NW. Improving the Peer-Review Process for Grant Applications Reliability, Validity, Bias, and Generalizability. American Psychologist. 2008; 63(3):160-8. doi: 10. 1037/0003-066X.63.3.160 PMID: 18377106
10. Marsh HW, Bornmann L, Mutz R, Daniel H- D, O'Mara A. Gender Effects in the Peer Reviews of Grant Proposals: A Comprehensive Meta-Analysis Comparing Traditional and Multilevel Approaches. Review of Educational Research. 2009; 79(3):1290-326. doi: 10.3102/0034654309334143
11. Ginther DK, Schaffer WT, Schnell J, Masimore B, Liu F, Haak LL, et al. Race, ethnicity, and NIH research awards. Science. 2011; 333(6045):1015-9. doi: 10.1126/science.1196783 PMID: 21852498; PubMed Central PMCID: PMCPMC3412416.
12. Martin MR, Kopstein A, Janice JM. An Analysis of Preliminary and Post-Discussion Priority Scores for Grant Applications Peer Reviewed by the Center for Scientific Review at the NIH. PLoS ONE. 2010; 5 (11). doi: 10.1371/journal.pone.0013526
13. Kotchen TA, Lindquist T, Malik K, Ehrenfeld E. NIH peer review of grant applications for clinical research. JAMA. 2004; 291(7):836-43. doi: 10.1001/jama.291.7.836 PMID: 14970062.
14. Kotchen TA, Lindquist T, Miller Sostek A, Hoffmann R, Malik K, Stanfield B. Outcomes of National Institutes of Health peer review of clinical grant applications. J Investig Med. 2006; 54(1):13-9. PMID: 16409886.
15. Lindner MD, Vancea a, Chen M-C, Chacko G. NIH Peer Review: Scored Review Criteria and Overall Impact. Am J Eval. 2015:1-12. Epub April 29, 2015. doi: 10.1177/1098214015582049
16. Garson GD. Hierarchical Linear Modeling: Guide and Applications. SAGE Publications, Inc.2012. 392 p.
17. Albright JJ. Estimating Multilevel Models using SPSS, Stata, and SAS. 2007.
18. Rabe-Hesketh S, Skrondal A. Multilevel and Longitudinal Modeling Using Stata. Second ed: Stata Press; 2008. 562 p.
19. Wooldridge J. Introductory Econometrics. 3rd ed: Cengage Learning; 2006. 912 p.
20. Goldberger AS. A Course in Econometrics. Cambridge, Massachusetts: Harvard University Press; 1991. 432 p.
21. O'brien RM. A Caution Regarding Rules of Thumb for Variance Inflation Factors. Quality & Quantity: International Journal of Methodology. 2007; 41(5):17. doi: 10.1007/s11135-006-9018-6