Little race or gender bias in an experiment of initial review of NIH R01 grant proposals

Nature Human Behaviour

Volumn 3, Issue 3, 2019, Pages 257-264

  Forscher, Patrick S ^a,b   Cox, William T L ^a   Brauer, Markus ^a   Devine, Patricia G ^a  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

^b UNIVERSITY OF ARKANSAS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; FEMALE; HUMAN; MALE; MEDICAL RESEARCH; MIDDLE AGED; NATIONAL HEALTH ORGANIZATION; PEER REVIEW; RACISM; SEXISM; UNITED STATES;

ADULT; BIOMEDICAL RESEARCH; FEMALE; HUMANS; MALE; MIDDLE AGED; NATIONAL INSTITUTES OF HEALTH (U.S.); PEER REVIEW, RESEARCH; RACISM; SEXISM; UNITED STATES;

EID: 85060785342     PISSN: None     EISSN: 23973374     Source Type: Journal    
DOI: 10.1038/s41562-018-0517-y     Document Type: Letter

References (27)

1. Ginther, D. K. et al. Race, ethnicity, and NIH research awards. Science 333, 1015–1019 (2011).
2. Ceci, S. J. & Williams, W. M. Understanding current causes of women’s underrepresentation in science. Proc. Natl Acad. Sci. USA 108, 3157–3162 (2011).
3. Pohlhaus, J. R., Jiang, H., Wagner, R. M., Schaffer, W. T. & Pinn, V. W. Sex differences in application, success, and funding rates for NIH extramural programs. Acad. Med. 86, 759–767 (2011).
4. Lakens, D. Equivalence tests: a practical primer for t tests, correlations, and meta-analyses. Soc. Psychol. Personal. Sci. 8, 355–362 (2017).
5. Kaatz, A., Magua, W., Zimmerman, D. R. & Carnes, M. A quantitative linguistic analysis of National Institutes of Health R01 application critiques from investigators at one institution. Acad. Med. 90, 69–75 (2015).
6. Crowne, D. P. & Marlowe, D. A new scale of social desirability independent of psychopathology. J. Consult. Psychol. 24, 349–354 (1960).
7. Moss-Racusin, C. A., Dovidio, J. F., Brescoll, V. L., Graham, M. J. & Handelsman, J. Science faculty’s subtle gender biases favor male students. Proc. Natl Acad. Sci. USA 109, 16474–16479 (2012).
8. Steinpreis, R. E., Anders, K. A. & Ritzke, D. The impact of gender on the review of the curricula vitae of job applicants and tenure candidates: a national empirical study. Sex Roles 41, 509–528 (1999).
9. Lerner, J. S. & Tetlock, P. E. Accounting for the effects of accountability. Psychol. Bull. 125, 255–275 (1999).
10. Tomkins, A., Zhang, M. & Heavlin, W. D. Reviewer bias in single- versus double-blind peer review. Proc. Natl Acad. Sci. USA 114, 12708–12713 (2017).
11. Peterson, D. A. M. Author gender and editorial outcomes at Political Behavior. PS Polit. Sci. Polit. 51, 866–869 (2018).
12. Samuels, D. Gender and editorial outcomes at Comparative Political Studies. PS Polit. Sci. Polit. 51, 854–858 (2018).
13. König, T. & Ropers, G. Gender and editorial outcomes at the American Political Science Review. PS Polit. Sci. Polit. 51, 849–853 (2018).
14. Tudor, C. L. & Yashar, D. J. Gender and the editorial process: World Politics, 2007–2017. PS Polit. Sci. Polit. 51, 870–880 (2018).
15. Nedal, D. K. & Nexon, D. H. Gender in the International Studies Quarterly Review process. PS Polit. Sci. Polit. 51, 859–865 (2018).
16. Williams, W. M. & Ceci, S. J. National hiring experiments reveal 2:1 faculty preference for women on STEM tenure track. Proc. Natl Acad. Sci. USA 112, 5360–5365 (2015).
17. Link, A. M. US and non-US submissions: an analysis of reviewer bias. JAMA 280, 246–247 (1998).
18. Bertrand, M. & Mullainathan, S. Are Emily and Greg more employable than Lakisha and Jamal? A field experiment on labor market discrimination. Am. Econ. Rev. 94, 991–1013 (2004).
19. Bates, D., Mächler, M., Bolker, B. & Walker, S. Fitting linear mixed-effects models using lme4. J. Stat. Softw. 67, 1–48 (2015).
20. Brauer, M. & Curtin, J. J. Linear mixed-effects models and the analysis of nonindependent data: a unified framework to analyze categorical and continuous independent variables that vary within-subjects and/or within-items. Psychol. Med. 23, 389–411 (2018).
21. Halekoh, U. & Højsgaard, S. A Kenward–Roger approximation and parametric bootstrap methods for tests in linear mixed models—the R package pbkrtest. J. Stat. Softw. 59, 1–32 (2014).
22. Fox, J. & Weisberg, S. An R Companion to Applied Regression (SAGE, Los Angeles, CA, USA, 2011).
23. Neale, M. C. et al. OpenMx 2.0: extended structural equation and statistical modeling. Psychometrika 81, 535–549 (2016).
24. Simonsohn, U., Simmons, J. P. & Nelson, L. D. Specification curve: descriptive and inferential statistics on all reasonable specifications. SSRN Electron. J. 10.2139/ssrn.2694998 (2015).
25. Pordes, R. et al. The Open Science Grid. J. Phys. Conf. Ser. 78, 12057 (2007).
26. Sfiligoi, I. et al. The Pilot Way to Grid Resources Using glideinWMS. In 2009 WRI World Congress on Computer Science and Information Engineering (eds Burgin, M. et al.) 428–432 (IEEE, 2009).
27. Tausczik, Y. R. & Pennebaker, J. W. The psychological meaning of words: LIWC and computerized text analysis methods. J. Lang. Soc. Psychol. 29, 24–54 (2009).