The emergence and reduction of bias in letters of recommendation

Journal of Applied Social Psychology

Volumn 43, Issue 11, 2013, Pages 2297-2306

  Morgan, Whitney Botsford ^a   Elder, Katherine B ^b   King, Eden B ^b  

^a UNIVERSITY OF HOUSTON DOWNTOWN   (United States)

^b GEORGE MASON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84887613617     PISSN: 00219029     EISSN: 15591816     Source Type: Journal    
DOI: 10.1111/jasp.12179     Document Type: Article

References (58)

1. Aamodt, M. G., Bryan, D. A., & Whitcomb, A. J. (1993). Predicting performance with letters of recommendation. Public Personnel Management, 22, 81-90.
2. Aamodt, M. G., Nagy, M. S., & Thompson, N. (1998). Employment references: Who are we talking about? Paper presented at the International Personnel Management Association Assessment Council, Chicago, IL.
3. Baltes, B. B., Bauer, C. B., & Frensch, P. A. (2007). Does a structured free recall intervention reduce the effect of stereotypes on performance ratings and by what cognitive mechanism? Journal of Applied Psychology, 92, 151-164.
4. Baxter, J. C., Brock, B., Hill, P. C., & Rozelle, R. M. (1981). Letters of recommendation: A question of value. Journal of Applied Psychology, 66, 296-301.
5. Bertrand, M., & Mullainathan, S. (2004). Are Emily and Greg more employable than Lakisha and Jamal? A field experiment on labor market discrimination. American Economic Review, 94, 991-1013.
6. Bragger, J. D., Kutcher, E., Morgan, J., & Firth, P. (2002). The effects of the structured interview on reducing biases against pregnant job applicants. Sex Roles, 46, 215-226.
7. Brem, C., Lampman, C., & Johnson, M. (1995). Preparation of applications for academic positions in psychology. American Psychologist, 50, 533-537.
8. Browning, R. C. (1968). Validity of reference ratings from previous employers. Personnel Psychology, 21, 389-393.
9. Burrelli, J. (2004). Science and engineering doctorate award. National Science Foundation (NSF 05-300).
10. Campion, M. A., Palmer, D. K., & Campion, J. E. (1997). A review of structure in the selection interview. Personnel Psychology, 50, 655-702.
11. Cascio, W. F., & Aguinis, H. (2004). Applied psychology in human resource management (6th ed.). Upper Saddle River, NJ: Prentice Hall.
12. Cascio, W. F., Jacobs, R., & Silva, J. (2010). Validity, utility, and adverse impact: Practical implications from 30 years of data. In J. L. Outtz (Ed.), Adverse impact: Implication for organizational staffing and high stakes selection, SIOP organizational frontiers series (pp. 271-322). New York: Routledge/Taylor & Francis Group.
13. Conway, J. M., Jako, R. A., & Goodman, D. F. (1995). A meta-analysis of interrater and internal consistency reliability of selection interviews. Journal of Applied Psychology, 80, 565-579.
14. Cotton, J. L., O'Neill, B. S., & Griffin, A. (2008). The "name game": Affective and hiring reactions to first names. Journal of Managerial Psychology, 23, 18-39.
15. Deitch, E. A., Barsky, A., Butz, R. M., Chan, S., Brief, A. P., & Bradley, J. C. (2003). Subtle yet significant: The existence and impact of everyday racial discrimination in the workplace. Human Relations, 56, 1299-1324.
16. Devine, P. G. (1989). Stereotypes and prejudice: Their automatic and controlled components. Journal of Personality and Social Psychology, 56, 5-18.
17. Dovidio, J. F., Fazio, R. H., & Tanur, J. M. (1992). New technologies for the direct and indirect assessment of attitudes. In J. M. Tanur (Ed.), Questions about questions: Inquiries into the cognitive bases of surveys (pp. 204-237). New York: Russell Sage Foundation.
18. Eagly, A. H., & Karau, S. J. (2002). Role congruity theory of prejudice toward female leaders. Psychological Review, 109, 573-598.
19. Fazio, R. H., Jackson, J. R., Dunton, B. C., & Williams, C. J. (1995). Variability in automatic activation as an unobstrusive measure of racial attitudes: A bona fide pipeline? Journal of Personality and Social Psychology, 69, 1013-1027.
20. Fiske, S. T., & Taylor, S. E. (1991). Social cognition (2nd ed.). New York: McGraw-Hill.
21. Fryer, R. G., & Levitt, S. D. (2004). The causes and consequences of distinctively black names. Quarterly Journal of Economics, 119, 767-805.
22. Gatewood, R., & Feild, H. (2001). Human resource selection: Application forms, training and experience evaluations, and reference checks (5th ed.). Mason, OH: Roche, M.
23. Goldberg, C. B. (2005). Relational demography and similarity-attraction in interview assessments and subsequent offer decisions: Are we missing something? Group and Organization Management, 30, 597-624.
24. Greenwald, A. G., & Banaji, M. R. (1995). Implicit social cognition: Attitudes, self-esteem, and stereotypes. Psychological Review, 102, 4-27.
25. Heilman, M. E. (1995). Sex stereotypes and their effects in the workplace: What we know and what we don't know. Journal of Social Behavior and Personality, 10, 3-26.
26. Heilman, M. E., Block, C. J., Martell, R. F., & Simon, M. C. (1989). Has anything changed? Current characterizations of men, women, and managers. Journal of Applied Psychology, 74, 935-942.
27. Heilman, M. E., & Haynes, M. C. (2005). No credit where credit is due: Attributional rationalization of women's success in male-female teams. Journal of Applied Psychology, 90, 905-916.
28. Heilman, M. E., & Haynes, M. C. (2008). Subjectivity in the appraisal process: A facilitator of gender bias in work settings. Beyond common sense: Psychological science in the courtroom. In E. Borgida & S. T. Fiske (Eds.), Beyond common sense: Psychological science in the courtroom (pp. 127-155). Malden: Blackwell Publishing.
29. Heilman, M. E., Wallen, A. S., Fuchs, D., & Tamkins, M. M. (2004). Penalties for success: Reactions to women who succeed at male gender-typed tasks. Journal of Applied Psychology, 89, 416-427.
30. Huffcutt, A. I., Conway, J. M., Roth, P. L., & Klehe, U. C. (2004). The impact of job complexity and study design on situational and behavior description interview validity. International Journal of Selection and Assessment, 12, 262-273.
31. Hunter, J. E., & Hunter, R. F. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 74, 72-98.
32. Keeping, L. M., & Levy, P. E. (2000). Performance appraisal reactions: Measurement, modeling, and method bias. Journal of Applied Psychology, 85, 708-723.
33. King, E. B., Madera, J. M., Hebl, M. R., Knight, J. L., & Mendoza, S. A. (2006). What's in a name? A multiracial investigation of the role of occupational stereotypes in selection decisions. Journal of Applied Social Psychology, 36, 1145-1159.
34. Kleinke, C. L. (1978). Perceived approbation in short, medium, and long letters of recommendation. Perceptual and Motor Skills, 46, 119-122.
35. Knouse, S. B. (1983). The letter of recommendation: Specificity and favorability of information. Personnel Psychology, 36, 331-341.
36. Liu, O. L., Minsky, J., Ling, G., & Kyllonen, P. (2009). Using the Standardized Letters of Recommendation in selection: Results from a multidimensional Rasch model. Educational and Psychological Measurement, 69, 475-492.
37. Lyness, K. S., & Heilman, M. E. (2006). When fit is fundamental: Performance evaluations and promotions of upper-level female and male managers. Journal of Applied Psychology, 91, 777-785.
38. Macrae, C. N., Bodenhausen, G. V., Milne, A. B., & Jetten, J. (1994). Out of mind but back in sight: Stereotypes on the rebound. Journal of Personality and Social Psychology, 67, 808-817.
39. MacRae, C. N., Bodenhausen, G. V., Milne, A. B., & Wheeler, V. (1996). On resisting the temptation for simplification: Counterintentional effects of stereotype suppression on social memory. Social Cognition, 14, 1-20.
40. Madera, J. M., Hebl, M. R., & Martin, R. C. (2009). Gender and letters of recommendation for academia: Agentic and communal differences. Journal of Applied Psychology, 94, 1591-1599.
41. McCarthy, J. M., & Goffin, R. D. (2001). Improving the validity of letters of recommendation: An investigation of three standardized reference forms. Military Psychology, 13, 199-222.
42. McDaniel, M. A., Whetzel, D. L., Schmidt, F. L., & Maurer, S. D. (1994). The validity of employment interviews: A comprehensive review and meta-analysis. Journal of Applied Psychology, 79, 599-616.
43. Newman, D. A., & Lyon, J. S. (2009). Recruitment efforts to reduce adverse impact: Targeted recruiting for personality, cognitive ability, and diversity. Journal of Applied Psychology, 94, 298-317.
44. Park, J., Malachi, E., Sternin, O., & Tevet, R. (2009). Subtle bias against Muslim job applicants in personnel decisions. Journal of Applied Social Psychology, 39, 2174-2190.
45. Peres, S. H., & Garcia, J. R. (1962). Validity and dimensions of descriptive adjectives used in reference letters for engineering applicants. Personnel Psychology, 15, 279-286.
46. Powell, G. N., & Butterfield, D. A. (2002). Exploring the influence of decision makers' ethnicity and gender on actual promotions to top management. Personnel Psychology, 55, 397-419.
47. Pulakos, E. D., Schmitt, N., Whitney, D., & Smith, M. (1996). Individual differences in interviewer ratings: The impact of standardization, consensus discussion, and sampling error on the validity of a structured interview. Personnel Psychology, 49, 85-102.
48. Ralston, S. M., & Thameling, C. A. (1988). Effects of vividness of language on information value of reference letters and job applicants' recommendation. Psychological Reports, 62, 867-870.
49. Reilly, R. R., & Chao, G. T. (1982). Validity and fairness of some alternate employee selection procedures. Personnel Psychology, 35, 1-62.
50. Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262-274.
51. Schmidt, F. L., & Zimmerman, R. D. (2004). A counterintuitive hypothesis about employment interview validity and some supporting evidence. Journal of Applied Psychology, 89, 553-561.
52. Schmitt, N., & Kunce, C. (2002). The effects of required elaboration of answers to biodata questions. Personnel Psychology, 55, 569-587.
53. Schmitt, N., Oswald, F. L., Kim, B. H., Gillespie, M. A., Ramsay, L. J., & Yoo, T.-Y. (2003). Impact of elaboration on socially desirable responding and the validity of biodata measures. Journal of Applied Psychology, 88, 979-988.
54. Singletary, S. L., & Hebl, M. R. (2009). Compensatory strategies for reducing interpersonal discrimination: The effectiveness of acknowledgments, increased positivity, and individuating information. Journal of Applied Psychology, 94, 797-805.
55. Steinpreis, R. E., Anders, K. A., & Ritzke, D. (1999). The impact of gender on the review of the curricula vitae of job applicants and tenure candidates: A national empirical study. Sex Roles, 41, 509-528.
56. Trix, F., & Psenka, C. (2003). Exploring the color of glass: Letters of recommendation for female and male medical faculty. Discourse and Society, 14, 191-220.
57. Wiesner, W. H., & Cronshaw, S. F. (1988). A meta-analytic investigation of the impact of interview format and degree of structure on the validity of the employment interview. Journal of Occupational Psychology, 61, 275-290.
58. Wright, P. M., Lichtenfels, P. A., & Pursell, E. D. (1989). The structured interview: Additional studies and a meta-analysis. Journal of Occupational Psychology, 62, 191-199.