Noncognitive constructs and their assessment in graduate education: A review

Educational Assessment

Volumn 10, Issue 3, 2005, Pages 153-184

  Kyllonen, Patrick C ^a   Walters, Alyssa M ^a   Kaufman, James C ^b  

^a EDUCATIONAL TESTING SERVICE   (United States)

^b CALIFORNIA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 27844447128     PISSN: 10627197     EISSN: None     Source Type: Journal    
DOI: 10.1207/s15326977ea1003_2     Document Type: Review

References (101)

1. Adorno, T. W., Frenkel-Brunswik, E., Levinson, D. J., & Sanford, R. N. (1950). The authoritarian personality. New York: Harpers.
2. Barrick, M. R., & Mount, M. K. (1991). The Big Five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1-26.
3. Barrick, M. R., Mount, M. K., & Judge, T. A. (2001). Personality and performance at the beginning of the new millennium: What do we know and where do we go next? International Journal of Selection and Assessment, 9, 9-30.
4. Benet-Martinez, V., & John, O. P. (1998). Los cinco grandes across cultures and ethnic groups: Multitrait multimethod analyses of the Big Five in Spanish and English. Journal of Personality and Social Psychology, 75, 729-750.
5. Briel, J., Bejar, I., Chandler, M., Powell, G., Manning, K., Robinson, D., et al. (2000). GRE Horizons Planning Initiative (Graduate Record Examination Board). Unpublished manuscript, Educational Testing Service, Princeton, New Jersey.
6. Briggs, K. C., Myers, I. B., & McCaulley, M. H. (1985). Manual: A guide to the development and use of the Myers-Briggs Type Indicator. Palo Alto, CA: Consulting Psychologists Press.
7. Brody, N., & Crowley, M. J. (1995). Environmental (and genetic) influences on personality and intelligence. In D. H. Saklofske & M. Zeidner (Eds.), International handbook on personality and intelligence (pp. 59-80). New York: Plenum Press.
8. Brown, J. D., & Marshall, M. A. (2001). Self-esteem and emotion: Some thoughts about feelings. Personality and Social Psychology Bulletin, 27, 575-584.
9. Busato, V. V., Prins, F. J., Elshout, J. J., & Hamaker, C. (2000). Intellectual ability, learning style, personality, achievement motivation and academic success of psychology students in higher education. Personality and Individual Differences, 29, 1057-1068.
10. Cable, D. M., & Murray, B. (1999). Tournaments versus sponsored mobility as determinants of job search success. Academy of Management Journal, 42, 439-449.
11. Cacioppo, J. T., Petty, R. E., Feinstein, J. A., & Jarvis, W. B. G. (1996). Dispositional differences in cognitive motivation: The life and times of individuals varying in need for cognition. Psychological Bulletin, 119, 197-253.
12. Campbell, J. P. (1990). An overview of the Army Selection and Classification Project (Project A). Personnel Psychology, 43, 231-239.
13. Campbell, J. P., McCloy, R. A., Oppler, S. H., & Sager, C. E. (1993). A theory of performance. In N. Schmitt & W. Borman (Eds.), Personnel selection in organizations (pp. 35-70). San Francisco: Jossey-Bass.
14. Carnevale, D. (2002). 2 students arrested for alleged high-tech cheating on the GRE. Chronicle of Higher Education. Retrieved November 21, 2002, from http://chronicle.com/free/2002/11/2002112102t.htm.
15. Cattell, R. B., Eber, H. W., & Tatsuoka, M. M. (1970). Handbook for the Sixteen Personality Factor Questionnaire. Champaign, IL: Institute for Personality Ability Testing.
16. Cattell, R., & Schuerger (1978). Personality theory in action: Handbook for the O-A (Objective-Analytic) Test Kit, Champaign, IL: Institute for Personality and Ability Testing.
17. Chemers, M. M., Hu, L., & Garcia, B. F. (2001). Academic self-efficacy and first year college student performance and adjustment. Journal of Educational Psychology, 93, 55-64.
18. Clark, M. J., & Centra, J. A. (1982). Conditions influencing career accomplishments of Ph.D.s. (GRE Board Professional Rep. No. 76-1R). Princeton, NJ: Educational Testing Service.
19. Collins, J. M., & Gleaves, D. H. (1998). Race, job applicants, and the Five-Factor Model of Personality: Implications for Black psychology, industrial/organizational psychology, and the Five-Factor Theory. Journal of Applied Psychology, 83, 531-544.
20. Comrey, A. L. (1970) The Comrey Personality Scales. San Diego, CA: Educational and Industrial Testing Service.
21. Costa, P. T., & McCrae, R. R. (1992). NEO Five-Factor Inventory. Odessa, FL: Psychological Assessment Resources.
22. Crooks, L. A., Campbell, J. T., & Rock, D. A. (1979). Predicting career progress of graduate students in management (Research Rep. 79-15). Princeton, NJ: Educational Testing Service.
23. Dahlstrom, W. G., Welsh, G. S., & Dahlstrom, L. E. (1972). An MMPI handbook: I. Clinical interpretation (Rev. ed.). Minneapolis: University of Minnesota Press.
24. de Raad, B., & Hendriks, A. A. J. (1997). A psycholexical route to content coverage in personality assessment. European Journal of Psychological Assessment, 13, 85-98.
25. Edwards, A. L. (1959). The Edwards Personal Preference Schedule. New York: The Psychological Corporation.
26. Ellingson, J. E., Sackett, P. R., & Hough, L. M. (1999). Social desirability corrections in personality measurement: Issues of applicant comparison and construct validity. Journal of Applied Psychology, 84, 155-166.
27. Ellingson, J. E., Smith, D. B., & Sackett, P. R. (2001). Investigating the influence of social desirability on personality factor structure. Journal of Applied Psychology, 86, 122-133.
28. Enright, M. K., & Gitomer, D. H. (1989). Toward a description of successful graduate students (GRE Board Professional Rep. No. 89-09, GRE Board Research Rep. 85-17R). Princeton, NJ: Educational Testing Service.
29. Eysenck, H. J. (1991). Dimensions of personality: The biosocial approach to personality. In J. Strelau & A. Angleitner (Eds.), Explorations in temperament: International perspectives on theory and measurement (pp. 87-103). London: Plenum.
30. Eysenck, H. J., & Eysenck, S. B. (1968). A factorial study of psychoticism. [Special issue]. Multivariate Behavioral Research, 15-31.
31. Eysenck, H. J., & Eysenck, S. B. J. (1975). The Eysenck Personality Questionnaire. London: Hodder and Stoughton.
32. Fernandez-Ballesteros, R. (Ed.). (2003). Encyclopedia of psychological assessment. Thousand Oaks, CA: Sage.
33. Funder, D. C. (2001). Personality. Annual Review of Psychology, 52, 197-221.
34. Goff, M., & Ackerman, P. L. (1992). Personality-intelligence relations: Assessment of typical intellectual engagement. Journal of Educational Psychology, 84, 537-552.
35. Goldberg, E. L., & Alliger, G. M. (1992). Assessing the validity of the GRE for students in psychology: A validity generalization approach. Educational and Psychological Measurement, 52, 1019-1027.
36. Goldberg, L. R. (1992). The development of markers for the Big-Five factor structure. Psychological Assessment, 4, 26-42.
37. Goldberg, L. R. (1999). A broad-bandwidth, public-domain, personality inventory measuring the lower-level facets of several five-factor models. In I. Mervielde, I. Deary, F. De Fruyt, & F. Ostendorf (Eds.), Personality psychology in Europe, Vol. 7 (pp. 7-28). Tilburg, The Netherlands: Tilburg University Press.
38. Goldberg, L. R. (2001, June). The Big-Five Factor structure as a framework for the consideration of noncognitive assessments for graduate admissions (Oregon Research Institute). Symposium conducted at the meeting on Noncognitive Assessments for Graduate Admissions, Graduate Record Examinations Board, Toronto, Ontario.
39. Goldberg, L. R. (in press). The comparative validity of adult personality inventories: Applications of a consumer-testing framework. In S. R. Briggs, J. M. Cheek, & E. M. Donahue (Eds.), Handbook of adult personality inventories. New York: Plenum.
40. Goldberg, L. R., Sweeney, D., Merenda, P. F., & Hughes, J. E., Jr. (1998). Demographic variables and personality: The effects of gender, age, education, and ethnic/racial status on self-descriptions of personality attributes. Personality and Individual differences, 24, 393-403.
41. Goleman, D. (1995). Emotional intelligence. New York: Bantam Books.
42. Gordon, L. V. (1978). The Gordon Personal Profile-Inventory. New York: The Psychological Corporation.
43. Gough, H. (1975). The California Psychological Inventory. Palo Alto, CA: Consulting Psychologists Press.
44. Guilford, J. S., Zimmerman, W. S., & Guilford, J. P. (1976). The Guilford-Zimmerman Temperament Survey handbook: Twenty-five years of research and application. San Diego, CA: EdITS.
45. Heath, A. C., Neale, M. C., Kessler, R. C., Eaves, L. J., & Kendler, K. S. (1992). Evidence for genetic influences on personality from self-reports and informant ratings. Journal of Personality and Social Psychology, 63, 85-96.
46. Heist, P., & Yonge, G. D. (1968). Omnibus Personality Inventory. San Antonio, TX: Psychological Corporation.
47. Hendriks, A. A. J., Hofstee, W. K. B., & de Raad, B. (1999). The Five-Factor Personality Inventory (FFPI). Personality and Individual Differences, 27, 307-325.
48. Heuchert, J. W. P., Parker, W. D., Stumpf, H., & Myburgh, C. P. H. (2000). The five-factor model of personality in South African college students. American Behavior Scientist, 44, 112-125.
49. Hirschberg, N., & Itkin, S. (1978). Graduate student success in psychology. American Psychologist, 33, 1083-1093.
50. Hofstee, W. K., de Raad, B., & Goldberg, L. R. (1992). Integration of the Big Five and circumplex approaches to trait structure. Journal of Personality and Social Psychology, 6, 146-163.
51. Hogan, J., & Hogan, R. (1989). How to measure employee reliability. Journal of Applied Psychology, 74, 273-279.
52. Hogan, J., & Holland, B. (2002, April). Evaluating personality-based job requirements. Paper presented at Seventeenth Annual Meeting of the Society for Industrial-Organizational Psychology, Inc., Toronto, Canada.
53. Hogan, R. (1986). Hogan Personality Inventory. Minneapolis, MN: National Computer Systems.
54. Hogan, R., & Hogan, J. (1995). Hogan Personality Inventory manual: Second edition. Tulsa, OK: Hogan Assessment Systems.
55. Hough, L. M. (1992). The "Big Five" personality variables - construct confusion: Description versus prediction. Human Performance, 5, 139-155.
56. Hough, L. M. (1997). The millennium for personality psychology: New horizons or good old daze. Applied Psychology International Review, 47, 233-261.
57. Hough, L. M. (2001). I/Owes its advances to personality. In B. W. Roberts & R. Hogan (Eds.), Personality psychology in the workplace. Decade of behavior (pp. 19-44). Washington, DC: American Psychological Association.
58. Hurtz, G. M., & Donovan, J. J. (2000). Personality and job performance: The big-five revisited. Journal of Applied Psychology, 85, 869-879.
59. Jackson, D. N. (1976). Jackson Personality Inventory. Port Huron, MI: Research Psychologists Press.
60. James, L. R. (1998). Measurement of personality via conditional reasoning. Organizational Research Methods, 1, 131-163.
61. Jamison, D. (1996). Occupational goals and persistence in African-American students attending four-year colleges. Dissertation Abstracts International Section A: Humanities and Social Sciences. Vol. 57(1-A): 0101.
62. Kinney, J. R. (1999). Effect of item clarity and probability of item endorsement on response latencies on personality test items (16 Personality Factor Questionnaire). Dissertation Abstracts International, 60(6), 3001B.
63. Kirnan, J. P., & Geisinger, K. F. (1981). The prediction of graduate school success in psychology. Educational and Psychological Measurement, 41, 815-820.
64. Kuncel, N. R., Campbell, J. P., Hezlett, S. A., & Ones, D. S. (2001, April). Performance in college: The criterion problem. In D. S. Ones & S. A. Hezlett (Chairs), Predicting performance: The interface of I/O psychology and educational research. Symposium presented at the annual conference of the Society for Industrial and Organizational Psychology, San Diego, CA.
65. Kuncel, N. R., Hezlett, S. A., & Ones, D. S. (2001). A comprehensive meta-analysis of the predictive validity of the graduate record examinations: Implications for graduate student selection and performance. Psychological Bulletin, 27, 162-181.
66. Lanthier, R. P. (2000). Intersibling agreement for Goldberg's Big Five adjective markers. Psychological Reports, 86, 400-406.
67. McAdams, D. P. (1999). Personal narratives and the life story. In L. A. Pervin & O. P. John (Eds.), Handbook of personality: Theory and research (2nd ed., pp. 478-500). New York: Guilford Press.
68. McAdams, D. P., Reynolds, J., Lewis, M., Patman, A. H., & Bowen, P. (2001). When bad things turn good and good things turn bad: Sequences of redemption and contamination in life narrative and their relation to psychosocial adaptation in midlife adults and in students. Personality and Social Psychology Bulletin, 27, 474-485.
69. McCrae, R. R., Costa, P. T., Jr., Del Pilar, G. H., Rolland, J. P., & Parker, W. D. (1998). Cross-cultural assessment of the five-factor model: The Revised NEO Personality Inventory. Journal of Cross-Cultural Psychology, 29, 171-188.
70. Mischel, W. (1973). Toward a cognitive social learning reconceptualization of personality. Psychological Review, 80, 252-253.
71. Mount, M. K., Barrick, M. R., & Stewart, G. L. (1998). Five factor model of personality and performance in jobs involving interpersonal interactions. Human Performance, 11, 145-165.
72. Mount, M. K., Barrick, M. R., & Strauss, J. P. (1994). Validity of observer ratings of the Big Five personality factors. Journal of Personality Psychology, 79, 272-280.
73. Musgrave-Marquart, D., Bromley, S. P., & Dalley, M. B. (1997). Personality, academic attribution, and substance use as predictors of academic achievement in college students. Journal of Social Behavior and Personality, 12, 501-511.
74. Nelson, N. G. (2000, September). Correlates of health and success among psychology graduate students: Stress, distress, coping, well being, and social support. Dissertation Abstracts International Section A: Humanities and Social Sciences. 61(3-A), 883.
75. Norman, W. T. (1963). Toward an adequate taxonomy of personality attributes: Replicated factor structure in peer nomination personality ratings. Journal of Abnormal and Social Psychology, 66, 574-583.
76. Ones, D. S., & Viswesvaran, C. (1998). Integrity testing in organizations. In R. W. Griffin, A. O'Leary-Kelly, & J. M. Collins (Eds.), Dysfunctional behavior in organizations: Nonviolent behaviors in organizations (Vol. 2, pp. 243-276). Greenwich, CT: JAI Press.
77. Ones, D. S., Viswesvaran, C., & Schmidt, F. L. (1993). Comprehensive meta-analysis of integrity test validities: Findings and implications for personnel selection and theories of job performance. Journal of Applied Psychology, 78, 679-703.
78. Paajanen, G. (1985). PDO Employment Inventory. Minneapolis, MN: Personnel Decisions, Inc.
79. Paunonen, S. V. (1989). Consensus in personality judgments: Moderating effects of target-rater acquaintanceship and behavior observability. Journal of Personality and Social Psychology, 56, 823-833.
80. Paunonen, S. V., & Ashton, M. C. (2001). Big Five factors and facets and the predication of behavior. Journal of Personality and Social Psychology, 81, 524-539.
81. Reeve, C. L., & Hakel, M. D. (2001, June). Criterion issues and practical considerations concerning noncognitive assessment in graduate admissions (Bowling Green State University). Symposium conducted at the meeting of Noncognitive Assessments for Graduate Admissions, Graduate Record Examinations Board, Toronto, Ontario.
82. Sackett, P. R., Schmitt, N., Ellingson, J. E., & Kabin, M. B. (2001). High-stakes testing in employment, credentialing, and higher education: Prospects in a post-affirmative action world. American Psychologist, 56, 302-318.
83. Sackett, P. R., & Wanek, J. E. (1996). New developments in the use of measures of honesty, integrity, conscientiousness, dependability, trustworthiness, and reliability for personnel selection. Personnel Psychology, 47, 787-829.
84. Salgado, J. F. (1998). Big Five personality dimensions and job performance in army and civil occupations: A European perspective. Human Performance, 11, 271-288.
85. Saucier, G. (2000). Isms and the structure of social attitudes. Journal of Personality and Social Psychology, 78, 366-385.
86. Saucier, G., & Goldberg, L. R. (1998). What is beyond the Big Five? Journal of Personality, 66, 495-524.
87. Schmidt, F. L. (1994). The future of personnel selection in the U.S. Army. In M. G. Rumsey & C. B. Walker (Eds.), Personnel selection and classification (pp. 333-350). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
88. Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262-274.
89. Seligman, M. E. P. (1991). Learned optimism. New York: A. A. Knopf.
90. Smith, D. B., Hanges, P. J., & Dickson, M. W. (2001). Personnel selection and the Five-Factor Model: Reexamining the effects of applicant's frame of reference. Journal of Applied Psychology, 86, 304-315.
91. Snyder, M. (1987). Public appearances, private realities: The psychology of self-monitoring. New York: W. H. Freeman.
92. Sternberg, R. J. (1977). Intelligence, information processing, and analogical reasoning: The componential analysis of human abilities. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
93. Sternberg, R. J. (1985). Beyond IQ: A triarchic theory of human intelligence. New York: Cambridge University Press.
94. Sternberg, R. J., & Williams, W. M. (1997). Does the Graduate Record Examination predict meaningful success in the graduate training of psychology? A case study. American Psychologist, 52, 630-641.
95. Tellegen, A. (1982). Brief manual for the Differential Personality Questionnaire. Unpublished manuscript, University of Minnesota, Minneapolis.
96. Terris, W. (1986). The development and validation of the EPI-3 (Research abstract). Park Ridge, IL: London House.
97. Tett, R. P., Jackson, D. N., & Rothstein, M. (1991). Personality measures as predictors of job performance: A meta-analytic review. Personnel Psychology, 44, 703-742.
98. Tsaousis, I. (1999). The Traits Personality Questionnaire (TPQue): A Greek measure of the five factor model. Personality and Individual Differences, 26, 271-283.
99. Tupes E. C., & Christal, R. C. (1958). Stability of personality trait rating factors obtained under diverse conditions (WADC-TN-58-61, AD-151 041). Lackland AFB, TX: Personnel Research Laboratory, Wright Air Development Center
100. Van-Heyningen, J. J. (1997). Academic achievement in college students: What factors predict success? Dissertation Abstracts International Section, 58(6), 2076A.
101. Walpole, M. B., Burton, N. W., Kanyi, K., & Jackenthal, A. (2002). Selecting successful graduate students: In-depth interviews with GRE users (Graduate Record Examination [GRE] Board Research Rep. No. 99-11R; Educational Testing Service [ETS] Research Rep. 02-08). Princeton, NJ: Educational Testing Service.