Constructing personality scales under the assumptions of an ideal point response process: Toward increasing the flexibility of personality measures

Psychological Assessment

Volumn 19, Issue 1, 2007, Pages 88-106

  Chernyshenko, Oleksandr S ^a   Stark, Stephen ^b   Drasgow, Fritz ^c   Roberts, Brent W ^c  

^a UNIVERSITY OF CANTERBURY   (New Zealand)

^b UNIVERSITY OF SOUTH FLORIDA   (United States)

^c UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Item response theory; Personality measurement; Test construction

Indexed keywords

ADULT; ARTICLE; CONTROLLED STUDY; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; METHODOLOGY; NORMAL HUMAN; PERSONALITY; PERSONALITY TEST; RATING SCALE; SCORING SYSTEM; VALIDITY;

ADOLESCENT; ADULT; FEMALE; HUMANS; MALE; PERSONALITY ASSESSMENT; PSYCHOMETRICS; REFERENCE VALUES; REPRODUCIBILITY OF RESULTS; STATISTICS; STUDENTS;

EID: 33947307406     PISSN: 10403590     EISSN: None     Source Type: Journal    
DOI: 10.1037/1040-3590.19.1.88     Document Type: Article

References (83)

1. Andrich, D. (1988). The application of an unfolding model of the PIRT type to the measurement of attitude. Applied Psychological Measurement, 12, 33-51.
2. Andrich, D. (1996). A hyperbolic cosine latent trait model for unfolding polytomous responses: Reconciling Thurstone and Likert methodologies. British Journal of Mathematical and Statistical Psychology, 49, 347-365.
3. Andrich, D., & Luo, G. (1993). A hyperbolic cosine latent trait model for unfolding dichotomous single-stimulus responses. Applied Psychological Measurement, 17, 253-276.
4. Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee's ability. In F. M. Lord & M. R. Novick (Eds.), Statistical theories of mental test scores (pp. 397-472). Reading, MA: Addison Wesley.
5. Bock, R. D., & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46, 443-459.
6. Bolt, D. M. (2002). A Monte Carlo comparison of parametric and non-parametric polytomous DIF detection methods. Applied Measurement in Education, 15, 113-141.
7. Butcher, J. N., Dahlstrom, W. G., Graham, I. R., Tellegen, A., & Kaemmer, B. (1989). MMPI-2: Minnesota Multiphasic Personality Inventory-2: Manual for administration and scoring. Minneapolis: University of Minnesota Press.
8. Candell, G. L., & Hulin, C. L. (1986). Cross-language and cross-cultural comparisons in scale translations: Independent sources of information about item nonequivalence. Journal of Cross-Cultural Psychology, 17, 417-440.
9. Caspi, A., Begg, D., Dickson, N., Harrington, H., Langley, J., Moffitt, T. E., et al. (1997). Personality differences predict health-risk behaviors in young adulthood: Evidence from a longitudinal study. Journal of Personality and Social Psychology, 73, 1052-1063.
10. Chalmers, D. K., Bowyer, C. A., & Olenick, N. L. (1990). Problem drinking and obesity: A comparison in personality patterns and life-style. International Journal of the Addictions, 25, 803-817.
11. Chernyshenko, O. S. (2002). Applications of ideal point approaches to scale construction and scoring in personality measurement: The development of a six-faceted measure of conscientiousness. Unpublished doctoral dissertation. University of Illinois at Urbana-Champaign.
12. Chernyshenko, O. S., Stark, S., Chan, K. Y., Drasgow, F., & Williams, B. A. (2001). Fitting item response theory models to two personality inventories: Issues and insights. Multivariate Behavioral Research, 36, 523-562.
13. Chernyshenko O. S., Stark, S., Prewett, M., Gray, A., Stilson, R., & Tuttle, M. (2006, April). Normative score comparisons from single stimulus, unidimensional forced choice, and multidimensional forced choice personality measures using item response theory. Paper presented at the 21st annual conference of the Society for Industrial and Organizational Psychology, Dallas, TX.
14. Clark, L. A., & Watson, D. (1999). Temperament: A new paradigm for trait psychology. In L. Pervin & O. John (Eds.), Handbook of personality research and theory (Vol. 2). New York: Guilford Press.
15. Coombs, C. H. (1964). A theory of data. New York: Wiley.
16. Costa, P. T., Jr., McCrae, R. R., & Dye, D. A. (1991). Facet scales for agreeableness and conscientiousness: A revision of the NEO Personality Inventory. Personality and Individual Differences, 12, 887-898.
17. Davison, M. L. (1977). On a metric, unidimensional unfolding model for attitudinal and developmental data. Psychometrika, 42, 523-548.
18. de la Torre, J. (2004). GGUM_MCMC: Markov chain Monte Carlo estimation of parameters in the generalized graded unfolding model. Unpublished manuscript. Rutgers, The State University of New Jersey, University College-New Brunswick.
19. de la Torre, J., Stark, S., & Chernyshenko, O. S. (2006). Markov chain Monte Carlo estimation of item parameters for the generalized graded unfolding model. Applied Psychological Measurement, 30, 1-17.
20. DeSarbo, W. S., & Hoffman, D. L. (1986). Simple and weighted unfolding threshold models for the spatial representation of binary choice data. Applied Psychological Measurement, 10, 247-264.
21. Drasgow, F., & Kang, T. (1984). Statistical power of differential validity and differential prediction analyses for detecting measurement non-equivalence. Journal of Applied Psychology, 69, 498-508.
22. Drasgow, F., Levine, M. V., Tsien, S., Williams, B. A., & Mead, A. D. (1995). Fitting polytomous item response theory models to multiple-choice tests. Applied Psychological Measurement, 19, 143-165.
23. Drasgow, F., & Lissak, R. I. (1983). Modified parallel analysis: A procedure for examining the latent dimensionality of dichotomously scored item responses. Journal of Applied Psychology, 68, 363-373.
24. Ellis, B. B., Becker, P., & Kimmel, H. D. (1993). An item response theory evaluation of an English version of the Trier Personality Inventory. Journal of Cross-Cultural Psychology, 2, 133-148.
25. Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Erlbaum.
26. Glas, C. A. W. (1988). The derivation of some tests for the Rasch model from the multinomial distribution. Psychometrika, 53, 525-546.
27. Goldberg, L. R. (1992). The development of markers for the Big Five factor structure. Psychological Assessment, 4, 26-42.
28. Goldberg, L. R. (1993). The structure of phenotypic personality traits. American Psychologist, 48, 26-34.
29. Goldberg, L. R. (1998, March 18). International Personality Item Pool: A scientific collaboratory for the development of advanced measures of personality and other individual differences. Retrieved May 20, 2001, from http://ipip.ori.org/ipip
30. Gough, H. G., & Bradley, P. (1996). CPI Manual (3rd ed.). Palo Alto, CA: Consulting Psychologists Press.
31. Habing, B., Finch, H., & Roberts, J. (2005). A Q-sub-3 statistic for unfolding item response theory models: Assessment of unidimensionality with two factors and simple structure. Applied Psychological Measurement, 29, 457-471.
32. Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory. Newbury Park, CA: Sage.
33. Hattie, J. A. (1984). An empirical study of various indices for determining unidimensionality. Multivariate Behavioral Research, 19, 49-78.
34. Hattie, J. A. (1985). Methodology review: Assessing unidimensionality of tests and items. Applied Psychological Measurement, 9, 139-164.
35. Hofstee, W. K., de Raad, B., & Goldberg, L. R. (1992). Integration of the Big Five and circumplex approaches to trait structure. Journal of Personality and Social Psychology, 63, 146-163.
36. Hoijtink, H. (1991). The measurement of latent traits by proximity items. Applied Psychological Measurement, 15, 153-169.
37. Hulin, C. L., Drasgow, F., & Parsons, C. K. (1983). Item response theory: Applications to psychological measurement. Homewood, IL: Dow Jones-Irwin.
38. Jackson, D. N. (1994). Jackson Personality Inventory-Revised manual. Port Huron, MI: Sigma Assessment Systems, Inc.
39. Jackson, D. N., Wrobleski, V. R., & Ashton, M. C. (2000). The impact of faking on employment tests: Does forced-choice offer a solution? Human Performance, 13, 371-388.
40. Johnson, M. S., & Junker, B. W. (2003). Using data augmentation and Markov chain Monte Carlo for the estimation of unfolding item response models. Journal of Educational and Behavioral Statistics, 28, 195-230.
41. Kenrick, D. T., & Funder, D. C. (1988). Profiting from controversy: Lessons from the person-situation debate. American Psychologist, 43, 23-34.
42. Levine, M. V. (1984). An introduction to multilinear formula score theory (Series No. 84-4). Arlington, VA: Office of Naval Research, Personnel and Training Research Programs.
43. Likert, R. (1932). A technique for the measurement of attitudes. Archives of Psychology, 140, 5-53.
44. Martin, N. G., & Boomsma, D. I. (1989). Willingness to drive when drunk and personality: A twin study. Behavior Genetics, 19, 97-111.
45. McCrae, R. R., & Costa, P. T., Jr. (1989). The structure of interpersonal traits: Wiggins's circumplex and the five-factor model. Journal of Personality and Social Psychology, 56, 586-595.
46. Meijer, R. R., & Baneke, J. J. (2004). Analyzing psychopathology items: A case for nonparametric item response theory modeling. Psychological Methods, 9, 354-368.
47. Mischel, W. (1968). Personality and assessment. New York: Wiley.
48. Mislevy, R. J., & Bock, R. D. (1991). BILOG user's guide. Chicago, IL: Scientific Software.
49. Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory. New York: McGraw-Hill.
50. Ones, D. S., Viswesvaran, C., & Reiss, A. D. (1996). Role of social desirability in personality testing for personnel selection: The red herring. Journal of Applied Psychology, 81, 660-679.
51. Orlando, M., & Thissen, D. (2000). Likelihood-based item-fit indices for dichotomous item response theory models. Applied Psychological Measurement, 24, 50-64.
52. Reise, S. P. (1999). Personality measurement issues viewed through the eyes of IRT. In S. E. Embretson & S. L. Hershberger (Eds.), The new rules of measurement (pp. 219-242). Mahwah, NJ: Erlbaum.
53. Reise, S. P., & Henson, J. M. (2000). Computerization and adaptive administration of the NEO-PI-R. Assessment, 7, 347-364.
54. Reise, S. P., & Waller, N. G. (1990). Fitting the two-parameter model to personality data. Applied Psychological Measurement, 14, 45-58.
55. Roberts, B. (2001). Study Behavior Questionnaire. Unpublished manuscript. University of Illinois at Urbana-Champaign, Department of Psychology.
56. Roberts, B., Chernyshenko, O. S., Stark, S., & Goldberg, L. (2005). The construct of conscientiousness: The convergence between lexical models and scales drawn from six major personality questionnaires. Personnel Psychology, 58, 103-139.
57. Roberts, J. S. (2001). GGUM2000: Estimation of parameters in the generalized graded unfolding model. Applied Psychological Measurement, 25, 38.
58. Roberts, J. S., Donoghue, J. R., & Laughlin, J. E. (1998). The generalized graded unfolding model: A general parametric item response model for unfolding graded responses (RR-98-32). Princeton, NJ: Educational Testing Service.
59. Roberts, J. S., Donoghue, J. R., & Laughlin, J. E. (1999, April). Estimating parameters in the generalized graded unfolding model: Sensitivity to the prior distribution assumption and the number of quadrature points used. Paper presented at the Annual Meeting of the National Council on Measurement in Education, Montreal, Québec, Canada.
60. Roberts, J. S., Donoghue, J. R., & Laughlin, J. E. (2000). A general item response theory model for unfolding unidimensional polytomous responses. Applied Psychological Measurement, 24, 3-32.
61. Roberts, J. S., & Laughlin, J. E. (1996). A unidimensional item response model for unfolding responses from a graded disagree-agree response scale. Applied Psychological Measurement, 20, 231-255.
62. Roberts, J. S., Laughlin, J. E., & Wedell, D. H. (1999). Validity issues in the Likert and Thurstone approaches to attitude measurement. Educational and Psychological Measurement, 59, 211-233.
63. Rouse, S. V., Finger, M. S., & Butcher, J. N. (1999). Advances in clinical personality measurement: An item response theory analysis of the MMPI-2 PSY-5 scales. Journal of Personality Assessment, 72, 282-307.
64. Shedler, J., & Block, J. (1990). Adolescent drug use and psychological health: A longitudinal inquiry. American Psychologist, 45, 612-630.
65. Sher, K. J., & Trull, T. J. (1994). Personality and disinhibitory psychopathology: Alcoholism and antisocial personality disorder. Journal of Abnormal Psychology, 103, 92-102.
66. Simms, L. J., & Clark, L. A. (2005). Validation of a computerized adaptive version of the Schedule for Nonadaptive and Adaptive Personality (SNAP). Psychological assessment, 17, 28-43.
67. Stark, S. (2001). MODFIT: A computer program for model-data fit. Unpublished manuscript. University of Illinois at Urbana-Champaign
68. Stark, S., Chernyshenko, O. S., Chan, K. Y., Lee, W. C., & Drasgow, F. (2001). Effects of the testing situation on item responding: Cause for concern. Journal of Applied Psychology, 86, 943-953.
69. Stark, S., Chernyshenko, O. S., & Drasgow, F. (2004). Examining the effects of differential item/test functioning (DIF/DTF) on selection decisions: When are statistically significant effects practically important? Journal of Applied Psychology, 89, 497-508.
70. Stark, S., Chernyshenko, O. S., Drasgow, F., & Williams, B. A. (2006). Examining assumptions about item responding in personality assessment: Should ideal point methods be considered for scale development and scoring? Journal of Applied Psychology, 91, 25-39.
71. Steinberg, L. (2001). The consequences of pairing questions: Context effects in personality measurement. Journal of Personality and Social Psychology, 81, 332-342.
72. Stocking, M. L., & Lord, F. M. (1983). Developing a common metric in item response theory. Psychological Bulletin, 99, 118-128.
73. Stout, W. F. (1987). A nonparametric approach for assessing latent trait dimensionality. Psychometrika, 55, 293-325.
74. Tellegen, A. (1982). A brief manual for the Multidimensional Personality Questionnaire. Unpublished manuscript, University of Minnesota.
75. Thissen, D., Steinberg, L., & Mooney, J. A. (1989). Trace lines for testlets: A use of multiple-categorical-response models. Journal of Educational Measurement, 26, 247-260.
76. Thissen, D., & Wainer, H. (Eds). (2001). Test scoring. Mahwah, NJ: Erlbaum.
77. Thurstone, L. L. (1928). Attitudes can be measured. American Journal of Sociology, 33, 529-554.
78. Van den Wollenberg, A. L. (1982). Two new test statistics for the Rasch model. Psychometrika, 47, 123-140.
79. Vickers, R. R., Jr., Conway, T. L., & Hervig, L. K. (1990). Demonstration of replicable dimensions of health behaviors. Preventive Medicine, 19, 377-401.
80. Waller, N. G., & Reise, S. P. (1989). Computerized adaptive personality assessment: An illustration with the Absorption scale. Journal of Personality and Social Psychology, 57, 1051-1058.
81. Waller, N. G., Tellegen, A., McDonald, R. P., & Lykken, D. T. (1996). Exploring nonlinear models in personality assessment: Development and preliminary validation of a negative emotionality scale. Journal of Personality, 64, 545-576.
82. Watson, D., & Clark, L. A. (1993). Behavioral disinhibition versus constraint: A dispositional perspective. In D. M. Wegner & J. W. Pennebaker (Eds.), Handbook of mental control (pp. 506-527). Upper Saddle River, NJ: Prentice Hall.
83. White, H. R., & Johnson, V. (1988). Risk taking as a predictor of adolescent sexual activity and use of contraception. Journal of Adolescent Research, 3, 317-331.