Implications of Item Keying and Item Valence for the Investigation of Construct Dimensionality

Multivariate Behavioral Research

Volumn 50, Issue 4, 2015, Pages 457-469

  Seng Kam, Chester Chun ^a   Meyer, John P ^b  

^a UNIVERSITY OF MACAU   (Macao)

^b UNIVERSITY OF WESTERN ONTARIO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ADOLESCENT; ADULT; BEHAVIORAL RESEARCH; FACTOR ANALYSIS; FEMALE; HUMAN; MALE; PROCEDURES; PSYCHOMETRY; STATISTICAL ANALYSIS; STATISTICAL BIAS; STATISTICAL MODEL; YOUNG ADULT;

ADOLESCENT; ADULT; BEHAVIORAL RESEARCH; BIAS (EPIDEMIOLOGY); DATA INTERPRETATION, STATISTICAL; FACTOR ANALYSIS, STATISTICAL; FEMALE; HUMANS; MALE; MODELS, STATISTICAL; PSYCHOMETRICS; YOUNG ADULT;

EID: 84938299149     PISSN: 00273171     EISSN: None     Source Type: Journal    
DOI: 10.1080/00273171.2015.1022640     Document Type: Article

References (67)

1. R.A.Altemeyer, (1981). Right-wing authoritarianism. Winnipeg, Canada: University of Manitoba.
2. M.Bäckström,, F.Björklund,, & M.R.Larsson, (2009). Five-factor inventories have a major general factor related to social desirability which can be reduced by framing items neutrally. Journal of Research in Personality, 43, 335–344.
3. J.L.Beauvois,, & N.Dubois, (2000). Affordances in social judgment: Experimental proof of why it is a mistake to ignore how others behave towards a target and look solely at how the target behaves. Swiss Journal of Psychology, 59, 16–33.
4. P.M.Bentler,, & C.-P.Chou (1987). Practical issues in structural modeling. Sociological Methods & Research, 16, 78–117.
5. P.Borkenau,, K.Zaltauskas,, & D.Leising, (2009). More may be better but there may be too much: Optimal trait level and self-enhancement bias. Journal of Personality, 77, 825–858.
6. D.Borsboom,, & G.J.Mellenbergh, (2007). Test validity in cognitive assessment. Cognitive diagnostic assessment for education: Theory and applications. New York: Cambridge University Press.
7. D.Borsboom,, G.J.Mellenbergh,, & J.van Heerden, (2004). The concept of validity. Psychological Review, 111, 1061–1071.
8. D.T.Campbell,, & D.W.Fiske, (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105.
9. E.G.Carmines,, & R.A.Zeller, (1979). Reliability and validity assessment. Beverly Hills, CA: Sage.
10. M.Credé,, C.S.Oleksandr,, J.Bagraim,, & M.Sully, (2009). Contextual performance and job satisfaction-dissatisfaction distinction: Examining artifacts and utility. Human Performance, 22, 246–272.
11. L.J.Cronbach,, & P.E.Meehl, (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302.
12. D.P.Dunlop,, A.D.Telford,, & D.L.Morrison, (2012). Not too little, but not too much: The perceived desirability of responses to personality items. Journal of Research in Personality, 46, 8–18.
13. M.Eid,, & E.Diener, (Eds.). (2006). Handbook of multimethod measurement in psychology. Washington, DC: American Psychological Association. doi: 10.1037/11383-000
14. C.K.Enders, (2001). The impact of nonnormality on full information maximum-likelihood estimation for structural equation models with missing data. Psychological Methods, 6, 352–370.
15. V.M.Esses,, L.M.Jackson,, & T.L.Armstrong, (1998). Intergroup competition and attitudes toward immigrants and immigration: An instrumental model of group conflict. Journal of Social Issues, 54, 699–724.
16. F.D.Fincham,, & K.J.Linfield, (1997). A new look at marital quality: Can spouses feel positive and negative about their marriage? Journal of Family Psychology, 11, 489–502.
17. C.Geiser,, M.Eid,, & F.W.Nussbeck, (2008). On the meaning of the latent variables in the CT-C(M-1) Model: A comment on Maydeu-Olivares and Coffman (2006). Psychological Methods, 13, 49–57.
18. J.W.Graham, (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549–576.
19. L.R.Goldberg,, J.A.Johnson,, H.W.Eber,, R.Hogan,, M.C.Ashton,, C.R.Cloninger,, & H.C.Gough, 2006. The International Personality Item Pool and the future of public-domain personality measures. Journal of Research in Personality, 4084–96
20. J.P.Guilford,, & B.Fruchter, (1978). Fundamental statistics in psychology and education. New York, NY: McGraw-Hill.
21. P.Y.Herzberg,, H.Glaesmer,, & J.Hoyer, (2006). Separating optimism and pessimism: A robust psychometric analysis of the Revised Life Orientation Test (LOT-R). Psychological Assessment, 18, 433–438.
22. A.K.Ho,, J.Sidanius,, F.Prato,, S.Levin,, L.Thomsen,, N.Kteily, (2012). Social dominance orientation: Revisiting the structure and function of a variable predicting social and political attitudes. Personality and Social Psychology Bulletin, 38, 583–606.
23. P.M.Horan,, C.DiStefano,, & R.W.Motl, (2003). Wording effects in self-esteem scales: Methodological artifact or response style? Structural Equation Modeling, 10, 444–455.
24. D.N.Jackson,, & S.Messick, (1958). Content and style in personality assessment. Psychological Bulletin, 55, 243–252.
25. D.N.Jackson,, & S.Messick, (1961). Acquiescence and desirability as response determinants on the MMPI. Educational and Psychological Measurement, 21, 771–790.
26. K.G.Jöreskog, (1971). Simultaneous factor analysis in several populations. Psychometrika, 36, 409–426.
27. C.Kam, (2013). Probing item social desirability by correlating personality items with Balanced Inventory of Desirable Responding (BIDR): A validity examination. Personality and Individual Differences, 54, 513–518.
28. D.A.Kenny, (1976). An empirical application of confirmatory factor analysis to the multitrait–multimethod matrix. Journal of Experimental Social Psychology, 65, 507–516.
29. C.E.Lance,, C.L.Noble,, & S.E.Scullen, (2002). A critique of the correlated trait-correlated method and correlated uniqueness models for multitrait-multimethod data. Psychological Methods, 7, 228–244. doi: 10.1037/1082-989X.7.2.228
30. A.Li,, & J.Bagger, (2007). The Balanced Inventory of Desirable Responding (BIDR): A reliability generalization study. Educational and Psychological Measurement, 67, 525–544.
31. M.Lindwall,, V.Barkoukis,, C.Grano,, F.Lucidi,, L.Raudsepp,, J.Liukkonen,. (2012). Method effects: The problem with negatively versus positively keyed items. Journal of Personality Assessment, 94, 196–204.
32. S.L.Magazine,, L.J.Williams,, & M.L.Williams, (1996). A confirmatory factor analysis examination of reverse coding effects in Meyer and Allen's affective and continuance commitment scales. Educational and Psychological Measurement, 56, 241–250.
33. H.W.Marsh, (1996). Positive and negative self-esteem: A substantively meaningful distinction or artifactors? Journal of Personality and Social Psychology, 70, 810–819.
34. H.W.Marsh,, L.F.Scalas,, & B.Nagengast, (2010). Longitudinal tests of competing factor structures for the Rosenberg Self-Esteem Scale: Traits, ephemeral artifacts, and stable response styles. Psychological Assessment, 22, 366–381.
35. G.N.Marshall,, C.B.Wortman,, J.W.Kusulas,, L.K.Hervig,, & R.R.Vickers,, Jr. (1992). Distinguishing optimism from pessimism: Relations to fundamental dimensions of mood and personality. Journal of Personality and Social Psychology. 62, 1067–1074.
36. A.Maydeu-Olivares,, & D.L.Coffman, (2006). Random intercept item factor analysis. Psychological Methods, 11, 344–362.
37. J.McPherson,, & P.Mohr, (2005). The role of item extremity in the emergence of keying-related factors: An exploration with Life Orientation Test. Psychological Methods, 10, 120–131.
38. W.Q.Meeker,, & L.Escobar, (1998). Statistical methods for reliability data. New York, NY: Wiley.
39. S.Messick,, & D.N.Jackson, (1961). Desirability scale values and dispersions for MMPI items. Psychological Reports, 8, 409–414.
40. L.K.Muthén, and B.O.Muthén, (1998–2010). Mplus User's Guide ()6th ed. Los Angeles, CA: Muthén & Muthén.
41. C.E.Osgood,, G.J.Suci,, & P.H.Tannenbaum, (1957). The measurement of meaning. Urbana, IL: University of Illinois.
42. D.L.Paulhus, (1991). Measurement and control of response bias. In J.P.Robinson, P.R.Shaver, & L.S.Wrightsman (Eds.), Measures of personality and social psychological attitudes (pp. 17–59) San Diego, CA: Academic.
43. D.Peabody, (1967). Trait inferences: Evaluative and descriptive aspects. Journal of Personality and Social Psychology Monographs, 7(Whole No. 644).
44. K.Peng,, & R.E.Nisbett, (1999). Culture, dialectics, and reasoning about contradiction. American Psychologist, 54, 741–754.
45. D.R.Peterson, (1965). Scope and generality of verbally defined personality factors. Psychological Review, 72, 48–79.
46. K.Pula,, S.McPherson,, & C.D.Parks, (2012). Invariance of a two-factor model of Social Dominance Orientation across gender. Personality and Individual Differences, 52, 285–389.
47. L.C.Quilty,, J.M.Oakman,, & E.Risko, (2006). Correlates of the Rosenberg Self-Esteem Scale method effects. Structural Equation Modeling 13, 99–117.
48. W.A.Rauch,, K.Schweizer,, & H.Moosbrugger, (2007). Method effects due to social desirability as a parsimonious explanation of the deviation from unidimensionality in LOT-R scores. Personality and Individual Differences, 42, 1597–1607.
49. M.Rosenberg, (1965). Society and the adolescent self-image. Princeton, NJ: Princeton University.
50. S.Rosenberg,, & K.Olshan, (1970). Evaluative and descriptive aspects in personality perception. Journal of Personality and Social Psychology, 16, 619–626.
51. Z.Rubin,, & L.A.Peplau, (1975). Who believes in a just world? Journal of Social Issues, 31, 65–90.
52. A.Satorra,, & P.M.Bentler, (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66, 507–514.
53. A.Satorra,, & P.M.Benter, (2010). Ensuring positiveness of the scaled difference chi-square test statistic. Psychometrika, 75, 243–248.
54. N.Schmitt,, & D.M.Stults, (1986). Methodology review: Analysis of multitrait-multimethod matrices. Applied Psychological Measurement, 10, 1–22.
55. C.A.Schriesheim,, R.J.Eisenbach,, & K.D.Hill, (1991). The effect of negation and polar opposite item reversals on questionnaire reliability and validity: An experimental investigation. Educational and Psychological Measurement, 51, 67–78.
56. C.A.Schriesheim,, & R.Eisenbach, (1995). An exploratory and confirmatory factor-analytic investigation of item wording effects on the obtained factor structures of survey questionnaire measures. Journal of Management, 21, 1177–1193.
57. C.Showers, (1992). Compartmentalization of positive and negative self-knowledge: Keeping bad apples out of the bunch. Journal of Personality and Social Psychology, 62, 1036–1049.
58. J.Sidanius,, & F.Pratto, (2001). Social dominance: An intergroup theory of social hierarchy and oppression. New York, NY: Cambridge University.
59. P.E.Spector,, P.T.van Katwhyk,, M.T.Brannick,, & P.Y.Chen, (1997). When two factors don't reflect two constructs: How item characteristics can produce artifactual factors. Journal of Management, 23, 659–677.
60. J.Spencer-Rodgers,, H.C.Boucher,, S.C.Mori,, L.Wang,, & K.Peng, (2009). The dialectical self-concept: Contradiction, change and holism in East Asian cultures. Personality and Social Psychology Bulletin, 35, 29–44.
61. S.K.Sterba,, & R.C.MacCallum, (2010). Variability in parameter estimates and model fit across random allocations of items to parcels. Multivariate Behavioral Research, 45, 322–358.
62. J.M.Tomás,, & A.Oliver, (1999) Rosenberg's self-esteem scale: Two factors or method effects. Structural Equation Modeling, 6, 84–98.
63. P.R.Vagg,, C.D.Spielberger,, & T.P.O'Hearn,, Jr. (1980). Is the state-trait anxiety inventory multidimensional? Personality and Individual Differences, 1, 207–214.
64. E.van Sonderen,, R.Sanderman,, & J.C.Coyne, (2013). Ineffectiveness of reverse wording of questionnaire items: Let's learn from cows in the rain. PLoS ONE, 8. doi: 10.1371/journal.pone.0068967
65. K.F.Widaman, (1985). Hierarchically nested covariance structures models for multitrait–multimethod data. Applied Psychological Measurement, 9, 1–26.
66. J.S.Wiggins, (1973). Personality and prediction: Principles of personality assessment. Philippines: Addison-Wesley.
67. K.-H.Yuan,, P.M.Bentler,, & Y.Kano, (1997). On averaging variables in a CFA model. Behaviormetrika, 24, 71–83.