Recovering Substantive Factor Loadings in the Presence of Acquiescence Bias: A Comparison of Three Approaches

Multivariate Behavioral Research

Volumn 49, Issue 5, 2014, Pages 407-424

  Savalei, Victoria ^a   Falk, Carl F ^b  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84907465408     PISSN: 00273171     EISSN: None     Source Type: Journal    
DOI: 10.1080/00273171.2014.931800     Document Type: Article

References (56)

1. Ashton, M.C., Lee, K., Perugini, M., Szarota, P., de Vries, R.E., Di Blas, L., … De Raad, B. (2004). A six-factor structure of personality-descriptive adjectives: Solutions from psycholexical studies in seven languages. Journal of Personality and Social Psychology, 86, 356–366.
2. Barnette, J.J. (2000). Effects of stem and Likert response option reversals on survey internal consistency: If you feel the need, there is a better alternative to using those negatively worded stems. Educational and Psychological Measurement, 60, 361–370.
3. Baumgartner, H., & Steenkamp, J.-B. E. M. (2001). Response style in marketing research: A cross-national investigation. Journal of Marketing Research, 38, 143–156.
4. Bernaards, C.A., & Jennrich, R.I. (2005). Gradient projection algorithms and software for arbitrary rotation criteria in factor analysis. Educational and Psychological Measurement, 65, 676–696.
5. Billiet, J.B., & McClendon, M.J. (2000). Modeling acquiescence in measurement models for two balanced sets of items. Structural Equation Modeling, 7, 608–628.
6. Block, J. (1965). The challenge of response sets. New York, NY: Appleton-Century-Crofts.
7. Bolt, D.M., & Johnson, T.R. (2009). Addressing score bias and differential item functioning due to individual differences in response style. Applied Psychological Measurement, 33, 335–352.
8. Browne, M.W. (1972). Orthogonal rotation to a partially specified target. British Journal of Mathematical and Statistical Psychology, 25, 115–120.
9. Browne, M.W. (2001). An overview of analytic rotation in exploratory factor analysis. Multivariate Behavioral Research, 36, 111–150.
10. Browne, M.W., Cudeck, R., Tateneni, K., & Mels, G. (2008). CEFA: Comprehensive Exploratory Factor Analysis (Version 3.03) [Computer software and manual]. Retrieved from http://faculty.psy.ohio-state.edu/browne/
11. Cambré, B., Welkenhuysen-Gybels, J., & Billiet, J. (2002). Is it content or style? An evaluation of two competitive measurement models applied to a balanced set of ethnocentrism items. International Journal of Comparative Sociology, 43, 1–20.
12. Canty, A., & Ripley, R. (2013). Boot: Bootstrap R (S-Plus) functions. R package version 1.3-9. Retrieved from http://CRAN.R-project.org/package=boot
13. Chan, W. (2003). Analyzing ipsative data in psychological research. Behaviormetrika, 30, 99–121.
14. Chan, W., & Bentler, P.M. (1993). The covariance structure analysis of ipsative data. Sociological Methods & Research, 22, 214–247.
15. Chan, W., & Bentler, P.M. (1996). Covariance structure analysis of partially additive ipsative data using restricted maximum likelihood estimation. Multivariate Behavioral Research, 31, 289–312.
16. Cheung, M.W.-L. (2004). A direct estimation method on analyzing ipsative data with Chan and Bentler's (1993) method. Structural Equation Modeling, 11, 217–243.
17. Cheung, M.W.-L., & Chan, W. (2002). Reducing uniform response bias with ipsative measurement in multiple-group confirmatory factor analysis. Structural Equation Modeling, 9, 55–57.
18. Couch, A., & Keniston, K. (1960). Yeasayers and naysayers: Agreeing response set as a personality variable. Journal of Abnormal and Social Psychology, 60, 151–174.
19. Cronbach, L.J. (1946). Response sets and test validity. Educational and Psychological Measurement, 6, 475–494.
20. Cudeck, R., & O’Dell, L.L. (1994). Applications of standard error estimates in unrestricted factor analysis: Significance tests for factor loadings and correlations. Psychological Bulletin, 115, 475–487.
21. DiStefano, C., & Motl, R.W. (2006). Further investigating method effects associated with negatively worded items on self-report surveys. Structural Equation Modeling, 13, 440–464.
22. DiStefano, C., & Motl, R.W. (2009). Self-esteem and method effects associated with negatively worded items: Investigating factorial invariance by sex. Structural Equation Modeling, 16, 134–146.
23. Falk, C.F., Heine, S.J., Takemura, K., Zhang, C.X. J., & Hsu, C.-W. (in press). Are implicit self-esteem measures valid for assessing individual and cultural differences? Journal of Personality.
24. Ferrando, P.J., & Lorenzo-Seva, U. (2010). Acquiescence as a source of bias and model and person misfit: A theoretical and empirical analysis. British Journal of Mathematical and Statistical Psychology, 63, 427–448.
25. Ferrando, P.J., Lorenzo-Seva, U., & Chico, E. (2003). Unrestricted factor analytic procedures for assessing acquiescent responding in balanced, theoretically unidimensional personality scales. Multivariate Behavioral Research, 38, 353–374.
26. Fischer, R. (2004). Standardization to account for cross-cultural response bias: A classification of score adjustment procedures and review of research in JCCP. Journal of Cross-Cultural Psychology, 35, 263–282.
27. Goldberg, L.R. (1990). An alternative “description of personality”: The Big-Five factor structure. Journal of Personality and Social Psychology, 59, 1216–1229.
28. Greenleaf, E.A. (1992). Improving rating scale measures by detecting and correcting bias components in some response styles. Journal of Marketing Research, 29, 176–188.
29. Hofstee, W.K. B., ten Berge, J.M. F., & Hendricks, A.A. J. (1998). How to score questionnaires. Personality and Individual Differences, 25, 897–909.
30. Jackson, D.J., & Alwin, D.F. (1980). The factor analysis of ipsative measures. Sociological Methods & Research, 9, 218–238.
31. Kieruj, N.D., & Moors, G. (2013). Response style behavior: Question format dependent or personal style? Quality and Quantity, 47, 193–211.
32. Knowles, E.S., & Condon, C.A. (1999). Why people say “yes”: A dual-process theory of acquiescence. Journal of Personality and Social Psychology, 77, 379–386.
33. Korth, B., & Tucker, L.R. (1976). Procrustes matching by congruence coefficients. Psychometrika, 41, 531–535.
34. Lindwall, M., Barkoukis, V., Grano, C., Lucidi, F., Raudsepp, L., Liukkonen, J., & Thogersen-Ntoumani, C. (2012). Method effects: The problem with negatively versus positively keyed items. Journal of Personality Assessment, 94, 196–204.
35. Lorenzo-Seva, U., & Ferrando, P.J. (2009). Acquiescent responding in partially balanced multidimensional scales. British Journal of Mathematical and Statistical Psychology, 62, 319–326.
36. Lorenzo-Seva, U., & Rodriguez-Fornells, A. (2006). Acquiescent responding bias in balanced multidimensional scales and exploratory factor analysis. Psychometrika, 71, 769–777.
37. Maydeu-Olivares, A., & Coffman, D.L. (2006). Random intercept item factor analysis. Psychological Methods, 11, 344–362.
38. McClendon, M.J. (1991). Acquiescence and recency response-order effects in interview surveys. Sociological Methods and Research, 20, 60–103.
39. Messick, S. (1991). Psychology and methodology of response styles. In R.E. Snow & D.E. Wiley (Eds.), Improving inquiry in social science (pp. 161–200). Hillsdale, NJ: Erlbaum.
40. Mirowsky, J., & Ross, C.E. (1991). Eliminating defense and agreement bias from measures of the sense of control: A 2 × 2 index. Social Psychology Quarterly, 54, 127–145.
41. Moors, G. (2004). Facts and artefacts in the comparison of attitudes among ethnic minorities: A multigroup latent class structure model with adjustment for response style behavior. European Sociological Review, 20, 303–320.
42. Morren, M., Gelissen, J., & Vermunt, J. (2012). The impact of controlling for extreme responding on measurement equivalence in cross-cultural research. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 8, 159–170.
43. R Development Core Team. (2012). R: A language and environment for statistical computing. Vienna, Austria. Retrieved from http://www.R-project.org
44. Rammstedt, B., Kemper, C.J., & Borg, I. (2013). Correcting big five personality measurements for acquiescence: An 18-country cross-cultural study. European Journal of Personality, 27, 71–81.
45. Ray, J.J. (1983). Reviving the problem of acquiescent response bias. The Journal of Social Psychology, 121, 81–96.
46. Revelle, W. (2012). Psych: Procedures for personality and psychological research. R package version 1.2.1. Northwestern University, Evanston, IL. Retrieved from http://CRAN.R-project.org/package=psych
47. Rhemtulla, M., Brosseau-Liard, P.E., & Savalei, V. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17, 354–373.
48. Ross, C.E., & Mirowsky, J. (1984). Socially desirable response and acquiescence in a cross-cultural survey of mental health. Journal of Health and Social Behavior, 25, 189–197.
49. Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1–36.
50. Tafarodi, R.W., & Swann, W.B. (2001). Two-dimensional self-esteem: Theory and measurement. Personality and Individual Differences, 31, 653–673.
51. ten Berge, J.M. F. (1999). A legitimate case of component analysis of ipsative measures, partialling the mean as an alternative to ipsatization. Multivariate Behavioral Research, 34, 89–102.
52. Watson, D. (1992). Correcting for acquiescent response bias in the absence of a balanced scale: An application to class consciousness. Sociological Methods Research, 21, 52–88.
53. Weijters, B., Baumgartner, H., & Schillewaert, N. (2013). Reversed item bias: An integrative model. Psychological Methods, 18, 320–334.
54. Weijters, B., Geuens, M., & Schillewaert, N. (2010). The stability of individual response styles. Psychological Methods, 15, 96–110.
55. Welkenhuysen-Gybels, J., Billiet, J., & Cambré, B. (2003). Adjustment for acquiescence in the assessment of construct equivalence of Likert-score items. Journal of Cross Cultural Psychology, 34, 702–722.
56. Zhang, G., Preacher, K.J., & Luo, S. (2010). Bootstrap confidence intervals for ordinary least squares factor loadings and correlations in exploratory factor analysis. Multivariate Behavioral Research, 45, 103–134.