A flexible full-information approach to the modeling of response styles

Psychological Methods

Volumn 21, Issue 3, 2016, Pages 328-347

  Falk, Carl F ^a   Cai, Li ^b  

^a MICHIGAN STATE UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Multidimensional item response theory; Nominal response model; Response styles

Indexed keywords

CONTROLLED STUDY; DISEASE MODEL; ERROR; HUMAN; INFORMATION SYSTEM; MODEL; PSYCINFO; SMOKING; FACTOR ANALYSIS; PSYCHOLOGIC TEST; PSYCHOLOGICAL MODEL; REACTION TIME;

FACTOR ANALYSIS, STATISTICAL; HUMANS; MODELS, PSYCHOLOGICAL; PSYCHOLOGICAL TESTS; REACTION TIME;

EID: 84949293723     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/met0000059     Document Type: Article

References (68)

1. Baumgartner, H., & Steenkamp, J.-B. E. M. (2001). Response style in marketing research: A cross-national investigation. Journal of Marketing Research, 38, 143-156.
2. Bock, R. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29-51.
3. Bock, R. D., & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46, 443-459.
4. Bock, R. D., & Lieberman, M. (1970). Fitting a response model for n dichotomously scored items. Psychometrika, 35, 179-197.
5. Bock, R. D., & Mislevy, R. J. (1982). Adaptive EAP estimation of ability in a microcomputer environment. Applied Psychological Measurement, 6, 431-444.
6. Böckenholt, U. (2012). Modeling multiple response processes in judgment and choice. Psychological Methods, 17, 665-678.
7. Böckenholt, U. (2014). Modeling motivated misreports to sensitive survey questions. Psychometrika, 79, 51-537.
8. Bolt, D. M., & Johnson, T. R. (2009). Addressing score bias and differential item functioning due to individual differences in response style. Applied Psychological Measurement, 33, 335-352.
9. Bolt, D. M., Lu, Y., & Kim, J.-S. (2014). Measurement and control of response styles using anchoring vignettes: A model-based approach. Psychological Methods, 19, 528 -541. http://dx.doi.org/10.1037/met0000016
10. Bolt, D. M., & Newton, J. R. (2011). Multiscale measurement of extreme response style. Educational and Psychological Measurement, 71, 814-833.
11. Cai, L. (2010). High-dimensional exploratory item factor analysis by a Metropolis Hastings Robbins Monro algorithm. Psychometrika, 75, 33-57.
12. Cai, L. (2010). Metropolis Hastings Robbins Monro algorithm for confirmatory item factor analysis. Journal of Educational and Behavioral Statistics, 35, 307-335.
13. Cai, L. (2013). flexMIRT® version 2: Flexible multilevel item factor analysis and test scoring [Computer software]. Chapel Hill, NC: Vector Psychometric Group.
14. Cai, L., Thissen, D., & du Toit, S. H. C. (2011). IRTPRO: Flexible, multidimensional, multiple categorical IRT modeling [Computer software]. Lincolnwood, IL: Scientific Software International.
15. Chalmers, R. P. (2012). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48, 1-29.
16. Chen, C., Lee, S.-Y., & Stevenson, H. W. (1995). Response style and cross-cultural comparisons of rating scales among East Asian and North American students. Psychological Science, 6, 170-175.
17. Cheung, G. W., & Rensvold, R. B. (2000). Assessing extreme and acquiescence response sets in cross-cultural research using structural equations modeling. Journal of Cross-Cultural Psychology, 31, 187-212.
18. Clarke, I. (2001). Extreme response style in cross-cultural research. International Marketing Review, 18, 301-324.
19. Couch, A., & Keniston, K. (1960). Yeasayers and naysayers: Agreeing response set as a personality variable. Journal of Abnormal and Social Psychology, 60, 151-174.
20. de Jong, M. G., Steenkamp, J.-B. E. M., Fox, J.-P., & Baumgartner, H. (2008). Using item response theory to measure extreme response style in marketing research: A global investigation. Journal of Marketing Research, 45, 104-115.
21. Diebolt, J., & Ip, E. H. S. (1996). Stochastic EM: Method and application. In W. Gilks, S. Richardson, & D. Spiegelhalter (Eds.), Markov Chain Monte Carlo in practice (pp. 259-273). London, England: Chapman and Hall.
22. Eddelbuettel, D., & Francois, R. (2011). Rcpp: Seamless R and Cintegration. Journal of Statistical Software, 40, 1-18.
23. Eddelbuettel, D., & Sanderson, C. (2014). RcppArmadillo: Accelerating R with high-performance Cinearalgebra. Computational Statistics and Data Analysis, 71, 1054-1063.
24. Ferrando, P. J., Lorenzo-Seva, U., & Chico, E. (2003). Unrestricted factor analytic procedures for assessing acquiescent responding in balanced, theoretically unidimensionaly personality scales. Multivariate Behavioral Research, 38, 353-374.
25. Fischer, R. (2004). Standardization to account for cross-cultural response bias: A classification of score adjustment procedures and review of research in JCCP. Journal of Cross-Cultural Psychology, 35, 263-282.
26. Fisher, R. A. (1925). Theory of statistical estimation. Proceedings of the Cambridge Philosophical Society, 22, 700-725.
27. Fox, J. P. (2003). Stochastic EM for estimating the parameters of a multilevel IRT model. British Journal of Mathematical and Statistical Psychology, 56, 65-81.
28. Greenleaf, E. A. (1992). Improving rating scale measures by detecting and correcting bias components in some response styles. Journal of Marketing Research, 29, 176-188.
29. Hansen, M., Cai, L., Stucky, B. D., Tucker, J. S., Shadel, W. G., & Edelen, M. O. (2014). Methodology for developing and evaluating the PROMIS smoking item banks. Nicotine & Tobacco Research, 16, S175-S189.
30. Jackson, D. N., & Messick, S. (1961). Acquiescence and desirability as response determinants on the MMPI. Educational and Psychological Measurement, 21, 771-790.
31. Javaras, K. N., & Ripley, B. D. (2007). An "unfolding" latent variable model for Likert attitude data: Drawing inferences adjusted for response style. Journal of the American Statistical Association, 102, 454-463.
32. Jin, K.-Y., & Wang, W.-C. (2014). Generalized IRT models for extreme response style. Educational and Psychological Measurement, 74, 116-138.
33. Johnson, T. R. (2003). On the use of heterogeneous thresholds ordinal regression models to account for individual differences in response styles. Psychometrika, 68, 563-583.
34. Johnson, T. R., & Bolt, D. M. (2010). On the use of factor-analytic multinominal logit item response models to account for individual differences in response styles. Journal of Educational and Behavioral Statistics, 35, 92-114.
35. Khorramdel, L., & von Davier, M. (2014). Measuring response styles across the Big Five: A multiscale extension of an approach using multinomial processing trees. Multivariate Behavioral Research, 49, 161-177.
36. Kieruj, N. D., & Moors, G. (2010). Variations in response style behaviour by response scale format in attitude research. International Journal of Public Opinion Research, 22, 320-342.
37. Kieruj, N. D., & Moors, G. (2013). Response style behavior: Question format dependent or personal style? Quality & Quantity, 47, 193-211.
38. Krosnick, J. A. (1991). Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied Cognitive Psychology, 5, 213-236.
39. Kuncel, N. R., & Tellegen, A. (2009). A conceptual and empirical reexamination of the measurement of the social desirability of items: Implications for detecting desirable response style and scale development. Personnel Psychology, 62, 201-228.
40. Louis, T. A. (1982). Finding the observed information matrix when using the EM algorithm. Journal of the Royal Statistical Society. Series B, 44, 226-233.
41. Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149-174.
42. Maydeu-Olivares, A., & Coffman, D. L. (2006). Random intercept item factor analysis. Psychological Methods, 11, 344-362.
43. McFadden, D. (1974). Conditional logit analysis of qualitative choice behavior. In P. Zarembka (Ed.), Frontiers of econometrics (pp. 105-142). New York, NY: Academic Press.
44. Monroe, S., & Cai, L. (2014). Estimation of a Ramsay-curve item response theory model by the MetropolisHastings RobbinsMonro algorithm. Educational and Psychological Measurement, 74, 343-369.
45. Moors, G. (2003). Diagnosing response style behavior by means of a latent-class factor approach. sociodemographic correlates of gender role attitudes and perceptions of ethnic discrimination reexamined. Quality & Quantity, 37, 277-302.
46. Moors, G. (2004). Facts and artefacts in the comparison of attitudes among ethnic minorities: A multigroup latent class structure model with adjustment for response style behavior. European Sociological Review, 20, 303-320.
47. Morey, L. C. (1991). The Personality Assessment Inventory: Professional manual. Odessa, FL: Psychological Assessment Resources.
48. Morren, M., Gelissen, J. P. T. M., & Vermunt, J. K. (2011). Dealing with extreme response style in cross-cultural research: A restricted latent class factor analysis approach. Sociological Methodology, 41, 13-47.
49. Morren, M., Gelissen, J. P. T. M., & Vermunt, J. K. (2012). The impact of controlling for extreme responding on measurement equivalence in cross-cultural research. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 8, 159-170.
50. Muraki, E. (1992). A generalized partial credit model: Application of an EM algorithm. Applied Psychological Measurement, 16, 159-176.
51. Paulhus, D. L. (1991). Measurement and control of response bias. In J. P. Robinson, P. Shaver, & L. S. Wrightsman (Eds.), Measure of personality and social psychological attitudes. San Diego, CA: Academic Press.
52. Paulhus, D. L., & Vazire, S. (2007). The self-report method. In R. Robins, R. C. Fraley, & R. F. Krueger (Eds.), Handbook of research methods in personality psychology. New York, NY: Guilford Press.
53. Plieninger, H., & Meiser, T. (2014). Validity of multiprocess IRT models for separating content and response style. Educational and Psychological Measurement, 74, 875-899.
54. R Core Team. (2012). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from https://www.R-project.org
55. Rossi, P. E., Gilula, Z., & Allenby, G. M. (2001). Overcoming scale usage heterogeneity: A Bayesian hierarchical approach. Journal of the American Statistical Association, 96, 20-31.
56. Savalei, V., & Falk, C. F. (2014). Recovering substantive factor loadings in the presence of acquiescence bias: A comparison of three approaches. Multivariate Behavioral Research, 49, 407-424.
57. Schilling, S., & Bock, R. D. (2005). High-dimensional maximum marginal likelihood item factor analysis by adaptive quadrature. Psychometrika, 70, 533-555.
58. Takane, Y., & de Leeuw, J. (1987). On the relationship between item response theory and factor analysis of discretized variables. Psychometrika, 52, 393-408.
59. Thissen, D., & Cai, L. (in press). Nominal categories models. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (2nd ed.). New York, NY: Chapman & Hall.
60. Thissen, D., Cai, L., & Bock, R. D. (2010). The nominal categories item response model. In M. Nering & R. Ostini (Eds.), Handbook of polytomous item response theory models: Developments and applications (p. 43-75). New York, NY: Taylor & Francis.
61. Thissen, D., & Steinberg, L. (1986). A taxonomy of item response models. Psychometrika, 51, 567-577.
62. Thissen-Roe, A., & Thissen, D. (2013). A two-decision model for responses to Likert-type items. Journal of Educational and Behavioral Statistics, 38, 522-547.
63. Trott, M. D., & Jackson, D. N. (1967). An experimental analysis of acquiescence. Journal of Experimental Research in Personality, 2, 278-288.
64. van Rosmalen, J., van Herk, H., & Groenen, P. J. F. (2010). Identifying response styles: A latent-class bilinear multinominal logit model. Journal of Marketing Research, 46, 157-172.
65. Wang, W.-C., Wilson, M., & Shih, C.-L. (2006). Modeling randomness in judging rating scales with a random-effects rating scale model. Journal of Educational Measurement, 43, 335-353.
66. Wang, W.-C., & Wu, S.-L. (2011). The random-effect generalized rating scale model. Journal of Educational Measurement, 48, 441-456.
67. Wetzel, E., Carstensen, C. H., & Böhnke, J. R. (2013). Consistency of extreme response style and non-extreme response style across traits. Journal of Research in Personality, 47, 178-189.
68. Yang, J. S., & Cai, L. (2014). Estimation of contextual effects through nonlinear multilevel latent variable modeling with a Metropolis Hastings Robbins Monro algorithm. Journal of Educational and Behavioral Statistics, 39, 550-582.