Measurement and control of response styles using anchoring vignettes: A model-based approach

Psychological Methods

Volumn 19, Issue 4, 2014, Pages 528-541

  Bolt, Daniel M ^a   Lu, Yi ^b   Kim, Jee Seon ^a  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

^b American College Testing Incorporated   (United States)

Author keywords

Anchoring vignettes; Item response theory; Multidimensionality; Response style

Indexed keywords

ALGORITHM; BAYES THEOREM; HUMAN; PSYCHOLOGICAL THEORY; SELF EVALUATION; SELF REPORT; STATISTICAL MODEL;

ALGORITHMS; BAYES THEOREM; HUMANS; MODELS, STATISTICAL; PSYCHOLOGICAL THEORY; SELF REPORT; SELF-ASSESSMENT;

EID: 84925602937     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/met0000016     Document Type: Article

References (36)

1. Baumgartner, H., & Steenkamp, J. B. E. M. (2001). Response styles in marketing research: A cross-national investigation. Journal of Marketing Research, 38, 143-156. doi:10.1509/jmkr.38.2.143.18840
2. Billiet, J. B., & McClendon, M. J. (2000). Modeling acquiescence in measurement models for two balanced sets of items. Structural Equation Modeling, 7, 608-628. doi:10.1207/S15328007SEM0704_5
3. Bock, R. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29-51. doi:10.1007/BF02291411
4. Bolt, D. M., & Johnson, T. R. (2009). Addressing score bias and DIF due to individual differences in response style. Applied Psychological Measurement, 33, 335-352. doi:10.1177/0146621608329891
5. Bolt, D. M., & Newton, J. R. (2011). Multiscale measurement of extreme response style. Educational and Psychological Measurement, 71, 814-833. doi:10.1177/0013164410388411
6. Buckley, J. (2009, June). Cross-national response styles in international educational assessments: Evidence from PISA 2006. Paper presented at the NCES Conference on the Program for International Student Assessment, Washington, DC. Retrieved from https://edsurveys.rti.org/PISA/
7. Geweke, J. (1992). Evaluating the accuracy of sampling-based approaches to calculating posterior moments. In J. M. Bernardo, J. O. Berger, A. P. Dawid, & A. F. M. Smith (Eds.), Bayesian statistics (Vol. 4, pp. 169-193). Oxford, England: Oxford University Press.
8. Gibbins, K. (1968). Response sets and the semantic differential. British Journal of Social and Clinical Psychology, 7, 253-263. doi:10.1111/j .2044-8260.1968.tb00567.x
9. Gilks, W. R., Richardson, S., & Spiegelhalter, D. J. (1996). Markov chain Monte Carlo in practice. Boca Raton, FL: Chapman & Hall/CRC.
10. Greenleaf, E. A. (1992a). Improving rating scale measures by detecting and correcting bias components in some response styles. Journal of Marketing Research, 29, 176-188. doi:10.2307/3172568
11. Greenleaf, E. A. (1992b). Measuring extreme response style. Public Opinion Quarterly, 56, 328-351. doi:10.1086/269326
12. Grol-Prokopczyk, H., Freese, J., & Hauser, R. M. (2011). Using anchoring vignettes to assess group differences in general self-related health. Journal of Health and Social Behavior, 52, 246-261. doi:10.1177/0022146510396713
13. Harzing, A.-W. (2006). Response style in cross-national survey research: A 26-country study. International Journal of Cross Cultural Management, 6, 243-266. doi:10.1177/1470595806066332
14. Hui, C. H., & Triandis, H. C. (1989). Effects of culture and response format on extreme response style. Journal of Cross-Cultural Psychology, 20,296-309. doi:10.1177/0022022189203004
15. Johnson, T., Kulesa, P., Cho, Y. I., & Shavitt, S. (2005). The relation between culture and response styles: Evidence from 19 countries. Journal of Cross-Cultural Psychology, 36, 264-277. doi:10.1177/0022022104272905
16. King, G., Murray, C. J. L., Salomon, J. A., & Tandon, A. (2004). Enhancing the validity and cross-cultural comparability of survey research. American Political Science Review, 98, 191-207. doi:10.1017/S000305540400108X
17. Lewis, N. A., & Taylor, J. A. (1955). Anxiety and extreme preferences. Educational and Psychological Measurement, 15, 111-116. doi: 10.1177/001316445501500203
18. Marshall, R., & Lee, C. (1998). A cross-cultural, between-gender study of extreme response style. In B. G. Englis & A. Olofsson (Eds.), European advances in consumer research (Vol. 3, pp. 90-95). Provo, UT: Association for Consumer Research.
19. Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149-174. doi:10.1007/BF02296272
20. Meisenberg, G., & Williams, A. (2008). Are acquiescent and extreme response styles related to low intelligence and education? Personality and Individual Differences, 44, 1539-1550. doi:10.1016/j.paid.2008.01.010
21. Moors, G. (2003). Diagnosing response style behavior by means of a latent-class factor approach: Socio-demographic correlations of gender role attitudes and perceptions of ethnic discrimination reexamined. Quality and Quantity, 37, 277-302. doi:10.1023/A:1024472110002
22. Moors, G. (2012). The effect of response style bias on the measurement of leadership. European Journal of Work and Organizational Psychology, 21, 271-298. doi:10.1080/1359432X.2010.550680
23. Morren, M., Gelissen, J., & Vermunt, J. (2011). Dealing with extreme response style in cross-cultural research: A restricted latent class factor analysis approach. Sociological Methodology, 41, 13-47. doi:10.1111/j.1467-9531.2011.01238.x
24. Mõttus, R., Allik, J., Realo, A., Pullman, H., Rossier, J., Zecca, J., Tseung, C. N. (2012). Comparability of self-reported conscientiousness across 20 countries. European Journal of Personality, 26, 307-317. doi:10.1002/per.840
25. Mõttus, R., Allik, J., Realo, A., Rossier, J., Zecca, J., Ah-Kion, J., Johnson, W. (2012). The effect of response style on self-reported conscientiousness across 20 countries. Personality and Social Psychology Bulletin, 38, 1423-1436. doi:10.1177/0146167212451275
26. Plummer, M., Best, N., Cowles, K., & Vines, K. (2006). CODA: Convergence Diagnosis and Output Analysis for MCMC. R News, 6(1), 7-11.
27. Raftery, A. E., & Lewis, S. M. (1992). One long run with diagnostics: Implementation strategies for Markov chain Monte Carlo. Statistical Science, 7, 493-497. doi:10.1214/ss/1177011143
28. Rossi, P. E., Gilula, Z., & Allenby, G. M. (2001). Overcoming scale usage heterogeneity: A Bayesian hierarchical approach. Journal of the American Statistical Association, 96, 20-31. doi:10.1198/016214501750332668
29. Saroglou, V. (2002). Religion and the five factors of personality: A meta-analytic review. Personality and Individual Differences, 32, 15-25. doi:10.1016/S0191-8869(00)00233-6
30. Spiegelhalter, D. J., Best, N. G., Carlin, B. P., & van der Linde, A. (2002). Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society: Series B. Statistical Methodology, 64, 583-639. doi:10.1111/1467-9868.00353
31. Spiegelhalter, D. J., Thomas, A., Best, N., & Lunn, D. (2003). WinBUGS Version 1.4 user's manual. Cambridge, England: MRC Biostatistics Unit.
32. Thissen, D., & Steinberg, L. (1986). A taxonomy of item response models. Psychometrika, 51, 567-577. doi:10.1007/BF02295596
33. van Rosmalen, J. M., van Herk, H., & Groenen, P. J. F. (2010). Identifying response styles: A latent-class bilinear multinomial logit model. Journal of Marketing Research, 47, 157-172. doi:10.1509/jmkr.47.1.157
34. Van Vaerenbergh, Y., & Thomas, T. D. (2013). Response styles in survey research: A literature review of antecedents, consequences, and remedies. International Journal of Public Opinion Research, 25, 195-217. doi:10.1093/ijpor/eds021
35. Weijters, B., Geuens, M., & Schillewaert, N. (2010a). The individual consistency of acquiescence and extreme response style in self-report questionnaires. Applied Psychological Measurement, 34, 105-121. doi: 10.1177/0146621609338593
36. Weijters, B., Geuens, M., & Schillewaert, N. (2010b). The stability of individual response styles. Psychological Methods, 15, 96-110. doi: 10.1037/a0018721