Measuring Response Styles Across the Big Five: A Multiscale Extension of an Approach Using Multinomial Processing Trees

Multivariate Behavioral Research

Volumn 49, Issue 2, 2014, Pages 161-177

  Khorramdel, Lale ^a   von Davier, Matthias ^b  

^a UNIVERSITY OF VIENNA   (Austria)

^b EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84898722354     PISSN: 00273171     EISSN: None     Source Type: Journal    
DOI: 10.1080/00273171.2013.866536     Document Type: Article

References (47)

1. Akaike, H. 1974. A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19: 716 - 723.
2. Austin, E. J., Deary, I. J. and Egan, V. 2006. Individual differences in response scale use: Mixed Rasch modelling of responses to NEO-FFI items. Personality and Individual Differences, 40: 1235 - 1245.
3. Bachman, J. G. and O'Malley, P. M. 1984. Yea-saying, nay-saying, and going to extremes: Black-white differences in response styles. Public Opinion Quarterly, 48: 491 - 509.
4. Baumgartner, H. and Steenkamp, J. -B. E. M. 2001. Response styles in marketing research: A cross-national investigation. Journal of Marketing Research, 38: 143 - 156.
5. Birnbaum, A. 1968. " Some latent trait models and their use in inferring an examinee's ability ". In Statistical theories of mental test scores, Edited by: Lord, F. M. and Novick, M. R. 397-424 Reading, MA: Addison-Wesley.
6. Böckenholt, U. 2012. Modeling multiple response processes in judgment and choice. Psychological Methods, 17: 665 - 678.
7. Bolt, D. M. and Johnson, T. R. 2009. Addressing score bias and differential item functioning due to individual differences in response style. Applied Psychological Measurement, 33: 335 - 352.
8. Bolt, D. M. and Newton, J. R. 2011. Multiscale measurement of extreme response style. Educational and Psychological Measurement, 71: 814 - 833.
9. Buckley, J. Cross-national response styles in international educational assessments: Evidence from PISA 2006. NCES Conference on the Program for International Student Assessment: What we can learn from PISA, Washington, DC, June, Retrieved from http://edsurveys.rti.org/PISA/
10. Chen, C., Lee, S. Y. and Stevenson, H. W. 1995. Response style and cross-cultural comparisons of rating scales among East Asian and North American students. Psychological Science, 6: 170 - 175.
11. De Jong, M. G., Steenkamp, J. -B. E. M., Fox, J.-P. and Baumgartner, H. 2008. Using item response theory to measure extreme response style in marketing research: A global investigation. Journal of Marketing Research, 45: 104 - 115.
12. Dolnicar, S. and Grun, B. 2009. Response style contamination of student evaluation data. Journal of Marketing Education, 31: 160 - 172.
13. Efron, B. 1982. The jackknife, the bootstrap, and other resampling plans. CBMS-NSF Monographs, 38, Philadelphia, PA: SIAM.
14. Embretson, S. E. and Reise, S. P. 2000. Item response theory for psychologists, Mahwah, NJ: Erlbaum.
15. Fienberg, S. E. 1970. Quasi-independence and maximum likelihood estimation in incomplete contingency tables. Journal of the American Statistical Association, 65: 1610 - 1616.
16. Gail, M. H. 1972. Mixed quasi-independent models for categorical data. Biometrics, 28: 703 - 712.
17. Goldberg, L. R., Johnson, J. A., Eber, H. W., Hogan, R., Ashton, M. C., Cloninger, C. R. and Gough, H. C. 2006. The International Personality Item Pool and the future of public-domain personality measures. Journal of Research in Personality, 40: 84 - 96.
18. Goodman, L. A. 1994. On quasi-independence and quasi-dependence in contingency tables, with special reference to ordinal triangular contingency tables. Journal of the American Statistical Association, 89: 1059 - 1063.
19. Hamamura, T., Heine, S. J. and Paulhus, D. L. 2008. Cultural differences in response styles: The role of dialectical thinking. Personality and Individual differences, 44: 932 - 942.
20. Hofstede, G. 2001. Culture's consequences (2nd ed.), Thousand Oaks, CA: Sage.
21. Hui, C. H. and Triandis, H. C. 1989. Effects of culture and response format on extreme response style. Journal of Cross-Cultural Psychology, 20: 296 - 309.
22. Javaras, K. N. and Ripley, B. D. 2007. An "unfolding" latent variable model for Likert attitude data: Drawing inferences adjusted for response style. Journal of the American Statistical Association, 102: 454 - 463.
23. Johnson, T. R. and Bolt, D. M. 2010. On the use of factor-analytic multinomial logit item response models to account for individual differences in response style. Journal of Educational and Behavioral Statistics, 35: 92 - 114.
24. Karner, T. 2002. The volunteer effect of answering personality questionnaires. Psychologische Beiträge [now known as Psychological Test and Assessment Modeling], 44: 42 - 49.
25. Khorramdel, L. and Kubinger, K. D. 2006. The effect of speediness on personality questionnaires: An experiment on applicants within a job recruiting procedure. Psychology Science [now known as Psychological Test and Assessment Modeling], 48: 378 - 397.
26. MacCann, C., Fogarty, G. and Roberts, R. D. 2012. Strategies for success in vocational education: Time management is more important for part-time than full-time students. Learning and Individual Differences, 22: 618 - 623.
27. McCrae, R. R. and Costa, P. T. 1987. Validation of the five-factor model of personality across instruments and observers. Journal of Personality and Social Psychology, 52: 81 - 90.
28. Nunnally, J. 1967. Psychometric theory, New York, NY: McGraw-Hill.
29. Paulhus, D. L. 1991. " Measurement and control of response bias ". In Measures of personality and social psychological attitudes, Edited by: Robinson, J. P., Shaver, P. R. and Wrightsman, L. S. 17 - 59. San Diego, CA: Academic Press.
30. Plieninger, H. and Meiser, T. 2013. Validity of multi-process IRT models for separating content and response styles, Manuscript submitted for publication.
31. Rasch, G. 1960. Probabilistic models for some intelligence and attainment tests, Chicago, IL: University of Chicago Press. Copenhagen, Denmark: Nielsen & Lydiche. (Expanded edition, 1980
32. Rost, J. 2004. Lehrbuch Testtheorie: Testkonstruktion [Textbook test theory: Test construction] (2nd ed.), Bern, Switzerland: Huber.
33. Rost, J., Carstensen, C. and von Davier, M. 1999. Sind die Big five Rasch-skalierbar? Eine Reanalyse der NEO-FFI-Normierungsdaten [Are the Big Five Rasch scalable? A reanalysis of the NEO-FFI norm data]. Diagnostica, 45: 119 - 127.
34. Samejima, F. 1969. " Estimation of ability using a response pattern of graded scores ". In Psychometric Monograph No, Vol. 17, Richmond, VA: Psychometric Society. Retrieved from http://www.psychometrika.org/journal/online/MN17.pdf
35. Schimmack, U., Böckenholt, U. and Reisenzein, R. 2002. Response styles in affect ratings: Making a mountain out of a molehill. Journal of Personality Assessment, 78: 461 - 483.
36. Schwarz, G. 1978. Estimating the dimension of a model. Annals of Statistics, 6: 461 - 464.
37. Shao, J. and Tu, D. 1995. The jackknife and bootstrap, New York, NY: Springer-Verlag.
38. Sireci, S. G., Thissen, D. and Wainer, H. 1991. On the reliability of testlet-based tests. Journal of Educational Measurement, 28: 237 - 247.
39. van Herk, H., Poortinga, Y. H. and Verhallen, T. M. M. 2004. Response styles in rating scales: Evidence of method bias in data from six EU countries. Journal of Cross-Cultural Psychology, 35: 346 - 360.
40. von Davier, M. 2005. A general diagnostic model applied to language testing data (Research Report No. RR-05-16), Princeton, NJ: Educational Testing Service.
41. von Davier, M. 2008. " The mixture general diagnostic model ". In Advances in latent variable mixture models, Edited by: Hancock, G. R. and Samuelson, K. M. 255-274 Charlotte, NC: Information Age Publishing.
42. von Davier, M. 2010a. " Why sum scores may not tell us all about test takers ". In Special Issue on Quantitative Research Methodology Edited by: Wang, L. Vol. 10, 27 - 36. Newborn and Infant Nursing Reviews
43. von Davier, M. 2010b. Hierarchical mixtures of diagnostic models. Psychological Test and Assessment Modeling, 52: 8 - 28.
44. von Davier, M., Rost, R. and Carstensen, C. H. 2007. " Introduction: Extending the Rasch model ". In Multivariate and mixture distribution Rasch models: Extensions and applications, Edited by: von Davier, M. and Carstensen, C. H. 1 - 12. New York, NY: Springer.
45. Wainer, H., Bradlow, E. T. and Wang, X. 2007. Testlet response theory and its applications, New York, NY: Cambridge University Press.
46. Weijters, B., Geuens, M. and Schillewaert, N. 2010. The stability of individual response styles. Psychological Methods, 15: 96 - 110.
47. Weijters, B., Schillewaert, N. and Geuens, M. 2008. Assessing response styles across modes of data collection. Journal of the Academy of Marketing Science, 36: 409 - 422.