A Two-Decision Model for Responses to Likert-Type Items

Journal of Educational and Behavioral Statistics

Volumn 38, Issue 5, 2013, Pages 522-547

  Thissen Roe, Anne ^a   Thissen, David ^b  

^a Kronos Inc ^*  (United States)

^b UNIVERSITY OF NORTH CAROLINA   (United States)

Author keywords

employee selection assessment; multidimensional item response models; response style; scale usage heterogeneity

Indexed keywords

EID: 84883043190     PISSN: 10769986     EISSN: None     Source Type: Journal    
DOI: 10.3102/1076998613481500     Document Type: Article

References (76)

1. Anderson J. A.Regression and ordered categorical variables (with discussion).Journal of the Royal Statistical Society: Series B. 1984;46:1-30.
2. Bachman J. G.,O'Malley P. M.Yea-saying, nay-saying, and going to extremes: Black-White differences in response styles.Public Opinion Quarterly. 1984;48:491-509.
3. Bachman J. G.,O'Malley P. M.,Freedman-Doan P.Response styles revisited: Racial/ethnic and gender differences in extreme responding. Ann Arbor, MI: Institute for Social Research; 2010:.
4. Baumgartner H.,Steenkamp J.-B. E. M.Response styles in marketing research: A cross-national investigation.Journal of Marketing Research. 2001;38:143-156.
5. Berg I.A.The reliability of extreme position response sets in two tests.Journal of Psychology: Interdisciplinary and Applied. 1953;36:3-9.
6. Berg I.A.,Collier J. S.Personality and group differences in extreme response sets.Educational and Psychological Measurement. 1953;13:164-169.
7. Bock R.Estimating item parameters and latent ability when responses are scored in two or more latent categories.Psychometrika. 1972;37:29-51.
8. Bock R. D.,Aitkin M.Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm.Psychometrika. 1981;46:443-459.
9. Bock R. D.,Lieberman M.Fitting a response model for n dichotomously scored items.Psychometrika. 1970;35:179-197.
10. Böckenholt U.Thresholds and intransitiveness in pairwise judgments: A multilevel analysis.Journal of Educational and Behavioral Statistics. 2001;26:269-282.
11. Böckenholt U.Modeling multiple response processes in judgment and choice.Psychological Methods, 17. 2012;:.
12. Bolt D. M.,Johnson T. R.Applications of a MIRT model to self-report measures: Addressing score bias and DIF due to individual differences in response style.Applied Psychological Measurement. 2009;33:335-352.
13. Bolt D.,Newton J.Application of a multidimensional partial credit model allowing within-item slope heterogeneity. Denver, CO:; 2010:.
14. Bolt D. M.,Newton J. R.Multiscale measurement of extreme response style.Educational and Psychological Measurement. 2011;71:814-833.
15. Bolt D. M.,Wollack J. A.,Suh Y.Application of a multidimensional nested logit model to multiple-choice test items.Psychometrika. 2012;77:339-357.
16. BuckleyJ. (2009). Cross-national response styles in international educational assessments: Evidence from PISA 2006. NCES Conference on the Program for International Student Assessment: What we can learn from PISA. Retrieved fromhttps://edsurveys.rti.org/PISA/.
17. Cai L.A two-tier full-information item factor analysis model with applications.Psychometrika. 2010;75:581-612.
18. Cai L.,Thissen D.,du Toit S. H. C.Lincolnwood, IL: Scientific Software International; 2011:.
19. Chen C.,Lee S.-Y.,Stevenson H. W.Response style and cross-cultural comparisons of rating scales among East Asian and North American students.Psychological Science. 1995;6:170-175.
20. Cheung G. W.,Rensvold R. B.Assessing extreme and acquiescence response sets in cross-cultural research using structural equations modeling.Journal of Cross-Cultural Psychology. 2000;31:187-212.
21. Clarke I.Extreme response style in cross-cultural research: An empirical investigation.Journal of Social Behavior and Personality. 2000;15:137-152.
22. Clarke I.Extreme response style in cross-cultural research.International Marketing Review. 2001;18:301-324.
23. Crandall J. E.Some relationships among sex, anxiety, and conservatism of judgment.Journal of Personality. 1965;33:99-107.
24. Crandall J. E.Social interest, extreme response style, and implications for adjustment.Journal of Research in Personality. 1982;16:82-89.
25. Cronbach L. J.Response sets and test validity.Educational and Psychological Measurement. 1946;6:475-494.
26. De Boeck P.,Partchev I.IRTrees: Tree-based item response models of the GLMM family.Journal of Statistical Software. 2012;48:1-28.
27. De Jong M. G.,Steenkamp J.-B. E. M.,Fox J.-P.,Baumgartner H.Using item response theory to measure extreme response style in marketing research: A global investigation.Journal of Marketing Research. 2008;45:104-115.
28. Greenleaf E. A.Improving rating scale measures by detecting and correcting bias components in some response styles.Journal of Marketing Research. 1992a;29:176-188.
29. Greenleaf E. A.Measuring extreme response style.Public Opinion Quarterly. 1992b;56:328-350.
30. Grimm S. D.,Church A. T.A cross cultural study of response biases in personality measures.Journal of Research in Personality. 1999;33:415-441.
31. Hamilton D. L.Personality attributes associated with extreme response style.Psychological Bulletin. 1968;69:192-203.
32. Hart H. N.University of Iowa Studies in Child Welfare. Baldwin B. T., ed. 1923:.
33. Hofstede G. H.Culture's consequences: Comparing values, behaviors, institutions, and organizations across nations. 2001). Culture's consequences: Comparing values, behaviors, institutions, and organizations across nations (2nd ed.). Thousand Oaks, CA: Sage.Thousand Oaks, CA: Sage; 2001:.
34. Hui C. H.,Triandis H. C.The instability of response sets.Public Opinion Quarterly. 1985;49:253-260.
35. Hui C. H.,Triandis H. C.Effects of culture and response format on extreme response style.Journal of Cross-Cultural Psychology. 1989;20:296-309.
36. Javaras K. N.,Ripley B. D.An "unfolding" latent variable model for Likert attitude data: Drawing inferences adjusted for response style.Journal of the American Statistical Association. 2007;478:454-463.
37. Johnson T. R.On the use of heterogeneous thresholds ordinal regression models to account for individual differences in response style.Psychometrika. 2003;68:563-583.
38. Johnson T. R.Discrete choice models for ordinal response variables: A generalization of the stereotype model.Psychometrika. 2007;72:489-504.
39. Johnson T. R.,Bolt D. M.On the use of factor-analytic multinomial logit item response models to account for individual differences in response style.Journal of Educational and Behavioral Statistics. 2010;35:92-114.
40. Johnson T.,Kulesa P.,Cho Y. I.,Shavitt S.The relation between culture and response styles.Journal of Cross-Cultural Psychology. 2005;36:264-277.
41. Landers R. N.,Sackett P. R.,Tuzinski K. A.Retesting after initial failure, coaching rumors, and warnings against faking in online personality measures for selection.Journal of Applied Psychology. 2011;96:202-210.
42. Lenk P.,Wedel M.,Böckenholt U.Bayesian estimation of circumflex models subject to prior theory constraints and scale-usage bias.Psychometrika. 2006;71:33-55.
43. Lewis N. A.,Taylor J. A.Anxiety and extreme response preferences.Educational and Psychological Measurement. 1955;15:111-116.
44. Likert R.A technique for the measurement of attitudes.Archives of Psychology. 1932;140:4-55.
45. Marin G.,Gamba R. J.,Marin B. V.Extreme response style and acquiescence among Hispanics: The role of acculturation and education.Journal of Cross-Cultural Psychology. 1992;23:498-509.
46. McFadden D.Structural analysis of discrete data with econometric application. Manski C. F.McFadden D., ed. Cambridge, MA: MIT Press; 1981:198-272.
47. McFadden D.Advances in econometrics. Hildebrand W., ed. Cambridge, MA: Cambridge University Press; 1982:1-37.
48. Meisenberg G.,Williams A.Are acquiescent and extreme response styles related to low intelligence and education?.Personality and Individual Differences. 2008;44:1539-1550.
49. Messick S.International encyclopedia of the social sciences. Sills D. L., ed. New York, NY: Macmillan; 1968:492-496.
50. Messick S.Improving inquiry in social science: A volume in honor of Lee J. Cronbach. Snow R. E.Wiley D. E., ed. Hillsdale, NJ: Lawrence Erlbaum; 1991:161-200.
51. Moors G.Diagnosing response style behavior by means of a latent-class factor approach: Socio-demographic correlates of gender role attitudes and perceptions of ethnic discrimination reexamined.Quality and Quantity. 2003;37:277-302.
52. Moors G.Facts and artifacts in the comparison of attitudes among ethnic minorities. A multigroup latent class structure model with adjustment for response style behavior.European Sociological Review. 2004;20:303-320.
53. Muraki E.A generalized partial credit model: Application of an EM algorithm.Applied Psychological Measurement. 1992;16:159-176.
54. Neumann G. B.A study of international attitudes of high school students. New York, NY: Teachers College, Columbia University, Bureau of Publications; 1926:.
55. Neyman J.,Pearson E. S.On the use and interpretation of certain test criteria for purposes of statistical inference: Part I.Biometrika. 1928;20A:175-240.
56. O'ConnellV. (2009, January 7). Tests for dwindling retail jobs spawn culture of cheating. Wall Street Journal, p. A-1. Retrieved fromhttp://online.wsj.com/article/SB123129220146959621.html.
57. Parducci A.The relativism of absolute judgement.Scientific American. 1968;219:84-90.
58. Paulhus D. L.Measures of personality and social psychological attitudes. Robinson J. P.Shaver P. R.Wrightsman L. S., ed. New York, NY: Academic Press; 1991:.
59. Pope J.Marketing Research: Methodological Foundations. 1991). How cultural differences affect multi-country research. In ChurchillG.(1995). Marketing Research: Methodological Foundations (6th ed., pp. 530). Orlando, FL: Dryden Press. Churchill G., ed. Orlando, FL: Dryden Press; 1991:530.
60. Rossi P. E.,Gilula Z.,Allenby G. M.Overcoming scale usage heterogeneity: A Bayesian hierarchical approach.Journal of the American Statistical Association. 2001;96:20-31.
61. Rundquist E. A.Response sets: A note on consistency in taking extreme positions.Educational and Psychological Measurement. 1950;10:97-99.
62. Samejima F.Estimation of latent ability using a response pattern of graded scores.Psychometric Monograph. 1969;17:.
63. Smith P.Acquiescent response bias as an aspect of cultural communication style.Journal of Cross-Cultural Psychology. 2004;35:50-61.
64. Suh Y.,Bolt D. M.Nested logit models for multiple-choice item response data.Psychometrika. 2010;75:454-473.
65. Thissen D.Marginal maximum likelihood estimation for the one-parameter logistic model.Psychometrika. 1982;47:175-186.
66. Thissen D.,Cai L.,Bock R. D.Handbook of polytomous item response theory models: Development and applications. Nering M. L.Ostini R., ed. New York, NY: Taylor & Francis; 2010:43-75.
67. Thissen D.,Steinberg L.A taxonomy of item response models.Psychometrika. 1986;51:567-577.
68. Thissen-Roe A.,Scarborough D.,Chambless B.,Hunt S.Inadvertent honesty: Occurrence and meaning of applicant faking in unproctored personality tests. Dallas, TX:; 2006:.
69. Thurstone L. L.Attitudes can be measured.American Journal of Sociology. 1928;33:529-554.
70. Tutz G.Compound regression models for ordered categorical data.Biometrical Journal. 1989;31:259-272.
71. Van Herk H.,Poortinga Y. H.,Verhallen T. M. M.Response styles in rating scales: Evidence of method bias in data from six EU countries.Journal of Cross-Cultural Psychology. 2004;35:346-360.
72. Van Hooft E. A. J.,Born M. P.Intentional response distortion on personality tests: Using eye-tracking to understand response processes when faking.Journal of Applied Psychology. 2012;97:301-316.
73. Van Rosmalen J.,Van Herk H.,Groenen P. J. F.Identifying response styles: A latent-class bilinear multinomial logit model.Journal of Marketing Research. 2010;47:157-172.
74. Weijters B.,Geuens M.,Schillewaert N.The individual consistency of acquiescence and extreme response style in self-report questionnaires.Applied Psychological Measurement. 2010a;34:105-121.
75. Weijters B.,Geuens M.,Schillewaert N.The stability of individual response styles.Psychological Methods. 2010b;15:96-110.
76. Wilks S. S.The large-sample distribution of the likelihood ratio for testing composite hypotheses.Annals of Mathematical Statistics. 1938;9:60-62.