Validity of Multiprocess IRT Models for Separating Content and Response Styles

Educational and Psychological Measurement

Volumn 74, Issue 5, 2014, Pages 875-899

  Plieninger, Hansjörg ^a   Meiser, Thorsten ^a  

^a UNIVERSITY OF MANNHEIM   (Germany)

Author keywords

item response theory; Likert type items; multiprocess model; response styles; validation study

Indexed keywords

EID: 84906891272     PISSN: 00131644     EISSN: 15523888     Source Type: Journal    
DOI: 10.1177/0013164413514998     Document Type: Article

References (63)

1. Aichholzer J.Intra-individual variation of extreme response style in mixed-mode panel studies.Social Science Research. 2013;42:957-970.
2. Austin E. J.,Deary I. J.,Egan V.Individual differences in response scale use: Mixed Rasch modelling of responses to NEO-FFI items.Personality and Individual Differences. 2006;40:1235-1245.
3. BatesD.MaechlerM.BolkerB. (2013). lme4: Linear mixed-effects models using S4 classes (R package version 0.999999-2) [Computer software]. Retrieved from http://CRAN.R-project.org/package=lme4.
4. Baumgartner H.,Steenkamp J.-B. E. M.Response styles in marketing research: A cross-national investigation.Journal of Marketing Research. 2001;38:143-156.
5. Billiet J. B.,Davidov E.Testing the stability of an acquiescence style factor behind two interrelated substantive variables in a panel design.Sociological Methods & Research. 2008;36:542-562.
6. Billiet J. B.,McClendon M. J.Modeling acquiescence in measurement models for two balanced sets of items.Structural Equation Modeling. 2000;7:608-628.
7. Böckenholt U.Modeling multiple response processes in judgment and choice.Psychological Methods. 2012;17:665-678.
8. Bolt D. M.,Newton J. R.Multiscale measurement of extreme response style.Educational and Psychological Measurement. 2011;71:814-833.
9. Camparo J.,Camparo L. B.The analysis of Likert scales using state multipoles: An application of quantum methods to behavioral sciences data.Journal of Educational and Behavioral Statistics. 2013;38:81-101.
10. Caprara G. V.,Vecchione M.,Alessandri G.,Gerbino M.,Barbaranelli C.The contribution of personality traits and self-efficacy beliefs to academic achievement: A longitudinal study.British Journal of Educational Psychology. 2011;81:78-96.
11. Cassady J. C.,Johnson R. E.Cognitive test anxiety and academic performance.Contemporary Educational Psychology. 2002;27:270-295.
12. Cheung G. W.,Lau R. S.Testing mediation and suppression effects of latent variables: Bootstrapping with structural equation models.Organizational Research Methods. 2008;11:296-325.
13. Cheung M. W.-L.,Chan W.Reducing uniform response bias with ipsative measurement in multiple-group confirmatory factor analysis.Structural Equation Modeling. 2002;9:55-77.
14. Chiu M. M.,Klassen R. M.Calibration of reading self-concept and reading achievement among 15-year-olds: Cultural differences in 34 countries.Learning and Individual Differences. 2009;19:372-386.
15. Conger A. J.A revised definition for suppressor variables: A guide to their identification and interpretation.Educational and Psychological Measurement. 1974;34:35-46.
16. De Beuckelaer A.,Weijters B.,Rutten A.Using ad hoc measures for response styles: A cautionary note.Quality & Quantity. 2010;44:761-775.
17. De Boeck P.,Partchev I.IRTrees: Tree-based item response models of the GLMM family.Journal of Statistical Software, Code Snippets. 2012;48 (1): 1-28.
18. De Jong M. G.,Steenkamp J.-B. E. M.,Fox J.-P.,Baumgartner H.Using item response theory to measure extreme response style in marketing research: A global investigation.Journal of Marketing Research. 2008;45:104-115.
19. Dolnicar S.,Grün B.,Leisch F.Quick, simple and reliable: Forced binary survey questions.International Journal of Market Research. 2011;53:231-252.
20. Fischer R.Standardization to account for cross-cultural response bias.Journal of Cross-Cultural Psychology. 2004;35:263-282.
21. Geiser C.,Eid M.,Nussbeck F. W.On the meaning of the latent variables in the CT-C(M-1) model: A comment on Maydeu-Olivares and Coffman.Psychological Methods. 2008 2006;13:49-57.
22. Glöckner-Rist A.,Hoijtink H.The best of both worlds: Factor analysis of dichotomous data using item response theory and structural equation modeling.Structural Equation Modeling. 2003;10:544-565.
23. Gollwitzer M.,Eid M.,Jürgensen R.Response styles in the assessment of anger expression.Psychological Assessment. 2005;17:56-69.
24. Greenleaf E. A.Improving rating scale measures by detecting and correcting bias components in some response styles.Journal of Marketing Research. 1992a;29:176-188.
25. Greenleaf E. A.Measuring extreme response style.Public Opinion Quarterly. 1992b;56:328-351.
26. Jin K.-Y.,Wang W.-C.Generalized IRT models for extreme response style.Educational and Psychological Measurement. 2013;.
27. Johnson T. R.On the use of heterogeneous thresholds ordinal regression models to account for individual differences in response style.Psychometrika. 2003;68:563-583.
28. Johnson T. R.,Bolt D. M.On the use of factor-analytic multinomial logit item response models to account for individual differences in response style.Journal of Educational and Behavioral Statistics. 2010;35:92-114.
29. Johnson T. R.,Shavitt S.,Holbrook A. L.Cross-cultural research methods in psychology. Matsumoto D.van de Vijver F. J. R., ed. New York, NY: Cambridge University; 2011:130-175.
30. Khorramdel L.,von Davier M.Measuring response styles across the Big Five: A multi-scale extension of an approach using multinomial processing trees.Multivariate Behavioral Research. in press;.
31. Little T. D.On the comparability of constructs in cross-cultural research: A critique of Cheung and Rensvold.Journal of Cross-Cultural Psychology. 2000;31:213-219.
32. MacKinnon D. P.Introduction to statistical mediation analysis. New York, NY: Lawrence Erlbaum; 2008.
33. MacKinnon D. P.,Krull J. L.,Lockwood C. M.Equivalence of the mediation, confounding and suppression effect.Prevention Science. 2000;1:173-181.
34. Masters G. N.A Rasch model for partial credit scoring.Psychometrika. 1982;47:149-174.
35. Maydeu-Olivares A.,Coffman D. L.Random intercept item factor analysis.Psychological Methods. 2006;11:344-362.
36. Maydeu-Olivares A.,Kramp U.,García-Forero C.,Gallardo-Pujol D.,Coffman D.The effect of varying the number of response alternatives in rating scales: Experimental evidence from intra-individual effects.Behavior Research Methods. 2009;41:295-308.
37. Meisenberg G.,Williams A.Are acquiescent and extreme response styles related to low intelligence and education?.Personality and Individual Differences. 2008;44:1539-1550.
38. Meiser T.Loglinear Rasch models for the analysis of stability and change.Psychometrika. 1996;61:629-645.
39. Meiser T.,Machunsky M.The personal structure of personal need for structure: A mixture-distribution Rasch analysis.European Journal of Psychological Assessment. 2008;24:27-34.
40. Morren M.,Gelissen J.,Vermunt J.The impact of controlling for extreme responding on measurement equivalence in cross-cultural research.Methodology. 2012;8:159-170.
41. MullisI. V. S.MartinM. O.KennedyA. M.FoyP. (2007). PIRLS 2006 international report: IEA's Progress in International Reading Literacy Study in primary schools in 40 countries. Chestnut Hill, MA: TIMSS & PIRLS International Study Center. Retrieved from http://timssandpirls.bc.edu.
42. Muthén L. K.,Muthén B. O.Mplus user's guide. 2010). Mplus user's guide (6th ed.). Los Angeles, CA: Author.Los Angeles, CA: Author; 2010.
43. Narayan S.,Krosnick J. A.Education moderates some response effects in attitude measurement.Public Opinion Quarterly. 1996;60:58-88.
44. Nunnally J. C.Psychometric theory. 1978). Psychometric theory (2nd ed.). New York, NY: McGraw-Hill.New York, NY: McGraw-Hill; 1978.
45. PISA 2006 technical report. Paris, France: Author; 2009.
46. Paulhus D. L.Measures of personality and social psychological attitudes. Robinson J. P.Shaver P. R.Wrightsman L. S., ed. San Diego, CA: Academic Press; 1991:17-59.
47. Pohl S.,Steyer R.Modeling common traits and method effects in multitrait-multimethod analysis.Multivariate Behavioral Research. 2010;45:45-72.
48. RammM.MultrusF.BargelT. (2011). Studiensituation und studentische Orientierungen. 11. Studierendensurvey an Universitäten und Fachhochschulen [Study conditions and students' orientation. 11th survey of students]. Bonn, Germany: Bundesministerium für Bildung und Forschung. Retrieved from http://www.bmbf.de/pub/studiensituation_studentetische_orientierung_elf_lang.pdf.
49. Rammstedt B.,Goldberg L. R.,Borg I.The measurement equivalence of Big-Five factor markers for persons with different levels of education.Journal of Research in Personality. 2010;44:53-61.
50. Rossi P. E.,Gilula Z.,Allenby G. M.Overcoming scale usage heterogeneity: A Bayesian hierarchical approach.Journal of the American Statistical Association. 2001;96:20-31.
51. Rutkowski L.,Gonzalez E.,Joncas M.,von Davier M.International large-scale assessment data issues in secondary analysis and reporting.Educational Researcher. 2010;39:142-151.
52. SamejimaF. (1969). Estimation of latent ability using a response pattern of graded scores (Psychometric Monograph No. 17). Richmond, VA: Psychometric Society. Retrieved from http://www.psychometrika.org/journal/online/MN17.pdf.
53. Schermelleh-EngelK.MoosbruggerH.MüllerH. (2003). Evaluating the fit of structural equation models: Test of significance and descriptive goodness-of-fit measures. Methods of Psychological Research - Online8(2), 23-74. Retrieved from http://www.dgps.de/fachgruppen/methoden/mpr-online.
54. ten Berge J. M. F.A legitimate case of component analysis of ipsative measures, and partialling the mean as an alternative to ipsatization.Multivariate Behavioral Research. 1999;34:89-102.
55. Tutz G.Sequential item response models with an ordered response.British Journal of Mathematical and Statistical Psychology. 1990;43:39-55.
56. Verhelst N. D.,Glas C. A. W.,de Vries H. H.Handbook of modern item response theory. van der Linden W. J.Hambleton R. K., ed. New York, NY: Springer; 1997:123-138.
57. Weijters B.,Cabooter E. F. K.,Schillewaert N.The effect of rating scale format on response styles: The number of response categories and response category labels.International Journal of Research in Marketing. 2010;27:236-247.
58. Weijters B.,Geuens M.,Schillewaert N.The stability of individual response styles.Psychological Methods. 2010a;15:96-110.
59. Weijters B.,Geuens M.,Schillewaert N.The individual consistency of acquiescence and extreme response style in self-report questionnaires.Applied Psychological Measurement. 2010b;34:105-121.
60. Weijters B.,Schillewaert N.,Geuens M.Assessing response styles across modes of data collection.Journal of the Academy of Marketing Science. 2008;36:409-422.
61. WetzelE.CarstensenC. H. (2013). Multidimensional modeling of response styles. Manuscript submitted for publication.
62. Wetzel E.,Carstensen C. H.,Böhnke J. R.Consistency of extreme response style and non-extreme response style across traits.Journal of Research in Personality. 2013;47:178-189.
63. Winkler J. D.,Kanouse D. E.,Ware J.Controlling for acquiescence response set in scale development.Journal of Applied Psychology. 1982;67:555-561.