Global, local, and graphical person-fit analysis using person-response functions

Psychological Methods

Volumn 10, Issue 1, 2005, Pages 101-119

  Emons, Wilco H M ^a   Sijtsma, Klaas ^a   Meijer, Rob R ^b  

^a TILBURG UNIVERSITY   (Netherlands)

^b UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Aberrant response patterns; Misfitting item score vectors; Nonparametric item response theory; Person fit analysis; Person response function

Indexed keywords

ARTICLE; HUMAN; METHODOLOGY; NONPARAMETRIC TEST; PSYCHOLOGICAL MODEL; PSYCHOLOGY;

HUMANS; MODELS, PSYCHOLOGICAL; PSYCHOLOGY; STATISTICS, NONPARAMETRIC;

EID: 17444402072     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/1082-989X.10.1.101     Document Type: Article

References (63)

1. Birenbaum, M. (1986). Effect of dissimulation motivation and anxiety on response pattern appropriateness measures. Applied Psychological Measurement, 10, 167-174.
2. Bleichrodt, N., Drenth, P. J. D., Zaal, J. N., & Resing, W. C. M. (1984). Revisie Amsterdamse Kinder Intelligentie Test [Revision of Amsterdam Child Intelligence Test]. Lisse, the Netherlands: Swets & Zeitlinger.
3. Bleichrodt, N., Resing, W. C. M., Drenth, P. J. D., & Zaal, J. N. (1987). Intelligentie-meting bij kinderen [Intelligence measurement of children]. Lisse, the Netherlands: Swets & Zeitlinger.
4. Bleichrodt, N., Resing, W. C. M., & Zaal, J. N. (1993). Beoordeling schoolgedrag, SCHOBL-R: Handleiding en verantwoording [School-Behavior Inventory, SCHOBL-R: Manual and justification]. Lisse, the Netherlands: Swets & Zeitlinger.
5. Davison, M. L., & Davenport, E. C. (2002). Identifying criterion-related patterns of predictor scores using multiple regression. Psychological Methods, 7, 468-483.
6. Douglas, J., & Cohen, A. (2001). Nonparametric function estimation for assessing parametric model fit. Applied Psychological Measurement, 25, 234-243.
7. Drasgow, F., Levine, M. V., & McLaughlin, M. E. (1987). Detecting inappropriate test scores with optimal and practical appropriateness indices. Applied Psychological Measurement, 11, 59-79.
8. Drasgow, F., Levine, M. V., & Williams, E. A. (1985). Appropriateness measurement with polychotomous item response models and standardized indices. British Journal of Mathematical and Statistical Psychology, 38, 67-68.
9. Ellis, J. L., & Van den Wollenberg, A. L. (1993). Local homogeneity in latent trait models: A characterization of the homogeneous monotone IRT model. Psychometrika, 58, 417-429.
10. Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Erlbaum.
11. Emons, W. H. M. (2003). Investigating the local fit of item-score vectors. In H. Yanai, A. Okada, K. Shigemasu, Y. Kano, & J. J. Meulman (Eds.). New developments in psychometrics (pp. 289-296). Tokyo: Springer.
12. Emons, W. H. M., Meijer, R. R., & Sijtsma, K. (2002). Comparing simulated and theoretical sampling distributions of the U3 person-fit statistic. Applied Psychological Measurement, 26, 88-108.
13. Emons, W. H. M., Sijtsma, K., & Meijer, R. R. (2004). Testing hypotheses about the person-response function in person-fit analysis. Multivariate Behavioral Research, 39, 1-35.
14. Fox, J. (1997). Applied regression analysis, linear models, and related methods. Thousand Oaks, CA: Sage.
15. Graham, J. R. (1993). MMPI-2: Assessing personality and psychopathology (2nd ed.). New York: University Press.
16. Grayson, D. A. (1988). Two group classification in latent trait theory: Scores with monotone likelihood ratio. Psychometrika, 53, 383-392.
17. Grossman, L. S., Haywood, T. W., & Wasyliw, O. E. (1988). The evaluation of truthfulness in alleged sex offenders' self reports: 16PF and MMPI validity scales. Journal of Personality Assessment, 59, 264-275.
18. Habing, B. (2001). Nonparametric regression and the parametric bootstrap for local dependence assessment. Applied Psychological Measurement, 25, 221-233.
19. Hemker, B. T., Sijtsma, K., Molenaar, I. W., & Junker, B. W. (1997). Stochastic ordering using the latent trait and the sum score in polytomous IRT models. Psychometrika, 62, 331-347.
20. Hoijtink, H., & Molenaar, I. W. (1997). A multidimensional item response model: Constrained latent class analysis using the Gibbs sampler and posterior predictive checks. Psychometrika, 62, 171-189.
21. Holland, P. W., & Rosenbaum, P. R. (1986). Conditional association and unidimensionality in monotone latent variable models. The Annals of Statistics, 14, 1523-1543.
22. Junker, B. W. (1993). Conditional association, essential independence, and monotone unidimensional item response models. The Annals of Statistics, 21, 1359-1378.
23. Karabatsos, G. (2003). Comparing the aberrant response detection performance of thirty-six person-fit statistics. Applied Measurement in Education, 16, 277-298.
24. Karabatsos, G., & Sheu, C. F. (2004). Order-constrained Bayes inference for dichotomous models of unidimensional nonparametric IRT. Applied Psychological Measurement, 28, 110-125.
25. Klauer, K. C. (1991). An exact and optimal standardized person test for assessing consistency with the Rasch model. Psychometrika, 56, 213-228.
26. Li, M. F., & Olejnik, S. (1997). The power of Rasch person-fit statistics in detecting unusual response patterns. Applied Psychological Measurement, 21, 215-231.
27. Lindgren, B. W. (1993). Statistical theory. New York: Chapman & Hall.
28. Meijer, R. R. (1994). The number of Guttman errors as a simple and powerful person-fit statistic. Applied Psychological Measurement, 18, 311-314.
29. Meijer, R. R. (1997). Person fit and criterion-related validity: An extension of the Schmitt, Cortina, and Whitney study. Applied Psychological Measurement, 21, 99-113.
30. Meijer, R. R. (2003). Diagnosing item score patterns on a test using item response theory-based person-fit statistics. Psychological Methods, 8, 72-87.
31. Meijer, R. R., Molenaar, I. W., & Sijtsma, K. (1994). Influence of test and person characteristics on nonparametric appropriateness measurement. Applied Psychological Measurement, 18, 111-120.
32. Meijer, R. R., & Sijtsma, K. (2001). Methodology review: Evaluating person fit. Applied Psychological Measurement, 25, 107-135.
33. Mokken, R. J. (1971). A theory and procedure of scale analysis. Berlin, Germany: De Gruyter.
34. Mokken, R. J., & Lewis, C. (1982). A nonparametric approach to the analysis of dichotomous item responses. Applied Psychological Measurement, 6, 417-430.
35. Molenaar, I. W., & Hoijtink, H. (1990). The many null distributions of person-fit indices. Psychometrika, 55, 75-106.
36. Molenaar, I. W., & Sijtsma, K. (2000). MSP5 for Windows. User's manual. Groningen, the Netherlands: ProGAMMA.
37. z statistic to person-fit measurement. Applied Psychological Measurement, 22, 53-69.
38. Pinsoneault, T. B. (2002). The clinical assessment of children and adolescents: A variable response inconsistency scale and a true response inconsistency scale for the Millon Adolescent Clinical Inventory. Psychological Assessment, 14, 320-330.
39. Ramsay, J. O. (1991). Kernel smoothing approaches to nonparametric item characteristic curve estimation. Psychometrika, 56, 611-630.
40. Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen, Denmark: Danish Institute for Educational Research.
41. Reise, S. P. (2000). Using multilevel logistic regression to evaluate person-fit in IRT models. Multivariate Behavioral Research, 35, 543-568.
42. Reise, S. P., & Waller, N. G. (1993). Traitedness and the assessment of response pattern scalability. Journal of Personality and Social Psychology, 65, 143-151.
43. Reise, S. P., & Widaman, K. F. (1999). Assessing the fit of measurement models at the individual level: A comparison of item response theory and covariance structure approaches. Psychological Methods, 4, 3-21.
44. Rosenbaum, P. R. (1987). Probability inequalities for latent scales. British Journal of Mathematical and Statistical Psychology, 40, 157-168.
45. Rudner, L. M. (1983). Individual assessment accuracy. Journal of Educational Measurement, 20, 207-219.
46. Schmitt, N., Chan, D., Sacco, J. M., McFarland, L. A., & Jennings, D. (1999). Correlates of person fit and effect of person fit on test validity. Applied Psychological Measurement, 23, 41-53.
47. Sijtsma, K., & Junker, B. W. (1996). A survey of theory and methods of invariant item ordering. British Journal of Mathematical and Statistical Psychology, 49, 79-105.
48. Sijtsma, K., & Meijer, R. R. (1992). A method for investigating the intersection of item response functions in Mokken's nonparametric IRT model. Applied Psychological Measurement, 16, 149-157.
49. Sijtsma, K., & Meijer, R. R. (2001). The person response function as a tool in person-fit research. Psychometrika, 66, 191-208.
50. Sijtsma, K., & Molenaar, I. W. (2002). Introduction to nonparametric item response theory. Thousand Oaks, CA: Sage.
51. Simonoff, J. S. (1996). Smoothing methods in statistics. New York: Springer-Verlag.
52. Smith, R. M. (1985). A comparison of Rasch person analysis and robust estimators. Educational and Psychological Measurement, 45, 433-444.
53. Smith, R. M. (1986). Person fit in the Rasch model. Educational and Psychological Measurement, 46, 359-372.
54. Sprent, P. (1993). Applied nonparametric statistical methods. New York: Chapman & Hall.
55. Stout, W. F. (1987). A nonparametric approach for assessing latent trait unidimensionality. Psychometrika, 52, 589-617.
56. Tatsuoka, K. K., & Tatsuoka, M. M. (1982). Detection of aberrant response patterns and their effect on dimensionality. Journal of Educational Statistics, 7, 215-231.
57. Tatsuoka, K. K., & Tatsuoka, M. M. (1983). Spotting erroneous rules by the Individual Consistency Index. Journal of Educational Measurement, 20, 221-230.
58. Tellegen, A. (1982). Brief manual of the Multidimensional Personality Questionnaire. Unpublished manuscript.
59. Trabin, T. E., & Weiss, D. J. (1983). The person response curve: Fit of individuals to item response theory models. In D. J. Weiss (Ed.), New horizons in testing (pp. 83-108). New York: Academic Press.
60. Van der Flier, H. (1980). Vergelijkbaarheid van individuele testprestaties [Comparability of individual test performance]. Lisse, the Netherlands: Swets & Zeitlinger.
61. Van der Flier, H. (1982). Deviant response patterns and comparability of test scores. Journal of Cross-Cultural Psychology, 13, 267-298.
62. Wright, B. D., & Stone, M. H. (1979). Best test design: Rasch measurement. Chicago: MESA Press.
63. Zickar, M. J., & Drasgow, F. (1996). Detecting faking on a personality instrument using appropriateness measurement. Applied Psychological Measurement, 20, 71-88.