Diagnosing Item Score Patterns on a Test Using Item Response Theory-Based Person-Fit Statistics

Psychological Methods

Volumn 8, Issue 1, 2003, Pages 72-87

  Meijer, Rob R ^a  

^a UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; APTITUDE TEST; ARTICLE; COMPUTER PROGRAM; EPIDEMIOLOGY; HUMAN; INTELLIGENCE TEST; MATHEMATICAL COMPUTING; PERSONNEL MANAGEMENT; PROBABILITY; PSYCHOMETRY; REPRODUCIBILITY; STATISTICAL ANALYSIS; STATISTICAL MODEL; STATISTICS;

ADULT; APTITUDE TESTS; BIAS (EPIDEMIOLOGY); DATA INTERPRETATION, STATISTICAL; HUMANS; INTELLIGENCE TESTS; MATHEMATICAL COMPUTING; MODELS, STATISTICAL; PERSONNEL SELECTION; PROBABILITY; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; SOFTWARE;

EID: 0041777704     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/1082-989X.8.1.72     Document Type: Article

References (52)

1. Drasgow, F., Levine, M. V., & McLaughlin, M. E. (1991). Appropriateness measurement for some multidimensional test batteries. Applied Psychological Measurement, 15, 171-191.
2. Drasgow, F., Levine, M. V., & Williams, E. A. (1985). Appropriateness measurement with polychotomous item response models and standardized indices. British Journal of Mathematical and Statistical Psychology, 38, 67-86.
3. Drenth, P. J. D. (1969). Test voor niet Verbale Abstractie [Test for Nonverbal Abstract Reasoning]. Lisse, the Netherlands: Swets & Zeitlinger.
4. Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Erlbaum.
5. Emons, W. H. M., Meijer, R. R., & Sijtsma, K. (2002). Comparing simulated and theoretical sampling distributions of the U3 person-fit statistic. Applied Psychological Measurement, 26, 88-108.
6. Glas, C. A. W. (1988). Contributions to testing and estimating Rasch models. Unpublished doctoral dissertation, University of Twente, Enschede, the Netherlands.
7. Glas, C. A. W., & Ellis, J. L. (1993). Rasch scaling program. Groningen, the Netherlands: iec ProGAMMA
8. Guttman, L. (1950). The basis for scalogram analysis. In S. A. Stouffer, L. Guttman, E. A. Suchman, P. F. Lazarsfeld, S. A. Star, & J. A. Clausen (Eds.), Measurement & prediction (pp. 60-90). Princeton, NJ: Princeton University Press.
9. Hambleton, R. K., & Swaminathan, H. (1985). Item response theory: Principles and applications. Boston: Kluwer-Nijhoff.
10. Junker, B. (2001). On the interplay between nonparametric and parametric IRT, with some thoughts about the future. In A. Boomsma, M. A. J. van Duijn, & T. A. B. Snijders (Eds.), Essays on item response theory (pp. 247-276). New York: Springer-Verlag.
11. Junker, B. W., & Sijtsma, K. (2001). Nonparametric item response theory [special issue]. Applied Psychological Measurement, 25(3).
12. Klauer, K. C. (1991). An exact and optimal standardized person test for assessing consistency with the Rasch model. Psychometrika, 56, 535-547.
13. Klauer, K. C. (1995). The assessment of person fit. In G. H. Fischer & I. W. Molenaar (Eds.), Rasch models: Foundations, recent developments, and applications (pp. 97-110). New York: Springer-Verlag.
14. Levine, M. V., & Drasgow, F. (1988). Optimal appropriateness measurement. Psychometrika, 53, 161-176.
15. Levine, M. V., & Rubin, D. B. (1979). Measuring the appropriateness of multiple-choice test scores. Journal of Educational Statistics, 4, 269-290.
16. Li, M. F., & Olejnik, S. (1997). The power of Rasch person-fit statistics in detecting unusual response patterns. Applied Psychological Measurement, 21, 215-231.
17. Lindgren, B. W. (1993). Statistical theory. New York: Chapman & Hall/CRC.
18. Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
19. Meijer, R. R. (1998). Consistency of test behavior and individual difference in precision of prediction. Journal of Occupational and Organizational Psychology, 71, 147-160.
20. Meijer, R. R., & Sijtsma, K. (1995). Detection of aberrant item score patterns: A review and new developments. Applied Measurement in Education, 8, 261-272.
21. Meijer, R. R., & Sijtsma, K. (2001). Methodology review: Evaluating person fit. Applied Psychological Measurement, 25, 107-135.
22. Meijer, R. R., Sijtsma, K., & Smid, N. G. (1990). An empirical and theoretical comparison of the Rasch and the Mokken approach to IRT. Applied Psychological Measurement, 14, 283-298.
23. Meijer, R. R., & van Krimpen-Stoop, E. M. L. A. (2001). Person fit across subgroups: an achievement testing example. In A. Boomsma, M. A. J. van Duijn, & T. A. B Snijders (Eds.), Essays on item response theory (pp. 377-390). New York: Springer-Verlag.
24. Mokken, R. J. (1971). A theory and procedure of scale analysis. The Hague, the Netherlands: Mouton.
25. Mokken, R. J. (1997). Nonparametric models for dichotomous responses. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 351-367). New York: Springer-Verlag.
26. Molenaar, I. W. (1997). Nonparametric models for polytomous responses. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 369-380). New York: Springer-Verlag.
27. Molenaar, I. W., & Hoijtink, H. (1990). The many null distributions of person fit indices. Psychometrika, 55, 75-106.
28. Molenaar, I. W., & Hoijtink, H. (1995). Person-fit and the Rasch model, with an application to knowledge of logical quantors. Applied Measurement in Education, 9, 27-45.
29. Molenaar, I. W., & Sijtsma, K. (2000). MSP5 for windows, a program for Mokken scale analysis for polytomous items. Groningen, the Netherlands: iec ProGAMMA.
30. Nering, M. L. (1995). The distribution of person fit using true and estimated person parameters. Applied Psychological Measurement, 19, 121-129.
31. Nering, M. L. (1997). The distribution of indexes of person fit within the computerized adaptive testing environment. Applied Psychological Measurement, 21, 115-127.
32. Rasch, G. (1960). Studies in mathematical psychology: Probabilistic models for some intelligence and attainment tests. Oxford, England: Nielsen & Lydiche.
33. Reise, S. P. (2000). Using multilevel logistic regression to evaluate person fit in IRT models. Multivariate Behavioral Research, 35, 543-568.
34. Reise, S. P., & Flannery, W. P. (1996). Assessing person-fit measurement of typical performance applications. Applied Measurement in Education, 9, 9-26.
35. Reise, S. P., & Waller, N. G. (1993). Traitedness and the assessment of response pattern scalability. Journal of Personality and Social Psychology, 65, 143-151.
36. Rosenbaum, P. R. (1987). Probability inequalities for latent scales. British Journal of Mathematical and Statistical Psychology, 40, 157-168.
37. Sijtsma, K. (1998). Methodology review: Nonparametric IRT approaches to the analysis of dichotomous item scores. Applied Psychological Measurement, 22, 3-32.
38. Sijtsma, K., & Meijer, R. R. (2001). The person response function as a tool in person-fit research. Psychometrika, 66, 191-207.
39. Smith, R. M. (1985). A comparison of Rasch person analysis and robust estimators. Educational and Psychological Measurement, 45, 433-444.
40. Smith, R. M. (1986). Person fit in the Rasch model. Educational and Psychological Measurement, 46, 359-372.
41. Smith, R. M. (1994). A comparison of the power of Rasch total and between-item fit statistics to detect measurement disturbances. Educational and Psychological Measurement, 54, 42-55.
42. Snijders, T. (2001). Asymptotic null distribution of person fit statistics with estimated person parameter. Psychometrika, 66, 331-342.
43. S-PLUS. (2000). Programmer's guide and software [Computer software and manual]. Seattle, WA: Mathsoft.
44. Stout, W. F. (1990). A new item response theory modeling approach with applications to unidimensional assessment and ability estimation. Psychometrika, 52, 293-325.
45. Tatsuoka, K. K. (1984). Caution indices based on item response theory. Psychometrika, 49, 95-110.
46. Thissen, D., & Steinberg, L. (1988). Data analysis using item response theory. Psychological Bulletin, 104, 385-395.
47. Trabin, T. E., & Weiss, D. J. (1983). The person response curve: Fit of individuals to item response theory models. In D. J. Weiss (Ed.), New horizons in testing (pp. 83108). New York: Academic Press.
48. van der Flier, H. (1982). Deviant response patterns and comparability of test scores. Journal of Cross-Cultural Psychology, 13, 267-298.
49. van Krimpen-Stoop, E. M. L. A., & Meijer, R. R. (1999). The null distribution of person-fit statistics for conventional and adaptive tests. Applied Psychological Measurement, 23, 327-345.
50. Wright, B. D., & Panchapakesan, N. (1969). A procedure for sample free item analysis. Educational and Psychological Measurement, 29, 23-24.
51. Wright, B. D., & Stone, M. H. (1979). Best test design. Chicago: Mesa Press.
52. Zickar, M. J., & Robie, C. (1999). Modeling faking good on personality items: An item level analysis. Journal of Applied Psychology, 84, 551-563.