Effects of anchor item methods on the detection of differential item functioning within the family of rasch models

Journal of Experimental Education

Volumn 72, Issue 3, 2004, Pages 221-261

  Wang, Wen Chung ^a  

^a NATIONAL CHUNG CHENG UNIVERSITY   (Taiwan)

Author keywords

Estimation bias; Item response theory; Partial credit model; Power; Type I error

Indexed keywords

EID: 2442624864     PISSN: 00220973     EISSN: 19400683     Source Type: Journal    
DOI: 10.3200/JEXE.72.3.221-261     Document Type: Article

References (74)

1. Adams, R. J., Wilson, M. R., & Wang, W.-C. (1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21, 1-23.
2. Adams, R. J., Wilson, M. R., & Wu, M. L. (1997). Multilevel item response models: An approach to errors in variables regression. Journal of Educational and Behavioral Statistics, 22, 46-75.
3. Andersen, E. B. (1972). The numerical solution of a set of conditional estimation equations. Journal of the Royal Statistical Society, Series B, 34, 42-54.
4. Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43, 561-573.
5. Andrich, D. (1988). Rasch models for measurement. Newbury Park, CA: Sage.
6. Ankenmann, R. D., Witt, E. A., & Dunbar, S. B. (1999). An investigation of the power of the likelihood ratio goodness-of-fit statistic in detecting differential item functioning. Journal of Educational Measurement, 36, 277-300.
7. Bimbaum, A. (1968). Some latent trait models and their use in inferring an examinee's ability. In F. M. Lord & M. R. Novick, Statistical theories of mental test scores (pp. 397-479). Reading, MA: Addison-Wesley.
8. Bock, R. D., & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: An application of the EM algorithm. Psychometrika, 46, 443-459.
9. Bock, R. D., & Lieberman, M. (1970). Fitting a response model for n dichotomously scored items. Psychometrika, 35, 179-197.
10. Bock, R. D., Muraki, E., & Pfeiffenberger, W. (1988). Item pool maintenance in the presence of item parameter drift. Journal of Educational Measurement, 25, 275-285.
11. Boomsma, A., van Duijn, M. A. J., & Snijders, T. B. (Eds.). (2000). Essays on item response theory. New York: Springer.
12. Budgell, G. R., Raju, N. S., & Quartetti, D. A. (1995). Analysis of differential item functioning in translated assessment instruments. Applied Psychological Measurement, 19, 309-321.
13. Candell, G. L., & Drasgow, F. (1988). An iterative procedure for linking metrics and assessing item bias in item response theory. Applied Psychological Measurement, 12, 253-260.
14. Chilisa, B. (2000). Towards equity in assessment: Crafting gender-fair assessment. Assessment in Education, Z, 61-81.
15. Cohen A. S., Kim, S., & Wollack, J. A. (1996). An investigation of the likelihood ratio test for detection of differential item functioning. Applied Psychological Measurement, 20, 15-26.
16. Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Erlbaum.
17. Fidalgo, A. M., Mellenbergh, G. J., & Muniz, J. (2000). Effects of amount of DIF, test length, and purification type on robustness and power of Mantel-Haenszel procedures. Methods of Psychological Research Online, 5, 43-53.
18. Fischer, G. H. (1973). The linear logistic model as an instrument in educational research. Acta Psy-chologica, 37, 359-374.
19. Fischer, G. H. (1993). Notes of the Mantel-Haenszel procedure and another chi-square tests for the assessment of DIF. Methodika, 7, 88-100.
20. Fischer, G. H., & Molenaar, I. W. (Eds.). (1995). Rasch models: Foundations, recent developments, and applications. New York: Springer-Verlag.
21. Fischer, G. H., & Pononcy, I. (1994). An extension of the partial credit model with an application to the measurement of change. Psychometrika, 59, 177-192.
22. Glas, C. A. W. (1998). Detection of differential item functioning using Lagrange multiplier tests. Statistica Sinica, 8, 641-661.
23. Glas, C. A. W., & Verhelst, N. D. (1995). Tests of fit for polytomous Rasch models. In G. H. Fischer & I. W. Molenaar (Eds.), Rasch models: Foundations, recent developments, and applications (pp. 325-352). New York: Springer-Verlag.
24. Haebara, T. (1980). Equating logistic ability scales by a weighted least squares method. Japanese Psychological Research, 22, 144-149.
25. Hanson, B. A., & Beguin, A. A. (1999). Separate versus concurrent estimation ofIRT item parameters in the common item equating design. ACT Research Report Series, 99-8. Iowa City, IA: American College Testing.
26. Hidalgo-Montesinos, M. D., & Lopez-Pina, J. A. (2002). Two-stage equating differential item functioning detection under the graded response model with the Raju area measures and the Lord statistic. Educational and Psychological Measurement, 62, 32-44.
27. Holland, P. W., & Thayer, D. T. (1988). Differential item performance and the Mantel-Haenszel procedure. In H. Wainer & H. Braun (Eds.), Test validity (pp. 129-145). Hillsdale, NJ: Erlbaum.
28. Huang, C. D., Church, A. T., & Katigbak, M. S. (1997). Identifying cultural differences in items and traits: Differential item functioning in the NEO personality inventory. Journal of Cross Cultural Psychology, 28, 192-218.
29. Jodoin, M. G., & Gierl, M. J. (2001). Evaluating Type I error and power rates using an effect size measure with the logistic regression procedure for DIF detection. Applied Measurement in Education, 14, 329-349.
30. Kim, M. (2001). Detecting DIF across the different language groups in a speaking test. Language Testing, 18, 89-114.
31. Kim, S.-H., & Cohen, A. S. (1995). A comparison of Lord's chi-square, Raju's area measures, and the likelihood ratio test on detection of differential item functioning. Applied Psychological Measurement, 8, 291-312.
32. Kim, S.-H, & Cohen, A. S. (1998). Detection of differential item functioning under the graded response model with the likelihood ratio test. Applied Psychological Measurement, 22, 345-355.
33. Kim, S.-H., & Cohen, A. S. (2002). A comparison of linking and concurrent calibration under the graded response model. Applied Psychological Measurement, 26, 25-41.
34. Lewis, C. (1993). A note of the value of including the studied item in the test score when analyzing test items for DIF. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 317-319). Hillsdale, NJ: Erlbaum.
35. Linacre, J. M. (1989). Many-facet Rasch measurement. Chicago: Measurement, Evaluation, Statistics, and Assessment Press.
36. Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Erlbaum.
37. Loyd, B. H., & Hoover, H. D. (1980). Vertical equating using the Rasch model. Journal of Educational Measurement, 17, 179-193.
38. Mailer, S. J. (2001). Differential item functioning in the WISC-III: Item parameters for boys and girls in the national standardization sample. Educational and Psychological Measurement, 61, 793-817.
39. Mantel, N., & Haenszel, W. (1959). Statistical aspects of the analysis of data from retrospective studies of disease. Journal of the National Cancer Institute, 22, 719-748.
40. Marco, G. L. (1977). Item characteristic curve solutions to three intractable testing problems. Journal of Educational Measurement, 14, 139-160.
41. Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149-174.
42. Meredith, W., & Millsap, R. E. (1992). On the misuse of manifest variables in the detection of mea-surement bias. Psychometrika, 57, 289-311.
43. Miller, M. D., & Oshima, T. C. (1992). Effect of sample size, number of biased items and magnitude of bias on a two-stage item bias estimation method. Applied Psychological Measurement, 16, 381-388.
44. Millsap, R. E., & Meredith, W. (1992). Inferential conditions in the statistical detection of measurement bias. Applied Psychological Measurement, 16, 389-402.
45. Muraki, E., Mislevy, R. J., & Bock, R. D. (1987). BIMAIN: A program for item pool maintenance in the presence of item parameter drift and item bias. Mooresville, IN: Scientific Software.
46. Narayanan, P., & Swaminathan, H. (1994). Performance of the Mantel-Haenszel and simultaneous item bias procedures for detecting differential item functioning. Applied Psychological Measurement, 18, 315-328.
47. Narayanan, P., & Swaminathan, H. (1996). Identification of items that show nonuniform DIF. Applied Psychological Measurement, 20, 257-274.
48. Neyman, J., & Pearson, E. S. (1928). On the use and interpretation of certain test criteria for purposes of statistical inference. Biometrika, 20A, 174-240, 263-294.
49. Raju, N. S. (1988). The area between two item characteristics curves. Psychometrika, 53, 495-502.
50. Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: Institute of Educational Research.
51. Rogers, H. J., & Swaminathan, H. (1993). A comparison of logistic regression and Mantel-Haenszel pro-cedures for detecting differential item functioning. Applied Psychological Measurement, 17,105-116.
52. Roussos, L. A., & Stout, W. (1996). Simulation studies of the effects of small sample size and studied item parameters on SIBTEST and Mantel-Haenszel Type I error performance. Journal of Educational Measurement, 33, 215-230.
53. Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometric Monograph Supplement, 17, 1-100.
54. Shealy, R., & Stout, W. (1993). Model-based standardization approach that separates true bias/DIF from group ability differences and detects test bias/DTF as well as item bias/DIF. Psychometrika, 58, 159-194.
55. Soper, J. C., & Walstad, W. B. (1987). Test of economic literacy: Examiner's manual (2nd ed.). New York: National Council on Economic Education.
56. Stocking, M. L., & Lord, F. M. (1983). Developing a common metric in item response theory. Applied Psychological Measurement, 7, 201-210.
57. Swaminathan, H., & Rogers, H. J. (1990). Detecting differential item functioning using logistic regression procedures. Journal of Educational Measurement, 27, 361-370.
58. Thissen, D. (1991). MULTILOG user's guide (Version 6). Mooresville, IN: Scientific Software.
59. Thissen, D., Steinberg, L., & Wainer, H. (1988). Use of item response theory in the study of group differences in trace lines. In H. Wainer & H. Braun (Eds.), Test validity (pp. 147-169). Hillsdale, NJ: Erlbaum.
60. Verhelst, N. D., & Glas, C. A. W. (1995). The one parameter logistic model. In G. H. Fischer & I. W. Molenaar (Eds.), Rasch models: Foundations, recent developments, and applications (pp. 215-237). New York: Springer-Verlag.
61. Volodin, N., & Adams, R. J. (1995, April). Identifying and estimating a d-dimensional Rasch model. Paper presented the annual meeting of the American Educational Research Association, San Francisco.
62. Walstad, W. B., & Robson, D. (1997). Differential item functioning and male-female differences on multiple-choice tests in economics. The Journal of Economic Education, 28, 155-171.
63. Wang, W.-C. (2000a). Modeling effects of differential item functioning in polytomous items. Journal of Applied Measurement, 1, 63-82.
64. Wang, W.-C. (2000b). The simultaneous factorial analysis of differential item functioning. Methods of Psychological Research Online, 5, 51-76.
65. Wang, W.-C., & Su, Y.-H. (in press). Effects of average signed area between two item characteristic curves and test purification procedures on the DIF detection via the Mantel-Haenszel method. Applied Measurement in Education.
66. Wang, W.-C., & Yeh, Y.-L. (2003). Effects of anchor item methods on differential item functioning detection with the likelihood ratio test. Applied Psychological Measurement, 27, 479-498.
67. Wilson, M. R. (1992). The partial order model: An extension of the partial credit model. Applied Psy-chological Measurement, 16, 309-325.
68. Wright, B. D., & Masters, G. N. (1982). Rating scale analysis. Chicago: Measurement, Evaluation, Statistics, and Assessment Press.
69. Wright, B. D., & Stone, M. H. (1979). Best test design. Chicago: Measurement, Evaluation, Statistics, and Assessment Press.
70. Wu, M. L. (1997). The development and application of a fit test for use with marginal maximum likelihood estimation and generalized item response models. Unpublished master's thesis, University of Melbourne, Australia.
71. Wu, M., Adams, R. J., & Wilson, M. R. (1998). ACER ConQuest: Generalized item response modeling software. Camberwell, Victoria: Australian Council for Educational Research.
72. Zimowski, M. F., Muraki, E., Mislevy, R. J., & Bock, R. D. (1996). BILOG-MG: Multiple-group IRT analysis and test maintenance for binary items. Chicago: Scientific Software.
73. Zwick, R. (1990). When do item response function and Mantel-Haenszel definitions of differential item functioning coincide? Journal of Educational Statistics, 75, 185-197.
74. Zwick, R., Donoghue, J. R., & Grima, A. (1993). Assessment of differential item functioning for per-formance tasks. Journal of Educational Measurement, 30, 233-251.