A simulation study provided sample size guidance for differential item functioning (DIF) studies using short scales

Journal of Clinical Epidemiology

Volumn 62, Issue 3, 2009, Pages 288-295

  Scott, Neil W ^a   Fayers, Peter M ^a,b   Aaronson, Neil K ^c   Bottomley, Andrew ^d   de Graeff, Alexander ^e   Groenvold, Mogens ^f,g   Gundy, Chad ^c   Koller, Michael ^h   Petersen, Morten A ^f   Sprangers, Mirjam A G ⁱ  

^a UNIVERSITY OF ABERDEEN   (United Kingdom)

^b NORWEGIAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Norway)

^c NETHERLANDS CANCER INSTITUTE   (Netherlands)

^d Cancer Data Center   (Belgium)

^e UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

^f BISPEBJERG HOSPITAL   (Denmark)

^g UNIVERSITY OF COPENHAGEN   (Denmark)

^h UNIVERSITY HOSPITAL REGENSBURG   (Germany)

ⁱ UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Computer simulations; Differential item functioning; Floor effects; Health related quality of life; Ordinal logistic regression; Short scales

Indexed keywords

ARTICLE; DIFFERENTIAL ITEM FUNCTIONING; LOGISTIC REGRESSION ANALYSIS; PRIORITY JOURNAL; QUALITY OF LIFE; SAMPLE SIZE; SAMPLING ERROR; SIMULATION; STATISTICAL ANALYSIS;

COMPUTER SIMULATION; FEMALE; HUMANS; LOGISTIC MODELS; MALE; MODELS, STATISTICAL; OUTCOME ASSESSMENT (HEALTH CARE); PSYCHOMETRICS; QUALITY OF LIFE; SAMPLE SIZE; WEIGHTS AND MEASURES;

EID: 58749086218     PISSN: 08954356     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2008.06.003     Document Type: Article

References (35)

1. Holland P.W., and Wainer H. Differential item functioning (1993), Lawrence Erlbaum Associates, Hillsdale, New Jersey
2. Groenvold M., and Petersen M.A. The role and use of differential item functioning (DIF) analysis of quality of life data from clinical trials. In: Fayers P., and Hays R. (Eds). Assessing quality of life in clinical trials (2005), Oxford University Press, Oxford 195-208
3. Teresi J.A. Statistical methods for examination of differential item functioning (DIF) with applications to cross-cultural measurement of functional, physical and mental health. J Mental Health Aging 7 (2001) 31-40
4. Teresi J.A. Overview of quantitative measurement methods: equivalence, invariance, and differential item functioning in health applications. Med Care 44 (2006) S39-S49
5. Benson J., and Hutchinson S.R. The state of the art in bias research in the United States. Eur Rev Appl Psychol 47 (1997) 281-294
6. Clauser B.E., and Mazor K.M. Using statistical procedures to identify differentially functioning test items. Educ Measur Iss Pract 2 (1998) 31-44
7. Teresi J.A. Different approaches to differential item functioning in health applications: advantages, disadvantages and some neglected topics. Med Care 44 (2006) S152-S170
8. Millsap R.E. Comments on methods for the investigation of measurement bias in the mini-mental state examination. Med Care 44 (2006) S171-S175
9. Zieky M. Practical questions in the use of DIF statistics in test development. In: Holland P.W., and Wainer H. (Eds). Differential item functioning (1993), Lawrence Erlbaum Associates, Hillsdale, New Jersey 337-348
10. Zumbo B.D. A handbook on the theory and methods of differential item functioning (DIF): logistic regression modeling as a unitary framework for binary and Likert-type (ordinal) item scores (1999) 1-57
11. Jodoin M.G., and Gierl M.J. Evaluating type I error and power rates using an effect size measure with the logistic regression procedure for DIF detection. Appl Measur Educ 14 (2001) 329-349
12. Crane P.K., Cetin K., Cook K.F., Johnson K., Deyo R., and Amtmann D. Differential item functioning impact in a modified version of the Roland-Morris disability questionnaire. Qual Life Res 16 (2007) 981-990
13. Ferreres Traver D., Fidalgo Aliste A.M., and Muñiz J. Detección del funcionamiento diferencial de los ítems no uniforme: comparación de los métodos Mantel-Haenszel y regressión logística. Psicothema 12 (2000) 220-225
14. French A.W., and Miller T.R. Logistic regression and its use in detecting differential functioning in polytomous items. J Educ Measur 33 (1996) 315-332
15. Gómez-Benito J., Hidalgo Montesinos M.D., Guilera Ferré G., and Moreno Torrente M. A bibliometric study of differential item functioning. Scientometrics 64 (2005) 3-16
16. Hidalgo M.D., and Lopez-Pina J.A. Differential item functioning detection and effect size: a comparison between logistic regression and Mantel-Haenszel procedures. Educ Psychol Measur 64 (2004) 903-915
17. Hidalgo Montesinos M.D., and Gómez-Benito J. Comparación de la eficacia de regresión logística politómica y análisis discriminante logístico en al detección del DIF no uniforme. Psicothema 12 (2000) 298-300
18. Penny J., and Johnson R.L. How group differences in matching criterion distribution and IRT item difficulty can influence the magnitude of the Mantel-Haenszel chi-squared DIF index. J Exp Educ 67 (1999) 343-367
19. Rogers H.J., and Swaminathan H. A comparison of logistic regression and Mantel-Haenszel procedures for detecting differential item functioning. Appl Psychol Measur 17 (1993) 105-116
20. Swaminathan H., and Rogers H.J. Detecting differential item functioning using logistic regression procedures. J Educ Measur 27 (1990) 361-370
21. Wang W.C., and Su Y.H. Factors influencing the Mantel and generalized Mantel-Haenszel methods for the assessment of differential item functioning in polytomous items. Appl Psychol Measur 28 (2004) 450-480
22. Wang W.C., and Su Y.H. Effects of average signed area between two item characteristic curves and test purification procedures on the DIF detection via the Mantel-Haenszel method. Appl Measur Educ 17 (2004) 113-144
23. Welkenhuysen-Gybels J. The performance of some observed and unobserved conditional invariance techniques for the detection of differential item functioning. Qual Quant 38 (2004) 681-702
24. Donoghue J.R., Holland P.W., and Thayer D.T. A Monte Carlo study of factors that affect the Mantel-Haenszel and standardization measures of differential item functioning. In: Holland P.W., and Wainer H. (Eds). Differential item functioning (1993), Lawrence Erlbaum Associates, Hillsdale, New Jersey 137-166
25. Scott N.W., Fayers P.M., Aaronson N.K., Bottomley A., de Graeff A., Groenvold M., et al. The use of differential item functioning analyses to identify cultural differences in responses to the EORTC QLQ-C30. Qual Life Res 16 (2007) 115-129
26. Scott S.C., Goldberg M.S., and Mayo N.E. Statistical assessment of ordinal outcomes in comparative studies. J Clin Epidemiol 50 (1997) 45-55
27. Crane P.K., Gibbons L.E., Jolley L., and van Belle G. Differential item functioning analysis with ordinal logistic regression techniques. Med Care 44 (2006) S115-S123
28. Aaronson N.K., Ahmedzai S., Bergman B., Bullinger M., Cull A., Duez N.J., et al. The European Organization for Research and Treatment of cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst 85 (1993) 365-376
29. Fayers P., Aaronson N., Bjordal K., Groenvold M., Curran D., and Bottomley A. EORTC QLQ-C30 scoring manual (2001), European Organization for Research and Treatment of Cancer, Brussels
30. Muraki E. A generalized partial credit model. In: van der Linden W.J., and Hambleton R.K. (Eds). Handbook of modern item response theory (1997), Springer-Verlag, New York 153-168
31. Bjorner J.B., Kreiner S., Ware J.E., Damsgaard M.T., and Bech P. Differential item functioning in the Danish translation of the SF-36. J Clin Epidemiol 51 (1998) 1189-1202
32. Fayers P.M., and Machin D. Quality of life: assessment, analysis and interpretation (2000), John Wiley & Sons, Chichester
33. Petersen M.A., Groenvold M., Bjorner J.B., Aaronson N., Conroy T., Cull A., et al., for the European Organisation for Research and Treatment of Cancer Quality of Life Group. Use of differential item functioning analysis to assess the equivalence of translations of a questionnaire. Qual Life Res 12 (2003) 373-385
34. Lai J.S., Teresi J., and Gershon R. Procedures for the analysis of differential item functioning (DIF) for small sample sizes. Eval Health Prof 28 (2005) 283-294
35. Fayers P., Weeden S., and Curran D. EORTC QLQ-C30 reference values (1998), EORTC Quality of Life Study Group, Brussels