Measurement equivalence: A comparison of methods based on confirmatory factor analysis and item response theory

Journal of Applied Psychology

Volumn 87, Issue 3, 2002, Pages 517-529

  Raju, Nambury S ^a   Laffitte, Larry J ^c   Byrne, Barbara M ^b  

^a ILLINOIS INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF OTTAWA   (Canada)

^c Psychological Associates Inc   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0036626070     PISSN: 00219010     EISSN: None     Source Type: Journal    
DOI: 10.1037/0021-9010.87.3.517     Document Type: Article

References (51)

1. Arbuckle, J. L. (1999). AMOS 4.0 [Computer Software]. Chicago: Small-waters.
2. Baker, F. B. (1995). EQUATE 2.1: Computer program for equating two metrics in item response theory [Computer program]. Madison: University of Wisconsin, Laboratory of Experimental Design.
3. Bentler, P. M. (1995). EQS: Structural equations program manual. Encino, CA: Multivariate Software.
4. Bock, R. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29-51.
5. Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley.
6. Byrne, B. M. (1988). The self description questionnaire: Testing for equivalent validity across ability. Educational and Psychological Measurement, 48, 397-406.
7. Byrne, B. M. (1994a). Structural equation modeling with EQS and EQS/ Windows: Basic concepts, applications, and programming. Thousand Oaks, CA: Sage.
8. Byrne, B. M. (1994b). Testing for the factorial validity, replication, and invariance of a measuring instrument: A paradigmatic application based on the Maslach Burnout Inventory. Multivariate Behavioral Research, 29, 289-311.
9. Byrne, B. M. (1998). Structural equation modeling with LISREL, PRELIS, and SIMPLIS: Basic concepts, applications, and programming. Mahwah, NJ: Erlbaum.
10. Byrne, B. M. (2001a). Structural equation modeling with AMOS: Basic concepts, applications, and programming. Mahwah, NJ: Erlbaum.
11. Byrne, B. M. (2001b). Structural equation modeling with AMOS, EQS, and LISREL: Comparative approaches to testing for the factorial validity of a measuring instrument. International Journal of Testing, 1, 55-86.
12. Byrne, B. M., & Shavelson, R. J. (1987). Adolescent self-concept: Testing the assumption of equivalent structure across gender. American Educational Research Journal, 24, 365-385.
13. Byrne, B. M., Shavelson, R., & Muthén, B. O. (1989). Testing for equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456-466.
14. Chan, D. (2000). Detection of differential item functioning on the Kirton Adaption-Innovation Inventory using multi-group mean and covariance structure analyses. Multivariate Behavioral Research, 35, 169-199.
15. Cheung,G.W., & Rensvold,R.B. (1999). Testing factorial invariance across groups: A reconceptualization and proposed new method. Journal of Management, 25, 1-27.
16. Cohen, A. S., Kim, S. H., & Baker, F. B. (1993). Detection of differential item functioning in the graded response model. Applied Psychological Measurement, 17, 335-350.
17. Collins, W. C., Raju, N. S., & Edwards, J. E. (2000). Assessing differential functioning in a satisfaction scale. Journal of Applied Psychology, 85, 451-461.
18. Dorans, N. J., & Holland, P. W. (1993). DIF detection and description: Mantel-Haenszel and standardization. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 35-66). Hillsdale, NJ: Erlbaum.
19. Drasgow, F., & Kanfer, R. (1985). Equivalence of psychological measurement in heterogeneous populations. Journal of Applied Psychology, 70, 662-680.
20. Edwards, J. E., Elig, T. W., Edwards, D. L., & Riemer, R. A. (1997, April). The 1995 Armed Forces Sexual Harassment Survey: Codebook for Form b (Report No. 95-014). Arlington. VA: Defense Manpower Data Center.
21. Facteau, J. D., & Craig, S. B. (2001). Are performance appraisal ratings from different sources comparable? Journal of Applied Psychology, 86, 215-227.
22. Flowers, C. P., Oshima, T. C., & Raju, N. S. (1999). A description and demonstration of the polytomous-DFIT framework. Applied Psychological Measurement, 23, 309-326.
23. Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory, Newbury Park. CA: Sage.
24. Jöreskog, K. G. (1971). Statistical analysis of sets of congeneric tests. Psychometrika, 36, 109-133.
25. Jöreskog, K. G., & Sörbom, D. (1989). LISREL 7: User's reference guide. Chicago: Scientific Software.
26. Jöreskog, K. G., & Sörbom, D. (1996). LISREL 8: User's reference guide. Chicago, IL: Scientific Software.
27. Kim, S. H., Cohen, A. S., & Park, T. H. (1995). Detection of differential item functioning in multiple groups. Journal of Educational Measurement, 32, 261-276.
28. Laffitte, L. J., Raju, N. S., Scott, J. C., & Fasolo, P. M. (1998, April). Examination of the measurement equivalence of a 360° feedback assessment with confirmatory factor analysis and item response theory. Paper presented at the annual conference of the Society for Industrial and Organizational Psychology, Dallas, TX.
29. Little, T. D. (1997). Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues. Multivariate Behavioral Research, 32, 53-76.
30. Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillside, NJ: Erlbaum.
31. Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
32. Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149-174.
33. Maurer, T. J., Raju, N. S., & Collins, W. C. (1998). Peer and subordinate performance appraisal measurement equivalence. Journal of Applied Psychology, 83, 693-702.
34. McDonald, R. P. (1999). Test theory: A unified treatment. Mahwah, NJ: Erlbaum.
35. Meredith, W. (1964). Notes on factorial invariance. Psychometrika, 29, 177-185.
36. Muraki, E. (1990). Fitting polytomous item response model to Likert-type data. Applied Psychological Measurement, 14, 59-71.
37. Muraki, E., & Bock, R. D. (1997). PARSCALE: IRT based test scoring and item analysis for graded open-ended exercises and performance tasks. Chicago, IL: Scientific Software International.
38. Oshima, T. C., Raju, N. S., & Flowers, C. (1997). Development and demonstration of multidimensional IRT-based internal measures of differential functioning of items and tests. Journal of Educational Measurement, 34, 253-272.
39. Raju, N. S. (1988). The area between two item characteristic curves. Psychometrika, 53, 495-502.
40. Raju, N. S. (1990). Determining the significance of estimated signed and unsigned areas between two item response functions. Applied Psychological Measurement, 14, 197-207.
41. Raju, N. S. (1999). DFIT5P: A Fortran program for calculating DIF/DTF [Computer program]. Chicago: Illinois Institute of Technology.
42. Raju, N. S., van der Linden, W., & Fleer, P. (1995). An IRT-based internal measure of test bias with applications for differential item functioning. Applied Psychological Measurement, 19, 353-368.
43. Reise, S. P., & Widaman, K. F. (1999). Assessing the fit of measurement models at the individual level: A comparison of item response theory and covariance structure approaches. Psychological Methods, 4, 3-21.
44. Reise, S. P., Widaman, K. F., & Pugh, R. H. (1993). Confirmatory factor analysis and item response theory: Two approaches for exploring measurement equivalence. Psychological Bulletin, 114, 552-566.
45. Rensvold, R. B., & Cheung, G. W. (1998). Testing measurement models for factorial invariance: A systematic approach. Educational and Psychological Measurement, 58, 1017-1034.
46. Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph, 17, 1-100.
47. Samejima, F. (1972). A general model for free-response data. Psychometrika Monograph, 18, 1-68.
48. Sörbom, D. (1974). A general method for studying differences in factor means and factor structure between groups. British Journal of Mathematical and Statistical Psychology, 27, 229-239.
49. Thissen, D. (1991). MULTILOC user's guide: Multiple, categorical item analysis and test scoring using item response theory (Version 6.0) [Computer program]. Chicago, IL: Scientific Software.
50. Thissen, D., Steinberg, L., & Wainer, H. (1988). Use of item response theory in the study of group differences in trace lines. In H. Wainer & H. I. Braun (Eds.), Test validity (pp. 147-169). Hillsdale, NJ: Erlbaum.
51. Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4-69.