Measurement invariance in careers research: Using IRT to study gender differences in medical students' specialization decisions

Journal of Career Development

Volumn 35, Issue 1, 2008, Pages 60-83

  Behrend, Tara S ^a   Foster Thompson, Lori ^a   Meade, Adam W ^a   Newton, Dale A ^b   Grayson, Martha S ^c  

^a NORTH CAROLINA STATE UNIVERSITY   (United States)

^b EAST CAROLINA UNIVERSITY   (United States)

^c NEW YORK MEDICAL COLLEGE   (United States)

Author keywords

Career choice; Differential item functioning; Gender differences; Item response theory; Measurement invariance; Medical students; Primary care specialty

Indexed keywords

EID: 49549123131     PISSN: 08948453     EISSN: None     Source Type: Journal    
DOI: 10.1177/0894845308317936     Document Type: Article

References (58)

1. Aros, J.R., Henly, G.A., & Curtis, N.T. (1998). Occupational sextype and sex differences in vocational preference-measured interest relationships. Journal of Vocational Behavior, 53, 227-242.
2. Baker, B.A., Caison, A.L., & Meade, A.W. (2007). Assessing gender-related differential item functioning and predictive validity with the institutional integration scale. Educational and Psychological Measurement, 67, 545-559.
3. Baker, F.B. (1995). EQUATE 2.1: Computer program for equating two metrics in item response theory. Madison: University of Wisconsin, Laboratory of Experimental Design.
4. Baron, R.M., & Kenny, D.A. (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic and statistical considerations. Journal of Personality and Social Psychology, 51, 1173-1182.
5. Bland, C.J., Meurer, L., & Maldonado, G. (1995). Determinants of primary care specialty choice: A non-statistical meta-analysis of the literature. Academic Medicine, 70, 620-641.
6. Blustein, D.L., & Ellis, M.V. (2000). The cultural context of career assessment. Journal of Career Assessment, 8, 379-390.
7. Boles, J.S., Dean, D.H., Ricks, J.M., Short, J.C., & Wang, G. (2000). The dimensionality of the Maslach burnout inventory across small business owners and educators. Journal of Vocational Behavior, 56, 12-34.
8. Brown, M.T. (2000). Blueprint for the assessment of socio-structural influences in career choice and decision making. Journal of Career Assessment, 8, 371-378.
9. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2 nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
10. Collins, W.C., Raju, N.S., & Edwards, J.E. (2000). Assessing differential functioning in a satisfaction scale. Journal of Applied Psychology, 85, 451-461.
11. Cross, S.E., & Madson, L. (1997). Models of the self: Self-construals and gender. Psychological Bulletin, 122, 5-37.
12. Dawis, R.V. (1994). The theory of work adjustment as convergent theory. In M. L. Savickas & R. W. Lent (Eds.), Convergence in career development theories: Implications for science and practice (pp 33-43). Palo Alto, CA: CPP Books.
13. Dawis, R.V., & Lofquist, L.H. (1984). A psychological theory of work adjustment: An individual-differences model and its applications. Minneapolis: University of Minnesota Press.
14. Donovan, M.A., Drasgow, F., & Probst, T.M. (2000). Does computerizing paper-and-pencil job attitude scales make a difference? New IRT analyses offer insight. Journal of Applied Psychology, 85, 305-13.
15. Dorsey, E.R., Jarjoura, D., & Rutecki, G.W. (2003). Influence of controllable lifestyle on recent rends in specialty choice by U.S. medical students. Journal of the American Medical Association, 290, 1173-1178.
16. Dorsey, E.R., Jarjoura, D., & Rutecki, G.W. (2005). The influence of controllable lifestyle and sex on the specialty choices of graduating U.S. medical students, 1996-2003. Academic Medicine, 80, 791-796.
17. Ellis, B.B., & Mead, A.D. (2000). Assessment of the measurement equivalence of a Spanish translation of the 16PF questionnaire. Educational and Psychological Measurement, 60, 787-807.
18. Facteau, J.D., & Craig, S.B. (2001). Are performance appraisal ratings from different rating sources comparable ? Journal of Applied Psychology, 86, 215-27.
19. Flowers, C.P., Oshima, T.C., & Raju, N.S. (1999). A description and demonstration of the polytomous-DFIT framework. Applied Psychological Measurement, 23, 309-326.
20. Gabriel, S., & Gardner, W.L. (1999). Are there "his" and "hers" types of interdependence? The implications of gender differences in collective versus relational interdependence for affect, behavior, and cognition. Journal of Personality and Social Psychology, 77, 642-55.
21. Grayson, M.S., Newton, D.A., & Thompson, L.F. (2005). Money isn't everything: Which career values determine whether students will become general internists ? Journal of General Internal Medicine, 20, 160.
22. Grayson, M.S., Newton, D.A., & Whitley, T. (1996). First-year medical students' knowledge of and attitudes toward primary care careers. Family Medicine, 28, 337-342.
23. Hair, J.F., Anderson, R.E., Tatham, R.L., & Black, W.C. (1998). Multivariate data analysis. Upper Saddle River, NJ: Prentice-Hall.
24. Harmon, L.W. (1997). Do gender differences necessitate separate career development theories and measures ? Journal of Career Assessment, 5, 463-470.
25. Holland, J.L. (1985). Making vocational choices: A theory of vocational personalities and work environments. Englewood Cliffs, NJ: Prentice Hall.
26. Horn, J.L., & McArdle, J.J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research, 18, 117-144.
27. Jolly, P. (2006). Charting outcomes in the match: Characteristics of applicants who matched to their preferred specialty in the 2005 NRMP main residency match. Retrieved August 20, 2007 from the World Wide Web: http://www.nrmp.org/matchoutcomes.pdf.
28. Konrad, A.M., Ritchie, J.E., Jr., Lieb, P., & Corrigall, E. (2000). Sex differences and similarities in job attribute preferences: A meta-analysis. Psychological Bulletin, 126, 593-641.
29. Marini, M.M., Fan, P.L., Finley, E., & Beutel, A.M. (1996). Gender and job values. Sociology of Education, 69, 49-65.
30. Maurer, J., Raju, N.S., & Collins, W.C. (1998). Peer and subordinate performance appraisal measurement equivalence. Journal of Applied Psychology, 83, 693-702.
31. McWhirter, E.H. (1997). Perceived barriers to education and career: Ethnic and gender differences. Journal of Vocational Behavior, 50, 124-140.
32. Meade, A.W., & Lautenschlager, G.J. (2004). A comparison of Item Response Theory and Confirmatory Factor Analytic methodologies for establishing measurement equivalence/ invariance. Organizational Research Methods, 7 (4). 361-388.
33. Meade, A.W., Michels, L.C., & Lautenschlager, G.J. (2007). Are Internet and paper-and-pencil personality tests truly comparable?: An experimental design measurement invariance study. Organizational Research Methods, 10, 322-345.
34. Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, 525-543.
35. Myers, D.G. (2005). Social psychology (8 th ed.). Boston: McGraw-Hill.
36. Newton, D.A., & Grayson, M.S. (2003). Trends in career choice by U.S. medical school graduates. Journal of the American Medical Association, 290, 1179-1182.
37. Newton, D.A., Grayson, M.S., & Thompson, L.F. (2005). The variable influence of lifestyle and income on medical students' career specialty choices: Data from two U.S. medical schools, 1998-2004. Academic Medicine, 80, 809-814.
38. Newton, D.A., Thompson, L.F., & Grayson, M.S. (2004). Career choices of medical students pursuing pediatrics: What predicts intentions to subspecialize? Pediatric Research, 55, 356A.
39. Raju, N.S. (1999). DFIT4P: A Fortran program for calculating DIF/DTF [Computer program]. Chicago: Illinois Institute of Technology.
40. Raju, N.S., Laffitte, L.J., & Byrne, B.M. (2002). Measurement equivalence: A comparison of methods based on confirmatory factor analysis and item response theory. Journal of Applied Psychology, 87, 517-529.
41. Reckase, M.D. (1979). Unifactor latent trait models applied to multifactor tests: Results and implications. Journal of Educational Statistics, 4, 207-230.
42. Reise, S.P., Smith, L., & Furr, R.M. (2001). Invariance on the NEO PI-R neuroticism scale. Multivariate Behavioral Research, 36, 83-110.
43. Roter, D.L., Hall, J.A., & Aoki, Y. (2002). Physician gender effects in medical communication: A meta-analytic review. The Journal of the American Medical Association, 288, 756-764.
44. Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores (Psychometric Monograph No. 18). Iowa City, IA: Psychometric Society.
45. Schwartz, S.H. (1992). Universals in the content and structure of values: Theoretical advances and empirical tests in 20 countries. In M. P. Zanna (Ed.), Advances in experimental social psychology (Vol. 25, pp. 1-65). New York: Academic Press.
46. Schwartz, M., Basco, W.T., Grey, M.R., Elmore, J., & Rubenstein, T. (2005). Rekindling student interest in generalist careers. Annals of Internal Medicine, 142, 715-724.
47. Sheppard, R., Han, K., Colarelli, S.M., Dai, G., & King, D.W. (2006). Differential item functioning by sex and race in the Hogan personality inventory. Assessment, 13, 442-453.
48. Smith, L.L., & Reise, S.P. (1998). Gender differences on negative affectivity: An IRT study of differential item functioning on the multidimensional personality questionnaire stress reaction scale. Journal of Personality and Social Psychology, 75, 1350-1362.
49. Stocking, M.L., & Lord, F.M. (1983). Developing a common metric in item response theory. Applied Psychological Measurement, 7, 201-210.
50. Stricker, L.J., & Emmerich, W. (1999). Possible determinants of differential item functioning: Familiarity, interest, and emotional reaction. Journal of Educational Measurement, 36, 347-366.
51. Taris, T.W., Bok, I.A., & Meijer, Z.Y. (1998). Assessing stability and change of psychometric properties of multi-item concepts across different situations: A general approach. Journal of Psychology: Interdisciplinary and Applied, 132, 301-316.
52. Thissen, D. (1991). MULTILOG user's guide (Version 6.0). Mooresville, IN: Scientific Software.
53. Tinsley, H.E.A. (2000). Technological magic, social change, and counseling rituals: The future of career assessment. Journal of Career Assessment, 8, 339-350.
54. Tracey, T.J.G., Watanabe, N., & Schneider, P.L. (1997). Structural invariance of vocational interests across Japanese and American cultures. Journal of Counseling Psychology, 44, 346-354.
55. Turner, S.L., & Lapan, R.T. (2003). The measurement of career interests among at-risk inner-city and middle-class suburban adolescents. Journal of Career Assessment, 11, 405-420.
56. Vandenberg, R.J. (2002). Toward a further understanding of an improvement in measurement invariance methods and procedures. Organizational Research Methods, 5, 139-158.
57. Whiston, S.C., & Bouwkamp, J.C. (2003). Ethical implications of career assessment with women. Journal of Career Assessment, 11, 59-75.
58. Yang, W., Lance, C.E., & Hui, H.C. (2006). Psychometric properties of the Chinese Self-Directed Search (1994 edition). Journal of Vocational Behavior, 68, 560-576.