Applications of item response theory to measurement issues in leadership research

Leadership Quarterly

Volumn 17, Issue 4, 2006, Pages 366-386

  A Scherbaum, Charles ^a   Finlinson, Scott ^b   Barden, Kira ^a   Tamanini, Kevin ^b  

^a CITY UNIVERSITY OF NEW YORK   (United States)

^b OHIO UNIVERSITY   (United States)

Author keywords

Item response theory; Leader member exchange; Leadership measurement; Psychometric techniques; Unfolding IRT models

Indexed keywords

EID: 33745951972     PISSN: 10489843     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.leaqua.2006.04.005     Document Type: Article

References (76)

1. Ackerman T.A. Using multidimensional item response theory to understand what items and tests are measuring. Applied Measurement in Education 7 (1994) 255-278
2. Ackerman T.A. Developments in multidimensional item response theory. Applied Psychological Measurement 20 (1996) 309-310
3. Ackerman T.A., Gierl M.J., and Walker C.M. Using multidimensional item response theory to evaluate educational and psychological tests. Educational Measurement: Issues and Practice 22 (2003) 37-53
4. Alvesson M. Leadership studies: From procedure and abstraction to reflexivity and situation. Leadership Quarterly 7 (1996) 455-486
5. Antonakis J., Avolio B.J., and Sivasubramaniam N. Context and leadership: An examination of the nine-factor full-range leadership theory using the Multifactor Leadership Questionnaire. Leadership Quarterly 14 (2003) 261-295
6. Barge J.K., and Schlueter D.W. Leadership as organizing: A critique of leadership instruments. Management Communication Quarterly 4 (1991) 541-570
7. Bass B.M., and Avolio B.J. Manual: The multifactor leadership questionnaire (1993), Consulting Psychologists' Press, Palo Alto, CA
8. Camilli G., and Shepard L. Methods for identifying biased test items (1994), Sage, Thousand Oaks, CA
9. In: Clark K.E., and Clark M.B. (Eds). Measures of leadership (1990), Center for Creative Leadership, Greensboro, NC
10. Coombs C.H. Psychological scaling without a unit of measurement. Psychological Review 57 (1950) 145-158
11. Coombs C.H. A theory of data (1964), John Wiley and Sons, New York
12. Craig S.B., and Gustafson S.B. Perceived leader integrity scale: An instrument for assessing employee perceptions of leader. Leadership Quarterly 9 (1998) 127-145
13. Dienesch R.M., and Liden R.C. Leader-member exchange model of leadership: A critique and further development. Academy of Management Review 11 (1986) 618-634
14. Dipboye R.L., and Flanagan M.F. Research settings in industrial and organizational psychology: Are findings in the field more generalizable than in the laboratory?. American Psychologist 34 (1979) 141-150
15. Drasgow, F. (2003, April). Modeling responses to personality scales. In F. Drasgow (Chair), Innovations in Personality Assessment. Symposium conducted at the 18th Annual Meeting of the Society for Industrial and Organizational Psychology, Orlando, Florida.
16. Drasgow F., and Hulin C.L. Item response theory. In: Dunnette M.D., and Hough L.M. (Eds). Handbook of industrial and organizational psychology. 2nd ed. Vol. 1 (1990), Consulting Psychologists' Press, Palo Alto, CA 577-636
17. Drasgow F., Levine M.V., Tsien S., Williams B., and Mead A. Fitting polytomous item response theory models to multiple-choice tests. Applied Psychological Measurement 19 (1995) 143-165
18. Drasgow F., and Lissak R. Modified parallel analysis: A procedure for examining the latent dimensionality of dichotomously scored item responses. Journal of Applied Psychology 68 (1983) 363-373
19. Drasgow F., and Parsons C.K. Application of unidimensional item response theory models to multidimensional data. Applied Psychological Measurement 7 (1983) 189-199
20. Embretson S.E., and Reise S.P. Item response theory for psychologists (2000), Lawrence Erlbaum, Mahwah, NJ
21. Facteau J.D., and Craig S.B. Are performance appraisal ratings from different rating sources comparable?. Journal of Applied Psychology 86 (2001) 215-227
22. Foti R.J., and Lord R.G. Prototypes and scripts: The effects of alternative methods of processing information on rating accuracy. Organizational Behavior and Human Decision Processes 39 (1987) 318-341
23. Gerstner C.R., and Day D.V. Meta-analytic review of leader-member exchange theory: Correlates and construct issues. Journal of Applied Psychology 82 (1997) 827-844
24. Graen G.B., and Uhl-Bien M. Relationship-based approach to leadership: Development of leader-member exchange (LMX) theory of leadership over 25 years: Applying a multi-level multi-domain perspective. Leadership Quarterly 6 (1995) 219-247
25. Guttman L. The basis for the scalogram analysis. In: Stouffer S., Guttman L., Suchman E., Lazerfeld P., Star S., and Gardner J. (Eds). Measurement and prediction. (1950), Princeton University Press, Princeton, NJ
26. Hambleton R.K., and Jones R.W. Comparison of classical test theory and item response theory and their applications to test development. Educational Measurement: Issues and Practice 12 (1993) 38
27. Hambleton R.K., Swaminathan H., and Rogers H.J. Fundamentals of item response theory (1991), Sage, Newbury Park, CA
28. Hernández A., Drasgow F., and González-Romá V. Investigating the functioning of a middle category by means of a mixed-measurement model. Journal of Applied Psychology 89 (2004) 687-699
29. Hunt J.G. Transformational/charismatic leadership's transformation of the field: A historical essay. Leadership Quarterly 10 (1999) 129-144
30. Keller T., and Dansereau F. The effect of adding items to scales: An illustrative case of LMX. Organizational Research Methods 4 (2001) 131-143
31. Korman A.F. Contingency approaches to leadership: An overview. In: Hunt J.G., and Larson L.L. (Eds). Contingency approaches to leadership (1974), Southern Illinois University Press, Carbondale, IL 189-195
32. Liden R.C., and Maslyn J.M. Multidimensionality of leader-member exchange: An empirical assessment through scale development. Journal of Management 24 (1998) 43-72
33. Liden R.C., Sparrowe R.T., and Wayne S.J. Leader-member exchange theory: The past and potential for the future. In: Ferris G.R. (Ed). Research in personnel and human resources management Vol. 15 (1997), JAI Press, Stamford, CT 47-119
34. Likert R. A technique for the measurement of attitudes. Archives of Psychology 22 140 (1932) 5-53
35. Lord R.G., Foti R.J., and De Vader C.L. A test of leadership categorization theory: Internal structure, information processing, and leadership perceptions. Organizational Behavior and Human Performance 34 (1984) 343-379
36. Lytle A.L., Brett J.M., Barsness Z.I., Tinsley C.H., and Janssens M. A paradigm for confirmatory cross-cultural research in organizational behavior. In: Staw B., and Cummings L.L. (Eds). Research in organizational behavior Vol. 17 (1995), JAI Press, Greenwich, CT 167-214
37. Marion R., and Uhl-Bien M. Leadership in complex organizations. Leadership Quarterly 12 (2001) 389-418
38. Masters G.N. A Rasch model for partial credit scoring. Psychometrika 47 (1982) 149-174
39. Meade A.W., and Lautenschlager G.J. A comparison of item response theory and confirmatory factor analytic methodologies for establishing measurement equivalence/invariance. Organizational Research Methods 7 (2004) 361-388
40. Millsap R.E., and Everson H.T. Methodology review: Statistical approaches for assessing measurement bias. Applied Psychological Measurement 17 (1993) 297-334
41. Muraki E. A generalized partial credit model: An application of an EM algorithm. Applied Psychological Measurement 16 (1992) 159-176
42. Osborn R.N., Hunt J.G., and Jauch L.R. Toward a contextual theory of leadership. Leadership Quarterly 13 (2002) 797-837
43. Phillips J.S., and Lord R.G. Notes on the practical and theoretical consequences of implicit leadership theories for the future of leadership measurement. Journal of Management 12 (1986) 31-41
44. Podsakoff P.M., MacKenzie S.B., Podsakoff N.P., and Lee J.Y. The mismeasure of man(agement) and its implications for leadership research. Leadership Quarterly 14 (2003) 615-656
45. Raju N.S., Laffitte L.J., and Byrne B.M. Measurement equivalence: A comparison of methods based on confirmatory factor analysis and item response theory. Journal of Applied Psychology 87 (2002) 517-529
46. Raju N.S., van der Linden W., and Fleer P.F. IRT-based internal measures of differential functioning of items and tests. Applied Psychological Measurement 19 (1995) 353-368
47. Reckase M.D. Unifactor latent trait models applied to multifactor tests: Results and implications. Journal of Educational Statistics 4 (1979) 207-230
48. Reise S.P., and Henson J.M. A discussion of modern versus traditional psychometrics as applied to personality assessment scales. Journal of Personality Assessment 81 (2003) 93-103
49. Roberts, J. S. (1995). Item response theory approaches to attitude measurement. (Doctoral Dissertation, University of South Carolina, Columbia, 1995). Dissertation Abstracts International, 56, 7089B.
50. Roberts, J. S., Donoghue, J. R., and Laughlin, J. E. (1999). Estimability of parameters in the generalized graded unfolding model. Paper presented at the American Educational Research Association, Montreal, Quebec.
51. Roberts J.S., Donoghue J.R., and Laughlin J.E. A general item response theory model for unfolding unidimensional polytomous responses. Applied Psychological Measurement 24 (2000) 3-32
52. Roberts, J. S., Fang, H., Cui, W., and Wang, Y. (2004). GGUM2004: A Windows-based program to estimate parameters of the generalized graded unfolding model. Manuscript in preparation.
53. Roberts J.S., and Laughlin J.E. A unidimensional item response model for unfolding responses from a graded disagree-agree response scale. Applied Psychological Measurement 20 (1996) 231-255
54. Roberts J.S., Laughlin J.E., and Wedell D.H. Validity issues in the Likert and Thurstone approaches to attitude measurement. Educational and Psychological Measurement 59 (1999) 211
55. Rost J. A logistic mixture distribution model for polychotomous item responses. British Journal of Mathematical and Statistical Psychology 44 (1991) 75-92
56. Rost J. Logistic mixture models. In: van der Linden W., and Hambleton R. (Eds). Handbook of modern item response theory (1997), Springer, New York 449-463
57. Ryan A.M., Horvath M., Ployhart R.E., Schmitt N., and Slade L.A. Hypothesizing differential item functioning in global employee opinion surveys. Personnel Psychology 53 (2000) 531-562
58. Samejima F. Estimation of latent ability using a response pattern of graded scores. Psychometrika 34 (1969) 1-100
59. Scandura T.A., and Dorfman P. Leadership research in an international and cross-cultural context. Leadership Quarterly 15 (2004) 277-307
60. Scandura T.A., and Williams E.A. Research methodology in management: Current practices, trends, and implications for future research. Academy of Management Journal 43 (2000) 1248-1264
61. Schriesheim C.A., Castro S.L., and Cogliser C.C. Leader-member exchange (LMX) research: A comprehensive review of theory, measurement, and data-analytic practices. Leadership Quarterly 10 (1999) 63-113
62. Schriesheim C., and Kerr S. Psychometric properties of the Ohio State leadership scales. Psychological Bulletin 81 (1974) 756-765
63. Schriesheim C.A., and Kerr S. Theories and measures of leadership: A critical appraisal. In: Hunt J.G., and Larson L.L. (Eds). Leadership: The cutting edge (1977), Southern Illinois University Press, Carbondale, IL 9-45
64. Schriesheim C.A., Powers K.J., Scandura T.A., Gardiner C.C., and Lankau M.J. Improving construct measurement in management research: Comments and a quantitative approach for assessing the theoretical content adequacy of paper- and pencil survey-type instruments. Journal of Management 19 (1993) 385-417
65. Tejeda M.J., Scandura T.A., and Pillai R. The MLQ revisited: Psychometric properties and recommendations. Leadership Quarterly 12 (2001) 31-52
66. Thissen D., Chen W.H., and Bock R.D. MULTILOG users' guide (2003), Scientific Software, Chicago
67. Thurstone L.L. Attitudes can be measures. The American Journal of Sociology 33 (1928) 529-554
68. Thurstone L.L. The measurement of social attitudes. Abnormal and Social Psychology 26 (1931) 249-269
69. In: van der Linden W.J., and Hambleton R.K. (Eds). Handbook of modern item response theory. (1997), Springer, New York
70. Vecchio R.P., and Gobdel B.C. The vertical dyad linkage model of leadership: Problems and prospects. Organization Behavior and Human Performance 34 (1984) 5-20
71. Yukl G. Managerial leadership: A review of theory and research. Journal of Management 15 (1989) 251-289
72. Yukl G.A. Leadership in organizations. 3rd ed. (1994), Prentice Hall, Englewood Cliffs, NJ
73. Yukl G., and Van Fleet D.D. Theory and research on leadership in organizations. In: Dunnette M.D., and Hough L.M. (Eds). Handbook of industrial and organizational psychology. 2nd ed. Vol. 3 (1992), Consulting Psychologists' Press, Palo Alto, CA 147-197
74. Zickar M.J. Conquering the next frontier: Modeling personality data with item response theory. In: Roberts B.W., and Hogan R. (Eds). Personality psychology in the workplace (2001), American Psychological Association, Washington, DC 141-160
75. Zickar M.J., Gibby R.E., and Robie C. Uncovering faking samples in applicant, incumbent, and experimental data sets: An application of mixed-model item response theory. Organizational Research Methods 7 (2004) 168-190
76. Zickar M.J., and Robie C. Modeling faking good on personality items: An item-level analysis. Journal of Applied Psychology 84 (1999) 551-563