Theoretical, Statistical, and Substantive Issues in the Assessment of Construct Dimensionality: Accounting for the Item Response Process

Organizational Research Methods

Volumn 15, Issue 3, 2012, Pages 363-384

  Tay, Louis ^a   Drasgow, Fritz ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

computer simulation procedures (e.g., Monte Carlo, bootstrapping); construct validation procedures; factor analysis; item response theory; reliability and validity

Indexed keywords

EID: 84862216403     PISSN: 10944281     EISSN: 15527425     Source Type: Journal    
DOI: 10.1177/1094428112439709     Document Type: Article

References (67)

1. Ackerman P. L.,Humphreys L. G.Handbook of industrial and organizational psychology. Dunnette M. D.Hough L. M., ed. New York, NY: Wiley; 1990:223-282.
2. Allen T. DHandbook of psychology. Schmitt N.Highhouse S., ed. New York, NY: Wiley; in press:.
3. Ashton M. C.,Lee K.,Perugini M.,Szarota P.,de Vries R. E.,Blas L. D.,De Raad B.A six-factor structure of personality-descriptive adjectives: Solutions from psycholexical studies in seven languages.Journal of Personality and Social Psychology. 2004;86:356-366.
4. Benet V.,Waller N. G.The Big Seven factor model of personality description: Evidence for its cross-cultural generality in a Spanish sample.Journal of Personality and Social Psychology. 1995;69:701-718.
5. Borg I.,Groenen P. J. F.Modern multidimensional scaling: Theory and applications. 2005). Modern multidimensional scaling: Theory and applications (2nd ed.). New York, NY: Springer.New York, NY: Springer; 2005:.
6. Cacioppo J. T.,Bernston G. G.Relationship between attitudes and evaluative space: A critical review, with emphasis on the separability of positive and negative substrates.Psychological Bulletin. 1994;115:401-423.
7. Campbell J. P.,Pritchard R. D.Handbook oIndividual differences theory in industrial and organizational psychology. 1983). Motivation theory in industrial and organizational psychology. In DunnetteM. D. (Ed.), Handbook of industrial and organizational psychology (2nd ed., pp. 63-130). New York, NY: Wiley.Dunnette M. D., ed. New York, NY: Wiley; 1983:63-130.
8. Carroll J. B.The effect of difficulty and chance success on correlations between items or between tests.Psychometrika. 1945;1945:1-19.
9. Chernyshenko O. S.,Stark S.,Chan K. Y.,Drasgow F.,Williams B.Fitting item response theory models to two personality inventories: Issues and insights.Multivariate Behavioral Research. 2001;36:523-562.
10. Chernyshenko O. S.,Stark S.,Drasgow F.,Roberts B. W.Constructing personality scales under the assumptions of an ideal point response process: Toward increasing the flexibility of personality measures.Psychological Assessment. 2007;19:88-106.
11. Conway J. M.,Huffcutt A. I.A review and evaluation of exploratory factor analysis practices in organizational research.Organizational Research Methods. 2003;6:147-168.
12. Coombs C. H.A theory of data. New York, NY: John Wiley; 1964:.
13. Coombs C. H.A note on the relation between the vector model and the unfolding model for preferences.Psychometrika. 1975;40:115-116.
14. Coombs C. H.,Kao R. C.On a connection between factor analysis and multidimensional unfolding.Psychometrika. 1960;25:219-231.
15. Cronbach L. J.Essentials of psychological testing. New York, NY: Harper; 1949:.
16. Cropanzano R.,Weiss H. M.,Hale J. M. S.,Reb J.The structure of affect: Reconsidering the relationship between negative and positive affectivity.Journal of Management. 2003;29:831-857.
17. Dalal R. S.A meta-analysis of the relationship between organizational citizenship behavior and counterproductive work behavior.Journal of Applied Psychology. 2005;90:1241-1255.
18. Davison M. L.On a metric, unidimensional unfolding model for attitudinal and developmental data.Psychometrika. 1977;42:523-548.
19. de Leeuw J.,Mair P.Multidimensional scaling using majorization: The R package smacof.Journal of Statistical Software. 2009;31:1-30.
20. Digman J. M.Personality structure: Emergence of the five-factor model.Annual Review of Psychology. 1990;41:417-440.
21. Drasgow F.,Chernyshenko O. S.,Stark S.75 years after Likert: Thurstone was right!.Industrial and Organizational Psychology: Perspectives on Science and Practice. 2010;3:465-476.
22. Drasgow F.,Levine M. V.,Tsien S.,Williams B. A.,Mead A. D.Fitting polytomous item response models to multiple-choice tests.Applied Psychological Measurement. 1995;19:145-165.
23. Eddington A.New York: Macmillan.The philosophy of physical science. 1939;:.
24. Farrell D.Exit, voice, loyalty, and neglect as responses to job dissatisfaction: A multidimensional scaling study.Academy of Management Journal. 1983;26:596-607.
25. Fiske D. W.,Butler J. M.The experimental conditions for measuring individual differences.Educational and Psychological Measurement. 1963;23:249-266.
26. Gelfand M. J.,Nishii L. H.,Holcombe K. M.,Dyer N.,Ohbuchi K.,Fukuno M.Cultural influences on cognitive representations of conflict: Interpretations of conflict episodes in the United States and Japan.Journal of Applied Psychology. 2001;86 (6): 1059-1074.
27. Green D. P.,Goldman S. L.,Salovey P.Measurement error masks bipolarity in affect ratings.Journal of Personality and Social Psychology. 1993;64:1029-1041.
28. Greenhaus J. F.,Powell G. N.When work and family are allies: A theory of work-family enrichment.Academy of Management Review. 2006;31:72-92.
29. Guo Y.,Tay L.New dimensionality assessment tool for the Generalized Graded Unfolding Model (GGUM). 2010, April:.
30. Habing B.,Finch H.,Roberts J.A Q3 statistic for unfolding item response theory models: Assessment of unidimensionality with two factors and simple structure.Applied Psychological Measurement. 2005;29:457-471.
31. Horn J. L.A rationale and test for the number of factors in factor analysis.Psychometrika. 1965;30:330-334.
32. Killingsworth M. A.,Gilbert D. T.A wandering mind is an unhappy mind.Science. 2010;330, 932:.
33. Larsen J. T.,McGraw A. P.,Cacioppo J. T.Can people feel happy and sad at the same time?.Journal of Personality and Social Psychology. 2001;4:684-696.
34. Lewin K.Field theory in social science; selected theoretical papers. New York, NY: Harper & Row; 1951:.
35. Likert R.A technique for the measurement of attitudes.Archives of Psychology. 1932;140:5-53.
36. Maraun M. D.,Rossi N. T.The extrafactor phenomenon revisted: Unidimensional unfolding as quadratic factor analysis.Applied Psychological Measurement. 2001;25:77-87.
37. McDonald R. P.Nonlinear factor analysis.Psychometric Monographs. 1967;15:167.
38. Mohammed S.,Klimoski R.,Rentsch J. R.The measurement of team mental models: We have no shared schema.Organizational Research Methods. 2000;3 (2): 123-165.
39. Morgeson F. P.,Campion M. A.,Dipboye R. L.,Hollenbeck J. R.,Murphy K.,Schmitt N.Reconsidering the use of personality tests in personnel selection contexts.Personnel Psychology. 2007;60:683-729.
40. Mount M. K.,Barrick M. R.,Scullen S. M.,Rounds J.Higher-order dimensions of the Big Five personality traits and the big six vocational interest types.Personnel Psychology. 2005;58 (2): 447-478.
41. O'Brien E.,LaHuis D. M.Do applicants and incumbents respond to personality items similarly? A comparison of dominance and ideal point response models.International Journal of Selection and Assessment. 2011;19:109-118.
42. Oswald F. L.,Schell K. L.Developing and scaling personality measures: Thurstone was right-but so far, Likert was not wrong.Industrial and Organizational Psychology: Perspectives on Science and Practice. 2010;3:481-484.
43. Polak M.,Heiser W. J.,de Rooij M.Two types of single-peaked data: Correspondence analysis as an alternative to principal components analysis.Computational Statistics and Data Analysis. 2009;53:3117-3128.
44. Reise S. P.Thurstone might have been right about attitudes, but Drasgow, Chernyshenko, and Stark fail to make the case for personality.Industrial and Organizational Psychology: Perspectives on Science and Practice. 2010;3:485-488.
45. Roberts J. S.,Donoghue J. R.,Laughlin J. E.A general item response theory model for unfolding unidimensional polytomous responses.Applied Psychological Measurement. 2000;24:3-32.
46. Roberts J. S.,Donoghue J. R.,Laughlin J. E.Characteristics of MML/EAP parameter estimates in the generalized graded unfolding model.Applied Psychological Measurement. 2002;26:192-207.
47. Roberts J. S.,Laughlin J. E.,Wedell D. H.Validity issues in the Likert and Thurstone approaches to attitude measurement.Educational and Psychological Measurement. 1999;59:211-233.
48. Robinson S. L.,Bennett R. J.A typology of deviant workplace behaviors: A multidimensional scaling study.Academy of Management Journal. 1995;38 (2): 555-572.
49. Rounds J.,Tracey T. J.Prediger's dimensional representation of Holland's RIASEC circumplex.Journal of Applied Psychology. 1993;78:875-890.
50. Russell J. A.,Carroll J. M.On the bipolarity of positive and negative affect.Psychological Bulletin. 1999;125:3-30.
51. Schmitt N.,Cortina J. M.,Ingerick M. J.,Wiechmann D.Handbook of industrial and organizational psychology. Borman W. C.Ilgen D. R.Klimoski R. J., ed. Hoboken, NJ: Wiley & Sons; 2003:77-105.
52. Segura S. L.,Gonzalez-Roma V.How do respondents construe ambiguous response formats of affect items?.Journal of Personality and Social Psychology. 2003;85:956-968.
53. Spector P.,Bauer J. A.,Fox S.Measurement artifacts in the assessment of counterproductive work behavior and organization citizenship behavior: Do we know what we think we know?.Journal of Applied Psychology. 2010;95:781-790.
54. Spector P.,Fox S.Counterproductive work behavior and organisational citizenship behavior: Are they opposite forms of active behavior?.Applied Psychology: An International Review. 2010;59:21-39.
55. Spector P. E.,Van Katwyk P. T.,Brannick M. T.,Chen P. Y.When two factors don't reflect two constructs: How item characteristics can produce artifactual factors.Journal of Management. 1997;23:659-677.
56. Stark S.,Chernyshenko O. S.,Drasgow F.,Williams B. A.Examining assumptions about item responding in personality assessment: Should ideal point models be considered for scale development and scoring?.Journal of Applied Psychology. 2006;91:25-39.
57. Tay L.,Ali U. S.,Drasgow F.,Williams B. A.Fitting simulated dichotomous and polytomous data: Examining the difference between ideal point and dominance models.Applied Psychological Measurement. 2011;35:280-295.
58. Tay L.,Drasgow F.,Rounds J.,Williams B.Fitting measurement models to vocational interest data: Are dominance models ideal?.Journal of Applied Psychology. 2009;94:1287-1304.
59. Tay L.,Su R.,Rounds J.People-Things and Data-Ideas: Bipolar dimensions.Journal of Counseling Psychology. 2011;58:424-440.
60. Terman L. M.The mental test as a psychological method.Psychological Assessment. 1924;31:93-117.
61. Thurstone L. L.A law of comparative judgment.Psychological Review. 1927a;34:273-286.
62. Thurstone L. L.Psychophysical analysis.American Journal of Psychology. 1927b;38:368-389.
63. Thurstone L. L.Attitudes can be measured.American Journal of Psychology. 1928;33:529-554.
64. Thurstone L. L.Multiple factor analysis. Chicago, IL: University of Chicago Press; 1945:.
65. van Schuur W. H.,Kiers H. A. L.Why factor analysis often is the incorrect model for analyzing bipolar concepts and what model to use instead.Applied Psychological Measurement. 1994;18:97-110.
66. Velicer W. F.,Jackson D. N.Component analysis versus common factor analysis: Some issues in selecting an appropriate procedure.Multivariate Behavioral Research. 1990;25:1-28.
67. Waples C. J.,Weyhrauch W. S.,Connell A. R.,Satoris S. C.Questionable defeats and discounted victories for Likert rating scales.Industrial and Organizational Psychology: Perspectives on Science and Practice. 2010;3:477-480.