Constructing and evaluating quantitative measures for social psychological research: Conceptual challenges and methodological solutions

The SAGE Handbook of Methods in Social Psychology

Volumn , Issue , 2004, Pages 145-172

  Wegener, Duane T ^a   Fabrigar, Leandre R ^b  

^a PURDUE UNIVERSITY   (United States)

^b QUEEN S UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 39049084841     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4135/9781412976190.n7     Document Type: Chapter

References (90)

1. Abelson R. P. Kinder D. R. Peters M. D. Fiske S. T. Affective and semantic components in political person perception Journal of Personality and Social Psychology 42 (1982) 619-630doi:10.1037/0022-3514.42.4.619 http://dx.doi.org/10.1037/0022-3514.42.4.619
2. Aiken, L. R.(1997). Psychological testing and assessment (9th ed.). Boston: Allyn 8 Bacon.
3. Allen, M. J., & Yen, W. M.(1979). Introduction to measurement theory. Belmont, CA: Wadsworth.
4. Bakeman, R.(2000). Behavioral observation and coding. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social and personality psychology (138-159). New York: Cambridge University Press.
5. Bollen, K. A.(1989). Structural equations with latent variables. New York: Wiley.
6. Breckler S. J. Empirical validation of affect, behavior, and cognition as distinct components of attitude Journal of Personality and Social Psychology 47 (1984) 1191-1205doi:10.1037/0022-3514.47.6.1191 http://dx.doi.org/10.1037/0022-3514.47.6.1191
7. Browne M. W. The decomposition of multitrait-multimethod matrices British Journal of Mathematical and Statistical Psychology 37 (1984) 1-21doi:10.1111/j.2044-8317.1984.tb00785.x http://dx.doi.org/10.1111/j.2044-8317.1984.tb00785.x
8. Budner S. Intolerance of ambiguity as a personality variable Journal of Personality 30 (1962) 29-50doi:10.1111/j.1467-6494.1962.tb02303.x http://dx.doi.org/10.1111/j.1467-6494.1962.tb02303.x
9. Cacioppo J. T. Crites S. L. Jr. Gardner W. L. Berntson G. G. Bioelectrical echoes from evaluative categorizations: I. A late positive brain potential that varies as a function of trait negativity and extremity Journal of Personality and Social Psychology 67 (1994) 115-125doi:10.1037/0022-3514.67.1.115 http://dx.doi.org/10.1037/0022-3514.67.1.115
10. Cacioppo J. T. Martzke J. S. Petty R. E. Tassinary L. G. Specific forms of facial EMG response index emotions during an interview: From Darwin to the continuous flow hypothesis of affect-laden information processing Journal of Personality and Social Psychology 54 (1988) 592-604doi:10.1037/0022-3514.54.4.592 http://dx.doi.org/10.1037/0022-3514.54.4.592
11. Cacioppo J. T. Petty R. E. Attitudes and cognitive response: An electrophysiological approach Journal of Personality and Social Psychology 37 (1979) 2181-2199doi:10.1037/0022-3514.37.12.2181 http://dx.doi.org/10.1037/0022-3514.37.12.2181
12. Cacioppo J. T. Petty R. E. The need for cognition Journal of Personality and Social Psychology 42 (1982) 116-131doi:10.1037/0022-3514.42.1.116 http://dx.doi.org/10.1037/0022-3514.42.1.116
13. Campbell D. T. Fiske D. W. Convergent and discriminant validation by the multitrait-multimethod matrix Psychological Bulletin 56 (1959) 81-105doi:10.1037/h0046016 http://dx.doi.org/10.1037/h0046016
14. Campbell D. T. O'Connell E. J. Method factors in multitrait-multimethod matrices: Multiplicative rather than additive? Multivariate Behavioral Research 2 (1967) 409-426doi:10.1207/s15327906mbr0204_1 http://dx.doi.org/10.1207/s15327906mbr0204_1
15. Chaiken, S., Liberman, A., & Eagly, A. H.(1989). Heuristic and systematic processing within and beyond the persuasion context. In J. S. Uleman & J. A. Bargh (Eds.), Unintended thought (212-252). New York: Guilford.
16. Converse, P. E.(1964). The nature of belief systems in the mass public. In D. E. Apter (Ed.), Ideology and discontent (206-261). New York: Free Press.
17. Crites S. L. Jr. Fabrigar L. R. Petty R. E. Measuring the affective and cognitive properties of attitudes: Conceptual and methodological issues Personality and Social Psychology Bulletin 20 (1994) 619-634doi:10.1177/0146167294206001 http://dx.doi.org/10.1177/0146167294206001
18. Cronbach L. J. Coefficient alpha and the internal structure of tests Psychometrika 16 (1951) 297-334doi:10.1007/BF02310555 http://dx.doi.org/10.1007/BF02310555
19. Cronbach L. J. Meehl P. E. Construct validity in psychological tests Psychological Bulletin 52 (1955) 281-302doi:10.1037/h0040957 http://dx.doi.org/10.1037/h0040957
20. Cunningham W. A. Preacher K. J. Banaji M. R. Implicit attitude measures: Consistency, stability, and convergent validity Psychological Science 12 (2001) 163-170doi:10.1111/1467-9280.00328 http://dx.doi.org/10.1111/1467-9280.00328
21. Davidson A. R. Jaccard J. Variables that moderate the attitude-behavior relation: Results of a longitudinal survey Journal of Personality and Social Psychology 37 (1979) 1364-1376doi:10.1037/0022-3514.37.8.1364 http://dx.doi.org/10.1037/0022-3514.37.8.1364
22. Doll J. Ajzen I. Accessibility and stability of predictors in the theory of planned behavior Journal of Personality and Social Psychology 63 (1992) 754-765doi:10.1037/0022-3514.63.5.754 http://dx.doi.org/10.1037/0022-3514.63.5.754
23. Eagly A. H. Mladinic A. Otto S. Cognitive and affective bases of attitudes toward social groups and social policies Journal of Experimental Social Psychology 30 (1994) 113-137doi:10.1006/jesp.1994.1006 http://dx.doi.org/10.1006/jesp.1994.1006
24. Edwards K. The interplay of affect and cognition in attitude formation and change Journal of Personality and Social Psychology 59 (1990) 202-216doi:10.1037/0022-3514.59.2.202 http://dx.doi.org/10.1037/0022-3514.59.2.202
25. Embretson, S. E., & Reise, S. P.(2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum.
26. Fabrigar L. R. Petty R. E. The role of the affective and cognitive bases of attitudes in susceptibility to affectively and cognitively based persuasion Personality and Social Psychology Bulletin 25 (1999) 363-381doi:10.1177/0146167299025003008 http://dx.doi.org/10.1177/0146167299025003008
27. Fabrigar L. R. Wegener D. T. MacCallum R. C. Strahan E. J. Evaluating the use of exploratory factor analysis in psychological research Psychological Methods 4 (1999) 272-299doi:10.1037/1082-989X.4.3.272 http://dx.doi.org/10.1037/1082-989X.4.3.272
28. Fazio R. H. Jackson J. R. Dunton B. C. Williams C. J. Variability in automatic activation as an unobtrusive measure of racial attitudes: A bona fide pipeline? Journal of Personality and Social Psychology 69 (1995) 1013-1027doi:10.1037/0022-3514.69.6.1013 http://dx.doi.org/10.1037/0022-3514.69.6.1013
29. Fazio, R. H., & Zanna, M. P.(1981). Direct experience and attitude-behavior consistency. In L. Berkowitz (Ed.), Advances in experimental social psychology (Vol. 14, 161-202). New York: Academic Press. doi:10.1016/S0065-2601(08)60372-X http://dx.doi.org/10.1016/S0065-2601%2808%2960372-X
30. Festinger L. Carlsmith J. M. Cognitive consequences of forced compliance Journal of Abnormal and Social Psychology 58 (1959) 203-210doi:10.1037/h0041593 http://dx.doi.org/10.1037/h0041593
31. Finch J. F. West S. G. The investigation of personality structure: Statistical models Journal of Research in Personality 31 (1997) 439-485doi:10.1006/jrpe.1997.2194 http://dx.doi.org/10.1006/jrpe.1997.2194
32. Floyd F. J. Widaman K. F. Factor analysis in the development and refinement of clinical assessment instruments Psychological Assessment 7 (1995) 286-299doi:10.1037/1040-3590.7.3.286 http://dx.doi.org/10.1037/1040-3590.7.3.286
33. Friedenberg, L.(1995). Psychological testing: Design, analysis, and use. Boston: Allyn 8 Bacon.
34. Gaito J. Measurement scales and statistics: Resurgence of an old misconception Psychological Bulletin 87 (1980) 564-567doi:10.1037/0033-2909.87.3.564 http://dx.doi.org/10.1037/0033-2909.87.3.564
35. Gorsuch, R. L.(1983). Factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
36. Greenwald A. G. Banaji M. R. Implicit social cognition: Attitudes, self-esteem, and stereotypes Psychological Review 102 (1995) 4-27doi:10.1037/0033-295X.102.1.4 http://dx.doi.org/10.1037/0033-295X.102.1.4
37. Greenwald A. G. McGhee D. E. Schwartz J. L. K. Measuring individual differences in implicit cognition: The implicit association test Journal of Personality and Social Psychology 74 (1998) 1464-1480doi:10.1037/0022-3514.74.6.1464 http://dx.doi.org/10.1037/0022-3514.74.6.1464
38. Hammond K. R. Measuring attitudes by error-choice: An indirect method Journal of Abnormal and Social Psychology 43 (1948) 38-48doi:10.1037/h0059576 http://dx.doi.org/10.1037/h0059576
39. Himmelfarb, S.(1993). The measurement of attitudes. In A. H. Eagly & S. Chaiken, The psychology of attitudes (23-88). Fort Worth, TX: Harcourt Brace Jovanovich.
40. Izard, C. E.(1977). Human emotions. New York: Plenum.
41. Jackson D. N. The dynamics of structured personality tests Psychological Review 78 (1971) 229-248doi:10.1037/h0030852 http://dx.doi.org/10.1037/h0030852
42. Janada, L. H.(1998). Psychological testing: Theory and applications. Boston: Allyn 8 Bacon.
43. John, O. P., & Benet-Martinez, V.(2000). Measurement: Reliability, construct validation, and scale construction. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social and personality psychology (339-369). New York: Cambridge University Press.
44. Jãreskog, K. G.(1974). Analyzing psychological data by structural analysis of covariance matrices. In R. C. Atkinson, D. H. Krantz, R. D. Luce, & P. Suppes (Eds.), Contemporary developments in mathematical psychology (Vol. 2, 1-56). San Francisco: W. H. Freeman.
45. Katz, D., & Stotland, E.(1959). A preliminary statement to a theory of attitude structure and change. In S. Koch (Ed.), Psychology: A study of a science: Vol. 3. Formulations of the person and the social context (423-475). New York: McGraw-Hill.
46. Kenny D. A. Kashy D. A. Analysis of the multitrait-multimethod matrix by confirmatory factor analysis Psychological Bulletin 112 (1992) 165-172doi:10.1037/0033-2909.112.1.165 http://dx.doi.org/10.1037/0033-2909.112.1.165
47. Kerr, N. L., Aronoff, J., & Messe, L. A.(2000). Methods of small group research. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social and personality psychology (160-189). New York: Cambridge University Press.
48. Kidder, L. H., & Campbell, D. T.(1970). The indirect testing of social attitudes. In G. F. Summers (Ed.), Attitude measurement (333-385). Chicago: Rand McNally.
49. Knowles E. S. Item context effects on personality scales: Measuring changes the measure Journal of Personality and Social Psychology 55 (1988) 312-320doi:10.1037/0022-3514.55.2.312 http://dx.doi.org/10.1037/0022-3514.55.2.312
50. Krosnick, J. A., & Fabrigar, L. R.(1997). Designing rating scales for effective measurement in surveys. In L. Lyberg, P. Biemer, M. Collins, E. De Leeuw, C. Dippo, N. Schwarz, & D. Trewin (Eds.), Survey measurement and process quality (pp. 141-164). New York: Wiley.
51. Krosnick, J. A., & Fabrigar, L. R. (in press). Designing questionnaires to measure attitudes. New York: Oxford University Press.
52. Likert R. A technique for the measurement of attitudes Archives of Psychology 140 (1932) 44-53
53. Loevinger J. Objective tests as instruments of psychological theory Psychological Reports 3 (1957) 635-694
54. Lord, F., & Novick, M. R.(1968). Statistical theories of mental tests. New York: Addison-Wesley.
55. Macrae C. N. Bodenhausen G. V. Milne A. B. Jetten J. Out of mind but back in sight: Stereotypes on the rebound Journal of Personality and Social Psychology 67 (1994) 808-817doi:10.1037/0022-3514.67.5.808 http://dx.doi.org/10.1037/0022-3514.67.5.808
56. Marsh, H. W., & Grayson, D.(1995). Latent variable models of multitrait-multi-method data. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (177-198). Thousand Oaks, CA: Sage.
57. McKinley, R. L., & Mills, C. N.(1989). Item response theory: Advances in achievement and attitude measurement. In B. Thompson (Ed.), Advances in social science methodology (Vol. 1, 71-135). Greenwich, CT: JAI.
58. Messick, S.(1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13-103). New York: Macmillan.
59. Millsap R. E. Sufficient conditions for rotational uniqueness in the additive MTMM model British Journal of Mathematical and Statistical Psychology 45 (1992) 125-138doi:10.1111/j.2044-8317.1992.tb00981.x http://dx.doi.org/10.1111/j.2044-8317.1992.tb00981.x
60. Mueller, D. J.(1986). Measuring social attitudes: A social handbook for researchers and practitioners. New York: Teachers College Press.
61. Nisbett R. E. Wilson T. D. Telling more than we can know: Verbal report on mental processes Psychological Review 84 (1977) 231-259doi:10.1037/0033-295X.84.3.231 http://dx.doi.org/10.1037/0033-295X.84.3.231
62. Nosek, B.(2002). Moderators of the relationship between implicit and explicit attitudes. Unpublished doctoral dissertation, Yale University.
63. Osgood, C. E., Suci, G. J., & Tannenbaum, P. H.(1957). The measurement of meaning. Urbana: University of Illinois Press.
64. Ostrom, T. M.(1989). Interdependence of attitude theory and measurement. In A. R. Pratkanis, S. J. Breckler, & A. G. Greenwald (Eds.), Attitude structure and function (pp. 11-36). Hillsdale, NJ: Erlbaum.
65. Petty, R. E., & Cacioppo, J. T.(1986). Communication and persuasion: Central and peripheral routes to persuasion. New York: Springer-Verlag. doi:10.1007/978-1-4612-4964-1 http://dx.doi.org/10.1007/978-1-4612-4964-1
66. Petty, R. E., & Cacioppo, J. T.(1996). Attitudes and persuasion: Classic and contemporary approaches. Boulder, CO: Westview.
67. Petty, R. E., Haugtvedt, C. P., & Smith, S. M.(1995). Elaboration as a determinant of attitude strength. In R. E. Petty & J. A. Krosnick (Eds.), Attitude strength: Antecedents and consequences (93-130). Mahwah, NJ: Lawrence Erlbaum.
68. Remmers, H. H.(1963). Rating methods in research on teaching. In N. L. Gage (Ed.), Handbook of research on teaching (pp. 329-378). Chicago: Rand McNally.
69. Rosenthal, R., & Rosnow, R. L.(1991). Essentials of behavioral research: Methods and data analysis (2nd ed.). New York: McGraw-Hill.
70. Rotter J. B. Generalized expectancies for internal versus external control of reinforcement Psychological Monographs 80 (1, Whole No. 609) (1966)
71. Russell J. A. A circumplex model of affect Journal of Personality and Social Psychology 39 (1980) 1161-1178doi:10.1037/h0077714 http://dx.doi.org/10.1037/h0077714
72. Schmitt N. Uses and abuses of coefficient alpha Psychological Assessment 8 (1996) 350-353doi:10.1037/1040-3590.8.4.350 http://dx.doi.org/10.1037/1040-3590.8.4.350
73. Schuman, H., & Presser, S.(1981). Questions and answers in attitude surveys: Experiments on question form, wording, and context. San Diego: Academic Press.
74. Schwarz, N., & Hippler, H. J.(1991). Response alternatives: The impact of their choice and ordering. In P. Biemer, R. Groves, N. Mathiowetz, & S. Sudman (Eds.), Measurement error in surveys (41-56). Chichester, UK: Wiley.
75. Steinberg, L., & Thissen, D.(1995). Item response theory in personality research. In P. E. Shrout & S. T. Fiske (Eds.), Personality research, methods, and theory: A festschrift honoring Donald W. Fiske (161-181). Hillsdale, NJ: Lawrence Erlbaum.
76. Steyer R. Schmitt M. J. The effects of aggregation across and within occasions on consistency, specificity, and reliability Methodika 4 (1990) 58-94
77. Sudman, S., Bradburn, N. M., & Schwarz, N.(1996). Thinking about answers: The application of cognitive processes to survey methodology. San Francisco: Jossey-Bass.
78. Thurstone L. L. Attitudes can be measured American Journal of Sociology 33 (1928) 529-554doi:10.1086/214483 http://dx.doi.org/10.1086/214483
79. Thurstone, L. L., & Chave, E. J.(1929). The measurement of attitude. Chicago: University of Chicago Press.
80. Tisak J. Tisak M. S. Permanency and ephemerality of psychological measures with application to organizational commitment Psychological Methods 5 (2000) 175-198doi:10.1037/1082-989X.5.2.175 http://dx.doi.org/10.1037/1082-989X.5.2.175
81. Tittle C. R. Hill R. J. Attitude measurement and prediction of behavior: An evaluation of conditions and measurement techniques Sociometry 30 (1967) 199-213doi:10.2307/2786227 http://dx.doi.org/10.2307/2786227
82. Townsend J. T. Ashby G. Measurement scale and statistics: The misconception misconceived Psychological Bulletin 96 (1984) 394-401doi:10.1037/0033-2909.96.2.394 http://dx.doi.org/10.1037/0033-2909.96.2.394
83. Tucker L. R. Lewis C. A reliability coefficient for maximum likelihood factor analysis Psychometrika 38 (1973) 1-10doi:10.1007/BF02291170 http://dx.doi.org/10.1007/BF02291170
84. Visser, P. S., Fabrigar, L. R., Wegener, D. T., & Browne, M. W.(2003). Analyzing social psychological multitrait-multimethod data. Unpublished manuscript, University of Chicago.
85. Weary G. Edwards J. A. Individual differences in causal uncertainty Journal of Personality and Social Psychology 67 (1994) 308-318doi:10.1037/0022-3514.67.2.308 http://dx.doi.org/10.1037/0022-3514.67.2.308
86. Webster D. M. Kruglanski A. W. Individual differences in need for cognitive closure Journal of Personality and Social Psychology 67 (1994) 1049-1062doi:10.1037/0022-3514.67.6.1049 http://dx.doi.org/10.1037/0022-3514.67.6.1049
87. Wegener, D. T., Downing, J., Krosnick, J. A., & Petty, R. E.(1995). Measures and manipulations of strength-related properties of attitudes: Current practice and future directions. In R. E. Petty & J. A. Krosnick (Eds.), Attitude strength: Antecedents and consequences (455-487). Mahwah, NJ: Lawrence Erlbaum.
88. Wegener, D. T., & Fabrigar, L. R.(2000). Analysis and design for nonexperimental data: Addressing causal and noncausal hypotheses. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social and personality psychology (412-450). New York: Cambridge University Press.
89. Wegener D. T. Petty R. E. The naive scientist revisited: Naive theories and social judgment Social Cognition 16 (1998) 1-7doi:10.1521/soco.1998.16.1.1 http://dx.doi.org/10.1521/soco.1998.16.1.1
90. Widaman K. F. Hierarchically nested covariance structure models for multitrait-multimethod data Applied Psychological Measurement 9 (1985) 1-26doi:10.1177/014662168500900101 http://dx.doi.org/10.1177/014662168500900101