The Moderator Effect That Wasn't There: Statistical Problems in Ambivalence Research

Journal of Personality and Social Psychology

Volumn 95, Issue 4, 2008, Pages 774-794

  Ullrich, Johannes ^a   Schermelleh Engel, Karin ^a   Böttcher, Björn ^b  

^a GOETHE UNIVERSITY   (Germany)

^b DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

attitude ambivalence; attitude strength; data analysis; moderator effects

Indexed keywords

ARTICLE; HUMAN; MONTE CARLO METHOD; PSYCHOLOGICAL MODEL; PSYCHOLOGY; STATISTICS;

HUMANS; MODELS, PSYCHOLOGICAL; MONTE CARLO METHOD; PSYCHOLOGY;

EID: 54949125665     PISSN: 00223514     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0012709     Document Type: Article

References (103)

1. Abelson R.P. Conviction. American Psychologist 43 (1988) 267-275
2. Abelson R.P. Vulnerability of contrast tests to simpler interpretations: An addendum to Rosnow and Rosenthal. Psychological Science 7 (1996) 242-246
3. Aguinis H., Beaty J.C., Boik R.J., and Pierce C.A. Effect size and power in assessing moderating effects of categorical variables using multiple regression: A 30-year review. Journal of Applied Psychology 90 (2005) 94-107
4. Aiken L.S., and West S.G. Multiple regression: Testing and interpreting interactions (1991), Sage, Newbury Park, CA
5. Armitage C.J., and Conner M. Attitudinal ambivalence: A test of three key hypotheses. Personality and Social Psychology Bulletin 26 (2000) 1421-1432
6. Armitage C.J., and Conner M. The effects of attitudinal ambivalence on attitude-intention-behavior relations. In: Haddock G., and Maio G.R. (Eds). Contemporary perspectives on the psychology of attitudes (2004), Psychology Press, Hove, England 121-143
7. Bargh J.A., Chaiken S., Govender R., and Pratto F. The generality of the automatic attitude activation effect. Journal of Personality and Social Psychology 62 (1992) 893-912
8. Baron R.M., and Kenny D.A. The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology 51 (1986) 1173-1182
9. Bassili J.N. Meta-judgmental versus operative indexes of psychological attributes: The case of measures of attitude strength. Journal of Personality and Social Psychology 71 (1996) 637-653
10. Bell D.W., and Esses V.M. Ambivalence and response amplification toward native peoples. Journal of Applied Social Psychology 27 (1997) 1063-1084
11. Bell D.W., and Esses V.M. Ambivalence and response amplification: A motivational perspective. Personality and Social Psychology Bulletin 28 (2002) 1143-1152
12. Bem D.J., and Funder D.C. Predicting more of the people more of the time: Assessing the personality of situations. Psychological Review 85 (1978) 485-501
13. Bleuler E. Vortrag von Prof. Bleuler-Zürich über Ambivalenz [Talk by Prof. Bleuler about ambivalence]. Zentralblatt für Psychoanalyse 1 (1911) 266-268
14. Bobko P. A solution to some dilemmas when testing hypotheses about ordinal interactions. Journal of Applied Psychology 71 (1986) 323-326
15. Breckler S.J. A comparison of numerical indexes for measuring attitude ambivalence. Educational and Psychological Measurement 54 (1994) 350-365
16. Briñol P., and Petty R.E. Self-validation processes: The role of thought confidence in persuasion. In: Haddock G., and Maio G.R. (Eds). Contemporary perspectives on the psychology of attitudes (2004), Psychology Press, Hove, England 205-226
17. Briñol, P., Petty, R. E., & DeMarree, K. G. (2008, June). Reducing subjective ambivalence by increasing doubt: A self-validation approach. Paper presented at the 15th General Meeting of the European Association of Experimental Social Psychology (EAESP), Opatija, Croatia.
18. Cacioppo J.T., and Berntson G.G. Relationship between attitudes and evaluative space: A critical review, with emphasis on the separability of positive and negative substrates. Psychological Bulletin 115 (1994) 401-423
19. Cacioppo J.T., Gardner W.L., and Berntson G.G. Beyond bipolar conceptualizations and measures: The case of attitudes and evaluative space. Personality and Social Psychology Review 1 (1997) 3-25
20. Campbell D.T., and Kenny D.A. A primer on regression artifacts (1999), Guilford Press, New York
21. Cavazza N., and Butera F. Bending without breaking: Examining the role of attitudinal ambivalence in resisting persuasive communication. European Journal of Social Psychology 38 (2008) 1-15
22. Champoux J.E., and Peters W.S. Form, effect size and power in moderated regression analysis. Journal of Occupational Psychology 60 (1987) 243-255
23. Chaplin W.F. The next generation of moderator research in personality psychology. Journal of Personality 59 (1991) 143-178
24. Cohen J. The statistical power of abnormal-social psychological research: A review. Journal of Abnormal and Social Psychology 65 (1962) 145-153
25. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. (1988), Erlbaum, Mahwah, NJ
26. Cohen J., and Cohen P. Applied multiple regression/correlation analysis for the behavioral sciences. 2nd ed. (1983), Erlbaum, Hillsdale, NJ
27. Cohen J., Cohen P., West S.G., and Aiken L.S. Applied multiple regression/correlation analysis for the behavioral sciences. 3rd ed. (2003), Erlbaum, Mahwah, NJ
28. Cohen P., Cohen J., Aiken L.S., and West S.G. The problem of units and the circumstance for POMP. Multivariate Behavioral Research 34 (1999) 315-346
29. Conner M., Povey R., Sparks P., James R., and Shepherd R. Moderating role of attitudinal ambivalence within the theory of planned behaviour. British Journal of Social Psychology 42 (2003) 75-94
30. Conner M., Sherlock K., and Orbell S. Psychosocial determinants of ecstasy use in young people in the UK. British Journal of Health Psychology 3 (1998) 295-317
31. Conner M., and Sparks P. Ambivalence and attitudes. In: Stroebe W., and Hewstone M. (Eds). European review of social psychology 12 (2002), Wiley, Chichester, England 37-70
32. Conner M., Sparks P., Povey R., James R., Shepherd R., and Armitage C.J. Moderator effects of attitudinal ambivalence on attitude-behaviour relationships. European Journal of Social Psychology 32 (2002) 705-718
33. Cooke R., and Sheeran P. Moderation of cognition-intention and cognition-behaviour relations: A meta-analysis of properties of variables from the theory of planned behaviour. British Journal of Social Psychology 43 (2004) 159-186
34. Costarelli S., and Colloca P. The moderation of ambivalence on attitude-intention relations as mediated by attitude importance. European Journal of Social Psychology 37 (2007) 923-933
35. Crano W.D., and Prislin R. Attitudes and persuasion. Annual Review of Psychology 57 (2006) 345-374
36. Cronbach L.J. Processes affecting scores on "understanding of others" and "assumed similarity.". Psychological Bulletin 52 (1955) 177-193
37. Dimitruk P., Schermelleh-Engel K., Kelava A., and Moosbrugger H. Challenges in nonlinear structural equation modeling. Methodology 3 (2007) 100-114
38. Dormandy E., Hankins M., and Marteau T.M. Attitudes and uptake of a screening test: The moderating role of ambivalence. Psychology & Health 21 (2006) 499-511
39. Eckes T., and Six B. Fact and fiction in attitude-behavior research: A meta-analysis. Zeitschrift für Sozialpsychologie 25 (1994) 253-271
40. Edwards J.R. The study of congruence in organizational behavior research: Critique and a proposed alternative. Organizational Behavior and Human Decision Processes 58 (1994) 51-100
41. Fazio R.H. Attitudes as object-evaluation associations: Determinants, consequences, and correlates of attitude accessibility. In: Petty R.E., and Krosnick J.A. (Eds). Attitude strength: Antecedents and consequences (1995), Erlbaum, Mahwah, NJ 247-282
42. Fox J. An R and S-Plus companion to applied regression (2002), Sage, London
43. Gross S., Holtz R., and Miller N. Attitude certainty. In: Petty R.E., and Krosnick J.A. (Eds). Attitude strength: Antecedents and consequences (1995), Erlbaum, Mahwah, NJ 215-245
44. Johns G. Difference score measures of organizational behavior variables: A critique. Organizational Behavior and Human Performance 27 (1981) 443-463
45. Jonas K., Brömer P., and Diehl M. Attitudinal ambivalence. In: Stroebe W., and Hewstone M. (Eds). European review of social psychology 11 (2000), Wiley, Chichester, England 35-74
46. Jonas K., Diehl M., and Brömer P. Effects of attitudinal ambivalence on information processing and attitude-intention consistency. Journal of Experimental Social Psychology 33 (1997) 190-210
47. Jöreskog K.G., and Yang F. Nonlinear structural equation models: The Kenny-Judd model with interaction effects. In: Marcoulides G.A., and Schumacker R.E. (Eds). Advanced structural equation modeling: Issues and techniques (1996), Erlbaum, Mahwah, NJ 57-88
48. Jost J.T., and Burgess D. Attitudinal ambivalence and the conflict between group and system justification motives in low status groups. Personality and Social Psychology Bulletin 26 (2000) 293-305
49. Kaplan K.J. On the ambivalence-indifference problem in attitude theory and measurement: A suggested modification of the semantic differential technique. Psychological Bulletin 77 (1972) 361-372
50. Katz I. Stigma: A social psychological analysis (1981), Erlbaum, Hillsdale, NJ
51. Katz I., Glass D.C., and Wackenhut J. An ambivalence-amplification theory of behavior toward the stigmatized. In: Worchel S., and Austin W.G. (Eds). Psychology of intergroup relations. 2nd ed. (1986), Nelson-Hall, Chicago 103-117
52. Kenny D.A., and Judd C.M. Estimating the nonlinear and interactive effects of latent variables. Psychological Bulletin 96 (1984) 201-210
53. Klein A.G., and Moosbrugger H. Maximum likelihood estimation of latent interaction effects with the LMS method. Psychometrika 65 (2000) 457-474
54. Klein A.G., and Muthén B.O. Quasi-maximum likelihood estimation of structural equation models with multiple interaction and quadratic effects. Multivariate Behavioral Research 42 (2007) 647-673
55. Kraus S.J. Attitudes and the prediction of behavior: A meta-analysis of the empirical literature. Personality and Social Psychology Bulletin 21 (1995) 58-75
56. Krosnick J.A., and Petty R.E. Attitude strength: An overview. In: Petty R.E., and Krosnick J.A. (Eds). Attitude strength: Antecedents and consequences (1995), Erlbaum, Mahwah, NJ 1-24
57. Lavine H. The electoral consequences of ambivalence toward presidential candidates. American Journal of Political Science 45 (2001) 915-929
58. Lavine H., Borgida E., and Sullivan J.L. On the relationship between attitude involvement and attitude accessibility: Toward a cognitive-motivational model of political information processing. Political Psychology 21 (2000) 81-106
59. Maio G.R., Bell D.W., and Esses V.M. Ambivalence and persuasion: The processing of messages about immigrant groups. Journal of Experimental Social Psychology 32 (1996) 513-536
60. Maio G.R., Fincham F.D., and Lycett E.J. Attitudinal ambivalence toward parents and attachment style. Personality and Social Psychology Bulletin 26 (2000) 1451-1464
61. Marsh H.W., Wen Z., and Hau K.T. Structural equation models of latent interactions: Evaluation of alternative estimation strategies and indicator construction. Psychological Methods 9 (2004) 275-300
62. Maxwell S.E. Sample size and multiple regression analysis. Psychological Methods 5 (2000) 434-458
63. McClelland G.H. Optimal design in psychological research. Psychological Methods 2 (1997) 3-19
64. McClelland G.H., and Judd C.M. Statistical difficulties of detecting interactions and moderator effects. Psychological Bulletin 114 (1993) 376-390
65. Moore M. Ambivalence in attitude measurement. Educational and Psychological Measurement 33 (1973) 481-483
66. Moore M. Validation of the Attitude Toward Any Practice Scale through the use of ambivalence as a moderator variable. Educational and Psychological Measurement 40 (1980) 205-208
67. Newby-Clark I.R., McGregor I., and Zanna M.P. Thinking and caring about cognitive inconsistency: When and for whom does attitudinal ambivalence feel uncomfortable?. Journal of Personality and Social Psychology 82 (2002) 157-166
68. Nisbett R.E., and Wilson T.D. Telling more than we can know: Verbal reports on mental processes. Psychological Review 84 (1977) 231-259
69. Nordgren L.F., van Harreveld F., and van der Pligt J. Ambivalence, discomfort, and motivated information processing. Journal of Experimental Social Psychology 42 (2006) 252-258
70. Petty R.E., Briñol P., and DeMarree K.G. The meta-cognitive model (MCM) of attitudes: Implications for attitude measurement, change, and strength. Social Cognition 25 (2007) 609-642
71. Petty R.E., and Cacioppo J.T. The elaboration likelihood model of persuasion. In: Berkowitz L. (Ed). Advances in experimental social psychology 19 (1986), Academic Press, New York 123-205
72. Petty R.E., and Krosnick J.A. Attitude strength: Antecedents and consequences (1995), Erlbaum, Mahwah, NJ
73. Petty R.E., Tormala Z.L., Briñol P., and Jarvis W.B.G. Implicit ambivalence from attitude change: An exploration of the PAST model. Journal of Personality and Social Psychology 90 (2006) 21-41
74. Povey R., Wellens B., and Conner M. Attitudes towards following meat, vegetarian and vegan diets: An examination of the role of ambivalence. Appetite 37 (2001) 15-26
75. Priester J.R., and Petty R.E. The gradual threshold model of ambivalence: Relating the positive and negative bases of attitudes to subjective ambivalence. Journal of Personality and Social Psychology 71 (1996) 431-449
76. Priester J.R., and Petty R.E. Extending the bases of subjective attitudinal ambivalence: Interpersonal and intrapersonal antecedents of evaluative tension. Journal of Personality and Social Psychology 80 (2001) 19-34
77. R Development Core Team. R: A language and environment for statistical computing (Version 2.3.0) [Software] (2006), R Foundation for Statistical Computing, Vienna
78. Raden D. Strength-related attitude dimensions. Social Psychology Quarterly 48 (1985) 312-330
79. Reichardt C.S. The principle of parallelism in the design of studies to estimate treatment effects. Psychological Methods 11 (2006) 1-18
80. Reis H.T., and Gable S.L. Event-sampling and other methods for studying everyday experience. In: Reis H.T., and Judd C.M. (Eds). Handbook of research methods in social and personality psychology (2000), Cambridge University Press, Cambridge, England 190-222
81. Riketta M. Discriminative validation of numerical indices of attitude ambivalence. Current Research in Social Psychology 5 (2000) 63-83
82. Riketta M., and Ziegler R. Self-ambivalence and reactions to success versus failure. European Journal of Social Psychology 37 (2007) 547-560
83. Roberts S., and Pashler H. How persuasive is a good fit? A comment on theory testing. Psychological Review 107 (2000) 358-367
84. Rogers W.M. Theoretical and mathematical constraints of interactive regression models. Organizational Research Methods 5 (2002) 212-230
85. Schermelleh-Engel K., Klein A.G., and Moosbrugger H. Estimating nonlinear effects using a latent moderated structural equations approach. In: Schumacker R.E., and Marcoulides G.A. (Eds). Interaction and nonlinear effects in structural equation modeling (1998), Erlbaum, Mahwah, NJ 203-238
86. Scott W.A. Attitude measurement. In: Lindzey G., and Aronson E. (Eds). Handbook of social psychology 2 (1968), Addison-Wesley, Reading, MA 204-273
87. Scott W.A. Structure of natural cognitions. Journal of Personality and Social Psychology 12 (1969) 261-278
88. Sparks P., Conner M., James R., Shepherd R., and Povey R. Ambivalence about health-related behaviours: An exploration in the domain of food choice. British Journal of Health Psychology 6 (2001) 53-68
89. Sparks P., Harris P.R., and Lockwood N. Predictors and predictive effects of ambivalence. British Journal of Social Psychology 43 (2004) 371-383
90. Spencer-Rodgers J., Peng K., Wang L., and Hou Y. Dialectical self-esteem and East-West differences in psychological well-being. Personality and Social Psychology Bulletin 30 (2004) 1416-1432
91. Stelzl I. Fehler und Fallen in der Statistik [Mistakes and traps in statistics] (1982), Huber, Bern, Switzerland
92. Stroebe W., Mensink W., Aarts H., Schut H., and Kruglanski A.W. Why dieters fail: Testing the goal conflict model of eating. Journal of Experimental Social Psychology 44 (2008) 26-36
93. Thompson M.M., Zanna M.P., and Griffin D.W. Let's not be indifferent about (attitudinal) ambivalence. In: Petty R.E., and Krosnick J.A. (Eds). Attitude strength: Antecedents and consequences (1995), Erlbaum, Mahwah, NJ 361-386
94. Ullrich, J. (in press). Reconsidering the "relative" in relative ingroup prototypicality. European Journal of Social Psychology
95. van Harreveld, F., Rutjens, B. T., Rotteveel, M., Nordgren, L. F., & van der Pligt, J. (2008). Ambivalence and decisional conflict as a cause of psychological discomfort: Feeling tense when jumping off the fence. Manuscript submitted for publication.
96. van Harreveld F., van der Pligt J., de Vries N.K., Wenneker C., and Verhue D. Ambivalence and information integration in attitudinal judgment. British Journal of Social Psychology 43 (2004) 431-447
97. Venables W.N., and Ripley B.D. Modern applied statistics with S. 4th ed. (2002), Springer, New York
98. Visser P.S., Bizer G.Y., and Krosnick J.A. Exploring the latent structure of strength-related attitude attributes. In: Zanna M.P. (Ed). Advances in experimental social psychology 38 (2006), Academic Press, New York, NY 1-67
99. Wallace D.S., Paulson R.M., Lord C.G., and Bond Jr. C.F. Which behaviors do attitudes predict? Meta-analyzing the effects of social pressure and perceived difficulty. Review of General Psychology 9 (2005) 214-227
100. Wegener D.T., Downing J., Krosnick J.A., and Petty R.E. Measures and manipulations of strength-related properties of attitudes: Current practice and future directions. In: Petty R.E., and Krosnick J.A. (Eds). Attitude strength: Antecedents and consequences (1995), Erlbaum, Mahwah, NJ 455-487
101. Whisman M.A., and McClelland G.H. Designing, testing, and interpreting interactions and moderator effects in family research. Journal of Family Psychology 19 (2005) 111-120
102. Yzerbyt V.Y., Muller D., and Judd C.M. Adjusting researchers' approach to adjustment: On the use of covariates when testing interactions. Journal of Experimental Social Psychology 40 (2004) 424-431
103. Zemborain M.R., and Johar G.V. Attitudinal ambivalence and openness to persuasion: A framework for interpersonal influence. Journal of Consumer Research 33 (2007) 506-514