The Alleged Crisis and the Illusion of Exact Replication

Perspectives on Psychological Science

Volumn 9, Issue 1, 2014, Pages 59-71

  Stroebe, Wolfgang ^a,b   Strack, Fritz ^c  

^a UTRECHT UNIVERSITY   (Netherlands)

^b UNIVERSITY OF GRONINGEN   (Netherlands)

^c UNIVERSITY OF WÜRZBURG   (Germany)

Author keywords

critical rationalism; epistemology; null findings; priming; replicability crisis; replication; scientific fraud

Indexed keywords

EID: 84892463327     PISSN: 17456916     EISSN: 17456924     Source Type: Journal    
DOI: 10.1177/1745691613514450     Document Type: Article

References (78)

1. Aarts H.,Dijksterhuis A.Category activation effects in judgment and behaviour: The moderating role of perceived comparability.British Journal of Social Psychology. 2002;41:123-128.
2. Arnett J. J.The neglected 95%: Why American psychology needs to become less American.American Psychologist. 2008;63:602-614.
3. Aronson E.,Mills J.The effect of severity of initiation on liking for a group.Journal of Abnormal and Social Psychology. 1959;59:177-181.
4. Bakker M.,van Dijk A.,Wicherts J. M.The rules of the game called psychological science.Perspectives on Psychological Science. 2012;7:543-554.
5. Bargh J. A.,Chen M.,Burrows L.Automaticity of social behavior: Direct effects of trait construct and stereotype-activation on action.Journal of Personality and Social Psychology. 1996;71:230-244.
6. Bem D. J.An experimental analysis of self-persuasion.Journal of Experimental Social Psychology. 1965;1:199-218.
7. Bengtsson S. L.,Dolan R.,Passingham R. E.Priming for self-esteem influences monitoring of one's own performance.Scan. 2011;6:417-425.
8. Bry C.,Follenfant A.,Meyer T.Blonde like me: When self-construals moderate stereotype priming effects on intellectual performance.Journal of Experimental Social Psychology. 2008;44:751-757.
9. Cesario J.,Plaks J. E.,Higgins T. E.Automatic social behavior as motivated preparation to interact.Journal of Personality and Social Psychology. 2006;90:893-910.
10. Chaiken S.Heuristic versus systematic information processing and the use of source versus message cues in persuasion.Journal of Personality and Social Psychology. 1980;39:725-766.
11. ChamberlinJ. (2000, May). A student publishing tradition. APA Monitor on Psychology, 31, 36. Retrieved from http://www.apa.org/monitor/may00/rrsp.aspx.
12. ChambersC.SumnerP. (2012, September14). Replication is the only solution to scientific fraud. The Guardian. Retrieved from http://www.guardian.co.uk/commentisfree/2012/sep/14/solution-scientific-fraud-replication.
13. Cooper J.,Worchel S.Role of undesirable consequences in arousing cognitive dissonance.Journal of Personality and Social Psychology. 1970;16:199-206.
14. Crocker J.,Cooper L.Editorial: Addressing scientific fraud.Science. 2011;334:1182.
15. DeCoster J.,Claypool H. M.A meta-analysis of priming effects on impression formation supporting a general model of informational bias.Personality and Social Psychology Review. 2004;8:2-27.
16. Dijksterhuis A.,Spears R.,Lepinasse V.Reflecting and deflecting stereotypes: Assimilation and contrast in impression formation and automatic behavior.Journal of Experimental Social Psychology. 2001;37:286-299.
17. Dijksterhuis A.,van Knippenberg A.The relation between perception and behavior or how to win a game of trivial pursuit.Journal of Personality and Social Psychology. 1998;74:865-877.
18. Doyen S.,Klein O.,Pichon C.-L.,Cleeremans A.Behavioral priming: It's all in the mind, but whose mind?.PLoS ONE. 2012;7:e29081.
19. Fazio R. H.,Zanna M. P.,Cooper J.Dissonance and self-perception: An integrative view of each theory's proper domain of application.Journal of Experimental Social Psychology. 1977;13:464-479.
20. Festinger L.A theory of cognitive dissonance. Stanford, CA: Stanford University Press; 1957:.
21. FestingerL.CarlsmithJ. M. (1959). Cognitive consequences of forced compliance. Journal of Abnormal and Social Psychology, 58, 203-210. Retrieved from http://ori.hhs.gov/sites/default/files/gallup_finalreport.pdf.
22. Galinsky A. D.,Wang C. S.,Ku G.Perspective-takers behave more stereotypically.Journal of Personality and Social Psychology. 2008;95:404-419.
23. Gergen K. J.Social psychology as history.Journal of Personality and Social Psychology. 1973;26:309-320.
24. Greenwald A. G.Consequences of prejudice against the null-hypothesis.Psychological Bulletin. 1975;82:1-20.
25. Greenwald A. G.There is nothing so theoretical as a good method.Perspectives on Psychological Science. 2012;7:99-108.
26. Greenwald A. G.,Pratkanis A. R.,Leippe M. R.,Baumgardner M. H.Under what conditions does theory obstruct research progress?.Psychological Review. 1986;93:216-229.
27. Haddock G.,Macrae C. N.,Fleck S.Syrian science and smart supermodels: On the when and how of perception-behavior effects.Social Cognition. 2002;20:461-481.
28. Hansen J.,Wänke M.Think of capable others and you can make it! Self-efficacy mediates the effect of stereotype activation on behavior.Social Cognition. 2009;27:76-88.
29. Higgins T. E.,Rholes W. S.,Jones C. R.Category accessibility and impression formation.Journal of Experimental Social Psychology. 1977;13:141-154.
30. Hilton D.Handbook of the history of social psychology. Kruglanski A.Stroebe W., ed. New York, NY: Psychology Press; 2012:45-79.
31. Janis I. L.,Feshbach S.Effects of fear-arousing communications.Journal of Abnormal and Social Psychology. 1953;48:78-92.
32. John L. K.,Loewenstein G.,Prelec D.Measuring the prevalence of questionable research practices with incentives for truth telling.Psychological Science. 2012;23:524-532.
33. Kawakami K. L.,Young H.,Dovidio J. F.Automatic stereotyping: Category, trait, and behavioral activations.Personality and Social Psychology Bulletin. 2002;28:3-15.
34. Klein C. T. F.,Webster D. M.Individual differences in argument scrutiny as motivated by need for cognitive closure.Basic and Applied Psychology. 2000;22:119-129.
35. Koole S. L.,Lakens D.Rewarding replications: A sure simple way to improve psychological science.Perspectives on Psychological Science. 2012;7:608-614.
36. Kruglanski A. W.,Stroebe W.Handbook of the history of social psychology. Kruglanski A. W.Stroebe W., ed. New York, NY: Psychology Press; 2012:3-18.
37. Ku G.,Wang C. S.,Galinsky A. D.Perception through a perspective-taking lens: Differential effects on judgments and behavior.Journal of Experimental Social Psychology. 2010;46:792-798.
38. Kuhn T. S.The structure of scientific revolutions. 1996). The structure of scientific revolutions (3rd ed.). Chicago, IL: University of Chicago Press.Chicago, IL: University of Chicago Press; 1996:.
39. LeBel E. P.,Borsboom D.,Giner-Sorolla R.,Hasselman F.,Peters K. R.,Ratliff K. A.,Tucker Mith C.PsychDisclosure.org: Grassroots support for reforming standards in psychology.Perspectives on Psychological Science. 2013;8:424-432.
40. LeBoeuf R. A.,Estes Z."Fortunately, I'm no Einstein": Comparison relevance as a determinant of behavioral assimilation and contrast.Social Cognition. 2004;22:607-636.
41. LeveltP.NoortE.DrenthP. (2012). Flawed science: The fraudulent research practices of social psychologist Diederik Stapel. Retrieved from http://www.tilburguniversity.edu/upload/3ff904d7-547b-40ae-85fe-bea38e05a34a_Final%20report%20Flawed%20Science.pdf.
42. Linder D. E.,Cooper J.,Jones E. E.Decision freedom as a determinant of the role of incentive magnitude in attitude change.Journal of Personality and Social Psychology. 1967;6:245-254.
43. Lodewijkx H. F. M.,Syroit J. E. M. M.Severity of initiation revisited: Does severity of initiation increase attractiveness in real groups?.European Journal of Social Psychology. 1997;27:275-300.
44. Lodewijkx H. F. M.,van Zomeren M.,Syroit J. E. M. M.The anticipation of a severe initiation: Gender differences in effects on affiliation tendency and group attraction.Small Group Research. 2005;36:237-262.
45. Loersch C.,Payne B. K.The situated inference model: An integrative account of the effects of primes on perception, behavior, and motivation.Perspectives on Psychological Science. 2011;6:234-252.
46. Lowery B. S.,Eisenberger N. I.,Hardin C. D.,Sinclair S.Long-term effects of subliminal priming on academic performance.Basic and Applied Social Psychology. 2007;29:151-157.
47. Macrae C. N.,Bodenhausen G. V.,Milne A. B.,Castelli L.,Schloerscheidt A. M.,Greco S.On activating exemplars.Journal of Experimental Social Psychology. 1998;34:330-354.
48. Meyer D. E.,Schvaneveldt R. W.Facilitation in recognizing pairs of words: Evidence of dependence between retrieval operations.Journal of Experimental Psychology. 1971;90:227-234.
49. Mummendey A.Scientific misconduct in social psychology-Towards a currency reform in science.European Bulletin of Social Psychology. 2012;24:4-7.
50. Mussweiler T.Doing is for thinking! Stereotype activation by stereotypic movement.Psychological Science. 2006;17:17-21.
51. Nussinson R.,Seibt B.,Häfner M.,Strack F.Come a bit closer: Approach motor actions lead to feeling similar and behavioral assimilation.Social Cognition. 2010;28:40-58.
52. An open, large-scale, collaborative effort to estimate the reproducibility of psychological science.Perspectives on Psychological Science. 2012;7:657-660.
53. Pashler H.,Coburn N.,Harris C. R.Priming of social distance? Failure to replicate effects on social and food judgments.PLoS ONE. 2012;7:e42510.
54. Pashler H.,Harris C. R.Is the replicability crisis overblown? Three arguments examined.Perspectives on Psychological Science. 2012;7:531-536.
55. Pashler H.,Wagenmakers E.-J.Editors' introduction to the special section on replicability in psychological science: A crisis of confidence?.Perspectives on Psychological Science. 2012;7:528-530.
56. Petty R. E.,Cacioppo J. T.Communication and persuasion. New York, NY: Springer; 1986:.
57. Petty R. E.,Cacioppo J. T.,Goldman R.Personal involvement as a determinant of argument-based persuasion.Journal of Personality and Social Psychology. 1981;41:847-855.
58. Petty R. E.,Wells G. L.,Brock T. C.Distraction can enhance or reduce yielding to propaganda: Thought disruption versus effort justification.Journal of Personality and Social Psychology. 1976;34:874-884.
59. Popper K. R.The logic of scientific discovery. London, England: Hutchinson; 1959:.
60. Roediger H. L.Psychology's woes and a partial cure: The value of replication.Observer. 2012;25 (2): 27-29.
61. Schmidt S.Shall we really do it again? The powerful concept of replication is neglected in the social sciences.Review of General Psychology. 2009;13:90-100.
62. Schröder T.,Thagard P.The affective meanings of automatic social behaviors: Three mechanisms that explain priming.Psychological Review. 2013;120:255-280.
63. Shanks D. R.,Newell B. R.,Lee E. H.,Balakrishnan D.,Ekelund L.,Cenac Z., Moore C.Priming intelligent behavior: An elusive phenomenon.PLoS ONE. 2013;8:e56515.
64. Simmons J. P.,Nelson L. D.,Simonsohn U.False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant.Psychological Science. 2011;22:1359-1366.
65. Stapel D.Ontsporing. Amsterdam, the Netherlands: Prometheus; 2012:.
66. Stapel D. A.,Lindenberg S.Coping with chaos: How disordered contexts promote stereotyping and discrimination.Science. 2011;332:251-252.
67. Steele C. M.,Aronson J.Stereotype threat and the intellectual test performance of African Americans.Journal of Personality and Social Psychology. 1995;69:797-811.
68. Strack F.,Deutsch R.Reflective and impulsive determinants of social behavior.Personality and Social Psychology Review. 2004;8:220-247.
69. Strack F.,Hannover B.The psychology of action: Linking cognition and motivation to behavior. Gollwitzer P.Bargh J. A., ed. New York, NY: Guilford; 1996:579-595.
70. Strack F.,Schwarz N.,Bless H.,Kübler A.,Wänke M.Awareness of the influence as a determinant of assimilation versus contrast.European Journal of Social Psychology. 1993;23:53-62.
71. Stroebe W.Social psychology and health. Maidenhead, England: Open University Press; 2011:.
72. Stroebe W.,Diehl M.When social support fails: Supporter characteristics in compliance induced attitude change.Personality and Social Psychology Bulletin. 1988;14:136-144.
73. Stroebe W.,Nijstad B.Do our psychological laws apply only to Americans?.American Psychologist. 2009;64:569.
74. Stroebe W.,Postmes T.,Spears R.Scientific misconduct and the myth of self-correction in science.Perspectives on Psychological Science. 2012;7:670-688.
75. Tetlock P. E.,Manstead A. S. R.Impression management versus intrapsychic explanations in social psychology: A useful dichotomy?.Psychological Review. 1985;92:59-77.
76. Tulving E.,Schacter D. L.Priming and human memory systems.Science. 1990;247:301-306.
77. Vul E.,Harris C.,Winkielman P.,Pashler H.Puzzling high correlations in fMRI studies of emotion, personality, and social cognition.Perspectives on Psychological Science. 2009;4:274-288.
78. Wheeler S. C.,Jarvis W. B. G.,Petty R. E.Think onto others: The self-destructive impact of negative racial stereotypes.Journal of Experimental Social Psychology. 2001;37:173-180.