Registered reports: A method to increase the credibility of published results

Social Psychology

Volumn 45, Issue 3, 2014, Pages 137-141

  Nosek, Brian A ^a   Lakens, Daniël ^b  

^a UNIVERSITY OF VIRGINIA   (United States)

^b EINDHOVEN UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84901708710     PISSN: 18649335     EISSN: 21512590     Source Type: Journal    
DOI: 10.1027/1864-9335/a000192     Document Type: Review

References (45)

1. Bastardi, A., Uhlmann, E. L., & Ross, L. (2011). Wishful thinking, belief, desire, and the motivated evaluation of scientific evidence. Psychological Science, 22, 731-732.
2. Blanken, I., Van de Ven, N., Zeelenberg, M., & Meijers, M. H. C. (2014). Three attempts to replicate the moral licensing effect. Social Psychology, 45, 232-238. doi: 10.1027/1864-9335/a000189
3. Brandt, M. J., IJzerman, H., & Blanken, I. (2014). Does recalling moral behavior change the perception of brightness? A replication and meta-analysis of Banerjee, Chatterjee, and Sinha (2012). Social Psychology, 45, 246-252. doi: 10.1027/1864-9335/a000191
4. Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafo, M. R. (2013). Power failure: Why small sample size undermines the reliability of neuroscience. Nature Reviews Neuroscience, 14, 1-12. doi: 10.1038/nrn3475
5. Calin-Jageman, R. J., & Caldwell, T. L. (2014). Replication of the superstition, performance study by Damisch, Stoberock, Mussweiler (2010). Social Psychology, 45, 239-245. doi: 10.1027/1864-9335/a000190
6. Chambers, C. D. (2013). Registered reports: A new publishing initiative at Cortex. Cortex, 49, 609-610.
7. Eich, E. (2013). Business not as usual. Psychological Science, 25, 3-6. doi: 10.1177/0956797613512465
8. Fanelli, D. (2010). "Positive" results increase down the hierarchy of the sciences. PLoS One, 5, e10068.
9. Gibson, C. E., Losee, J., & Foxwell, C. (2014). A replication of stereotype susceptibility (Shih, Pittinsky, & Ambady, 1999): Identity salience and shifts in quantitative performance. Social Psychology, 45, 194-198. doi: 10.1027/1864-9335/a000184
10. Gibson, C. E., Losee, J., & Vitiello, C. (2014). A replication attempt of stereotype susceptibility: Identity salience and shifts in quantitative performance. Social Psychology, 45, 1XX-1XX. doi: 10.1027/1864-9335/a000184
11. Giner-Sorolla, R. (2012). Science or art? How aesthetic standards grease the way through the publication bottleneck but undermine science. Perspectives on Psychological Science, 7, 562-571.
12. Greenwald, A. G. (1975). Consequences of prejudice against the null hypothesis. Psychological Bulletin, 82, 1-20. doi: 10.1037/h0076157
13. Greenwald, A. G. (2009). What (and where) is the ethical code concerning researcher conflict of interest? Perspectives on Psychological Science, 4, 32-35.
14. IJzerman, H., Blanken, I., Brandt, M. J., Oerlemans, J. M., Van den Hoogenhof, M. M. W., Franken, S. J. M., & Oerlemans, M. W. G. (2014). Sex differences in distress from infidelity in early adulthood and in later life: A replication and metaanalysis of Shackelford et al. (2004). Social Psychology, 45, 202-208. doi: 10.1027/1864-9335/a000185
15. Johnson, D. J., Cheung, F., & Donnellan, M. B. (2014). Does cleanliness influence moral judgments? A direct replication of Schnall, Benton, and Harvey (2008). Social Psychology, 45, 209-215. doi: 10.1027/1864-9335/ a000186
16. Kerr, N. L. (1998). HARKing: Hypothesizing after the results are known. Personality and Social Psychology Review, 2, 196-217.
17. Klein, R. A., Ratliff, K., Vianello, M., Adams, A. B. Jr., Bahník, S., Bernstein, N. B.,... Nosek, B. A. (2014). Investigating variation in replicability: A "Many Labs" Replication Project. Social Psychology, 45, 142-152. doi: 10.1027/1864-9335/a000178
18. Koole, S. L., & Lakens, D. (2012). Rewarding replications: A sure and simple way to improve psychological science. Perspectives on Psychological Science, 7, 608-614. doi: 10.1177/1745691612462586
19. Lakens, D., & Evers, E. (in press). Sailing from the seas of chaos into the corridor of stability: Practical recommendations to increase the informational value of studies. Perspectives on Psychological Science.
20. LeBel, E., Borsboom, D., Giner-Sorolla, R., Hasselman, F., Peters, K., Ratliff, K., & Smith, C. (2013). Psychdisclosure. Org: Grassroots support for reforming reporting standards in psychology. Perspectives on Psychological Science, 8, 424-432.
21. LeBel, E. P., & Peters, K. R. (2011). Fearing the future of empirical psychology: Bem's (2011) evidence of psi as a case study of deficiencies in modal research practice. Review of General Psychology, 15, 371-379. doi: 10.1037/a0025172
22. Lynott, D., Corker, K. S., Wortman, J., Connell, L., Donnellan, M. J., Lucas, R. E., & O'Brien, K. (2014). Replication of "Experiencing physical warmth promotes interpersonal warmth" by Williams and Bargh (2008). Social Psychology, 45, 216-222. doi: 10.1027/1864-9335/a000187
23. Makel, M., Plucker, J., & Hegarty, B. (2012). Replications in psychology research: How often do they really occur? Perspectives in Psychological Science, 7, 537-542. doi: 10.1177/1745691612460688
24. Miguel, E., Camerer, C., Casey, K., Cohen, J., Esterling, K. M., Gerber, A.,... Van der Laan, M. (2014). Promoting transparency in social science research. Science, 343, 30-31. doi: 10.1126/science.1245317
25. Moon, A., & Roeder, S. S. (2014). A secondary replication attempt of stereotype susceptibility (Shih, Pittinsky, & Ambady, 1999). Social Psychology, 45, 199-201. doi: 10.1027/1864-9335/a000193
26. Müller, F., & Rothermund, K. (2014). Replication of stereotype activation (Banaji & Hardin, 1996; Blair & Banaji, 1996). Social Psychology, 45, 187-193. doi: 10.1027/1864-9335/a000183
27. Nauts, S., Langner, O., Huijsmans, I., Vonk, R., & Wigboldus, D. H. J. (2014). Forming impressions of personality: A replication and review of Asch's (1946) evidence for a primacy-of-warmth effect in impression formation. Social Psychology, 45, 153-163. doi: 10.1027/1864-9335/a000179
28. Neuliep, J. W., & Crandall, R. (1990). Editorial bias against replication research. Journal of Social Behavior and Personality, 5, 85-90.
29. Neuliep, J. W., & Crandall, R. (1993). Reviewer bias against replication research. Journal of Social Behavior and Personality, 8, 21-29.
30. Nosek, B. A., & Lakens, D. (2013). Call for proposals: Special issue of social psychology on "Replications of important results in social psychology". Social Psychology, 44, 59-60. doi: 10.1027/1864-9335/a000143
31. Nosek, B. A., Spies, J. R., & Motyl, M. (2012). Scientific utopia: II Restructuring incentives and practices to promote truth over publishability. Perspectives in Psychological Science, 7, 615-631.
32. Open Science Collaboration. (2012). An open, large-scale, collaborative effort to estimate the reproducibility of psychological science. Perspectives on Psychological Science, 7, 657-660. doi: 10.1177/1745691612462588
33. Open Science Collaboration. (2013). The reproducibility project: A model of large-scale collaboration for empirical research on reproducibility. In V. Stodden, F. Leisch, & R. Peng (Eds.), Implementing reproducible computational research (a volume in the r series). New York, NY: Taylor & Francis.
34. Schmidt, S. (2009). Shall we really do it again? The powerful concept of replication is neglected in the social sciences. Review of General Psychology, 13, 90-100. doi: 10.1037/a0015108
35. Schönbrodt, F. D., & Perugini, M. (2013). At what sample size do correlations stabilize? Journal of Research in Personality, 47, 609-612. doi: 10.1016/j.jrp.2013.05.009
36. Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359-1366.
37. Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2012). A 21 word solution. Retrieved from http://ssrn. com/abstract=2160588
38. Simons, D., & Holcombe, A. (2013). Registered replication reports. Retrieved from http://www.psychologicalscience.org/index.php/replication
39. Sinclair, H. C., Hood, K., & Wright, B. (2014). Revisiting Romeo and Juliet (Driscoll, Davis, & Lipetz, 1972): Reexamining the links between social network opinions and romantic relationship outcomes. Social Psychology, 45, 170-178. doi: 10.1027/1864-9335/a000181
40. Sterling, T. D. (1959). Publication decisions and their possible effects on inferences drawn from tests of significance - Or vice versa. Journal of the American Statistical Association, 54, 30-34.
41. Vermeulen, I., Batenburg, A., Beukeboom, C., & Smits, T. (2014). Breakthrough or one-hit wonder? Replicating effects of single-exposure musical conditioning on choice behavior (Gorn, 1982). Social Psychology, 45, 179-186. doi: 10.1027/1864-9335/a000182
42. Wagenmakers, E. J., Wetzels, R., Borsboom, D., van der Maas, H. L., & Kievit, R. A. (2012). An agenda for purely confirmatory research. Perspectives on Psychological Science, 7, 632-638.
43. Wesselmann, E. D., Williams, K. D., Pryor, J. B., Eichler, F. A., Gill, D., & Hogue, J. D. (2014). Revisiting Schachter's research on rejection, deviance, and communication (1951). Social Psychology, 45, 164-169. doi: 10.1027/1864-9335/a000180
44. Wolfe, J. M. (2013). Registered reports and replications in attention, perception, & psychophysics. Attention, Perception, & Psychophysics, 75, 781-783. doi: 10.3758/s13414-013-0502-5
45. Žeželj, I. L., & Jokić, B. R. (2014). Replication of experiments evaluating impact of psychological distance on moral judgment (Eyal, Liberman & Trope, 2008; Gong & Medin, 2012). Social Psychology, 45, 223-231. doi: 10.1027/1864-9335/a000188