Commentary: A big problem requires a foundational change

Journal of Experimental Social Psychology

Volumn 66, Issue , 2016, Pages 159-165

  Dovidio, John F ^a  

^a YALE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84977104345     PISSN: 00221031     EISSN: 10960465     Source Type: Journal    
DOI: 10.1016/j.jesp.2016.01.008     Document Type: Note

References (39)

1. Abelson, R.P., Statistics as principled argument. 1995, Lawrence Erlbaum Associates, Mahwah, NJ.
2. Bakan, D., The test of significance in psychological research. Psychological Bulletin 66 (1966), 423–437, 10.1037/h0020412.
3. Berinsky, A., Margolis, M., Sances, M., Can we turn shirkers into workers?. Journal of Experimental Social Psychology 66 (2016), 20–28.
4. Buhrmester, M., Kwang, T., Gosling, S.D., Amazon's Mechanical Turk a new source of inexpensive, yet high-quality, data?. Perspectives on Psychological Science 6 (2011), 3–5, 10.1177/1745691610393980.
5. Campbell, D.T., Factors relevant to the validity of experiments in social settings. Psychological Bulletin 54 (1957), 297–312, 10.1037/h0040950.
6. Chang, L., Krosnick, J.A., National surveys via RDD telephone interviewing versus the internet. Comparing sample representativeness and response quality. Public Opinion Quarterly 73 (2009), 641–678, 10.1093/poq/nfp075.
7. Crandall, C.S., Sherman, J.W., On the scientific superiority of conceptual replications. Journal of Experimental Social Psychology 66 (2016), 93–99.
8. Curran, P.G., Methods for the detection of carelessly invalid responses in survey data. Journal of Experimental Social Psychology 66 (2016), 4–19.
9. Echterhoff, G., Higgins, E.T., Groll, S., Audience-tuning effects on memory: The role of shared reality. Journal of Personality and Social Psychology 89 (2005), 257–276, 10.1037/0022-3514.89.3.257.
10. Fabrigar, L.R., Wegener, D.T., Conceptualizing and evaluating the replication of research results. Journal of Experimental Social Psychology 66 (2016), 68–80.
11. Francis, G., Too good to be true: Publication bias in two prominent studies from experimental psychology. Psychonomic Bulletin & Review 19 (2012), 146–151, 10.3658/s13423-012-0227-9.
12. Gergen, K.J., Social psychology as history. Journal of Personality and Social Psychology 26 (1973), 209–320, 10.1037/h0034436.
13. Giner-Sorolla, R., Science or art? How aesthetic standards grease the way through the publication bottleneck but undermine science. Perspectives on Psychological Science 7 (2012), 562–571, 10.1177/1745691612457576.
14. Greenwald, A.G., Consequences of prejudice against the null hypothesis. Psychological Bulletin 82 (1975), 1–20, 10.1037/h0076157.
15. Greenwald, A.G., Pratkanis, A.G., Leippe, M.R., Baumgardner, M.H., Under what conditions does theory obstruct research progress?. Psychological Review 93 (1986), 216–229, 10.1037/0033-295X.93.2.216.
16. Hales, A., Does the conclusion follow from the evidence? Recommendations for improving research. Journal of Experimental Social Psychology 66 (2016), 39–46.
17. Head, M.L., Holman, L., Lanfear, R., Kahn, A.T., Jennions, M.D., The extent and consequences of p-hacking in science. PLoS Biology, 13(3), 2015, e1002106, 10.1371/journal.pbio.1002106.
18. Huffmeier, J., Mazei, J., Schultze, T., Reconceptualizing replication as a sequence of different studies: A replication typology. Journal of Experimental Social Psychology 66 (2016), 81–92.
19. Jussim, L., Maoz, I., Desperately seeking the “wow effect”: Data interpretation and scientific story-telling as issues of research integrity. Presentation at the October 2014 meeting of the society for experimental social psychology, 2014.
20. Jussim, L., Crawford, J.T., Anglin, S.M., Stevens, S.T., Duarte, J.L., Interpretations and methods: Towards a more effectively self-correcting social psychology. Journal of Experimental Social Psychology 66 (2016), 116–133.
21. Maner, J.K., Into the wild: Field studies can increase both replicability and real-world impact. Journal of Experimental Social Psychology 66 (2016), 100–106.
22. Marascuilo, L.A., Levin, J.R., Appropriate post hoc comparisons for interaction and nested hypotheses in analysis of variance designs: The elimination of type IV errors. American Educational Research Journal 7 (1970), 397–421 doi: http://www.jstor.org/stable/1161635.
23. Nosek, B.A., Bar-Anan, Y., Scientific utopia: I. Opening scientific communication. Psychological Inquiry 23 (2012), 217–243, 10.1080/1047840X.2012.692215.
24. Nosek, B.A., Spies, J.R., Motyl, M., Scientific utopia: II. Restructuring incentives and practices to promote truth over publishability. Perspectives on Psychological Science 7 (2012), 615–631, 10.1177/1745691612459058.
25. Open Science Collaboration. Estimating the reproducibility of psychological science. Science, 349, 2015, 10.1126/science.aac4716 (aac4716).
26. Pettigrew, T.F., Influencing policy with social psychology. Journal of Social Issues 44:2 (1988), 205–219, 10.1111/j.1540-4560.1988.tb02071.x.
27. Pierce, J.L., Kostova, T., Dirks, K.T., The state of psychological ownership: Integrating and extending a century of research. Review of General Psychology 7 (2003), 84–107, 10.1037/1089-2680.7.1.84.
28. Pirlott, A., MacKinnon, D.P., Design approaches to experimental mediation. Journal of Experimental Social Psychology 66 (2016), 29–38.
29. Reis, H.T., Stiller, J., Publication trends in JPSP: A three-decade review. Personality and Social Psychology Bulletin 18 (1992), 465–472, 10.1177/0146167292184011.
30. Rodin, J., The application of social psychology. Lindzey, G., Aronson, E., (eds.) The handbook of social psychology, 3rd ed., 2, 1985, Random House, New York, NY, 805–881.
31. Sakaluk, J.,.K., Exploring Small, Confirming Big: An alternative system to The New Statistics for advancing cumulative and replicable psychological research. Journal of Experimental Social Psychology 66 (2016), 47–54.
32. Schaller, M., The empirical benefits of conceptual rigor: Systematic articulation of conceptual hypotheses can reduce the risk of non-replicable results (and facilitate novel discoveries too). Journal of Experimental Social Psychology 66 (2016), 107–115.
33. Schimmack, U., The ironic effect of significant results on the credibility of multi-study articles. Psychological Methods 17 (2012), 551–566, 10.1037/a0029487.
34. Schultz, D.M., Rejection rates for journals publishing in the atmospheric sciences. Bulletin of the American Meteorological Society 91 (2010), 231–243, 10.1175/2009BAMS2908.1.
35. Schweinsberg, M., Madan, N., Vianello, M., Sommer, S.A., Jordan, J., Tierney, W. Uhlmann, E.L., The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline. Journal of Experimental Social Psychology 66 (2016), 55–67.
36. Simmons, J.P., Nelson, L.D., Simonsohn, U., False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science 22 (2011), 1359–1366, 10.1177/0956797611417632.
37. Stroebe, W., Are most published social psychological findings false?. Journal of Experimental Social Psychology 66 (2016), 134–144.
38. Stroebe, W., Strack, F., The alleged crisis and the illusion of exact replication. Perspectives on Psychological Science 8 (2014), 59–71, 10.1177/1745691613514450.
39. Stroebe, W., Postmes, T., Spears, R., Scientific misconduct and the myth of self-correction in science. Perspectives on Psychological Science 7 (2012), 670–688, 10.1177/1745691612460687.