On the scientific superiority of conceptual replications for scientific progress

Journal of Experimental Social Psychology

Volumn 66, Issue , 2016, Pages 93-99

  Crandall, Christian S ^a   Sherman, Jeffrey W ^b  

^a UNIVERSITY OF KANSAS   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Conceptual replications; Philosophy of science; Replication; Social psychology

Indexed keywords

HUMAN; PHILOSOPHY; PSYCHOLOGY; TENSION;

EID: 84977100505     PISSN: 00221031     EISSN: 10960465     Source Type: Journal    
DOI: 10.1016/j.jesp.2015.10.002     Document Type: Article

References (56)

1. Bem, S.L., Androgyny and gender schema theory: A conceptual and empirical integration. Nebraska Symposium on Motivation, vol. 32, 1981, University of Nebraska Press, Lincoln, 179–226.
2. Brehm, J., Postdecision changes in the desirability of alternatives. Journal of Abnormal and Social Psychology 52 (1956), 384–389.
3. Bridgman, P., The logic of modern physics. 1927, Macmillan, New York.
4. Brown, R., Social psychology. 1965, Free Press, New York.
5. Campbell, D.T., Evolutionary epistemology. Schilpp, P.A., (eds.) The Philosophy of Karl Popper, Book 1, 1974, Open Court Publishing, LaSalle, IL, 413–463.
6. Casadevall, A., Fang, F.C., Reproducible science. Infection and Immunity 78 (2010), 4972–4975.
7. Chen, M.K., Risen, J.L., How choice affects and reflects preferences: revisiting the free-choice paradigm. Journal of Personality and Social Psychology 99 (2010), 573–594.
8. Crandall, C., Scientific progress: A need for trust, a need for skepticism. Dialogue 16:2 (2001), 20–21 (Available for download at: http://www.academia.edu/2705937/Scientific_Progress_A_need_for_trust_a_need_for_skepticism).
9. Crowe, E., Higgins, E.T., Regulatory focus and strategic inclinations: Promotion and prevention in decision-making. Organizational Behavior and Human Decision Processes 69 (1997), 117–132.
10. Drummond, C., Replicability is not reproducibility: Nor is it good science. Proc. Eval. Methods Mach. Learn. Workshop 26th ICML, Montreal, Quebec, Canada, 2009 (Downloaded from http://www.csi.uottawa.ca/∼cdrummon/pubs/ICMLws09.pdf, Mar 25, 2015).
11. Duhem, P., La théorie physique. Son objet, sa structure (Trans.) translated as The aim and structure of physical theory, 1906/1954, Princeton University Press, Princeton, NJ.
12. Egan, L.C., Santos, L.R., Bloom, P., The origins of cognitive dissonance: Evidence from children and monkeys. Psychological Science 18 (2007), 978–983.
13. Eidelman, S., Crandall, C.S., Goodman, J.A., Blanchar, J.C., Low-effort thought promotes political conservatism. Personality and Social Psychology Bulletin 38:6 (2012), 808–820.
14. Fraley, R.C., Vazire, S., The N-pact factor: Evaluating the quality of empirical journals with respect to sample size and statistical power. PloS One, 9(10), 2014, e109019.
15. Fuller, S., Science. 1997, University of Minnesota Press, Minneapolis.
16. Funder, D.C., Levine, J.M., Mackie, D.M., Morf, C.C., Sansone, C., Vazire, S., West, S.G., Improving the dependability of research in personality and social psychology: Recommendations for research and educational practice. Personality and Social Psychology Review 18 (2014), 3–12.
17. Godfrey-Smith, P., Theory and reality: An introduction to the philosophy of science. 2009, University of Chicago Press, Chicago.
18. Greenwald, A.G., The extremely limited value of isolated failures to replicate. In “What do direct replications say about the reproducibility of psychological phenomena?”. 2015, Symposium at Association for Psychological Science, New York (May 22, 2015).
19. Head, M.L., Holman, L., Lanfear, R., Kahn, A.T., Jennions, M.D., The extent and consequences of p-hacking in science. PLoS Biology, 13(3), 2015, e1002106, 10.1371/journal.pbio.1002106.
20. Henry, P.F., Sears, D.O., The symbolic racism 2000 scale. Political Psychology 23 (2002), 253–283.
21. Hull, D.L., Science as a process: An evolutionary account of the social and conceptual development of science. 1988, University of Chicago Press, Chicago.
22. Ioannidis, J.P., Why most published research findings are false. PLoS Medicine, 2, 2005, e124.
23. John, L., Loewenstein, G.F., Prelec, D., Measuring the prevalence of questionable research practices with incentives for truth-telling. Psychological Science, 2012, 10.2139/ssrn.1996631.
24. Kicinski, M., Publication bias in recent meta-analyses. PloS One, 8(11), 2013, e81823.
25. Kitcher, P., The advancement of science: Science without legend, objectivity without illusions. 1995, Oxford University Press, New York.
26. Lakatos, I., Musgrave, A., Criticism and the growth of knowledge. 1970, Cambridge University Press, Cambridge.
27. Laudan, L., Progress and its problems: Towards a theory of scientific growth, vol. 282, 1978, University of California Press, Berkeley, CA.
28. MacKay, R.J., Oldford, R.W., Scientific method, statistical method and the speed of light. Statistical Science 15 (2000), 254–278.
29. Maxwell, S.E., The persistence of underpowered studies in psychological research: Causes, consequences, and remedies. Psychological Methods 9 (2004), 147–163.
30. McGrath, J.E., Dilemmatics: The study of research choices and dilemmas. American Behavioral Scientist 25 (1981), 179–210.
31. Meehl, P.E., Theory testing in psychology and physics: A methodological paradox. Philosophy of Science 34 (1967), 103–115.
32. Meehl, P.E., Appraising and amending theories: The strategy of Lakatosian defense and two principles that warrant it. Psychological Inquiry 1 (1990), 108–141.
33. Meyer, M.N., Chabris, C., Why psychologists' food fight matters: Important findings haven't been replicated, and science may have to change its ways. Slate.com. http://www.slate.com/articles/health_and_science/science/2014/07/replication_controversy_in_psychology_bullying_file_drawer_effect_blog_posts.html, 2014.
34. Moscovici, S., Zavalloni, M., The group as a polarizer of attitudes. Journal of Personality and Social Psychology 12 (1969), 125–135.
35. Neuberg, S.L., Newsom, J.T., Personal need for structure: Individual differences in the desire for simpler structure. Journal of Personality and Social Psychology 65 (1993), 113–131.
36. Nosek, B.A., Spies, J.R., Motyl, M., Scientific utopia: II. Restructuring incentives and practices to promote truth over publishability. Perspectives on Psychological Science 7 (2012), 615–631.
37. Open Science Collaboration. An open, large-scale, collaborative effort to estimate the reproducibility of psychological science. Perspectives on Psychological Science 7:6 (2012), 657–660.
38. Open Science Collaboration. Estimating the reproducibility of psychological science. Science, 349(6251), 2015.
39. Pashler, H., Harris, C., Is the replicability crisis overblown? Three arguments examined. Perspectives on Psychological Science 7 (2012), 531–536.
40. Pashler, H., Wagenmakers, E., Special section on replicability in psychological science: A crisis of confidence? (special section). Perspectives on Psychological Science 7 (2012), 528–654.
41. Popper, K.R., The logic of scientific discovery. 1959, Hutchinson, London.
42. Popper, K.R., Conjectures and refutations: The growth of scientific knowledge. 1963/2002, Routledge, London.
43. Quine, W.V.O., From a logical point of view: Nine logico-philosophical essays Cambridge. 1980, Harvard University Press, MA.
44. Ramscar, M., The unspeakable in the pursuit of the unrepeatable (web log post). (Retrieved from) https://ramscar.wordpress.com/2015/08/05/the-unspeakable-in-pursuit-of-the-unrepeatable/#more-704, 2015, Aug. 15.
45. Retraction Watch, 50 years later, is it time to retract a retraction by a Nobel prize-winning author?. Downloaded from http://retractionwatch.com/2015/09/25/five-decades-later-is-it-time-to-retract-a-nobelists-retraction/, 2015 (September 25, 2015).
46. Roberts, B.W., The Deathly Hallows of psychological science. Downloaded October 31, 2014 from http://pigee.wordpress.com/2014/03/10/the-deathly-hallows-of-psychological-science/, 2014.
47. Schmidt, S., Shall we really do it again? The powerful concept of replication is neglected in the social sciences. Review of General Psychology 13 (2009), 90–100.
48. Simmons, J.P., Nelson, L.D., Simonsohn, U., False-positive psychology undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science 22 (2011), 1359–1366.
49. Sniderman, P.M., Piazza, T., Tetlock, P.E., Kendrick, A., The new racism. American Journal of Political Science 35 (1991), 423–447.
50. Soter, S., deGrasse Tyson, N., Cosmic horizons: Astronomy at the cutting edge. 2000, American Museum of Natural History, New York.
51. Spence, J.T., Gender-related traits and gender ideology: Evidence for a multifactorial theory. Journal of Personality and Social Psychology 64 (1993), 624–635.
52. Stanley, D.J., Spence, J.R., Expectations for replications are yours realistic?. Perspectives on Psychological Science 9 (2014), 305–318.
53. Stoner, J. A. (1961). A comparison of individual and group decision involving risk. Unpublished master's thesis, Massachusetts Institute of Technology, School of Industrial Relations.
54. Stroebe, W., Strack, F., The alleged crisis and the illusion of exact replication. Perspectives in Psychological Science 8 (2014), 59–71.
55. Van Berkel, L., Crandall, C.S., Eidelman, S., Blanchar, J.C., Hierarchy, dominance, and deliberation egalitarian values require mental effort. Personality and Social Psychology Bulletin 41 (2015), 1207–1222.
56. Webster, D.M., Kruglanski, A.W., Individual differences in need for cognitive closure. Journal of Personality and Social Psychology 67 (1994), 1049–1067.