Just Post It: The Lesson From Two Cases of Fabricated Data Detected by Statistics Alone

Psychological Science

Volumn 24, Issue 10, 2013, Pages 1875-1888

  Simonsohn, Uri ^a  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

data posting; data sharing; decision making; fake data; judgment; scientific communication

Indexed keywords

ARTICLE; DATA POSTING; DATA SHARING; DECISION MAKING; ETHICS; FAKE DATA; HUMAN; INFORMATION DISSEMINATION; PSYCHOLOGY; PUBLISHING; RESEARCH; SCIENTIFIC COMMUNICATION; SCIENTIFIC MISCONDUCT; STATISTICAL ANALYSIS; UNIVERSITY;

DATA POSTING; DATA SHARING; DECISION MAKING; FAKE DATA; JUDGMENT; SCIENTIFIC COMMUNICATION;

DATA INTERPRETATION, STATISTICAL; HUMANS; INFORMATION DISSEMINATION; PSYCHOLOGY; PUBLISHING; RESEARCH; SCIENTIFIC MISCONDUCT; UNIVERSITIES;

EID: 84885334592     PISSN: 09567976     EISSN: 14679280     Source Type: Journal    
DOI: 10.1177/0956797613480366     Document Type: Article

References (51)

1. Ayduk O.,Gyurak A.,Luerssen A.Individual differences in the rejection-aggression link in the hot sauce paradigm: The case of rejection sensitivity.Journal of Experimental Social Psychology. 2008;44:775-782.
2. Bargh J. A.,Gollwitzer P. M.,Lee-Chai A.,Barndollar K.,Trotschel R.The automated will: Nonconscious activation and pursuit of behavioral goals.Journal of Personality and Social Psychology. 2001;81:1014-1027.
3. Baumeister R. F.,Bratslavsky E.,Muraven M.,Tice D. M.Ego depletion: Is the active self a limited resource?.Journal of Personality and Social Psychology. 1998;74:1252-1265.
4. Benford F.The law of anomalous numbers.Proceedings of the American Philosophical Society. 1938;78:551-572.
5. Boos D. D.Introduction to the bootstrap world.Statistical Science. 2003;18:168-174.
6. Boos D. D.,Brownie C.Bootstrap methods for testing homogeneity of variances.Technometrics. 1989;31:69-82.
7. Cackowski J. M.,Nasar J. L.The restorative effects of roadside vegetation.Environment and Behavior. 2003;35:736-751.
8. Carlisle J. B.The analysis of 169 randomised controlled trials to test data integrity.Anaesthesia. 2012;67:521-537.
9. De Cremer D.,van Dijk E.Reactions to group success and failure as a function of identification level: A test of the goal-transformation hypothesis in social dilemmas.Journal of Experimental Social Psychology. 2002;38:435-442.
10. de Kwaadsteniet E. W.,van Dijk E.,Wit A.,de Cremer D.Social dilemmas as strong versus weak situations: Social value orientations and tacit coordination under resource size uncertainty.Journal of Experimental Social Psychology. 2006;42:509-516.
11. Efron B.,Tibshirani R. J.An introduction to the bootstrap. Boca Raton, FL: Chapman & Hall; 1994:.
12. Fisher R. A.Has Mendel's work been rediscovered?.Annals of Science. 1936;1:115-137.
13. Frederick S.Overestimating others' willingness to pay.Journal of Consumer Research. 2012;39:1-21.
14. Fudenberg D.,Levine D. K.,Maniadis Z.On the robustness of anchoring effects in WTP and WTA experiments.American Economic Journal: Microeconomics. 2012;4:131-145.
15. Gaffan E.,Gaffan D.Less-than-expected variability in evidence for primacy and Von Restorff effects in rats' nonspatial memory.Journal of Experimental Psychology: Animal Behavior Processes. 1992;18:298-301.
16. Inesi M. E.,Botti S.,Dubois D.,Rucker D. D.,Galinsky A. D.Power and choice: Their dynamic interplay in quenching the thirst for personal control.Psychological Science. 2011;22:1042-1048.
17. Johnson C. S.,Smeesters D.,Wheeler S. C.Retraction of Johnson, Smeesters, and Wheeler (2012).Journal of Personality and Social Psychology. 2012;103:605.
18. Kalai G.,McKay B.,Bar-Hillel M.The two famous rabbis experiments: How similar is too similar (Discussion Paper 182). Jerusalem, Israel: Center for the Study of Rationality; 1998:.
19. Keren G.,Willemsen M. C.Decision anomalies, experimenter assumptions, and participants' comprehension: Revaluating the uncertainty effect.Journal of Behavioral Decision Making. 2009;22:301-317.
20. Kerr N. L.,Rumble A. C.,Park E. S.,Ouwerkerk J. W.,Parks C. D.,Gallucci M.,Van Lange P. A. M."How many bad apples does it take to spoil the whole barrel?": Social exclusion and toleration for bad apples.Journal of Experimental Social Psychology. 2009;45:603-613.
21. Keselman H.,Othman A. R.,Wilcox R. R.,Fradette K.The new and improved two-sample t test.Psychological Science. 2004;15:47-51.
22. Klinesmith J.,Kasser T.,McAndrew F. T.Guns, testosterone, and aggression: An experimental test of a mediational hypothesis.Psychological Science. 2006;17:568-571.
23. Liu J.,Smeesters D.,Trampe D.Effects of messiness on preferences for simplicity.Journal of Consumer Research. 2012;39:199-214.
24. McGregor H. A.,Lieberman J. D.,Greenberg J.,Solomon S.,Arndt J.,Simon L.,Pyszczynski T.Terror management and aggression: Evidence that mortality salience motivates aggression against worldview-threatening others.Journal of Personality and Social Psychology. 1998;74:590-605.
25. Newman G. E.,Mochon D.Why are lotteries valued less? Multiple tests of a direct risk-aversion mechanism.Judgment and Decision Making. 2012;7:19-24.
26. Oppenheimer D.,Meyvis T.,Davidenko N.Instructional manipulation checks: Detecting satisficing to increase statistical power.Journal of Experimental Social Psychology. 2009;45:867-872.
27. Roberts S.Less-than-expected variability in evidence for three stages in memory formation.Behavioral Neuroscience. 1987;101:120-130.
28. Rubin D. B.,Stigler S. M.Dorfman's data analysis.Science. 1979;205:1204-1206.
29. Sanna L. J.,Chang E. C.,Miceli P. M.,Lundberg K. B.Rising up to higher virtues: Experiencing elevated physical height uplifts prosocial actions [Retracted article].Journal of Experimental Social Psychology. 2011;47:472-476.
30. Sanna L. J.,Chang E. C.,Miceli P. M.,Lundberg K. B.Retraction notice to "Rising up to higher virtues: Experiencing elevated physical height uplifts prosocial actions" [Journal of Experimental Social Psychology 47 (2010) 472-476].Journal of Experimental Social Psychology. 2013;49:316.
31. Sanna L. J.,Chang E. C.,Parks C. D.,Kennedy L. A.Construing collective concerns: Increasing cooperation by broadening construals in social dilemmas.Psychological Science. 2009;20:1319-1321.
32. Sanna L. J.,Parks C. D.,Chang E. C.Mixed-motive conflict in social dilemmas: Mood as input to competitive and cooperative goals.Group Dynamics: Theory, Research, and Practice. 2003;7:26-40.
33. Simonsohn U.Direct risk aversion: Evidence from risky prospects valued below their worst outcome.Psychological Science. 2009;20:686-692.
34. Simonson I.,Drolet A.Anchoring effects on consumers' willingness-to-pay and willingness-to-accept.Journal of Consumer Research. 2004;31:681-690.
35. Smeesters D.,Liu J. E.The effect of color (red versus blue) on assimilation versus contrast in prime-to-behavior effects [Retracted article].Journal of Experimental Social Psychology. 2011;47:653-656.
36. Smeesters D.,Liu J. E.Retraction notice to "The effect of color (red versus blue) on assimilation versus contrast in prime-to-behavior effects" [Journal of Experimental Social Psychology 47 (2011) 653-656].Journal of Experimental Social Psychology. 2013;49:315.
37. Smeesters D.,Wheeler S. C.,Kay A. C.The role of interpersonal perceptions in the prime-to-behavior pathway.Journal of Personality and Social Psychology. 2009;96:395-414.
38. SternbergS.RobertsS. (2006). Nutritional supplements and infection in the elderly: Why do the findings conflict?Nutrition Journal, 5(1), 30. Retrieved from http://www.nutritionj.com/content/5/1/30.
39. Tice D. M.,Bratslavsky E.,Baumeister R. F.Emotional distress regulation takes precedence over impulse control: If you feel bad, do it!.Journal of Personality and Social Psychology. 2001;80:53-67.
40. Tversky A.,Kahneman D.Belief in the law of small numbers.Psychological Bulletin. 1971;76:105-110.
41. Van Vugt M.,De Cremer D.,Janssen D. P.Gender differences in cooperation and competition.Psychological Science. 2007;18:19-23.
42. Vohs K. D.,Heatherton T. F.Self-regulatory failure: A resource-depletion approach.Psychological Science. 2000;11:249-254.
43. Warburton W. A.,Williams K. D.,Cairns D. R.When ostracism leads to aggression: The moderating effects of control deprivation.Journal of Experimental Social Psychology. 2006;42:213-220.
44. Webb T. L.,Sheeran P.Can implementation intentions help to overcome ego-depletion?.Journal of Experimental Social Psychology. 2003;39:279-286.
45. Wicherts J. M.Psychology must learn a lesson from fraud case.Nature. 2011;480:7.
46. Wicherts J. M.,Bakker M.Publish (your data) or (let the data) perish! Why not publish your data too?.Intelligence. 2012;40:73-76.
47. Wicherts J. M.,Borsboom D.,Kats J.,Molenaar D.The poor availability of psychological research data for reanalysis.American Psychologist. 2006;61:726-728.
48. YangY.VosgerauJ.LoewensteinG. F. (2012). The influence of framing on willingness to pay as an explanation of the uncertainty effects. Unpublished manuscript, Carnegie Mellon University.
49. Yuen K. K.The two-sample trimmed t for unequal population variances.Biometrika. 1974;61:165-170.
50. Yule G. U.An introduction to the theory of statistics. London, England: Charles Griffen; 1922:.
51. ZwaanR. A.GroenenP. J. F.van der HeijdenA. J.te LindertR. (2012). Report by the Committee for Inquiry into Scientific Integrity. Retrieved from http://www.eur.nl/fileadmin/ASSETS/press/2012/Juli/report_Committee_for_inquiry_prof._Smeesters.publicversion.28_6_2012.pdf.