Replication initiatives will not salvage the trustworthiness of psychology

BMC Psychology

Volumn 4, Issue 1, 2016, Pages

  Coyne, James C ^a  

^a UNIVERSITY MEDICAL CENTER GRONINGEN   (Netherlands)

Author keywords

P hacking; Publication bias; Randomized controlled trials; Reproducibility

Indexed keywords

HUMAN; METHODOLOGY; PEER REVIEW; PSYCHOLOGY; REPRODUCIBILITY;

HUMANS; PEER REVIEW, RESEARCH; PSYCHOLOGY; REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN;

EID: 85008498783     PISSN: None     EISSN: 20507283     Source Type: Journal    
DOI: 10.1186/s40359-016-0134-3     Document Type: Article

References (59)

1. Brembs B. Predatory practices. Bjoem. Brembs. Blog. September 23, 2015. http:// bjoern.brembs.net/2015/10/predatory-priorities/ Accessed 08 Apr 2016.
2. Gilbert D, King G, Pettigrew S, Wilson T. Comment on 'Estimating the reproducibility of psychological science. Science. 2016;351(6277):1037a-b.
3. Anderson CJ, Bahník Š, Barnett-Cowan M, Bosco FA, Chandler J, Chartier CR, Cheung F, Christopherson CD, Cordes A, Cremata EJ, Della Penna N, Estel V, Fedor A, Fitneva SA, Frank MC, Grange JA, Hartshorne JK, Hasselman F, Henninger F, van der Hulst M, Jonas KJ, Lai CK, Levitan CA, Miller JK, Moore KS, Meixner JM, Munafò MR, Neijenhuijs KI, Nilsonne G, Nosek BA, Plessow F, Prenoveau JM, Ricker AA, Schmidt K, Spies JR, Stieger S, Strohminger N, Sullivan GB, van Aert RC, van Assen MA, Vanpaemel W, Vianello M, Voracek M, Zuni K. Response to comment on "estimating the reproducibility of psychological science". Science. 2016;351(6277):1037.
4. Open Science Collaboration. Estimating the reproducibility of psychological science. Science. 2015;349(6251):aac4716.
5. Gelman A. Replication crisis crisis: Why I continue in my "pessimistic conclusions about reproducibility. " Statistical Modeling, Causal Inference, and Social Science. 2016. http://andrewgelman.com/2016/03/05/29195/.
6. Herbert, W. Life is one big priming experiment. 2011. http://www. psychologicalscience.org/index.php/news/were-only-human/life-israndom-get-a-plan.html Accessed 08 Apr 2016.
7. Oettingen G. Rethinking positive thinking: inside the new science of motivation. NY: Current; 2014.
8. Coyne JC. Do positive fantasies prevent dieters from losing weight?. Mind the Brain. 2015. http://blogs.plos.org/mindthebrain/2015/09/16/do-positivefantasies-prevent-dieters-from-losing-weight/ Accessed 08 Apr 8 2016.
9. Finkel EJ, Eastwick PW, Reis HT. Best research practices in psychology: Illustrating epistemological and pragmatic considerations with the case of relationship science. J Pers Soc Psychol. 2015;108(2):275.
10. Reuell P. Study that undercut psych research got it wrong. Harvard Gazette. 2016. http://news.harvard.edu/gazette/story/2016/03/study-that-undercutpsych-research-got-it-wrong/ Accessed 08 Apr 2016.
11. Peterson D. The baby factory difficult research objects, disciplinary standards, and the production of statistical significance. Socius: Sociological Research for a Dynamic World. 2016;2:2378023115625071.
12. Frank M. The ManyBabies Project. Babies Learning Languages. 2015. http:// babieslearninglanguage.blogspot.com/2015/12/the-manybabies-project.html.
13. Coyne JC, Kok RN. Salvaging psychotherapy research: a manifesto. J Evidence-Based Psychotherapies. 2014;14(2):105-24.
14. Coyne JC, Thombs BD, Hagedoorn M. Ain't necessarily so: review and critique of recent meta-analyses of behavioral medicine interventions in health psychology. Health Psychol. 2010;29(2):107-16. doi:10.1037/a0017633.
15. Cristea IA, Kafesciogly N, Coyne JC. The worrisome state of research concerning couples interventions for cancer patients: A systematic review. Psychol Health. 2013;28 Suppl 1:2-335. doi:10.1080/08870446.2013.810851.
16. Coyne JC. Re: meta-analysis of efficacy of interventions elevated depressive symptoms in adults diagnosed with cancer. J Natl Cancer Inst. 2012;104(22):1770. djs408.
17. Luborsky L, Diguer L, Seligman DA, Rosenthal R, Krause ED, Johnson S, Schweizer E. The Researcher's Own therapy allegiances: a "wild card" in comparisons of treatment efficacy. Clin Psychol Sci Pract. 2006;6(1):95-106. doi:10.1093/clipsy.6.1.95.
18. Dragioti E, Dimoliatis I, Evangelou E. EPA-0834-documentation of therapeutic investigator allegiance in meta-analyses of randomised controlled trials. Eur Psychiatry. 2014;29:1. doi:10.1016/S0924-9338(14)78172-6.
19. Nezu AM, Nezu CM, Felgoise SH, McClure KS, Houts PS. Project genesis: assessing the efficacy of problem-solving therapy for distressed adult cancer patients. J Consult Clin Psychol. 2003;71(6):1036.
20. Hart SL, Hoyt MA, Diefenbach M, Anderson DR, Kilbourn KM, Craft LL, et al. Meta-analysis of efficacy of interventions for elevated depressive symptoms in adults diagnosed with cancer. J Natl Cancer Inst. 2012.
21. Meijer A, Roseman M, Delisle VC, Milette K, Levis B, Syamchandra A, Stefanek ME, Stewart DE, de Jonge P, Coyne JC, Thombs BD. Effects of screening for psychological distress on patient outcomes in cancer: a systematic review. J Psychosom Res. 2013;75(1):1-7.
22. Coyne JC, Kwakkenbos L. Triple P-positive parenting programs: the folly of basing social policy on underpowered flawed studies. BMC Med. 2013;11(1):11. doi:10.1186/1741-7015-11-11.
23. Leon AC, Davis LL, Kraemer HC. The role and interpretation of pilot studies in clinical research. J Psychiatr Res. 2011;45(5):626-9.
24. Burgoine T, Forouhi NG, Griffin SJ, Wareham NJ, Monsivais P. Associations between exposure to takeaway food outlets, takeaway food consumption, and body weight in Cambridgeshire, UK: population based, cross sectional study. BMJ. 2014;13:348.
25. Burgoine T, Alvanides S, Lake AA. Creating'obesogenic realities'; do our methodological choices make a difference when measuring the food environment. Int J Health Geogr. 2013;12(1):33.
26. Coyne JC. Negative emotion and health: why do we keep stalking bears, when we only find scat? European Health Psychologist. 2014;16(S):429.
27. Coyne JC, de Voogd JN. Are we witnessing the decline effect in the type D personality literature? What can be learned? J Psychosom Res. 2012;73(6):401-7.
28. Smith TW. Toward a more systematic, cumulative, and applicable science of personality and health: lessons from Type D personality. Psychosom Med. 2011;73(7):528-32.
29. Meehl PE. Why summaries of research on psychological theories are often uninterpretable. Psychol Rep. 1990;66(1):195-244.
30. Ketterer MW, Denollet J, Goldberg AD, McCullough PA, John S, Farha AJ, Clark V, Keteyian S, Chapp J, Thayer B, Deveshwar S. The big mush: psychometric measures are confounded and non-independent in their association with age at initial diagnosis of Ischaemic Coronary Heart Disease. Eur J Cardiovascular Risk. 2002;9(1):41-8.
31. Austin PC, Mamdani MM, Juurlink DN, Hux JE. Testing multiple statistical hypotheses resulted in spurious associations: a study of astrological signs and health. J Clin Epidemiol. 2006;59(9):964-9.
32. Gelman A. The problems with p-values are not just with p-values: My comments on the recent ASA statement. Statistical Modeling, Causal Inference, and Social Science. 2016. http://andrewgelman.com/2016/03/07/ 29212/ Accessed 08 Apr 2016.
33. Wasserstein RL, Lazar NA. The ASA's statement on p-values: context, process, and purpose. Am Stat. 2016.
34. De Groot AD. The meaning of "significance" for different types of research [translated and annotated by Eric-Jan Wagenmakers, Denny Borsboom, Josine Verhagen, Rogier Kievit, Marjan Bakker, Angelique Cramer, Dora Matzke, Don Mellenbergh, and Han LJ van der Maas]. Acta Psychol (Amst). 2014;148:188-94.
35. Kahneman D. A new etiquette for replication. Scribd. https://www.scribd. com/doc/225285909/Kahneman-Commentary. Accessed 08 Apr 2016.
36. Ioannidis JP. Scientific inbreeding and same-team replication: type D personality as an example. J Psychosom Res. 2012;73(6):408-10. doi:10.1016/j. jpsychores. 2012.09.014.
37. Berkowitz L, Donnerstein E. External validity is more than skin deep: Some answers to criticisms of laboratory experiments. Am Psychol. 1982;37(3):245.
38. Stapel D. Faking science: A true story of academic fraud (N. J. L. Brown, Trans.). Originally published in Dutch as Ontsporing. 2012. Retrieved from http://nick.brown.free.fr/stapel/ Accessed 08 Apr 2016.
39. Martens A, Kosloff S, Greenberg J, Landau MJ, Schmader T. Killing begets killing: evidence from a bug-killing paradigm that initial killing fuels subsequent killing. Pers Soc Psychol Bull. 2007;12.
40. Kappes HB, Oettingen G. Positive fantasies about idealized futures sap energy. J Exp Soc Psychol. 2011;47(4):719-29.
41. Kail RV. Reflections on five years as editor. Observer. 2012; 25 (9).
42. Simmons JP, Nelson LD, Simonsohn U. False-positive psychology undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychol Sci. 2011;1:0956797611417632.
43. Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMC Med. 2010;8(1):18.
44. Coyne JC, Cook JM, Palmer SC, Rusiewicz A. Clarification of clinical trial standards. APA Monitor on Psychology. 2004;35(11):4-8.
45. Coyne JC, van Linschoten HS. Cognitive therapy for patients with schizophrenia. Lancet. 2014;384(9941):400. doi:10.1016/S0140-6736(14)61273-3.
46. Goldacre B. Make journals report clinical trials properly. Nature. 2016;530(7588):7.
47. Wicherts JM, Bakker M, Molenaar D. Willingness to share research data is related to the strength of the evidence and the quality of reporting of statistical results. PLoS One. 2011;6(11):e26828.
48. Kok BE, Coffey KA, Cohn MA, Catalino LI, Vacharkulksemsuk T, Algoe SB, Brantley M, Fredrickson BL. How positive emotions build physical health perceived positive social connections account for the upward spiral between positive emotions and vagal tone. Psychol Sci. 2013;24(7):1123-32.
49. Heathers JA, Brown NJ, Coyne JC, Friedman HL. The elusory upward spiral a reanalysis of Kok et al. (2013). Psychol Sci. 2015;29:0956797615572908.
50. Kok BE, Fredrickson BL. Evidence for the upward spiral stands steady a response to heathers, brown, Coyne, and Friedman (2015). Psychol Sci. 2015;26(7):1144-6.
51. Coyne JC. Highly correlated hedonic and eudaimonic well-being thwart genomic analysis. Proc Natl Acad Sci. 2013;66(6):868-75.
52. Fredrickson BL, Grewen KM, Coffey KA, Algoe SB, Firestine AM, Arevalo JM, Ma J, Cole SW. A functional genomic perspective on human well-being. Proc Natl Acad Sci. 2013;110(33):13684-9.
53. Brown NJ, MacDonald DA, Samanta MP, Friedman HL, Coyne JC. A critical reanalysis of the relationship between genomics and well-being. Proc Natl Acad Sci. 2014;111(35):12705-9.
54. Cole SW, Fredrickson BL. Errors in the Brown et al. critical reanalysis. Proc Natl Acad Sci. 2014;111(35):E3581.
55. Fredrickson BL, Grewen KM, Algoe SB, Firestine AM, Arevalo JM, Ma J, Cole SW. Psychological well-being and the human conserved transcriptional response to adversity. PLoS One. 2015;10(3):e0121839.
56. White PD, Goldsmith KA, Johnson AL, Potts L, Walwyn R, DeCesare JC, Baber HL, Burgess M, Clark LV, Cox DL, Bavinton J. Comparison of adaptive pacing therapy, cognitive behaviour therapy, graded exercise therapy, and specialist medical care for chronic fatigue syndrome (PACE): a randomised trial. Lancet. 2011;377(9768):823-36.
57. Coyne JC, Laws KR. Results of the PACE follow-up study are uninterpretable. Lancet Psychiatry. 2016;3(2):e6-7.
58. Sharpe M, Goldsmith KA, Johnson AL, Chalder T, White PD. Author's reply. Lancet Psychiatry. 2016;3(2):e7.
59. McCrone P, Sharpe M, Chalder T, Knapp M, Johnson AL, et al. Adaptive pacing, cognitive behaviour therapy, graded exercise, and specialist medical care for chronic fatigue syndrome: a cost-effectiveness analysis. PLoS One. 2012;7(8):e40808. doi:10.1371/journal. pone.0040808.