Enhancing transparency of the research process to increase accuracy of findings: A guide for relationship researchers

Personal Relationships

Volumn 21, Issue 4, 2014, Pages 531-545

  Campbell, Lorne ^a   Loving, Timothy J ^b   Lebel, Etienne P ^c  

^a UNIVERSITY OF WESTERN ONTARIO   (Canada)

^b UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^c MONTCLAIR STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84916884038     PISSN: 13504126     EISSN: 14756811     Source Type: Journal    
DOI: 10.1111/pere.12053     Document Type: Review

References (59)

1. Adam, T., Agafonova, N., Aleksandrov, A., Altinok, O., Alvarez Sanchez, P., Anokhina, A. . . . Zghiche, A. (2011). Measurement of the neutrino velocity with the OPERA detector in the CNGS beam. Retrieved from http://arxiv.org/abs/1109.4897
2. Bakker, M., van Dijk, A., & Wicherts, J. M. (2012). The rules of the game called psychological science. Perspectives on Psychological Science, 7, 543-554.
3. Birnbaum, G. E., Reis, H. T., Mikulincer, M., Gillath, O., & Orpaz, A. (2006). When is sex more than just sex: Attachment orientations, sexual experience, and relationship quality. Journal of Personality and Social Psychology, 91, 929-943.
4. Bolger, N., Davis, A., & Rafaeli, E. (2003). Diary methods: Capturing life as it is lived. Annual Review of Psychology, 54, 579-616.
5. Brewer, M. G. (2000). Validity issues and research design. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social and personality psychology (pp. 3-16). Cambridge, England: Cambridge University Press.
6. Brumfiel, G. (2012). Neutrinos not faster than light. Nature News. Retrieved from http://www.nature.com/news/neutrinos-not-faster-than-light-1.10249 doi:10.1038/nature.2012.10249
7. Burnham, B. (2014, February 5). Open data and IRBs [Blog post]. Retrieved from http://osc.centerforopenscience.org/2014/02/05/open-data-and-IRBs
8. Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafo, M. R. (2013). Power failure: Why small sample size undermines the reliability of neuroscience. Nature Reviews Neuroscience, 14, 365-376.
9. Campbell, L., Simpson, J. A., Boldry, J. G., & Kashy, D. (2005). Perceptions of conflict and support in romantic relationships: The role of attachment anxiety. Journal of Personality and Social Psychology, 88, 510-531.
10. Campbell, L., Simpson, J. A., Kashy, D. A., & Fletcher, G. J. O. (2001). Ideal standards, the self, and flexibility of ideals in close relationships. Personality and Social Psychology Bulletin, 27, 447-462.
11. Casey, K., Glennerster, R., & Miguel, E. (2012). Reshaping institutions: Evidence on aid impacts using a preanalysis plan. Quarterly Journal of Economics, 127, 1755-1812.
12. Cohen, J. (1962). The statistical power of abnormal-social psychological research: A review. Journal of Abnormal and Social Psychology, 65, 145-153.
13. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
14. Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155-159.
15. Cumming, G. (2014). The new statistics: Why and how. Psychological Science, 25, 7-29.
16. Donnellan, M. B., Roisman, G. L., Fraley, R. C., & Lucas, R. E. (2013, Summer). Methodological reform 101 for developmental researchers. Developmental Psychologist Division 7 Newsletter, 34-40.
17. Eich, E. (2014). Business not as usual. Psychological Science, 25, 3-6.
18. Fanelli, D. (2010). "Positive" results increase down the hierarchy of Science. PLoS ONE, 5(4), e10068. doi:10.1371/journal.pone.0010068
19. Feynman, R. P. (1986). Surely you're joking. Mr. Feynman!. New York, NY: Bantam Books.
20. Funder, D. C., Levine, J. M., Mackie, D. M., Morf, C. C., Vazire, S., & West, S. G. (2014). Improving the dependability of research in personality and social psychology: Recommendations for research and educational practice. Personality and Social Psychology Review, 18, 3-12.
21. Giner-Sorolla, R. (2012). Science or art? How aesthetic standards grease the way through the publication bottleneck but undermine science. Perspectives on Psychological Science, 7, 562-571.
22. Hanson, R. (1958). Evidence and procedural characteristics of "reliable" propositions in social science. American Journal of Sociology, 63, 357-370.
23. Huston, T. L., Caughlin, J. P., Houts, R. M., Smith, S. E., & George, L. J. (2001). The connubial crucible: Newlywed years as predictors of marital delight, distress, and divorce. Journal of Personality and Social Psychology, 80, 237-252.
24. Ioannidis, J. P. A. (2005). Why most published research findings are false. PLoS Medicine, 2, e124.
25. Ioannidis, J. P., Munafo, M. R., Fusar-Poli, P., Nosek, B. A., & David, S. P. (2014). Publication and other reporting biases in cognitive sciences: Detection, prevalence, and prevention. Trends in Cognitive Science, 18, 235-241.
26. Journal of Experimental Social Psychology. (2014). JESP editorial guidelines. Retrieved from http://www.journals.elsevier.com/journal-of-experimental-social-psychology/news/jesp-editorial-guidelines
27. Karremans, J. C., Dotsch, R., & Corneille, O. (2011). Romantic relationship status biases memory of faces of attractive opposite-sex others: Evidence from a reverse-correlation paradigm. Cognition, 121, 422-426.
28. Kashy, D. A., Donnellan, M. B., Ackerman, R. A., & Russell, D. W. (2009). Reporting and interpreting research in PSPB: Practices, principles, and pragmatics. Personality and Social Psychology Bulletin, 35, 1131-1142.
29. Kerr, N. L. (1998). HARKing: Hypothesizing after results are known. Personality and Social Psychology Review, 2, 196-217.
30. LeBel, E. P. (2014, April 15). A simpler and more intuitive publication bias index? [Blog post]. Retrieved from http://proveyourselfwrong.wordpress.com/2014/04/15/a-simpler-publication-bias-index
31. LeBel, E. P., Borsboom, D., Giner-Sorolla, R., Hasselman, F., Peters, K. R., Ratliff, K. A., & Tucker Smith, C. (2013). PsychDisclosure.org: Grassroots support for reforming reporting standards in psychology. Perspectives on Psychological Science, 8, 424-432.
32. LeBel, E. P., & Campbell, L. (2013). Heightened sensitivity to temperature cues in highly anxiously attached individuals: Real or elusive phenomenon? Psychological Science, 24, 2128-2120.
33. LeBel, E. P., & Peters, K. R. (2011). Fearing the future of empirical psychology: Bem's (2011) evidence of psi as a case study of deficiencies in modal research practice. Review of General Psychology, 15, 371-379.
34. LeBel, E. P., & Wilbur, C. J. (2014). Big secrets do not necessarily cause hills to appear steeper. Psychonomic Bulletin & Review, 21, 696-700.
35. Lykken, D. T. (1991). What's wrong with psychology anyway? In D. Cicchetti & W. M. Grove (Eds.), Thinking clearly about psychology: Vol. 1. Matters of public interest (pp. 3-39). Minneapolis: University of Minnesota Press.
36. Makel, M. C., Plucker, J. A., & Hegarty, B. (2012). Replications in psychology research: How often do they really occur? Perspectives on Psychological Science, 7, 537-542.
37. Maner, J. K. (2014). Let's put our money where our mouth is: If authors are to change their ways, reviewers (and editors) must change with them. Psychological Science, 9, 343-351.
38. Meehl, P. E. (1967). Theory-testing in psychology and physics: A methodological paradox. Philosophy of Science, 34, 103-115.
39. Meehl, P. E. (1990). Why summaries of research on psychological theories are often uninterpretable. Psychological Reports, 66, 195-244.
40. Miguel, E., Camerer, C., Casey, K., Cohen, J., Esterling, K. M., Gerber, A. ... Van der Laan, M. (2014). Promoting transparency in social science research. Science, 343(6166), 30-31.
41. Murray, S. L., Holmes, J. G., & Griffin, D. W. (1996). The benefits of positive illusions: Idealization and the construction of satisfaction in close relationships. Journal of Personality and Social Psychology Bulletin, 70, 79-98.
42. Murray, S. L., Holmes, J. G., MacDonald, G., & Ellsworth, P. (1998). Through the looking glass darkly? When self-doubt turns into relationship insecurities. Journal of Personality and Social Psychology, 75, 1459-1480.
43. Neuliep, J. W., & Crandall, R. (1990). Editorial bias against replication research. Journal of Social Behavior and Personality, 5, 85-90.
44. Neuliep, J. W., & Crandall, R. (1993). Reviewer bias against replication research. Journal of Social Behavior and Personality, 8, 21-29.
45. Nosek, B. A., Spies, J. R., & Motyl, M. (2012). Scientific utopia II: Restructuring incentives and practices to promote truth over publishability. Perspectives on Psychological Science, 7, 615-631.
46. O'Boyle, E. H., Jr., Banks, G. C., & Gonzalez-Mule, E. (2014). The Chrysalis effect: How ugly initial results metamorphosize into beautiful articles. Journal of Management. Advance online publication. doi:10.1177/0149206314527133
47. Rossi, J. S. (1990). Statistical power of psychological research: What have we gained in 20 years. Journal of Consulting and Clinical Psychology, 58, 646-656.
48. Schimmack, U. (2012). The ironic effect of significant results on the credibility of multiple-study articles. Psychological Methods, 17, 551-566.
49. Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359-1366.
50. Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2012). A 21 word solution. Available at SSRN: http://ssrn.com/abstract=2160588 or http://dx.doi.org/10.2139/ssrn.2160588
51. Simonsohn, U. (2014). Go big or go home: A practical alternative to impractical power analysis. Presented at the annual conference of the Society of Personality and Social Psychology, Austin, TX.
52. Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2013). P-curve: A key to the file drawer. Journal of Experimental Psychology: General, 143, 534-547.
53. Simpson, J. A., Collins, W. A., Tran, S., & Haydon, K. D. (2007). Attachment and the experience and expression of emotions in adult romantic relationships: A development perspective. Journal of Personality and Social Psychology, 92, 355-367.
54. Slotter, E. B., & Luchies, L. B. (2014). Relationship quality promotes the desire for closeness among distressed avoidantly attached individuals. Personal Relationships, 21, 22-34.
55. Smith, A., Loving, T. J., Crockett, E. E., & Campbell, L. (2009). What's closeness got to do with it? Men's and women's cortisol responses when providing and receiving support. Psychosomatic Medicine, 71, 843-851.
56. Sterling, T. D. (1959). Publication decisions and their possible effects on inferences drawn from tests of significance-Or vice versa. Journal of the American Statistical Association, 54, 30-34.
57. Sterling, T. D., Rosebaum, W. L., & Weinkam, J. J. (1995). Publication decisions revisited: The effect of the outcome of statistical tests on the decision to publish and vice versa. The American Statistician, 49, 108-112.
58. Van 't Veer, A. E., Stel, M., van Beest, I., & Gallucci, M. (2014). Registered report: Measuring unconscious deception detection by skin temperature. Frontiers in Psychology, 5, 442. doi:10.3389/fpsyg.2014.00442
59. Wagenmakers, E. J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A. (2012). An agenda for purely confirmatory research. Perspectives on Psychological Science, 7, 632-638.