Life After NHST: How to Describe Your Data Without “p-ing” Everywhere

Basic and Applied Social Psychology

Volumn 37, Issue 5, 2015, Pages 260-273

  Valentine, Jeffrey C ^a   Aloe, Ariel M ^b   Lau, Timothy S ^a  

^a UNIVERSITY OF LOUISVILLE   (United States)

^b UNIVERSITY OF IOWA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84942991092     PISSN: 01973533     EISSN: None     Source Type: Journal    
DOI: 10.1080/01973533.2015.1060240     Document Type: Article

References (43)

1. R.P.Abelson, (1997). On the surprising longevity of flogged horses: Why there is a case for the significance test. Psychological Science, 8, 12–15. doi:10.1111/j.1467-9280.1997.tb00536.x
2. ACT. (2014). ACT profile report–national. Graduating class 2014. Retrieved from http://www.act.org/newsroom/data/2014/pdf/profile/National2014.pdf
3. J.Baron, (1997). Confusion of relative and absolute risk in valuation. Journal of Risk and Uncertainty, 14, 301–309.
4. S.Bolkan, & P.A.Andersen, (2009). Image induction and social influence: Explication and initial tests. Basic and Applied Social Psychology, 31, 317–324. doi:10.1080/01973530903316898
5. R.Boruch, (2007). The null hypothesis is not called that for nothing: Statistical tests in randomized trials. Journal of Experimental Criminology, 3, 1–20. doi:10.1007/s11292-007-9026-0
6. J.Cohen, (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
7. J.Cohen, (1994). The earth is round (p <.05). American Psychologist, 49, 997–1003. doi:10.1037/0003-066x.49.12.997
8. College Board. (2012). 2012 college bound seniors: Total group report. Retrieved from http://media.collegeboard.com/digitalServices/pdf/research/TotalGroup-2012.pdf
9. H.Cooper, (2007). Evaluating and interpreting research syntheses in adult learning and literacy. Boston, MA: National Center for the Study of Adult Learning and Literacy, World Education Inc. Retrieved from http://www.ncsall.net/fileadmin/resources/research/op_research_syntheses.pdf
10. J.Covey, (2007). A meta-analysis of the effects of presenting treatment benefits in different formats. Medical Decision Making, 27, 638–654. doi:10.1177/0272989x07306783
11. G.Cumming, (2008). Replication and p intervals: p values predict the future only vaguely, but confidence intervals do much better. Perspectives on Psychological Science, 3, 286–300. doi:10.1111/j.1745-6924.2008.00079.x
12. G.Cumming, (2014). The new statistics: Why and how. Psychological Science, 25, 7–29. doi:10.1177/0956797613504966
13. A.Fagerlin,, C.Wang, & P.A.Ubel, (2005). Reducing the influence of anecdotal reasoning on people's health care decisions: Is a picture worth a thousand statistics? Medical Decision Making, 25, 398–405. doi:10.1177/0272989x05278931
14. F.Fidler,, N.Thomason,, G.Cumming,, S.Finch, & J.Leeman, (2004). Editors can lead researchers to confidence intervals, but can't make them think statistical reform lessons from medicine. Psychological Science, 15, 119–126. doi:10.1111/j.0963-7214.2004.01502008.x
15. J.L.Fleiss, (1986). Significance tests have a role in epidemiologic research: Reactions to A. M. Walker. American Journal of Public Health, 76, 559–560. doi:10.2105/ajph.76.5.559
16. A.Gelman, & H.Stern, (2006). The difference between “significant” and “not significant” is itself not statistically significant. The American Statistician, 60, 328–331. doi:10.1198/000313006x152649
17. G.Gigerenzer, & A.Edwards, (2003). Simple tools for understanding risks: From innumeracy to insight. British Medical Journal, 327, 741–744. doi:10.1136/bmj.327.7417.741
18. J.W.Grice, (2011). Observation oriented modeling: Analysis of cause in the behavioral sciences. London, UK: Academic Press.
19. P.C.Gøtzsche, (2006). Believability of relative risks and odds ratios in abstracts: cross sectional study. British Medical Journal, 333, 231–234. doi:10.1136/bmj.38895.410451.79
20. R.L.Hagen, (1997). In praise of the null hypothesis statistical test. American Psychologist, 52, 15–24. doi:10.1037//0003-066x.52.1.15
21. E.K.Harris, (1993). On P values and confidence intervals (why can't we P with more confidence?). Clinical Chemistry, 39, 927–928.
22. J.P.A.Ioannidis, (2005). Why most published research findings are false. PLoS medicine, 2(8), e124. doi:10.1371/journal.pmed.0020124
23. E.Kifer, (2001, May). Why research on science and mathematics education in rural schools is important or the mean is the wrong message. Paper presented at the Understanding Achievement in Science and Mathematics in Rural Schools conference, Lexington, KY. ED 467 509
24. J.M.Lang,, K.J.Rothman, & C.I.Cann, (1998). That confounded P-value. Epidemiology, 9, 7–8.
25. M.W.Lipsey, & D.B.Wilson, (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
26. H.I.M.Mahler,, S.E.Beckerley, & M.T.Vogel, (2010). Effects of media images on attitudes toward tanning. Basic and Applied Social Psychology, 32, 118–127. doi:10.1080/01973531003738296
27. K.O.McGraw, & S.P.Wong, (1992). A common language effect size statistic. Psychological Bulletin, 111(2), 361.
28. W.Mischel, & Y.Shoda, (1995). A cognitive-affective system theory of personality: Reconceptualizing situations, dispositions, dynamics, and invariance in personality structure. Psychological Review, 102, 246–268. doi:10.1037/0033-295x.102.2.246
29. J.C.Nunnally, & I.H.Bernstein, (1994). Psychometric theory (3rd ed.). New York, NY: McGraw-Hill.
30. T.D.Pigott,, J.C.Valentine,, J.R.Polanin,, R.T.Williams, & D.D.Canada, (2013). Outcome-reporting bias in education research. Educational Researcher, 42, 424–432. doi:10.3102/0013189x13507104
31. R.Rosenthal, & D.B.Rubin, (1979). A note on percent variance explained as a measure of the importance of effects. Journal of Applied Social Psychology, 9, 395–396. doi:10.1111/j.1559-1816.1979.tb02713.x
32. R.L.Rosnow, & R.Rosenthal, (1989). Statistical procedures and the justification of knowledge in psychological science. American Psychologist, 44, 1276–1284. doi:10.1037/0003-066x.44.10.1276
33. H.R.Rothstein,, A.J.Sutton, & M.R.Borenstein, (2005). Publication bias in meta-analysis: Prevention, assessment and adjustments. West Sussex, England: Wiley & Sons.
34. F.L.Schmidt, & J.E.Hunter, (1997). Eight common but false objections to the discontinuation of significance testing in the analysis of research data. In L.H.Harlow S.A.Mulaik & J.H.Steiger (Eds.), What if there were no significance tests? (pp. 37–64). Mahwah, NJ: Erlbaum.
35. U.Simonsohn,, L.D.Nelson, & J.P.Simmons, (2014). P-curve: A key to the file-drawer. Journal of Experimental Psychology: General, 143, 534–547. doi:10.1037/a0033242
36. D.Trafimow, (2003). Hypothesis testing and theory evaluation at the boundaries: Surprising insights from Bayes's theorem. Psychological Review, 110, 526–535. doi:10.1037/0033-295x.110.3.526
37. D.Trafimow, (2014). On teaching about the coefficient of variation in introductory statistics courses. Teaching Statistics, 36, 81–82. doi:10.1111/test.12042
38. 2 as an effect size statistic: Dichotomous variables. Frontiers in Psychology, 6, Article 294. doi:10.3389/fpsyg.2015.00294
39. D.Trafimow, & M.Marks, (2015). Editorial. Basic and Applied Social Psychology, 37, 1–2.
40. J.W.Tukey, (1962). The future of data analysis. The Annals of Mathematical Statistics, 33, 1–67.
41. J.W.Tukey, (1977). Exploratory data analysis. Reading, MA: Addison-Wesley.
42. A.Tversky, & D.Kahneman, (1971). Belief in the law of small numbers. Psychological Bulletin, 76, 105–110. doi:10.1037/h0031322
43. S.S.Vedula,, L.Bero,, R.W.Scherer, & K.Dickersin, (2009). Outcome reporting in industry-sponsored trials of gabapentin for off-label use. The New England Journal of Medicine, 361, 1963–1971. doi:10.1056/NEJMsa0906126