Four Requirements for an Acceptable Research Program

Basic and Applied Social Psychology

Volumn 38, Issue 6, 2016, Pages 308-312

  Marsman, Maarten ^a   Ly, Alexander ^a   Wagenmakers, Eric Jan ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84991721675     PISSN: 01973533     EISSN: None     Source Type: Journal    
DOI: 10.1080/01973533.2016.1221349     Document Type: Note

References (45)

1. J.Aitchison, & I.R.Dunsmore, (1975). Statistical prediction analysis. Cambridge, UK:Cambridge University Press.
2. T.X.Barber, (1976). Pitfalls in human research:Ten pivotal points. New York, NY:Pergamon Press Inc.
3. M.J.Bayarri, D.J.Benjamin, J.O.Berger, & T.M.Sellke, (2016). Rejection odds and rejection ratios:A proposal for statistical practice in testing hypotheses. Journal of Mathematical Psychology, 72, 90–103.
4. J.O.Berger, & M.Delampady, (1987). Testing precise hypotheses. Statistical Science, 2, 317–352.
5. J.O.Berger, & R.L.Wolpert, (1988). The likelihood principle (2nd ed.). Hayward, CA:Institute of Mathematical Statistics.
6. P.J.Bickel, & B.J.K.Kleijn, (2012). The semiparametric Bernstein–von Mises theorem. The Annals of Statistics, 40, 206–237.
7. C.D.Chambers, (2013). Register reports:A new publishing initiative at Cortex. Cortex, 49, 609–610.
8. W.Edwards, (1965). Tactical note on the relation between scientific and statistical hypotheses. Psychological Bulletin, 63, 400–402.
9. W.Edwards, H.Lindman, & L.J.Savage, (1963). Bayesian statistical inference for psychological research. Psychological Review, 70, 193–242.
10. R.Feynman, (1998). The meaning of it all:Thoughts of a citizen–scientist. Reading, MA:Perseus Books.
11. B.Goldacre, (2009). Bad science. London, UK:Fourth Estate.
12. JASP Team, T. (2016). JASP (Version 0.7.5.6)[Computer software].
13. V.E.Johnson, (2013). Revised standards for statistical evidence. Proceedings of the National Academy of Sciences of the United States of America, 110, 19313–19317.
14. M.C.Kidwell, L.B.Lazarević, E.Baranski, T.E.Hardwicke, S.Piechowski, L.S.Falkenberg, & B.A.Nosek, (2016). Badges to acknowledge open practices:A simple, low cost, effective method for increasing transparency. PLoS Biology, 14, e1002456.
15. B.Kleijn, & A.van der Vaart, (2012). The bernstein-von-mises theorem under misspecification. Electronic Journal of Statistics, 6, 354–381.
16. D.V.Lindley, (1985). Making Decisions (2nd ed.). London, UK:Wiley.
17. C.C.Liu, & M.Aitkin, (2008). Bayes factors:Prior sensitivity and model generalizability. Journal of Mathematical Psychology, 52, 362–375.
18. A.Ly, A.Etz, & E.J.Wagenmakers, (2015). Replication Bayes factors. Manuscript in preparation.
19. A.Ly, A.J.Verhagen, & E.J.Wagenmakers, (2016a). An evaluation of alternative methods for testing hypotheses, from the perspective of Harold Jeffreys. Journal of Mathematical Psychology, 72, 43–55.
20. A.Ly, A.J.Verhagen, & E.J.Wagenmakers, (2016b). Harold Jeffreys’s Default Bayes Factor Hypothesis Tests:Explanation, extension, and application in psychology. Journal of Mathematical Psychology, 72, 19–32.
21. M.Marsman, & E.J.Wagenmakers, (in press). Three insights from a Bayesian Interpretation of the one–sided p value. Educational and Psychological Measurement.
22. R.D.Morey, C.D.Chambers, P.J.Etchells, C.R.Harris, R.Hoekstra, D.Lakens, & R.A.Zwaan, (2016). The peer reviewers’ openness initiative:Incentivizing open research practices through peer review. Royal Society Open Science, 3, 150547.
23. B.A.Nosek, G.Alter, G.C.Banks, D.Borsboom, S.D.Bowman, S.J.Breckler, & T.Yarkoni, (2015). Promoting an open research culture. Science, 348, 1422–1425.
24. B.A.Nosek, & D.Lakens, (2014). Registered reports:A method to increase the credibility of published results. Social Psychology, 45, 137–141.
25. Open Science Collaboration, T. (2012). An open, large–scale, collaborative effort to estimate the reproducibility of psychological science. Perspectives on Psychological Science, 7, 657–660.
26. H.Pashler, & E.J.Wagenmakers, (2012). Editors’ introduction to the special section on replicability in psychological science:A crisis of confidence? Perspectives on Psychological Science, 7, 528–530.
27. C.S.Peirce, (1878). Deduction, induction, and hypothesis. Popular Science Monthly, 13, 470–482.
28. C.S.Peirce, (1883). A theory of probable inference. In C.S.Peirce (Ed.), Studies in logic, pp. 126–181. Boston, MA:Little & Brown.
29. J.N.Rouder, R.D.Morey, A.J.Verhagen, J.M.Province, & E.J.Wagenmakers, (in press). Is there a free lunch in inference? Topics in Cognitive Science.
30. J.N.Rouder, P.L.Speckman, D.Sun, R.D.Morey, & G.Iverson, (2009). Bayesian t tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin & Review, 16, 225–237.
31. W.W.Rozeboom, (1960). The fallacy of the null–hypothesis significance test. Psychological Bulletin, 57, 416–428.
32. B.Scheibehenne, T.Jamil, E.J.Wagenmakers, (in press). Bayesian evidence synthesis can reconcile seemingly inconsistent results:The case of hotel towel reuse. Psychological Science.
33. T.Sellke, M.J.Bayarri, & J.O.Berger, (2001). Calibration of p values for testing precise null hypotheses. The American Statistician, 55, 62–71.
34. R.M.Shiffrin, M.D.Lee, W.Kim, & E.J.Wagenmakers, (2008). A survey of model evaluation approaches with a tutorial on hierarchical Bayesian methods. Cognitive Science, 32, 1248–1284.
35. D.Trafimow, & M.Marks, (2015). Editorial. Basic and Applied Social Psychology, 37, 1–2.
36. A.W.van der Vaart, (1998). Asymptotic statistics. New York, NY:Cambridge University Press.
37. A.J.Verhagen, & E.J.Wagenmakers, (2014). Bayesian tests to quantify the result of a replication attempt. Journal of Experimental Psychology:General, 143, 1457–1475.
38. E.J.Wagenmakers, R.D.Morey, & M.D.Lee, (2016). Bayesian benefits for the pragmatic researcher. Current Directions in Psychological Science, 25, 169–176.
39. E.J.Wagenmakers, A.J.Verhagen, & A.Ly, (2016). How to quantify the evidence for the absence of a correlation. Behavior Research Methods, 48, 413–426.
40. E.J.Wagenmakers, A.J.Verhagen, A.Ly, M.Bakker, M.D.Lee, D.Matzke, & R.D.Morey, (2015). A power fallacy. Behavior Research Methods, 47, 913–917.
41. E.J.Wagenmakers, A.J.Verhagen, A.Ly, D.Matzke, H.Steingroever, J.N.Rouder, & R.D.Morey, (in press). The need for Bayesian hypothesis testing in psychological science. In S.O.Lilienfeld & I.Waldman (Eds.), Psychological science under scrutiny:Recent challenges and proposed solutions. New York, NY:Wiley and Sons.
42. E.J.Wagenmakers, R.Wetzels, D.Borsboom, R.Kievit, & H.L.J.van der Maas, (2015). A skeptical eye on psi. In E.May & S.Marwaha (Eds.), Extrasensory perception:Support, skepticism, and science, (pp. 153–176). ABC-CLIO.
43. E.J.Wagenmakers, R.Wetzels, D.Borsboom, H.L.J.van der Maas, & R.A.Kievit, (2012). An agenda for purely confirmatory research. Perspectives on Psychological Science, 7, 627–633.
44. R.Wetzels, D.Matzke, M.D.Lee, J.N.Rouder, G.J.Iverson, & E.J.Wagenmakers, (2011). Statistical evidence in experimental psychology:An empirical comparison using 855 t tests. Perspectives on Psychological Science, 6, 291–298.
45. E.H.Witte, & F.Zenker, (2016). Reconstructing recent work on macro-social stress as a research program. Basic and Applied Social Psychology, 38(6), 301–307. doi:10.1080/01973533.2016.1207077