Using Bayes factors to evaluate evidence for no effect: examples from the SIPS project

Addiction

Volumn 113, Issue 2, 2018, Pages 240-246

  Dienes, Zoltan ^a   Coulton, Simon ^b   Heather, Nick ^c  

^a UNIVERSITY OF SUSSEX   (United Kingdom)

^b UNIVERSITY OF KENT   (United Kingdom)

^c NORTHUMBRIA UNIVERSITY   (United Kingdom)

Author keywords

Alcohol brief interventions; Bayes factors; Bayesian statistics; evidence of absence; non significance; SIPS project

Indexed keywords

ALCOHOLISM; BAYES THEOREM; CLINICAL TRIAL; CLUSTER ANALYSIS; CONTROLLED STUDY; COUNSELING; HUMAN; META ANALYSIS (TOPIC); MULTICENTER STUDY; RANDOMIZED CONTROLLED TRIAL; TREATMENT OUTCOME;

ALCOHOLISM; BAYES THEOREM; CLUSTER ANALYSIS; COUNSELING; HUMANS; META-ANALYSIS AS TOPIC; TREATMENT OUTCOME;

EID: 85030027366     PISSN: 09652140     EISSN: 13600443     Source Type: Journal    
DOI: 10.1111/add.14002     Document Type: Article

References (35)

1. Dienes Z. Using Bayes to get the most out of non-significant results. Front Psychology 2014; 5: 781.
2. West R. Using Bayesian analysis for hypothesis testing [Editorial]. Addiction 2015; 111: 3–4.
3. Fisher R. The Design of Experiments. Macmillan: London, UK; 1971.
4. Johansson T. Hail the impossible: p-values, evidence, and likelihood. Scand J Psychol 2011; 52: 113–125.
5. Dienes Z. How Bayes factors change scientific practice. J Math Psychol 2016; 72: 78–89.
6. Goldacre B. Bad Pharma. Fourth Estate: London, UK; 2012.
7. Dienes Z. Understanding Psychology as a Science: An Introduction to Scientific and Statistical Inference. Basingstoke, UK: Palgrave Macmillan; 2008.
8. Rouder J., Speckman P., Sun D., Morey R., Iverson G. Bayesian t-tests for accepting and rejecting the null hypothesis. Psychonomic Bull Rev 2009; 16: 225–237.
9. Jeffreys H. The Theory of Probability. Oxford, UK: The Clarendon Press; 1939.
10. Lee M. D., Wagenmakers E.-J. Bayesian Cognitive Modeling: A Practical Course. Cambridge, UK: Cambridge University Press; 2013.
11. Saunders J. B., Aasland O. G., Amundsen A., Grant M. Alcohol consumption and related problems among primary health care patients: WHO collaborative project on early detection of persons with harmful alcohol consumption. Addiction 1993; 88: 349–362.
12. Kaner E., Bland M., Cassidy P., Coulton S., Deluca P., Drummond C. et al. Screening and brief interventions for hazardous and harmful alcohol use in primary care: a cluster randomised controlled trial protocol. BMC Public Health 2009; 9: 287.
13. Coulton S., Perryman K., Bland M., Cassidy P., Crawford M., Deluca P. et al. Screening and brief interventions for hazardous alcohol use in accident and emergency departments: a randomised controlled trial protocol. BMC Health Serv Res 2009; 9: 114.
14. Newbury-Birch D., Bland M., Cassidy P., Coulton S., Deluca P., Drummond C. et al. Screening and brief interventions for hazardous and harmful alcohol use in probation services: a cluster randomised controlled trial protocol. BMC Public Health 2009; 9: 418.
15. Kaner E., Bland M., Cassidy P., Coulton S., Dale V., Deluca P. et al. Effectiveness of screening and brief alcohol intervention in primary care (SIPS trial): pragmatic cluster randomised controlled trial. BMJ 2013; 346: e8501.
16. Drummond C., DeLuca P., Coulton S., Bland M., Cassidy P., Crawford M. et al. The effectiveness of alcohol screening and brief intervention in emergency departments: a multicentre pragmatic cluster randomized controlled trial. PLOS ONE 2014; 9: e99463.
17. Newbury-Birch D., Coulton S., Bland M., Cassidy P., Dale V., Deluca P. et al. Alcohol screening and brief interventions for offenders in the probation setting (SIPS trial): a pragmatic multicentre cluster randomized controlled trial. Alcohol Alcohol 2014; 49: 540–548.
18. Heather N. Interpreting null findings from trials of alcohol brief interventions. Front Psychiatry 2014; 5: 85.
19. Woodhead D. Patient leaflet enough to tackle problem drinking, researchers suggest. Pulse 11 January 2013. Available at: http://www.pulsetoday.co.uk/clinical/therapy-areas/addiction/patient-leaflet-enough-to-tackle-problem-drinking-researchers-suggest/20001448.article (accessed 7 September 2017) (Archived at: http://www.webcitation.org/6tOsgzWDo).
20. Morey R. D., Romelin J.-W., Rouder J. N. The philosophy of Bayes factors and the quantification of statistical evidence. J Math Psychol 2016; 72: 6–18.
21. Lee M. D., Vanpaemel W. Determining informative priors for cognitive models. Psychon Bull Rev 2016; 1–14.
22. Ballesteros J., Duffy J. C., Querejeta I., Arino J., Gonzalez-Pinto A. Efficacy of brief interventions for hazarous drinkers in primary care|: systematic review and meta-analysis. Alcohol Clin Exp Res 2004; 28: 608–618.
23. Moyer A., Finney J. W., Swearingen C. E., Vergun P. Brief interventions for alcohol problems: a meta-analytic review of controlled investigations in treatment-seeking and non-treatment-seeking populations. Addiction 2002; 97: 279–292.
24. Borenstein M., Hedges L. V., Higgins J. P. T., Rothstein H. R. Introduction to Meta-Analysis. Chichester, UK: Wiley; 2009.
25. Camerer C. F., Dreber A., Forskell E., Ho T. H., Huber J., Johannesson M. et al. Evaluating replicability of laboratory experiments in economics. Science 2016; 351: 1433–1436.
26. Ioannides J. P. A. Why most discovered true associations are inflated. Epidemiology 2008; 19: 640–648.
27. Open Science Collaboration. Estimating the reproducibility of psychological science. Science 2015; 349: 943–951.
28. Dienes Z., McLatchie N. Four reasons to prefer Bayesian over orthodox statistical analyses. Psychon Bull Rev 2017; https://doi.org/10.3758/s13423-017-1266-z.
29. Wilk A. I., Jensen N. M., Havighurst T. C. Meta-analysis of randomized control trials addressing brief interventions in heavy alcohol drinkers. J Gen Intern Med 1997; 12: 274–283.
30. Kaner E. F., Beyer F. R., Dickinson H. O., Campbell F., Schlesinger C., Heather N. et al. Effectiveness of brief alcohol interventions in primary care populations. Cochrane Database Syst Rev 2007; Issue 2. Art. No.: CD004148. https://doi.org/10.1002/14651858.CD004148.pub3.
31. Kaner E. Screening and brief alcohol intervention in primary care: a perfect fit or a square peg in a round hole? Keynote presentation at Annual Conference of International Network on Brief Interventions for Alcohol & Other Drugs (INEBRIA), Lausanne, Switzerland, 22 September 2016. Available at: http://inebria.net/wp-content/uploads/2016/10/Plenary-session-1-Eileen-Kaner-SBI-in-PHC-perfect-fit-or-round-peg-in-a-square-hole-final.pdf (accessed 7 September 2017) (Archived at: http://www.webcitation.org/6s4gKLyew).
32. Verhagen J., Wagenmakers E. J. Bayesian tests to quantify the result of a replication attempt. J Exp Psychol Gen 2014; 143: 1457–1475.
33. Beard E., Dienes Z., Muirhead C., West R. Using Bayes factors for testing hypotheses about intervention effectiveness in addiction research. Addiction 2016; 111: 2230–2247.
34. Morey R. D., Rouder J. N. Bayes factor approaches for testing interval null hypotheses. Psychol Methods 2011; 16: 406–419.
35. Schönbrodt, F., Wagenmakers, E.-J. Bayes factor design analysis: planning for compelling evidence. Psychon Bull Rev 2017; https://doi.org/10.3758/s13423-017-1230-y.