Interpreting null findings from trials of alcohol brief interventions

Frontiers in Psychiatry

Volumn 5, Issue JUL, 2014, Pages

  Heather, Nick ^a  

^a NORTHUMBRIA UNIVERSITY   (United Kingdom)

Author keywords

Alcohol related problems; Bayesian statistics; Brief interventions; Null findings; Null hypothesis significance testing; Randomized controlled trials

Indexed keywords

ALCOHOL BRIEF INTERVENTION; ALCOHOL CONSUMPTION; ASSESSMENT REACTIVITY; CLINICAL EFFECTIVENESS; DRINKING BEHAVIOR; HISTORICAL TREND; HUMAN; INVESTIGATIVE PROCEDURES; MEDICAL PROCEDURES; NULL FINDING; RANDOMIZED CONTROLLED TRIAL (TOPIC); REGRESSION TO THE MEAN; RESEARCH PARTICIPATION EFFECT; REVIEW; SCREENING AND INTERVENTION PROGRAM FOR SENSIBLE DRINKING; STATISTICAL PARAMETERS; STATISTICAL SIGNIFICANCE; THERAPEUTIC MISCONCEPTION;

EID: 84904468296     PISSN: None     EISSN: 16640640     Source Type: Journal    
DOI: 10.3389/fpsyt.2014.00085     Document Type: Review

References (68)

1. O'Donnell A, Anderson P, Newbury-Birch D, Schulte B, Schmidt C, Reimer J, et al. The impact of brief alcohol intervention in primary healthcare: a systematic review of reviews. Alcohol Alcohol (2014) 49:66-78. doi:10.1093/alcalc/agt170
2. Kaner EFS, Beyer F, Dickinson HO, Pienaar E, Campbell F, Schlesinger C, et al. Effectiveness of brief alcohol interventions in primary care populations. Cochrane Database Syst Rev (2007) (2):CD004148. doi:10.1002/14651858.CD004148.pub3
3. Jonas D, Garbutt J, Brown J, Amick H, Brownley K, Council C, et al. Screening, Behavioral Counseling, and Referral in Primary Care to Reduce Alcohol Misuse. Rockville MD: Agency for Healthcare Research & Quality (2012).
4. Ballesteros J, Gonzalez-Pinto A, Querejeta I, Arino J. Brief interventions for hazardous drinkers delivered in primary care are equally effective in men and women. Addiction (2004) 99:103-8. doi:10.1111/j.1360-0443.2004.00499.x
5. Solutions for Public Health. Appraisal for Screening for Alcohol Misuse. Oxford, UK: Solutions for Public Health (2011).
6. Nilsen P, Baird J, Mello M, Nirenberg TD, Woolard R, Bendtsen P, et al. A systematic review of emergency care brief alcohol interventions for injury patients. J Subst Abuse Treat (2008) 35:184-201. doi:10.1016/j.jsat.2007.09.008
7. Mdege N, Fayter D, Watson J, Stirk L, Sowden A, Godfrey C. Interventions for reducing alcohol consumption among general hospital inpatient heavy alcohol users: a systematic review. Drug Alcohol Depend (2013) 131:1-22. doi:10.1016/j.drugalcdep.2013.01.023
8. Rosenthal R. The 'file drawer problem' and tolerance for null results. Psychol Bull (1979) 86:638-41. doi:10.1037/0033-2909.86.3.638
9. Scargle J. Publication bias: the "file drawer" problem in scientific inference. J Sci Explor (2000) 14:91-106.
10. Heather N. Can screening and brief intervention lead to population-level reductions in alcohol-related harm? Addict Sci Clin Pract (2012) 7:15. doi:10.1186/1940-0640-7-15
11. Cumming G. Understanding the New Statistics: Effect Sizes, Confidence Intervals, and Meta-analysis. New York: Routledge (2012).
12. Cohen J. Statistical Power Analysis for the Behavioural Sciences. Hillsdale, NJ: Lawrence Erlbaum Associates (1988).
13. Cumming G. Replication and p intervals: p values predict the future only vaguely, but confidence intervals do much better. Perspect Psychol Sci (2008) 3:286-300. doi:10.1111/j.1745-6924.2008.00079.x
14. Moyer A, Finney J, Swearingen C, Vergun P. Brief interventions for alcohol problems: a meta-analytic review of controlled investigations in treatment seeking and non-treatment seeking populations. Addiction (2002) 97:279-92. doi:10.1046/j.1360-0443.2002.00018.x
15. Faul F, Erdfelder E, Lang A-G, Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods (2007) 39:175-91. doi:10.3758/BF03193146
16. American Psychological Association. Publication Manual of the American Psychological Association. Washington, DC: American Psychological Association (2010).
17. Kline R. Beyond Significance Testing: Reforming Data Analysis Methods in Behavioral Research. Washington, DC: American Psychological Association (2004).
18. Schmidt FL, Hunter J. Eight common but false objections to the discontinuation of significance testing in the analysis of research data. In: Harlow L, Mulaik S, Steiger J editors. What If There Were No Significance Tests? Mahwah, NJ: Erlbaum (1997). p. 37-64.
19. Prime Minister's Strategy Unit. Alcohol Harm Reduction Strategy for England. London: Cabinet Office (2004).
20. Kaner E, Bland M, Cassidy P, Coulton C, Dale V, Deluca P, et al. Effectiveness of screening and brief alcohol intervention in primary care (SIPS trial): pragmatic cluster randomised controlled trial. BMJ (2013) 346:e8501. doi:10.1136/bmj.e8501
21. Kaner E, Bland M, Cassidy P, Coulton S, Crawford M, DeLuca P, et al. Screening and brief interventions for hazardous and harmful alcohol use in primary care: a randomised controlled trial protocol. BMC Public Health (2009) 9:287. doi:10.1186/1471-2458-9-287
22. Saunders JB, Aasland OG, Babor TF, de la Fuente JR, Grant M. Development of the alcohol use disorders identification test (AUDIT): WHO collaborative project on early detection of persons with harmful alcohol consumption - II. Addiction (1993) 88:791-804. doi:10.1111/j.1360-0443.1993.tb00822.x
23. Drummond DC. The relationship between alcohol dependence and alcohol-related problems in a clinical population. Br J Addict (1990) 85:357-66. doi:10.1111/j.1360-0443.1990.tb00652.x
24. Fisher R. The Design of Experiments. 9th ed. London: Macmillan (1971).
25. Hoening J, Heisey D. The abuse of power: the pervasive fallacy of power calculations for data analysis. Am Stat (2001) 55:1-6.
26. Heather N. The efficacy-effectiveness distinction in trials of alcohol brief intervention. Addict Sci Clin Pract (2014) (in press).
27. Saitz R. SIPS trial findings most consistent with a lack of effectiveness of brief intervention in real clinical practice (letter). Br Med J (2013) 346:e8501. doi:10.1136/bmj.e8501
28. The Alcohol Academy. Clarifying Alcohol Brief Interventions: 2013 Update. London: The Alcohol Academy (2013). Available from: http://www.alcoholacademy.net/news/47/65/Clarifying-brief-Interventions-2013-update.html
29. Woodhead D. Patients leaflet enough to tackle problem drinking, researchers suggest. Pulse (2013). Available from: http://www.pulsetoday.co.uk/clinical/therapy-areas/addiction/patient-leaflet-enough-to-tackle-problem-drinking-researchers-suggest/20001448.article
30. Babor T. Taking stock: twenty-five years of translational research on alcohol screening and brief intervention. Nord Stud Alcohol Drugs (2011) 25:578-80.
31. Williams E, Johnson M, Lapham G, Caldeiro R, Chew L, Fletcher G, et al. Strategies to implement alcohol screening and brief intervention in primary care settings: a structured literature review. Psychol Addict Behav (2011) 25:206-14. doi:10.1037/a0022102
32. Aalto M, Pekuri P, Seppa K. Obstacles to carrying out brief intervention for heavy drinkers in primary health care: a focus group study. Drug Alcohol Rev (2003) 22:169-73. doi:10.1080/09595230100100606
33. Wilson G, Lock C, Heather N, Cassidy P, Christie M, Kaner E. Intervention against excessive alcohol consumption in primary health care: a survey of GPs' attitudes and practices in England 10 years on. Alcohol Alcohol (2011) 46:570-7. doi:10.1093/alcalc/agr067
34. Heather N, Hönekopp J. Readiness to change and the transtheoretical model as applied to addictive disorders: a balanced appraisal. In: Martin L, DiMatteo M editors. The Oxford Handbook of Health Communication, Behavior Change, and Treatment Adherence. Oxford, UK: Oxford University Press (2014). p. 214-50.
35. Jenkins R, McAlaney J, McCambridge J. Change over time in alcohol consumption in control groups in brief intervention studies: systematic review and meta-regression study. Drug Alcohol Depend (2009) 100:107-14. doi:10.1016/j.drugalcdep.2008.09.016
36. Jenkins R, McAlaney J, McCambridge J. Corrigendum to "Change over time in alcohol consumption in control groups in brief intervention studies: systematic review and meta-regression study" [Drug Alcohol Depen. 100 (2009) 107-114]. Drug Alcohol Depend (2010) 108:151. doi:10.1016/j.drugalcdep.2008.09.016
37. Bernstein J, Bernstein E, Heeren T. Mechanisms of change in control group drinking in clinical trials of brief alcohol intervention: implications for bias toward the null. Drug Alcohol Rev (2010) 29:498-507. doi:10.1111/j.1465-3362.2010.00174.x
38. Morton V, Torgerson D. Effect of regression to the mean on decision making in health care. Br Med J (2003) 326:1083-4. doi:10.1136/bmj.326.7398.1083
39. Finney J. Regression to the mean in substance use disorder treatment research. Addiction (2008) 103:42-52. doi:10.1111/j.1360-0443.2007.02032.x
40. McCambridge J, Kypri K, McElduff P. Regression to the mean and alcohol consumption: a cohort study exploring implications for the interpretation of change in control groups in brief intervention trials. Drug Alcohol Depend (2014) 135:156-9. doi:10.1016/j.drugalcdep.2013.11.017
41. McCambridge J, Kypri K, Elbourne D. Research participation effects: a skeleton in the methodological cupboard. J Clin Epidemiol (2014) 67(8):845-9. doi:10.1016/j.jclinepi.2014.03.002
42. Parsons H. What happened at Hawthorne? Science (1974) 183:922-32. doi:10.1126/science.183.4128.922
43. McCambridge J, Witton J, Elbourne D. Systematic review of the Hawthorne effect: new concepts are needed to study research participation effects. J Clin Epidemiol (2014) 67:267-77. doi:10.1016/j.jclinepi.2013.08.015
44. Orne M. On the social psychology of the psychological experiment: with particular reference to demand characteristics and their implications. Am Psychol (1962) 17:776-83. doi:10.1037/h0043424
45. McCambridge J, de Bruin M, Witton J. The effects of demand characteristics on research participant behaviours in non-laboratory settings. PLoS One (2012) 7:e39116. doi:10.1371/journal.pone.0039116
46. Wagenaar A, Salois M, Komro K. Effects of beverage alcohol price and tax levels on drinking: a meta-analysis of 1003 estimates from 112 studies. Addiction (2009) 104:179-90. doi:10.1111/j.1360-0443.2008.02438.x
47. Babor T, Caetano R, Casswell S, Edwards G, Giesbrecht N, Graham K, et al. Alcohol: No Ordinary Commodity - Research and Public Policy. 2nd ed. Oxford, UK: Oxford University Press (2010).
48. Kypri K, Langley J, Saunders J, Cashell-Smith M. Assessment may conceal therapeutic benefit: findings from a randomised controlled trial for hazardous drinking. Addiction (2007) 102:62-70. doi:10.1111/j.1360-0443.2006.01632.x
49. World Health Organization. A cross-national trial of brief interventions with heavy drinkers. WHO Brief Intervention Study Group. Am J Public Health (1996) 86:948-55. doi:10.2105/AJPH.86.7.948
50. McCambridge J, Day M. Randomized controlled trial of the effects of completing the alcohol use disorders identification test questionnaire on self-reported hazardous drinking. Addiction (2008) 103:241-8. doi:10.1111/j.1360-0443.2007.02080.x
51. McCambridge J, Kypri K. Can simply answering research questions change behaviour? Systematic review and meta analysis of brief alcohol intervention trials. PLoS One (2011) 6:e23748. doi:10.1371/journal.pone.0023748
52. Daeppen J-B, Gaume J, Badty P, Yersin B, Calmes J-M, Givel J-C, et al. Brief alcohol interventions and alcohol assessment do not influence alcohol use in injured patients treated in the emergency department: a randomized controlled trial. Addiction (2007) 102:1224-33. doi:10.1111/j.1360-0443.2007.01869.x
53. Cherpitel C, Korcha R, Moskalewicz J, Swiatkiewicz G, Ye Y, Bond J. Screening, brief intervention, and referral to treatment (SBIRT): 12-month outcomes of a randomized controlled clinical trial in a Polish emergency department. Alcohol Clin Exp Res (2010) 34:1922-8. doi:10.1111/j.1530-0277.2010.01281.x
54. Richmond R, Heather N, Wodak A, Kehoe L, Webster I. Controlled evaluation of a general practice-based brief intervention for excessive drinking. Addiction (1995) 90:119-32. doi:10.1111/j.1360-0443.1995.tb01016.x
55. McCambridge J, Bendtsen M, Kaarlsson N, Withe IR, Nilsen P. Alcohol assessment and feedback by email for university students: main findings from a randomised controlled trial. Br J Psychiatry (2013) 203:334-40. doi:10.1192/bjp.bp.113.128660
56. Bush K, Kivlahan DR, McDonell MB, Fihn SD, Bradley KA. The AUDIT alcohol consumption questions (AUDIT-C): an effective brief screening test for problem drinking. Arch Intern Med (1998) 158:1789-95. doi:10.1001/archinte.158.16.1789
57. McCambridge J. Research assessments: instruments of bias and brief interventions of the future? Addiction (2009) 104:1311-2. doi:10.1111/j.1360-0443.2009.02684.x
58. Moos R. Context and mechanisms of reactivity to assessment and treatment. Addiction (2008) 103:249-50. doi:10.1111/j.1360-0443.2007.02123.x
59. Sedgewick P. What is a non-inferiority trial? Br Med J (2013) 347:f6853. doi:10.1136/bmj.f6853
60. Miller WR, Sovereign RG, Krege B. Motivational interviewing with problem drinkers: II the drinkers check-up as a preventive intervention. Behav Psychother (1988) 16:251-68. doi:10.1017/S0141347300014129
61. Burke BL, Arkowitz H, Menchola M. The efficacy of motivational interviewing: a meta-analysis of controlled clinical trials. J Consult Clin Psychol (2003) 71:843-61. doi:10.1037/0022-006X.71.5.843
62. Apodoca T, Miller W. A meta-analysis of the effectiveness of bibliotherapy for alcohol problems. J Clin Psychol (2003) 59:289-304. doi:10.1002/jclp.10130
63. Dienes Z. Using Bayes to get the most out of non-significant results. Front Psychol (2014) 5:781. doi:10.3389/fpsyg.2014.00781
64. Stone J. Bayes' Rule: A Tutorial Introduction to Bayesian Analysis. London: Sebtel Press (2013).
65. Lee PM. Bayesian Statistics: An Introduction. Chichester: John Wiley (2004).
66. Dienes Z. Understanding Psychology as a Science: An Introduction to Scientific and Statistical Inference. Basingstoke: Palgrave Macmillan (2008).
67. Jeffreys H. The Theory of Probability. 3rd ed. Oxford: Oxford University Press (1961).
68. McGrayne S. The Theory That Would Not Die: How Bayes' Rule Cracked the Enigma Code, Hunted Down Russian Submarines and Emerged Triumphant From Two Centuries of Controversy. New Haven: Yale University Press (2011).