Assessment of generalizability, applicability and predictability (GAP) for evaluating external validity in studies of universal family-based prevention of alcohol misuse in young people: Systematic methodological review of randomized controlled trials

Addiction

Volumn 107, Issue 9, 2012, Pages 1570-1579

  Fernandez Hermida, Jose Ramon ^a   Calafat, Amador ^b   Becoña, Elisardo ^c   Tsertsvadze, Alexander ^d   Foxcroft, David R ^e  

^a UNIVERSITY OF OVIEDO   (Spain)

^b European Institute of Studies on Prevention ^*  (Spain)

^c UNIVERSITY OF SANTIAGO DE COMPOSTELA   (Spain)

^d OTTAWA HOSPITAL RESEARCH INSTITUTE   (Canada)

^e OXFORD BROOKES UNIVERSITY   (United Kingdom)

Author keywords

Alcohol; Applicability; External validity; Family; Gerneralizability; Predictability; Prevention

Indexed keywords

ADOLESCENT; ADULT; ALCOHOLISM; EPIDEMIOLOGY; FAMILY THERAPY; HUMAN; METHODOLOGY; RANDOMIZED CONTROLLED TRIAL (TOPIC); REPRODUCIBILITY; REVIEW; TREATMENT OUTCOME;

ADOLESCENT; ALCOHOLISM; BIAS (EPIDEMIOLOGY); FAMILY THERAPY; HUMANS; RANDOMIZED CONTROLLED TRIALS AS TOPIC; REPRODUCIBILITY OF RESULTS; TREATMENT OUTCOME; YOUNG ADULT;

EID: 84864757413     PISSN: 09652140     EISSN: 13600443     Source Type: Journal    
DOI: 10.1111/j.1360-0443.2012.03867.x     Document Type: Review

References (76)

1. Foxcroft D., Ireland D., Lowe G., Breen R. Primary prevention for alcohol misuse in young people. Cochrane Database Syst Rev 2002; (3): CD003024.
2. Foxcroft D. R., Tsertsvadze A. Universal family-based prevention programs for alcohol misuse in young people. Cochrane Database Syst Rev 2011; (9): CD009308.
3. Foxcroft D. R., Tsertsvadze A. Universal multi-component prevention programs for alcohol misuse in young people. Cochrane Database Syst Rev 2011; (10): CD009307.
4. Foxcroft D., Ireland D., Lister-Sharp D., Lowe G., Breen R. Longer-term primary prevention for alcohol misuse in young people: a systematic review. Addiction 2003; 98: 397-411.
5. Smit E., Verdurmen J., Monshouwer K., Smit F. Family interventions and their effect on adolescent alcohol use in general populations: a meta-analysis of randomised controlled trials. Drug Alcohol Depend 2008; 97: 195-206.
6. Shadish W. R., Cook T. D., Campbell D. T. Experimental and Quasi-Experimnental Designs for Generalized Causal Inference. Boston: Houghton Mifflin; 2002.
7. Rothwell P. M. External validity of randomised controlled trials: 'to whom do the results of this trial apply?'. Lancet 2005; 365: 82-93.
8. Eldridge S., Ashby D., Bennett C., Wakelin M., Feder G. Internal and external validity of cluster randomised trials: systematic review of recent trials. BMJ 2008; 336: 876-80.
9. Rothwell P. M. Factors that can affect the external validity of randomised controlled trials. PLoS Clin Trials 2006; 1: e9.
10. Pearson M., Coomber R. The challenge of external validity in policy-relevant systematic reviews: a case study from the field of substance. Addiction 2009; 105: 136-45.
11. Dekkers O. M., von Elm E., Algra A., Romijin J. A., Vandenbroucke J. P. How to assess the external validity of therapeutic trials: a conceptual approach. Int J Epidemiol 2009; 39: 89-94.
12. Alhalabí-Diaz S., Secades-Villa R., Perez J. M. E., Fernandez-Hermida J. R., Garcia-Rodriguez O., Crespo J. L. C. Family predictors of parent participation in an adolescent drug abuse prevention program. Drug Alcohol Rev 2006; 25: 327-31.
13. Heinrichs N., Bertram H., Kuschel A., Hahlweg K. Parent recruitment and retention in a universal prevention program for child behavior and emotional problems: barriers to research and program participation. Prev Sci 2005; 6: 275-86.
14. Hogue A., Johnson-Leckrone J., Liddle H. A. Recruiting high-risk families into family-based prevention and prevention research. J Ment Health Couns 1999; 4: 337-51.
15. Spoth R., Redmond C. Study of participation barriers in family-focused prevention: research issues and preliminary results. Int Q Commun Health Educ 1992; 4: 365-8.
16. Hawe P., Shiell A., Riley T., Gold L. Methods for exploring implementation variation and local context within a cluster randomised community intervention trial. J Epidemiol Commun Health 2004; 58: 788-93.
17. Trickett E. J., Beehler S., Deutsch C., Green L. W., Hawe P., McLeroy K. etal. Advancing the science of community-level interventions. Am J Public Health 2011; 101: 1410-9.
18. Caulkins J. P., Pacula R. L., Paddock S., Chieas J. School-Based Drug Prevention: What Kind of Drug Use Does It Prevent?. Santa Monica, CA: RAND; 2002.
19. Dawson D. A., Goldstein R. B., Chou S. P., Ruan W. J., Grant B. F. Age at first drink and the first incidence of adult-onset DSM-IV alcohol use disorders. Alcohol Clin Exp Res 2008; 32: 2149-60.
20. Grant B. F., Dawson D. A. Age at onset of alcohol use and its association with DSM-IV alcohol abuse and dependence results from the National Longitudinal Alcohol Epidemiologic Survey. J Subst Abuse 1997; 9: 103-10.
21. Smith Lesley A., Foxcroft D., Holloway A., Minozzi S., Casazza G. Brief Alcohol Questionnaires for Identifying Hazardous, Harmful and Dependent Alcohol Use in Primary Care. Cochrane Database of Systematic Reviews. Chichester, UK: John Wiley & Sons, Ltd; 2010.
22. Fishbein M., Jarvis B. Failure to find a behavioral surrogate for STD incidence-what does it really mean? Sex Transm Dis 2000; 27: 452-5.
23. Peterman T. A., Lin L. S., Newman D. R., Kamb M. L., Bolan G., Zenilman J. etal. Does measured behavior reflect STD risk? An analysis of data from a randomized controlled behavioral intervention study. Project RESPECT Study Group. Sex Transm Dis 2000; 27: 446-51.
24. Taylor R. S., Elston J. The use of surrogate outcomes in model-based cost-effectiveness analyses: a survey of UK Health Technology Assessment reports. Health Technol Assess 2009; 13: iii, ix-xi, 1-50.
25. ICH Expert Working Group. International Conference on Harmonisation 10. Guidelines for the Conduct of Clinical Trials for the Registration of Drugs. E9: Statistical Principles for Clinical Trials 1998. Available at: (Accessed 15 July 2011 and Archived at on 27 March 2012).
26. Bucher H. C., Guyatt G. H., Cook D. J., Holbrook A., McAlister F. A. Users' guides to the medical literature: XIX. Applying clinical trial results. A. How to use an article measuring the effect of an intervention on surrogate end points. JAMA 1999; 282: 771-8.
27. Lassere M. N., Johnson K. R., Boers M., Tugwell P., Brooks P., Simon L. etal. Definitions and validation criteria for biomarkers and surrogate endpoints: development and testing of a quantitative hierarchical levels of evidence schema. J Rheumatol 2007; 34: 607-15.
28. Foxcroft D. R., Tsertsvadze A. Universal multi-component prevention programs for alcohol misuse in young people. Cochrane Database Syst Rev 2011; (9): CD009307.
29. Bauman K. E., Ennett S. T., Foshee V. A., Pemberton M., King T. S., Koch G. G. Influence of a family program on adolescent smoking and drinking prevalence. Prev Sci 2002; 3: 35-42.
30. Brody G. H., Murry V. M., McNair L., Chen Y., Gibbons F. X., Gerrard M. etal. Linking changes in parenting to parent-child relationship quality and youth self-control: the Strong African American Families Program. J Res Adolesc 2005; 15: 47-69.
31. Eddy J. M., Reid J. B., Fetrow R. A. An elementary school based prevention program targeting modifiable antecedents of youth delinquency and violence: linking the interests of families and teachers (LIFT). J Emot Behav Disord 2000; 8: 165-76.
32. Hawkins J. D., Oesterle S., Brown E. C., Arthur M. W., Abbott R. D., Fagan A. A. etal. Results of a type 2 translational research trial to prevent adolescent drug use and delinquency: a test of communities that care. Arch Pediatr Adolesc Med 2009; 163: 789-98.
33. Loveland-Cherry C. J., Ross L. T., Kaufman S. R. Effects of a home-based family intervention on adolescent alcohol use and misuse. J Stud Alcohol 1999; 13: 94-102.
34. Perry C. L., Komro K. A., Mortenson-Veblen S., Bosma L. M., Farbakhsh K., Munson K. A. etal. A randomised controlled trial of the middle and junior high school D.A.R.E. and D.A.R.E. Plus programs. Arch Pediatr Adolesc Med 2003; 157: 178-84.
35. Perry C. L., Williams C. L., Veblen-Mortenson S., Toomey T. L., Komro K. A., Anstine P. S. etal. Project Northland: outcomes of a community wide alcohol use prevention program during early adolescence. Am J Public Health 1996; 86: 956-65.
36. Schinke S. P., Fang L., Cole K. C. Computer-delivered, parent-involvement intervention to prevent substance use among adolescent girls. Prev Med 2009; 49: 429-35.
37. Simons-Morton B., Haynie D., Saylor K., Crump A. D., Chen R. The effects of the going places program on early adolescent substance use and antisocial behavior. Prev Sci 2005; 6: 187-97.
38. Spoth R., Redmond C., Lepper H. Alcohol initiation outcomes of universal family-focused preventive interventions: one- and two-year follow-ups of a controlled study. J Stud Alcohol Suppl 1999; 13: 103-11.
39. Spoth R., Redmond C., Shin C., Greenberg M., Clair S., Feinberg M. Substance-use outcomes at 18 months past baseline: the PROSPER Community-University Partnership Trial. Am J Prev Med 2007; 32: 395-402.
40. Spoth R. L., Redmond C., Trudeau L., Shin C. Longitudinal substance initiation outcomes for a universal preventive intervention combining family and school programs. Psychol Addict Behav 2002; 16: 129-34.
41. Wu Y., Stanton B. F., Galbraith J., Kaljee L., Cottrell L., Li X. etal. Sustaining and broadening intervention impact: a longitudinal randomised trial of 3 adolescent risk reduction approaches. Pediatrics 2003; 111: e32-8.
42. Brown E. C., Catalano R. F., Fleming C. B., Haggerty K. P., Abbott R. D. Adolescent substance use outcomes in the Raising Healthy Children project: a two-part latent growth curve analysis. J Consult Clin Psychol 2005; 73: 699-710.
43. Furr-Holden C. D., Ialango N. S., Anthony J. C., Petras H., Kellam S. G. Developmentally inspired drug prevention: middle school outcomes in a school-based randomised prevention trial. Drug Alcohol Depend 2004; 73: 149-58.
44. Komro K. A., Perry C. L., Veblen-Mortenson S., Farbakhsh K., Kugler K. C., Alfano K. A. etal. Cross-cultural adaptation and evaluation of a home-based program for alcohol use prevention among urban youth: the 'Slick Tracy Home Team Program'. J Prim Prev 2006; 27: 135-54.
45. O'Donnell L., Myint U. A., Duran R., Stueve A. Especially for daughters: parent education to address alcohol and sex-related risk taking among urban young adolescent girls. Health Promot Pract 2010; 11: 70S-8S.
46. Schinke S. P., Cole K. C., Fang L. Gender-specific intervention to reduce underage drinking among early adolescent girls: a test of a computer-mediated, mother-daughter program. J Stud Alcohol Drugs 2009; 70: 70-7.
47. Schinke S. P., Schwinn T. M., Di Noia J., Cole K. C. Reducing the risks of alcohol use among urban youth: three year effects of a computer-based intervention with and without parent involvement. J Stud Alcohol 2004; 65: 443-9.
48. Werch C., Moore M., DiClemente C. C., Owen D. M., Jobli E., Bledsoe R. A sport-based intervention for preventing alcohol use and promoting physical activity among adolescents. J School Health 2003; 73: 380-8.
49. Werch C., Pappas D., Carlson J., Edgemont P., Sinder J., DiClemente C. Evaluation of a brief alcohol prevention program for urban school youth. Am J Health Behav 2000; 24: 120-31.
50. Werch C. C., Moore M. J., DiClemente C. C. Brief image-based health behavior messages for adolescents and their parents. J Child Adolesc Subst Abuse 2008; 17: 19-40.
51. Werch C. E., Moore M. M., DiClemente C. C., Owen D. M., Carlson J. M., Jobli E. Single versus multiple drug prevention: is more always better? A pilot study. Subst Use Misuse 2005; 40: 1085-101.
52. Reddy K. S., Arora M., Perry C. L., Nair B., Kohli A., Lytle L. A. etal. Tobacco and alcohol use outcomes of a school-based intervention in New Dehli. Am J Health Behav 2002; 26: 173-81.
53. Shortt A. L., Hutchinson D. M., Chapman R., Toumbourou J. W. Family, school, peer and individual influences on early adolescent alcohol use: first-year impact of the Resilient Families programme. Drug Alcohol Rev 2007; 26: 625-34.
54. Koning L. M., Vollebergh W. A., Smit F., Verdurmen J. E., van den Eijnden R. J., ter Bogt T. etal. Preventing heavy alcohol use in adolescents (PAS): cluster randomised trial of a parent and student intervention offered separately and simultaneously. Addiction 2009; 104: 1669-78.
55. Schinke S. P., Fang L., Cole K. C. Preventing substance use among adolescent girls: 1-year outcomes of a computerized, mother-daughter program. Addict Behav 2009; 34: 1060-4.
56. Spoth R., Randall G. K., Shin C., Redmond C. Randomized study of combined universal family and school preventive interventions: patterns of long-term effects on initiation, regular use, and weekly drunkenness. Psychol Addict Behav 2005; 19: 372-81.
57. Spoth R., Redmond C., Shin C., Azevedo K. Brief family intervention effects on adolescent substance initiation: school-level growth curve analyses 6 years following baseline. J Consult Clin Psychol 2004; 72: 535-42.
58. Spoth R., Shin C., Guyll M., Redmond C., Azevedo K. Universality of effects: an examination of the comparability of long-term family intervention effects on substance use across risk-related subgroups. Prev Sci 2006; 7: 209-24.
59. Spoth R. L., Clair S., Shin C., Redmond C. Long-term effects of universal preventive interventions on methamphetamine use among adolescents. Arch Pediatr Adolesc Med 2006; 160: 876-82.
60. Spoth R. L., Guyll M., Day S. X. Universal family-focused interventions in alcohol-use disorder prevention: cost-effectiveness and cost-benefit analyses of two interventions. J Stud Alcohol 2002; 63: 219-28.
61. Spoth R. L., Randall G. K., Trudeau L., Shin C., Redmond C. Substance use outcomes 5 1/2 years past baseline for partnership-based, family-school preventive interventions. Drug Alcohol Depend 2008; 96: 57-68.
62. Spoth R. L., Redmond C., Shin C. Randomized trial of brief family interventions for general populations: adolescent substance use outcomes 4 years following baseline. J Consult Clin Psychol 2001; 69: 627-42.
63. Brody G. H., Murry V. M., Gerrard M., Gibbons F. X., Molgaard V., McNair L. etal. The Strong African American Families Program: translating research into prevention programming. Child Dev 2004; 75: 900-17.
64. Brody G. H., Murry V. M., Kogan S. M., Gerrard M., Gibbons F. X., Molgaard V. etal. The Strong African American Families Program: a cluster-randomized prevention trial of long-term effects and a mediational model. J Consult Clin Psychol 2006; 74: 356-66.
65. Werch C. E., DiClemente C. C. A multi-component stage model for matching drug prevention strategies and messages to youth stage of use. Health Educ Res 1994; 9: 37-46.
66. Werch C. E., Owen D. M., Carlson J. M., DiClemente C. C., Edgemon P., Moore M. One-year follow-up results of the STARS for Families alcohol prevention program. Health Educ Res 2003; 18: 74-87.
67. Werch C. E., Pappas D. M., Carlson J. M., DiClemente C. C. Short- and long-term effects of a pilot prevention program to reduce alcohol consumption. Subst Use Misuse 1998; 33: 2303-21.
68. Higgins J. P. T., Green S. Cochrane Handbook for Systematic Reviews of Interventions 2009. Version 5.0.2 [updated September 2009]. Available at: (Accessed 14 December 2010 and Archived at on 27 March 2012).
69. Stevens M. M., Olson A. L., Gaffney C. A., Tosteson T. D., Mott L. A., Starr P. A pediatric, practice-based, randomised trial of drinking and smoking prevention and bicycle helmet, gun, and seatbelt safety promotion. Pediatrics 2002; 109: 490-7.
70. Haggerty K. P., Skinner M. L., MacKenzie E. P., Catalano R. F. A randomised trial of Parents Who Care: effects on key outcomes at 24-month follow-up. Prev Sci 2007; 8: 249-60.
71. Gorman D. M., Conde E., Huber J. C. Jr. The creation of evidence in 'evidence-based' drug prevention: a critique of the strengthening families program plus life skills training evaluation. Drug Alcohol Rev 2007; 26: 585-93.
72. Burchett H., Umoquit M., Dobrow M. How do we know when research from one setting can be useful in another? A review of external validity, applicability and transferability frameworks. J Health Serv Res Policy 2011; 16: 238-44.
73. Foxcroft D. R., Tsertsvadze A. Universal school-based prevention programs for alcohol misuse in young people. Cochrane Database Syst Rev 2011; (5): CD009113. doi: 10.1002/14651858.CD009113.
74. Abraham C., Michie S. A taxonomy of behavior change techniques used in interventions. Health Psychol 2008; 27: 379-87.
75. Ahmad N., Boutron I., Dechartres A., Durieux P., Ravaud P. Applicability and generalisability of the results of systematic reviews to public health practice and policy: a systematic review. Trials 2010; 11: 20.
76. Perry C. L., Williams C. L., Komro K. A., Veblen-Mortenson S., Stigler M. H. etal. Project Northland: long-term outcomes of community action to reduce adolescent alcohol use. Health Educ Res 2002; 17: 117-32.