A Systematic and Transparent Approach for Assessing the Methodological Quality of Intervention Effectiveness Research: The Study Design and Implementation Assessment Device (Study DIAD)

Psychological Methods

Volumn 13, Issue 2, 2008, Pages 130-149

  Valentine, Jeffrey C ^a   Cooper, Harris ^b  

^a UNIVERSITY OF LOUISVILLE   (United States)

^b DUKE UNIVERSITY   (United States)

Author keywords

quality scale; research synthesis; study quality; systematic review

Indexed keywords

ARTICLE; HUMAN; METHODOLOGY; PSYCHOLOGY; STATISTICAL ANALYSIS; STATISTICS;

DATA INTERPRETATION, STATISTICAL; HUMANS; PSYCHOLOGY;

EID: 45449094803     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/1082-989X.13.2.130     Document Type: Article

References (29)

1. Beckerman H., de Bie R.A., Bouter L.M., de Cuyper H.J., and Oostendorp R.A.B. The efficacy of laser therapy for musculoskeletal and skin disorders: A criteria-based meta-analysis of randomized clinical trials. Physical Therapy 72 (1992) 483-491
2. Berlin J.A., and Rennie D. Measuring the quality of trials: The quality of quality scales. JAMA 282 (1999) 1083-1084
3. Blueprints for Violence Prevention. Blueprints model programs selection criteria (2004). http://www.colorado.edu/cspv/blueprints/model/criteria.html Retrieved November 7, 2005, from http://www.colorado.edu/cspv/blueprints/model/criteria.html
4. Brown S.A. Measurement of quality of primary studies for meta-analysis. Nursing Research 40 (1991) 352-355
5. Campbell D.T., and Stanley J.C. Experimental and quasi-experimental designs for research (1966), Rand McNally, Chicago
6. Chambless D.L., and Hollon S.D. Defining empirically supported therapies. Journal of Consulting and Clinical Psychology 66 (1998) 7-18
7. Cook T.D., and Campbell D.T. Quasi-experimentation: Design & analysis issues for field settings (1979), Houghton Mifflin, Boston
8. Council for International Organizations of Medical Sciences. International ethical guidelines for biomedical research involving human subjects (1993), Author, Geneva, Switzerland
9. Des Jarlais D.C., Lyles C., and Crepaz N. Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: The TREND statement. American Journal of Public Health 94 (2004) 361-366
10. Domitrovich C.E., and Greenberg M.T. The study of implementation: Current findings from effective programs that prevent mental disorders in school-aged children. Journal of Educational and Psychological Consultation 11 (2000) 173-296
11. Emanuel E.J., Wendler D., and Grady C. What makes clinical research ethical?. JAMA 283 (2000) 2701-2711
12. Flay B.R., Biglan A., Boruch R.F., González Castro F., Gottfredson D., Kellam S., et al. Standards of evidence: Criteria for efficacy, effectiveness, and dissemination. Prevention Science 6 (2005) 151-175
13. Greenberg M.T. Current and future challenges in school-based prevention: The researcher perspective. Prevention Science 5 (2004) 5-13
14. Greenland S. Quality scales are useless and potentially misleading. American Journal of Epidemiology 140 (1994) 300-302
15. Greenland S., and O'Rourke K. On the bias produced by quality scores in meta-analysis, and a hierarchical view of proposed solutions. Biostatistics 2 (2001) 463-471
16. Jüni P., Altman D.G., and Egger M. Assessing the quality of randomised controlled trials. In: Egger M., Smith G.D., and Altman D.G. (Eds). Systematic reviews in health care: Meta-analysis in context. 2nd ed. (2001), BMJ, London 87-108
17. Jüni P., Witshci A., Bloch R., and Egger M. The hazards of scoring the quality of clinical trials for meta-analysis. JAMA 282 (1999) 1054-1060
18. Kellam S.G., and Langevin D.J. A framework for understanding "evidence" in prevention research and programs. Prevention Science 4 (2003) 137-153
19. Levin J.R. Randomized classroom trials on trial. In: Phye G.D., Robinson D.H., and Levin J. (Eds). Experimental methods for educational interventions: Prospects, pitfalls and perspectives (2005), Academic Press, San Diego, CA 3-28
20. Matt G.E., and Cook T.D. Threats to the validity of research syntheses. In: Cooper H., and Hedges L.V. (Eds). The handbook of research synthesis (1994), Russell Sage Foundation, New York 503-520
21. McGrath J.B. Student and parental homework practices and the effect of English homework on student test scores (Doctoral dissertation, United States International University). Dissertation Abstracts International 53 (1992) 3490
22. Moher D., Schulz K., and Altman D.G. The CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet 357 (2001) 1191-1194
23. Mosteller F., Nave B., and Meich E.J. Why we need a structured abstract in education research. Educational Researcher 33 (2003) 29-34
24. National Registry of Evidence-Based Programs and Practices. NREPP review criteria (2007). http://www.nrepp.samhsa.gov/review-criteria.htm Retrieved September 14, 2007, from http://www.nrepp.samhsa.gov/review-criteria.htm
25. Shadish W.R., Cook T.D., and Campbell D.T. Experimental and quasi-experimental designs for generalized causal inference (2002), Houghton Mifflin, Boston, MA
26. Sherman L.W., and Gottfredson D. Appendix: Research methods. In: Sherman L., Gottfredson D., MacKenzie D., Eck J., Reuter P., and Bushway S. (Eds). Preventing crime: What works, what doesn't, what's promising: A report to the United States Congress (1997), U.S. Office of Justice Programs, Washington, DC
27. Staines G.L. The strategic combination argument. In: Leinfellner W., and Kohler E. (Eds). Developments in the methodology of social science (1974), Reidel, Dordecht, Holland 417-430
28. Valentine J.C., and Cooper H. Can we measure the quality of causal research in education?. In: Phye G.D., Robinson D.H., and Levin J. (Eds). Experimental methods for educational interventions: Prospects, pitfalls, and perspectives (2005), Academic Press, San Diego, CA 85-112
29. Valentine J.C., and McHugh C.M. The effects of attrition on baseline group comparability in randomized experiments in education: A meta-analytic review. Psychological Methods 12 (2007) 268-282