Measuring the quality of substance use disorder treatment: Evaluating the validity of the Department of Veterans Affairs continuity of care performance measure

Journal of Substance Abuse Treatment

Volumn 36, Issue 3, 2009, Pages 294-305

  Harris, Alex H S ^a   Humphreys, Keith ^a   Bowe, Thomas ^a   Kivlahan, Daniel R ^b   Finney, John W ^a  

^a STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b VA PUGET SOUND HEALTH CARE SYSTEM   (United States)

Author keywords

Continuing care; Continuity of care; Health care delivery; Performance measures; Standards of quality; Substance use disorder services; Veterans

Indexed keywords

METHADONE;

ALCOHOL ABSTINENCE; ALCOHOL INTOXICATION; ALCOHOLISM; ARTICLE; DRUG DEPENDENCE TREATMENT; HEALTH CARE QUALITY; HUMAN; MAJOR CLINICAL STUDY; METHADONE TREATMENT; OUTPATIENT; PATIENT CARE; PERFORMANCE MEASUREMENT SYSTEM; PRIORITY JOURNAL; QUESTIONNAIRE; SUBSTANCE ABUSE; TREATMENT OUTCOME; VALIDITY;

ANALYSIS OF VARIANCE; COHORT STUDIES; CONTINUITY OF PATIENT CARE; HUMANS; QUALITY ASSURANCE, HEALTH CARE; STREET DRUGS; SUBSTANCE ABUSE TREATMENT CENTERS; SUBSTANCE-RELATED DISORDERS; TREATMENT OUTCOME; UNITED STATES; UNITED STATES DEPARTMENT OF VETERANS AFFAIRS;

EID: 61349170175     PISSN: 07405472     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jsat.2008.05.011     Document Type: Article

References (47)

1. AcademyHealth. Glossary of terms commonly used in health care. from (2004). www.academyhealth.org/publications/gloaary.htm
2. Collins L.M., Schafer J.L., and Kam C.-M. A comparison of inclusive and restrictive strategies in modern missing data procedures. Psychological Methods 6 (2001) 330-351
3. Foote A., and Erfurt J.C. Effects of EAP follow-up on prevention of relapse among substance abuse clients. Journal of Studies on Alcohol 52 (1991) 241-248
4. Friedman J.H. Greedy function approximation: A gradient boosting machine. Annals of Statistics 29 (2001) 1189-1232
5. Garnick D., Horgan C., and Chalk M. Performance measures for alcohol and other drug services. Retrieved Sept 12, 2006, from (2006). http://pubs.niaaa.nih.gov/publications/arh291/19-26.htm
6. Glabman M. Health plans can learn from VHA turnaround. Managed care magazine (2007). http://www.managedcaremag.com/archives/0702/0702.veterans.html
7. Hayward R.A. Performance measurement in search of a path. New England Journal of Medicine 356 (2007) 951-953
8. Heath I., Hippisley-Cox J., and Smeeth L. Measuring performance and missing the point?. British Medical Journal 335 (2007) 1075-1076
9. Hedeker D., and Gibbons R.D. Application of random-effects pattern-mixture models for missing data in longitudinal studies. Psychological Methods 2 (1997) 64-78
10. Heilizer F. Some cautions concerning the use of change scores. Journal of Clinical Psychology 15 (1959) 447-449
11. Humpheys, K., Harris, A., & Kivlahan, D. (in review). Performance monitoring of substance use disorder interventions in the Veterans Health Administration.
12. Kerr E.A., and Fleming B. Making performance indicators work: Experiences of US Veterans Health Administration. British Medical Journal 335 (2007) 971-973
13. Lash S.J., Stephens R.S., Burden J.L., Grambow S.C., Demarce J.M., Jones M.E., et al. Contracting, prompting, and reinforcing substance use disorder continuing care: A randomized clinical trial. Psychology of Addictive Behaviors 21 (2007) 387-397
14. Lilford R.J., Brown C.A., and Nicholl J. Use of process measures to monitor the quality of clinical practice. British Medical Journal 335 (2007) 648-650
15. Little R.J.A. Pattern-mixture models for multivariate incomplete data. Journal of the American Statistical Association 88 (1993) 125-133
16. Lord F. A paradox in the interpretation of group comparisons. Psychological Bulletin 72 (1967) 304-305
17. Madigan D., and Ridgeway G. Discussion of "least angle regression" by Efron et al. Annals of Statistics 32 (2004) 465-469
18. Majeed A., Lester H., and Bindman A.B. Improving the quality of care with performance indicators. British Medical Journal 335 (2007) 916-918
19. Maxwell S., and Howard G. Change scores-Necessarily anathema?. Educational and Psychological Measurement 41 (1981) 747-756
20. McCaffrey D.F., Ridgeway G., and Morral A.R. Propensity score estimation with boosted regression for evaluating causal effects in observational studies. Psychological Methods 9 (2004) 403-425
21. McKay J.R. Effectiveness of continuing care interventions for substance abusers. Implications for the study of long-term treatment effects. Evaluation Revivew 25 (2001) 211-232
22. McKay J.R., Alterman A.I., Cacciola J.S., O'Brien C.P., Koppenhaver J.M., and Shepard D.S. Continuing care for cocaine dependence: Comprehensive 2-year outcomes. Journal of Consulting and Clinical Psychology 67 (1999) 420-427
23. McLellan A., Chalk M., and Bartlett J. Outcomes, performance, and quality-What's the difference?. Journal of Substance Abuse Treatment 32 (2007) 331-340
24. McLellan A., Kushner H., Metzger D., Peters R., Smith I., Grissom G., et al. The fifth edition of the Addiction Severity Index. Journal of Substance Abuse Treatment 9 (1992) 199-213
25. McLellan A.T., McKay J.R., Forman R., Cacciola J., and Kemp J. Reconsidering the evaluation of addiction treatment: From retrospective follow-up to concurrent recovery monitoring. Addiction 100 (2005) 447-458
26. Moos R., Schaefer J., Andrassy J., and Moos B. Outpatient mental health care, self-help groups, and patients' one-year treatment outcomes. Journal of Clinical Psychology 57 (2001) 273-287
27. Moos R.H., and Moos B.S. Protective resources and long-term recovery from alcohol use disorders. Drug and Alcohol Dependence 86 (2007) 46-54
28. Moos R.H., Finney J.W., Ouimette P.C., and Suchinsky R.T. A comparative evaluation of substance abuse treatment: I. Treatment orientation, amount of care, and 1-year outcomes. Alcoholism: Clinical and Experimental Research 23 (1999) 529-536
29. Oliver A. The Veterans Health Administration: An American success story?. Milbank Quarterly 85 (2007) 5-35
30. Patterson D.G., Macpherson J., and Brady N.M. Community psychiatric nurse aftercare for alcoholics: A five-year follow-up study. Addiction 92 (1997) 459-468
31. Ouimette P.C., Moos R.H., and Finney J.W. Influence of outpatient treatment and 12-step group involvement on one-year substance abuse treatment outcomes. Journal of Studies on Alcohol 59 5 (1998) 513-522
32. R Development Core Team. R: A language and environment for statistical computing (2005), R Foundation for Statistical Computing, Vienna
33. Robinson W. Ecological correlations and the behavior of individuals. American Sociological Review 15 (1950) 351-357
34. Rosen C.S., Henson B.R., Finney J.W., and Moos R.H. Consistency of self-administered and interview-based Addiction Severity Index composite scores. Addiction 95 (2000) 419-425
35. Rubin D.B. Inference and missing data. Biometrika 63 (1976) 581-592
36. Schaefer J., Harris A., Cronkite R., and Turrubiartes P. Treatment staff's continuity of care practices, patients' engagement in continuing care, and abstinence following outpatient substance use disorder treatment. Journal of Studies on Alcohol and Drugs 69 (2008) 1-10
37. Schafer J.L. Analysis of incomplete multivariate data (1997), Chapman & Hall, New York
38. Schafer J.L., and Graham J.W. Missing data: Our view of the state of the art. Psychological Methods 7 (2002) 147-177
39. Simpson D.D., Joe G.W., and Rowan-Szal G.A. Drug abuse treatment retention and process effects on follow-up outcomes. Drug and Alcohol Dependence 47 (1997) 227-235
40. Tiet Q.Q., Brynes H.F., Barnett P., and Finney J.W. A practical system for monitoring the outcomes of substance use disorder patients. Journal of Substance Abuse Treatment 30 (2006) 337-347
41. Van Buuren S., and Oudshoorn C.G.M. Multivariate imputation by chained equations. R package version 1.14 (2005)
42. Veterans Health Administration Office of Quality and Performance. FY05 VHA Performance Measure Technical Manual (2005), Author, Washington, DC
43. Walter L.C., Davidowitz N.P., Heineken P.A., and Covinsky K.E. Pitfalls of converting practice guidelines into quality measures: Lessons learned from a VA performance measure. JAMA 291 (2004) 2466-2470
44. Werner R.M., and Bradlow E.T. Relationship between Medicare's hospital compare performance measures and mortality rates. JAMA 296 (2006) 2694-2702
45. Witbrodt J., Bond J., Kaskutas L.A., Weisner C., Jaeger G., Pating D., et al. Day hospital and residential addiction treatment: Randomized and nonrandomized managed care clients. Journal of Consulting and Clinical Psychology 75 6 (2007) 947-959
46. Wright D. Comparing groups in a before-after design: When t test and ANCOVA produce different results. British Journal of Educational Psychology 76 (2006) 663-675
47. Zhang Z., Friedmann P.D., and Gerstein D.R. Does retention matter? Treatment duration and improvement in drug use. Addiction 98 (2003) 673-684