Treatment services: Triangulation of methods when there is no gold standard

Substance Use and Misuse

Volumn 46, Issue 5, 2011, Pages 620-632

  Reif, Sharon ^a   Horgan, Constance M ^a   Ritter, Grant A ^a  

^a BRANDEIS UNIVERSITY   (United States)

Author keywords

kappa; methods; self reportENGL; services; substance abuse treatment

Indexed keywords

ARTICLE; COMPARATIVE STUDY; DRUG DEPENDENCE TREATMENT; HEALTH CARE DELIVERY; HEALTH CARE SURVEY; HUMAN; INFORMATION PROCESSING; METHODOLOGY; PATIENT ATTITUDE; STATISTICS;

DATA COLLECTION; HEALTH CARE SURVEYS; HEALTH SERVICES ACCESSIBILITY; HUMANS; PATIENT ACCEPTANCE OF HEALTH CARE; SUBSTANCE ABUSE TREATMENT CENTERS;

EID: 79952591086     PISSN: 10826084     EISSN: 15322491     Source Type: Journal    
DOI: 10.3109/10826084.2010.528119     Document Type: Article

References (41)

1. Brown, J. B., & Adams, M. E. (1992). Patients as reliable reporters of medical care process: Recall of ambulatory encounter events. Medical Care, 30(5), 400-411.
2. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37-46.
3. Cook, R. J. (1998). Kappa and its dependence on marginal rates. In P. Armitage&T. Colton (Eds.), The encyclopedia of biostatistics (pp. 2166-2168). New York: Wiley.
4. Corser, W., Sikorskii, A., Olomu, A., Stommel, M., Proden, C., & Holmes-Rovner, M. (2008). Concordance between comorbidity data from patient self-report interviews and medical record documentation. BMC Health Services Research, 8, 85.
5. Del Boca, F. K., & Noll, J. A. (2000). Truth or consequences: The validity of self-report data in health services research on addictions. Addiction, 95(Suppl. 3), S347-S360.
6. Digiusto, E., Seres, V., Bibby, A., & Batey, R. (1996). Concordance between urinalysis results and self-reported drug use by applicants for methadone maintenance in Australia. Addictive Behaviors, 21(3), 319-329. (Pubitemid 26162228)
7. Ducharme, L. J., Knudsen, H. K., & Roman, P. M. (2005). Computer systems in addiction treatment programs: Availability and implications for program evaluation. Evaluation and Program Planning, 28, 368-378. (Pubitemid 41722593)
8. Feinstein, A. R., & Cicchetti, D. V. (1990). High agreement but low kappa: I. The problems of two paradoxes. Journal of Clinical Epidemiology, 43(6), 543-549. (Pubitemid 20178543)
9. Fleiss, J. P. (1981). Statistical methods for rates and proportions (2nd ed.). New York: John Wiley.
10. Gagne, C., White, W., & Anthony, W. A. (2007). Recovery: A common vision for the fields of mental health and addictions. Psychiatric Rehabilitation Journal, 31(1), 32-37. (Pubitemid 47080855)
11. Garnick, D. W., Hodgkin, D., & Horgan, C. M. (2002). Selecting data sources for substance abuse services research. Journal of Substance Abuse Treatment, 22(1), 11-22. (Pubitemid 34158758)
12. Harlow, S. D., & Linet, M. S. (1989). Agreement between questionnaire data and medical records: The evidence for accuracy of recall. American Journal of Epidemiology, 129(2), 233-248. (Pubitemid 19046991)
13. Hillestad, R., Bigelow, J., Bower, A., Girosi, F., Meili, R., Scoville, R., et al. (2005). Can electronic medical record systems transform health care? Potential health benefits, savings, and costs. Health Affairs, 24(5), 1103-1117. (Pubitemid 41577096)
14. Jha, A. K., DesRoches, C. M., Campbell, E. G., Donelan, K., Rao, S. R., Ferris, T. G., et al. (2009). Use of electronic health records in U.S. hospitals. New England Journal of Medicine, 360(16), 1628-1638.
15. Kashner, T. M. (1998). Agreement between administrative files and written medical records: A case of the Department of Veterans Affairs. Medical Care, 36(9), 1324-1336. (Pubitemid 128452863)
16. Killeen, T. K., Brady, K. T., Gold, P. B., Tyson, C., & Simpson, K. N. (2004). Comparison of self-report versus agency records of service utilization in a community sample of individuals with alcohol use disorders. Drug and Alcohol Dependence, 73(2), 141-147. (Pubitemid 38068350)
17. Koppel, R. (2009). EMR entry error: Not so benign. AHRQ mortality & morbidity rounds on the web. Retrieved July 16, 2009, from http://www.webmm. ahrq.gov/case.aspx?caseID = 199
18. Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174. (Pubitemid 8054849)
19. Langendam, M. W., van Haastrecht, H. J. A., & van Ameijden, E. J. C. (1999). The validity of drug users' self-reports in a nontreatment setting: Prevalence and predictors of incorrect reporting methadone treatment modalities. International Journal of Epidemiology, 28, 514-520. (Pubitemid 29276714)
20. Lloyd-Evans, B., Johnson, S., & Slade, M. (2007). Assessing the content of mental health services: A review of measures. Social Psychiatry and Psychiatric Epidemiology, 42(8), 673-682. (Pubitemid 47190044)
21. Luck, J., Peabody, J. W., Dresselhaus, T. R., Lee, M., & Glassman, P. (2000). How well does chart abstraction measure quality? A prospective comparison of standardized patients with the medical record. American Journal of Medicine, 108(8), 642-649. (Pubitemid 30337876)
22. Maclure, M., & Willett, W. C. (1987). Misinterpretation and misuse of the kappa statistic. American Journal of Epidemiology, 126(2), 161-169. (Pubitemid 17102743)
23. Mant, J., Murphy, M., Rose, P., & Vessey, M. (2000). The accuracy of general practitioner records of smoking and alcohol use: Comparison with patient questionnaires. Journal of Public Health Medicine, 22(2), 198-201. (Pubitemid 30406602)
24. McLellan, A. T., Alterman, A. I., Cacciola, J., Metzger, D., & O'Brien, C. P. (1992). A new measure of substance abuse treatment: Initial studies of the Treatment Services Review. Journal of Nervous and Mental Disease, 180(2), 101-110.
25. McLellan, A. T., Carise, D., & Kleber, H. D. (2003). Can the national addiction treatment infrastructure support the public's demand for quality care? Journal of Substance Abuse Treatment, 25(2), 117-121. (Pubitemid 37415291)
26. McPhillips-Tangum, C. A., Aubert, R., Bailey, C. M., & Koplan, J. P. (1997). Measuring pediatric immunization status in a managed care organization: Agreement between medical charts and parent telephone interviews. HMO Practice, 11(3), 104-110.
27. Mee-Lee, D., Schulman, G. D., Fishman, M., Gastfriend, D. R., & Griffith, J. H. (Eds.). (2001). ASAM patient placement criteria for the treatment of substance-related disorders (2nd ed. revised). Chevy Chase, MD: American Society of Addiction Medicine.
28. National Center for Health Statistics. (2006). Electronic medical record use by office-based physicians: United States, 2005. Retrieved July 16, 2009, from www.cdc.gov/ nchs/data/hestat/electronic/electronic.htm
29. Quam, L., Ellis, L. B. M., Venus, P., Clouse, J., Taylor, C. G., & Leatherman, S. (1993). Using claims data for epidemiologic research: The concordance of claims-based criteria for identifying a hypertensive population. Medical Care, 31(6), 498-507.
30. Rhodes, A. E., & Fung, K. (2004). Self-reported use of mental health services versus administrative records: Care to recall? International Journal of Methods in Psychiatric Research, 13(3), 165-175. (Pubitemid 39264456)
31. Ritter, P. L., Stewart, A. L., Kaymaz, H., Sobel, D. S., Block, D. A., & Lorig, K. R. (2001). Self-reports of health care utilization compared to provider records. Journal of Clinical Epidemiology, 54(2), 136-141. (Pubitemid 32112371)
32. Roberts, R. O., Bergstralh, E. J., Schmidt, L., & Jacobsen, S. J. (1996). Comparison of self-reported and medical record health care utilization measures. Journal of Clinical Epidemiology, 49(9), 989-995 (Pubitemid 26319031)
33. SAMHSA Office of Applied Studies. (2003a). Alcohol and Drug Services Study (ADSS): Methodology report: Phases I, II and III. Rockville, MD: Substance Abuse and Mental Health Services Administration, Office of Applied Studies. Retrieved from http://www.oas.samhsa.gov/ADSS/ADSSmethods.pdf
34. SAMHSA Office of Applied Studies. (2003b). Alcohol and Drug Services Study (ADSS): The national substance abuse treatment system: Facilities, clients, services, and staffing. Rockville, MD: Substance Abuse and Mental Health Services Administration, Office of Applied Studies. Retrieved from http://www.oas.samhsa.gov/ADSS/ADSSorg.pdf
35. Spitznagel, E. L., & Helzer, J. E. (1985). A proposed solution to the base rate problem in the kappa statistic. Archives of General Psychiatry, 42, 725-728. (Pubitemid 15054618)
36. Stange, K. C., Zyzanski, S. J., Smith, T. F., Kelly, R., Langa, D.M., Flocke, S. A., et al. (1998). How valid are medical records and patient questionnaires for physician profiling and health services research? A comparison with direct observation of patients visits. Medical Care, 36(6), 851-867. (Pubitemid 128454322)
37. Substance Abuse and Mental Health Services Administration. (2002). Alcohol and Drug Services Study [data files]. Restricted files accessed via SAMHSA, 2001-2002, from www.icpsr.umich.edu
38. Thompson, B. L., O'Connor, P., Boyle, R., Hindmarsh, M., Salem, N., Simmons, K. W., et al. (2001). Measuring clinical performance: Comparison and validity of telephone survey and administrative data. Health Services Research, 36(4), 813-825. (Pubitemid 32738734)
39. Tisnado, D. M., Adams, J. L., Liu, H., Damberg, C. L., Chen, W. P., Hu, F. A., et al. (2006).What is the concordance between themedical record and patient self-report as data sources for ambulatory care? Medical Care, 44(2), 132-140. (Pubitemid 43755464)
40. Zanis, D. A., McLellan, A. T., Belding, M., & Moyer, G. (1997). A comparison of three methods of measuring the type and quantity of services provided during substance abuse treatment. Drug and Alcohol Dependence, 49, 25-32. (Pubitemid 28040900)
41. Zanis, D. A., McLellan, A. T., & Randall, M. (1994). Can you trust patient self-reports of drug use during treatment? Drug and Alcohol Dependence, 35, 127-132. (Pubitemid 24154032)