Evaluating rapid assessment instruments' psychometric error in a practice setting: Use of receiver operating characteristics analysis

Journal of Evidence-Based Social Work

Volumn 2, Issue 1-2, 2005, Pages 137-154

  Conley, Timothy B ^a  

^a UNIVERSITY OF MONTANA   (United States)

Author keywords

Assessment; Measurement error; Psychometric error; Receiver operating analysis

Indexed keywords

EID: 33751502267     PISSN: 15433714     EISSN: 15433722     Source Type: Journal    
DOI: 10.1300/J394v02n01_08     Document Type: Article

References (38)

1. Allen, J. P., Litten, R. Z., Fertig, J. B., and Babor, T., 1997. A review of research on the Alcohol Use Disorders Identification Test. Alcoholism:Clinical and Experimental Research, 21(4):613–619.
2. American Psychiatric Association. 1994. Diagnostic and statistical manual of mental disorders, 4th ed., Washington, DC:American Psychiatric Association.
3. Babor, T. F., Stephens, R. S., and Marlatt, G. A., 1987. Verbal report methods and clinical research on alcoholism:Response bias and its minimization. Journal of Studies on Alcohol, 48:410–14.
4. Cherpitel, C. J., 1995. Analysis of cut points for screening instruments for alcohol problems in the emergency room. Journal of Studies of Alcohol, 56:695–700.
5. Cherpitel, C. J., 1997. Brief Screening Instruments for Alcoholism. Alcohol Health and Research World, 21(4):348–351.
6. Conigrave, K. M., Hall, W. D., and Saunders, J. B., 1995. The AUDIT questionnaire:Choosing a cut-off score. Research Report. Addiction, 90:1349–1356.
7. Conley, T. B., 2001. Construct Validity of the MAST and AUDIT with multiple offender drunk drivers. Journal of Substance Abuse Treatment, 20:287–295.
8. Davidson, R., 1987. Assessment of the alcohol dependence syndrome:A review of self-report screening questionnaires. British Journal of Clinical Psychology, 26:243–255.
9. Edwards, G., and Gross, M., 1976. Alcohol dependence:Provisional description of a clinical syndrome. British Medical Journal, 1:1058–1061.
10. Fischer, J., and Corcoran, K., 2000. Measures for clinical practice:A source book, 3rd ed., NY:The Free Press.
11. Gibbs, L. E., 1983. Validity and reliability of the Michigan Alcoholism Screening Test:A review. Drug and Alcohol Dependence, 12:279–285.
12. Grant, B. F., and Hasin, D. S., 1992. The Alcohol Use Disorder and Associated Disabilities Interview Schedule, Rockville, MD:National Institute of Alcohol Abuse and Alcoholism.
13. Grant, B. F., Harford, T. C., Dawson, D. A., Chou, P., Dufor, M., and Pickering, R., 1994. Prevalence of DSM-IV alcohol abuse and dependence:United States, 1992. Alcohol Health and Research World, 18(3):243–248. (NIAAA's Epidemiologic Bulletin # 35)
14. Grant, B. F., Harford, T. C., Dawson, D. A., Chou, P., and Pickering, R., 1995. The Alcohol Use Disorder and Associated Disabilities Interview Schedule (AUDADIS):Reliability of alcohol and drug modules in a general population sample. Drug and Alcohol Dependence, 39:37–44.
15. Grant, B. F., and Towle, L., 1990. Standardized diagnostic interviews for alcohol research. Alcohol Health & Research World, 14(4):340–348.
16. Horn, J. L., Skinner, H. A., Wanburg, K. W., and Foster, F. M., 1984. The Alcohol Dependence Scale (ADS), Toronto:Addiction Research Foundation.
17. Hsaio, J. K., Bartko, J. M., and Potter, W. Z., 1989. Diagnosing diagnosis:Receiver operating characteristic methods and psychiatry. Archives of General Psychiatry, 46:664–667.
18. Hudson, W. W., 1982. The Clinical Measurement Package:A Field Manual, Tallahassee, FL:WALMYR Publishing Co.
19. Lapham, S. C., Skipper, B. J., Owen, J. P., Kleyboecker, K., Teaf, D., Thompson, B., and Simpson, G., 1995. Alcohol abuse screening instruments:Normative test data collected from a first DWI offender screening program. Journal of Studies on Alcohol, 56:51–59.
20. McMurtry, S. L., Rose, S. J., and Cisler, R. A., Identifying and administering the most-used rapid assessment instruments in research. Workshop presented at the Society for Social Work and Research 7th annual conference. 2003, Washington, DC. Abstract retrieved on-line 12–21-03 at:http://www.sswr.org/papers2003/618.htm
21. Meehan, J. P., Webb, M., and Unwin, A., 1985. The Severity of Alcohol Dependence Questionnaire (SAD-Q) in a sample of Irish problem drinkers. British Journal of Addictions, 80(1):57–64.
22. Mischke, H. D., and Venneri, R., 1987. Reliability and validity of the MAST, Mortimer-Filkins Questionnaire and CAGE in DWI assessment. Journal of Studies on Alcohol, 48(5):492–501.
23. Murphy, J. M., Berwick, D. M., Weinstein, M. C., Borus, J. F., Budman, S. H., and Klerman, G. L., 1988. Performance of screening and diagnostic tests:Application of receiver operating characteristic analysis. Archives of General Psychiatry, 44:550–555.
24. Robins, L. N., Helzer, J. E., Croughan, J., and Ratcliff, K. S., 1981. National Institute of Mental Health Diagnostic Interview Schedule:Its history, characteristics, and validity. Archives of General Psychiatry, 38:381–389.
25. Ross, H. E., Gavin, D. R., and Skinner, H. A., 1990. Diagnostic validity of the MAST and the Alcohol Dependence Scale in the assessment of DSM-III alcohol disorders. Journal of Studies on Alcohol, 51(6):506–513.
26. Saunders, J. B., Aasland, O. G., Babor, T. F., De La Fuente, J. R., and Grant, M., 1993. Development of the AUDIT:WHO collaborative project on early detection of persons with harmful alcohol consumption-II. Addiction, 88:791–804.
27. Selzer, M. L., 1971. The Michigan Alcoholism Screening Test:The quest for a new diagnostic instrument. American Journal of Psychiatry, 127:1653–1658.
28. Selzer, M. L., Vinokur, A., and Rooijen, L., 1975. A self-administered short Michigan Alcoholism Screening Test (SMAST). Journal of Studies on Alcohol, 36:117–126.
29. Skipsey, K., Burleson, J. A., and Kranzler, H. R., 1997. Utility of the AUDIT for identification of hazardous and harmful drinking in drug dependent patients. Drug and Alcohol Dependence, 45(3):157–63.
30. Springer, D. W., Abell, N., and Hudson, W. W., 2002. Creating and validating rapid assessment instruments for practice and research part 1. Research on Social Work Practice, 12(3):408–439.
31. SPSS. 2001. Version 10.0 for P.C. http://www.spss.com
32. Stockwell, T., Hodgson, R., Edwards, G., Taylor, C., and Rankin, H., 1979. The development of a questionnaire to measure severity of alcohol dependence. British Journal of Addiction, 74:79–87.
33. Stockwell, T., Murphy, D., and Hodgson, R., 1983. The Severity of Alcohol Dependence Questionnaire:Its use, reliability and validity. British Journal of Addiction, 78:145–155.
34. Stockwell, T., Sitharthan, T., McGrath, D., and Lang, E., 1994. The measurement of alcohol dependence and impaired control in community samples. Addiction, 89:167–174.
35. Swets, J. A., 1996. Signal detection theory and ROC analysis in psychology and diagnostics:Collected papers, Mahawa, NJ:Lawrence Erlbaum Associates.
36. Ustun, B., Compton, W., Mager, D., Babor, T., Baiyewu, O., Chatterji, S., Cottler, L., Gogus, A., Mavreas, V., Peters, L., Pull, C., Saunders, J., Smeets, R., Stipec, M.-R., Vrasti, R., Hasin, D. S., Room, R., Van den Brink, W., Regier, D., Blaine, J., Grant, B. F., and Sartorius, N., 1997. WHO study on the reliability and validity of the alcohol and drug use disorders instruments:Overview of methods and results. Drug and Alcohol Dependence, 47:161–169.
37. Volke, R. J., Steinbauer, J. R., Cantor, S. B., and Holzer, C. E., 1997. The Alcohol Use Disorders Identification Test (AUDIT) as a screen for at risk drinking in primary care patients of different racial/ethnic backgrounds. Addiction, 92:197–206.
38. Weiczorek, W. F., Miller, B. A., and Nochajski, T. H., 1991. Screening of DWI offenders:Needs and prospects The Problem Drinker-Driver Project:New York State Division of Alcohol Abuse and Alcoholism:Research note 91–4, July 1991. ISSN # 1049–1813