Test-retest reliability of psychological and neurobehavioral tests self-administered by computer

Assessment

Volumn 6, Issue 1, 1999, Pages 21-32

  Campbell, Keith A ^a   Rohlman, Diane S ^b   Storzbach, Daniel ^b   Binder, Laurence M ^b   Anger, W Kent ^b   Kovera, Craig A ^b   Davis, Kelly L ^b   Grossmann, Sandra J ^b  

^a Clinical and Consulting Psychology   (United States)

^b NONE

Author keywords

BAI (beck anxiety inventory), neurobehavioral assessment; BDI (beck depression inventory); Computer assessment; F 36; PCL (PTSD checklist); S; SCL 90 R, MMPI 2; Test retest reliability

Indexed keywords

ADULT; ARTICLE; COMPUTER ASSISTED DIAGNOSIS; EDUCATIONAL STATUS; ETHNIC GROUP; FEMALE; HUMAN; MALE; METHODOLOGY; NEUROPSYCHOLOGICAL TEST; PSYCHOLOGIC TEST; PSYCHOMETRY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; STANDARD; TIME;

ADULT; DIAGNOSIS, COMPUTER-ASSISTED; EDUCATIONAL STATUS; ETHNIC GROUPS; FEMALE; HUMANS; MALE; NEUROPSYCHOLOGICAL TESTS; PSYCHOLOGICAL TESTS; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; TIME FACTORS;

EID: 0033090074     PISSN: 10731911     EISSN: None     Source Type: Journal    
DOI: 10.1177/107319119900600103     Document Type: Article

References (72)

1. Addiction Research & Consultation. (1988). Substance Abuse Subtle Screening Inventory manual. Spencer, IN: Glen A. Miller.
2. Addiction Research & Consultation. (1994). Adult SASSI-2 manual supplement. Spencer, IN: Glen A. Miller.
3. American Psychological Association (1986). Guidelines for computer-based tests and interpretations. Washington, DC: Author.
4. Anger, W. K., Rohlman, D. S., & Sizemore, O. J. (1994). A comparison of instruction formats for administering a computerized behavioral test. Behavior Research Methods, Instruments, & Computers, 26, 209-212.
5. Anger, W. K., Rohlman, D. S., Sizemore, O. J., Kovera, C. A., Gibertini, M., & Ger, J. (1996). Human behavioral assessment in neurotoxicology: Producing appropriate test performance with written and shaping instructions. Neurotoxicology and Teratology, 18, 371-379.
6. Artiola i Fortuny, L., & Heaton, R. K. (1996). Standard versus computerized administration of the Wisconsin Card Sorting Test. Clinical Neuropsychologist, 10, 419-424.
7. Barnard, G. W., Hankins, G. C., & Robbins, L. (1992). Prior life trauma, post-traumatic stress symptoms, sexual disorders and character traits in sex offenders: An exploratory study. Journal of Traumatic Stress Studies, 5, 393-420.
8. Beaumont, G. J., & French, C. C. (1987). A clinical field study of eight automated psychometric procedures: The Leicester/DHSS project. International Journal of Man-Machine Studies, 26, 661-682.
9. Beck, A. T., Epstein, N., Brown, G., & Steer, R. A. (1988). An inventory for measuring clinical anxiety: Psychometric properties. Journal of Consulting and Clinical Psychology, 56, 893-897.
10. Beck, A. T., Rush, A. J., Shaw, B. F., & Emery, G. (1979). Cognitive therapy of depression. New York: Guilford.
11. Beck, A. T., & Steer, R. A. (1993). Beck Anxiety Inventory manual. San Antonio, TX: The Psychological Corporation.
12. Beck, A. T., Steer, R. A., & Garbin, M. (1988). Psychometric properties of the Beck Depression Inventory: Twenty-five years of evaluation. Clinical Psychology Review, 8, 77-100.
13. Benton, A. L., Hamsher, K. des., Varney, N. R., & Spreen, O. (1983). Contributions to neuropsychological assessment. New York: Oxford University Press.
14. Binder, L. M. (1993). Assessment of malingering after mild head trauma with the Portland Digit Recognition Test. Journal of Clinical and Experimental Neuropsychology, 15, 170-182.
15. Brazier, J. E., Harper, R., Jones, N. M. B., O'Cathain, A., Thomas, K. J., Usherwood, T., & Westlake, L. (1992). Validating the SF-36 Health Survey Questionnaire: New outcome measure for primary care. British Medical Journal, 305, 160-164.
16. Burke, J. D., Burke, K. C., Baker, J. H., & Hillis, A. (1995). Test-retest reliability in psychiatric patients of the SF-36 Health Survey. International Journal of Methods in Psychiatric Research, 5, 189-194.
17. Butcher, J. N., Dahlstrom, W. G., Graham, J. R., Tellegen, A., & Kaemmer, B. (1989). Minnesota Multiphasic Personality Inventory-2: Manual for administration and scoring. Minneapolis: University of Minnesota Press.
18. Carr, A. C., Ancill, R. J., Ghosh, A., & Margo, A. (1981). Direct assessment of depression by microcomputer. A feasibility study. Acta Psychiatrica Scandinavica, 64, 415-422.
19. Derogatis, L. R. (1994). Symptom Checklist-90-R (SCL-90-R) administration, scoring, and procedures manual (3rd ed.). Minneapolis, MN: National Computer Systems.
20. Derogatis, L. R., Rickels, K., & Rock, A. (1976). The SCL-90 and the MMPI: A step in the validation of a new self-report scale. British Journal of Psychiatry, 128, 280-289.
21. Devore, J., & Peck, R. (1993). Statistics: The exploration and analysis of data (2nd ed.). Belmont, CA: Duxbury Press.
22. Donders, F. C. (1969). On the speed of mental processes. (Trans. By W. G. Koster) Acta Psycologica, 30, 412-431.
23. Duffy, J. C., & Waterton, J. J. (1984). Under reporting of alcohol consumption in sample surveys: The effect of computer interviewing in fieldwork. British Journal of Addiction, 79, 303-308.
24. Duthie, B. (1984). A critical examination of computer-administered psychological tests. In M. D. Schwartz (Ed.), Using computers in clinical practice: Psychotherapy and mental health applications. New York: The Haworth Press.
25. Grant, C. D., & Nash, M. R. (1995). The computer-assisted Hypnosis Scale: Standardization and norming of a computer-administered measure of hypnotic ability. Psychological Assessment, 7, 49-58.
26. Greaud, V. A., & Green, B. F. (1986). Equivalence of conventional and computer presentation of speed tests. Applied Psychological Measurement, 10, 23-34.
27. Hammarberg, M. (1992). Penn Inventory for Post-traumatic Stress Disorder: Psychometric properties. Psychological Assessment, 4, 67-76.
28. Hänninen, H., & Lindström, K. (1989) rev. Neuro-behavioral Test Battery of the Institute of Occupational Health. Helsinki, Finland: Institute of Occupational Health.
29. Hart, R. R., & Goldstein, M. A. (1985). Computer assisted psychological assessment. Computers in Human Services, 1, 69-75.
30. Hofer, P. J., & Green, B. F. (1985). The challenge of competence and creativity in computerized psychological testing. Journal of Consulting and Clinical Psychology, 53, 826-838.
31. Holden, R. R., & Hickman, D. (1987). Computerized versus standard administration of the Jenkins Activity Survey (Form T). Journal of Human Stress, 13, 175-179.
32. Horowitz, L. M., Rosenberg, S. E., Baer, B. A., Ureno, G., & Villasenor, V. S. (1988). Inventory of interpersonal problems: Psychometric properties and clinical applications. Journal of Consulting and Clinical Psychology, 56, 885-892.
33. Jackson, D. N. (1985). Computer based personality testing. Special issue: Computer assessment and interpretation: Prospects, promise and pitfalls. Computers in Human Behavior, 1, 255-264.
34. Keane, T. M., Caddell, J. M., & Taylor, K. L. (1988). Mississippi Scale for combat-related posttraumatic stress disorder: Three studies in reliability and validity. Journal of Consulting and Clinical Psychology, 56, 85-90.
35. Keane, T. M., Fairbank, J. A., Caddell, J. M., Zimering, R. T., Taylor, K. L., & Mora, C. A. (1989). Clinical evaluation of a measure to assess combat exposure. Psychological Assessment, 1, 53-55.
36. Kennedy, R. S., Baltzley, D. R., Turnage, J. J., & Jones, M. B. (1989). Factor analysis and predictive validity of microcomputer-based tests. Perceptual and Motor Skills, 69, 1059-1074.
37. Kovera, C. A., Anger, W. K., Campbell, K. A., Binder, L. M., Storzbach, D., Davis, K. L., & Rohlman, D. S. (1996). Computer-administration of questionnaires: A Health Screening System (HSS) developed for veterans. Neurotoxicology and Teratology, 18, 511-518.
38. Kyllonen, P. C. (1991). Principles for creating a computerized test battery. Intelligence, 15, 1-15.
39. Larson, G. E., & Alderton, D. (1997). Test-retest results for the ECAT battery. Military Psychology, 9, 39-47.
40. Lautenschlager, G. J., & Flaherty, V. L. (1990). Computer administrations of questions: More desirable or more social desirability. Journal of Applied Psychology, 75, 310-314.
41. Letz, R. (1990). The neurobehavioral evaluation system: An international effort. In B. L. Johnson, W. K. Anger, A. Durao, & C. Xintaras (Eds.), Advances in neurobehavioral toxicology: Applications in environmental and occupational health (pp. 189-201). Chelsea, MI: Lewis.
42. Lewis, G., Pelosi, A. J., Glover, E., Wilkinson, G., Stansfeld, S. A., Williams, P., & Shepherd, M. (1988). The development of a computerized assessment for minor psychiatric disorder. Psychological Medicine, 18, 737-743.
43. Lezak, M. D. (1995). Neuropsychological assessment (3rd ed.). New York: Oxford University Press.
44. Lucas, R. W., Mullin, P. J., Luna, C. B. X., & McIlroy, D. C. (1977). Psychiatrists and a computer as interrogators of patients with alcohol related illnesses: A comparison. British Journal of Psychiatry, 131, 160-167.
45. Malcom, R., Sturgis, E. T., Anton, R. F., & Williams, L. (1989). Computer-assisted diagnosis of alcoholism. Computers in Human Services, 5, 163-170.
46. Matarazzo, J. D. (1983). Computerized psychological testing. Science, 221, 323.
47. Matarazzo, J. D. (1986). Computerized clinical psychological test interpretations: Unvalidated plus all mean and no sigma. American Psychologist, 41, 14-24.
48. Mead, A. D., & Drasgow, F. (1993). Equivalence of computerized and paper-and pencil cognitive ability tests: A meta-analysis. Psychological Bulletin, 114, 449-458.
49. Moreland, K. L. (1985). Validation of computer-based test interpretations: Problems and prospects. Journal of Consulting and Clinical Psychology, 53, 816-825.
50. Navaline, H. A., Snider, E. C., Petro, C. J., Tobin, D., Metzger, D., Alterman, A. I., & Woody, G. E. (1994). Preparations for AIDS vaccine trials. An automated version of the Risk Assessment Battery (RAB): Enhancing the assessment of risk behaviors. AIDS Research & Human Retroviruses, 10, Suppl. 2:S281-283.
51. Neal, L. A., Busuttil, W., Herapath, R., & Strike, P. W. (1994). Development and validation of the computerized Clinician Administered Post-traumatic Stress disorder scale-1-Revised. Psychological Medicine, 24, 701-706.
52. Pinsoneault, T. B. (1996). Equivalency of computer-assisted and paper-and-pencil administered versions of the Minnesota Multiphasic Personality Inventory-2. Computers in Human Behavior, 12, 291-300.
53. Reitan, R. M., & Davison, L. A. (1974). Clinical neuropsychology: Current status and applications. New York: Hemisphere.
54. Rohlman, D. S., Sizemore, O. J., Anger, W. K., & Kovera, C. A. (1996). Computerized neurobehavioral testing: Techniques for improving test instructions. Neurotoxicology and Teratology, 18, 407-412.
55. Roper, B. L., Ben-Porath, Y. S., & Butcher, J. N. (1991). Comparability of computerized adaptive and conventional testing with the MMPI-2. Journal of Personality Assessment, 57, 278-290.
56. Sarason, I., Johnson, E., & Siegel, J. (1978). Assessing the impact of life changes. Journal of Consulting and Clinical Psychology, 46, 932-946.
57. Schuldberg, D. (1988). The MMPI is less sensitive to the automated testing format than it is to repeated testing: Item and scale effects. Computers in Human Behavior, 4, 285-298.
58. Schuldberg, D. (1990). Varieties of inconsistency across test occasions: Effects of computerized test administration and repeated testing. Journal of Personality Assessment, 55, 168-182.
59. Simola, S. K., & Holden, R. R. (1992). Equivalence of computerized and standard administration of the Piers-Harris children's self-concept scale. Journal of Personality Assessment, 58, 287-294.
60. Skinner, H., & Pakula, A. (1986). Challenge of computers in psychological assessment. Professional Psychology: Research and Practice, 17, 44-50.
61. Smith, A. (1968). SDMT: A neuropsychological test for economic screening. Hearing Disorders, 3, 83-91.
62. Spray, J. A., Ackerman, T. A., Reckase, M. D., & Carlson, J. E. (1989). Effect of medium of item presentation on examinee performance and item characteristics. Journal of Educational Measurement, 26, 261-271.
63. Ware, J. E., Sherbourne, C. A., & Davies, A. R. (1988). A short-form general health survey. Santa Monica, CA: RAND Corporation Publication Number P-7444.
64. Ware, J. E., & Sherbourne, C. D. (1992). The MOS 36-item Short-Form Health Survey (SF-36). I. Conceptual framework and item selection. Medical Care, 30, 473-483.
65. Watson, D., Clark, L. A., and Tellegen, A. (1988). Development and validation of brief measures of Positive and Negative Affect: The PANAS Scales. Journal of Personality and Social Psychology, 54, 1063-1070.
66. Weathers, F. W., Litz, B. T., Herman, D. S., Huska, J. A., & Keane, T. M. (1993, October). The PTSD Checklist (PCL): Reliability, validity, and diagnostic utility. Paper presented at the meeting of the International Society for Traumatic Stress Studies, San Antonio, TX.
67. Webster, J., & Compeau, D. (1996). Computer-assisted versus paper-and-pencil administration of questionnaires. Behaviour Research Methods, Instruments & Computers, 28, 567-576.
68. Wilson, F. R., Genco, K. T., & Yager, G. G. (1985). Assessing the equivalence of paper-and-pencil vs computerized tests: Demonstrating a promising methodology. Computers in Human Behavior, 1, 265-275.
69. Wolfe, J., Brown, P. J., Furey, J., & Levin, K. B. (1993). Development of a wartime stressor scale for women. Psychological Assessment, 5, 330-335.
70. Wood, S. (1984). Computer use in testing and assessment. Journal of Counseling and Development, 63, 177-179.
71. Yokley, J. M., Coleman, D. J., & Yates, B. T. (1990). Cost effectiveness of three child mental health assessment methods: Computer-assisted assessment is effective and inexpensive. Journal of Mental Health Administration, 17, 99-107.
72. Youngjohn, J. R., Larrabee, G. J., Glenn, J., & Crook, T. H. (1992). Test-retest reliability of computerized, everyday memory measures and traditional memory tests. Clinical Neuropsychologist, 6, 276-286.