Computerized neuropsychological assessment devices: Joint position paper of the American academy of clinical neuropsychology and the national academy of neuropsychology

Archives of Clinical Neuropsychology

Volumn 27, Issue 3, 2012, Pages 362-373

  Bauer, Russell M ^a,b   Iverson, Grant L ^c,d   Cernich, Alison N ^a,e   Binder, Laurence M ^c,f   Ruff, Ronald M ^c,g   Naugle, Richard I ^a,h  

^a American Academy of Clinical Neuropsychology   (United States)

^b UNIVERSITY OF FLORIDA   (United States)

^c National Academy of Neuropsychology   (United States)

^d UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^e VETERANS AFFAIRS MEDICAL CENTER   (United States)

^f OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

^g San Francisco Clinical Neurosciences   (United States)

^h LERNER RESEARCH INSTITUTE   (United States)

Author keywords

Computerized testing; Neurocognition; Neuropsychological test validity

Indexed keywords

EID: 84863320553     PISSN: 08876177     EISSN: 18735843     Source Type: Journal    
DOI: 10.1093/arclin/acs027     Document Type: Review

References (86)

1. American Academy of Clinical Neuropsychology. (2007). American Academy of Clinical Neuropsychology (AACN) practice guidelines for neuropsychological assessment and consultation. Clinical Neuropsychology, 21 (2), 209-231.
2. American Psychological Association. (1986). Guidelines for computer-based tests and interpretations. Washington, DC: Author.
3. American Psychological Association. (1999). Standards for educational and psychological testing. Washington, DC: Author.
4. American Psychological Association. (2007). Record keeping guidelines. American Psychologist, 62, 993-1004.
5. Anger, W. K., Storzbach, D., Binder, L. M., Campbell, K. A., Rohlman, D. S., McCauley, L., et al. (1999). Neurobehavioral deficits in Persian Gulf veterans: Evidence from a population-based study. Portland Environmental Hazards Research Center. Journal of the International Neuropsychological Society, 5 (3), 203-212. (Pubitemid 29201653)
6. APA. (2010). Ethical Principles of Psychologists and Code of Conduct (2010 Amendments). Retrieved from http://www.apa.org/ethics/code/index.aspx.
7. Berger, S. G., Chibnall, J. T., & Gfeller, J. D. (1997). Construct validity of the computerized version of the Category Test. Journal of Clinical Psychology, 53 (7), 723-726. (Pubitemid 27454574)
8. Bleiberg, J., Cernich, A. N., Cameron, K., Sun, W., Peck, K., Ecklund, P. J., et al. (2004). Duration of cognitive impairment after sports concussion. Neurosurgery, 54 (5), 1073-1078; discussion 1078-1080.
9. Bleiberg, J., Garmoe, W. S., Halpern, E. L., Reeves, D. L., & Nadler, J. D. (1997). Consistency of within-day and across-day performance after mild brain injury. Neuropsychiatry, Neuropsychology, and Behavioral Neurology, 10 (4), 247-253. (Pubitemid 27477902)
10. Bolfer, C., Casella, E. B., Baldo, M. V., Mota, A. M., Tsunemi, M. H., Pacheco, S. P., et al. (2010). Reaction time assessment in children with ADHD. Arquivos de Neuro-Psiquiatria, 68 (2), 282-286.
11. Boone, K. B. (Ed.). (2007). Assessment of feigned cognitive impairment: A neuropsychological perspective. New York: Guilford Press.
12. Boone, K. B. (2009). The need for continuous and comprehensive sampling of effort/response bias during neuropsychological examinations. The Clinical Neuropsychologist, 23, 729-741.
13. Broglio, S. P., Ferrara, M. S., Macciocchi, S. N., Baumbartner, T. A., & Elliott, R. (2007). Test-retest reliability of computerized concussion assessment programs. Journal of Athletic Training, 42, 509-514. (Pubitemid 351377899)
14. Brooks, B. L., Iverson, G. L., Sherman, E. M., & Roberge, M. C. (2010). Identifying cognitive problems in children and adolescents with depression using computerized neuropsychological testing. Applied Neuropsychology, 17 (1), 37-43.
15. Bush, S. S., Ruff, R. M., Troster, A. I., Barth, J. T., Koffler, S. P., Pliskin, N. H., et al. (2005). Symptom validity assessment: Practice issues and medical necessity NAN policy & planning committee. Archives of Clinical Neuropsychology, 20 (4), 419-426. (Pubitemid 40719546)
16. Campbell, K. A., Rohlman, D. S., Storzbach, D., Binder, L. M., Anger, W. K., Kovera, C. A., et al. (1999). Test-retest reliability of psychological and neurobehavioral tests self-administered by computer. Assessment, 6 (1), 21-32.
17. Cernich, A., Reeves, D., Sun, W., & Bleiberg, J. (2007). Automated Neuropsychological Assessment Metrics sports medicine battery. Archives of Clinical Neuropsychology, 22(Suppl. 1), S101-S114.
18. Cernich, A. N., Brennana, D. M., Barker, L. M., & Bleiberg, J. (2007). Sources of error in computerized neuropsychological assessment. Archives of Clinical Neuropsychology, 22S, S39-S48.
19. Chamberlain, S. R., Robbins, T. W., Winder-Rhodes, S., Muller, U., Sahakian, B. J., Blackwell, A. D., et al. (2011). Translational approaches to frontostriatal dysfunction in attention-deficit/hyperactivity disorder using a computerized neuropsychological battery. Biological Psychiatry, 69 (12), 1192-1203.
20. Choca, J., & Morris, J. (1992). Administering the Category Test by computer: Equivalence of results. The Clinical Neuropsychologist, 6 (1), 9-15.
21. Collie, A., Makdissi, M., Maruff, P., Bennell, K., & McCrory, P. (2006). Cognition in the days following concussion: Comparison of symptomatic versus asymptomatic athletes. Journal of Neurology, Neurosurgery and Psychiatry, 77 (2), 241-245. (Pubitemid 43220852)
22. Collins, M. W., Lovell, M. R., Iverson, G. L., Ide, T., & Maroon, J. (2006). Examining concussion rates and return to play in high school football players wearing newer helmet technology: A three year prospective cohort study. Neurosurgery, 58 (2), 275-286.
23. Constantinou, M., Bauer, L., Ashendorf, L., Fisher, J. M., & McCaffrey, R. J. (2005). Is poor performance on recognition memory effort measures indicative of generalized poor performance on neuropsychological tasks? Archives of Clinical Neuropsychology, 20, 191-198. (Pubitemid 40222156)
24. Creeger, C. P., Miller, K. F., & Paredes, D. R. (1990). Micromanaging time: Measuring and controlling timing errors in computer-controlled experiments. Behavior Research Methods, Instruments, and Computers, 22, 34-79.
25. Cronbach, L. J. (1971). Test validation. In R. L. Thorndike (Ed.), Educational measurement (2nd ed., pp. 443-507). Washington, DC: American Counsel on Education.
26. Crook, T. H., Kay, G. G., & Larrabee, G. J. (2009). Computer-based cognitive testing. In I. Grant, & K. M. Adams (Eds.), Neuropsychological assessment of neuropsychiatric and neuromedical disorders (3rd ed., pp. 84-100). New York: Oxford University Press.
27. Doniger, G. M., Dwolatzky, T., Zucker, D. M., Chertkow, H., Crystal, H., Schweiger, A., et al. (2006). Computerized cognitive testing battery identifies mild cognitive impairment and mild dementia even in the presence of depressive symptoms. American Journal of Alzheimer's Disease and Other Dementias, 21 (1), 28-36.
28. Doniger, G. M., Zucker, D. M., Schweiger, A., Dwolatzky, T., Chertkow, H., Crystal, H., et al. (2005). Towards practical cognitive assessment for detection of early dementia: A 30-minute computerized battery discriminates as well as longer testing. Current Alzheimer Research, 2 (2), 117-124. (Pubitemid 40862871)
29. Dorion, A. A., Sarazin, M., Hasboun, D., Hahn-Barma, V., Dubois, B., Zouaoui, A., et al. (2002). Relationship between attentional performance and corpus callosum morphometry in patients with Alzheimer's disease. Neuropsychologia, 40 (7), 946-956. (Pubitemid 34233633)
30. Downing, S. M., & Haladyna, T. M. (Eds.). (2006). Handbook of test development. Mahwah, NJ: Lawrence Erlbaum Associates Publishers.
31. Dwolatzky, T., Whitehead, V., Doniger, G. M., Simon, E. S., Schweiger, A., Jaffe, D., et al. (2004). Validity of the Mindstreams computerized cognitive battery for mild cognitive impairment. J Mol Neurosci, 24 (1), 33-44. (Pubitemid 41359165)
32. Feldstein, S. N., Keller, F. R., Protman, R. E., Durham, R. L., Klebe, K. J., & Davis, H. P. (1999). A comparison of computerized and standard version of the Wisconsin Card Sorting Test. The Clinical Neuropsychologist, 13, 303-313. (Pubitemid 30040142)
33. Forster, K. I., & Forster, J. C. (2003). DMDX: A Windows display program with millisecond accuracy. Behavior Research Methods, Instruments, and Computers, 35, 116-124. (Pubitemid 37545055)
34. Franzen, M. D. (1989). Reliability and validity in neuropsychological assessment. New York: Plenum Press.
35. Franzen, M. D. (2000). Reliability and validity in neurological assessment (2nd ed.). New York: Kluwer Academic/Plenum Press.
36. Gaver, W.W. (1991). Technology affordances. In CHI 1991 Proceedings of the SIGCHI conference on human factors in computing systems: Reaching through technology. New York: Association for Computing Machinery.
37. Gofen, A., & Mackeben, M. (1997). An introduction to accurate display timing for PC's under "Windows". Spatial Vision, 10 (4), 361-368. (Pubitemid 127582513)
38. Green, P., Rohling, M. L., Lees-Haley, P. R., & Allen, L. M., 3rd (2001). Effort has a greater effect on test scores than severe brain injury in compensation claimants. Brain Injury, 15 (12), 1045-1060. (Pubitemid 33120963)
39. Gualtieri, C. T., & Johnson, L. G. (2005). Neurocognitive testing supports a broader concept of mild cognitive impairment. American Journal of Alzheimer's Disease and Other Dementias, 20 (6), 359-366. (Pubitemid 43030925)
40. Gualtieri, C. T., & Johnson, L. G. (2006). Efficient allocation of attentional resources in patients with ADHD: Maturational changes from age 10 to 29. Journal of Attention Disorders, 9 (3), 534-542. (Pubitemid 43171145)
41. Gualtieri, C. T., & Johnson, L. G. (2008). A computerized test battery sensitive to mild and severe brain injury. Medscape Journal of Medicine, 10 (4), 90.
42. Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G. J., & Millis, S. R., & Conference Participants. (2009). American Academy of Clinical Neuropsychology Consensus Conference Statement on the neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 23 (7), 1093-1129.
43. Hitchcock, E. (2006). Computer access for people after stroke. Topics in Stroke Rehabilitation, 13, 22-30. (Pubitemid 44320639)
44. Iverson, G. L., Brooks, B. L., Ashton, V. L., Johnson, L. G., & Gualtieri, C. T. (2009). Does familiarity with computers affect computerized neuropsychological test performance? Journal of Clinical and Experimental Neuropsychology, 31, 594-604.
45. Iverson, G. L., Brooks, B. L., Collins, M. W., & Lovell, M. R. (2006). Tracking neuropsychological recovery following concussion in sport. Brain Injury, 20 (3), 245-252.
46. Iverson, G. L., Brooks, B. L., Langenecker, S. A., & Young, A. H. (2011). Identifying a cognitive impairment subgroup in adults with mood disorders. Journal of Affective Disorders, 132, 360-367.
47. Iverson, G. L., Brooks, B. L., Lovell, M. R., & Collins, M. W. (2006). No cumulative effects for one or two previous concussions. British Journal of Sports Medicine, 40 (1), 72-75. (Pubitemid 43028600)
48. Kramer, J. J. (1987). On the question of professional standards for computer-based test interpretation. American Psychologist, 42, 889-890.
49. Larrabee, G. J. (2007). Assessment of malingered neuropsychological deficits. New York: Oxford University Press.
50. Marx, B. P., Brailey, K., Proctor, S. P., MacDonald, H. Z., Graefe, A. C., Amoroso, P., et al. (2009). Association of time since deployment, combat intensity, and posttraumatic stress symptoms with neuropsychological outcomes following Iraq war deployment. Archives of General Psychiatry, 66 (9), 996-1004.
51. Matarazzo, J. D. (1985). Clinical psychological test interpretations by computer: Hardware outpaces software. Computers in Human Behavior, 1, 235-253.
52. Matarazzo, J. D. (1986). Computerized clinical psychological test interpretations: Unvalidated plus all mean and no sigma. American Psychologist, 41, 96.
53. Matarazzo, J. D. (1990). Psychological assessment versus psychological testing: Validation from Binet to the school, clinic, and courtroom. American Psychologist, 45, 999-1017.
54. McInnes, W. J., & Taylor, T. L. (2001). Millisecond timing on PC's and Macs. Behavior Research Methods Instruments and Computers, 31 (1), 129-136.
55. McLay, R., Spira, J., & Reeves, D. (2010). Use of computerized neuropsychological testing to help determine fitness to return to combat operations when taking medication that can influence cognitive function. Military Medicine, 175 (12), 945-946.
56. Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13-103). New York: American Council on Education and Macmillan.
57. Mitrushina, M., Boone, K. B., Razani, J., & D'Elia, L. F. (2005). Handbook of normative data for neuropsychological assessment (2nd ed.). New York: Oxford University Press.
58. Moore, J. L., McAuley, J. W., Long, L., & Bornstein, R. (2002). An evaluation of the effects of methylphenidate on outcomes in adult epilepsy patients. Epilepsy Behavior, 3 (1), 92-95. (Pubitemid 35174434)
59. Myors, B. (1999). Timing accuracy of PC programs running under DOS and Windows. Behavior Research Methods, Instruments, and Computers, 31, 322-328.
60. Naglieri, J. A., Drasgow, F., Schmit, M., Handler, L., Prifitera, A., Margolis, A., et al. (2004). Psychological testing on the internet: New problems, old issues. American Psychologist, 59 (3), 150-162. (Pubitemid 38651451)
61. Newman, T. B., & Kohn, M. R. (2009). Evidence-based diagnosis. New York: Cambridge University Press.
62. Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.
63. Ozonoff, D. (1995). Environmental medicine for all: Getting there form here. Lancet, 346 (8979), 860.
64. Pedhazer, E. J., & Pedhazer Schmelkin, L. (1991). Measurement, design, and analysis: An integrated approach. Hillsdale, NJ: Lawrence Erlbaum Associates Publishers.
65. Peterson, S. E., Stull, M. J., Collins, M.W., & Wang, H. E. (2009). Neurocognitive function of emergency department patients with mild traumatic brain injury. Annals of Emergency Medicine, 53 (6), 796-803 e791.
66. Plant, R. R., Hammond, N., & Turner, G. (2004). Self-validating presentation and response timing in cognitive paradigms: How and why? Behavioral Research Methods, Instrumentation, and Computers, 36 (2), 291-303. (Pubitemid 39196128)
67. Plant, R. R., & Turner, G. (2009). Millisecond precision psychological research in a world of commodity computers: New hardware, new problems? Behavior Research Methods, 41 (3), 598-614.
68. Polderman, T. J., van Dongen, J., & Boomsma, D. I. (2011). The relation between ADHD symptoms and fine motor control: A genetic study. Child Neuropsychology, 17 (2), 138-150.
69. Raymond, P. D., Hinton-Bayre, A. D., Radel, M., Ray, M. J., & Marsh, N. A. (2006). Assessment of statistical change criteria used to define significant change in neuropsychological test performance following cardiac surgery. European Journal of Cardiothoracic Surgery, 29 (1), 82-88. (Pubitemid 41831354)
70. Reise, S. P., & Waller, N. G. (2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5, 27-48.
71. Retzlaff, P. D., Callister, J. D., & King, R. E. (1999). Clinical procedures for the neuropsychological evaluation of U.S. Air Force pilots. Military Medicine, 164 (7), 514-519. (Pubitemid 29321313)
72. Retzlaff, P. D., & Gibertini, M. (2000). Neuropsychometric issues and problems. In R. D. Vanderploeg (Ed.), Clinician's guide to neuropsychological assessment (pp. 277-299). Mahwah, NJ: Lawrence Erlbaum Associates Publishers.
73. Slick, D. J., Tan, J. E., Strauss, E., Mateer, C. A., Harnadek, M., & Sherman, E. M. (2003). Victoria Symptom Validity Test scores of patients with profound memory impairment: Nonlitigants case studies. The Clinical Neuropsychologist, 17 (3), 390-394. (Pubitemid 37521916)
74. Stevens, A., Friedel, E., Mehen, G., & Merten, T. (2008). Malingering and uncooperativeness in psychiatric and psychological assessment: Prevalence and effects in a German sample of claimants. Psychiatric Research, 157, 191-200. (Pubitemid 350166540)
75. Sweeney, J. A., Kmiec, J. A., & Kupfer, D. J. (2000). Neuropsychologic impairments in bipolar and unipolar mood disorders on the CANTAB neurocognitive battery. Biological Psychiatry, 48 (7), 674-684.
76. Sweet, J. J., King, J. H., Malina, A. C., Bergman, M. A., & Simmons, A. (2002). Documenting the presence of forensic neuropsychology at national meetings and in relevant professional journals from 1990 to 2000. The Clinical Neuropsychologist, 16, 481-494. (Pubitemid 36605803)
77. Thomas, M. L. (2010). The value of item response theory in clinical assessment: A review. Assessment, 18 (3), 291-307.
78. Tien, A. Y., Spevack, T. V., Jones, D.W., Pearlson, G. D., Schlaepfer, T. E., & Strauss, M. E. (1996). Computerized Wisconsin Card Sorting Test: Comparison with manual administration. The Kaohsiung Journal of Medical Sciences, 12 (8), 479-485.
79. Tornatore, J. B., Hill, E., Laboff, J. A., & McGann, M. E. (2005). Self-administered screening for mild cognitive impairment: Initial validation of a computerized test battery. Journal of Neuropsychiatry and Clinical Neurosciences, 17 (1), 98-105. (Pubitemid 40283776)
80. Urbina, S. (2004). Essentials of psychological testing. Hoboken, NJ: John Wiley & Sons.
81. Van Kampen, D. A., Lovell, M. R., Pardini, J. E., Collins, M. W., & Fu, F. H. (2006). The "value added" of neurocognitive testing after sports-related concussion. American Journal of Sports Medicine, 34 (10), 1630-1635. (Pubitemid 44385857)
82. Vasterling, J. J., Proctor, S. P., Amoroso, P., Kane, R., Heeren, T., & White, R. F. (2006). Neuropsychological outcomes of army personnel following deployment to the Iraq war. Journal of the American Medical Association, 296 (5), 519-529. (Pubitemid 44157126)
83. West, L. K., Curtis, K. L., Greve, K. W., & Bianchini, K. J. (2011). Memory in traumatic brain injury: The effects of injury severity and effort on the Wechsler Memory Scale-III. Journal of Neuropsychology, 5, 114-125.
84. Wild, K., Howieson, D., Webbe, F., Seelye, A., & Kaye, J. (2008). Status of computerized cognitive testing in aging: A systematic review. Alzheimers Dement, 4 (6), 428-437.
85. Wouters, H., de Koning, I., Zwinderman, A. H., van Gool, W. A., Schmand, B., Buiter, M., et al. (2009). Adaptive cognitive testing in cerebrovascular disease and vascular dementia. Dementia and Geriatric Cognitive Disorders, 28 (5), 486-492.
86. Wouters, H., Zwinderman, A. H., van Gool, W. A., Schmand, B., & Lindeboom, R. (2009). Adaptive cognitive testing in dementia. International Journal of Methods in Psychiatric Research, 18 (2), 118-127.