Computerized neuropsychological assessment devices: Joint position paper of the American academy of clinical neuropsychology and the national academy of neuropsychology

Clinical Neuropsychologist

Volumn 26, Issue 2, 2012, Pages 177-196

  Bauer, Russell M ^a,g   Iverson, Grant L ^b,h   Cernich, Alison N ^c,g   Binder, Laurence M ^d,h   Ruff, Ronald M ^e,h   Naugle, Richard I ^f,g  

^a UNIVERSITY OF FLORIDA   (United States)

^b UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^c VETERANS AFFAIRS MEDICAL CENTER   (United States)

^d OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

^e San Francisco Clinical Neurosciences   (United States)

^f LERNER RESEARCH INSTITUTE   (United States)

^g American Academy of Clinical Neuropsychology   (United States)

^h National Academy of Neuropsychology   (United States)

Author keywords

Computerized testing; neurocognition; neuropsychological test validity

Indexed keywords

ARTICLE; COGNITION; COMPUTER; HUMAN; NEUROPSYCHOLOGICAL TEST; PSYCHOMETRY; REPRODUCIBILITY; STANDARD;

COGNITION; COMPUTERS; HUMANS; NEUROPSYCHOLOGICAL TESTS; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS;

EID: 84859176619     PISSN: 13854046     EISSN: 17444144     Source Type: Journal    
DOI: 10.1080/13854046.2012.663001     Document Type: Article

References (88)

1. American Academy of Clinical Neuropsychology. 2007. American Academy of Clinical Neuropsychology (AACN) practice guidelines for neuropsychological assessment and consultation. The Clinical Neuropsychologist, 21 (2): 209-231.
2. American Psychological Association. 2007. Record keeping guidelines. American Psychologist, 62: 993-1004.
3. American Psychological Association. 1999. Standards for educational and psychological testing, Washington, DC: American Psychological Association.
4. American Psychological Association. 1986. Guidelines for computer-based tests and interpretations, Washington, DC: American Psychological Association.
5. Anger, WK, Storzbach, D, Binder, LM, Campbell, KA, Rohlman, DS, McCauley, L. 1999. Neurobehavioral deficits in Persian Gulf veterans: evidence from a population-based study. Portland Environmental Hazards Research Center. Journal of the International Neuropsychological Society, 5 (3): 203-212. (Pubitemid 29201653)
6. APA (2010). Ethical Principles of Psychologists and Code of Conduct (2010 Amendments), from http://www.apa.org/ethics/code/index.aspx
7. Berger, SG, Chibnall, JT, and, Gfeller, JD. 1997. Construct validity of the computerized version of the Category Test. Journal of Clinical Psychology, 53 (7): 723-726. (Pubitemid 27454574)
8. Bleiberg, J, Cernich, AN, Cameron, K, Sun, W, Peck, K, Ecklund, PJ. 2004. Duration of cognitive impairment after sports concussion. Neurosurgery, 54 (5): 1073-1078., discussion 1078-1080
9. Bleiberg, J, Garmoe, WS, Halpern, EL, Reeves, DL, and, Nadler, JD. 1997. Consistency of within-day and across-day performance after mild brain injury. Neuropsychiatry, Neuropsychology, and Behavioral Neurology, 10 (4): 247-253. (Pubitemid 27477902)
10. Bolfer, C, Casella, EB, Baldo, MV, Mota, AM, Tsunemi, MH, Pacheco, SP. 2010. Reaction time assessment in children with ADHD. Arquivos de Neuro-Psiquiatria, 68 (2): 282-286.
11. Boone, KB. 2009. The need for continuous and comprehensive sampling of effort/response bias during neuropsychological examinations. The Clinical Neuropsychologist, 23: 729-741.
12. Boone, KB. (Ed.) (2007). Assessment of feigned cognitive impairment: A neuropsychological perspective. New York: Guilford Press
13. Broglio, SP, Ferrara, MS, Macciocchi, SN, Baumbartner, TA, and, Elliott, R. 2007. Test-retest reliability of computerized concussion assessment programs. Journal of Athletic Training, 42: 509-514. (Pubitemid 351377899)
14. Brooks, BL, Iverson, GL, Sherman, EM, and, Roberge, MC. 2010. Identifying cognitive problems in children and adolescents with depression using computerized neuropsychological testing. Applied Neuropsychology, 17 (1): 37-43.
15. Bush, SS, Ruff, RM, Troster, AI, Barth, JT, Koffler, SP, Pliskin, NH. 2005. Symptom validity assessment: practice issues and medical necessity NAN policy & planning committee. Archives of Clinical Neuropsychology, 20 (4): 419-426. (Pubitemid 40719546)
16. Campbell, KA, Rohlman, DS, Storzbach, D, Binder, LM, Anger, WK, Kovera, CA. 1999. Test-retest reliability of psychological and neurobehavioral tests self-administered by computer. Assessment, 6 (1): 21-32.
17. Cernich, A, Reeves, D, Sun, W, and, Bleiberg, J. 2007. Automated Neuropsychological Assessment Metrics sports medicine battery. Archives of Clinical Neuropsychology, 22 (Suppl 1): S101-114. (Pubitemid 46420505)
18. Cernich, AN, Brennana, DM, Barker, LM, and, Bleiberg, J. 2007. Sources of error in computerized neuropsychological assessment. Archives of Clinical Neuropsychology, 22S: S39-S48.
19. Chamberlain, SR, Robbins, TW, Winder-Rhodes, S, Muller, U, Sahakian, BJ, Blackwell, AD. 2011. Translational approaches to frontostriatal dysfunction in attention-deficit/hyperactivity disorder using a computerized neuropsychological battery. Biological Psychiatry, 69 (12): 1192-1203.
20. Choca, J, and, Morris, J. 1992. Administering the Category Test by computer: Equivalence of results. The Clinical Neuropsychologist, 6 (1): 9-15.
21. Collie, A, Makdissi, M, Maruff, P, Bennell, K, and, McCrory, P. 2006. Cognition in the days following concussion: comparison of symptomatic versus asymptomatic athletes. Journal of Neurology, Neurosurgery, and Psychiatry, 77 (2): 241-245. (Pubitemid 43220852)
22. Collins, MW, Lovell, MR, Iverson, GL, Ide, T, and, Maroon, J. 2006. Examining concussion rates and return to play in high school football players wearing newer helmet technology: a three year prospective cohort study. Neurosurgery, 58 (2): 275-286.
23. Constantinou, M, Bauer, L, Ashendorf, L, Fisher, JM, and, McCaffrey, RJ. 2005. Is poor performance on recognition memory effort measures indicative of generalized poor performance on neuropsychological tasks?. Archives of Clinical Neuropsychology, 20: 191-198. (Pubitemid 40222156)
24. Creeger, CP, Miller, KF, and, Paredes, DR. 1990. Micromanaging time: Measuring and controlling timing errors in computer-controlled experiments. Behavior Research Methods, Instruments, and Computers, 22: 34-79.
25. Cronbach, LJ. 1971. Test validation. In Educational measurement, 2nd, Edited by: Thorndike, RL. 443-507. Washington, DC: American Council on Education.
26. Crook, TH, Kay, GG, and, Larrabee, GJ. 2009. Computer-based cognitive testing. In Neuropsychological Asessment of Neuropsychiatric and Neuromedical Disorders, 3rd, Edited by: Grant, I and Adams, KM. 84-100. New York: Oxford University Press.
27. Doniger, GM, Dwolatzky, T, Zucker, DM, Chertkow, H, Crystal, H, Schweiger, A. 2006. Computerized cognitive testing battery identifies mild cognitive impairment and mild dementia even in the presence of depressive symptoms. American Journal of Alzheimer's Disease and Other Dementias, 21 (1): 28-36.
28. Doniger, GM, Zucker, DM, Schweiger, A, Dwolatzky, T, Chertkow, H, Crystal, H. 2005. Towards practical cognitive assessment for detection of early dementia: a 30-minute computerized battery discriminates as well as longer testing. Current Alzheimer Research, 2 (2): 117-124. (Pubitemid 40862871)
29. Dorion, AA, Sarazin, M, Hasboun, D, Hahn-Barma, V, Dubois, B, Zouaoui, A. 2002. Relationship between attentional performance and corpus callosum morphometry in patients with Alzheimer's disease. Neuropsychologia, 40 (7): 946-956. (Pubitemid 34233633)
30. Downing, SM. & Haladyna, T. M. (Eds.) (2006). Handbook of test development. Mahwah, NJ: Lawrence Erlbaum Associates Publishers
31. Dwolatzky, T, Whitehead, V, Doniger, GM, Simon, ES, Schweiger, A, Jaffe, D. 2004. Validity of the Mindstreams computerized cognitive battery for mild cognitive impairment. Journal of Molecular Neuroscience, 24 (1): 33-44. (Pubitemid 41359165)
32. Feldstein, SN, Keller, FR, Protman, RE, Durham, RL, Klebe, KJ, and, Davis, HP. 1999. A comparison of computerized and standard version of the Wisconsin Card Sorting Test. The Clinical Neuropsychologist, 13: 303-313. (Pubitemid 30040142)
33. Forster, KI, and, Forster, JC. 2003. DMDX: A Windows display proram with millisecond accuracy. Behavior Research Methods, Instruments, and Computers, 35: 116-124. (Pubitemid 37545055)
34. Franzen, MD. 1989. Reliability and validity in neuropsychological assessment, New York, NY: Plenum Press.
35. Franzen, MD. 2000. Reliability and validity in neurological assessment, 2nd, New York, NY: Kluwer Academic/Plenum Press.
36. Gaver, WW. 1991. Technology affordances. In In CHI 1991 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Reaching through Technology, New York: Association for Computing Machinery.
37. Gofen, A, and, Mackeben, M. 1997. An introduction to accurate display timing for PC's under Windows. Spatial Vision, 10 (4): 361-368. (Pubitemid 127582513)
38. Green, P, Rohling, ML, Lees-Haley, PR, and, Allen, LM. 2001. Effort has a greater effect on test scores than severe brain injury in compensation claimants. Brain Injury, 15: 1045-1060. (Pubitemid 33120963)
39. Green, P, Rohling, ML, Lees-Haley, PR, and, Allen, LM 3rd. 2001. Effort has a greater effect on test scores than severe brain injury in compensation claimants. Brain Injury, 15 (12): 1045-1060. (Pubitemid 33120963)
40. Gualtieri, CT, and, Johnson, LG. 2005. Neurocognitive testing supports a broader concept of mild cognitive impairment. American Journal of Alzheimer's Disease and Other Dementias, 20 (6): 359-366. (Pubitemid 43030925)
41. Gualtieri, CT, and, Johnson, LG. 2006. Efficient allocation of attentional resources in patients with ADHD: maturational changes from age 10 to 29. Journal of Attentional Disorders, 9 (3): 534-542. (Pubitemid 43171145)
42. Gualtieri, CT, and, Johnson, LG. 2008. A computerized test battery sensitive to mild and severe brain injury. Medscape Journal of Medicine, 10 (4): 90
43. Heilbronner, RL, Sweet, JJ, Morgan, JE, Larrabee, GJ, and, Millis, SR. 2009. American Academy of Clinical Neuropsychology Consensus Conference Statement on the neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 23 (7): 1093-1129.
44. Heilbronner, RL, Sweet, JJ, Morgan, JE, Larrabee, GJ, Millis, SR, and, Participants, C. 2009. American Academy of Clinical Neuropsychology Consensus Conference statement on the neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 23 (7): 1093-1129.
45. Hitchcock, E. 2006. Computer access for people after stroke. Topics in Stroke Rehabilitation, 13: 22-30. (Pubitemid 44320639)
46. Iverson, GL, Brooks, BL, Ashton, VL, Johnson, LG, and, Gualtieri, CT. 2009. Does familiarity with computers affect computerized neuropsychological test performance?. Journal of Clinical and Experimental Neuropsychology, 31: 594-604.
47. Iverson, GL, Brooks, BL, Collins, MW, and, Lovell, MR. 2006. Tracking neuropsychological recovery following concussion in sport. Brain Injury, 20 (3): 245-252.
48. Iverson, GL, Brooks, BL, Langenecker, SA, and, Young, AH. 2011. Identifying a cognitive impairment subgroup in adults with mood disorders. Journal of Affective Disorders, 132: 360-367.
49. Iverson, GL, Brooks, BL, Lovell, MR, and, Collins, MW. 2006. No cumulative effects for one or two previous concussions. British Journal of Sports Medicine, 40 (1): 72-75. (Pubitemid 43028600)
50. Kramer, JJ. 1987. On the question of professional standards for computer-based test interpretation. American Psychologist, 42: 889-890.
51. Larrabee, GJ. 2007. Assessment of malingered neuropsychological deficits, New York: Oxford University Press.
52. Marx, BP, Brailey, K, Proctor, SP, MacDonald, HZ, Graefe, AC, Amoroso, P. 2009. Association of Time Since Deployment, Combat Intensity, and Posttraumatic Stress Symptoms With Neuropsychological Outcomes Following Iraq War Deployment. Archives of General Psychiatry, 66 (9): 996-1004.
53. Matarazzo, JD. 1985. Clinical psychological tst interpretations by computer: Hardware outpaces software. Computers in Human Behavior, 1: 235-253.
54. Matarazzo, JD. 1986. Computerized clinical psychological test interpretations: Unvalidated plue all mean and no sigma. American Psychologist, 41: 96
55. Matarazzo, JD. 1990. Psychological assessment versus psychological testing: Validation from Binet to the school, clinic, and courtroom. American Psychologist, 45: 999-1017.
56. McInnes, WJ, and, Taylor, TL. 2001. Millisecond timing on PC's and Macs. Behavior Research Methods Instruments and Computers, 31 (1): 129-136.
57. McLay, R, Spira, J, and, Reeves, D. 2010. Use of computerized neuropsychological testing to help determine fitness to return to combat operations when taking medication that can influence cognitive function. Military Medicine, 175 (12): 945-946.
58. Messick, S. 1989. Validity. In Educational measurement, 3rd, Edited by: Linn, RL. 13-103. New York: American Council on Education and Macmillan.
59. Mitrushina, M, Boone, KB, Razani, J, and, D'Elia, LF. 2005. Handbook of normative data for neuropsychological assessment, 2nd, New York: Oxford University Press.
60. Moore, JL, McAuley, JW, Long, L, and, Bornstein, R. 2002. An Evaluation of the Effects of Methylphenidate on Outcomes in Adult Epilepsy Patients. Epilepsy & Behavior, 3 (1): 92-95. (Pubitemid 35174434)
61. Myors, B. 1999. Timing accuracy of PC programs running under DOS and Windows. Behavior Research Methods, Instruments, & Computers, 31: 322-328.
62. Naglieri, JA, Drasgow, F, Schmit, M, Handler, L, Prifitera, A, Margolis, A, and, Velasquez, R. Psychological testing on the internet: New problems, old issues. American Psychologist, 59 (3) 150-162. (date)
63. Newman, TB, and, Kohn, MR. 2009. Evidence-based diagnosis, New York: Cambridge University Press.
64. Nunnally, JC, and, Bernstein, IH. 1994. Psychometric theory, 3rd, New York: McGraw-Hill, Inc.
65. Ozonoff, D. 1995. Environmental medicine for all: getting there form here. Lancet, 346 (8979): 860
66. Pedhazer, EJ, and, Pedhazer Schmelkin, L. 1991. Measurement, design, and analysis: An integrated approach, Hillsdale, NJ: Lawrence Erlbaum Associates Publishers.
67. Peterson, SE, Stull, MJ, Collins, MW, and, Wang, HE. 2009. Neurocognitive function of emergency department patients with mild traumatic brain injury. Annals of Emergency Medicine, 53 (6): 796-803 e791.
68. Plant, RR, and, Turner, G. 2009. Millisecond precision psychological research in a world of commodity computers: new hardware, new problems?. Behavior Research Methods, 41 (3): 598-614.
69. Plant, RR, Hammond, N, and, Turner, G. 2004. Self-validating presentation and response timing in cognitive paradigms: how and why?. Behavioral Research Methods, Instrumentation, and Computers, 36 (2): 291-303. (Pubitemid 39196128)
70. Polderman, TJ, van Dongen, J, and, Boomsma, DI. 2011. The relation between ADHD symptoms and fine motor control: a genetic study. Child Neuropsychology, 17 (2): 138-150.
71. Raymond, PD, Hinton-Bayre, AD, Radel, M, Ray, MJ, and, Marsh, NA. 2006. Assessment of statistical change criteria used to define significant change in neuropsychological test performance following cardiac surgery. European Journal of Cardiothoracic Surgery, 29 (1): 82-88. (Pubitemid 41831354)
72. Reise, SP, and, Waller, NG. 2009. Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5: 27-48.
73. Retzlaff, PD, Callister, JD, and, King, RE. 1999. Clinical procedures for the neuropsychological evaluation of U.S. Air Force pilots. Military Medicine, 164 (7): 514-519. (Pubitemid 29321313)
74. Retzlaff, PD, and, Gibertini, M. 2000. Neuropsychometric issues and problems. In Clinician's guide to neuropsychological assessment, Edited by: Vanderploeg, RD. 277-299. Mahwah, NJ: Lawrence Erlbaum Associates, Publishers.
75. Slick, DJ, Tan, JE, Strauss, E, Mateer, CA, Harnadek, M, and, Sherman, EM. 2003. Victoria Symptom Validity Test scores of patients with profound memory impairment: nonlitigants case studies. The Clinical Neuropsychologist, 17 (3): 390-394. (Pubitemid 37521916)
76. Stevens, A, Friedel, E, Mehen, G, and, Merten, T. 2008. Malingering and uncooperativeness in psychiatric and psychological assessment: prevalance and effects in a German sample of claimants. Psychiatric Research, 157: 191-200. (Pubitemid 350166540)
77. Sweeney, JA, Kmiec, JA, and, Kupfer, DJ. 2000. Neuropsychologic impairments in bipolar and unipolar mood disorders on the CANTAB neurocognitive battery. Biological Psychiatry, 48 (7): 674-684.
78. Sweet, JJ, King, JH, Malina, AC, Bergman, MA, and, Simmons, A. 2002. Documenting the presence of forensic neuropsychology at national meetings and in relevant professional journals from 1990 to 2000. The Clinical Neuropsychologist, 16: 481-494. (Pubitemid 36605803)
79. Thomas, ML. (2010). The value of Item Response Theory in clinical assessment: A review. Assessment, 18 (3), 291-307
80. Tien, AY, Spevack, TV, Jones, DW, Pearlson, GD, Schlaepfer, TE, and, Strauss, ME. 1996. Computerized Wisconsin Card Sorting Test: comparison with manual administration. The Kaohsiung Journal of Medical Sciences, 12 (8): 479-485.
81. Tornatore, JB, Hill, E, Laboff, JA, and, McGann, ME. 2005. Self-administered screening for mild cognitive impairment: initial validation of a computerized test battery. Journal of Neuropsychiatry and Clinical Neurosciences, 17 (1): 98-105. (Pubitemid 40283776)
82. Urbina, S. 2004. Essentials of psychological testing, Hoboken, NJ: John Wiley & Sons.
83. Van Kampen, DA, Lovell, MR, Pardini, JE, Collins, MW, and, Fu, FH. 2006. The value added of neurocognitive testing after sports-related concussion. American Journal of Sports Medicine, 34 (10): 1630-1635. (Pubitemid 44385857)
84. Vasterling, JJ, Proctor, SP, Amoroso, P, Kane, R, Heeren, T, and, White, RF. 2006. Neuropsychological outcomes of army personnel following deployment to the Iraq war. Journal of the American Medical Association, 296 (5): 519-529. (Pubitemid 44157126)
85. West, LK, Curtis, KL, Greve, KW, and, Bianchini, KJ. 2011. Memory in traumatic brain injury: the effects of injury severity and effort on the Wechsler Memory Scale-III. Journal of Neuropsychology, 5: 114-125.
86. Wild, K, Howieson, D, Webbe, F, Seelye, A, and, Kaye, J. 2008. Status of computerized cognitive testing in aging: a systematic review. Alzheimer's & Dementia, 4 (6): 428-437.
87. Wouters, H, de Koning, I, Zwinderman, AH, van Gool, WA, Schmand, B, Buiter, M. 2009. Adaptive cognitive testing in cerebrovascular disease and vascular dementia. Dementia and Geriatric Cognitive Disorders, 28 (5): 486-492.
88. Wouters, H, Zwinderman, AH, van Gool, WA, Schmand, B, and, Lindeboom, R. 2009. Adaptive cognitive testing in dementia. International Journal of Methods in Psychiatric Research, 18 (2): 118-127.