Initial clinical validation of an embedded performance validity measure within the Automated Neuropsychological Metrics (ANAM)

Archives of Clinical Neuropsychology

Volumn 28, Issue 7, 2013, Pages 700-710

  Roebuck Spencer, Tresa M ^a   Vincent, Andrea S ^a   Gilliland, Kirby ^a   Johnson, Dan R ^b   Cooper, Douglas B ^c  

^a UNIVERSITY OF OKLAHOMA   (United States)

^b WASHINGTON AND LEE UNIVERSITY   (United States)

^c San Antonio Military Medical Center   (United States)

Author keywords

ANAM; Computer based testing; Neuropsychology; Performance Validity Testing; Simulators

Indexed keywords

ADOLESCENT; ADULT; AGED; ANAM; ARTICLE; COGNITIVE DEFECT; COMPUTER-BASED TESTING; FEMALE; HUMAN; MALE; MIDDLE AGED; NEUROPSYCHOLOGICAL TEST; NEUROPSYCHOLOGY; PERFORMANCE VALIDITY TESTING; PSYCHOLOGICAL ASPECT; RECEIVER OPERATING CHARACTERISTIC; SENSITIVITY AND SPECIFICITY; SIMULATORS; VALIDATION STUDY;

ANAM; COMPUTER-BASED TESTING; NEUROPSYCHOLOGY; PERFORMANCE VALIDITY TESTING; SIMULATORS;

ADOLESCENT; ADULT; AGED; COGNITION DISORDERS; FEMALE; HUMANS; MALE; MIDDLE AGED; NEUROPSYCHOLOGICAL TESTS; ROC CURVE; SENSITIVITY AND SPECIFICITY;

EID: 84890385120     PISSN: 08876177     EISSN: 18735843     Source Type: Journal    
DOI: 10.1093/arclin/act055     Document Type: Article

References (53)

1. Allen, L. M., Green, P.,Cox, D. R.,&Conder, R. L. (2006).CARB:Computerized Assessment of Response Bias:Amanual for computerized administration, reporting, and interpretation of CARB running under CogShellTM assessment environment. Durham, NC: CogniSyst
2. Bianchini, K. J., Mathias, C.W., & Greve, K.W. (2001). Symptom Validity Testing: A critical review. The Clinical Neuropsychologist, 15 (1), 19-45
3. Bleiberg, J., Cernich, A. N., Cameron, K. L., Sun, W., Peck, K., Uhorchak, J., et al. (2004). Duration of cognitive impairment following sports concussion. Neurosurgery, 54 (4), 1-6
4. Bleiberg, J., Kane, R. L.,Reeves, D. L., Garmoe,W. S.,&Halpern, E. (2000).Factor analysis of computerized and traditional tests used in mild brain injury research. The Clinical Neuropsychologist, 14 (3), 287-294
5. Bolan, B., Foster, J. K., Schmand, B., & Bolan, S. (2002). A comparison of three tests to detect feigned amnesia: The effects of feedback and the measurement of response latency [Comparative Study]. Journal of Clinical and Experimental Neuropsychology, 24 (2), 154-167. doi:10.1076/jcen.24.2.154. 1000
6. Boone, K. B. (2009). The need for continuous and comprehensive sampling of effort/response bias during neuropsychological examinations. Clinical Neuropsychology, 23 (4), 729-741. doi:904732228
7. Boone, K. B., Lu, P., &Wen, J. (2005). Comparison of various RAVLT scores in the detection of noncredible memory performance [Controlled Clinical Trial]. Archives of Clinical Neuropsychology, 20 (3), 301-319. doi:10.1016/j.acn.2004.08.001
8. Bryan, C.,&Hernandez, A. M. (2012). Magnitudes of decline on automated neuropsychological assessment metrics subtest scores relative to predeployment baseline performance among service members evaluated for traumatic brain injury in Iraq. Journal of Head Trauma Rehabilitation, 27 (1), 45-54. doi:10.1097/ HTR.0b013e318238f146
9. Bush, S. S., Ruff, R. M., Troster, A. I., Barth, J. T., Koffler, S. P., Pliskin, N. H., et al. (2005). Symptom validity assessment: Practice issues and medical necessity NAN policy & planning committee [Review]. Archives of Clinical Neuropsychology, 20 (4), 419-426. doi:10.1016/j.acn.2005.02.002
10. Cercy, S. P., Schretlen, D.,&Brandt, J. (1997). Simulated amnesia and the pseudo-memory phenomena. In R. Rogers (Ed.), Clinical assessment of malingering and deception (2nd ed., pp. 85-107). New York: Guilford Press
11. Cognitive Science Research Center (CSRC). (2012). ANAM4 Core: Administration manual. Norman, OK: University of Oklahoma
12. Coldren, R. L., Russell, M. L., Parish, R.V., Dretsch, M.,&Kelly, M. P. (2012). TheANAMlacks utility as a diagnostic or screening tool for concussion more than 10 days following injury. Military Medicine, 177 (2), 179-183
13. Dunn, T. M., Shear, P. K., Howe, S., & Ris, M. D. (2003). Detecting neuropsychological malingering: Effects of coaching information. Archives of Clinical Neuropsychology, 18, 121-134
14. Friedl, K. E., Grate, S. J., Proctor, S. P., Ness, J.W., Lukey, B. J.,&Kane, R. L. (2007). Army research needs for automated neuropsychological tests: Monitoring soldier health and performance status. Archives of Clinical Neuropsychology, 22 (S1), S7-S14
15. Greve, K. W., & Bianchini, K. J. (2004). Setting empirical cut-offs on psychometric indicatory of negative response bias: A methodological commentary with recommendations. Archives of Clinical Neuropsychology, 19, 533-541. doi:10.1016/j.acn.2003.08.002
16. Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G. J., Millis, S. R.,&Conference, P. (2009). American Academy of Clinical NeuropsychologyConsensus Conference Statement on the neuropsychological assessment of effort, response bias, and malingering [Consensus Development Conference]. Clinical Neuropsychology, 23 (7), 1093-1129. doi:10.1080/ 13854040903155063
17. Hoddes, E., Zarcone, V., Smythe, H., Phillips, R., & Dement,W. C. (1973). Quantification of sleepiness: A new approach. Psychophysiology, 10 (4), 431-436
18. Hohle, R. H. (1965). Inferred components of reaction times as functions of foreperiod duration. Journal of Experimental Psychology, 69, 382-386
19. Johnson, D. R., Gilliland, K., & Vincent, A. S. (2009). Automated Neuropsychological Assessment Metrics (ANAM)'s measure of invalid scores: A simulator study. Paper presented at the National Academy of Neuropsychology, New Orleans, LA
20. Kabat, M. H., Kane, R. L., Jefferson, A. L., & DiPino, R. K. (2001). Construct validity of selected Automated Neuropsychological Assessment Metrics (ANAM) battery measures. The Clinical Neuropsychologist, 15 (4), 498-507
21. Kane, R. L., Roebuck-Spencer, T., Short, P., Kabat, M.,&Wilken, J. (2007). Identifying and monitoring cognitive deficits in clinical populations using Automated Neuropsychological Assessment Metrics (ANAM) tests. Archives of Clinical Neuropsychology, 22(Suppl. 1), S115-S126. doi:10.1016/j.acn.2006.10.006
22. Kelly, M. P.,Coldren, R. L., Parish, R.V., Dretsch, M.N.,&Russell, M.L. (2012). Assessment of acute concussion in the combat environment. Archives of Clinical Neuropsychology, 27 (4), 375-388
23. Kim, N., Boone, K. B., Victor, T., Lu, P., Keatinge, C.,& Mitchell, C. (2010). Sensitivity and specificity of a digit symbol recognition trial in the identification of response bias. Archives of Clinical Neuropsychology, 25 (5), 420-428. doi:10.1093/arclin/acq040
24. Larrabee, G. J. (2007a). Identification of malingering by pattern analysis on neuropsychological tests. In G. J. Larrabee (Ed.), Assessment of malingered neuropsychological deficits (pp. 80-99). New York: Oxford University Press
25. Larrabee, G. J. (Ed.). (2007b). Assessment of malingered neuropsychological deficits. New York: Oxford University Press
26. Larrabee, G. J. (2008). Aggregation across multiple indicators improves the detection of malingering: Relationship to likelihood ratios. Clinical Neuropsychology, 22 (4), 666-679. doi:782115341
27. Lowe, M., Harris,W., Kane, R. L., Banderet, L., Levinson, D.,&Reeves, D. (2007). Neuropsychological assessment in extreme environments. Archives of Clinical Neuropsychology, 22 (Suppl. 1), S89-S99
28. Luce, R. D. (1986). Response times: Their role in inferring elementary mental organization. New York: Oxford University Press
29. Luethcke, C. A., Bryan, C. J., Morrow, C. E., & Isler,W. C. (2011). Comparison of concussive symptoms, cognitive performance, and psychological symptoms between acute blast-versus nonblast-induced mild traumatic brain injury. Journal of the International Neuropsychological Society, 17 (1), 36-45. doi:10.1017/ S1355617710001207
30. Madden, D. J., Gottlob, L. R., Denny, L. L., Turkington, T. G., Provenzale, J. M., Hawk, T. C., et al. (1999). Aging and recognition memory: Changes in regional cerebral blood flow associated with components of reaction time distributions. Journal of Cognitive Neuroscience, 11 (5), 511-520
31. McCaffrey, R. J.,&Kane, R. L. (Eds.). (2007).DoDcontributions to computerized neurocognitive assessment: TheANAMtest system [Special Issue]. Archives of Clinical Neuropsychology, 22S1
32. McDiarmid, M. A., Hooper, F. J., Squibb, K., McPhaul, K., Engelhardt, S. M., Kane, R., et al. (2002). Health effects and biological monitoring results of GulfWar veterans exposed to depleted uranium. Military Medicine, 167 (2 Suppl.), 123-124
33. Rahill, A. A.,Weiss, B., Morrow, P. E., Frampton, M.W., Cox, C., Gibb, R., et al. (1996). Human performance during exposure to toluene. Aviation, Space, and Environmental Medicine, 67 (7), 640-647
34. Reedy, S. D., Boone, K. B., Cottingham, M. E., Glaser, D. F., Lu, P. H., Victor, T. L., et al. (2013). Cross validation of the Lu and colleagues (2003) Rey-Osterrieth Complex Figure Test effort equation in a large known-group sample. Archives of Clinical Neuropsychology, 28 (1), 30-37. doi:10.1093/arclin/acs106.
35. Rees L. M. Tombaugh T.N. Gansler D.A. Moczynski N.P. 1998 Five validation experiments on theTest ofMemoryMalingering(TOMM) Psychological Assessment 10 10-20
36. Reicker, L. I. (2008). The ability of reaction time tests to detect simulation: An investigation of contextual effects and criterion scores [Controlled Clinical Trial]. Archives of Clinical Neuropsychology, 23 (4), 419-431. doi:10.1016/j.acn.2008.02.003
37. Rose, F. E., Hall, S., & Szalda-Petree, A. D. (1995). Portland Digit Recognition Test-Computerized: Measuring response latency improves the detection of malingering. Clinical Neuropsychologist, 9, 124-134
38. Schmiedek, F., Oberauer, K., Wilhelm, O., Suss, H. M.,& Wittmann,W.W. (2007). Individual differences in components of reaction time distributions and their relations to working memory and intelligence [Research Support, Non-U.S. Gov't]. Journal of Experimental Psychology: General, 136 (3), 414-429. doi:10.1037/0096-3445.136.3.414
39. Silverberg, N. D., Wertheimer, J. C., & Fichtenberg, N. L. (2007). An effort index for the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS). Clinical Neuropsychology, 21 (5), 841-854. doi:769512323
40. Sim, A., Terryberry-Spohr, L.,&Wilson, K. R. (2008). Prolonged recovery of memory functioning after mild traumatic brain injury in adolescent athletes. Journal of Neurosurgery, 108 (3), 511-516. doi:10.3171/JNS/2008/108/3/ 0511
41. Slick, D. J., Hopp, G., Strauss, E., & Thompson, G. B. (2005). VSVT: Victoria Symptom Validity Test professional manual. Lutz, FL: Psychological Assessment Resources
42. Slick, D. J., Sherman, E. M., & Iverson, G. L. (1999). Diagnostic criteria for malingered neurocognitive dysfunction: Proposed standards for clinical practice and research. The Clinical Neuropsychologist, 13 (4), 545-561. doi:10.1076/1385-4046(199911)13:04;1-Y;FT545
43. Suhr, J. A., & Gunstad, J. (2007). Coaching and malingering: A review. In G. J. Larrabee (Ed.), Assessment of malingered neuropsychological deficits (pp. 287-311). New York: Oxford University Press
44. Tan, J. E., Slick, D. J., Strauss, E., & Hultsch, D. F. (2002). How'd they do it? Malingering strategies on symptom validity tests. The Clinical Neuropsychologist, 16 (4), 495-505. doi:10.1076/clin.16.4.495.13909
45. United States House of Representatives H.R. 4986. (2008). National Defense Authorization Act for Fiscal Year 2008, Sec. 1618, Comprehensive plan on prevention, diagnosis, mitigation, treatment, rehabilitation of, and research on, traumatic brain injury, post traumatic stress disorder, and othermental health conditions in members of the armed forces. Retrieved January 6, 2010, from http://thomas.loc.gov/cgi-bin/query/C?R110:./temp/~r110itMI1I
46. Van Gorp,W. G., Humphrey, L. A., Kalechstein, A., Brumm,V. L., McMullen,W. J., et al. (1999). Howwell to standard clinical neuropsychological tests identity malingering? A preliminary analysis. Journal of Clinical and Experimental Neuropsychology, 21, 245-250
47. Vincent, A. S., Bleiberg, J.,Yan, S., Ivins, B.,Reeves, D. L., Schwab, K., et al. (2008).Reference data fromthe automated Neuropsychological Assessment Metrics for use in traumatic brain injury in an active duty military sample. Military Medicine, 173 (9), 836-852
48. Vincent, A. S., Roebuck-Spencer, T. M., Gilliland, K., & Schlegal, R. (2012). Automated Neuropsychological Assessment Metrics (v4) Traumatic Brain Injury Battery: Military normative data. Military Medicine, 177, 256-269.
49. Vincent, A. S., Roebuck-Spencer, T. M., Gilliland, K., & Schlegal, R. (2012). Automated Neuropsychological Assessment Metrics (v4) Traumatic Brain Injury Battery: Military normative data. Military Medicine, 177, 256-269.
50. Wilken, J. A., Kane, R., Sullivan, C. L.,Wallin, M., Usiskin, J. B., Quig,M.E., et al. (2003). The utility of computerized neuropsychological assessment of cognitive dysfunction in patients with relapsing-remitting multiple sclerosis. Multiple Sclerosis, 9 (2), 119-127
51. Wilken, J. A., Sullivan, C. L., Lewandowski, A., & Kane, R. L. (2007). The use of ANAM to assess the side-effect profiles and efficacy of medication. Archives of Clinical Neuropsychology, 22 (Suppl. 1), S127-S133. doi:10.1016/j.acn.2006.10.007
52. Willison, J.,&Tombaugh, T. N. (2006). Detecting simulation of attention deficits using reaction time tests. Archives of Clinical Neuropsychology, 21 (1), 41-52. doi:10.1016/j.acn.2005.07.005
53. Woodhouse, J.,Heyanka, D. J., Scott, J., Vincent, A. S.,Roebuck-Spencer, T. M.,Domboski, K., et al. (2013). Efficacy of theANAM4General Neuropsychological Screening battery (ANAM4 GNS) for detecting neurocognitive impairment in a mixed clinical sample. The Clinical Neuropsychologist, 27 (3), 376-385.