Is co-norming required?

Archives of Clinical Neuropsychology

Volumn 30, Issue 7, 2015, Pages 611-633

  Rohling, Martin L ^a   Miller, Ronald M ^b   Axelrod, Bradley N ^c   Wall, Jacqueline R ^d   Lee, Amy J H ^b   Kinikini, Daniel T ^b  

^a UNIVERSITY OF SOUTH ALABAMA   (United States)

^b BRIGHAM YOUNG UNIVERSITY HAWAII   (United States)

^c VETERANS AFFAIRS MEDICAL CENTER   (United States)

^d UNIVERSITY OF INDIANAPOLIS   (United States)

Author keywords

Cognitive Test Norms; Forensic Neuropsychology; Neuropsychological Assessment; Neuropsychology; Normative Studies; Psychological Assessment

Indexed keywords

ADOLESCENT; ADULT; AGED; ANALYSIS OF VARIANCE; COGNITION DISORDERS; FACTUAL DATABASE; FEMALE; HUMAN; MALE; MIDDLE AGED; NEUROPSYCHOLOGICAL TEST; REFERENCE VALUE; STANDARDS; STATISTICS; STATISTICS AND NUMERICAL DATA; YOUNG ADULT;

ADOLESCENT; ADULT; AGED; ANALYSIS OF VARIANCE; COGNITION DISORDERS; DATABASES, FACTUAL; FEMALE; HUMANS; MALE; MIDDLE AGED; NEUROPSYCHOLOGICAL TESTS; REFERENCE VALUES; STATISTICS AS TOPIC; YOUNG ADULT;

EID: 84954541086     PISSN: 08876177     EISSN: 18735843     Source Type: Journal    
DOI: 10.1093/arclin/acv039     Document Type: Article

References (65)

1. American Academy of Clinical Neuropsychology (AACN). (2008) Baxter v. Temple, 949 A.2d 167 (N.H. May 20, 2008). Amicus Brief submitted on behalf of the American Academy of Clinical Neuropsychology and in Support of Plaintiff. Retrieved June 18, 2015, from https://www.courtlistener.com/nh/8Ucx/baxter-v-Temple/.
2. Army Individual Test Battery. (1944). Manual of directions and scoring.Washington, DC:War Department, Adjutant Generals Office.
3. Axelrod, B. N., & Wall, J. R. (2007). Expectancy of impaired neuropsychological test scores in a non-clinical sample. International Journal of Neuroscience, 117, 1591-1602.
4. Barona, A., Reynolds, C. R., & Chastain, R. (1984).Ademographically based index of premorbid intelligence for theWAIS-R. Journal of Consulting and Clinical Psychology, 52, 885-887.
5. Benton, A. L., Hamsher, S. K., & Sivan, A. B. (1994). Multilingual aphasia examination manual for instruction, (2nd ed.). Iowa City, IA: AJA Associates.
6. Bigler, E. D. (2007).Amotion to exclude and the "fixed" vs. "flexible" battery in forensic neuropsychology: Challenges to the practice of clinical neuropsychology. Archives of Clinical Neuropsychology, 22, 45-51.
7. Calamia, M., Markon, K., & Tranel, D. (2014). The robust reliability of neuropsychological measures: Meta-Analyses of test-retest correlations. The Clinical Neuropsychologist, 27, 1077-1105.
8. DeFilippis, N. A., & McCampbell, E. (1997). Booklet Category Test (BCT) (2nd ed.). Odessa, FL: Psychological Assessment Resources.
9. Delis, D. C., Kramer, J. H., Kaplan, E., & Ober, B. A. (1987). The California Verbal Learning Test. San Antonio, TX: Psychological Corporation.
10. Fields, K., Hill, B. D., Corley, E., Russ, K., Boettcher, A., Musso, M., et al. (2013, October). 1, 2, 3, 4. . . I declare norms war! Comparison of the Mitrushina metanorms and Heaton and Comprehensive Neuropsychological Normative System demographic norms in a matched African-American and white sample. Poster presented at the 33rd Annual Meeting of the National Academy of Neuropsychology in San Diego, CA.
11. Halstead, W. (1947). Brain and intelligence. Chicago: University of Chicago Press.
12. Hasselblad, V., & Hedges, L. V. (1995). Meta-Analysis of screening and diagnostic tests. Psychological Bulletin, 117, 167-178.
13. Heaton, R. K., Gladsjo, J. A., Palmer, B.W., Kick, J., Marcotte, T. D., & Jeste, D. V. (2001). Stability and course of neuropsychological deficits in schizophrenia. Archives of General Psychiatry, 58, 24-32.
14. Heaton, R. K., Grant, I., & Matthews, C. G. (1991). Comprehensive norms for an expanded Halstead-Reitan battery: demographic corrections, research findings, and clinical applications. Odessa, FL: Psychological Assessment Resources.
15. Heaton, R. K., Miller, W., Taylor, M. J., & Grant, I. (2004). Revised comprehensive norms for an expanded Halstead-Reitan Battery: Demographically adjusted neuropsychological norms for African American and Caucasian adults. Lutz, FL: Psychological Assessment Resources.
16. Hill, B. D., Boettcher, A., Cary, B., Kline, J., Womble, M., & Rohling, M. L. (2013, February). Much ado about norming: A comparison of the Heaton demographically adjusted norms and Mitrushina meta-norms. Poster presented at the 41st Annual Meeting of the International Neuropsychological Society in Waikoloa, HI.
17. Hill, B. D., Rohling, M. L., Boettcher, A. C., & Meyers, J. E. (2013). Cognitive intra-individual variability has a positive association with traumatic brain injury severity and suboptimal effort. Archives of Clinical Neuropsychology, 28, 640-648.
18. Holdnack, J. A. (2001). Wechsler Test of Adult Reading: WTAR. San Antonio, TX: Pearson.
19. Holdnack, J. A., & Drozdick, L.W. (2009). Advanced clinical solutions: Clinical and interpretive manual. San Antonio, TX: Pearson.
20. Hom, J. (2008). Commentary. Response to Bigler (2007). The sky is not falling. Archives of Clinical Neuropsychology, 23, 125-128.
21. Irwig, L., Tosteson, A. N., Gatsonis, C., Lau, L., Colditz, G., Chalmers, T. C., et al. (1994). Guidelines for meta-Analyses evaluating diagnostic tests. Annuals of Internal Medicine, 120, 667-676.
22. Jastak, S. R., & Wilkinson, G. S. (1984). Wide Range Achievement Tests-Revised. Wilmington, DE: Jastak Associates.
23. Kaplan, E., Goodglass, H., & Wientrab, S. (1983). The boston naming test. Philadelphia, PA: Lea & Febriger.
24. Kern, R. S., Nuechterlein, K. H., Green, M. F., Baade, L. E., Fenton, W. S., Gold, J. M., et al. (2008). The MATRICS Consensus Cognitive Battery, Part 2: Co-norming and standardization. American Journal of Psychiatry, 165, 214-220.
25. Koenig, K. A., Frey, M. C., & Detterman, D. K. (2008). ACT and general cognitive ability. Intelligence, 36, 153-160.
26. Kozel, J. J., & Meyers, J. E. (1998). A cross-validation study of the Victoria Revision of the Category Test. Archives of Clinical Neuropsychology, 13, 327-332.
27. Labreche, T. M. (1983). The Victoria Revision of the Halstead Category Test. Unpublished doctoral dissertation, University of Victoria, BC, Canada.
28. Larrabee, G. J. (2008). Commentary: Flexible vs. fixed batteries in forensic neuropsychological assessment: Reply to Bigler and Hom. Archives of Clinical Neuropsychology, 23, 763-776.
29. Lezak, M. D., Howieson, D. B., & Loring, D.W. (2004). Neuropsychological evaluation. New York: Oxford University Press.
30. Meyers, J. E. (1995). Manual for the Meyers Neuropsychological Battery (MNB). Retrieved June 18, 2015, from www.meyersneuropsychological.com.
31. Meyers, J. E. (2007). Malingering mild traumatic brain injury: Behavioral approaches used by both malingering actors and probable malingerers. InK. Boone (Ed.), Assessment of feigned cognitive impairment: A neuropsychological perspective. New York: Guilford Press.
32. Meyers, J. E., & Rohling, M. L. (2004). Validation of the Meyers Short Battery on mild TBI patients. Archives of Clinical Neuropsychology, 19, 637-651.
33. Meyers, J. E., & Rohling, M. L. (2009). CT and MRI correlations with neuropsychological tests. Applied Neuropsychology, 16, 237-253.
34. Meyers, J. E., & Volbrecht, M. E. (2003).Avalidation of multiple malingering detection methods in a large clinical sample. Archives of Clinical Neuropsychology, 18, 261-276.
35. Meyers, J. E., Volbrecht, M., Axelrod, B. N., & Reinsch-Boothby, L. (2011). Embedded symptom validity tests and overall neuropsychological test performance. Archives of Clinical Neuropsychology, 26, 8-15.
36. Miller, L. S., & Rohling, M. L. (2001). A statistical interpretive method for neuropsychological test data. Neuropsychology Review, 11, 143-169.
37. Mitrushina, M., Boone, K. B., Razani, J., & DElia, L. F. (2005). Handbook of normative data for neuropsychological assessment (2nd ed.). New York: Oxford University Press.
38. Moore, D., McCabe, G., & Craig, B. (2012). Introduction to the practice of statistics (7th ed.). New York:W.H. Freeman & Company.
39. Putnam, S. (1989). The TCN Salary Survey: A salary survey of neuropsychologists. The Clinical Neuropsychologist, 3, 97-115.
40. Rabin, L. A., Barr, W. B., & Burton, L. A. (2005). Assessment practices of clinical neuropsychologists in the United States and Canada:Asurvey of INS, NAN, and APA Division 40 members. Archives of Clinical Neuropsychology, 20, 33-65.
41. Reitan, R. M., & Wolfson, D. (1985). The Halstead-Reitan Neuropsychological Test Battery: Theory and interpretation. Tucson, AZ: Neuropsychology Press.
42. Rey, A. (1941). Lexamen psychologique dans les cas dencéphalopathie traumatique. Archives de Psychologie, 28, 21.
43. Rohling, M. L., Axelrod, B. N., & Wall, J. R. (2008, June). What impact does co-norming have on neuropsychological test scores: Myth vs. reality. Poster presented at the sixth annual meeting of the American Academy of Clinical Neuropsychology in Boston, MA. The Clinical Neuropsychologist, 22, 384-454.
44. Rohling, M. L., Langhinrichsen-Rohling, J., & Miller, L. S. (2003). Statistical methods for determining malingering:Rohlings interpretive method. In R. Franklin (Ed.), Prediction in forensic and neuropsychology: Sound statistical practices (pp. 171-207). Mahwah, NJ: Lawrence Erlbaum Associates.
45. Rohling, M. L., Miller, L. S., & Langhinrichsen-Rohling, J. (2004). Rohlings interpretive method for neuropsychological data analysis: A response to critics. Neuropsychology Review, 14, 155-169.
46. Rosenthal, R. (1995). Writing meta-Analytic reviews. Psychological Bulletin, 118, 183-192.
47. Ross, S. R., Putnam, S. H., Millis, S. R., Adams, K. M., & Krukowski, R. A. (2006). Detecting insufficient effort using the Seashore Rhythm and Speech-Sounds Perception Test in head injury. The Clinical Neuropsychologist, 20, 789-815.
48. Russell, E.W. (2004). The operating characteristics of the major HRNES-R measures. Archives of Clinical Neuropsychology, 19, 1043-1061.
49. Russell, E.W. (2012). Scientific foundations of neuropsychological assessment: With application to forensic evaluation (pp. 297-298).Waltham, MA: Elsevier.
50. Russell, E.W., Russell, S. L. K., & Hill, B. D. (2005). The fundamental psychometric status of neuropsychological batteries. Archives of Clinical Neuropsychology, 20, 785-794.
51. Schneider, J., & McGrew, K. (2011). Applied psychometrics 101-#10: "Just say no" to averaging IQ subtest scores. St. Josephs, MN: Institute of Applied Psychometrics. Retrieved September 10, 2014, from http://www.iapsych.com/iapap101/iap10110.pdf
52. Schretlen, D. J., Testa, S. M., & Pearlson, G. D. (2010). Calibrated Neuropsychological Normative System professional manual. Lutz, FL: Psychological Assessment Resources.
53. Slick, D. J., Sherman, E. M. S., & Iverson, G. L. (1999). Diagnostic criteria for malingered neurocognitive dysfunction: Proposed standards for clinical practice and research. Clinical Neuropsychology, 13, 545-561.
54. Spreen, O., & Strauss, E. (1998). A compendium of neuropsychological tests: Administration, norms, and commentary (2nd ed.). New York: Oxford University Press.
55. Stern, R. A., & White, T. (2003).Neuropsychological assessment battery: Administration, scoring, and interpretation manual. Lutz, FL: Psychological Assessment Resources.
56. Sweet, J. J., Meyers, D. G., Nelson, N.W., & Moberg, P. J. (2011). The TCN/AACN 2010 "Salary Survey:" Professional practices, beliefs, and incomes if U.S. neuropsychologists. The Clinical Neuropsychologist, 25, 12-61.
57. Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics (6th ed.). Boston: Allyn and Bacon.
58. Uttle, B. (2002). North American AdultReadingTest:Agenorms, reliability, and validity. Journal of Clinicaland Experimental Neuropsychology, 24, 1123-1137.
59. Wechsler, D. (2008). Wechsler Adult Intelligence Scale-Fourth edition. San Antonio, TX: Pearson.
60. Wechsler, D. (2009a). Wechsler Individual Achievement Test-Third edition. San Antonio, TX: Pearson.
61. Wechsler, D. (2009b). Wechsler Memory Scale-Fourth edition. San Antonio, TX: Pearson.
62. Weins, A. N., Tindall, A. G., & Crossen, J. R. (1994). California Verbal Learning Test: A normative data study. The Clinical Neuropsychologist, 8, 75-90.
63. White, T., & Stern, R. A. (2003). Neuropsychological assessment battery: Psychometric and technical manual (pp. 1-6). Lutz, FL: Psychological Assessment Resources.
64. Youngstrom, W. A., Glutiing, J. J., & Watkins, M.W. (2003). Stanford-Binet Intelligence Scale: Fourth Edition (SB4): Evaluating the empirical bases for interpretations. In C. R. Reynolds, & R. W. Kamphaus (Eds.), Handbook of psychological and educational assessment: Intelligence, aptitude, and achievement (2nd ed., pp. 217-242). New York: Guilford Press.
65. Zheng, B., & Agresti, A. (2000). Summarizing the predictive power of a generalized linear model. Statistics in Medicine, 19, 1771-1781.