Stability in Test-Usage Practices of Clinical Neuropsychologists in the United States and Canada over a 10-Year Period: A Follow-Up Survey of INS and NAN Members

Archives of Clinical Neuropsychology

Volumn 31, Issue 3, 2016, Pages 206-230

  Rabin, Laura A ^a   Paolillo, Emily ^a   Barr, William B ^b  

^a CITY UNIVERSITY OF NEW YORK   (United States)

^b NEW YORK UNIVERSITY MEDICAL CENTER   (United States)

Author keywords

Current assessment practices; Neuropsychology survey; Test usage

Indexed keywords

ADULT; AGED; CANADA; CLINICAL PSYCHOLOGY; EPIDEMIOLOGY; FEMALE; HEALTH CARE ORGANIZATION; HEALTH SURVEY; HUMAN; LONGITUDINAL STUDY; MALE; MENTAL DISORDERS; MIDDLE AGED; NEUROPSYCHOLOGICAL TEST; PSYCHOLOGY; REPRODUCIBILITY; UNITED STATES; VERY ELDERLY; WECHSLER INTELLIGENCE SCALE;

ADULT; AGED; AGED, 80 AND OVER; CANADA; FEMALE; HEALTH SURVEYS; HUMANS; LONGITUDINAL STUDIES; MALE; MENTAL DISORDERS; MIDDLE AGED; NEUROPSYCHOLOGICAL TESTS; PSYCHOLOGY, CLINICAL; REPRODUCIBILITY OF RESULTS; SOCIETIES, SCIENTIFIC; UNITED STATES; WECHSLER SCALES;

EID: 84965043343     PISSN: 08876177     EISSN: 18735843     Source Type: Journal    
DOI: 10.1093/arclin/acw007     Document Type: Article

References (103)

1. Benton, A. L. (1946). A visual retention test for clinical use. New York: Psychological Corporation.
2. Bilder, R. M. (2011). Neuropsychology 3.0: Evidence-based science and practice. Journal of the International Neuropsychological Society, 17, 7-13.
3. Bortnik, K. E., Boone, K. B., Wen, J., Lu, P., Mitrushina, M., Razani, J., et al. (2013). Survey results regarding use of the Boston Naming Test: Houston, we have a problem. Journal of Clinical and Experimental Neuropsychology, 35, 857-866.
4. Bowden, S. C., Fowler, K. S., Bell, R. C., Whelan, G., Clifford, C. C., Ritter, A. J., et al. (1998). The reliability and internal validity of the Wisconsin Card Sorting Test. Neuropsychological Rehabilitation, 8, 243-254.
5. Butler, M., Retzlaff, P., & Vanderploeg, R. (1991). Neuropsychological test usage. Professional Psychology: Research and Practice, 22, 510-512.
6. Cabral, J., Kringelbach, M. L., & Deco, G. (2014). Exploring the network dynamics underlying brain activity during rest. Progress in Neurobiology, 114, 102-131.
7. Calamia, M., Markon, K., & Tranel, D. (2012). Scoring higher the second time around: Meta-analyses of practice effects in neuropsychological assessment. The Clinical Neuropsychologist, 26, 543-570.
8. Camara, W. J., Nathan, J. S., & Puente, A. E. (2000). Psychological test usage: Implications in Professional Psychology. Professional Psychology: Research and Practice, 31, 141-154.
9. Chaytor, N., & Schmitter-Edgecombe, M. (2003). The ecological validity of neuropsychological tests: A review of the literature on everyday cognitive skills. Neuropsychology Review, 13, 181-197.
10. Crawford, J. R., & Garthwaite, P. H. (2008). On the "Optimal" size for normative samples in neuropsychology: Capturing the uncertainty when normative data are used to quantify the standing of a neuropsychological test score. Child Neuropsychology, 14, 99-117.
11. Dandachi-FitzGerald, B., Ponds, R.W. H. M., & Merten, T. (2013). Symptom validity and neuropsychological assessment: A survey of practices and beliefs of neuropsychologists in six European countries. Archives of Clinical Neuropsychology, 28, 771-783.
12. Davies, S. R., Field, A. R. J., Andersen, T., & Pestell, C. (2011). The ecological validity of the Rey-Osterreith Complex Figure: Predicting everyday problems in children with neuropsychological disorders. Journal of Clinical and Experimental Neuropsychology, 33, 820-831.
13. Decker, S. L., Schneider, W. J., & Hale, J. B. (2012). Estimating base rates of impairment in neuropsychological test batteries: Acomparison of quantitative models. Archives of Clinical Neuropsychology, 27, 69-84.
14. Delis, D., Kaplan, E., & Kramer, J. H. (2001). Delis-Kaplan Executive Function System. San Antonio, TX: Psychological Corporation.
15. Delis, D. C., Kramer, J. H., Kaplan, E., & Ober, B. A. (2000). The California Verbal Learning Test-Second Edition: Adult version manual. San Antonio, TX: The Psychological Corporation.
16. Delis, D. C., Kramer, J. H., Kaplan, E., Ober, B. A., & Fridlund, A. (1987). The California Verbal Learning Test. New York: Psychological Corporation.
17. Dodrill, C. B. (1997). Myths of neuropsychology. Clinical Neuropsychologist, 11, 1-17.
18. Duff, K. (2012). Evidence-based indicators of neuropsychological change in the individual patient: Relevant concepts and methods. Archives of Clinical Neuropsychology, 27, 248-261.
19. Elbulok-Charcape, M. M., Rabin, L. A., Spadaccini, A.T., & Barr, W. B. (2014). Trends in the neuropsychological assessment of ethnic/racial minorities: Asurvey of clinical neuropsychologists in the United States and Canada. Cultural Diversity & Ethnic Minority Psychology, 20, 353-361.
20. Gershon, R. C., Wagster, M. V., Hendrie, H. C., Fox, N. A., Cook, K. F., & Nowinski, C. J. (2013). NIH toolbox for assessment of neurological and behavioral function. Neurology, 80 (11 Suppl. 3), S2-S6.
21. Gevins, A., Ilan, A. B., Jiang, A., Chan, C. S., Gelinas, D., Smith, M. E., et al. (2011). A method to combine cognitive and neurophysiological assessments of the elderly. Dementia and Geriatric Cognitive Disorders, 31, 7-19.
22. Gold, D. A. (2012). An examination of instrumental activities of daily living assessment in older adults and mild cognitive impairment. Journal of Clinical and Experimental Neuropsychology, 34, 11-34.
23. Golden, C. J., & Hines, L. (2010). Normative data and scaling issues in neuropsychology. In L.C. Hartlage, & , JrA. M. Horton (Eds.), Handbook of forensic neuropsychology (2nd ed., pp. 75-90). NY: Springer Publishing Company.
24. Guilmette, T. J., Faust, D., Hart, K., & Arkes, H. R. (1990). A national survey of psychologists who offer neuropsychological services. Archives of Clinical Neuropsychology, 5, 373-392.
25. Hall, V. L. (2013). Use of theWechsler scales in traumatic brain injury: Cautions in the newWechsler scales. Clinical Psychology Forum, 245, 15-19.
26. Harry, A., & Crowe, S. F. (2014). Is the Boston Naming Test still fit for purpose? The Clinical Neuropsychologist, 28, 486-504.
27. Hartlage, L. C., & Telzrow, C. F. (1980). The practice of clinical neuropsychology in the U.S. Clinical Neuropsychology, 2, 200-202.
28. Harvey, P. D. (2012). Clinical applications of neuropsychological assessment. Dialogues in Clinical Neuroscience, 14 (1), 91.
29. Hathaway, S. R., & McKinley, J. C. (1951). The Minnesota multiphasic personality interview. New York: The Psychological Corporation.
30. Heaton, R. K., Chelune, G. J., Talley, J. L., Kay, C. G., & Curtiss, G. (1993). Wisconsin Card Sorting Test manual. Odessa, FL: Psychological Assessment Resources.
31. Heaton, R. K., Miller, W., Taylor, M. J., & Grant, I. (2004). Revised comprehensive norms for an expanded Halstead-Reitan Battery: Demographically adjusted neuropsychological norms for African American and Caucasian adults. Lutz, FL: Psychological Assessment Resources.
32. Heaton, R. K., Ryan, L., & Grant, I. (2009). Demographic influences and use of demographically corrected norms in neuropsychological assessment. In I. Grant, & K. Adams(Eds.), Neuropsychological assessment of neuropsychiatric and neuromedical disorders (pp. 127-155). NewYork, NY: Oxford University Press.
33. Heflin, L. H., Laluz, V., Jang, J., Ketelle, R., Miller, B. L., & Kramer, J. H. (2011). Let's inhibit our excitement: The relationships between Stroop, behavioral disinhibition, and the frontal lobes. Neuropsychology, 25, 655-665.
34. Hilsabeck, R. C., & Martin, E. M. (2010). Women and advancement in neuropsychology: Real-life lessons learned. The Clinical Neuropsychologist, 24, 481-492.
35. Hoge, M. A., Karel, M. J., Zeiss, A. M., Alegria, M., & Moyle, J. (2015). Strengthening psychology's workforce for older adults: Implications of the Institute of Medicine's report to Congress. American Psychologist, 70, 265-278.
36. Hoppmann, C. A., & Riediger, M. (2009). Ambulatory assessment in lifespan psychology: An overview of current status and new trends. European Psychologist, 14, 98-108.
37. Ingraham, L. J., & Aikken, C. B. (1996). An empirical approach to determining criteria for abnormality in test batteries with multiple measures. Neuropsychology, 10, 120-124.
38. Jagaroo, V. (2009). Neuroinformatics for neuropsychology. New York, NY: Springer.
39. Jastak, J., & Wilkinson, G. S. (1984). The wide range achievement test-revised. Wilmington, DE: Jastak Associates.
40. Jekel, K., Damian, M., Wattmo, C., Hausner, L., Bullock, R., Connelly, R. J., et al. (2015). Mild cognitive impairment and deficits in instrumental activities of daily living: A systematic review. Alzheime's Research & Therapy, 7-17.
41. Kamat, R., Weinborn, M., Kellogg, E. J., Bucks, R. S., Velnoweth, A., & Woods, S. P. (2014). Construct validity of the Memory for Intentions Screening Test (MIST) in healthy older adults. Assessment, 21, 742-753.
42. Kanauss, K., Schatz, P., & Puente, A. E. (2005). Current trends in the reimbursement of professional neuropsychological services. Archives of Clinical Neuropsychology, 20 (3), 341-353.
43. Kaufmann, P. M. (2009). Protecting raw data and psychological tests from wrongful disclosure: A primer on the law and other persuasive strategies. The Clinical Neuropsychologist, 23, 1130-1159.
44. Kohout, J., & Wicherski, M. (2010). 2011 graduate study in psychology snapshot: Applications, acceptances, enrollments, and degrees awarded to master's-and doctoral-level students in U.S. and Canadian graduate departments of psychology: 2009-2010. Center for Workforce Studies, American Psychology Association. Retrieved http://www.apa.org/workforce/publications/11-grad-study/applications.pdf (accessed 22 June 2015).
45. Kremen, W. S., Lachman, M. E., Pruessner, J. C., Sliwinski, M., & Wilson, R. S. (2012). Mechanisms of age-related cognitive change and targets for intervention: Social interactions and stress. The Journals of Gerontology Series A: Biological Sciences and Medical Sciences, 67, 760-765.
46. LaDuke, C., DeMatteo, D., Heilbrun, K., & Swirsky-Sacchetti, T. (2012). Clinical neuropsychology in forensic contexts: Practitioners' experience, training, and practice. Professional Psychology: Research and Practice, 43, 503-509.
47. LaDuke, C., Barr, W. B., Brodale, D., & Rabin, L. A. (2016). Common test utilization in forensic neuropsychological assessment: A survey of INS and NAN members. Presented at the 2016 American Academy of Clinical Neuropsychology Annual Meeting, Chicago.
48. Larrabee, G. J. (2008). Flexible vs. fixed batteries in forensic neuropsychological assessment: Reply to Bigler and Hom. Archives of Clinical Neuropsychology, 23, 763-776.
49. Lees-Haley, P. R., Smith, H. H., Williams, C. W., & Dunn, J. T. (1996). Forensic neuropsychological test usage: An empirical study. Archives of Clinical Neuropsychology, 11, 45-51.
50. Lemonda, B., Barr, W. B., & Rabin, L. A. (2016). Assessment trends for neuropsychologists conducting evaluations on sport-related concussion. Presented at the 2016 American Academy of Clinical Neuropsychology Annual Meeting, Chicago.
51. Lewis, R. F., & Rennick, P. M. (1979). Manual for the repeatable cognitive-perceptual-motor battery. Grosse Pointe Park, MI: Axon Publishing.
52. Lippa, S. M., Hawes, S., Jokic, E., & Caroselli, J. S. (2013). Sensitivity of the RBANS to acute traumatic brain injury and length of post-traumatic amnesia. Brain Injury, 27, 689-695.
53. Loring, D.W., & Bauer, R. M. (2010). Testing the limits: Cautions and concerns regarding the newWechsler IQ and Memory scales. Neurology, 74, 685-690.
54. Martin, P. K., Schroeder, R.W., & Odland, A. P. (2015). Neuropsychologists' validity testing beliefs and practices: Asurvey of North American Professionals. The Clinical Neuropsychologist, 29, 741-776.
55. Meador, K. J., Gevins, A., Loring, D.W., McEvoy, L. K., Ray, P. G., Smith, M. E., et al. (2007). Neuropsychological and neurophysiological effects of carbamazepine and levetiracetam. Neurology, 69, 2076-2084.
56. McEvoy, L. K., Smith, M. E., Fordyce, M., & Gevins, A. (2006). Characterizing impaired functional alertness from diphenhydramine in the elderly with performance and neurophysiologic measures. Sleep, 29, 959-966.
57. Mitrushina, M., Boone, K. B., Razani, J., & D'Elia, L. F. (2005). Handbook of normative data for neuropsychological assessment. New York, NY: Oxford University Press.
58. Moore, D. J., Palmer, B.W., Patterson, T. L., & Jeste, D. V. (2007). A review of performance-based measures of functional living skills. Journal of Psychiatric Research, 41, 97-118.
59. National Science Foundation. (2013). Women, minorities, and persons with disabilities in science and engineering. Arlington, VA: NSF 13-304. Retrieved http://www.nsf.gov/statistics/wmpd/2013/digest/theme2-1.cfm.
60. Palta, P., Schneider, A. L. C., Biessels, G. J., Touradji, P., & Hill-Briggs, F. (2014). Magnitude of cognitive dysfunction in adults with Type 2 diabetes: A meta-analysis of six cognitive domains and the most frequently reported neuropsychological tests within domains. Journal of the International Neuropsychological Society, 20, 278-291.
61. Paolillo, E.W., Elbulok-Charcape, M. M., Barr, W. B., & Rabin, L. A. (2016). Utilization of instruments with alternate/parallel test forms among clinical neuropsychologists in the U.S. and Canada. Presented at the 44th Annual Meeting of the International Neuropsychological Society, Boston.
62. Parsons, T. D. (2011). Neuropsychological assessment using virtual environments: Enhanced assessment technology for improved ecological validity. In S. Brahnam (Ed.), Advanced computational intelligence paradigms in healthcare: Virtual reality in psychotherapy, rehabilitation, and assessment (pp. 271-289). Germany: Springer-Verlag.
63. Parsons, T. D. (2012). Virtual simulations and the second life metaverse: Paradigm shift in neuropsychological assessment. In V. Zagalo, T. Morgado, & A. Boa-Ventura (Eds.), Virtual worlds, second life and metaverse platforms: New communication and identity paradigms (pp. 234-250). Hershey: IGI Global.
64. Parsons, T. D. (2015). Ecological validity in virtual reality-based neuropsychological assessment. In Mehdi Khosrow-Pour (Ed.), Information Science and Technology, 3rd ed. (pp. 214-223), Hershey: IGI Global.
65. Perry, W. (2009). Beyond the numbers: Expanding the boundaries of neuropsychology. Archives of Clinical Neuropsychology, 24, 21-29.
66. Possin, K. L., LaMarre, A. K., Wood, K. A., Mungas, D. M., & Kramer, J. H. (2014). Ecological validity and neuroanatomical correlates of the NIH EXAMINER Executive Composite Score. Journal of the International Neuropsychological Society, 20, 20-28.
67. Puente, A. E., & Puente, A. N. (2013). Assessment of neuropsychological functioning. In K.F. Geisinger (Editor in Chief), APAhandbookof testing and assessment in psychology: Vol. 2. testing and assessment in clinical and counseling psychology (pp. 133-152), Washington, DC: American Psychological Association.
68. Rabin, L. (2001). Test usage patterns and perceived ecological utility of neuropsychological assessment techniques: A survey of North American clinical neuropsychologists. Ann Arbor, MI: ProQuest.
69. Rabin, L. A., Barr, W. B., & Burton, L. A. (2005). Assessment practices of clinical neuropsychologists in the United States and Canada: Asurvey of INS, NAN, and APA Division 40 members. Archives of Clinical Neuropsychology, 20, 33-65.
70. Rabin, L. A., Borgos, M. J., & Saykin, A. J. (2008). A survey of neuropsychologists' practices and perspectives regarding the assessment of judgment ability. Applied Neuropsychology, 15, 264-273.
71. Rabin, L. A., Burton, L. A., & Barr, W. B. (2007). Utilization rates of ecologically oriented instruments among clinical neuropsychologists. The Clinical Neuropsychologist, 21, 727-743.
72. Rabin, L., Spadaccini, A., Brodale, D., Charcape, M., & Barr, B. (2014). Utilization rates of computerized tests and test batteries among clinical neuropsychologists in the U.S. and Canada. Professional Psychology: Research and Practice, 45, 368-377.
73. Raichle, M. E. (2011). The restless brain. Brain Connectivity, 1, 3-12.
74. Reinvang, I. (2014). A lifetime in neuropsychology - Perspectives on an era. Scandinavian Journal of Psychology, 55, 189-190.
75. Reitan, R. M. (1958). Validity of the Trail Making test as an indicator of organic brain damage. Perceptual and Motor Skills, 8, 271-276.
76. Reitan, R.M., & Wolfson, D. (1985). The Halstead Reitan neuropsychological test battery: Theory and clinical interpretation. Tucson, AZ: Neuropsychology Press.
77. Rey, A. (1941). Psychologicalexamination of traumatic encephalopathy.Archives de Psychologie, 28, 286-340 (sections translated byCorwin, J., & Bylsma, F.W. The Clinical Neuropsychologist, 7, 4-9.
78. Ritchie, D., Odland, A. P., Ritchie, A. S., & Mittenberg, W. (2012). Selection criteria for internships in clinical neuropsychology. The Clinical Neuropsychologist, 26, 1245-1254.
79. Rizzo, A., & Kim, G. J. (2005). A SWOT analysis of the field of virtual reality rehabilitation and therapy. Presence, 14 (2), 119-146.
80. Rohling, M. L., Miller, R. M., Axelrod, B. N., Wall, J. R., Lee, A. J. H., & Kinikini, D.T. (2015). Is co-norming required? Archives of Clinical Neuropsychology, 30, 611-633.
81. Ryan, J. J., Glass, L. A., & Tree, H. A. (2008). Administration frequencies ofWAIS-III supplementary and optional subtests of board-certified clinical neuropsychologists. Archives of Clinical Neuropsychology, 15, 205-207.
82. Schretlen, D. J., Testa, S. M., & Pearlson, G. D. (2010). Calibrated neuropsychologicalnormative system professional manual. Lutz, FL: Psychological Assessment Resources.
83. Scott, S. B., Graham-Engeland, J. E., Engeland, C. G., Smyth, J. M., Almeida, D. M., Katz, M. J., et al. (2015). The effects of stress on cognitive aging, physiology and emotion (ESCAPE) project. BMC Psychiatry, 15, 146.
84. Seretny, M. L., Dean, R. S., Gray, J. W., & Hartlage, L. C. (1986). The practice of clinical neuropsychology in the United States. Archives of Clinical Neuropsychology, 1, 5-12.
85. Sharland, M. J., & Gfeller, J. D. (2007). A survey of neuropsychologists' beliefs and practices with respect to the assessment of effort. Archives of Clinical Neuropsychology, 22, 213-223.
86. Slick, D. J., Tan, J. E., Strauss, E. H., & Hultsch, D. F. (2004). Detecting malingering: Asurvey of experts' practices. Archives of Clinical Neuropsychology, 19 (4), 465-473.
87. Smith, S. R., Gorske, T. T., Wiggins, C., & Little, J. A. (2010). Personality assessment use by clinical neuropsychologists. International Journal of Testing, 10, 6-20.
88. Stern, R. A., & White, T. (2003). Neuropsychological assessment battery: Administration, scoring, and interpretation manual. Lutz, FL: Psychological Assessment Resources.
89. Strauss, E., Sherman, E. M., & Spreen, O. (2006). A compendium of neuropsychological tests: Administration, norms, and commentary. USA: Oxford University Press.
90. Sweet, J. J., Meyer, D. G., Nelson, N.W., & Moberg, P. J. (2011). The TCN/AACN 2010 "Salary Survey": Professional practices, beliefs, and incomes of U.S. neuropsychologists. The Clinical Neuropsychologist, 25, 12-61.
91. Sweet, J. J., Moberg, P., & Suchy, Y. (2000). Ten-year follow-up survey of clinical neuropsychologists: Part I. Practices and beliefs. The Clinical Neuropsychologist, 14, 18-37.
92. Sweet, J., Nelson, N., & Moberg, P. (2006). The TCN/AACN 2005 "Salary Survey": Professional practices, beliefs, and incomes of U.S. neuropsychologists. The Clinical Neuropsychologist, 20, 325-364.
93. Tan, J. E., Springate, B. A., & Tremont, G. (2012). Neuropsychologists' beliefs about alcohol and dementia. The Clinical Neuropsychologist, 26, 879-893.
94. Thompson, G. J., Pan, W-J., & Keilholz, S. D. (2015). Different dynamic resting state fMRI patterns are linked to different frequencies of neural activity. Journal of Neurophysiology. doi: 10.1152/jn.00235.2015.
95. Trull, T. J., & Ebner-Priemer, U. (2013). Ambulatory assessment. Annual Review of Clinical Psychology, 9, 151-176.
96. Van der Elst, W., Van Boxtel, M. P., Van Breukelen, G. J., & Jolles, J. (2008). A large-scale cross-sectional and longitudinal study into the ecological validity of neuropsychological test measures in neurologically intact people. Archives of Clinical Neuropsychology, 23, 787-800.
97. Wechsler, D. (1955). Wechsler Adult Intelligence Scale manual. New York: The Psychological Corporation.
98. Wechsler, D. (1974). Wechsler Memory Scale manual. San Antonio, TX: The Psychological Corporation.
99. Wechsler, D. (1981). Wechsler Adult Intelligence Scale-Revised manual. New York: The Psychological Corporation.
100. Wechsler, D. (1987). Wechsler Memory Scale-Revised manual. San Antonio, TX: The Psychological Corporation.
101. Wechsler, D. (1991). Wechsler Intelligence Scale for Children-Third Edition Manual. San Antonio, TX: The Psychological Corporation.
102. Wilde, M. C. (2006). The validity of the Repeatable Battery of Neuropsychological Status in acute stroke. The Clinical Neuropsychologist, 20, 702-715.
103. Williams, R. N., Gupta, A. S., Finch, W. H., & Randolph, C. (2015). Evaluating neurocognitive deficits in patients with multiple sclerosis via a brief neuropsychological approach. Applied Neuropsychology. doi: 10.1080/23279095.2014.949717.