The Role of External Validity in Evidence-Based Practice for Rehabilitation

Rehabilitation Psychology

Volumn 53, Issue 3, 2008, Pages 294-302

  Schutz, Larry E ^a   Rivers, Kenyatta O ^a   Ratusnik, David L ^a  

^a UNIVERSITY OF CENTRAL FLORIDA   (United States)

Author keywords

evidence based practice; generalizability, cognitive rehabilitation; randomized clinical trials; research design

Indexed keywords

ARTICLE; CLINICAL RESEARCH; COGNITIVE REHABILITATION; EVIDENCE BASED PRACTICE; EXPERIMENTAL STUDY; EXTERNAL VALIDITY; INTERNAL VALIDITY; PRACTICE GUIDELINE; REHABILITATION CARE; VALIDATION STUDY;

EID: 54949154836     PISSN: 00905550     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0012923     Document Type: Article

References (118)

1. Agency for Healthcare Policy and Research. Rehabilitation for traumatic brain injury: Evidence Report/Technology Assessment No. 2 (AHCPR Pub No. 99-E005) (1999), Author, Rockville, MD
2. American Occupational Therapy Federation. International conference on evidence-based occupational therapy (2004). http://www.aota.org/documentvault/35636.aspx Retrieved June 30, 2007, from www.aota.org/documentvault/35636.aspx
3. American Psychological Association. Standards for psychological and educational testing (1985), Author, Washington, DC
4. American Psychological Association. Evidence-based practice in psychology. American Psychologist 61 (2006) 271-285
5. American Speech-Language-Hearing Association. Evidence-based practice in communication disorders (2005). http://www.asha.org/docs/html/PS2005-00221.html Retrieved June 30, 2007, from http://www.asha.org/docs/html/PS2005-00221.html
6. Argyris C. Knowledge for action: A guide to overcoming barriers to organizational change (1993), Jossey-Bass, San Francisco
7. Bailar J.C. Response to "Meta-analyses and large randomized, controlled trials.". The New England Journal of Medicine 338 (1998, January 1) 62
8. Bartholomew L.K., Parcel G.S., Kok G., and Gottlieb N.H. Intervention mapping: Theory and evidence-based promotion programs (2001), Mayfield, Mountain View, CA
9. Ben-Yishay Y., Ben-Nachum Z., Cohen A., Gross Y., Hoofien D., and Rattok J. Digest of a two-year comprehensive clinical research program for out-patient head injured Israeli veterans. NYU rehabilitation monograph #59: Working approaches to remediation of cognitive deficits in brain damaged persons (1978), New York University Press, New York 1-61
10. Ben-Yishay Y., and Prigatano G. Cognitive remediation. In: Rosenthal M., Griffith E., Bond M., and Miller J. (Eds). Rehabilitation of the adult and child with traumatic head injury. 2nd ed. (1990), Davis, Philadelphia 393-409
11. Blackmore S.J. A report of a visit to Carl Sargent's laboratory. Journal of the Society for Psychical Research 54 (1987) 186-198
12. Bleiberg J., Cope D., and Spector J. Cognitive assessment and therapy in traumatic brain injury. In: Horn L.J., and Cope D.N. (Eds). Physical medicine and rehabilitation state of the art reviews: Traumatic brain injury (1989), Haley and Belfus, Philadelphia 95-122
13. Boake C. History of cognitive rehabilitation following head injury. In: Kreutzer J.S., and Wehman P.H. (Eds). Cognitive rehabilitation for persons with traumatic brain injury (1991), Imaginart, Bisbee, AZ 3-12
14. Boake C., and Diller L. History of rehabilitation for traumatic brain injury. In: High W.M., Sander A.M., Struchen M.A., and Hart K.A. (Eds). Rehabilitation for traumatic brain injury (2005), Oxford University Press, New York 3-13
15. Bohart A., and Tallman K. How clients make psychotherapy work: The process of active self-healing (1999), American Psychological Association Press, Washington, DC
16. Booth A., and Brice A. A brief history of evidence-based practice. In: Booth A., and Brice A. (Eds). Evidence-based practice for information professionals (2004), Facet Publishing, London 13-24
17. Boring E. A history of experimental psychology (1929), Appleton-Century-Crofts, New York
18. Burgess S., and Turkstra L.S. Social skills intervention for adolescents with autism spectrum disorders: A review of the experimental evidence. EBP Briefs 1 (2006) 1-19
19. Burstein A.G., and Loucks S. The psychologist as health care clinician. In: Millon T., Green C., and Meagher R. (Eds). Handbook of clinical health psychology (1982), Plenum, New York 175-189
20. Cappa S.F., Benkeb T., Clarkec S., Rossid B., Stemmere B., and van Heugten C.M. EFNS guidelines on cognitive rehabilitation: Report of an EFNS task force. European Journal of Neurology 12 (2006) 665-680
21. Carney N., Chesnut R.M., Maynard H., Mann N.C., and Helfand M. Effect of cognitive rehabilitation on outcomes for persons with traumatic brain injury: A systematic review. Journal of Head Trauma Rehabilitation 14 (1999) 227-307
22. Chambless D.L., and Hollon S.D. Defining empirically supported therapies. Journal of Consulting and Clinical Psychology 66 (1998) 7-18
23. Cicerone K.D. Evidence-based practice and the limits of rational rehabilitation. Archives of Physical Medicine and Rehabilitation 86 (2005) 1073-1074
24. Cicerone K.D., Dahlberg C., Kalmar K., Langenbahn D.M., Malec J.F., Bergquist T.F., et al. Evidence-based cognitive rehabilitation: Recommendations for clinical practice. Archives of Physical Medicine and Rehabilitation 81 (2000) 1596-1613
25. Cicerone K.D., Dahlberg C., Malec J.F., Langenbahn D.M., Felicetti T., Kniepp S., et al. Evidence-based cognitive rehabilitation: Updated review of the literature from 1998 through 2002. Archives of Physical Medicine and Rehabilitation 86 (2005) 1681-1692
26. Clarkin J.F., and Levy K.N. The influence of client variables on psychotherapy. In: Lambert M.J. (Ed). Bergin and Garfield's handbook of psychotherapy and behavior change. 5th ed. (2004), Wiley, New York 194-226
27. Cochrane A. Effectiveness and efficiency: Random reflections on health services (1972), Nuffield Provincial Hospitals Trust, London
28. Coelho C., DeRuyter F., and Stein M. Treatment efficacy: Cognitive-communicative disorders resulting from traumatic brain injury in adults. Journal of Speech and Hearing Research 39 (1996) S5-S17
29. Cohen A., Stavri P.Z., and Hersh W.R. A categorization and analysis of the criticisms of evidence-based medicine. International Journal of Medical Informatics 73 (2004) 35-43
30. Cope D.N., and Reynolds W.E. Systems of care. In: Yudofsky S.C., McAllister T.W., and Silver J.M. (Eds). Textbook of traumatic brain injury (2005), American Psychiatric Publishing, Washington, DC 559-569
31. Coyne J.C., and Holroyd K. Stress, coping and illness: A transactional perspective. In: Millon T., Green C., and Meagher R. (Eds). Handbook of clinical health psychology (1982), Plenum, New York 103-127
32. Crepeau F., and Scherzer P. Predictors and indicators of work status after traumatic brain injury: A meta-analysis. Neuropsychological Rehabilitation 3 (1993) 5-35
33. Cromer A. Connected knowledge (1997), Oxford University Press, New York
34. Cronbach L. Designing evaluations of educational and social programs (1982), Jossey-Bass, San Francisco
35. Cronbach L., Gleser G., Nanda H., and Rajaratnam N. The dependability of behavioral measurements: Theory of generalizability for scores and profiles (1972), Wiley, New York
36. DeLisa J. Issues and challenges for physiatry in the coming decade. Archives of Physical Medicine and Rehabilitation 80 (1999) 1-12
37. Deshler D.D. Intervention research and bridging the gap between research and practice. The ERIC Clearinghouse on Disabilities and Gifted Education (2005). http://www.ldonline.org/article/5596 Retrieved June 30, 2007, from www.ldonline.org/article/5596
38. Edelson M. Can psychotherapy research answer this psychotherapist's questions?. In: Talley P., Strupp H., and Butler S. (Eds). Psychotherapy research and practice: Bridging the gap (1994), Basic, New York 60-87
39. Engel G.L. The need for a new medical model: A challenge for biomedicine. Science 196 (1977, April 8) 129-136
40. Fordyce W.E. Behavioral methods in rehabilitation. In: Neff W.S. (Ed). Rehabilitation psychology (1970), American Psychological Association Press, Washington, DC 74-108
41. Frank J.D., and Frank J.B. Persuasion and healing: A comparative study of psychotherapy (1993), Johns Hopkins University Press, Baltimore
42. Garfield S.L. Some problems associated with "validated" forms of psychotherapy. Clinical Psychology: Science and Practice 3 (1996) 218-229
43. Gatchel R.J., and Maddrey A.M. Experimental design issues in clinical research of musculoskeletal pain disabilities. Critical Reviews in Physical and Rehabilitation Medicine 12 (2000) 91-101
44. Gates J. Viewpoints on String Theory [Interview] (2003). http://www.pbs.org/wgbh/nova/elegant/view-gates.html Retrieved March 15, 2008, from http://www.pbs.org/wgbh/nova/elegant/view-gates.html
45. Gigerenzer G. Adaptive thinking: Rationality in the real world (2000), Oxford University Press, New York
46. Gordon W.A., and Hibbard M. Cognitive rehabilitation. In: Silver J.M., McAllister T.W., and Yudofsky S.C. (Eds). Textbook of traumatic brain injury (2005), American Psychiatric Publishing, Washington, DC 655-660
47. Gordon W.A., Zafonte R., Cicerone K., Cantor J., Brown M., Lombard L., et al. Traumatic brain injury rehabilitation: State of the science. American Journal of Physical Medicine and Rehabilitation 85 (2006) 343-382
48. Green L.W., and Glasgow R.E. Evaluating the relevance, generalizability, and applicability of research: Issues in external validation and translation of methodology. Evaluation and the Health Professions 29 (2006) 126-153
49. Guala F. Experimental localism and external validity. Philosophy of Science 70 (2003) 1195-1205
50. Guyatt G.H., Sackett D.L., Sinclair J.C., Hayward R.C., Cook D.J., and Cook R.J. User's guides to the medical literature IX: A method for grading health care recommendations. Journal of the American Medical Association 274 (1995) 1800-1804
51. Havens L.C. Approaches to the mind (1973), Little, Brown, Boston
52. Havens L.C. Some suggestions for making research more applicable to clinical practice. In: Talley P., Strupp H., and Butler S. (Eds). Psychotherapy research and practice: Bridging the gap (1994), Basic, New York 88-98
53. Henry W.P. Science, politics, and the politics of science: The use and misuse of empirically validated treatment research. Psychotherapy Research 8 (1998) 126-140
54. Henry W.P., Schacht T.E., Strupp H.H., Butler S.F., and Binder L. The effects of training in time-limited psychotherapy: Changes in therapist behavior. Journal of Consulting and Clinical Psychology 61 (1993) 434-440
55. Hill A.B. The environment and disease: Association or causation. Proceedings of the Royal Society of Medicine 58 (1965) 295-300
56. Institute of Medicine. Crossing the quality chasm: A new health system for the 21st century (2001), National Academies Press, Washington, DC
57. Kamhi A.G. Some final thoughts on EBP. Language, Speech, and Hearing Services in Schools 37 (2006) 320-322
58. Katz D.I., Ashley M.J., O'Shanick G.J., and Connors S.W. Cognitive rehabilitation: The evidence, funding, and case for advocacy in brain injury (2006), Brain Injury Association of America, McLean, VA
59. Kazdin A.E. Methodological issues and strategies in clinical research (1992), American Psychological Association Press, Washington, DC
60. Kelly G. The psychology of personal constructs (1955), Norton, New York
61. Kernberg O., and Clarkin J.F. Training and the integration of research and clinical practice. In: Talley P., Strupp H., and Butler S. (Eds). Psychotherapy research and practice: Bridging the gap (1994), Basic Books, New York 39-59
62. Klonoff P.S., Lamb D.G., and Henderson S.W. Outcomes from milieu-based neurorehabilitation at up to 11 years post-discharge. Brain Injury 15 (2001) 413-428
63. Kuhn T.S. The structure of scientific revolutions (1962), University of Chicago Press, Chicago
64. Lambert M.J. Psychotherapy outcome research: Implications for integrative and eclectic theories. In: Norcross J.C., and Goldfried M.R. (Eds). Handbook of psychotherapy integration (1992), Basic, New York 94-129
65. Law M. Introduction to evidence-based practice. In: Law M. (Ed). Evidence-based rehabilitation (2002), Slack, Thorofare, NJ 1-14
66. Lipsey M. The challenges of interpreting research for use by practitioners. American Journal of Preventative Medicine 28 (2005) 1-3
67. Lipsey M.W., and Wilson D.B. The efficacy of psychological, educational, and behavioral treatment. American Psychologist 48 (1993) 1181-1201
68. Malec J. Cognitive rehabilitation. In: Evans R.W. (Ed). Neurology and trauma (1996), Saunders, Philadelphia 231-248
69. Maling M.S., and Howard K.I. From research to practice to research to.... In: Talley P.F., Strupp H.H., and Butler S.P. (Eds). Psychotherapy research and practice: Bridging the gap (1994), Basic, New York 246-253
70. Marceil J.C. Implicit dimensions of idiography and nomothesis: A reformulation. American Psychologist 32 (1977) 1046-1055
71. Meehl P.E. Psychodiagnosis: Selected papers (1977), Norton, New York
72. Meehl P.E. Theoretical risks and tabular asterisks. Journal of Consulting and Clinical Psychology 46 (1978) 806-834
73. Moras K. Spence and Havens: Examples of practitioner contributions to bridging the chasm. In: Talley P., Strupp H., and Butler S. (Eds). Psychotherapy research and practice: Bridging the gap (1994), Basic, New York 181-195
74. Mulrow C.D., and Lohr K.N. Proof and policy from medical research evidence. Journal of Health Politics, Policy and Law 26 (2001) 249-266
75. Nathan P.E., and Gorman J. Efficiency, effectiveness, and the clinical utility of psychotherapy research. In: Nathan P.E., and Gorman J. (Eds). A guide to treatments that work. 2nd ed. (2002), Oxford University Press, New York 643-654
76. National Academy of Neuropsychology. Cognitive rehabilitation (2002). http://www.nanonline.org/NAN/PAIC/PositionPapers/CognitiveRehabilitation.aspx Retrieved March 15, 2008, from http://www.nanonline.org/NAN/PAIC/PositionPapers/CognitiveRehabilitation.aspx
77. National Institutes of Health Consensus Development Panel. Rehabilitation of persons with traumatic brain injury (1998). http://consensus.nih.gov/1998/1998TraumaticBrainInjury109html.htm Retrieved June 30, 2007, from http://consensus.nih.gov/1998/1998TraumaticBrainInjury109html.htm
78. Naylor C.W. Grey zones of clinical practice: Some links to evidence-based medicine. Lancet 345 (1995) 840-842
79. Osipow S., and Walsh W. Strategies in counseling for behavior change (1970), Appleton-Century-Crofts, New York
80. Pepper S. World hypotheses (1942), University of California Press, Berkeley, CA
81. Popper K. The logic of scientific discovery (1959), Basic, New York
82. Porter R. The greatest benefit to mankind: A medical history of humanity from antiquity to the present (1997), Harper-Collins, London
83. Prigatano G., Fordyce D.J., Zeiner H.K., Roueche J.R., Pepping M., and Wood B.C. Neuropsychological rehabilitation after closed head injury in young adults. Journal of Neurology, Neurosurgery and Psychiatry 47 (1984) 505-513
84. Ratner N.B. Evidence-based practice: An examination of its ramifications for the practice of speech-language pathology. Language, Speech, and Hearing Services in Schools 37 (2006) 257-267
85. Rogers C. On becoming a person (1961), Houghton-Mifflin, New York
86. Rosenthal R., and Rubin D.B. Interpersonal expectancy effects: The first 345 studies. Behavioral and Brain Sciences 1 (1978) 377-415
87. Roth A., and Fonagy P. What works for whom: A critical review of psychotherapy research. 2nd ed. (2005), Guilford, New York
88. Sackett D.L., Haynes R., and Tugwell P. Clinical epidemiology (1985), Little, Brown, Boston
89. Sackett D.L., Rosenberg W., Muir-Gray J.A., Haynes R., and Richardson W.S. Evidence-based practice: What it is and what it isn't. It's about integrating individual clinical expertise and the best external evidence. British Medical Journal 312 (1996) 71-72
90. Salazar A.M., Warden D.L., Schwab K., Spector J., Braverman S., Walter J., et al. Cognitive rehabilitation for traumatic brain injury: A randomized trial. Journal of the American Medical Association 283 (2000) 3075-3081
91. Schofield W. Clinical psychologists as health professionals. In: Stone G.C., Cohen F., and Adler N.E. (Eds). Health psychology: A handbook (1979), Jossey-Bass, San Francisco 447-463
92. Schutz L.E. Models of exceptional adaptation in recovery from traumatic brain injury: A case series. Journal of Head Trauma Rehabilitation 22 (2007) 48-55
93. Schutz L., and Schutz J. Successful educational re-entry after severe traumatic brain injury: The contribution of cognitive compensation strategies. Florida Journal of Communication Disorders 20 (2000) 28-36
94. Schutz, L. E., & Schutz, M. E. (2008). Head injury recovery in real life. Manuscript submitted for publication.
95. Schutz L.E., and Trainor K. Evaluation of cognitive rehabilitation as a treatment paradigm. Brain Injury 21 (2007) 545-557
96. Seligman M. Afterword--A plea. In: Nathan P.E., and Gorman J. (Eds). A guide to treatments that work (1998), Oxford University Press, New York 568-572
97. Sexton T.L. The relevance of counseling outcome research: Current trends and practical implications. Journal of Counseling & Development 74 (1996) 590-600
98. Shadish W.R., Cook T.D., and Campbell D.T. Experimental and quasi-experimental designs for generalized causal inference (2002), Houghton-Mifflin, Boston
99. Shallice T. Cognitive neuropsychology and rehabilitation: Is pessimism justified?. Neuropsychological Rehabilitation 10 (2000) 209-217
100. Silverman W.H. Cookbooks, manuals, and paint-by-numbers psychotherapy in the ′90s. Psychotherapy 33 (1996) 207-215
101. Smith E. A passionate, rational response to the "manualization" of psychotherapy. Psychotherapy Bulletin 30 (1995) 36-40
102. Smith M.L., Glass G.V., and Miller T.I. The benefits of psychotherapy (1980), Johns Hopkins University Press, Baltimore
103. Strupp H.H., Hadley S., and Gomes-Schwartz B. Psychotherapy for better or worse (1977), Aronson, New York
104. Thomas J.D., and Trexler L.E. Behavioral and cognitive deficits in cerebrovascular accident and closed head injury: Implications for cognitive rehabilitation. In: Trexler L.E. (Ed). Cognitive rehabilitation: Conceptualization and intervention (1982), Plenum, New York 27-62
105. Trexler L.E., and Fordyce D.J. Psychological perspectives on rehabilitation: Contemporary assessment in intervention strategies. In: Braddom R.L. (Ed). Physical medicine and rehabilitation (1996), W. B. Saunders, Philadelphia 66-82
106. Turk D.C., and Rudy T.E. Spine update: Methods for evaluating treatment outcomes: Ways to overcome potential obstacles. Spine 19 (1994) 1759-1763
107. UK Department of Health. Saving lives: Our healthier nation (1999), HMSO, London
108. Upshur R.E., VanDenKerkhof E.G., and Goel V. Meaning and measurement: An inclusive model of evidence in health care. Journal of the Evaluation of Clinical Practice 7 (2001) 91-96
109. Wampold B.E. Methodological problems in identifying efficacious psychotherapies. Psychotherapy Research 7 (1997) 21-43
110. Wampold B.E. The great psychotherapy debate: Models, methods, and findings (2001), Erlbaum, Mahwah, NJ
111. Weiner H. Psychological factors in bodily disease. In: Millon T., Green C., and Meagher R. (Eds). Handbook of clinical health psychology (1982), Plenum, New York 31-52
112. Whyte J. Traumatic brain injury rehabilitation: Are there alternatives to randomized clinical trials?. Archives of Physical Medicine and Rehabilitation 83 (2002) 1320-1322
113. Whyte J. Promoting research in cognitive neuroscience and cognitive rehabilitation. Health Policy Newsletter 18 3 (2005) 4
114. Widiger T.A., and Trull T.J. Diagnosis and clinical assessment. Annual Review of Psychology 42 (1991) 109-134
115. Williams W.H., Evans J.J., and Wilson B.A. Outcome measures for survivors of acquired brain injury in day and outpatient rehabilitation programmes. Neuropsychological Rehabilitation 9 (1999) 421-436
116. Wilson B.A. Case studies in neuropsychological rehabilitation (1999), Oxford University Press, New York
117. Wilson E.B. An introduction to scientific research (1952), McGraw-Hill, Boston
118. Ylvisaker M., Hanks R., and Johnson-Greene D. Perspectives on rehabilitation of individuals with cognitive impairment after brain injury: Rationale for reconsideration of theoretical paradigms. Journal of Head Trauma Rehabilitation 17 (2002) 191-209