Measurement error in the immediate postconcussion assessment and cognitive testing (ImPACT): Systematic review

Journal of Head Trauma Rehabilitation

Volumn 31, Issue 4, 2016, Pages 242-251

  Alsalaheen, Bara ^a   Stockdale, Kayla ^a   Pechumer, Dana ^a   Broglio, Steven P ^b  

^a UNIVERSITY OF MICHIGAN FLINT   (United States)

^b UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Mild closed head injury; Mild traumatic brain injury; Minor head injury; Postconcussion syndrome; Reliability; Reliable change; Sport

Indexed keywords

COGNITIVE FUNCTION TEST; CORRELATION COEFFICIENT; HUMAN; IMMEDIATE POSTCONCUSSION ASSESSMENT AND COGNITIVE TESTING; MEASUREMENT ERROR; METHODOLOGY; NEUROLOGIC EXAMINATION; QUALITY CONTROL; REACTION TIME; RELIABILITY; REVIEW; SYSTEMATIC REVIEW; VERBAL MEMORY; VISUAL MEMORY; BRAIN CONCUSSION; COGNITION; NEUROPSYCHOLOGICAL TEST; REPRODUCIBILITY; SPORT INJURY;

ATHLETIC INJURIES; BRAIN CONCUSSION; COGNITION; HUMANS; NEUROPSYCHOLOGICAL TESTS; REPRODUCIBILITY OF RESULTS;

EID: 84944342410     PISSN: 08859701     EISSN: 1550509X     Source Type: Journal    
DOI: 10.1097/HTR.0000000000000175     Document Type: Review

References (38)

1. Broglio SP, Cantu RC, Gioia GA, et al. National Athletic Trainers' Association position statement: management of sport concussion. J Athl Training. 2014;49:245-265.
2. McCrory P, Meeuwisse WH, Aubry M, et al. Consensus statement on concussion in sport: the 4th International Conference on Concussion in Sport held in Zurich, November 2012. Br J Sports Med. 2013;47:250-258.
3. Meehan WP IIIrd, d'Hemecourt P, Collins CL, Taylor AM, Com-stock RD. Computerized neurocognitive testing for the management of sport-related concussions. Pediatrics. 2012;129:38-44.
4. Covassin T, Elbin R IIIrd, Stiller-Ostrowski JL. Current sport-related concussion teaching and clinical practices of sports medicine professionals. J Athl Training. 2009;44:400-404.
5. Cole WR, Arrieux JP, Schwab K, Ivins BJ, Qashu FM, Lewis SC. Test-retest reliability of four computerized neurocognitive assessment tools in an active duty military population. Arch Clin Neu-ropsychol. 2013;28:732-742.
6. Maroon JC, Lovell MR, Norwig J, Podell K, Powell JW, Hartl R. Cerebral concussion in athletes: evaluation and neuropsychologi-cal testing. Neurosurgery. 2000;47:659-669.
7. Schatz P, Pardini JE, Lovell MR, Collins MW, Podell K. Sensitivity and specificity of the ImPACT Test Battery for concussion in athletes. Arch Clin Neuropsychol. 2006;21:91-99.
8. Lovell MR, Collins MW, Iverson GL, Johnston KM, Bradley JP. Grade 1 or "ding" concussions in high school athletes. Am J Sports Med. 2004;32:47-54.
9. Iverson GL, Lovell MR, Collins MW. Validity of ImPACT for measuring processing speed following sports-related concussion. J Clin Exp Neuropsychol. 2005;27:683-689.
10. Baumgartner T, Jackson A, Mahar M, Rowe M. Measurement for Evaluation in Physical Education and Exercise Science. 4th ed. Dubuque, IA: McGraw-Hill; 1999.
11. Maassen GH. The standard error in the Jacobson and Truax Reliable Change Index: the classical approach to the assessment of reliable change. J Int Neuropsychol Soc. 2004;10:888-893.
12. Hinton-Bayre AD, Geffen GM, Geffen LB, McFarland KA, Friis P. Concussion in contact sports: reliable change indices of impairment and recovery. J Clin Exp Neuropsychol. 1999;21:70-86.
13. Jacobson NS, Follette WC, Revenstorf D. Psychotherapy outcome research-methods for reporting variability and evaluating clinical-significance. Behav Ther. 1984;15:336-352.
14. Temkin NR. Standard error in the Jacobson and Truax Reliable Change Index: the "classical approach" leads to poor estimates. J Int Neuropsychol Soc. 2004;10:899-901; discussion 902-893.
15. Hsu LM. A comparison of three methods of identifying reliable and clinically significant client changes: commentary on Hageman and Arrindell. Behav Res Ther. 1999;37:1195-1202.
16. Jacobson NS, Truax P. Clinical-significance-a statistical approach to defining meaningful change in psychotherapy-research. J Consult Clin Psych. 1991;59:12-19.
17. von Elm E, Altman DG, Egger M, et al. The strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. Ann Intern Med. 2007;147:573-577.
18. Broglio SP, Ferrara MS, Macciocchi SN, Baumgartner TA, Elliott R. Test-retest reliability of computerized concussion assessment programs. J Athl Training. 2007;42:509-514.
19. Bruce J, Echemendia R, Meeuwisse W, Comper P, Sisco A. 1 year test-retest reliability of ImPACT in professional ice hockey players. Clin Neuropsychol. 2014;28:14-25.
20. Elbin RJ, Schatz P, Covassin T. 1 year test-retest reliability of the online version of ImPACT in high school athletes. Am J Sports Med. 2011;39:2319-2324.
21. Iverson GL, Lovell MR, Collins MW. Interpreting change on ImPACT following sport concussion. Clin Neuropsychol. 2003;17:460-467.
22. Register-Mihalik JK, Kontos DL, Guskiewicz KM, Mihalik JP, Conder R, Shields EW. Age-related differences and reliability on computerized and paper-and-pencil neurocognitive assessment batteries. J Athl Training. 2012;47:297-305.
23. Resch J, Driscoll A, McCaffrey N, et al. ImPACT test-retest reliability: reliably unreliable? J Athl Training. 2013;48:506-511.
24. Schatz P. Long-term test-retest reliability of baseline cognitive assessments using ImPACT. Am J Sports Med. 2010;38:47-53.
25. Schatz P, Ferris CS. One-month test-retest reliability of the ImPACT test battery. Arch Clin Neuropsychol. 2013;28:499-504.
26. Nakayama Y, Covassin T, Schatz P, NogleS, Kovan J. Examination of the test-retest reliability of a computerized neurocognitive test battery. Am J Sports Med. 2014;42:2000-2005.
27. Moritz S, Iverson GL, Woodward TS. Reliable change indexes for memory performance in schizophrenia as a means to determine drug-induced cognitive decline. Appl Neuropsychol. 2003;10:115-120.
28. Chelune GJ, Naugle RI, Lüders H, Sedlak J, Awad IA. Individual change after epilepsy surgery: practice effects and base-rate information. Neuropsychology. 1993;7:41-52.
29. Portney L, Watkins M. Foundations of Clinical Research: Applications to Practice. 3rd ed. Upper Saddle River, NJ: Prentice-Hall, Inc; 2009.
30. Hopkins WG. Measures of reliability in sports medicine and science. Sports Med. 2000;30:1-15.
31. Gardner MJ, Altman DG. Confidence intervals rather than P values: estimation rather than hypothesis testing. Br Med J (Clin Res Ed). 1986;292:746-750.
32. Donner A, Eliasziw M. A goodness-of-fit approach to inference procedures for the kappa statistic: confidence interval construction, significance-testing and sample size estimation. Stat Med. 1992;11:1511-1519.
33. Kottner J, Audige L, Brorson S, et al. Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. J Clin Epidemiol. 2011;64:96-106.
34. Bey T, Ostick B. Second impact syndrome. West J Emerg Med. 2009;10:6-10.
35. Maassen GH. Reliable change assessment in sport concussion research: a comment on the proposal and reviews of Collie et al. Br J Sports Med. 2005;39:483-487.
36. Maerlender A, Flashman L, Kessler A, et al. Discriminant construct validity of ImPACT: a companion study. Clin Neuropsychol. 2013;27:290-299.
37. Schatz P, Maerlender A. A two-factor theory for concussion assessment using ImPACT: memory and speed. Arch Clin Neuropsychol. 2013;28:791-797.
38. Resch JE, Macciocchi S, Ferrara MS. Preliminary evidence of equivalence of alternate forms of the ImPACT. Clin Neuropsychol. 2013;27:1265-1280.