The human-computer interface in computer-based concussion assessment

Journal of Clinical Sport Psychology

Volumn 6, Issue 4, 2012, Pages 385-408

  Woodard, John L ^a   Rahman, Annalise A M ^a  

^a WAYNE STATE UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Assessment; Computer; Concussion; Neuropsychology; Sport

Indexed keywords

EID: 84872147021     PISSN: 19329261     EISSN: 1932927X     Source Type: Journal    
DOI: 10.1123/jcsp.6.4.385     Document Type: Article

References (75)

1. Aşkar, P., Altun, A., Cangöz, B., Cevik, V., Kaya, G., & Türksoy, H. (2012). A comparison of paper-and-pencil and computerized forms of Line Orientation and Enhanced Cued Recall Tests. Psychological Reports, 110, 383-396.PubMed doi:10.2466/03.22. PR0.110.2.383-396
2. Barlow, H.B. (1958). Temporal and spatial summation in human vision at different back-ground intensities. The Journal of Physiology, 141, 337-350.PubMed
3. Bergeron, B.P. (1996). Voice recognition: An enabling technology for modern health care? Proceedings of the American Medical Informatics Association, AMIA Fall Symposium, 802-806.
4. Bleiberg, J., Garmoe, W.S., Halpern, E.L., Reeves, D.L., & Nadler, J.D. (1997). Consistency of within-day and across-day performance after mild brain injury. Neuropsychiatry, Neuropsychology, and Behavioral Neurology, 10, 247-253.PubMed
5. Botella, C., Baños, R.M., Guerrero, B., García-Palacios, A., Quero, S., & Alcañíz, M. (2006). Using a fexible virtual environment for treating a storm phobia. PsychNology Journal, 4, 129-144.
6. Bracken, C.C., Pettey, G., Guha, T., & Rubenking, B.E. (2010). Sounding out small screens and telepresence: The impact of audio, screen size and pace. Journal of Media Psychology, 22, 125-137.
7. Broglio, S.P., Ferrara, M.S., Macciocchi, S.N., & Baumgartner, T.A. (2007). Test-retest reliability of computerized concussion assessment programs. Journal of Athletic Training, 42, 509-514.PubMed
8. Campbell, Z., Zakzanis, K.K., Jovanovski, D., Joordens, S., Mraz, R., & Graham, S.J. (2009). Utilizing virtual reality to improve the ecological validity of clinical neuropsychology: An FMRI case study elucidating the neural basis of planning by comparing the Tower of London with a three-dimensional navigation task. Applied Neuropsychology, 16, 295-306.PubMed doi:10.1080/09084280903297891
9. Carstairs, J., & Myors, B. (2009). Internet testing: A natural experiment reveals test score infation on a high-stakes, unproctored cognitive test. Computers in Human Behavior, 25, 738-742.doi:10.1016/j.chb.2009.01.011
10. Castelnuovo, G., Lo Priore, C., Liccione, D., & Cioff, G. (2003). Virtual reality based tools for the rehabilitation of cognitive and executive functions: The V-STORE. PsychNoogy Journal, 1, 310-325.
11. Cedrus (2012a). RB series response pads. http://www.cedrus.com/responsepads/features.htm.
12. Cedrus (2012b). SuperLab 4.5 manual. San Pedro, CA: Cedrus. http://www.superlab.com/manual/superlab-manual.pdf
13. Centers for Disease Control and Prevention. (2012). FAQs about baseline testing among young athletes. Retrieved from http://www.cdc.gov/concussion/pdf/baseline_testing_FAQs-a.pdf
14. Cernich, A.N., Brennana, D.M., Barker, L.M., & Bleiberg, J. (2007). Sources of error in computerized neuropsychological assessment. Archives of Clinical Neuropsychology, 22(Suppl. 1), S39-S48.PubMeddoi:10.1016/j.acn.2006.10.004
15. Chambers, C.D., & Brown, M. (2003). Timing accuracy under Microsoft Windows revealed through external chronometry. Behavior Research Methods, Instruments, & Computers, 35, 96-108.PubMed doi:10.3758/BF03195501
16. Cherniack, E.P. (2011). Not just fun and games: An application of virtual reality in the identifcation and rehabilitation of cognitive disorders of the elderly. Disability and Rehabilitation. Assistive Technology, 6, 283-289.PubMed doi:10.3109/17483107.20 10.542570
17. CogState (1999). Cogsport [computer software], Parkville, Victoria, Australia: CogState, Ltd.
18. Diedrichsen, J., Wiestler, T., & Krakauer, J.W. (2012). Two distinct ipsilateral cortical representations for individuated fnger movements. Cerebral Cortex. Advance Access.
19. Doniger, G.M., & Simon, E.S. (2009). Computerized cognitive testing in aging. Alzheimer's Dementia, 5, 439-440.
20. Dux, M.C., Woodard, J.L., Morton, C.H., & Pica, A.A. (2005). Indexes of testing variability as measures of effortful performance in computer-based testing. The Clinical Neuropsychologist, 19, 149.
21. Dwolatzky, T., Whitehead, V., Doniger, G.M., Simon, E.S., Schweiger, A., Jaffe, D., et al. (2003). Validity of a novel computerized cognitive battery for mild cognitive impairment. BMC Geriatrics, 3, 4.
22. Elbert, T., Pantev, C., Wienbruch, C., Rockstroh, B., & Taub, E. (1995). Increased cortical representation of the fngers of the left hand in string players. Science, 270, 305-307.PubMed doi:10.1126/science.270.5234.305
23. Erdal, K. (2012). Neuropsychological testing for sports-related concussion: How athletes can sandbag their baseline testing without detection. Archives of Clinical Neuropsychology, 27, 473-479.PubMed doi:10.1093/arclin/acs050
24. Erlanger, D.M., Feldman, D.J., & Kutner, K. (1999). Concussion Resolution Index. New York: HeadMinder, Inc.
25. Feldstein, S.N., Keller, F.R., Portman, R.E., Durham, R.L., Klebe, K.J., & Davis, H.P. (1999). A comparison of computerized and standard versions of the Wisconsin Card Sorting Test. The Clinical Neuropsychologist, 13, 303-313. PubMed doi:10.1076/ clin.13.3.303.1744
26. Felipe, A., Buades, M.J., & Artigas, J.M. (1993). Infuence of the contrast sensitivity function on the reaction time. Vision Research, 33(17), 2461-2466.PubMed doi:10.1016/0042-6989(93)90126-H
27. Gofen, A., & Mackeben, M. (1997). An introduction to accurate display timing for PCs under 'Windows.'. Spatial Vision, 10(4), 361-368.PubMed doi:10.1163/156856897X00285
28. Gualtieri, C.T., & Johnson, L.G. (2006). Reliability and validity of a computerized neuro-cognitive test battery, CNS Vital Signs. Archives of Clinical Neuropsychology, 21(7), 623-643.PubMed doi:10.1016/j.acn.2006.05.007
29. Hudnell, H.K., Otto, D.A., & House, D.E. (1996). The infuence of vision on computerized neurobehavioral test scores: A proposal for improving test protocols. [Clinical Trial]. Neurotoxicology and Teratology, 18(4), 391-400.PubMed doi:10.1016/0892- 0362(96)00040-2
30. Johnson, D.R., Gilliland, K., & Vincent, A. (2009). Automated Neuropsychological Assessment Metrics (ANAM)'s measure of invalid scores: A simulator study. Archives of Clinical Neuropsychology, 24, 513-514.
31. Johnson, E.W., Kegel, N.E., & Collins, M.W. (2011). Neuropsychological assessment of sport-related concussion. Clinics in Sports Medicine, 30(1), 73-88 viii-ix. PubMed doi:10.1016/j.csm.2010.08.007
32. Jones-Gotman, M., & Milner, B. (1977). Design fuency: The invention of nonsense drawings after focal cortical lesions. Neuropsychologia, 15, 653-674. PubMed doi:10.1016/0028- 3932(77)90070-7
33. Kallinen, K., & Ravaja, N. (2007). Comparing speakers versus headphones in listening to news from a computer - individual differences and psychophysiological responses. Computers in Human Behavior, 23, 303-317.doi:10.1016/j.chb.2004.10.014
34. Květon, P., Jelínek, M., Vobořil, D., & Klimusová, H. (2007). Computer-based tests: The impact of test design and problem of equivalency. Computers in Human Behavior, 23, 32-51.doi:10.1016/j.chb.2004.03.034
35. Lange, T., Indelicato, D.J., & Rosen, J.M. (2000). Virtual reality in surgical training. Surgical Oncology Clinics of North America, 9(1), 61-79 vii.PubMed
36. Letz, R. (2003). Continuing challenges for computer-based neuropsychological tests. Neurotoxicology, 24, 479-489.PubMed doi:10.1016/S0161-813X(03)00047-0
37. Lezak, M.D. (1995). Neuropsychological assessment. New York: Oxford.
38. Lovell, M.R., Collins, M.W., Podell, K., Powell, J., & Maroon, J. (2000). ImPACT: Immediate post-concussion assessment and cognitive testing. Pittsburgh, PA: NeuroHealth Systems, LLC.
39. Makhoul, J., & Schwartz, R. (1995). State of the art in continuous speech recognition. Proceedings of the National Academy of Sciences of the United States of America, 92, 9956-9963.PubMed doi:10.1073/pnas.92.22.9956
40. Mantovani, F., Castelnuovo, G., Gaggioli, A., & Riva, G. (2003). Virtual reality training for health-care professionals. Cyberpsychology & Behavior: The Impact of the Internet. Multimedia and Virtual Reality on Behavior and Society, 6, 389-395.
41. McCormack, P.D. (1972). Recognition memory: How complex a retrieval system? Canadian Journal of Psychology, 26, 19-41.doi:10.1037/h0082413
42. McCrea, M., Kelley, J.P., Kluge, J., Ackley, B., & Randolph, C. (1997). Standardized assessment of concussion in football players. Neurology, 48, 586-588.PubMed doi:10.1212/ WNL.48.3.586
43. McDonald, A.S. (2002). The impact of individual differences on the equivalence of computer-based and paper-and-pencil educational assessments. Computers & Education, 39, 299-312.doi:10.1016/S0360-1315(02)00032-5
44. Microsoft. (2012a). Microsoft Windows Millennium Edition. http://support.microsoft.com/ph/6519.
45. Microsoft. (2012b). Microsoft ends support of Windows XP, Offce 2003 in 2014! http://www.microsoft.com/en-us/windows/endofsupport.aspx
46. Moon, G.W., Blakey, W.A., Gorsuch, R.L., & Fantuzzo, J.W. (1991). Frequent WAIS-R administration errors: An ignored source of inaccurate measurement. Professional Psychology, Research and Practice, 3, 256-258. doi:10.1037/0735-7028.22.3.256
47. Noyes, J.M., & Garland, K.J. (2008). Computer-vs. paper-based tasks: Are they equivalent? Ergonomics, 51, 1352-1375. PubMed doi:10.1080/00140130802170387
48. Pearson Education. (2009, November). Computer-based & paper-pencil test comparability studies (Test, Measurement & Research Services Bulletin, 9). http://www.pearson-assessments.com/NR/rdonlyres/93727FC9-96D3-4EA5-B807- 5153EF17C431/0/Bulletin_9.pdf
49. Plant, R. R., Hammond, N., & Whitehouse, T. (2003). How choice of mouse may affect response timing in psychological studies. Behavior Research Methods, Instruments, & Computers: A Journal of the Psychonomic Society, 35(2), 276-284.
50. Pommerich, M. (2004). Developing computerized versions of paper-and-pencil tests: Mode effects for passage-based tests. Journal of Technology, Learning, and Assessment, 2. Available from http://www.jtla.org
51. Psychology Software Tools. (2011). E-Prime timing. Retrieved March 21, 2011, from http://www.pstnet.com/eprimetiming.cfm
52. Reeves, D.L., Winter, K.P., Bleiberg, J., & Kane, R.L. (2007). ANAM Genogram: Historical perspectives, description and current endeavors. Archives of Clinical Neuropsychology, 22(Suppl. 1), S15-S37.PubMed doi:10.1016/j.acn.2006.10.013
53. Riggs, L.A. (1971). Vision. In J.W. Kling & L.A. Riggs (Eds.), Woodworth & Schlosberg's experimental psychology (3rd ed., pp. 273-314). New York: Holt, Rinehart, & Winston.
54. Riva, G. (1998). Virtual reality as assessment tool in psychology. In G. Riva (Ed.), Virtual reality in neuro-psycho-physiology (pp. 1-10). Amsterdam: IOS Press.
55. Schatz, P. (2010). Test-retest reliability of baseline cognitive assessments using ImPACT. American Journal of Sports Medicine, 38, 47-53.PubMed doi:10.1177/0363546509343805
56. Schatz, P., & Browndyke, J. (2002). Applications of computer-based neuropsychological assessment. The Journal of Head Trauma Rehabilitation, 17, 395-410.PubMed doi:10.1097/00001199-200210000-00003
57. Schatz, P., & Zillmer, E.A. (2003). Computer-based assessment of sports-related concussion. Applied Neuropsychology, 10(1), 42-47.PubMed doi:10.1207/S15324826AN1001_6
58. Schlegel, R.E., & Gilliland, K. (2007). Development and quality assurance of computer-based assessment batteries. Archives of Clinical Neuropsychology, 22S, S49-S61. PubMed doi:10.1016/j.acn.2006.10.005
59. Schneider, W., Eschman, A., & Zuccolotto, A. (2002). E-Prime user's guide. Pittsburgh: Psychology Software Tools, Inc.
60. Schultheis, M.T., Himelstein, J., & Rizzo, A.A. (2002). Virtual reality and neuropsychology: Upgrading the current tools. The Journal of Head Trauma Rehabilitation, 17, 378-394.PubMed doi:10.1097/00001199-200210000-00002
61. Shieh, K.K., & Chen, M.H. (2005). Effects of display medium and luminance contrast on concept formation and EEG response. Perceptual and Motor Skills, 100(3, Pt 2), 943-954.PubMed
62. Tombaugh, T.N., & Rees, L. (2000). Manual for the Computerized Tests of Information Processing (CTIP). Ottawa, Ontario: Carleton University.
63. Vincent, A., Roebuck-Spencer, T., Cooper, D., Bowles, A., & Gilliland, K. (2010). Clinical validation of the Automated Neuropsychological Assessment Metrics embedded effort measure. Archives of Clinical Neuropsychology, 25, 582.
64. Warden, D.L., Bleiberg, J., Cameron, K.L., Ecklund, L.T.C.J., Walter, J., Sparling M.B., et al. (2001). Persistent prolongation of simple reaction time in sports concussion. Neurology, 57, 524-526.PubMed doi:10.1212/WNL.57.3.524
65. Wang, S.S., & Starren, J. (1999). A Java speech implementation of the Mini Mental Status Exam. Proceedings of the American Medical Informatics Association, AMIA Fall Symposium, 435-439.
66. Wechsler, D. (2009). Wechsler Memory Scale-IV administration and scoring manual. San Antonio, TX: Pearson.
67. Weniger, G., Ruhleder, M., Lange, C., Wolf, S., & Irle, E. (2011). Egocentric and allocentric memory as assessed by virtual reality in individuals with amnestic mild cognitive impairment. Neuropsychologia, 49, 518-527.PubMed doi:10.1016/j.neuropsychologia.2010.12.031
68. Wild, K., Howieson, D., Webbe, F., Seelye, A., & Kaye, J. (2008). Status of computerized cognitive testing in aging: A systematic review. Alzheimer's Dementia, 4, 428-437.
69. Willison, J., & Tombaugh, T.N. (2006). Detecting simulation of attention defcits using reaction time tests. Archives of Clinical Neuropsychology, 21, 41-52.PubMed doi:10.1016/j. acn.2005.07.005
70. Woodard, J.L., Axelrod, B.N., & Henry, R.R. (1992). Interrater reliability of scoring parameters for the Design Fluency Test. Neuropsychology, 6, 173-178.doi:10.1037/0894- 4105.6.2.173
71. Zheltukhin, A.Y., & Woodard, J.L. (2004). Non-dominant hand performance on the clock-drawing test. Journal of the International Neuropsychological Society, 10, 218.
72. Zheltukhin, A.Y., Woodard, J.L., & Shannon, K. (2002a). Making the Digit Symbol Substitution Test memory oriented. Journal of the International Neuropsychological Society, 8, 151.
73. Zheltukhin, A.Y., Woodard, J.L., & Shannon, K. (2002b). Processing differences on the computerized Digit-Symbol and Symbol-Digit Coding. Journal of the International Neuropsychological Society, 8, 151-152.
74. Zheltukhin, A.Y., Woodard, J.L., Shannon, K., & Hertzog, C. (2000). Validation of a novel computer-based implementation of the Trail Making Test. Journal of the International Neuropsychological Society, 6, 145.
75. Zheltukhin, A.Y., Woodard, J.L., Shannon, K., & Hertzog, C. (2001). New approach to the analysis of performance on the Digit Symbol Substitution Test. Journal of the International Neuropsychological Society, 7, 254.