Usability testing of two e-learning resources: Methods to maximize potential for clinician use

Journal of Rehabilitation Medicine

Volumn 44, Issue 4, 2012, Pages 338-345

  Menon, Anita ^a,b   Korner Bitensky, Nicol ^b,c   Chignell, Mark ^a   Straus, Sharon ^a  

^a UNIVERSITY OF TORONTO   (Canada)

^b MCGILL UNIVERSITY   (Canada)

^c CENTRE FOR INTERDISCIPLINARY RESEARCH IN REHABILITATION OF GREATER MONTREAL   (Canada)

Author keywords

Continuing education; E learning; Evidence based practice; Methodology; Rehabilitation; Stroke

Indexed keywords

ARTICLE; CEREBROVASCULAR ACCIDENT; COMPUTER INTERFACE; EDUCATION; EVALUATION; FEMALE; HEALTH CARE PLANNING; HUMAN; INTERNET; LEARNING; MALE; MEDICAL EDUCATION; METHODOLOGY; OCCUPATIONAL THERAPY; PHYSIOTHERAPIST;

EDUCATION, MEDICAL, CONTINUING; FEMALE; HEALTH RESOURCES; HUMANS; INTERNET; LEARNING; MALE; OCCUPATIONAL THERAPY; PHYSICAL THERAPISTS; STROKE; USER-COMPUTER INTERFACE;

EID: 84859910994     PISSN: 16501977     EISSN: None     Source Type: Journal    
DOI: 10.2340/16501977-0952     Document Type: Article

References (42)

1. Davis J, Chryssafdou E, Zamora J, Davies D, Khan K, Coomara-samy A. Computer-based teaching is as good as face to face lecture-based teaching of evidence-based medicine: a randomized controlled trial. BMC Med Educ 2007; 7: 23.
2. Kulier R, Hadley J, Weinbrenner S, Meyerrose B, Decsi T, Horvath A, et al. harmonizing evidence-based medicine teaching: a study of the outcomes of e-learning in fve European countries. BMC Med Educ 2008; 8: 27.
3. Bennett S, Tooth L, McKenna K, Rodger S, Strong J, Ziviani J, Mickan S, Gibson L. Perceptions of evidence-based practice: a survey of occupational therapists. Aust Occup Ther J 2003; 53: 445-453.
4. McCluskey A. Occupational therapists report a low level of knowledge, skill and involvement in evidence-based practice. Aust Occup Ther J 2003; 50: 3-12. (Pubitemid 36526762)
5. Jette DU, Bacon K, Batty C, Carlson M, Ferland A, Hemingway RD. et al. Evidence-based practice: beliefs, attitudes, knowledge, and behaviors of physical therapists. Phys Ther 2003; 83: 786-805. (Pubitemid 37243538)
6. Smith LN, Craig LE, Weir CJ, McAlpine CH. Stroke education for healthcare professionals: making it ft for purpose. Nurse Educ Today 2008; 28: 337-347.
7. Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Internet-based learning in the health professions: a meta-analysis. JAMA 2008; 300: 1181-1196.
8. Kushniruk AW, Patel VL, Cimino JJ. Usability testing in medical informatics: cognitive approaches to evaluations of information systems and user interfaces. Proceedings from AMIA Symposium; Oct 25-29, 1997, Nashville, TN. Philadelphia, PA: hanley & Belfus Inc.; 1997, P. 218-222. (Pubitemid 127434475)
9. Kushniruk AW, Patel VL. Cognitive and usability engineering methods for the evaluation of clinical information systems. J Biomed Inform 2004; 37; 56-76. (Pubitemid 38338551)
10. Kushniruk AW, Patel VL. Cognitive computer-based video analysis. In: Greens R.A, Peterson H.E, Protti D.J editors. Proceedings of the Eighth world Conference on Medical Informatics. Edmonton, Alberta: healthcare Computing and Communications Canada; 1995, P. 1566-1569.
11. Kushniruk AW, Kaufman DR, Patel VL, Levesque Y, Lottin P. Assessment of a computerized patient record system: a cognitive approach to evaluating an emerging medical technology. MD Comput 1996; 13: 406-415. (Pubitemid 126445193)
12. Kushniruk A. Evaluation in the design of health information systems: application of approaches emerging from usability engineering. Comput Biol Med 2002; 32: 141-149. (Pubitemid 34258467)
13. Patel VL, Kushniruk AW, Yang S, Yale JF. Impact of a computer-based patient record system on data collection, knowledge organization and reasoning. J Am Med Inform Assoc 2000: 7: 569-585.
14. Sandars J, Lafferty N. Twelve Tips on usability testing to develop effective e-learning in medical education. Med Teach 2010; 32: 956-960.
15. Chisnell D, Rubin J. handbook of usability testing: how to plan, design, and conduct effective tests. 2nd ED. New york, Ny: wiley; 2008.
16. Zaharias P, Poylymenakou A. Developing a usability evaluation method for e-learning applications: beyond functional usability. Int J hum-Comput Int 2009; 25: 75-98.
17. Nielsen J. Usability engineering. New york: Academic Press; 1993.
18. Dumas JS. User-based Evaluations. In: Jacko JA, Sears A, Editors. The human-computer interaction handbook. New Jersey: lawrence Earlbaum Associates; 2003, P. 1093-1117.
19. Daniels J, Fels S, Kushniruk A, Lim J, Ansermino JM. A framework for evaluating usability of clinical monitoring technology. J Clin Monit Compu 2007, 21: 323-330. (Pubitemid 47399699)
20. Kastner M, Lottridge D, Marquez C, Newton D, Straus SE. Usability evaluation of a clinical decision support tool for osteoporosis disease management. Implement Sci 2010; 5: 96.
21. Lottridge DM, Chignell M, Danicic-Mizdrak R, Pavlovic NJ, Kushniruk A, Straus SE. Group differences in physician response to handheld presentation of clinical evidence: a verbal protocol analysis. BMC Med Inform Decis Mak 2007; 7: 22.
22. th world Stroke Congress. Stroke 2006; 37: 631.
23. Menon-Nair A, Korner-Bitensky N, Ogourtsova T. Occupational therapists' identifcation, assessment and treatment of unilateral spatial neglect during stroke rehabilitation in Canada. Stroke 2007; 38: 2556-2562. (Pubitemid 47329637)
24. Dumoulin C, Korner-Bitensky N, Tannenbaum C. The cross Canada study of stroke rehabilitation: fndings on the identifcation, assessment and management of urinary incontinence after stroke. Stroke 2007; 38: 2745-2751.
25. Korner-Bitensky N, Desrosiers J, Rochette A. A national survey of occupational therapists' practices related to participation post-stroke. J Rehab Med 2008; 40: 291-297. (Pubitemid 351596990)
26. Rochette A, Korner-Bitensky N, Desrosiers J. Actual versus best practices for families post-stroke according to three rehabilitation disciplines. J Rehab Med 2007; 39: 513-519. (Pubitemid 47455218)
27. Korner-Bitensky N, Roy MA, Teasell R, Kloda L, Storr C, Asseraf-Pasin, Menon-Nair A. Creation and pilot testing of StrokEngine: the stroke rehabilitation intervention website for clinicians and families. J Rehab Med 2008; 40: 329-333. (Pubitemid 351688279)
28. Korner-Bitensky N, Teasell R, Wood-Dauphinee S, Foley N, Jutai J, Salter K, et al. Introducing StrokEngine: the stroke rehabilitation intervention website for clinicians, patients and families. OT Now 2007; 9: 10-12.
29. Rochette A, Korner-Bitensky N, Tremblay V, Kloda L. Internet information on stroke rehabilitation for clients and families: assessment of the quality of StrokEngine-Family. Disabil Rehabil 2007; 8: 1-7.
30. Canadian Cochrane Center, Ottawa, ON: 2008. [cited 2011 June 1] Available from: http://ccnc.cochrane.org/cochrane-practice.
31. Nielsen J. Estimating the number of subjects needed for a thinking aloud test. Int J hum Comput Stud 1994; 41: 385-397.
32. Virizi RA. Refning the test phase of usability evaluation: how many subjects is enough? hum Factors 1992; 34: 457-468.
33. Lewis CH. Using the "thinking aloud" method in cognitive interface design. Technical Report IBM RC-926; 1982.
34. Jaspers MwM, Steen T, Van den Bos C, Geenen M. The think aloud method: a guide to user interface design. Int J Med Inform 2004; 73: 781-795. (Pubitemid 39446026)
35. Ericsson KA, Simon HA. Protocol analysis: verbal reports as data. Cambridge, MA: MIT Press; 1984.
36. Kiernan RJ, Mueller J, Langston JW, Van Dyke C. The Neurobe-havioral Cognitive Status Examination: a brief but differentiated approach to cognitive assessment. Ann Intern Med 1987; 107: 481-485. (Pubitemid 17149762)
37. Mayring, Philipp. Qualitative content analysis. Forum: Qualitative Social Research, 1(2), Art. 20, 2000 [cited 2011 June 1] Available from: http://nbn-resolving.de/urn:nbn:de:0114-fqs0002204.
38. Glaser BG. The constant comparative method of qualitative analysis. Sociol Rev 1964; P. 436-444.
39. Howe JA, Inness EL, Venturini A, Williams JI, Verrier MC. The Community Balance and Mobility Scale- a balance measure for individuals with traumatic brain injury. Clin Rehabil 2006; 20: 885-895. (Pubitemid 46940496)
40. Wang PL. Ennis KE. Competency assessment in clinical populations: an introduction to the Cognitive Competency Test. In: Uzzell B, Gross Y, Editors. Clinical neuropsychology of intervention. Boston, MA: Martinus Nijhoff; 1986; 199-133.
41. College of Occupational Therapists of Ontario. Ontario: 2010. [cited 2011 June 1]. Annual Report. Available from: http://www. coto.org/about/ annualReports.asp.
42. College of Physiotherapists of Ontario. Ontario: 2010. [cited 2011 June 1]. Annual Report. Available from: http://www.collegept.org/Physiotherapists/ CollegeDocuments/AnnualReports.