Requirements analysis for customization using subgroup differences and large sample user testing: A case study of information retrieval on handheld devices in healthcare

International Journal of Industrial Ergonomics

Volumn 41, Issue 3, 2011, Pages 208-218

  Lottridge, Danielle ^a   Chignell, Mark ^b   Straus, Sharon E ^c  

^a STANFORD UNIVERSITY   (United States)

^b UNIVERSITY OF TORONTO   (Canada)

^c UNIVERSITY OF TORONTO   (Canada)

Author keywords

Customization; Individual differences; Requirements analysis; Sample size; User test; User testing

Indexed keywords

CUSTOMIZATION; INDIVIDUAL DIFFERENCES; REQUIREMENTS ANALYSIS; SAMPLE SIZES; USER TEST; USER TESTING;

ACCIDENT PREVENTION; APPROXIMATION THEORY; HAND HELD COMPUTERS; HEALTH CARE; INFORMATION RETRIEVAL; MEDICAL COMPUTING; REQUIREMENTS ENGINEERING; SYSTEMS ANALYSIS;

BEHAVIORAL RESEARCH;

ADULT; ARTICLE; CASE STUDY; COMPUTER INTERFACE; ERGONOMICS; HEALTH CARE; HUMAN; INFORMATION RETRIEVAL; METHODOLOGY; MICROCOMPUTER; NEEDS ASSESSMENT; PHYSICIAN ATTITUDE; PRIORITY JOURNAL; PROCESS DESIGN; SAMPLE SIZE; STATISTICAL ANALYSIS;

EID: 79953296406     PISSN: 01698141     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ergon.2011.01.005     Document Type: Article

References (55)

1. Abrams, D., Baecker, R., Chignell, M., 1998. Information archiving with bookmarks: personal web space construction and organization. Proceedings of ACM CHI'98 Human Factors in Computing Systems, pp. 41-48.
2. Ahmed S.M.Z. A comparison of usability techniques for evaluating information retrieval system interfaces. Performance Measurement and Metrics 2008, 9(1):48-58.
3. Buhler C. Approach to the analysis of user requirements in assistive technology. International Journal of Industrial Ergonomics 1996, 17:187-192.
4. Chen, K., Zhang, W., Zhao, H., Mei, H., 2005. An approach to constructing feature models based on requirements clustering. Proceedings of the 13th IEEE International Conference on Requirements Engineering (RE'05).
5. Clinical Evidence (CE) [monograph on CD-ROM], 2001. BMJ Publishing Group Ltd., London, Issue 6.
6. Cooper A. The Inmates Are Running the Asylum 1999, SAMS, Macmillan.
7. Cooper A., Reimann R. About Face 2.0: The Essentials of Interaction Design 2003, John Wiley & Sons, New York, NY. second ed.
8. Coplien J., Hoffman D., Weiss D. Commonality and variability in software engineering. IEEE Software 1998, 15(6):37-45.
9. Criswell D.F., Parchman M.L. Handheld computer use in U.S. family practice residency programs. Journal of the American Medical Informatics Association 2002, 9:80-86.
10. Delice E., Güngör Z. The usability analysis with heuristic evaluation and analytic hierarchy process. International Journal of Industrial Ergonomics 2009, 39(6):934-939.
11. Denning, S., Hoiem, D., Simpson, M., Sullivan, K., 1990. The value of thinking-aloud protocols in industry: a case study at Microsoft Corporation. Proceedings of the Human Factors Society 34th Annual Meeting, pp. 1285-1289.
12. Dillon A., Watson C. User analysis in HCI: the historical lessons from individual differences research. International Journal of Human-Computer Studies 1996, 45(6):619-637.
13. Dikel D., Kane D., Ornburn S., Loftus W., Wilson J. Applying software product-line architecture. Computer 1997, 30(8):49-55.
14. Duda R.O., Hart P.E., Stork D.G. Pattern Classification 2000, Wiley, NY. second ed.
15. Egan D.E. Individual differences in human-computer interaction. Handbook of Human-Computer Interaction 1988, 543-568. North Holland, New York. M. Helander (Ed.).
16. Ericsson K., Simon H.A. Protocol Analysis: Verbal Reports as Data 1984, MIT Press, Cambridge.
17. Garmer K., Liljegren E., Osvalder A.L., Dahlman S. Application of usability testing to the development of medical equipment. Usability testing of a frequently used infusion pump and a new user interface for an infusion pump developed with a human factors approach. International Journal of Industrial Ergonomics 2002, 29:145-159.
18. Garmer K., Ylven J., Karlsson I.C.M.A. User participation in requirements elicitation comparing focus group interviews and usability tests for eliciting usability requirements for medical equipment: a case study. International Journal of Industrial Ergonomics 2004, 33:85-98.
19. Gregoriades, A., Shin, J.-E., Sutcliffe, A., 2004. Human-centred requirements engineering. Proceedings of the12th IEEE International Requirements Engineering Conference (RE'04), pp. 154-163.
20. Gwizdka J., Chignell M. Chapter 12: individual differences. Personal Information Management 2007, 206-220. University Washington Press, Seattle. W. Jones, J. Teevan (Eds.).
21. Hartigan J.A. Clustering Algorithms 1975, John Wiley & Sons, Inc, New York.
22. Holzman T.G., Griffith A., Hunter W.G., Allen T., Simpson R.J. Computer-assisted trauma care prototype. Medinfo 1995, 8(Pt 2):1685.
23. Hui, B., Liaskos, S., Mylopoulos, J., 2003. Requirements analysis for customizable software: a goal-skills-preferences framework. Proceedings of the 11th IEEE International Conference on Requirements Engineering, pp. 117-126.
24. Hutchinson, H., Mackay, W., Westerlund, B., Bederson, B.B., Druin, A., Plaisant, C., Beaudouin-Lafon, M., Conversy, S., Evans, H., Hansen, H., Roussel, N., Eiderbäck, B., Lindquist, S., Sundblad, Y., 2003. Technology probes: inspiring design for and with families. Proceedings of ACM CHI '03 Human Factors in Computing Systems, pp. 17-24.
25. Jeffries, R., Millwe, J., Wharton, C., Uyeda, K., 1991. User interface evaluation in the real world: a comparison of four techniques. Proceedings of ACM CHI 91 Human Factors in Computing Systems, pp. 119-124.
26. Jokela T., Koivumaa J., Pirkola J., Salminen P., Kantola N. Methods for quantitative usability requirements: a case study on the development of the user interface of a mobile phone. Personal and Ubiquitous Computing 2006, 10:345-355.
27. Jones W., Dumais S., Bruce H. Once found, what then? A study of keeping behaviours in the personal use of web information. Proceedings of the American Society for Information Science and Technology 2002, 39:391-402.
28. Krishnan A., Jones S. TimeSpace: activity-based temporal visualisation of personal information spaces. Personal and Ubiquitous Computing 2005, 9(1):46-65.
29. Kushniruk A.W., Triola M., Stein B., Borycki E., Kannry J. The relationship of usability to medical error: an evaluation of errors associated with usability problems in the use of a handheld application for prescribing medications. Medinfo 2004, 11(Pt 2):1073-1076.
30. Landauer T.K. Chapter 9: behavioral research methods in human-computer interaction. Handbook of Human-Computer Interaction 1997, 203-227. Elsevier Science BV, Amsterdam. second ed. M.G. Helander, T.K. Landauer, P.V. Prabhu (Eds.).
31. Liljegren E. Usability in a medical technology context assessment of methods for usability evaluation of medical equipment. International Journal of Industrial Ergonomics 2006, 36:345-352.
32. Lottridge, D., Chignell, M., Straus, S.E., 2004. Physicians responses to handheld presentation of clinical evidence: analysis of group differences. Proceedings of the Human Factors Society 48th Annual Meeting, pp. 1783-1787.
33. Lottridge D., Chignell M., Danicic-Mizdrak R., Pavlovic N.J., Kushniruk A., Straus S.E. Group differences in physicians responses to handheld presentation of clinical evidence: a verbal protocol analysis. BioMed Central Medical Informatics and Decision Making 2007, 7:22.
34. Lu Y.C., Xiao Y., Sears A., Jacko J.A. A review and a framework of handheld computer adoption in healthcare. International Journal of Medical Informatics 2005, 74:409-422.
35. Mackay, W.E., 1988. More than just a communication system: diversity in the use of electronic mail. Proceedings of ACM CHI'88 Human Factors in Computing Systems, pp. 344-353.
36. Mackay, W.E., 1991. Triggers and barriers to customizing software. Proceedings of ACM CHI '91 Human Factors in Computing Systems, pp. 153-160.
37. Malone T.W. How do people organize their desk: implications for the design of office information system. ACM Transactions on Office Information Systems 1983, 1(1):99-112.
38. Murphy K.R., Myors B. Statistical Power Analysis: A Simple and General Model for Traditional and Modern Hypothesis Tests 2004, Lawrence Erlbaum Associates, New Jersey.
39. National Physician Survey. College of Family Physicians of Canada (CFPC), 2005. Available from: http://www.cfpc.ca/nps/English/Physician_Stats.asp.
40. Nielsen, J., Landauer, T.K., 1993. A mathematical model of the finding of usability problems. Proceedings of ACM INTERCHI'93 Conference, pp. 206-213.
41. Park K.S., Lim C.H. A structured methodology for comparative evaluation of user interface designs using usability criteria and measures. International Journal of Industrial Ergonomics 1999, 23:379-389.
42. Rhenius, D., Deffner, G., 1990. Evaluation of concurrent thinking aloud using eye-tracking data. Proceedings of the Human Factors Society 34th Annual Meeting, pp. 1265-1269.
43. Sackett D.L., Straus S.E. Finding and applying evidence during clinical rounds: the evidence cart. Journal of the American Medical Association 1998, 280:1336-1338.
44. Sackett D.L., Straus S.E. Bringing evidence to the point of care. Journal of the American Medical Association 1999, 281:1171-1172.
45. Sanderson P.M., James J.M., Seidler K.S. SHAPA: an interactive software environment for protocol analysis. Ergonomics 1989, 32:1271-1302.
46. Sauro J. Premium usability: getting the discount without paying the price. Interactions 2004, 30-37.
47. Straus S.E., Evans M., Davis D.A., Goel V. Bringing evidence to the point of care: needs of clinicians. Journal of General Internal Medicine 2002, 17:213.
48. Straus, S.E., Evans, M., Goel, V., Davis, D., 2001a. Bringing evidence to the point of care: what do clinicians want. (Abstract) Biomed Central Meeting Abstracts: 4th International Cochrane Colloquium:1, pp. op047.
49. Straus S.E., Hsu S.I., Ball C.M., Phillips R.S. Evidence-Based On-Call: Acute Medicine 2001, Churchill Livingstone, Edinburgh.
50. Takeshita, H., Davis, D., Straus, S.E., 2002. Clinical Evidence at the Point of Care in Acute Medicine: A Handheld Usability Case Study. Proceedings of the Human Factors Society 46th Annual Meeting, pp. 1409-1413.
51. Tan W.-S., Liu D., Bishu R. Web evaluation: heuristic evaluation vs. user testing. International Journal of Industrial Ergonomics 2009, 39(4):621-627.
52. Virzi R.A. Refining the test phase of usability evaluation: how many subjects is enough?. Human Factors 1992, 34(4):457-468.
53. Wildman D. Getting the most from paired-user testing. Interactions 1995, 2(3):21-27.
54. Wu R.C., Orr M.S., Chignell M., Straus S.E. Usability of a mobile electronic medical record prototype: a verbal protocol analysis. Informatics for Health and Social Care 2008 Jun, 33(2):139-149.
55. Zave P. Classification of research efforts in requirements engineering. ACM Computing Surveys 1997, 29(4):315-321.