Component-specific usability testing

IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans

Volumn 38, Issue 5, 2008, Pages 1143-1155

  Brinkman, Willem Paul ^a,b   Haakma, Reinder ^c   Bouwhuis, Don G ^d  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b BRUNEL UNIVERSITY   (United Kingdom)

^c PHILIPS RESEARCH LABORATORIES   (Netherlands)

^d EINDHOVEN UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

Component based software engineering (CBSE); Software testing; Usability testing; User centered design methodology

Indexed keywords

COMPONENT-BASED SOFTWARE ENGINEERING (CBSE); SOFTWARE TESTING; USABILITY TESTING; USER-CENTERED DESIGN METHODOLOGY;

SOFTWARE ENGINEERING;

EID: 51449094378     PISSN: 10834427     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCA.2008.2001056     Document Type: Article

References (50)

1. B. M. Horowitz and J. H. Lambert, "Assembling off-the-shelf components: 'Lean as you go' system engineering," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 36, no. 2, pp. 286-297, Mar. 2006.
2. W. Bewley, T. L. Roberts, D. Schroit, and W. L. Verplank, "Human factors testing in the design of Xerox's 8010 Start Office workstation," in Proc. CHI, 1983, pp. 72-77.
3. S. Rosenbaum, J. A. Rohn, and J. Humburg, "A toolkit for strategic usability: Results from workshops, panels, and surveys," in Proc. CHI, 2000, pp. 337-344.
4. I. Bark, A. Følstad, and J. Gulliksen, "Use and usefulness of HCI methods: Results from an exploratory study among Nordic HCI practitioners," in Proc. HCI, 2005, pp. 201-217.
5. Y. G. Ji and M. H. Yun, "Enhancing the minority discipline in the IT industry: A survey of usability and user-centered design practice," Int. J. Hum.-Comput. Interact., vol. 20, no. 2, pp. 117-134, May 2006.
6. J. Nielsen and R. Molich, "Heuristic evaluation of user interfaces," in Proc. CHI, 1990, pp. 249-256.
7. H. R. Hartson, T. S. Andre, and R. C. Williges, "Criteria for evaluating usability evaluation methods," Int. J. Hum.-Comput. Interact., vol. 13, no. 4, pp. 373-410, Dec. 2001.
8. W.-P. Brinkman, R. Haakma, and D. G. Bouwhuis, "Empirical usability testing in a component-based environment: Improving test efficiency with component-specific usability measures," in Proc. EHCI-DSVIS, 2005, vol. 3425, pp. 20-37.
9. W.-P. Brinkman, R. Haakma, and D. G. Bouwhuis, "Usability evaluation of component-based user interfaces," in Proc. IFIP INTERACT, 2001, pp. 767-768.
10. E. Chang and T. S. Dillon, "A usability-evaluation metric based on a soft-computing approach," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 36, no. 2, pp. 356-372, Mar. 2006.
11. M. Matera, M. F. Costabile, F. Garzotto, and P. Paolini, "SUE inspection: An effective method for systematic usability evaluation of hypermedia," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 32, no. 1, pp. 93-103, Jan. 2002.
12. P. G. Polson, C. Lewis, J. Rieman, and C. Wharton, "Cognitive walk-throughs: A method for theory-based evaluation of user interfaces," Int. J. Man-Mach. Stud., vol. 36, no. 5, pp. 741-773, May 1992.
13. S. K. Card, T. P. Moran, and A. Newell, The Psychology of Human-Computer Interaction. London, U.K.: Lawrence Erlbaum, 1983.
14. D. Kieras and P. G. Polson, "An approach to the formal analysis of user complexity," Int. J. Man-Mach. Stud., vol. 22, no. 2, pp. 365-394, Aug. 1985.
15. W.-P. Brinkman, R. Haakma, and D. G. Bouwhuis, "Towards an empirical method of efficiency testing of system parts: A methodological study," Interact. Comput., vol. 19, no. 3, pp. 342-356, May 2007.
16. M. Hertzum, "Component-based design may degrade system usability: Consequences of software re-use," in Proc. OZCHI, 2000, pp. 88-94.
17. W.-P. Brinkman, R. Haakma, and D. G. Bouwhuis, "Consistency: A factor that links the usability of individual interaction components together," in Proc. ECCE-12, 2004, pp. 57-64.
18. M. M. Taylor, P. S. E. Farrell, and J. G. Hollands, "Perceptual control and layered protocols in interface design: II. The general protocol grammar," Int. J. Hum.-Comput. Stud., vol. 50, no. 6, pp. 521-555, Jun. 1999.
19. R. Haakma, "Towards explaining the behaviour of novice users," Int. J. Hum.-Comput. Stud., vol. 50, no. 6, pp. 557-570, Jun. 1999.
20. W.-P. Brinkman, R. Haakma, and D. G. Bouwhuis, "Memory load: A factor that links the usability of individual interaction components together," in Proc. HCI, 2004, vol. 2, pp. 165-168.
21. B. E. John, L. Bass, M.-I. Sanchez-Sequra, and R. J. Adams, "Bringing usability concerns to design of software architecture," in Proc. EHCI-DSVIS, 2005, vol. 3425, pp. 1-19.
22. C. Gram and G. Cockton, Design Principles for Interactive Software London, U.K.: Chapman & Hall, 1996.
23. G. E. Krasner and S. T. Pope, "A cookbook for using the model-view-controller user interface paradigm in Smalltalk-80," J. Objected-Oriented Program., vol. 1, no. 3, pp. 27-49, Aug/Sep. 1988.
24. J. Coutaz, "PAC, an object oriented model for dialog design," in Proc. IFIP INTERACT, 1987, pp. 431-436.
25. F. Paternò, Model-Based Design and Evaluation of Interactive Applications. London, U.K.: Springer-Verlag, 2000.
26. C. S. Carver and M. F. Scheier, On the Self-Regulation of Behavior New York: Cambridge Univ. Press, 1998.
27. W. T. Powers, Behavior: The Control of Perception. Chicago, IL: Aldine, 1973.
28. P. S. E. Farrell, J. G. Hollands, M. M. Taylor, and H. D. Gamble, "Perceptual control and layered protocols in interface design: I. Fundamental concepts," Int. J. Hum.-Comput. Stud., vol. 50, no. 6, pp. 489-520, Jun. 1999.
29. W.-P. Brinkman, "Is usability compositional?" Ph.D. dissertation, Technische Univ. Eindhoven, Eindhoven, The Netherlands, 2003.
30. D.C. Howell, Statistical Methods for Psychology, 5th ed. London, U.K.: Duxbury, 2001.
31. W. D. Coleman, R. C. Williges, and D. R. Wixon, "Collecting detailed user evaluations of software interfaces," in Proc. 29th Annu. Meeting Hum. Factors Soc., 1985, pp. 240-244.
32. W.-P. Brinkman, R. Haakma, and D. G. Bouwhuis, "The theoretical foundation and validity of a component-based usability questionnaire," in Behav. Inf. Technol. to be published.
33. F. D. Davis, "Perceived usefulness, perceived ease of use, and user acceptance of information technology," MIS Q., vol. 13, no. 3, pp. 319-340, Sep. 1989.
34. W. J. Doll, A. Hendrickson, and X. Deng, "Using Davis's perceived usefulness and ease-of-use instruments for decision making: A confirmatory and multigroup invariance analysis," Decis. Sci., vol. 29, no. 4, pp. 839-869, Sep. 1998.
35. J. R. Lewis, "IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use," Int. J. Hum.-Comput. Interact., vol. 7, no. 1, pp. 57-78, Jan.-Mar. 1995.
36. G. J. Shaw, "User satisfaction in group support systems research: A meta-analysis of experimental results," in Proc. 31st Syst. Sci., 1998, vol. 1, pp. 369-369.
37. S. Hanque and S. Srinivasan, "A meta-analysis of the training effectiveness of virtual reality surgical simulators," IEEE Trans. Inf. Technol. Biomed., vol. 10, no. 1, pp. 51-58, Jan. 2006.
38. J. Miller, "Can results from software engineering experiments be safely combined?" in Proc. Softw. Metrics Symp., 1999, pp. 143-151.
39. W. Hayes, "Research synthesis in software engineering: A case for meta-analysis," in Proc. Softw. Metrics Symp., 1999, pp. 143-151.
40. J. Cohen, Statistical Power Analysis for the Behavioral Sciences, 2nd ed. New York: Academic, 1988.
41. T. K. Landauer, "Behavioral research methods in human-computer interaction," in Handbook of Human-Computer Interaction, M. G. Helander, T. K. Landauer, and P. V. Prabhu, Eds. Amsterdam, The Netherlands: Elsevier, 1997, pp. 203-227.
42. E. Erdfelder, F. Faul, and A. Buchner, "GPOWER: A general power analysis program," Behav. Res. Methods Instrum. Comput., vol. 28, pp. 1-11, 1996.
43. R. C. Thomas, Long Term Human-Computer Interaction: An Exploratory Perspective. London, U.K.: Springer-Verlag, 1998.
44. I. McLeod, H. Evans, P. Gray, and R. Mancy, "Instrumenting bytecode for the production of usage data," in Proc. CADUI, 2005, pp. 185-196.
45. P. M. Sanderson and C. Fisher, "Exploratory sequential data analysis: Qualitative and quantitative handling of continuous observational data," in Handbook of Human Factors and Ergonomics, 2nd ed., G. Salvendy and E. Chichester, Eds. New York: Wiley-Interscience, 1997, pp. 1471-1513.
46. A. Lecerof and F. Paternò, "Automatic support for usability evaluation," IEEE Trans. Softw. Eng., vol. 24, no. 10, pp. 863-888, Oct. 1998.
47. M. Hertzum and N. E. Jacobsen, "The evaluator effect: A chilling fact about usability evaluation methods," Int. J. Hum.-Comput. Interact. vol. 13, no. 4, pp. 421-443, Dec. 2001.
48. R. Molich, M. R. Ede, K. Kaasgaard, and B. Baryukin, "Comparative usability evaluation," Behav. Inf. Technol., vol. 23, no. 1, pp. 65-74, Jan/Feb. 2004.
49. A. Seffah and E. Metzker, "The obstacles and myths of usability and software engineering," Commun. ACM, vol. 47, no. 12, pp. 71-76, Dec. 2004.
50. N. A. Stanton and M. S. Young, "What price ergonomics?" Nature, vol. 399, no. 6733, pp. 197-198, May 20, 1999.