Measuring the User Experience

Measuring the User Experience

Volumn , Issue , 2008, Pages

  Albert, William ^a   Tullis, Thomas ^b  

^a BENTLEY UNIVERSITY   (United States)

^b Fidelity Investments ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85013752534     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-0-12-373558-4.X0001-5     Document Type: Book

References (150)

1. Agresti A., Coull B. Approximate is better than 'exact' for interval estimation of binomial proportions. The American Statistician 1998, 52:119-126.
2. Albert, W. (2002). Do Web users actually look at ads? A case study of banner ads and eye-tracking technology. Proceedings of the Usability Professionals Association Conference 2002, Orlando.
3. Albert, W., & Dixon, E. (2003). Is this what you expected? The use of expectation measures in usability testing. Proceedings of the Usability Professionals Association 2003 Conference, Scottsdale, AZ.
4. Aldenderfer M., Blashfield R. Cluster analysis (quantitative applications in the social sciences) 1984, Sage Publications, Inc., Beverly Hills, CA.
5. Windows XP Home Edition vs. Windows Millennium Edition (ME) public report 2001, American Institutes for Research, Available at, New England Research Center, Concord, MA. http://download.microsoft.com/download/d/8/1/d810ce49-d481-4a55-ae63-3fe2800cbabd/ME_Public.doc.
6. Anttonen J., Surakka V. Emotions and heart rate while sitting on a chair 2005, 491-499.
7. Apple IIe design guidelines 1982, Apple Computer Inc., Apple Computer, Inc., Cupertino, CA.
8. Bailey B. Judging the severity of usability issues on web sites: This doesn't work. Usability Updates Newsletters 2005, Available at. http://www.usability.gov/pubs/102005news.html.
9. Barnum, C., Bevan, N., Cockton, G., Nielsen, J., Spool, J., & Wixon, D. (2003). The "magic number 5": Is it enough for web testing? CHI 2003, April 5-10, Ft. Lauderdale, FL.
10. Benedek, J., & Hazlett, R. (2005). Incorporating facial EMG emotion measures as feedback in the software design process. Human Computer Interaction Consortium, February, Colorado.
11. Benedek J., Miner T. Measuring desirability: New methods for evaluating desirability in a usability lab setting 2002, Also available at, Also see the appendix listing the Product Reaction Cards at. http://www.microsoft.com/usability/UEPostings/ProductReactionCards.doc.
12. Bias R., Mayhew D. Cost-justifying usability: An update for the Internet age 2005, Morgan Kaufmann, San Francisco. 2nd ed.
13. Birns J.H., Joffre J.A., Leclerc J.F., Paulsen C.A. Getting the whole picture-The importance of collecting usability data using both concurrent think aloud and retrospective probing procedures 2002, Also available at. http://www.usabilityair.org/publications/christinepaulsen/upa_thinkaloud_paper.pdf.
14. Breyfogle F. Implementing Six Sigma: Smarter solutions using statistical methods 1999, John Wiley, New York.
15. Brooke J. SUS: A quick and dirty usability scale. Usability evaluation in industry 1996, Taylor & Francis, London, Also see. http://www.usability.serco.com/trump/documents/Suschapt.doc, P.W. Jordan, B. Thomas, B.A. Weerdmeester, I.L. McClelland (Eds.).
16. Brush A.J.B., Ames M., Davis J. A comparison of synchronous remote and local usability studies for an expert interface 2004, Available at. http://www.stanford.edu/~morganya/research/chi2004-remote.pdf.
17. Castillo J.C., Hartson H.R., Hix D. Remote usability evaluation: Can users report their own critical incidents?. Proceedings of CHI '98 Conference 1998.
18. Catani M., Biers D. Usability evaluation and prototype fidelity. Proceedings of the Human Factors and Ergonomic Society 1998.
19. Chadwick-Dias, A., Bergel, M., LeDoux, L., & Tullis, T. (2005). How to improve Web usability for older users. Proceedings of HCI International 2005 Conference, July, Las Vegas.
20. Chadwick-Dias, A., McNulty, M., & Tullis, T. (2003). Web usability and age: How design changes can improve performance. Proceedings of the 2003 ACM Conference on Universal Usability, Vancouver, BC.
21. Chin J.P., Diehl V.A., Norman K.L. Development of an instrument measuring user satisfaction of the human-computer interface. ACM CHI '88proceedings 1988, 213-218.
22. Cockton G., Woolrych A. Understanding inspection methods: Lessons from an assessment of heuristic evaluation. Joint Proceedings of HCI and IHM: People and Computers, XV 2001.
23. Darwin C. The expression of the emotions in man and animals 1872, John Murray, Albemarle Street, London, Available at. http://pages.britishlibrary.net/charles.darwin3/expression/expression_intro.htm.
24. den Uyl M.J., van Kuilenburg H. The FaceReader: Online facial expression recognition. Proceedings of MeasuringBehavior 2005 2005, Available at. http://www.noldus.com/site/content/files/other_downloads/fc_denuyl_and_vankuilenburg_2005.pdf.
25. Dennerlein, J., Becker, T., Johnson, P., Reynolds, C. J., & Picard, R. W. (2003). Frustrating computer users increases exposure to physical factors. Proceedings of the International Ergonomics Association, August 24-29, Seoul.
26. Dillman D.A., Phelps G., Tottora R, Swift K, Kohrell J., Berck J. Response rate and measurement differences in mixed mode surveys using mail, telephone, interactive voice response, and the Internet 2001, Available at. http://survey.sesrc.wsu.edu/dillman/papers.htm.
27. Dumas J., Molich R., Jeffries R. Describing usability problems: Are we sending the right message?. Interactions 2004, July-August.
28. Educause Recommended readings of the top-ten IT issues 2005, Available at. http://www.educause.edu/ir/library/pdf/ERM0566.pdf.
29. Ekman P., Friesen W.V. Unmasking the face: A guide to recognizing emotions from facial clues 1975, Prentice Hall, Englewood Cliffs, NJ.
30. Ekman P., Friesen W.V., Hager J.C. The facial action coding system 2002, Research Nexus eBook, Salt Lake City. 2nd ed.
31. Ekman P., Sorenson E.R., Friesen W.V. Pan-cultural elements in facial displays of emotions. Science 1969, 164(3875):86-88.
32. Essa I.A., Pentland A.P. Coding, analysis, interpretation, and recognition of facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 1997, 19(7):757-763.
33. Everett, S. P., Byrne, M. D., & Greene, K. K. (2006). Measuring the usability of paper ballots: Efficiency, effectiveness, and satisfaction. Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting. Santa Monica, CA.
34. Few S. Show me the numbers: Designing tables and graphs to enlighten 2004, Analytics Press, Oakland, CA.
35. Few S. Information dashboard design: The effective visual communication of data 2006, O'Reilly, Sebastopol, CA.
36. Fogg B.J., Marshall J., Laraki O., Osipovich A., Varma C., Fang N., Paul J., Rangnekar A., Shon J., Swani P., Treinen M. What makes a Web site credible? A report on a large quantitative study. Proceedings of ACM CHI 2001 Conference on Human Factors in Computing Systems 2001, 1:61-68. ACM Press, New York.
37. ForeSee Results (2006). E-Government Satisfaction Index, June 20, Ann Arbor, MI. Available at http://www.ForeSeeResults.com.
38. Fukuda R., Bubb H. Eye tracking study on Web-use: Comparison between younger and elderly users in case of search task with electronic timetable service. PsychNology Journal 2003, 1(3):202-228.
39. Gall M.D., Borg W.R., Gall J.P. Educational research: An introduction 1996, Longman, White Plains, NY. 6th ed.
40. Granholm E., Asarnow R.F., Sarkin A.J., Dykes K.L. Pupillary responses index cognitive resource limitations. Psychophysiology 1996, 33:457-461.
41. Gygi C., DeCarlo N., Williams B., Covey S. Six Sigma for dummies 2005, John Wiley, Hoboken, NJ.
42. Hammontree M., Weiler P., Nayak N. Remote usability testing. Interactions 1994, July 21-25.
43. Harris R.L. Information graphics: A comprehensive illustrated reference 1999, Oxford University Press, New York.
44. Hart T. Designing "senior friendly" Websites: Do guidelines help?. Usability News 6.1 2004, http://psychology.wichita.edu/surl/usabilitynews/61/older_adults-withexp.htm.
45. Hartson, H. R., Castillo, J. C., Kelso, J., & Neale, W. C. (1996). Remote evaluation: The network as an extension of the laboratory. Proceedings of CHI'96 Conference. Vancouver, BC.
46. Hazlett R.L. Measurement of user frustration: A biologic approach 2003, ACM Press, New York.
47. Hazlett R.L., Benedek J. Measuring the emotional reaction to passive first impression of software. Proceedings of Designing Pleasurable Products and Interfaces 2005 2005, Springer-Verlag, Eindhoven, Netherlands.
48. Henry S. Just ask: Integrating accessibility throughout design 2007, Available at. http://Lulu.com.
49. Hertzum M., Jacobsen N., Molich R. Usability inspections by groups of specialists: Perceived agreement in spite of disparate observations. CHI 2002 2002, Minneapolis.
50. Hess E.H., Polt J.M. Pupil size in relation to mental activity during simple problem-solving. Science 1964, 143:1190-1192.
51. Ergonomic requirements for office work with visual display terminals (VDTs); Part 11-Guidance on usability 1998, 22. International Standards Organization-ISO 9241-11.
52. Iqbal, S. T., Zheng, X. S., & Bailey, B. P. (2004). Task-evoked pupillary response to mental workload in human-computer interaction. Extended Abstracts of the ACM Conference on Human Factors in Computing Systems, Vienna.
53. Jacobsen N., Hertzum M., John B. The evaluator effect in usability studies: problem detection and severity judgments. Proceedings of the Human Factors and Ergonomics Society 1998.
54. Kahneman D. Attention and effort 1973, Prentice-Hall, Englewood Cliffs, NJ.
55. Kahneman D., Beatty J. Pupil diameter and load on memory. Science 1966, 154:1583-1585.
56. Kapoor, A., Mota, S. & Picard R. (2001). Towards a learning companion that recognizes affect. AAAI Fall Symposium, November, North Falmouth, MA.
57. Kaushik, A. (2007) Web analytics: An hour a day Sybex; Pap/Cdr edition (June).
58. Kessner, M., Wood, J., Dillon, R., & West, R. (2001). On the reliability of usability testing. Proceedings of CHI 2001, Seattle.
59. Kirkpatrick A., Rutter R., Heilmann C., Thatcher J., Waddell C. Web accessibility: Web standards and regulatory compliance 2006, Available online from Friends of ED. http://www.friendsofed.com/book/html%3Fisbn=I590596382.
60. Kohavi R., Round M. Front line Internet analytics at Amazon.com Presentation at Emetrics Summit 2004. Retrieved on May 22, 2007. http://ai.stanford.edu/~ronnyk/emetricsAmazon.pdf.
61. Krug S. Don't make me think! A common sense approach to Web usability 2000, New Riders Press, Indianapolis.
62. Kruskal J., Wish M. Multidimensional scaling (quantitative applications in the social sciences) 2006, Sage Publications, Inc., Beverly Hills, CA.
63. Kuniavsky M. Observing the user experience: A practitioner's guide to user research 2003, Morgan Kaufmann, San Francisco.
64. LeDoux L., Connor Mangan E., Tullis T. Extreme makeover: UI edition 2005, Available at. http://www.upassoc.org/usability_resources/conference/2005/ledoux-UPA2005-Extreme.pdf.
65. Lewis J.R. Psychometric evaluation of an after-scenario questionnaire for computer usability studies. The ASQ. SIGCHI Bulletin 1991, 23(1):78-81. Also see. http://www.acm.org/~perlman/question.cgi%3Fform=ASQ.
66. Lewis J.R. Psychometric evaluation of the post-study system usability questionnaire: The PSSUQ 1992, 1259-1263.
67. Lewis J.R. Sample sizes for usability studies: Additional considerations. Human Factors 1994, 36:368-378.
68. Lewis J.R. IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. International Journal of Human-Computer Interaction 1995, 7(1):57-78. Also see. http://www.acm.org/~perlman/question.cgi%3Fform=CSUQ.
69. Lewis J., Sauro J. When 100% really isn't 100%: Improving the accuracy of small-sample estimates of completion rates. Journal of Usability Studies 2006, 1(3):136-150. Also see. http://www.upassoc.org/upa_publications/jus/2006_may/lewis_small_sample_estimates.pdf.
70. Libby W.L., Lacey B.C., Lacey J.I. Pupillary and cardiac activity during visual attention. Psychophysiology 1973, 10:270-294.
71. Likert R. A technique for the measurement of attitudes. Archives of Psychology 1932, 140:55.
72. Lin, T., Hu, W., Omata, M., & Imamiya, A. (2005). Do physiological data relate to traditional usability indexes? Proceedings of OZCHI 2005, November 23-25, Canberra, Australia.
73. Lindgaard, G., & Chattratichart, J. (2007). Usability testing: What have we overlooked? Proceedings of ACM CHI Conference on Human Factors in Computing Systems.
74. Lindgaard G., Fernandes G., Dudek C., Brown J. Attention web designers: You have 50 milliseconds to make a good first impression!. Behaviour & Information Technology 2006, 25:115-126.
75. Lund A. Measuring usability with the USE questionnaire. Usability and User Experience Newsletter of the STC Usability SIG. 2001, See. http://www.stcsig.org/usability/newsletter/0110_measuring_with_use.html.
76. Marshall, S. (2000). Method and apparatus for eye tracking and monitoring pupil dilation to evaluate cognitive activity. U.S. Patent approved, February.
77. Martin P., Bateson P. Measuring behaviour 1993, Cambridge University Press, Cambridge. 2nd ed.
78. Maurer D., Warfel T. Card sorting: A definitive guide. Boxes and Arrows 2004, http://www.boxesandarrows.com/archives/card_sorting_a_definitive_guide.php.
79. Mayhew D., Bias R. Cost-justifying usability 1994, Morgan Kaufmann, San Francisco.
80. McGee, M. (2003). Usability magnitude estimation. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Denver.
81. McGee M. Master usability scaling: Magnitude estimation and master scaling applied to usability measurement 2004, ACM Press, New York.
82. McRobbie M. Architecture for the 21st century: An information technology strategic plan for Indiana University 1998, Indiana University, Bloomington.
83. Molich, R., Bevan, N., Butler, S., Curson, I., Kindlund, E., Kirakowski, J., & Miller, D. (1998). Comparative evaluation of usability tests. Usability Professionals Association Conference, Washington, DC.
84. Molich R., Dumas J. Comparative usability evaluation (CUE-4). Behaviour & Information Technology 2006, 99999(1):0144-929X. Retrieved on August 27, 2007, from. http://www.informa%20world.com/10.1080/01449290600959062.
85. Molich R., Jeffries R., Dumas J. Making usability recommendations useful and usable. Journal of Usability Studies 2007, 2(4):162-179. Available at. http://www.upassoc.org/upa_publications/jus/2007august/useful-usable.pdf.
86. About Motorola University: The inventors of Six Sigma Motorola, Retrieved on May 28, 2007, from. http://www.motorola.com/content.jsp%3FglobalObjectId=3079.
87. Mueller J. Accessibility for everybody: Understanding the Section 508 accessibility requirements 2003, Apress, Berkeley, CA.
88. Nancarrow C., Brace I. Saying the "right thing": Coping with social desirability bias in marketing research. Bristol Business School Teaching and Research Review 2000, 3(Summer).
89. Common industry format for usability test reports National Institute of Standards and Technology (NIST), See. http://zing.ncsl.nist.gov/iusr/documents/cifv1.1b.htm.
90. National Institute of Standards and Technology (NIST).(2001). ANSI/INCITS 354-2001: Common Industry Format (CIF) for usability test reports. See. http://webstore.ansi.org/ansidocstore/product.asp%3Fsku=ANSI+INCITS+354-2001.
91. NCSS: Statistical and power analysis software NCSS, Retrieved on May 26, 2007, from. http://www.ncss.com/.
92. Nielsen, J. (Undated). Severity ratings for usability problems. Available at http://www.useit.com/papers/heuristic/severityrating.html.
93. Nielsen J. Usability engineering 1993, Morgan Kaufmann, San Francisco.
94. Nielsen J. Sun Microsystems 1997 Web Design January 13. Retrieved on May 28, 2007, from. http://www.useit.com/papers/sun/1997/.
95. Nielsen J. Why you only need to test with 5 users AlertBox, March 19. Available at. http://www.useit.com/alertbox/20000319.html.
96. Nielsen J. Jakob Nielsen's AlertBox, February 18. Success rate: The simplest usability metric Available at. http://www.useit.com/alertbox/20010218.html.
97. Nielsen J. Designing web ads using click-through data AlertBox, September 2. Retrieved on May 22, 2007, from. http://www.useit.com/alertbox/20010902.html.
98. Nielsen J. Beyond accessibility: Treating users with disabilities as people AlertBox, November 11. Retrieved on May 27, 2007, from. http://www.useit.com/alertbox/20011111.html.
99. Nielsen J. Medical usability: How to kill patients through bad design Available at. http://www.useit.com/alertbox/20050411.html.
100. Nielsen, J., & Landauer, T. (1993). A mathematical model of the finding of usability problems. ACM Proceedings, Interchi 93, Amsterdam.
101. Nunnally J.C., Knott P.D., Duchnowski A., Parker R. Pupillary response as a general measure of activation. Perception & Psychophysics 1967, 2:149-150.
102. Osgood C.E., Suci G., Tannenbaum P. The measurement of meaning 1957, University of Illinois Press, Urbana.
103. Pande P., Holpp L. What is Six Sigma? 2001, McGraw-Hill, New York.
104. Peterson E. Web analytics demystified: A marketer's guide to understanding how your Web site affects your business 2004, Celilo Group Media, Portland, OR.
105. Picard, R., & Scheirer, J. (2001). The Galvactivator: A glove that senses and communicates skin conductivity. Proceedings of the 9th International Conference on Human-Computer Interaction, New Orleans.
106. Pyzdek T. The Six Sigma handbook: The complete guide for greenbelts, blackbelts, and managers at all levels, revised and expanded edition 2003, McGraw-Hill, New York.
107. Rehabilitation Act as Amended, Section 508 of the 1973. (1998). Workforce Investment Act of 1998, Pub. L. No. 105-220, 112 Stat. 936 (August 7). Codified at 29 U.S.C. §794d.
108. RelevantView. (2006). Ratings, reviews and the customer decision process: Amazon v. Best Buy v. CircuitCity v. WalMart. March/April. Available at http://www.relevantview.com/retailreport.htm.
109. Reynolds, C. (2005). Adversarial uses of affective computing and ethical implications. Ph.D. Thesis, Massachusetts Institute of Technology, Cambridge. Available at http://affect.media. mit. edu/pdfs/05. reynolds-phd.pdf.
110. Rubin J. Handbook of usability testing. How to plan, design, and conduct effective tests 1994, John Wiley, New York.
111. Sauro, J., & Kindlund, E. (2005). A method to standardize usability metrics into a single score. Proceedings of the Conference on Human Factors in Computing Systems (CHI 2005), Portland, OR.
112. Sauro, J., & Lewis, J. (2005). Estimating completion rates from small samples using binomial confidence intervals: Comparisons and recommendations. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Orlando.
113. Shaikh A., Baker J., Russell M. What's the skinny on weight loss websites?. Usability News 2004, 6(1). Available at. http://psychology.wichita.edu/surl/usabilitynews/61/diet_domain.htm.
114. Smith P.A. Towards a practical measure of hypertext usability. Interacting with Computers 1996, 8(4):365-381.
115. Snyder, C. (2006). Bias in usability testing. Boston Mini-UPA Conference, March 3, Natick, MA.
116. Sostre P., LeClaire J. Web analytics for dummies 2007, John Wiley, New York.
117. Spool J., Schroeder W. Testing web sites: Five users is nowhere near enough. CHI 2001 2001, Seattle.
118. Steinhauer S.R., Boller F., Zubin J., Pearlman S. Pupillary dilation to emotional visual stimuli revisited. Psychophysiology 1983, 20:472.
119. Sterne J. Web metrics: Proven methods for measuring Web site success 2002, John Wiley, New York.
120. Stevens S.S. On the psychophysical law. Psychological Review 1957, 64(3):153-181.
121. Stover A., Coyne K., Nielsen J. Designing usable site maps for Websites Available at. http://www.nngroup.com/reports/sitemaps/.
122. Tedesco, D., & Tullis, T. (2006). A comparison of methods for eliciting post-task subjective ratings in usability testing. Usability Professionals Association Conference, June 12-16, Broomfield, CO.
123. Thomas J. Indiana University's Enterprise portal as a service delivery framework in designing portals: Opportunities and challenges. Designing portals: Opportunities and challenges 2003, Information Science Publishing, Hershey, PA. A. Jafari, M. Sheehan (Eds.).
124. Trimmel M., Meixner-Pendleton M., Haring S. Stress response caused by system response time when searching for information on the Internet: Psychophysiology in ergonomics. Human Factors 2003, 45(4):615-621.
125. Tufte E.R. Envisioning information 1990, Graphics Press, Chesire, CT.
126. Tufte E.R. Visual explanations: Images and quantities, evidence and narrative 1997, Graphics Press, Chesire,CT.
127. Tufte E.R. The visual display of quantitative information 2001, Graphics Press, Chesire, CT. 2nd ed.
128. Tufte E.R. Beautiful evidence 2006, Graphics Press, Chesire, CT.
129. Tullis, T. S. (1985). Designing a menu-based interface to an operating system. Proceedings of CHI'85 Conference on Human Factors in Computing Systems, San Francisco.
130. Tullis, T. S. (1998). A method for evaluating web page design concepts. Proceedings of CHI'98 Conference on Computer-Human Interaction, Los Angeles.
131. Tullis, T. S. (2005). How reliable are the results of a usability test? Boston Mini-UPA Conference, March 3, Natick, MA.
132. Tullis, T. S. (2007). Using closed card-sorting to evaluate information architectures. Usability Professionals Association Conference, Austin, TX.
133. Tullis T.S., Fleischman S., McNulty M., Cianchette C., Bergel M. An empirical comparison of lab and remote usability testing of Web sites 2002, Available at. http://home.comcast.net/~tomtullis/publications/RemoteVsLab.pdf.
134. Tullis, T. S., Mangan, E. C., & Rosenbaum, R. (2007). An empirical comparison of on-screen keyboards. Human Factors and Ergonomics Society 51st Annual Meeting, October 1-5, Baltimore.
135. Tullis T.S., Stetson J. A comparison of questionnaires for assessing Website usability 2004, Available at, Slides. http://www.upassoc.org/usability_resources/conference/2004/UPA-2004-TullisStetson.pdf.
136. Tullis, T. S., & Tullis, C. (2007). Statistical analyses of e-commerce Websites: Can a site be usable and beautiful? Proceedings of HCI International Conference, Beijing.
137. Tullis T.S., Wood L. How many users are enough for a card-sorting study? 2004, Available at. http://websort.net/articles/Tullis%26Wood.pdf.
138. Tullis, T.S, Wood, L., (2005). How can you do a card-sorting study with lots of cards? Usability Professionals Association Conference, Montreal.
139. Turner, C., Nielsen, J., & Lewis, J. (2002). Current issues in the determination of usability test sample size: How many users is enough? Usability Professionals Association Conference, Orlando.
140. Usability Professionals Association. See http://upassoc.org/usability_resources/about_usability/definitions_of_usability.html.
141. Usborne N. Design choices can cripple a Website. A List Apart 2005, November 8. Retrieved on May 22, 2007, from. http://alistapart.com/articles/designcancripple.
142. Virzi R. Refining the test phase of the usability evaluation: How many subjects is enough?. Human Factors 1992, 34(4):457-468.
143. Ward R., Marsden P. Physiological responses to different WEB page designs. International Journal of Human-Computer Studies 2003, 59:199-212.
144. Wilson C. Readers' questions: Severity scales. Usability Interface 1999, 5(4). Available at. http://www.stcsig.org/usability/newsletter/9904-severity-scale.html.
145. Wilson C., Coyne K.P. Tracking usability issues: To bug or not to bug?. Interactions 2001, May-June.
146. Withrow, J., Brinck, T., & Speredelozzi, A. (2000). Comparative usability evaluation for an e-governmentportal. Diamond Bullet Design Report, #U1-00-2, December, Ann Arbor, MI. Available at http://www.diamondbullet.com/egovportal.pdf.
147. Woolrych A., Cockton G. Why and when five test users aren't enough. Proceedings of IHM-HCI2001 2001, 2:105-108. Cépaduès-Éditions, Toulouse, France.
148. Web content accessibility guidelines 1.0 World-Wide Web Consortium, Retrieved on May 27, 2007, from. http://www.w3.org/TR/WAI-WEBCONTENT/.
149. Zazelenchuk T.W. Measuring satisfaction in usability tests: A comparison of question-naire administration methods and an investigation into users' rationales for satisfaction. Dissertation Abstracts International 2002, 63(05A). UMI No. 3054425.
150. Zazelenchuk T.W., Boling E. Considering user satisfaction in designing web-based portals. Educause Quarterly 2003, 26(1):35-40.