Design parameters of rating scales for web sites

ACM Transactions on Computer-Human Interaction

Volumn 14, Issue 1, 2007, Pages

  Van Schaik, Paul ^a   Ling, Jonathan ^b  

^a TEESSIDE UNIVERSITY   (United Kingdom)

^b KEELE UNIVERSITY   (United Kingdom)

Author keywords

Human computer interaction; Interaction mechanism; Likert scale; Online questionnaires; Psychometrics; Questionnaire layout; Response format; Screen design; Visual analogue scale; Web site

Indexed keywords

INTERACTION MECHANISM; LIKERT SCALE; ONLINE QUESTIONNAIRES; QUESTIONNAIRE LAYOUT;

COMPUTER AIDED DESIGN; COMPUTER SYSTEMS; HUMAN COMPUTER INTERACTION; PARAMETER ESTIMATION;

WEBSITES;

EID: 34248329172     PISSN: 10730516     EISSN: 15577325     Source Type: Journal    
DOI: 10.1145/1229855.1229859     Document Type: Article

References (46)

1. AHUJA, J. AND WEBSTER, J. 2001. Perceived disorientation: An examination of a new measure to assess web design effectiveness. Interact. Comput. 14, 15-29.
2. BAGOZZI, R. P., DAVIS, F. D., AND WARSHAW, P. R. 1992. Development and test of a theory of technological learning and usage. Human Relat. 45, 659-686.
3. BELLAMY, N., CAMPBELL, J., AND SYROTUIK, J. 1999a. Comparative study of self-rating pain scales in rheumatoid arthritis patients. (Retrieved November 12, 2000, from the World Wide Web: http://www.librapharm.co.uk/cmro/vol.15/2001/main.htm.)
4. BELLAMY, N., CAMPBELL, J., AND SYROTUIK, J. 1999b. Comparative study of self-rating pain scales in osteoarthritis patients. (Retrieved November 12, 2000, from the World Wide Web: http://www.librapharm.co.uk/cmro/vol.15/2000/main.htm.)
5. BLACKMON, M., KITAJIMA, M., AND POLSON, P. 2005. Tool for accurately predicting website navigation problems, nonproblems, problem severity, and effectiveness of repairs. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, 31-40.
6. BRUNIER, G., AND GRAYDON, J. 1996. A comparison of two methods of measuring fatigue in patients on chronic haemodialysis: Visual analogue versus Likert scale. Int. J. Nurs. Stud. 33, 338-348.
7. BUCHANAN, T. 2000. Internet research: Self-monitoring and judgments of attractiveness. Behav. Res. Meth., Instrum. Comput. 32, 521-527.
8. CARD, S., PIROLLI, P., VAN DER WEGE, M., MORRISON, J., REEDER, R., SCHRAEDLEY, P., AND BOSHART, J. 2001. Information scent as a driver of web behavior graphs: Results of a protocol analysis method for web usability. In Proceedings of CHI 2001 (Seattle, WA), ACM, New York. 498-505.
9. CHEN, H., WIGAND, R., AND NILAN, M. 1999. Optimal experience of Web activities. Comput. Human Behau. 15, 585-608.
10. COCKBURN, A., AND MCKENZIE, B. 2001. What do web users do? An empirical analysis of web use. Int. J. Human-Comput. Stud. 54, 903-922.
11. COHEN, J. 1988. Statistical Power Analysis for the Behavioral Sciences (2nd ed.) Erlbaum, Hillsdale, NJ.
12. COUPER, M. P., TOURANGEAU, R., CONRAD, F. G., AND CRAWFORD, S. D. 2004. What they see is what we get: Response options for web surveys. Soc. Sci. Comput. Rev. 22, 111-127.
13. DALAL, N. P., QUIBLE, Z., AND WYATT, K. 2000. Cognitive design of home pages: An experimental study of comprehension on the World Wide Web. Inf. Proc. Manage. 36, 607-621.
14. DAVIS, F. 1989. Perceived usefulness, perceived ease of use and user acceptance of information technology. MIS Quart. 13, 318-340.
15. DAVIS, F., BAGOZZI, R., AND WARSHAW, P. 1989. User acceptance of computer technology: A comparison of two theoretical models. Manag. Sci. 35, 982-1003.
16. DAVIS, S., AND WIEDENBECK, S. 2001. The mediating effects of intrinsic motivation, ease of use and usefulness perceptions on performance in first-time and subsequent computer users. Interac. Comput. 13, 549-580.
17. DILLMAN, D. A., AND CHRISTIAN, L. M. 2005. Survey mode as a source of instability in responses across surveys. Field Meth. 17, 30-52.
18. GILLAN, D., AND COOKE, N. 1995. Methods of cognitive analysis in HCI. In Proceedings of CHI'95. ACM, New York, 349-350.
19. HASSENZAHL, M. 2004. The interplay of beauty, goodness, and usability in interactive products. Human-Comput. Interact. 19, 319-349.
20. HARPER, B., SLAUGHTER, L., AND NORMAN, K. 1997. Questionnaire administration via the WWW: A validation and reliability study for a user satisfaction questionnaire. Paper presented at WebNet 97, Association for the Advancement of Computing in Education, Toronto, Ont., Canada. (Retrieved July 20, 2002 from the World Wide Web: http://www.lap.umd.edu/webnet/paper.html.)
21. HAYES, R., WALKER, S., AND KIRKPATRICK, J. 1996. Topical diclofenac relieves pain from corneal rust ring. Eye 19, 443-446.
22. INTERNET SOFTWARE CONSORTIUM. 2005. Internet domain survey host count. (Retrieved February 28, 2005 from the World Wide Web: http://www.isc.org/index.pl?/ops/ds/hosts.php.)
23. JACCARD, J. 1998. Interaction effects in factorial analysis of variance. Sage, London, UK.
24. JOYCE, C. R. B., ZUTSHI, D. W., HRUBES, V., AND MASON, R. M. 1975. Comparison of fixed interval and visual analogue scales for rating chronic pain. Europ. J. Clini. Pharm. 8 415-420.
25. KLINE, P. 2000. The Handbook of Psychological Testing 2nd ed. Routledge, London, UK.
26. KNAPP, H., AND KIRK, S. 2003. Using pencil and paper, Internet and touch-tone phones for self-administered surveys: Does methodology matter? Comput. Human Behav. 19, 117-134.
27. LARSON, K., AND CZERWINSKI, M. 1998. Web page design: Implications of memory, structure and scent for information retrieval. Proceedings of CHI 1998 (Los Angeles, CA). ACM, New York, 25-32.
28. LEWIS, J. 2002. Psychometric evaluation of the PSSUQ using data from five years of usability testing. Inter. J. Human-Comput. Interact. 14, 463-388.
29. LINDGAARD, G., AND DUDEK, C. 2003. What is this evasive beast called user satisfaction? Interac. Comput. 15, 429-452.
30. MONETA, G. AND CSIKSZENTMIHALYI, M. 1996. The effect of perceived challenges and skills on the quality of subjective experience. J. Personality 64, 275-310.
31. MURPHY, D. F., MCDONALD, A., POWER, C., UNWIN, A., AND MACSULLIVAN, R. 1988. Measurement of pain: A comparison of the visual analogue with a non-visual analogue scale. Clin. J. Pain 3, 197-199.
32. NIELSEN, J. 2003. Two sigma: Usability and six sigma quality assurance. [Column posted on the World Wide Web.] Retrieved January 27, 2006 from the World Wide Web: http://www.useit.com/alertbox/20031124.html
33. NORMAN, K. L., FRIEDMAN, Z, NORMAN, K., AND STEVENSON, R. 2001. Navigational issues in the design of online self-administered questionnaires. Behav. Info. Tech. 20, 37-45.
34. NUNNALLY, J., AND BERNSTEIN, I. 1994. Psychometric theory. McGraw-Hill, London, UK.
35. PFENNINGS, L., COHEN, L., AND VAN DER PLOEG, H. 1995. Preconditions for sensitivity in measuring change: Visual analogue scales compared to rating scales in a Likert format. Psych. Rep. 77, 475-480.
36. PRICE, D., BUSH, F., LONG, S., AND HARKINGS, S. 1994. A comparison of pain measurement characteristics of mechanical visual analogue and simple numerical rating scales. Pain 6, 217-226.
37. ROSENFELD, L., AND MORVILLE, P. 2002. Information Architecture for the World Wide Web 2nd ed. O'Reilly, Sebastopol, CA.
38. SAFAR, J., AND TURNER, C. 2005. Validation of a two-factor structure for system trust. In Proceedings of the HFES Annual Meeting. Human Factors Society, Santa Monica, CA.
39. SAPSFORD, R. 1999. Survey Research. Sage, London, UK.
40. SLAUGHTER, L., HARPER, B., AND NORMAN, K. 1994. Assessing the equivalence of the paper and on-line formats of the QUIS 5.5. In Proceedings of the Mid-Atlantic Human Factors Conference (Washington, DC). 87-91.
41. TOURANGEAU, R., COUPER, M. P., AND CONRAD, F. G. 2004. Spacing position and order: Interpretive statistics for visual features of survey questions. Public Opinion Quart. 68, 368-393.
42. VAN SCHAIK, P., AND LING, J. 2003a. Using online surveys to measure three key constructs of the quality of human-computer interaction in Web sites: Psychometric properties and implications. Int. J. Human-Comput. Stud. 59, 545-567.
43. VAN SCHAIK, P., AND LING, J. 2003b. The effect of link colour on information retrieval in educational intranet use. Comput. Human Behav. 19, 553-564.
44. VOGT, W. 1999. Dictionary of statistics and methodology. Sage, Thousand Oaks, CA.
45. WARD, R., AND MARSDEN, P. 2003. Physiological responses to different Web page designs. Int. J. Human-Comput. Stud. 59, 199-212.
46. WARE, C. 2004. Information visualization: Perception for design 2nd ed. Morgan Kaufmann, San Francisco, CA.