Using on-line surveys to measure three key constructs of the quality of human-computer interaction in web sites: Psychometric properties and implications

International Journal of Human Computer Studies

Volumn 59, Issue 5, 2003, Pages 545-567

  Van Schaik, Paul ^a   Ling, Jonathan ^a  

^a TEESSIDE UNIVERSITY   (United Kingdom)

Author keywords

Intranet; Likert scale; On line surveys; Psychometrics; Response format; Visual analogue scale; World Wide Web

Indexed keywords

DATA ACQUISITION; INFORMATION RETRIEVAL; ONLINE SYSTEMS; WEBSITES;

PSYCHOMETRICS;

HUMAN COMPUTER INTERACTION;

EID: 0242303033     PISSN: 10715819     EISSN: None     Source Type: Journal    
DOI: 10.1016/S1071-5819(03)00078-8     Document Type: Article

References (40)

1. Ahuja, J., Webster, J., 2001. Perceived disorientation: an examination of a new measure to assess web design effectiveness. Interacting with Computers 14, 15-29.
2. Bagozzi, R.P., Davis, F.D., Warshaw, P.R., 1992. Development and test of a theory of technological learning and usage. Human Relations 45, 659-686.
3. Bellamy, N., Campbell, J., Syrotuik, J., 1999a. Comparative study of self-rating pain scales in rheumatoid arthritis patients. Retrieved November 12, 2000, from the World Wide Web: http://www.librapharm.co.uk/cmro/vol.15/2001/main.htm
4. Bellamy, N., Campbell, J., Syrotuik, J., 1999b. Comparative study of self-rating pain scales in osteoarthritis patients. Retrieved November 12, 2000, from the World Wide Web: http://www.librapharm.co.uk/cmro/vol_15/2000/main.htm
5. Brunier, G., Graydon, J., 1996. A comparison of two methods of measuring fatigue in patients on chronic haemodialysis: visual analogue versus likert scale. International Journal of Nursing Studies 33, 338-348.
6. Buchanan, T., 2000. Internet research: self-monitoring and judgments of attractiveness. Behaviour Research Methods, Instruments & Computers 32, 521-527.
7. Chen, H., Wigand, R., Nilan, M., 1999. Optimal experience of Web activities. Computers in Human Behavior 15, 585-608.
8. Cockburn, A., McKenzie, B., 2001. What do web users do? An empirical analysis of web use. International Journal of Human-Computer Studies 54, 903-922.
9. Davis, F., 1989. Perceived usefulness, perceived ease of use and user acceptance of information technology. MIS Quarterly 13 (3), 318-340.
10. Davis, S., Wiedenbeck, S., 2001. The mediating effects of intrinsic motivation, ease of use and usefulness perceptions on performance in first-time and subsequent computer users. Interacting with Computers 13, 549-580.
11. Davis, F., Bagozzi, R., Warshaw, P., 1989. User acceptance of computer technology: a comparison of two theoretical models. Management Science 35, 982-1003.
12. Flynn, D., van Schaik, P., van Wersch, A., forthcoming. A comparison of multi-item Likert and visual analogue scales for the assessment of transactionally defined coping function. European Journal of Psychological Assessment, forthcoming.
13. Gift, A.G., 1989, Visual analogue scales: measurement of a subjective phenomena. Nursing Research 30, 268-288.
14. Gillan, D., Cooke, N., 1995. Methods of cognitive analysis in HCI. Proceedings of the CHI'95. ACM, New York, pp. 349-350.
15. Grant, S., Aitchison, T., Henderson, E., Christie, J., Zare, S., McMurray, J., Dargie, M.D., 1999. A comparison of the reproducibility and the sensitivity to change of visual analogue scales, Borg scales and Likert scales in normal subjects during submaximal exercise. Chest 116, 1208-1217.
16. Guyatt, G.H., Townsend, M., Berman, L.B., Keller, J.L., 1987. A comparison of Likert and Visual Analogue Scales for measuring change in function. Journal of Chronic Disability 40, 1129-1133.
17. Harper, B., Slaughter, L., Norman, K., 1997. Questionnaire administration via the WWW: a validation and reliability study for a user satisfaction questionnaire. Paper Presented at WebNet 97, Association for the Advancement of Computing in Education, Toronto, Canada. Retrieved July 20, 2002 from the World Wide Web: http://www.lap.umd.edu/webnet/paper.html
18. Hart, S.G., Staveland, L.E., 1988. Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. In: Hancock, P.A., Meshkati, N. (Eds.), Human Mental Workload. North Holland, Elsevier.
19. Hayes, R., Walker, S., Kirkpatrick, J., 1996. Topical diclofenac relieves pain from corneal rust ring. Eye 19, 443-446.
20. ICM, 2002. Latest polls. Retrieved January 2, 2003 from the World Wide Web: http://www.icmresearch.co.uk/reviews/latest-polls.htm
21. Jaeschke, R., Singer, J., Gordon, H., Guyatt, G.H., 1990. A comparison of seven-point and visual analogue scales: data from a randomised controlled trial. Controlled Clinical Trials 11, 43-51.
22. Joyce, C.R.B., Zutshi, D.W., Hrubes, V., Mason, R.M., 1975. Comparison of fixed interval and visual analogue scales for rating chronic pain. European Journal of Clinical Pharmacology 8, 415-420.
23. Kirakowski, J., 1994. The use of questionnaire methods for usability assessment. Retrieved December 10 2002 from the World Wide Web: http://www.ucc.ie/hfrg/questionnaires/sumi/sumipapp.html
24. Kline, P., 2000. Handbook of Psychological Testing, 2nd Edition. Routledge, London.
25. Lewis, J., 1995. IBM computer satisfaction questionnaires: psychometric evaluation and instructions for use. International Journal of Human-Computer Interaction 7, 57-78.
26. Moneta, G., Csikszentmihalyi, M., 1996. The effect of perceived challenges and skills on the quality of subjective experience. Journal of Personality 64, 275-310.
27. Murphy, D.F., McDonald, A., Power, C., Unwin, A., MacSullivan, R., 1988. Measurement of pain: a comparison of the visual analogue with a non-visual analogue scale. The Clinical Journal of Pain 3, 197-199.
28. Neely, G., Borg, E., 1995. Properties of a category ratio scale (CR-10) and the visual analogue scale (VAS): a comparison with magnitude estimation, line production and category scaling (Tech. Rep. No. 791). Department of Psychology, Stockholm University, Stockholm, Sweden.
29. Neely, G., Ljunggren, G., Sylven, C., Borg, G., 1992. Comparison between the visual analogue scale (VAS) and the category ratio scale (CR) for the evaluation of leg exertion. International Journal of Sports Medicine 13, 133-136.
30. Nielsen, J., 2001. Are users stupid? The difference between Intranet and Internet design. [Column posted on the World Wide Web.]. Author, Mountain View, CA. Retrieved November 27, 2002 from the World Wide Web: http://www.useit.com/alertbox/20010204.html
31. Norman, K.L., Friedman, Z., Norman, K., Stevenson, R., 2001. Navigational issues in the design of online self-administered questionnaires. Behaviour and Information Technology 20, 37-45.
32. Nyren, O., Adami, O., Bates, S., Bergstrom, R., Gustavsson, S., Loof, L., Sjoden, P.O., 1987. Self-rating of pain in non-ulcer dyspepsia. Journal of Clinical Gastroenterology 9, 408-414.
33. Pfennings, L., Cohen, L., van der Ploeg, H., 1995. Preconditions for sensitivity in measuring change: visual analogue scales compared to rating scales in a Likert format. Psychological Reports 77, 475-480.
34. Price, D., Bush, F., Long, S., Harkings, S., 1994. A comparison of pain measurement characteristics of mechanical visual analogue and simple numerical rating scales. Pain 6, 217-226.
35. Rosenfeld, L., Morville, P., 2002. Information architecture for the World Wide Web, 2nd Edition. O'Reilly, Sebastopol, CA.
36. Slaughter, L., Harper, B., Norman, K., 1994. Assessing the equivalence of the paper and on-line formats of the QUIS 5.5. In: Proceedings of the Mid Atlantic Human Factors Conference, Washington, DC, pp. 87-91.
37. Smith, P., 1996. Towards a practical measure of hypertext usability. Interacting with Computers 4, 365-381.
38. Spenkelink, G., Besuijen, K., 2003. Visual display quality. In: Daily, J.E., Kent, A., Lancour, H. (Eds.), Encyclopedia of Library and Information Science. Marcel Dekker, New York.
39. Tabachnick, B., Fidell, L., 2001. Using Multivariate Statistics, 4th Edition. Allyn and Bacon, Boston, London.
40. Vogt, W., 1999. Dictionary of Statistics and Methodology. Sage, Thousand Oaks, CA.