User evaluation of websites: From first impression to recommendation

Interacting with Computers

Volumn 26, Issue 1, 2014, Pages 89-102

  Thielsch, Meinald T ^a   Blotenberg, Iris ^a   Jaron, Rafael ^b  

^a UNIVERSITY OF MÜNSTER   (Germany)

^b Nordlight Research GmbH   (Germany)

Author keywords

aesthetics; content; evaluation; usability; user experience; world wide web

Indexed keywords

REGRESSION ANALYSIS; USABILITY ENGINEERING; USER EXPERIENCE; WEB DESIGN; WORLD WIDE WEB;

AESTHETICS; CONTENT; EVALUATION; EVALUATION OF WEBSITES; FIRST IMPRESSIONS; USABILITY; USER EVALUATIONS; USERS' PERCEPTION;

WEBSITES;

EID: 84890495557     PISSN: 09535438     EISSN: None     Source Type: Journal    
DOI: 10.1093/iwc/iwt033     Document Type: Article

References (87)

1. Agarwal, R. andVenkatesh, V. (2002) Assessing a firm's web presence: a heuristic evaluation procedure for the measurement of usability. Inf. Syst. Res., 13, 168-186.
2. Aladwani, A.M. and Palvia, P.C. (2002) Developing and validating an instrument for measuring user-perceived web quality. Inf. Manage., 39, 467-476.
3. Allen, D.G., Mahto, R.V. and Otondo R.F. (2007) Web-based recruitment: effects of information, organizational brand and attitudes toward a web site on applicant attraction. J.Appl. Psychol., 92, 1696-1708.
4. Bargas-Avila, J.A. and Hornbæk, K. (2011) Old Wine in New Bottles or Novel Challenges: A Critical Analysis of Empirical Studies of User Experience. Proc. 2011Annual Conf. Human Factors in Computing Systems, pp. 2689-2698. ACM, Vancouver BC.
5. Berners-Lee, T. (2001) Publishing on the semantic web. Nature, 410, 1023-1024.
6. Braddy, P.W., Meade, A.W., Michael, J.J. and Fleenor, J.W. (2009) Internet recruiting: effects of website content features on viewers' perceptions of organizational culture. Int. J. Sel. Assess., 17, 19-34.
7. Cober, R.T., Brown, D.A., Levy, P.E., Cober, A.B. and Keeping, L.M. (2003) Organizational web sites: web site content and style as determinants of organizational attraction. Int. J. Sel. Assess., 11, 158-169.
8. Cohen, J. (1988) Statistical Power Analysis for the Behavioural Sciences. Erlbaum, Hillsdale.
9. Cyr, D., Head, M. and Larios, H. (2010) Colour appeal in website design within and across cultures: a multi-method evaluation. Int. J. Hum.-Comput. Stud., 68, 1-21.
10. Cyr, D., Head, M., Larios, H. and Pan, B. (2009) Exploring human images in website design: a multi-method approach. MIS Q., 33, 539-566.
11. D'Ambra, J. and Rice, R.E. (2001) Emerging factors in user evaluation of theWorldWideWeb. Inf. Manage., 38, 373-384.
12. De Angeli, A., Sutcliffe, A. and Hartmann, J. (2006) Interaction, Usability and Aesthetics: What Influences Users' Preferences? Proc. 6th Conf. Designing Interactive Systems, University Park, PA, USA, pp. 271-280. ACM, New York.
13. De Wulf, K., Schillewaert, N., Muylle, S. and Rangarajan, D. (2006) The role of pleasure in web site success. Inf. Manage., 43, 434-446.
14. Deng, L. and Poole, M.S. (2010) Affect in web interfaces: a study of the impacts of web page visual complexity and order. MIS Q., 34, 711-730.
15. Dutta-Bergman, M.J. (2004) The impact of completeness and web use motivation on the credibility of e-health information. J. Commun., 54, 253-269.
16. Engholm, I. (2002) Digital style history: the development of graphic design on the Internet. Digit. Creat., 13, 193-211.
17. Eysenbach, G. and Köhler, C. (2002) How do consumers search for and appraise health information on theworld wide web? Qualitative study using focus groups, usability tests, and in-depth interviews. Br. Med. J., 324, 573-577.
18. Fauzi, F. and Belkhatir, M. (2010) A user study to investigate semantically relevant contextual information of WWW images. Int. J. Hum.-Comput. Stud., 68, 270-287.
19. Flavián, C., Guinalíu, M. and Gurrea, R. (2006) The role played by perceived usability, satisfaction and consumer trust on website loyalty. Inf. Manage., 43, 1-14.
20. Fu, L.M. and Salvendy, G. (2002) The contribution of apparent and inherent usability to a user's satisfaction in a searching and browsing task on theWeb. Ergonomics, 45, 415-424.
21. Geissler, G.L., Zinkhan, G.M. andWatson, R.T. (2006) The influence of home page complexity on consumer attention, attitudes, and purchase intent. J. Advert., 35, 69-80.
22. Hartmann, J., Sutcliffe, A. and De Angeli, A. (2008)Towards a theory of user judgment of aesthetics and user interface quality. ACM Trans. Comput.-Hum. Interact., TOCHI, 15, Article 15.
23. Hassenzahl, M. and Monk, A. (2010) The inference of perceived usability from beauty. Hum.-Comput. Interact., 25, 235-260.
24. Hassenzahl, M. andTractinsky, N. (2006) User experience - a research agenda. Behav. Inf. Technol., 25, 91-97.
25. Hendler, J. (2003) Science and the semantic Web. Science, 299, 520-521.
26. Hendler, J., Shadbolt, N., Hall, W., Berners-Lee, T. and Weitzner, D. (2008)Web science: an interdisciplinary approach to understanding the web. Commun. ACM, 51, 60-69.
27. Hornbæk, K. (2006) Current practice in measuring usability: challenges to usability studies and research. Int. J. Hum.-Comput. Stud., 64, 79-102.
28. Hu, L. and Bentler, P.M. (1999) Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equ. Modeling, 6, 1-55.
29. Huizingh, E. (2000) The content and design of web sites: an empirical study. Inf. Manage., 37, 123-134.
30. Ilmberger, W., Schrepp, M. and Held, T. (2008) What Kind of Cognitive Process Causes the Relationship Between Aesthetics and Usability. In Holzinger, A. (ed.), USAB 2008 - 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, Graz, Austria, Lecture Notes in Computer Science 5298, pp. 43-54.
31. ISO (1998) ISO 9241: Ergonomic Requirements for Office Work with Visual Display Terminals, VDTS - Part 11: Guidance on Usability. International Organization for Standardisation, Geneva.
32. ISO (2006) ISO 9241: Ergonomics of Human-System Interaction - Part 151: Guidance on World Wide Web Interfaces. International Organization for Standardisation, Geneva.
33. ISO (2009) ISO FDIS 9241-210: Ergonomics of Human System Interaction - Part 210: Human-Centred Design for Interactive Systems. International Organization for Standardisation, Geneva.
34. Ivory, M.Y. and Megraw, R. (2005) Evolution of web site design patterns. ACM Trans. Inf. Syst., 23, 463-497.
35. Jansen, B. and Spink, A. (2006) How are we searching the World Wide Web? A comparison of nine search engine transaction logs. Inf. Process. Manage., 42, 248-263.
36. Kang, Y. and Kim, Y. (2006) Do visitors' interest level and perceived quantity of web page content matter in shaping the attitude toward a web site? Decis. Support Syst., 42, 1187-1202.
37. Kim, S.Y. and Lim, Y.J. (2001) Customers' perceived importance of and satisfaction with Internet shopping. Electron. Mark., 11, 148-154.
38. Kurosu, M. and Kashimura, K. (1995) Apparent Usability vs. Inherent Usability: Experimental Analysis on the Determinants of the Apparent Usability. Conf. Companion on Human Factors in Computing Systems, Denver, CO, USA, pp. 292-293.ACM Press, New York.
39. Lavie, T. and Tractinsky, N. (2004) Assessing dimensions of perceived visual aesthetics of web sites. Int. J. Hum.-Comput. Stud., 60, 269-298.
40. Leder, H., Belke, B., Oeberst, A. and Augustin, D. (2004) A model of aesthetic appreciation and aesthetic judgements. Br. J. Psychol., 95, 489-508.
41. Lee, S. and Koubek, R.J. (2010) Understanding user preferences based on usability and aesthetics before and after actual use. Interact. Comput., 22, 530-543.
42. Lee, S. and Koubek, R.J. (2012) Users' perceptions of usability and aesthetics as criteria of pre- and post-use preferences. Eur. J. Ind. Eng., 6, 87.
43. Lindgaard, G., Fernandes, G., Dudek, C. and Brown, J. (2006) Attention web designers: you have 50 milliseconds to make a good first impression! Behav. Inf. Technol., 25, 115-126.
44. Lindgaard, G., Dudek, C., Sen, D., Sumegi, L. and Noonan, P. (2011) An exploration of relations between visual appeal, trustworthiness and perceived usability of homepages.ACMTrans. Comput.-Hum. Interact., 18, 1-30.
45. Liu, C. and Arnett, K.P. (2000) Exploring the factors associated with Web site success in the context of electronic commerce. Inf. Manage., 38, 23-33.
46. Mahlke, S. (2002) Factors Influencing the Experience of Website Usage. Proc. CHI'02 Extended Abstracts on Human Factors in Computing Systems, pp. 846-847.ACM, Minneapolis, Minnesota.
47. Marcus, A. and Gould, E.W. (2000) Crosscurrents: cultural dimensions and global web user-interface design. Interactions, 7, 32-46.
48. Metzger, M. (2007) Making sense of credibility on the web: models for evaluating online information and recommendations for future research. J. Am. Soc. Inf. Sci. Technol., 58, 2078-2091.
49. Moshagen, M. and Thielsch, M.T. (2010) Facets of visual aesthetics. Int. J. Hum.-Comput. Stud., 68, 689-709.
50. Moshagen, M. and Thielsch, M.T. A short version of the visual aesthetics of websites inventory. Behav. Inf. Technol., in press.
51. Moshagen, M., Musch, J. and Göritz, A.S. (2009) A blessing, not a curse: experimental evidence for beneficial effects of visual aesthetics on performance. Ergonomics, 52, 1311-1320.
52. Muthén, L.K. and Muthén, B.O. (2010) Mplus. User's Guide (6th edn). Muthén & Muthén, Los Angeles, CA.
53. Nadkarni, S. and Gupta, R. (2007) A task-based model of perceived website complexity. MIS Q., 31, 501-524.
54. Nordlight Research (2008) NLR Web Scan Instrumentenentwicklung [NRL web scan development]. Rafael Jaron, Hilden, Germany.
55. Ou, C.X. and Sia, C.L. (2010) Consumer trust and distrust: an issue of website design. Int. J. Hum.-Comput. Stud., 68, 913-934.
56. Palmer, J.W. (2002) Web site usability, design, and performance metrics. Inf. Syst. Res., 13, 151-167.
57. Petty, R.E. and Cacioppo, J.T. (1986) The elaboration likelihood model of persuasion. Adv. Exp. Soc. Psychol., 19, 123-205.
58. Pfieffelmann, B., Wagner, S.H. and Libkuman, T. (2010) Recruiting on corporate web sites: perceptions of fit and attraction. Int. J. Sel. Assess., 18, 40-47.
59. Podsakoff, P.M., MacKenzie, S.B., Lee, J.Y. and Podsakoff, N.P. (2003) Common method biases in behavioral research: a critical review of the literature and recommended remedies. J. Appl. Psychol., 88, 879-903.
60. Rains, S.A. and Karmikel, C.D. (2009) Health information-seeking and perceptions of website credibility: examiningWeb-use orientation, message characteristics, and structural features of websites. Comput. Hum. Behav., 25, 544-553.
61. Ranganathan, C. and Ganapathy, S. (2002) Key dimensions of business-to-consumer web sites. Inf. Manage., 39, 457-465.
62. Robins, D. and Holmes, J. (2008) Aesthetics and credibility in web site design. Inf. Process. Manage., 44, 386-399.
63. Robbins, S.S. and Stylianou, A.C. (2003) Global corporate web sites: an empirical investigation of content and design. Inf. Manage., 40, 205-212.
64. Scharrer, L., Bromme, R., Britt, M.A. and Stadtler, M. (2012) The seduction of easiness: howscience depictions influence laypeople's reliance on their own evaluation of scientific information. Learn. Instr., 22, 231-243.
65. Schenkman, B.N. and Jönsson, F.U. (2000) Aesthetics and preferences of web pages. Behav. Inf. Technol., 19, 367-377.
66. Shneiderman, B. and Plaisant, C. (2009) Designing the User Interface: Strategies for Effective Human-Computer Interaction (5th edn). Addison-Wesley, Boston.
67. Soobrah, R. and Clark, S.K. (2011)Your patient information website: how good is it? Colorectal Dis., 14, 90-94.
68. Sillence, E., Briggs, P., Harris, P.R. and Fishwick, L. (2007) How do patients evaluate and make use of online health information? Soc. Sci. Med., 64, 1853-1862.
69. Simon, S.J. (2001) The impact of culture and gender on web sites: an empirical study. ACM SIGMIS Database, 32, 18-37.
70. Sonderegger, A., Zbinden, G., Uebelbacher, A. and Sauer, J. (2012) The influence of product aesthetics and usability over the course of time: a longitudinal field experiment. Ergonomics, 55, 713-730
71. Sun, H. (2001) Building a Culturally-Competent Corporate Web Site: An Exploratory Study of Cultural Markers in Multilingual Web Design. Proc. 19th Annual Int. Conf. Computer Documentation, Santa Fe, NM, USA, pp. 95-102. ACM Press, New York.
72. Sutherland, L.A., Wildemuth, B., Campbell, M.K. and Haines, P.S. (2005) Unraveling the web: an evaluation of the content quality, usability, and readability of nutrition web sites. J. Nutr. Educ. Behav., 37, 300-305.
73. Tarasewich, P., Daniel, H.Z. and Griffin, H.E. (2001) Aesthetics and web site design. Q. J. Electron. Commer., 2, 67-81.
74. Thielsch, M.T. (2008) Ästhetik vonWebsites [Aesthetics of websites]. MV Wissenschaft, Münster.
75. Thielsch, M.T. and Hirschfeld, G. (2010) High and low spatial frequencies in website evaluations. Ergonomics, 53, 972-978.
76. Thielsch, M.T. and Hirschfeld, G. (2012) Spatial frequencies in aesthetic website evaluations - explaining how ultra-rapid evaluations are formed. Ergonomics, 55, 731-742.
77. Thüring, M. and Mahlke, S. (2007) Usability, aesthetics and emotions in human-technology interaction. Int. J. Psychol., 42, 253-264.
78. Tractinsky, N. (1997) Aesthetics and Apparent Usability: Empirically Assessing Cultural and Methodological Issues. In Pemberton, S. (ed.) Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Atlanta, Georgia, USA, pp. 115-122. ACM Press, New York.
79. Tractinsky, N. (2004) Toward the Study of Aesthetics in Information Technology. In DeGross, J.I. (ed.), Proc. 25th ICIS, pp. 771-780. ICIS Press, Washington DC.
80. Tractinsky, N., Cokhavi, A., Kirschenbaum, M. and Sharfi, T. (2006) Evaluating the consistency of immediate aesthetic perceptions of web pages. Int. J. Hum.-Comput. Stud., 64, 1071-1083.
81. Tuch, A.N., Bargas-Avila, J.A., Opwis, K. and Wilhelm, F.H. (2009) Visual complexity of websites: effects on users' experience, physiology, performance, and memory. Int. J. Hum.-Comput. Stud., 67, 703-715.
82. Tuch, A.N., Presslaber, E.E., Stöcklin, M., Opwis, K. and Bargas-Avila, J.A. (2012) The role of visual complexity and prototypicality regarding first impression of websites: working towards understanding aesthetic judgments. Int. J. Hum.-Comput. Stud., 70, 794-811.
83. Van der Heijden, H. (2003) Factors influencing the usage of websites: the case of a generic portal in The Netherlands. Inf. Manage., 40, 541-549.
84. Van Schaik, P. and Ling, J. (2009) The role of context in perceptions of the aesthetics of web pages over time. Int. J. Hum.-Comput. Stud., 67, 79-89.
85. Watanabe, T. (2009) Experimental evaluation of usability and accessibility of heading elements. Disabil. Rehabil. Assist. Technol., 4, 236-247.
86. Yoo, B. and Donthu, N. (2001) Developing a scale to measure the perceived quality of an Internet shopping site, SITEQUAL. Q. J. Electron. Commer., 2, 31-46.
87. Zhao, W., Massey, B., Murphy, J. and Fang, L. (2003) Cultural dimensions of website design and content. Prometheus, 21, 74-84.