Measuring the quality of governmental websites in a controlled versus an online setting with the 'Website Evaluation Questionnaire'

Government Information Quarterly

Volumn 29, Issue 3, 2012, Pages 383-393

  Elling, Sanne ^a   Lentz, Leo ^a   de Jong, Menno ^b   van den Bergh, Huub ^a  

^a UTRECHT UNIVERSITY   (Netherlands)

^b UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Governmental websites; Multidimensionality; Questionnaires; Usability; Website quality

Indexed keywords

EID: 84862555235     PISSN: 0740624X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.giq.2011.11.004     Document Type: Article

References (49)

1. Akkaya C., Wolf P., Krcmar H. The role of trust in e-government adoptation: A literature review. AMCIS 2010 proceedings, paper 297 2010.
2. Albert W., Dixon E. Is this what you expected? The use of expectation measures in usability testing. Proceedings of the usability professionals association 2003 conference 2003, Scottsdale, AZ.
3. Anderson E.W., Fornell C. Foundations of the American Customer Satisfaction Index. Total Quality Management 2000, 11:869-882.
4. Bangor A., Kortum P., Miller J.A. The System Usability Scale (SUS): An empirical evaluation. International Journal of Human Computer Interaction 2008, 24:574-594.
5. Bangor A., Kortum P., Miller J.A. Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of Usability Studies 2009, 4(3):114-123.
6. Beldad A., De Jong M., Steehouder M. How shall I trust the faceless and the intangible? A literature review on the antecedents of online trust. Computers in Human Behavior 2010, 26:857-869.
7. Bertot J.C., Jaeger P.T. The E-Government paradox: Better customer service doesn't necessarily cost less. Government Information Quarterly 2008, 25:149-154.
8. Brinkman W.P., Haakma R., Bouwhuis D.G. The theoretical foundation and validity of a component-based usability questionnaire. Behaviour and Information Technology 2009, 28:121-137.
9. Brooke J. SUS: A quick and dirty usability scale. Usability evaluation in industry 1996, Taylor and Francis, London, http://www.usability.serco.com/trump/documents/Suschapt.doc. P.W. Jordan, B. Thomas, B.A. Weerdmeester, I.L. McClelland (Eds.).
10. Couper M.P. Web surveys: A review of issues and approaches. Public Opinion Quarterly 2000, 64:464-494.
11. Couper M.P., Miller P.V. Web survey methods: Introduction. Public Opinion Quarterly 2008, 72:831-835.
12. De Jong M., Lentz L. Scenario evaluation of municipal websites. Development and use of an expert-focused evaluation tool. Government Information Quarterly 2006, 23:191-206.
13. Elling S., Lentz L., De Jong M. Website Evaluation Questionnaire: Development of a research-based tool for evaluating informational websites. Lecture Notes in Computer Science 2007, 4656:293-304.
14. Elling S., Lentz L., De Jong M. Retrospective think-aloud method: Using eye movements as an extra cue for participants' verbalizations. Proceedings of the 2011 annual conference on human factors in computing systems 2011, 1161-1170. ACM, New York.
15. Elling S., Lentz L., De Jong M. Users' abilities to review website pages. Journal of Business and Technical Communication 2012, 26:170-200.
16. Fan W., Yan Z. Factors affecting response rates of the web survey: A systematic review. Computers in Human Behavior 2010, 26:132-139.
17. Galesic M., Bosjnak M. Effects of questionnaire length on participation and indicators of response quality in a web survey. Public Opinion Quarterly 2009, 73:349-360.
18. Heerwegh D., Loosveldt G. Face-to-face web surveying in a high-internet-coverage population. Differences in response quality. Public Opinion Quarterly 2008, 72:836-846.
19. Hornbæk K. Current practice in measuring usability: Challenges to usability studies and research. International Journal of Human Computer Studies 2006, 64:79-102.
20. Jöreskog K.G. Statistical analysis of sets of congeneric tests. Psychometrika 1971, 36:109-132.
21. Jöreskog K.G., Sörbom D. LISREL 8.51 2001, Scientific Software International, Chicago.
22. Kirakowski J., Claridge N., Whitehand R. Human-centered measures of success in website design. Proceedings of the 4th conference on human factors & the web 1998, 1-9. Baskerville, NJ.
23. Lewis J.R. Psychometric evaluation of an after-scenario questionnaire for computer usability studies: The ASQ. SIGGHI Bulletin 1991, 23(1):78-81.
24. Lewis J.R., Sauro J. The factor structure of the System Usability Scale. Lecture Notes in Computer Science 2009, 5619:94-103.
25. Loukis E., Xenakis A., Charalabidis Y. An evaluation framework for e-participation in parliaments. International Journal of Electronic Governance 2010, 3:25-47.
26. Magoutas B., Halaris C., Mentzas G. An ontology for the multi-perspective evaluation of quality in e-government services. Lecture Notes in Computer Science 2007, 4656:318-329.
27. McGee M. Master usability scaling: Magnitude estimation and master scaling applied to usability measurement. Proceedings of CHI conference on human factors in computer systems 2004, 335-342. ACM, Vienna, NY.
28. Muylle S., Moenaert R., Despontin M. The conceptualization and empirical validation of website user satisfaction. Information Management 2004, 41:543-560.
29. Ozok A.A. Survey design and implementation in HCI. Handbook of human-computer interaction 2008, 151-1169. Lawrence Erlbaum, New York. J. Jacko, A. Sears (Eds.).
30. Peytchev A. Survey breakoff. Public Opinion Quarterly 2009, 73:74-92.
31. Raita E., Oulasvirta A. Too good to be bad: Favorable product expectations boost subjective usability ratings. Interacting with Computers 2011, 23:363-371.
32. Rijkeboer M.M., Van den Bergh H. Multiple group confirmatory factor analysis of the Young Schema-Questionnaire in a Dutch clinical versus non-clinical population. Cognitive Therapy and Research 2006, 30:263-278.
33. Sauro J., Dumas J. Comparison of three one-question, post-task usability questionnaires. Proceedings of the 27th international conference on human factors in computing systems 2009, 1599-1608. Boston.
34. Schriver K.A. Evaluating text quality: The continuum from text-focused to reader-focused methods. IEEE Transactions on Professional Communication 1989, 32:238-255.
35. Spyridakis J.H., Wei C., Barrick J., Cuddihy E., Maust B. Internet-based research: Providing a foundation for web-design guidelines. IEEE Transactions on Professional Communication 2005, 48:242-260.
36. Tedesco D., Tullis T. A comparison of methods for eliciting post-task subjective ratings in usability testing. Usability Professionals Association (UPA) conference 2006, 1-9. Denver, Colorado.
37. Tourangeau R. Cognitive aspects of survey measurement and mismeasurement. International Journal of Public Opinion Research 2003, 15:3-7.
38. Tourangeau R., Rips L.J., Rasinski K.A. The psychology of survey response 2000, Cambridge University Press, Cambridge.
39. Tullis T., Albert B. Measuring the user experience. Collecting, analyzing, and presenting usability metrics 2008, Morgan Kaufmann Publishers Inc., San Francisco, CA.
40. Tullis S.T., Stetson J.N. A comparison of questionnaires for assessing website usability. Usability Professionals Association (UPA) Conference 2004, 7-11. Minneapolis, USA.
41. Van den Haak M.J., De Jong M.D.T., Schellens P.J. Evaluation of an informational website: Three variants of the think-aloud method compared. Technical Communication 2007, 54:58-71.
42. Van den Haak M., De Jong M., Schellens P.J. Evaluating municipal websites: A methodological comparison of three think-aloud variants. Government Information Quarterly 2009, 26:193-202.
43. Van Deursen A.J.A.M., Van Dijk J.A.G.M. Improving digital skills for the use of online public information and services. Government Information Quarterly 2009, 26:333-340.
44. Van Dijk J., Pieterson W., Van Deursen A., Ebbers W. E-services for citizens: The Dutch usage case. Lecture Notes in Computer Science 2007, 4656:155-166.
45. Van Schaik P., Ling J. Five psychometric scales for online measurement of the quality of human-computer interaction in websites. International Journal of Human Computer Interaction 2005, 18:309-322.
46. Verdegem P., Verleye G. User-centered e-government in practice: A comprehensive model for measuring user satisfaction. Government Information Quarterly 2009, 26:487-497.
47. Welle Donker-Kuijer M., De Jong M., Lentz L. Usable guidelines for usable websites? An analysis of five e-government heuristics. Government Information Quarterly 2010, 27:254-263.
48. Young J.E. Cognitive therapy for personality disorders. A schema-focused approach (revised ed.) 1994, Professional Resource Press, Sarasota, FL.
49. Zijlstra, F. (1993). Efficiency in work behavior. A design approach for modern tools. PhD Thesis, Delft University of Technology. Delft, The Netherlands: Delft University Press.