A comparison of usability testing methods for an e-commerce website: A case study on a Malaysia online gift shop

Proceedings of the 2013 10th International Conference on Information Technology: New Generations, ITNG 2013

Volumn , Issue , 2013, Pages 143-150

  Goh, K N ^a   Chen, Y Y ^a   Lai, F W ^a   Daud, S C ^a   Sivaji, A ^b   Soo, S T ^b  

^a DEPARTMENT OF CHEMICAL ENGINEERING   (Malaysia)

^b Technology Park Malaysia   (Malaysia)

Author keywords

Evaluation method; eye tracking; observation; retrospective think aloud; usability testing

Indexed keywords

EVALUATION METHOD; EYE-TRACKING; OBSERVATION; THINK ALOUD; USABILITY TESTING;

ELECTRONIC COMMERCE; EYE MOVEMENTS; INFORMATION TECHNOLOGY; TESTING; USER INTERFACES; VISUAL LANGUAGES;

WEBSITES;

EID: 84886695319     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ITNG.2013.129     Document Type: Conference Paper

References (26)

1. PayPal: Online Shopping Hits 1.8 Billion. (2011). Retrieved from http://marketing-interactive.com/news/25946
2. Li, F. and Li, Y. (2011). Usability evaluation of e-commerce on B2C websites in China, Procedia Engineering, 15, 5299-5304.
3. Sivaji, A., Mazlan, M. F., Soo, S. T., Abdullah, A., & Downe, A. G. (2011). Importance of Incorporating Fundamental Usability with Social, Trust & Persuasive Elements for E-Commerce Website, IEEEXplore Business, Engineering and Industrial Applications (ICBEIA), pp. 221-226.
4. Bevan, N. (2008). Classifying and selecting UX and usability measures, Proceedings of Meaningful Measures: Valid Useful User Experience Measurement (VUUM), 5th COST294-MAUSE Open Workshop, 18th June 2008, Reykjavik, Iceland
5. Kim, D.J., Ferrin, D. L. and Rao, H. R. (2009).Trust and Satisfaction, Two Stepping Stones for Successful E-Commerce Relationships: A Longitudinal Exploration, Journal Information Systems Research, 20(2), pp. 237-257.
6. Tezza, R., Bornia, A.C. and Andrade, D. F. (2011). Measuring web usability using item response theory: Principles, features and opportunities, Journal Interacting with Computers, 23(2), pp. 167-175.
7. Offutt, J. (2002). Quality attributes of Web software applications, in: IEEE Software:Special Issue on Software Engineering of Internet Software, pp. 25-32.
8. Oneupweb. (2010). Revolutionizing Website Design. Retrieved from: http://www.oneupweb.com
9. Shi, M. (2011). Website Characteristics And Their Influences: A Review On Web Design, Association of Business Information Systems (ABIS) Refereed Proceedings. Retrieved from http://www.abis-fbd.org/wp-content/uploads/2011/03/ ABIS-2011-Proceedings.pdf#page=147
10. Papadopoulou, P. and Pelet, J. (2009).The effect of colors of e-commerce websites on consumer mood, memorization and buying intention, MCIS 2009 Proceedings. Paper 116.
11. Kamoun, F. and Halaweh, M. (2012). User Interface Design and E-Commerce Security Perception: An Empirical Study, E-business Research, 8(2).
12. Fernandez, A., Insfran, E. and Abrahao, S. (2011).Usability evaluation methods for the web: A systematic mapping study, Information and Software Technology, 53, pp. 789-81.
13. Sauro, J. Why you only need to test with five users (explained) (2010) Retrieved from http://www.measuringusability.com/five-users.php
14. Sivaji, A., Mohd Nor, Z. and Downe, A. G. (2011). Comparison of the Lab Based Usability Testing and Exploratory Heuristic Evaluation: A Case Study on Human Factor Conference Website Usability. Malaysian Journal of Ergonomics, pp. 57-71.
15. Pernice, K. and Nielsem,J, (2009). How to conduct eye tracking studies, 20, 51 Retrieved from http://nngroup.com.s3.amazonaws.com/media/reports/free/ How-to-Conduct-Eyetracking-Studies.pdf
16. Sivaji, A. and Soo, S. T. (2012). Website User Experience (UX) Testing Tool Development using Open Source Software (OSS). In press IEEEXplore, 2nd South East Asian Network of Ergonomics Societies (SEANES), Malaysia.
17. van den Haak, M. J., DeJong, M. D. T. and Schellens, P. J. (2010). Retrospective vs. concurrent think-aloud protocols: testing the usability of an online library catalogue. Behaviour & Information Technology, 22 (5), pp. 339-351.
18. Yu, B. and Voll, K. (2011). Probing student problem solving skills in mathematical induction using a scenario based think aloud protocol. Proceedings of the 16th Western Canadian Conference on Computing Education (WCCCE '11), pp. 33-37.
19. Sivaji, A. and Wan Ahmad, W. F. (2012). Benefits of complementing Eye Tracking analysis with Think Aloud protocol in a multilingual country with high power distance (Hofstede's model) for website user experience testing. In press Current Themes in Eye Tracking Research: Method and Application.
20. Clemmensen, T., Hertzum, M., Hornbaek, K., Shi, Q. and Yammiyavar, P. (2008). Cultural Cognition in the Thinking-Aloud Method for Usability Evaluation. Journal Interacting with Computers, 21 (3), pp. 212-22
21. Elling, S., Lentz, L. and de Jong, M. (2011). Retrospective think-aloud method: using eye movements as an extra cue for participants' verbalizations. Proceedings of the 2011 annual conference on Human factors in computing systems (CHI '11), pp. 1161-1170.
22. Ball, L. J., Eger, N., Stevens, R. and Dodd, J. (2006). Applying the PEEP method in usability testing. Interfaces, 67, pp. 15-19
23. Ehmke, C. and Wilson, S. (2007). Identifying web usability problems from eye-tracking data. Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it, 1, pp. 119-128.
24. Goldberg, J. H. and Kotval, X. P. (1999). Computer interface evaluation using eye movements: Methods and constructs, International Journal of Industrial Ergonomics, 24(6), pp. 631-645.
25. Poole, A. and Ball, L. J. (2005). Eye tracking in human-computer interaction and usability research. Encyclopedia of human computer interaction. Idea Group, Pennsylvania, pp. 211-219
26. Baauw, E. and Markopoulous, P. (2004). A comparison of think aloud and post-task interview for usability testing with children. Proceedings of the 2004 conference on Interaction design and children: building a community (IDC '04), pp. 115-116.