Meta-analysis of correlations among usability measures

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2007, Pages 617-626

  Hornbæk, Kasper ^a   Law, Effie Lai Chong ^b  

^a UNIVERSITY OF COPENHAGEN   (Denmark)

^b ETH ZURICH   (Switzerland)

Author keywords

ISO 9241; Meta analysis; Subjective satisfaction; Usability evaluation; Usability measures

Indexed keywords

COMPUTATIONAL COMPLEXITY; CORRELATION METHODS; ERROR ANALYSIS; METADATA;

META ANALYSIS; SUBJECTIVE SATISFACTION; USABILITY EVALUATION; USABILITY MEASURES;

USER INTERFACES;

EID: 35348895123     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1240624.1240722     Document Type: Conference Paper

References (31)

1. Arnold, H. J. & Feldman, D. C. Social Desirability Response Bias in Self-Report Choice Situations, Academy of Management Journal, 24 (1981), 377-385.
2. Bailey, R. Performance vs. Preference, Proc. HFES 1993, 282-286.
3. Bevan, N. Measuring Usability As Quality of Use, Software Quality Journal, 4 (1995), 115-150.
4. Chin, J. P., Diehl, V. A., & Norman, K. L. Development of an Instrument for Measuring User Satisfaction of the Human-Computer Interface, Proc. CHI '88, 213-218.
5. Cohen, J. Statistical Power Analysis for the Behavioral Sciences, Lawrence Erlbaum Associates, 1969.
6. Cronbach, L. J. Coefficient Alpha and the Internal Structure of Tests, Psychometrika, 16 (1951), 297-333.
7. Czerwinski, M., Horvitz, E., & Cutrell, E. Subjective Duration Assessment: An Implicit Probe for Software Usability? Proc. IHM-HCI2001, (2001), 167-170.
8. Douglas, S. A., Kirkpatrick, A. E., & MacKenzie, I. S. Testing Pointing Device Performance and User Assessment with the ISO 9241, Part 9 Standard, Proc. CHI'99, 215-222.
9. Frøkjær, E., Hertzum, M., & Hornbæk, K. Measuring Usability: Are Effectiveness, Efficiency, and Satisfaction Really Correlated? CHI2000, 345-352.
10. Glass, G., McGaw, B., & Lee Smith, M. Meta-Analysis in Social Research, Sage Publications, 1981.
11. Hart S. & Staveland, L., Development of NASA-TLX, in Hancock & Meshkati Human Mental Workload, Elsevier, 1988, 139-183.
12. Hassenzahl, M. & Tractinsky, N. User Experience - a Research Agenda, Behaviour & Information Technology, 25, 2 (2006), 91-99.
13. Hornbæk, K. Current Practice in Measuring Usability: Challenges to Usability Studies and Research, International Journal of Human-Computer Studies, 64, 2 (2006), 79-102.
14. Hunter, J. & Schmidt, F. Methods of Meta-Analysis: Correcting Error and Bias in Research Findings, Sage Publications, Thousand Oaks, CA, 2004.
15. ISO Ergonomie Requirements for Office Work With Visual Display Terminals (VDTs)-Part 11: Guidance on Usability, 1998.
16. Kindlund, E. & Sauro, J. A Method to Standardize Usability Metrics into a Single Score, Proc. CHI 2005, 401-409.
17. Kissel, G. The Effect of Computer Experience on Subject and Objective Software Usability Measures, Proc. CHI'95, (1995), 284-285.
18. Lewis, J. IBM Computer Usability Satisfaction Questionnaires: Psychometric Evaluation and Instructions for Use, International Journal of Human-Computer Interaction, 7, 1 (1995), 57-78.
19. Lipsey, M. & Wilson, D. Practical Meta-Analysis, Sage Publications, Thousand Oaks, CA, 2000.
20. McGee, M. Master Usability Scaling: Magnitude Estimation and Master Scaling Applied to Usability Measurement, Proc. CHI2004, 335-342.
21. McGee, M., Rich, A., & Dumas, J. Understanding the Usability Construct: User-Perceived Usability, Proc. HFES'2004, 907-911.
22. Newman, W. & Taylor, A. Towards a Methodology Employing Critical Parameters to Deliver Performance Improvements in Interactive Systems, Proc. INTERACT'99, 605-612.
23. Nielsen, J. & Levy, J. Measuring Usability: Preference Vs. Performance, Comm. ACM, 37, 4 (1994), 66-75.
24. Rasmussen, J. Skills, Rules, and Knowledge: Signals, Signs, and Symbols, and Other Distinctions in Human Performance Models, IEEE Transactions on Systems, Man, and Cybernetics, SMC-13, 3 (1983), 257-266.
25. Rosenthal, R. Meta-Analytic Procedures for Social Research, Sage Publications, Newbury Park, CA, 1991.
26. Seffah, A., Donyaee, M., Kline, R., & Padda, H. Usability Measurement and Metrics: A Consolidated Model, Software Quality Journal, 14 (2006), 159-178.
27. Shackel B., Usability - Context, Framework, Definition, Design and Evaluation, in Human Factors for Informatics Usability, 1991, 21-38.
28. Shneiderman, B. & Plaisant, C. Designing the User Interface: Strategies for Effective Human-Computer Interaction, Addison Wesley, Boston, MA, 2005.
29. Taylor, S. & Todd, P. Assessing IT Usage: the Role of Prior Experience, MIS Quarterly, Dec. (1995), 561-570.
30. Weisband, S. & Kiesler, S. Self Disclosure on Computer Forms: Meta-Analysis and Implications, Proc. CHI 1996, 3-10.
31. Yeh, Y.-Y. & Wickens, C. D. Dissociation of Performance and Subjective Measures of Workload, Human Factors, 30, 1 (1988), 111-120.