A usability evaluation toolkit for In-Vehicle Information Systems (IVISs)

Applied Ergonomics

Volumn 42, Issue 4, 2011, Pages 563-574

  Harvey, Catherine ^a   Stanton, Neville A ^a   Pickering, Carl A ^b   McDonald, Mike ^a   Zheng, Pengjun ^a  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^b JAGUAR LAND ROVER   (United Kingdom)

Author keywords

Evaluation; In Vehicle Information Systems; Usability

Indexed keywords

AUTOMOBILE DRIVERS; INFORMATION SYSTEMS; ITERATIVE METHODS; VEHICLES;

DESIGN EVALUATION; DRIVING EXPERIENCES; EVALUATION; EVALUATION METHODS; IN-VEHICLE INFORMATION SYSTEM; ITERATIVE PROCESS; USABILITY; USABILITY EVALUATION;

USABILITY ENGINEERING;

ARTICLE; CAR DRIVING; DISTRACTIBILITY; EQUIPMENT DESIGN; ERGONOMICS; EVALUATION; EYE TRACKING; IN VEHICLE INFORMATION SYSTEM; MAN MACHINE INTERACTION; PROTECTIVE EQUIPMENT; SATISFACTION; TASK PERFORMANCE; TRAFFIC SAFETY; VISUAL INFORMATION;

EID: 79551580563     PISSN: 00036870     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.apergo.2010.09.013     Document Type: Article

References (85)

1. Statement of Principles, Criteria and Verification Procedures on Driver Interactions with Advanced In-vehicle Information and Communication Systems 2006, Alliance of Automobile Manufacturers, AAM, Washington DC.
2. Amditis A., Pagle K., Joshi S., Bekiaris E. Driver-vehicle-environment monitoring for on-board driver support systems: lessons learned from design and implementation. Appl. Ergon. 2010, 41:225-235.
3. Angell L., Auflick J., Austria P.A., Kochhar D., Tijerina L., Biever W., Diptiman T., Hogsett J., Kiger S. Driver Workload Metrics Task 2 Final Report. Crash Avoidance Metrics Partnership 2006, Farmington Hills, MI.
4. Annett J. Subjective rating scales: science or art?. Ergonomics 2002, 45:966-987.
5. Annett J. Hierarchical task analysis. The Handbook of Task Analysis for Human-Computer Interaction 2004, 67-82. Lawrence Erlbaum, London. D. Diaper, N.A. Stanton (Eds.).
6. Au, F.T.W., Baker, S., Warren, I., Dobbie, G., 2008. Automated Usability Testing Framework. In: 9th Australasian User Interface Conference, Wollongong, Australia, 22-25 January, 2008.
7. Baber C., Mellor B. Using critical path analysis to model multimodal human-computer interaction. Int. J. Hum. Comput. St. 2001, 54:613-636.
8. Baber C., Stanton N.A. Human error identification techniques applied to public technology: predictions compared with observed use. Appl. Ergon. 1996, 27:119-131.
9. Baber C. Critical path analysis for multimodal activity. Handbook of Human Factors and Ergonomics Methods 2005, 41-1-41-8. CRC Press, London. N. Stanton, A. Hedge, K. Brookhuis, E. Salas, H. Hendrick (Eds.).
10. Bangor A., Kortum P.T., Miller J.T. An empirical evaluation of the system usability scale. Int. J. Hum. Comput. Int. 2008, 24:574-594.
11. Bevan N. International standards for HCI and usability. Int. J. Hum. Comput. St. 2001, 55:532-552.
12. Bhise V.D., Dowd J.D., Smid E. A Comprehensive HMI Evaluation Process for Automotive Cockpit Design 2003, SAE World Congress, Detroit, MI, March 3-6, 2003.
13. Bouchner, P., Novotný, S., Piekník, R., 2007. Objective methods for assessments of influence of IVIS (in-vehicle information systems) on safe driving. In: 4th international driving symposium on human factors in driver assessment, training and vehicle design, Stevenson, WA, 9-12 July, 2007.
14. Brooke J. SUS: a 'quick and dirty' usability scale. Usability Evaluation in Industry 1996, 189-194. Taylor and Francis, London. P.W. Jordan, B. Thomas, B.A. Weerdmeester, I.L. McClelland (Eds.).
15. Burns, P.C., Trbovich, P.L., Harbluk, J.L., McCurdie, T., 2005. Evaluating one screen/one control multifunction devices in vehicles. 19th international technical conference on the enhanced safety of vehicles, Washington, DC, 6-9 June, 2005.
16. Butler K.A. Usability engineering turns 10. Interactions 1996, 58-75.
17. Butters L.M., Dixon R.T. Ergonomics in consumer product evaluation: an evolving process. Appl. Ergon. 1998, 29:55-58.
18. Cellario M. Human-centered intelligent vehicles: toward multimodal interface integration. IEEE Intell. Trans. Syst. 2001, 16:78-81.
19. Chamorro-Koc M., Popovic V., Emmison M. Human experience and product usability: principles to assist the design of user-product interactions. Appl. Ergon. 2008, 40:648-656.
20. Cherri C., Nodari E., Toffetti A. Review of Existing Tools and Methods: AIDE Deliverable 2.1.1 2004, VTEC, Gothenburg.
21. Chiang D.P., Brooks A.M., Weir D.H. On the highway measures of driver glance behavior with an example automobile navigation system. Appl. Ergon. 2004, 35:215-223.
22. Commission Reccomendation of 26/V/2008 on Safe and Efficient In-vehicle Information and Communication Systems: Update of the European Statement of Principles on Human-Machine Interface Commission of the European Communities, Brussels 2008, Commission of the European Communities.
23. Daimon T., Kawashima H. New viewpoints for the evaluation of in-vehicle information systems: applying methods in cognitive engineering. JSAE Rev. 1996, 17:151-157.
24. Diaper D., Stanton N.A. Wishing on a sTAR: the future of task analysis. The Handbook of Task Analysis for Human-Computer Interaction 2004, 603-619. Lawrence Erlbaum, London. D. Diaper, N.A. Stanton (Eds.).
25. Doubleday, A., Ryan, M., Springett, M., Sutcliffe, A., 1997. A comparison of usability techniques for evaluating design. In: Designing Interactive Systems Conference, Amsterdam, 18-20 August, 1997.
26. Fastrez P., Haué J.-B. Editorial: designing and evaluating driver support systems with the user in mind. Int. J. Hum. Comput. St. 2008, 66:125-131.
27. Gould J.D., Lewis C. Designing for usability: key principles and what designers think. Communications of the ACM 1985, 300-311. ACM, New York. P.J. Denning (Ed.).
28. Green P., Levison W., Paelke G., Serafin C. Suggested Human Factors Design Guidelines for Driver Information Systems 1994, The University of Michigan Transportation Research Institute (UMTRI), Ann Arbor, Michigan.
29. Green, P., 1999. The 15-second rule for driver information systems. In: ITS America ninth annual meeting, Washington, DC, April, 1999.
30. Greenberg, S., Buxton, B., 2008. Usability evaluation considered harmful (some of the time). In: 26th conference on human factors in computing systems, Florence, 5-10 April, 2008.
31. Harris D., Stanton N.A., Marshall A., Young M.S., Demagalski J., Salmon P. Using SHERPA to predict design-induced error on the flight deck. Aerosp. Sci. Technol. 2005, 9:525-532.
32. Harvey, C., Stanton, N.A., Pickering, C.A., McDonald, M., Zheng, P., Context of use as a factor in determining the usability of in-vehicle devices. Theor. Issues Ergonomics Sci., in press-a.
33. Harvey, C., Stanton, N.A., Pickering, C.A., McDonald, M., Zheng, P., In-vehicle information systems to meet the needs of drivers. Int. J. Hum. Comput. Int., in press-b.
34. Hewett T.A. The role of iterative evaluation in designing systems for usability. People and Computers: Designing for Usability. Proceedings of the Second Conference of the British Computer Society Human Computer Special Interest Group 1986, University of York, 23-26 September, 1986. M.D. Harrison, A.F. Monk (Eds.).
35. Hodgkinson G.P., Crawshaw C.M. Hierarchical task analysis for ergonomics research. Appl. Ergon. 1985, 16:289-299.
36. Hornbæk K. Current practice in measuring usability. Int. J. Hum. Comput. St. 2006, 64:79-102.
37. ISO 9241. Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs) - Part 11: Guidance on Usability 1998, International Organization for Standardization.
38. Guideline for In-vehicle Display Systems, Version 3.0 2004, Japan Automobile Manufacturers Association, JAMA, Tokyo.
39. Jeffries, R., Miller, J.R., Wharton, C., Uyeda, K.M., 1991. User interface evaluation in the real world: a comparison of four techniques. In: 8th Conference on Human Factors in Computing Systems, Pittsburgh, Pennsylvania, 15-20 May, 1999.
40. Johansson E., Engström J., Cherri C., Nodari E., Toffetti A., Schindhelm R., Gelau C. Review of Existing Techniques and Metrics for IVIS and ADAS Assessment 2004, Volvo Technology Corporation, Gothenberg.
41. Johnson G.I., Clegg C.W., Ravden S.J. Towards a practical method of user interface evaluation. Appl. Ergon. 1989, 20:255-260.
42. Kantowitz B.H. Selecting measures for human factors research. Hum. Factors 1992, 34:387-398.
43. Kirwan B., Ainsworth L.K. A Guide to Task Analysis 1992, Taylor and Francis, London. first ed.
44. Kirwan B. Human error identification in human reliability assessment, part 1: overview of approaches. Appl. Ergon. 1992, 23:299-318.
45. Kontogiannis T., Embrey D. A user-centred design approach for introducing computer-based process information systems. Appl. Ergon. 1997, 28:109-119.
46. Kwahk J., Han S.H. A methodology for evaluating the usability of audiovisual consumer electronic products. Appl. Ergon. 2002, 33:419-431.
47. Landauer T.K. Behavioral research methods in human-computer interaction. Handbook of Human-Computer Interaction 1997, 203-227. Elsevier Science, Oxford. M. Helander, T.K. Landauer, P. Prabhu (Eds.).
48. Lansdown T.C. Driver visual allocation and the introduction of intelligent transport systems. P. I. Mech. Eng. D-J. Aut. 2000, 214:645-652.
49. Liu Y.-C., Bligh T., Chakrabarti A. Towards an 'ideal' approach for concept generation. Design Stud. 2003, 24:341-355.
50. Liu C.-C., Doong J.-L., Hsu C.-C., Huang W.-S., Jeng M.-C. Evidence for the selective attention mechanism and dual-task interference. Appl. Ergon. 2009, 40:341-347.
51. Lyons M. Towards a framework to select techniques for error prediction: supporting novice users in the healthcare sector. Appl. Ergon. 2009, 40:379-395.
52. McClelland I. Product assessment and user trials. Evaluation of Human Work: A Practical Ergonomics Methodology 1991, 218-247. Taylor and Francis, London. J.R. Wilson, E.N. Corlett (Eds.).
53. Nielsen J., Phillips V.L. Estimating the relative usability of two interfaces: heuristic, formal, and empirical methods compared. 11th Conference on Human Factors in Computing Systems, Amsterdam, 24-29 April, 1993 1993, S. Ashlund, K. Mullet, A. Henderson, E. Hollnagel, T. White (Eds.).
54. Nielsen, J., 1992. Finding usability problems through heuristic evaluation. In: Conference on human factors in computing systems, Monterey, California, 3-7 May, 1992.
55. Nielsen J. Usability Engineering 1993, Academic Press, London. first ed.
56. Norman D.A. Design Principles for Human Computer Interfaces. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Boston, MA, 12-15 December, 1983 1983, A. Janda (Ed.).
57. Norman D.A. The Design of Everyday Things 2002, Basic Books, New York. first ed.
58. Noy Y.I., Lemoine T.L., Klachan C., Burns P.C. Task interruptability and duration as a measure of visual distraction. Appl. Ergon. 2004, 35:207-213.
59. Pauzié, A., 2008. Evaluating driver mental workload using the driving activity load index (DALI). In: European Conference on Human Centred Design for Intelligent Transport Systems, Lyon, 3-4 April, 2008.
60. Preece J., Rogers Y., Sharp H. Interaction Design: Beyond Human-Computer Interaction 2002, John Wiley and Sons, New Jersey. first ed.
61. Rennie A.M. The application of ergonomics to consumer product evaluation. Appl. Ergon. 1981, 12:163-168.
62. Santos J., Merat N., Mouta S., Brookhuis K., de Waard D. The interaction between driving and in-vehicle information systems: comparison of results from laboratory, simulator and real-world studies. Transport. Res. F-Traf. 2005, 8:135-146.
63. Sauer J., Sonderegger A. The influence of prototype fidelity and aesthetics of design in usability tests: effects on user behaviour, subjective evaluation and emotion. Appl. Ergon. 2009, 40:670-677.
64. Sauer J., Seibel K., Rüttinger B. The influence of user expertise and prototype fidelity in usability tests. Appl. Ergon. 2010, 41:130-140.
65. Shackel B. Ergonomics in design for usability. 2nd Conference of the British Computer Society Human Computer Special Interest Group, York, 23-26 September, 1986 1986, M.D. Harrison, A.F. Monk (Eds.).
66. Shneiderman B. Designing the User Interface: strategies for Effective Human-computer Interaction 1992, Addison-Wesley, New York. second ed.
67. Stanton N.A., Baber C. Modelling of human alarm handling response times: a case study of the Ladbroke Grove rail accident in the UK. Ergonomics 2008, 51:423-440.
68. Stanton N.A., Salmon P.M. Human error taxonomies applied to driving: a generic driver error taxonomy and its implications for intelligent transport systems. Saf. Sci 2009, 47:227-237.
69. Stanton N.A., Young M.S. Is utility in the mind of the beholder? A study of ergonomics methods. Appl. Ergon. 1998, 29:41-54.
70. Stanton N.A., Young M.S. A Guide to Methodology in Ergonomics: Designing for Human Use 1999, Taylor and Francis, London. first ed.
71. Stanton N.A., Young M.S. What price ergonomics?. Nature 1999, 197-198.
72. Stanton N.A., Young M.S. Giving ergonomics away? The application of ergonomics methods by novices. Appl. Ergon. 2003, 34:479-490.
73. Stanton N.A., Young M., McCaulder B. Drive-by-wire: the case of driver workload and reclaiming control with adaptive cruise control. Saf. Sci 1997, 27:149-159.
74. Stanton N.A., Salmon P.M., Walker G.H., Baber C., Jenkins D.P. Human Factors Methods: A Practical Guide for Engineering and Design 2005, Ashgate, Aldershot. first ed.
75. Stanton N.A. Hierarchical task analysis: developments, applications, and extensions. Appl. Ergon. 2006, 37:55-79.
76. Stevens A., Board A., Allen P., Quimby A. A Safety Checklist for the Assessment of In-vehicle Information Systems: A User's Manual 1999, Transport Research Laboratory, London.
77. Stevens A., Quimby A., Board A., Kersloot T., Burns P. Design Guidelines for Safety of In-vehicle Information Systems 2002, Transport Research Laboratory, London.
78. Sweeney M., Maguire M., Shackel B. Evaluating user-computer interaction: a framework. Int. J. Man Mach. Stud. 1993, 38:689-711.
79. Statement of Principles of Good Practice Concerning the Ergonomics and Safety of In-vehicle Information Systems 2003, The European Conference of Ministers of Transport, ECMT, Leipzig.
80. Victor T.W., Engström J., Harbluk J.L. Distraction assessment methods based on visual behavior and event detection. Driver Distraction: Theory, Effects and Mitigation 2009, 135-165. CRC Press, Florida. M.A. Regan, J.D. Lee, K.L. Young (Eds.).
81. Walker G.H., Stanton N.A., Young M.S. Hierarchical task analysis of driving: a new research tool. Contemporary Ergonomics 2001 2001, 435-440. Taylor and Francis, London. M. Hanson (Ed.).
82. Wickens C.D. Processing resources and attention. Multiple-task Performance 1991, 3-34. Taylor and Francis, London. D.L. Damos (Ed.).
83. Wittmann M., Kiss M., Gugg P., Steffen A., Fink M., Pöppel E., Kaniya H. Effect of display position of a visual in-vehicle task on simulated driving. Appl. Ergon. 2006, 37:187-199.
84. Young K.L., Regan M.A., Lee J.D. Measuring the effects of driver distraction: direct driving performance methods and measures. Driver Distraction: Theory, Effects and Mitigation 2009, 85-105. CRC Press, Florida. M.A. Regan, J.D. Lee, K.L. Young (Eds.).
85. Young K.L., Lenné M.G., Williamson A.R. Sensitivity of the lane change test as a measure of in-vehicle system demand. Appl. Ergon 2011, 42:611-618.