Performance-based usability evaluation of a safety information and alarm system

International Journal of Human Computer Studies

Volumn 63, Issue 3, 2005, Pages 328-361

  Norros, Leena ^a   Nuutinen, Maaria ^a  

^a VTT TECHNICAL RESEARCH CENTRE OF FINLAND   (Finland)

Author keywords

Control room; Information presentation; Nuclear power plant; Operators; Practice; Validation method

Indexed keywords

ACCIDENT PREVENTION; ALARM SYSTEMS; COGNITIVE SYSTEMS; CONTROL ROOMS (POWER PLANTS); INFORMATION RETRIEVAL; INTEGRATION; NUCLEAR POWER PLANTS; PROCESS CONTROL; SAFETY TESTING; STRESS ANALYSIS;

HABIT-CENTRED ANALYSIS; MEASURING SYSTEMS; SAFETY INFORMATION AND ALARM PANEL (SIAP); SHIFT SUPERVISORS;

INFORMATION RETRIEVAL SYSTEMS;

EID: 23044468708     PISSN: 10715819     EISSN: 10959300     Source Type: Journal    
DOI: 10.1016/j.ijhcs.2005.03.004     Document Type: Article

References (81)

1. L. Bannon Situating workplace studies within the human-computer interaction field P. Luff J. Hindmarsh Ch. Heath Workplace Studies. Recovering Work Practice and Informing System Design 2000 Cambridge University Press Cambridge, UK 230 241
2. L. Bannon, and V. Kaptelinin From human-computer interaction to computer-mediated activity C. Stephanidis User Interfaces for All: Concepts, Methods, and Tools 2000 Lawrence Erlbaum Mahwah, NJ 183 202
3. Beguin, P., Kazmierczak, M., Cottura, R., Leininger, J., Vicot, P., 1999. Design of an alarm and risk management system in chemistry. Some lessons learned from interdisciplinary research. Presented at Human Error, Safety, and Systems Development, Liege, Belgium.
4. Bove, T., Andersen, H.B., 1999. The effect of advisory system on pilots go/no-go decision during take off. Presented at Human Error, Safety, and Systems Development, Liege, Belgium.
5. J.M. Carrol Human-computer interaction: psychology as a science of design International Journal of Human-Computer Studies 46 1997 5105 5122
6. T. Cook, and D. Campbell Quasi-experimentation: Design and Analysis Issues for Field Settings 1979 Houghton Mifflin Boston, MA
7. W.R. Corcoran, N.J. Porter, J.F. Church, M.T. Cross, and W.M. Guinn The critical safety functions and plant operation Nuclear Technology 55 1981 690 712
8. F. Decortis, S. Noirfalise, and B. Saudelli Activity theory, cognitive ergonomics and distributed cognition: three views of a transport company International Journal of Human-Computer Studies 53 2000 5 33
9. Y. Engeström Expansive Learning 1987 Orienta Jyväskylä
10. Y. Engeström Activity theory and individual and social transformation Y. Engeström R. Miettinen R.-L. Punamäki Perspectives in Activity Theory 1999 Cambridge University Press Cambridge 19 38
11. J. Flach, P. Hancock, J. Caird, and K.J. Vicente Global Perspectives on the Ecology of Human-Machine Systems 1995 Lawrence Erlbaum Hillsdale, NJ
12. C.A. Halverson Activity theory and distributed cognition: or what does CSCW need to do with theories Computer Supported Cooperative Work 11 2002 243 267
13. K.R. Hammond Naturalistic decision making from a Brunswikian viewpoint: its past, present, future G.A. Klein J. Orasanu R. Calderwood C. Zambok Decision Making in Action: Models and Methods 1993 Ablex Norwood, NJ
14. J.-M. Hoc Towards a cognitive approach to human-machine cooperation in dynamic situations International Journal of Human-Computer Studies 54 2001 509 540
15. J.-M. Hoc, R. Amalberti, and N. Boreham Human operator expertise in diagnosis, decision making and time management J.-M. Hoc P.C. Cacciabue E. Hollnagel Expertise and Technology. Cognition & Human-computer Cooperation 1995 Lawrence Erlbaum Hillsdale, NJ 19 42
16. J. Hollan, E. Hutchins, and D. Kirsch Distributed cognition: toward a new foundation for human- computer interaction research AMC Transactions on Computer-Human Interaction 7 2 2000 174 196
17. E. Hollnagel Handbook of Cognitive Task Design 2003 Lawrence Erlbaum Mahwah, NJ
18. J. Holmberg, K. Hukki, L. Norros, U. Pulkkinen, and P. Pyy An integrated approach to human reliability analysis. Decision analytic dynamic reliability model Reliability Engineering and System Safety 65 1999 239 250
19. K. Hukki, and L. Norros Diagnostic judgement in the control of disturbance situations in Nuclear Power Plant Operation Ergonomics 36 11 1993 1317 1328
20. K. Hukki, and L. Norros Subject-centred and systemic conceptualisation as a tool of simulator training Le Travail Humain 1998 313 331
21. E. Hutchins Cognition in the Wild 1995 MIT Press Cambridge
22. IEC-9064. 1989. Design for control rooms of nuclear power plants. IEC.
23. E. Ilyenkov Dialectical Logic: Essays on its History and Theory 1977 Progress Moscow
24. E. Ilyenkov Learning to Think 1984 Tutkijaliitto Helsinki (in Finnish)
25. Jeanton, G., 2003. Electricite de France organisation and process concerning modifications of nuclear plants. Presented at Modifications at Nuclear Power Plants, Paris, pp. 1-7.
26. Kautto, A., 1984. Information presentation in power plant control rooms. Report RR 320, Technical Research Centre of Finland, Espoo.
27. B. Kirwan Design process and human-system interfaces. Presented at International Summer School on Design and Evaluation of Human-System Interfaces 2003 Halden Norway pp. 1-26
28. U.-M. Klemola, and L. Norros Analysis of the clinical behaviour of anaesthetists: recognition of uncertainty as basis for practice Medical Education 31 1997 449 456
29. U.-M. Klemola, and L. Norros Practice-based criteria for assessment the anaesthetists' habits of action. Outline for a reflexive turn in practice Medical Education 35 2001 455 464
30. T. Kontogiannis Sress and operator decision making in coping with emergencies International Journal of Human-Computer Studies 45 1996 75 104
31. J. Lee, and N. Moray Trust, self confidence, and operators' adaptation to automation International Journal of Human-Computer Studies 40 1 1994 153 184
32. A.N. Leont'ev Activity, Consciousness, and Personality 1978 Prentice-Hall Englewood Cliffs, NJ
33. P. Luff, and C. Heath The collaborative production of computer commands in command control International Journal of Human-Computer Studies 52 2000 669 699
34. A. MacIntyre After Virtue: Study in Moral Theory 1984 University of Notre Dame Press Notre Dame, IN
35. Miberg-Skjerve, A.B., Skraaning, G., 2003. A classification of validation criteria for new operational design concepts in nuclear process control. Presented at NEA/CSNI Workshop on Modifications at Nuclear Power Plants, Paris, France.
36. R.J. Mumaw, E.M. Roth, K.J. Vicente, and C.M. Burns There is more to monitoring a nuclear power plant than meets the eye Human Factors 42 1 2000 36 55
37. S. Mustonen SURVO: An Integrated Environment for Statistical Computing and Related Areas 1992 Survo Systems Helsinki
38. N. Naikar, B. Pearce, D. Drumm, and P.M. Sanderson Designing teams for first-of-a-kind, complex systems using the initial phases of cognitive work analysis: case study Human Factors 45 2 2002 2022 2217
39. Naser, J., Hanes, L., O'Hara, J., Fink, R., Hill, D., Morris, G., 2003. Guidelines for control room modernisation as part of instrument and control modernisation programs. Presented at Modifications at Nuclear Power Plants, Paris, pp. 1-10.
40. J. Nielsen Usability Engineering 1993 Academic Press Boston, MA
41. L. Norros An orientation-based approach to expertise J.-M. Hoc P.C. Cacciabue E. Hollnagel Cognition and Human-Computer Co-operation 1995 Lawrence Erlbaum Hillsdale, NJ 137 160
42. Norros, L., 1997. Human factors in NPP operations. RETU The Finnish research programme on reactor safety. Interim Report 1995 May 1997, Report VTT Research Notes 1856, Espoo.
43. L. Norros Acting under Uncertainty. The Core-Task Analysis in Ecological Study of Work 2004 VTT Espoo
44. Norros, L., Hukki, K., 1995. Contextual analysis of the operators' on-line interpretations of process dynamics. Presented at Proceedings of Fifth European Conference on Cognitive Science Approaches to Process Control, Espoo, pp. 182-195.
45. Norros, L., Hukki, L., 1997. Analysis of control room operators' ways of acting in complex process control situations. Presented at the 13th Triennial Congress of the International Ergonomic Association, Tampere, Finland, pp. 61-63.
46. L. Norros, and U.-M. Klemola Naturalistic analysis of anaesthetists' clinical practice H. Montgomery R. Lipshitz B. Brehmer How Professionals Make Decisions 2005 Lawrence Erlbaum Mahwah, NJ
47. L. Norros, and M. Nuutinen The concept of the core task and the analysis of working practices N. Boreham R. Samurcay M. Fischer Work process knowledge 2002 Routledge London 25 39
48. Norros, L., Sammatti, P., 1986. Nuclear power plant operator errors during simulator training. Research Report 446, Technical Research Centre of Finland, Espoo.
49. Norros, L., Savioja, P., 2004. Usability evaluation of complex systems. A literature review. Report STUK-YTO-TR 204, Radiation and Nuclear Safety Authority, Helsinki.
50. Nuutinen, M., 2003. The change of personnel generation as a challenge of safety critical work: Operator trainee as an apprentice or an inquiring learner? (In Finnish, English abstract) Työ ja ihminen 17(2), 173-189.
51. Nuutinen, M., Norros, L., 2001. Co-operation on bridge in piloting situations. Analysis of 13 accidents on Finnish Fairways. In: Onken, R. (Ed.), The Cognitive Work Process: Automation and Interaction. Proceedings of the Eighth Conference on Cognitive Science Approaches to Process Control. European Association of Cognitive Ergonomics, Munich, pp. 3-14.
52. Nuutinen, M., Reiman, T., Oedewald, P., 2003. Osaamisen hallinta ydinvoimalaitoksessa operaattoreiden sukupolvenvaihdostilanteessa (Management of operators' competence and change of generation at NPP), VTT Publications No. 496. VTT, Espoo.
53. P. Oedewald, and T. Reiman Core task modeling in cultural assessment: a case study in nuclear power plant maintenance Cognition, Technology & Work 5 2003 283 293
54. O'Hara, J., 2003. Overview of different types of control rooms and their human system interface solutions. Presented at International Summer School on Design and Evaluation of Human System Interfaces, Halden, Norway, 3/1-28.
55. J. O'Hara, J. Higgins, J. Persensky, P. Lewis, and J. Bongarra Human factors engineering program review model. Report NUREG-0711 2002 United States Regulatory Commission Washington, DC
56. J.M. O'Hara A quasi-experimental model of complex human-machine system validation Cognition, Technology & Work 1 1 1999 37 46
57. Östlund, A.M., 2003. Säkerheten i fokus i det nya kontrollrummet. In Nucleus, ed. pp. 26-29.
58. Papin, B., 2002. Integration of human factors requirements in the design of future plants. Presented at Enlarged Halden Programme Group Meeting, Storefjell, C3/1/-10.
59. C.S. Peirce Letters to Lady Welby P. Wiener Selected Writings of C.C. Peirce 1958 Dover Publications New York 380 432
60. Peirce, C.S., 1998a. The Harvard lectures on pragmatism. In: The Peirce Edition Project (Ed.), The Essential Peirce. Selected Philosophical Writings. Indiana University Press, Bloomington and Indianapolis, pp. 133-241.
61. Peirce, C.S., 1998b. The Peirce Edition Project. Introduction. In: The Peirce Edition Project, (Ed.), The Essential Peirce. Selected Philosophical Writings. Indiana University Press, Bloomington and Indianapolis, pp. XVII- XXXVIII.
62. Pirus, D., 2002. Computerized operation using formal plant functional breakdown. Presented at Enlarged Halden Programme Group Meeting, Storefjell, C3/8/1-8.
63. Pirus, D., 2003a. Functional analysis - Operating functions Report, Electricité de France, Septen, France.
64. Pirus, D., 2003b. Human-system interfaces. Types and principles. Presented at International summer school on Design and Evaluation of Human-System Interfaces, Halden, 9/1-69.
65. Quentin, L., Niger, D., 2003. Taking into account of socio-organisational and human aspects into upgrade packages. Presented at Modifications at Nuclear Power Plants, Paris, pp. 1-10.
66. Rasmussen, J., 1986. Information Processing and Human-Machine Interaction. North-Holland, Amsterdam.
67. J. Rasmussen, and I. Svedung Proactive risk management in a dynamic society 2000 Swedish Rescue Services Karlstad
68. T. Reiman, and L. Norros Regulatory culture: balancing the different demands on the regulatory practice in nuclear industry A.R. Hale A. Hopkins B. Kirwan Changing Regulation - Controlling Hazards in Society 2002 Elsevier Amsterdam
69. W.B. Rouse Design for Success - A human-centered approach to designing successful products and systems 1991 Wiley New York
70. Savioja, P., Norros, L., 2004. Artefact performance evaluation. A preliminary framework. Report BTUO62-041223, Technical Research Centre of Finland, Espoo.
71. P.R. Schulman The analysis of high reliability organisations: a comparative framework K.H. Roberts New Challenges to Understanding Organisations 1993 Macmillan New York 33 53
72. L.A. Suchman Plans and Situated Actions: The Problem of Human-Machine Communication 1987 Cambridge University Press New York
73. Theureau, J., 1996. Course of action analysis and ergonomic design. Presented at Work and Learning in Transition, San Diego, pp. 1-29.
74. J. Theureau, and G. Filippi Analysing cooperative work in an urban traffic control room for the design of a coordination support system P. Luff J. Hindmarsh Ch. Heath Work Place Studies. Recovering Work Practice and Informing System Design 2000 Cambridge University Press Cambridge, UK 68 91
75. K.J. Vicente Cognitive Work Analysis. Toward a Safe, Productive, and Healthy Computer-Based Work 1999 Lawrence Erlbaum Mahwah, NJ
76. K.J. Vicente, E. Roth, and R.J. Mumaw How do operators monitor a complex, dynamic work domain? The impact on control room technology International Journal of Human-Computer Studies 54 2001 831 856
77. G.H. Von Wright Explanation and Understanding 1971 Routledge and Kegan Paul London
78. G.H. Von Wright In the Shadow of Descart. Essays in the Philosophy of Mind 1998 Kluwer Dordrecht
79. L.S. Vygotsky Mind in Society. The Development of Higher Psychological Processes 1978 Harvard University Press Cambridge, MA
80. C. Zambok Naturalistic decision making: where are we now? C. Zambok G.A. Klein Naturalistic Decision Making 1997 Lawrence Erlbaum Hillsdale, NJ
81. S. Zuboff In the Age of the Smart Machine. The Future of Work and Power 1988 Basic Books New York