Development of a team workload assessment technique for the main control room of advanced nuclear power plants

Human Factors and Ergonomics In Manufacturing

Volumn 21, Issue 4, 2011, Pages 397-411

  Lin, Chiuhsiang Joe ^a   Hsieh, Tsung Ling ^a   Tsai, Ping Jung ^a   Yang, Chih Wei ^b   Yenn, Tzu Chung ^b  

^a CHUNG YUAN CHRISTIAN UNIVERSITY   (Taiwan)

^b INSTITUTE OF NUCLEAR ENERGY RESEARCH   (Taiwan)

Author keywords

Advanced nuclear power plant; Main control room; Team Workload Assessment; Teamwork; Workload

Indexed keywords

ADVANCED NUCLEAR POWER PLANTS; MAIN CONTROL ROOM; TEAM WORKLOAD ASSESSMENT; TEAMWORK; WORKLOAD;

CONTROL ROOMS (POWER PLANTS); HUMAN ENGINEERING; NASA; NUCLEAR POWER PLANTS; SURVEYS;

RATING;

EID: 79957967640     PISSN: 10908471     EISSN: 15206564     Source Type: Journal    
DOI: 10.1002/hfm.20247     Document Type: Article

References (92)

1. Ameersing, L., &, Ravindra, S., (2001). Simplified subjective workload assessment technique. Ergonomics, 44 (3), 229-243.
2. Bagozzi, R. P., &, Yi, Y., (1988). On the evaluation for structural equation models. Journal of the Academy of Marketing Science, 16 (1), 74-94.
3. Bowers, C. A., Braun, C. C., &, Morgan, B. B., (1997). Team workload: Its meaning and measurement. In, M. T. Brannick, E. Salas, &, C. Prince, (Eds.), Team performance assessment and measurement: Theory, methods, and applications (pp. 85-108) Mahwah, NJ: Erlbaum.
4. Bowers, C. A., Urban, J. M., &, Morgan Jr., B. B., (1992). The study of crew coordination and performance in hierarchical team decision making (Team Performance Laboratory Tech.Rep. No. 92-1). Orlando, FL: University of Central Florida.
5. Cannon-Bowers, J. A., Oser, R., &, Flanagan, D., (1992). Work teams in industry: A selected review and proposed framework. In, R. W. Swezy, &, E. Salas, (Eds.), Teams: Their training and performance Norwood, NJ: Ablex.
6. Cannon-Bowers, J. A., Tannenbaum, S. I., Salas, E., &, Volpe, C. E., (1995). Defining team competencies and establishing team training requirements. In, R. Guzzo, &, E. Salas, (Eds.), Team effectiveness and decision making in organizations (pp. 333-380) San Francisco: Jossey-Bass.
7. Carvalho, P. V. R., Dos Santos, I. L., Gomes, J. O., Borges, M. R. S., &, Guerlain, S., (2008). Human factors approach for evaluation and redesign of human-system interfaces of a nuclear power plant simulator. Displays, 29, 273-284. (Pubitemid 351467724)
8. Charlton, S. G., (2002). Measurement of cognitive states in test and evaluation. In, S. G. Charlton, &, T. G. O'Brien, (Eds.), Handbook of human factors testing and evaluation (pp. 97-126) Mahwah, NJ: Lawrence Erlbaum Associates.
9. Chiocchio, F., (2007). Project team performance: A study of electronic task and coordination communication. Project Management Journal, 38, 97-109.
10. Chuang, C. F., &, Chou, H. P., (2006). Investigation on the Design of Human-System Interface for Advanced Nuclear Plant Control Room, 5th International Topical Meeting on Nuclear Plant Instrumentation Control and Human Machine Interface Technology (NPIC & HMIT 2006), Nov. 12-16, Albuquerque, NM, USA.
11. Denison, D. R., Hart, S. L., &, Kahn, J. A., (1996). From chimneys to cross-functional teams: Developing and validating a diagnostic model. The Academy of Management Journal, 39, 1005-1026.
12. DeVellis, R. F., (1991). Scale development: Theory and application. Newbury Park, CA: Sage.
13. Dickinson, T. L., &, McIntyre, R. M., (1997). A conceptual framework for teamwork measurement. In, M. T. Brannick, E. Salas, &, C. Prince, (Eds.), Team performance assessment and measurement: Theory, methods and applications (pp. 19-45) Mahwah, NJ: Erlbaum.
14. Entin, E. E., &, Serfaty, D., (1999). Adaptive team coordination. Human Factors, 41, 312-325. (Pubitemid 29330654)
15. Farmer, E., &, Brownson, A., (2003). Review of workload measurement, analysis and interpretation methods (No. CARE-integra-TRS-130-02-WP2).
16. Ford, J. K., &, Schmidt, A. M., (2000). Emergency response training: Strategies for enhancing real-world performance. Journal of Hazardous Materials, 75, 195-215. (Pubitemid 30320948)
17. Fornell, C., &, Larcker, D. F., (1981). Evaluating structural equation models with unobservable and measurement errors. Journal of Marketing Research, 18 (1), 39-50.
18. Furuta, K., Shimada, T., &, Kondo, S., (1999). Behavioral simulation of a nuclear power plant operator crew for human-machine system design. Nuclear Engineering and Design, 188, 97-109.
19. Gay, L. R., (1992). Educational research: Competencies for analysis and application (4th ed.). New York: Macmillan.
20. Glickman, A. S., Zimmer, S., Montero, R. C., Guerette, P. J., Campbell, W. J., Morgan, B. B., et al. (1987). The evolution of teamwork skills: An empirical assessment with implications for training (NTSC Tech. Rep. No. TR-87-016). Orlando, FL: Naval Training Systems Center.
21. Goodman, P. S., Ravlin, E. C., &, Argote, L., (1986). Current thinking about groups: Setting the stage for new ideas. In, P. S. Goodman, (Ed.), Designing effective work groups (pp. 1-33) San Francisco: Jossey-Bass.
22. Gopher, D., &, Braune, R., (1984). On the psychophysics of workload: Why bother with subjective measures ? Human Factors, 26, 519-532. (Pubitemid 15167952)
23. Gorsuch, R. L., (1997). Exploratory factor analysis: Its role in item analysis. Journal of Personality Assessment, 68 (3), 532-560. (Pubitemid 27218206)
24. Ha, J. S., Seong, P. H., Lee, M. S., &, Hong, J. H., (2007). Development of human performance measures for human factors validation in the advanced MCR of APR-1400. IEEE Transactions on Nuclear Science, 54 (6), 2687-2700. (Pubitemid 350274136)
25. Hallbert, B. P., Sebok, A., Morisseau, D. S., &, Persensky, J. J., (1997). Effects of advanced plant design features and control room staffing on operator and plant performance. IEEE Conference on Human Factors and Power Plants, 5.7-5.12.
26. Hancock, P. A., Mihaly, T., Rahimi, M., &, Meshkati, N., (1988). A bibliographic listing of mental workload research. In, P. A. Hancock, &, N. Meshkati, (Eds.), Human mental workload New York: North-Holland.
27. Hart, S. G., &, Staveland, L. E., (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In, P. A. Hancock, &, N. Meshkati, (Eds.), Human mental workload, Amsterdam: North-Holland.
28. Hill, S. G., Iavecchia, H. P., Byers, J. C., Bittner Jr., A. C., Zaklad, A. L., &, Christ, R. E., (1992). Comparison of four subjective workload rating scales. Human Factors, 34 (4), 429-439.
29. Hoc, J. M., (1988). Cognitive psychology of planning. London: Academic Press.
30. Huang, F. H., &, Hwang, S. L., (2009). Experimental studies of computerized procedures and team size in nuclear power plant operations. Nuclear Engineering and Design, 239, 373-380.
31. Huey, B. M., &, Wickens, C. D., (1993). Workload transition: Implications for individual and team performance. Washington, DC: National Academies Press.
32. Hwang, S. L., Yau, Y. J., Lin, Y. T., Chen, J. H., Huang, T. H., Yenn, T. C., et al. (2008). Predicting work performance in nuclear power plants. Safety Science, 46, 1115-1124.
33. Johnston, J. A., Smith-Jentsch, K. A., &, Cannon-Bowers, J. A., (1997). Performance measurement tools for enhancing team decision making. In, M. T. Brannick, E. Salas, &, C. Prince, (Eds.), Team performance assessment and measurement: Theory, methods and applications (pp. 311-327) Mahwah, NJ: Lawrence Erlbaum Associates.
34. Jones, J. M., Ma, R., Starkey, R. L., &, Ma, Z., (2007). Information complexity and appropriate interface design in nuclear power plant control rooms. Proceedings of Human Factors and Power Plants and HPRCT 13th Annual Meeting, 45-49.
35. Jou, Y. T., Lin, C. J., Yenn, T. C., Yang, C. W., Yang, L. C., &, Tsai, R. C., (2008). The implementation of a human factors engineering checklist for humanâsystem interfaces upgrade in nuclear power plants. Safety Science, 47, 1016-1025.
36. Kidd, J. S., (1961). A comparison of one-, two-, and three-man work units under various conditions of workload. Journal of Applied Psychology, 45, 195-200.
37. Kim, S. C., Chang, S. H., &, Heo, G., (2006). Team crystallization (SIO2): Dynamic model of team effectiveness evaluation under the dynamic and tactical environment at nuclear installation. Safety Science, 44, 701-721. (Pubitemid 44224007)
38. Kleinman, D. L., &, Serfaty, D., (1989). Team performance assessment in distributed decisionmaking. Simulation and Training Research Symposium on Interactive Networked Simulation for Training, University of Central Florida, Orlando, FL.
39. Klimoski, R., &, Jones, R. G., (1995). Staffing for effective group decision-making: Key issues in matching people and teams. In, R. A. Guzzo, &, E. Salas, (Eds.), Team effectiveness and decision making in organizations (pp. 291-332) San Francisco: Jossey-Bass.
40. Kontogiannis, T., &, Kossiavelou, Z., (1999). Stress and team performance: Principles and challenges for intelligent decision aids. Safety Science, 33, 103-128.
41. Lin, C. J., Jou, Y. T., Yenn, T. C., Hsieh, T. L., &, Yang, C. W., (2009). A Study of Control Room Staffing and Workload from the Human Information Processing Perspective, 2009 IEEE International Conference on Networking, Sensing and Control, Okayama City, Japan.
42. Lysaght, R. J., Hill, S. G., Dick, A. O., Plamondon, B. D., Linton, P. M., &, Wierwille, W. W., (1989). Operator workload: Comprehensive review and evaluation of workload methodologies (Technical Report 851). Alexandria, VA: U.S. Army Research Institute.
43. McCallum, G. A., Oser, R., &, Salas, E., (1989). Toward a definition of teamwork: Behavioral patterns of effective teams (NTSC Tech. Rep. No. TR-89-018). Orlando, FL: Naval Training Systems Center.
44. MacMillan, J., Entin, E. E., &, Serfaty, D., (2004). Communication overhead: The hidden cost of team cognition. In, E. Salas, &, S. M. Fiore, (Eds.), Team cognition: Understanding the factors that drive process and performance (pp. 61-82) Washington, DC: American Psychological Association.
45. Mathieu, J. E., Heffner, T. S., Goodwin, G. F., Salas, E., &, Cannon-Bowers, J. A., (2000). The influence of shared mental models on team process and performance. Journal of Applied Psychology, 85, 273-283.
46. Mearns, K., Flin, R., Gordon, R., &, Fleming, M., (2001). Human and organisational factors in offshore safety. Work and Stress, 15 (2), 144-160. (Pubitemid 33021845)
47. Mo, K., Lee, S. J., &, Seong, P. H., (2007). A neural network based operation guidance system for procedure presentation and operation validation in nuclear power plants. Annals of Nuclear Energy, 34, 813-823. (Pubitemid 47368866)
48. Moray, N., (1988). Mental workload since 1979. International Review of Ergonomics, 2, 123-150.
49. Morgan Jr., B. B., Glickman, A. S., Woodard, E. A., Blaiwes, A. S., &, Salas, E., (1986). Measurement of team behaviors in a Navy environment (NTSC Tech. Rep. No. TR-86-014). Orlando, FL: Naval Training Systems Center.
50. Morgan Jr., B. B., Salas, E., &, Glickman, A. S., (1994). An analysis of team evolution and maturation. Journal of General Psychology, 120, 277-291.
51. Mumaw, R. J., Roth, E. M., Vicente, K. J., &, Burns, C. M., (2000). There is more to monitoring a nuclear power plant than meets the eye. Human Factors, 42 (1), 36-55. (Pubitemid 30456527)
52. Nachreiner, F., Nickel, P., &, Meyer, I., (2006). Human factors in process control systems: The design of human-machine interfaces. Safety Science, 44, 5-26. (Pubitemid 41736034)
53. Navon, D., &, Gopher, D., (1979). On the economy of the human processing system. Psychological Review, 91, 216-234.
54. Norman, D. A., &, Bobrow, D. G., (1975). On data-limited and resource-limited processes. Cognitive Psychology, 7, 44-64.
55. Norros, L., &, Nuutinen, M., (2005). Performance-based usability evaluation of a safety information and alarm system. International Journal of Human-Computer Studies, 63, 328-361. (Pubitemid 41066446)
56. Nunnally, J. C., (1978). Psychometric theory. New York: McGraw-Hill.
57. Nygren, T. E., (1991). Psychometric properties of subjective workload measurement techniques: Implications for their use in the assessment of perceived mental workload. Human Factors, 33 (1), 17-33.
58. O'Dea, A., &, Flin, R., (2001). Site managers and safety leadership in the offshore oil and gas industry. Safety Science, 37, 39-57.
59. O'Donnell, R. D., &, Eggemeier, F. T., (1986). Workload assessment methodology. In, K. Boff, L. Kaufman, &, J. P. Thomas, (Eds.), Handbook of perception and human performance (pp. 42.41-42.49) New York: Wiley-Interscience.
60. O'Hara, J. M., &, Hall, M. W., (1992). Advanced control rooms and crew performance issues: Implications for human reliability. IEEE Transactions on Nuclear Science, 39, 919-923.
61. O'Hara, J. M., Higgins, J. C., Persensky, J. J., Lewis, P. M., &, Bongarra, J. P., (2004). Human factors engineering program review model (NUREG-0711, Rev.2). Washington, DC: U.S. Nuclear Regulatory Commission.
62. Orasanu, J., &, Salas, E., (1993). Team decision making in complex environments. In, G. A. Klein, J. Orasanu, &, R. Calderwood, (Eds.), Decision making in action: Models and methods (pp. 327-345) Norwood, NJ: Ablex.
63. Oser, R. L., McCallum, G. A., Salas, E., &, Morgan Jr., B., (1989). Toward a definition of teamwork: An analysis of critical team behaviour. NTSC technical report no. 90-009 (Orlando, FL: Naval Training Systems Center).
64. Park, J. K., Jung, W. D., Ha, J. J., &, Shin, Y. H., (2004). Analysis of operators' performance under emergencies using a training simulator of the nuclear power plant. Reliability Engineering and System Safety, 83, 179-186.
65. Patrashkova-Volzdoska, R., McComb, S. A., Green, S. G., &, Compton, W. D., (2003). Examining a curvilinear relationship between communication frequency and team performance in cross-functional project teams. IEEE Transactions on Engineering Management, 50 (3), 262-269.
66. Pinto, M. B., &, Pinto, J. K., (1991). Determinants of cross-functional cooperation in the project implementation process. Project Management Journal, 22 (2), 13-21.
67. Plott, B. M., Scott-Nash, S., Hallbert, B. P., &, Sebok, A. L., (1995). Computer modeling of a nuclear power plant operating crew to aid in analysis of crew size issues. Proceedings of the Human Factors and Ergonomics Society, 1214-1218.
68. Plott, C., Engh, T., &, Barnes, V., (2003). Technical basis for regulatory guidance for assessing exemption requests from the nuclear power plant licensed operator staffing requirements specified in 10 CFR 50.54(m). Washington, DC: US Nuclear Regulatory Commission. NUREG/CR-6838.
69. Reich, B. H., &, Benbasat, I., (2000). Factors that influence the social dimension of alignment between business and information technology objectives. MIS Quarterly, 24 (1), 81-103.
70. Roth, K., (1995). Managing international interdependence: CEO characteristics in a resource-based framework. Academy of Management Journal, 38 (1), 200-231.
71. Rubio, S., Diaz, E., Martin, J., &, Puente, J. M., (2004). Evaluation of subjective mental workload: A comparison of SWAT, NASA-TLX, and Workload Profile methods. Applied Psychology: An International Review, 53 (1), 61-86. (Pubitemid 38169984)
72. Salas, E., Dickinson, T. L., Converse, S. A., &, Tannenbaum, S. I., (1992). Toward an understanding of team performance and training. In, R. W. Swezey, &, E. Salas, (Eds.), Teams: Their training and performance (pp. 3-29) Norwood, NJ: Ablex.
73. Sanders, M. S., &, McCormick, E. J., (1993). Human factors in engineering and design. New York: McGraw Hill.
74. Scholtes, P. R., (1988). The team training handbook. Madison. WI: Joiner Associates.
75. Sebok, A., (2000). Team performance in process control: Influences of interface design and staffing levels. Ergonomics, 43 (8), 1210-1236. (Pubitemid 30657657)
76. Serfaty, D., Entin, E., &, Volpe, C., (1993). Adaptation to stress in team decision-making and coordination. Proceedings of the Human Factors Society 37th Annual Meeting, HFS, Santa Monica, CA, 1228-1232.
77. Skitka, L. J., (1999). Does automation bias decision-making ? International Journal of Human-Computer Studies, 51, 991-1006.
78. Smith-Jentsch, F., Bowers, C. A., &, Holmes, B., (1995). The acquisition and decay of aircrew coordination skills. Proceedings of the 8th International Symposium on Aviation Psychology, Columbus, OH, HFS, 1063-1068.
79. Steiner, I. D., (1966). Models for inferring relationships between group size and potential group productivity. Behavioral Science, 11, 273-283.
80. Steiner, I. D., (1972). Group process and productivity. New York: Academic Press.
81. Stout, R. J., Cannon-Bowers, J. A., Salas, E., &, Milanovich, D. M., (1999). Planning, shared mental models, and coordinated performance: An empirical link is established. Human Factors, 41 (1), 61-71. (Pubitemid 29228327)
82. Suchman, L. A., (1987). Plans and situated actions. New York: Cambridge University Press.
83. Thornton, C., Braun, C., Bowers, C., &, Morgan, B., (1992). Automation effects in the cockpit: A low-fidelity investigation. Proceedings of the Human Factors Society, 36th Annual Meeting, 1, 30-34. Atlanta, GA: Human Factors Society. (Pubitemid 23583657)
84. Urban, J. M., Bowers, C. A., Monday, S. D., &, Morgan Jr., B. B., (1995). Workload, team structure, and communication in team performance. Military Psychology, 7, 123-139.
85. Urban, J. M., Weaver, J. L., Bowers, C. A., &, Rhodenizer, L., (1996). Effects of workload and structure on team processes and performance: Implications for complex team decision making. Human Factors, 38, 300-310. (Pubitemid 26362371)
86. Veltman, J. A., &, Gaillard, A. W. K., (1996). Physiological indices of workload in a simulated flight task. Biological Psychology, 42, 323-342. (Pubitemid 26068935)
87. Vicente, K., Mumaw, R., &, Roth, E., (1997). Cognitive functioning of control room operators-Final phase. AECB, 96-175. Ottawa, Ontario, Canada: Atomic Energy Canadian Bureau.
88. Vicente, K. J., Roth, E., &, Mumaw, R. J., (2001). How do operators monitor a complex, dynamic work domain? The impact on control room technology. International Journal of Human-Computer Studies, 54, 831-856.
89. Volpe, C. E., Cannon-Bowers, J. A., Salas, E., &, Spector, P. E., (1996). The impact of cross-training on team functioning: An empirical investigation. Human Factors, 38, 87-100. (Pubitemid 26185319)
90. Weil, S. A., Hussain, T., Diedrich, F., Ferguson, W., &, MacMillan, J., (2004). Assessing distributed team performance in DARWARS training: Challenges and methods. Proceedings of the 2004 Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC).
91. Wickens, C. D., &, Hollands, J. G., (2002). Engineering Psychology and Human Performance. Upper Saddle River, NJ: Prentice Hall.
92. Xie, B., &, Salvendy, G., (2000). Review and reappraisal of modeling and predicting mental workload in single-and multi-task environments. Work and Stress, 14 (1), 74-99.