Human Error Data Collection and Comparison with Predictions by SPAR-H

Risk Analysis

Volumn 34, Issue 9, 2014, Pages 1706-1719

  Liu, Peng ^a   Li, Zhizhong ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

Human error data; Human reliability analysis; Performance shaping factors

Indexed keywords

ERRORS; NUCLEAR FUELS; NUCLEAR POWER PLANTS; RISK ANALYSIS; RISK ASSESSMENT;

HUMAN ERROR PROBABILITY; HUMAN ERRORS; HUMAN RELIABILITY; HUMAN RELIABILITY ANALYSIS; OPERATIONAL EXPERIENCE; PERFORMANCE SHAPING FACTORS; RELATIVE EFFECTS; TIME AVAILABILITY;

RELIABILITY ANALYSIS;

COMPARATIVE STUDY; EMPIRICAL RESEARCH; HUMAN; REPRODUCIBILITY; RISK ASSESSMENT;

EMPIRICAL RESEARCH; HUMANS; REPRODUCIBILITY OF RESULTS; RISK ASSESSMENT;

EID: 84939255832     PISSN: 02724332     EISSN: 15396924     Source Type: Journal    
DOI: 10.1111/risa.12199     Document Type: Article

References (68)

1. Hollnagel E. Extending the scope of the human factor. Pp. 37-59 in Hollnagel E (ed). Safer Complex Industrial Environments: A Human Factors Approach. London: Taylor & Francis, 2010.
2. Rasmussen J. Human error and the problem of causality in analysis of accidents. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 1990; 327(1241):449-462.
3. Reason J. The Human Contribution: Unsafe Acts, Accidents, and Heroic Recoveries. Burlington, VT: Ashgate, 2008.
4. Spurgin AJ. Human Reliability Assessment Theory and Practice. London: CRC Press, 2010.
5. Griffith CD, Mahadevan S. Inclusion of fatigue effects in human reliability analysis. Reliability Engineering and System Safety, 2011; 96(11):1437-1447.
6. Hollnagel E. Cognitive Reliability and Error Analysis Method. Oxford, UK: Elsevier Science Ltd, 1998.
7. Kirwan B. A Guide to Practical Human Reliability Assessment. Bristol, PA: Taylor and Francis, 1994.
8. Swain AD, Guttmann HE. Handbook of Human Reliability Analysis with Emphasis on Nuclear Power Plant Applications. NUREG/CR-1278. Washington, DC: U.S. Nuclear Regulatory Commission, 1983.
9. Bell J, Holroyd J. Review of Human Reliability Assessment Methods. Derbyshire: Health and Safety Laboratory, RR679, 2009.
10. Kirwan B, Gibson WH, Hickling B. Human error data collection as a precursor to the development of a human reliability assessment capability in air traffic management. Reliability Engineering and System Safety, 2008; 93(2):217-233.
11. Hallbert B, Kolaczkowski A. The Employment of Empirical Data and Bayesian Methods in Human Reliability Analysis: A Feasibility Study. NUREG/CR-6949. Washington, DC: U.S. Nuclear Regulatory Commission, 2007.
12. Boring R, Kelly D, Smidts C, Mosleh A, Dyre B. Microworlds, simulators, and simulation: Framework for a benchmark of human reliability data sources. Proceedings of the 11th International Probabilistic Safety Assessment and Management Conference (PSAM11) and the Annual European Safety and Reliability Conference (ESREL 2012), Helsinki, Finland, June 25-29, 2012.
13. Preischl W, Hellmich M. Human error probabilities from operational experience of German nuclear power plants. Reliability Engineering and System Safety, 2013; 109:150-159.
14. Hallbert B, Gertman D, Lois E, Marble J, Blackman H, Byers J. The use of empirical data sources in HRA. Reliability Engineering and System Safety, 2004; 83(2):139-143.
15. Tran TQ, Boring RL, Joe JC, Griffith CD. Extracting and converting quantitative data into human error probabilities. Proceedings of 2007 IEEE 8th Human Factors and Power Plants (HFPP) and 13th Annual HPRCT Meeting, Monterey, CA, August 26-31, 2007.
16. Meister D. The History of Human Factors and Ergonomics. London: Lawrence Erlbaum Associates, Inc., 1999.
17. Hollnagel E. Human reliability assessment in context. Nuclear Engineering and Technology, 2005; 37(2):159-166.
18. Le Bot P. Human reliability data, human error and accident models-Illustration through the Three Mile Island accident analysis. Reliability Engineering and System Safety, 2004; 83(2):153-167.
19. Boring RL. Modeling Human Reliability Analysis Using MIDAS. INL/CON-06-11170. Idaho Falls: Idaho National Laboratory, 2006.
20. Chang YHJ, Mosleh A. Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents: Part 5: Dynamic probabilistic simulation of the IDAC model. Reliability Engineering and System Safety, 2007; 92(8):1076-1101.
21. Shen S-H, Smidts C, Mosleh A. A methodology for collection and analysis of human error data based on a cognitive model: IDA. Nuclear Engineering and Design, 1997; 172(1-2):157-86.
22. Embrey DE. SLIM-MAUD: A computer-based technique for human reliability assessment. International Journal of Quality & Reliability Management, 1986; 3(1):5-12.
23. Gertman DI, Gilmore WE, Ryan TG. NUCLARR and human reliability: Data sources and data profile. Proceedings of 1988 IEEE Fourth Conference on Human Factors and Power Plants, Monterey, CA, June 5-9, 1988.
24. Hallbert B, Boring R, Gertman D, Dudenhoeffer D, Whaley A, Marble J, Joe J, Lois E. Human Event Repository and Analysis (HERA) System, Overview. NUREG/CR-6903, Vol. 1. Washington, DC: U.S. Nuclear Regulatory Commission, 2006.
25. Stanton N. Simulators: A review of research and practice. Pp. 117-140 in Stanton N (ed). Human Factors in Nuclear Safety. London: Taylor & Francis, 1996.
26. Groth KM, Swiler LP. Bridging the gap between HRA research and HRA practice: A Bayesian network version of SPAR-H. Reliability Engineering and System Safety, 2013; 115:33-42.
27. Groth KM, Mosleh A. Deriving causal Bayesian networks from human reliability analysis data: A methodology and example model. Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability, 2012; 226(4):361-379.
28. Brooker P. Experts, Bayesian belief networks, rare events and aviation risk estimates. Safety Science, 2011; 49(8-9):1142-1155.
29. Gertman D, Blackman H, Marble J, Byers J, Smith C. The SPAR-H Human Reliability Analysis Method. NUREG/CR-6883, Washington, DC: U.S. Nuclear Regulatory Commission, 2005.
30. Reece WJ, Gilbert BG, Richards RE. Nuclear Computerized Library for Assessing Reactor Reliability (NUCLARR) Data Manual Part 2: Human Error Probability (HEP) Data. NUREG/CR-4639, EGG-2458, V. 5 Rev. 4. Washington, DC: U.S. Nuclear Regulatory Commission, 1994.
31. Xu S, Song F, Li Zhong Z, Zhao Q, Luo W, He X, Salvendy G. An ergonomics study of computerized emergency operating procedures: Presentation style, task complexity, and training level. Reliability Engineering and System Safety, 2008; 93(10):1500-1511.
32. Roth E, Mumaw R, Lewis P. An Empirical Investigation of Operator Performance in Cognitively Demanding Simulated Emergencies. NUREG/CR-6208. Washington, DC: U.S. Nuclear Regulatory Commission, 1994.
33. Liu P, Li ZZ, Wang Z. Task complexity measure for emergency operating procedures based on resource requirements in human information processing. Proceedings of the 11th International Probabilistic Safety Assessment and Management Conference (PSAM11) and the Annual European Safety and Reliability Conference (ESREL 2012), Helsinki, Finland, June 25-29, 2012.
34. Hart SG, Staveland LE. Development of NASA-TLX (task load index): Results of empirical and theoretical research. Pp. 239-250 in Hancock PA, Meshkati N (eds). Human Mental Workload. Amsterdam, Netherlands: North Holland Press, 1988.
35. Rouse WB, Rouse SH. Analysis and classification of human error. IEEE Transactions on Systems, Man and Cybernetics, 1983; SMC-13(4):539-549.
36. Nawrocki LH, Strub MH, Cecil RM. Error categorization and analysis in man-computer communication systems. IEEE Transactions on Reliability, 1973; R-22(3):135-140.
37. Stanton NA, Stevenage SV. Learning to predict human error: Issues of acceptability, reliability and validity. Ergonomics, 1998; 41(11):1737-1756.
38. Hollnagel E, Kaarstad M, Lee H-C. Error mode prediction. Ergonomics, 1999; 42(11):1457-1471.
39. Zhao B. A Structured Analysis and Quantitative Measurement of Task Complexity in Human-Computer Interaction. PhD dissertation. West Lafayette, IN: Purdue University, 1992.
40. Ringle C, Wende S, Will A. Smart PLS 2.0 (beta). Available at: http://www.smartpls.de, Accessed on October 20, 2012.
41. Baron RM, Kenny DA. The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 1986; 51(6):1173-1182.
42. Chin WW. Commentary: Issues and opinion on structural equation modeling. MIS Quarterly, 1998; 22(1):vii-xvi.
43. Chin WW. How to write up and report PLS analyses. Pp. 655-690 in Vinzi VE, Chin W, Henseler J, Wang H (eds). Handbook of Partial Least Squares: Concepts, Methods and Applications. Berlin: Springer, 2010.
44. Cohen J. Statistical Power Analysis for the Behavioral Sciences, 2nd ed. Hillsdale, NJ: Lawrence Erlbaum Associates, 1988.
45. Hendrickson SML, Forester JA, Dang VN, Mosleh A, Lois E, Xing J. HRA method analysis criteria. Proceedings of the 11th International Probabilistic Safety Assessment and Management Conference (PSAM11) and the Annual European Safety and Reliability Conference (ESREL 2012), Helsinki, Finland, June 25-29, 2012.
46. Whaley AM, Kelly DL, Boring RL, Galyean WJ. SPAR-H Step-by-Step Guidance. NL/EXT-10-18533, Rev. 2. Idaho Falls: Idaho National Laboratory, 2011.
47. Hockey GRJ. Compensatory control in the regulation of human performance under stress and high workload: A cognitive-energetical framework. Biological Psychology, 1997; 45(1-3):73-93.
48. Sundaramurthi R, Smidts C. Human reliability modeling for the next generation system code. Annals of Nuclear Energy, 2013; 52:137-156.
49. Forester J, Kolaczkowski A, Lois E, Kelly D. Evaluation of Human Reliability Analysis Methods Against Good Practices. NUREG-1842. Washington, DC: U.S. Nuclear Regulatory Commission, 2006.
50. Atwood CL. Constrained noninformative priors in risk assessment. Reliability Engineering and System Safety, 1996; 53(1):37-46.
51. Bye A, Lois E, Dang VN, Parry G, Forester J, Massaiu S, Boring R, Braarud PØ, Broberg H, Julius J, Männistö I, Nelson P. The International HRA Empirical Study-Phase 2 Report-Results from Comparing HRA Methods Predictions to HAMMLAB Simulator Data on SGTR Scenario. HWR-915. Halden, Norway: OECD Halden Reactor Project, 2010.
52. Lois E, Dang VN, Forester J, Broberg H, Massaiu S, Hildebrandt M, Braarud PØ, Parry G, Julius J, Boring R, Männistö I, Bye A. International HRA Empirical Study-Phase 1 - Report Description of Overall Approach and Pilot Phase Results from Comparing HRA Methods to Simulator Performance Data. NUREG/IA-0216, Vol. 1. Washington, DC: U.S. Nuclear Regulatory Commission, 2009.
53. Marble J, Liao H, Forester J, Bye A, Dang V, Presley M, Lois E. Results and insights derived from the intra-method comparisons of the US Empirical HRA Study. Proceedings of the 11th International Probabilistic Safety Assessment and Management Conference (PSAM11) and the Annual European Safety and Reliability Conference (ESREL 2012), Helsinki, Finland, June 25-29, 2012.
54. Bye A, Dang VN, Forester J, Hildebrandt M, Marble J, Liao H, Lois E. Overview and preliminary results of the US Empirical HRA Study. Proceedings of the 11th International Probabilistic Safety Assessment and Management Conference (PSAM11) and the Annual European Safety and Reliability Conference (ESREL 2012), Helsinki, Finland, June 25-29, 2012.
55. Hickling EM, Bowie JE. Applicability of human reliability assessment methods to human-computer interfaces. Cognition, Technology & Work, 2013; 15(1):19-27.
56. Thiruvengadachari S. Experimental and Neural Network-based Model for Human-Machine Systems Reliability. Master thesis. New York: Binghamton University, 2006.
57. Kirwan B. The validation of three human reliability quantification techniques-THERP, HEART and JHEDI: Part I-Technique descriptions and validation issues. Applied Ergonomics, 1996; 27(6):359-373.
58. Kirwan B, Kennedy R, Taylor-Adams S, Lambert B. The validation of three human reliability quantification techniques-THERP, HEART and JHEDI: Part II-Results of validation exercise. Applied Ergonomics, 1997; 28(1):17-25.
59. Hickling N. A comparison of published human computer interaction reliability data with established HRA methods. Proceedings of the 11th International Probabilistic Safety Assessment and Management Conference (PSAM11) and the Annual European Safety and Reliability Conference (ESREL 2012), Helsinki, Finland, June 25-29, 2012.
60. O'Hara JM, Higgins JC, Stubler WF, Kramer J. Computer-Based Procedure Systems: Technical Basis and Human Factors Review Guidance. NUREG/CR-6634. Washington, DC: U.S. Nuclear Regulatory Commission, 2000.
61. Park J, Jung W. A database for human performance under simulated emergencies of nuclear power plants. Nuclear Engineering and Technology, 2005; 37(5):491-502.
62. Park J, Park S, Cho S. Some insights to determine the proper level of descriptions about proceduralized tasks. Progress in Nuclear Energy, 2010; 52:214-224.
63. Ambroggi MD, Trucco P. Modelling and assessment of dependent performance shaping factors through analytic network process. Reliability Engineering and System Safety, 2011; 96(7):849-860.
64. Galyean WJ. Orthogonal PSF taxonomy for human reliability analysis. Proceedings of the 8th International Probabilistic Safety Assessment and Management Conference (PSAM8), New Orleans, May 14-18, 2006.
65. Groth KM, Mosleh A. A data-informed PIF hierarchy for model-based human reliability analysis. Reliability Engineering and System Safety, 2012; 108:154-174.
66. Forester JA, Dang VN, Bye A, Boring RL, Liao H, Lois E. Conclusions on human reliability analysis (HRA) methods from the International HRA Empirical Study. Proceedings of the 11th International Probabilistic Safety Assessment and Management Conference (PSAM11) and the Annual European Safety and Reliability Conference (ESREL 2012), Helsinki, Finland, June 25-29, 2012.
67. Groth KM. A Data-Informed Model of Performance Shaping Factors for Use in Human Reliability Analysis. PhD dissertation. College Park: University of Maryland, 2009.
68. Boring RL. How many performance shaping factors are necessary for human reliability analysis? Proceedings of the 10th International Probabilistic Safety Assessment & Management Conference (PSAM10), Seattle, WA, June 7-11, 2010.