Workload prediction for improved design and reliability of complex systems

Reliability Engineering and System Safety

Volumn 93, Issue 4, 2008, Pages 530-549

  Gregoriades, Andreas ^a   Sutcliffe, Alistair ^b  

^a UNIVERSITY OF SURREY   (United Kingdom)

^b UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

Bayesian belief networks; Human reliability; Socio technical systems design; Workload prediction

Indexed keywords

BAYESIAN NETWORKS; COMPUTER SYSTEM RECOVERY; CONTROL SYSTEM ANALYSIS; INNOVATION; RELIABILITY; STRESS ANALYSIS;

HUMAN PERFORMANCE; HUMAN RELIABILITY; PERFORMANCE SHAPING FACTORS (PSF); WORKLOAD PREDICTION;

LARGE SCALE SYSTEMS;

EID: 36849067938     PISSN: 09518320     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ress.2007.02.001     Document Type: Article

References (75)

1. Redhill F., and Rajan J. Human factors in safety-critical systems (1997), Butterworth-Heinemann, Oxford
2. Reason J. Human error (1990), Cambridge University Press, Cambridge
3. Sussman M.C. Fatigue and alertness in the United States railroad industry part I: the nature of the problem. Transp Res Part F: Traffic Psychol Behav 3 4 (2000) 211-220
4. Leveson N. Safeware: system safety and computers (1995), Addison-Wesley, Reading, MA
5. Hollnagel E., and Bye A. Principles for modelling function allocation. Int J Human-Comput Stud 52 2 (2000) 253-265
6. Swain A.D., and Guttmann H.E. Handbook of human reliability analysis with emphasis on nuclear power plant applications, ed. NUREG/CR-1278 (1983), US Nuclear Regulatory Commission, Washington, DC
7. Mosleh A., and Chang Y.H. Model-based human reliability analysis: prospects and requirements. Reliab Eng Syst Safety 83 2 (2004) 241-253
8. Smidts C., Shen S.H., and Mosleh A. The IDA cognitive model for the analysis of nuclear power plant operator response under accident conditions. Part I: problem solving and decision making model. Reliab Eng Syst Safety 55 1 (1997) 51-71
9. Shen S.-H., Smidts C., and Mosleh A. A methodology for collection and analysis of human error data based on a cognitive model: IDA. Nucl Eng Des 172 1-2 (1997) 157-186
10. Rouse W.B., Edwards S.L., and Hammer J.M. Modelling the dynamics of mental workload and human performance in complex systems. IEEE Trans Syst Man Cybernet 23 6 (1993) 1662-1671
11. Hart S.G., and Wickens C.D. Manprint: an approach to systems integration (1990), Van Nostrand Reinhold, New York
12. Brookings J., Wilson G., and Swain C. Psychological responses to changes in workload during simulated air traffic control. Biol Psychol 24 (1996)
13. Wierwille W. Important remaining issues in mental workload estimation. In: Meshkati N., and Hancock P.A. (Eds). Human mental workload (1988), North-Holland, Amsterdam
14. Moray N. Mental workload: its theory and measurements (1979), Plenum, New York
15. Hart S.G., and Staveland L.E. Development of a NASA-TLX (Task Load Index): results of empirical and theoretical research. In: Hancock P.A., and Meshkati N. (Eds). Human mental workload (1988), North-Holland, Amsterdam
16. Gopher D., and Donchin E. Workload-an examination of the concept. In: Boff K.R., Kaufman L., and Thomas J.P. (Eds). Handbook of perception and human performance (1986), Wiley, New York 41-49
17. Baines TS, Asch R, Hadfield L, Mason JP, Fletcher S, Kay JM. Towards a theoretical framework for human performance modelling within manufacturing systems design. Simulation Modelling Pract Theory 2005;13(6) 486-504.
18. Toriizuka T. Application of performance shaping factors (PSF) for work improvement in industrial plant maintenance tasks. Int J Ind Ergon 28 3-4 (2001) 225-236
19. Dougherty M. Is human failure a stochastic process?. Reliab Eng Syst Safety 55 3 (1997) 209-215
20. Kecklund L.J., and Svenson O. Human errors and work performance in a nuclear power plant control room: associations with work-related factors and behavioral coping. Reliab Eng Syst Safety 56 1 (1997) 5-15
21. Gregoriades A., Shin J., and Sutcliffe A.G. Human-centred requirements engineering. IEEE joint international conference on requirements engineering, Kyoto (2004), IEEE, Japan, New York 143-152
22. Kim MC, Seong PH, Hollnagel E. A probabilistic approach for determining the control mode in CREAM. Reliab Eng Syst Safety 2005;91(2) 191-99.
23. Hollnagel E. Human reliability analysis: context and control (1993), Academic Press, London
24. Yu E. Modelling strategic relationships for process reengineering (1994), University of Toronto, Toronto
25. Liu L., Yu E., and Mylopoulos J. Security and privacy requirements analysis within a social setting. EEE joint international conference on requirements engineering (2003), IEEE Computer Society Press, Los Alamitos, CA 151-161
26. Sutcliffe A.G. Requirements analysis for socio-technical system design. Inf Syst 25 3 (2000) 213-233
27. Sutcliffe A.G. Requirements engineering for complex collaborative systems. RE 01: fifth IEEE international symposium on requirements engineering (2001), IEEE Computer Society Press, Toronto 110-119
28. Clark H.H. Using language (1996), Cambridge University Press, Cambridge
29. Winograd T., and Flores F. Understanding computers and cognition: a new foundation for design (1986), Addison-Wesley, Reading, MA
30. McCrasken JH, Aldrich TB. Analysis of selected LHX mission functions: implications for operator workload and system automation goals. Technical note ASI479-024-84, Fort Rucker, AL: Army Research Institute Aviation Research and Development Activity; 1984.
31. Aldrich T.B., Szabo S.M., and Bierbaum C.R. The development and application of models to predict operator workload during system design. In: McMillan G.R., Beevis D., Salas E., Strub M.H., Sutton R., and Breda L.V. (Eds). Applications of human performance models to system design, defense research series (1989), Defense research series, Plenum, New York 65-80
32. Szabo SM, Bierbaum CR. A comprehensive task analysis of the AH-64 mission with crew workload estimates and preliminary decision rules for developing and AH-64 workload prediction model. Technical report ASI678-204-86[B]. Fort Rucker, AL; Anacapa Sciences, Inc.; 1986.
33. Sutcliffe A.G., and Minocha S. Linking business modelling to socio-technical system design. CAiSE99, advanced information system engineering (1999), Springer, Berlin 73-87
34. Megaw E. The definition and measurement of mental workload. In: Wilson J., and Corlett N. (Eds). Evaluation of human work (2005), Taylor & Francis, London 525-551
35. Pearl J. Probabilistic reasoning in intelligent systems: networks of plausible information (1988), Morgan Kaufmann, San Francisco
36. Fenton N. Applying Bayesian belief networks to critical systems assessment. Crit Systems 8 (1999) 10-13
37. Fenton N., and Pfleeger S.L. Software metrics: a rigorous approach (1997), International Thomson Computer Press, London
38. Fenton N., and Neil M. Software metrics: successes, failures and new directions. J Syst Softw 47 2-3 (2000) 149-157
39. Meshkati N., Hancock P., and Rahimi M. Techniques in mental workload assessment. In: Wilson J., and Corlett E. (Eds). Evaluation of human work. A practical ergonomics methodology (1992), Taylor & Francis, London 605-627
40. Hollnagel E. Cognitive reliability and error analysis method: CREAM (1998), Elsevier, Oxford
41. Grabowski M., and Sanborn S. Human performance and embedded intelligent technology in safety-critical systems. Int J Human-Comput Stud 58 6 (2003) 637-670
42. Bailey R.W. Human performance engineering (1996), Prentice-Hall, Englewood Cliffs, NJ
43. Wickens C.D. Multiple resources and performance prediction. Theor Issues Ergon 2 2 (2002) 159-177
44. Druzdzel M.J., and van der Gaag L.C. Building probabilistic networks: "Where do the numbers come from?" guest editors' introduction. IEEE Trans Knowl Data Eng 12 4 (2000) 481-486
45. Lemmer J.F., and Gossink D.E. Recursive noisy OR-a rule for estimating complex probabilistic interactions. IEEE Trans Syst Man Cybernet Part B 34 6 (2004) 2252-2261
46. Onisko A., Druzdzel M.J., and Wasyluk H. Learning Bayesian network parameters from small data sets: application of noisy-OR gates. Int J Approximate Reasoning 27 2 (2001) 165-182
47. Onisko A., Druzdzel M., and Wasyluk H. Learning Bayesian network parameters from small data sets: application of noisy-OR gates. 12th European conference on artificial intelligence: Bayesian and causal networks: from inference to data mining (2000), Berlin, Germany
48. Williams J.C. A data-based method for assessing and reducing human error to improve operational performance. Human factors and power plants (1988), IEEE, Monterey, CA
49. Friedman N., and Goldszmidt M. Learning Bayesian networks with local structure. In: Jordan M. (Ed). Learning in graphical models (1998)
50. Zagorecki A., and Druzdzel M.J. An empirical study of probability elicitation under Noisy-OR assumption. Proceedings of the 17th international Florida artificial intelligence research society conference (FLAIRS-2004) (2004), AAA Press, Menlo Park, CA 880-885
51. Gregoriades A., and Sutcliffe A. Scenario-based assessment of nonfunctional requirements. IEEE Trans Softw Eng 31 5 (2005) 392-409
52. Gerdes VGJ. Identification and analysis of cognitive errors - application to control room operators, Delft, Doctoral thesis ISBN:90-9010488-7.
53. Kim J.W., and Jung W. A taxonomy of performance influencing factors for human reliability analysis of emergency tasks. J Loss Prev Process Ind 16 6 (2003) 479-495
54. Swain AD. Field calibrated simulation. In: Symposium on human performance quantification in system effectiveness, National Academy Command and the National Academy of Engineering; 1967. p. IV-A-1-IV-A-21.
55. Reason J. Managing the risks of organizational accidents (2000), Ashgate, Aldershot
56. Rasmussen J. Information processing in human computer interaction: an approach to cognitive engineering (1986), North-Holland, Amsterdam
57. Gregoriades A., Sutcliffe A.G., and Karanikas H. Evaluation of the SRA tool using data mining techniques. CAiSE (2003), Klagenfurt/Velden, Austria
58. Entin E.E., MacMillan J., and Serfaty D. Analysis of organizational processes in adaptive command and control architectures. IEEE international conference on systems, man, and cybernetics (1997), IEEE Computer Society Press, Los Alamitos CA
59. Xie B., and Salvendry G. Review and reappraisal of modelling and predicting mental workload in single and multi-task environments. Work Stress 14 1 (2000) 74-99
60. Chubb G.P., Laughery K.R., and Pritsker A.B. Simulating manned systems. In: Salvendy G. (Ed). Handbook of human factors (1987), Wiley, New York
61. Baron S., Corker K., McMillan G.R., Bevis D., Salas E., Strub M.H., et al. Engineering based approaches to human performance modelling. In: McMillan G.R., Bevis D., Salas E., Strub M.H., Sutton R., and Breda L.V. (Eds). Applications of human performance modelling to system design (1989), Plenum Press, New York 203-218
62. Jung H.S., and Jung H. Establishment of overall workload assessment technique for various tasks and workplaces. Int J Ind Ergon 28 (2001) 341-353
63. Parks D.L., and Boucek G.P. TLAP: a method for time line analysis and workload prediction. In: McMillan G.R., Bevis D., Salas E., Strub M.H., Sutton R., and Breda L.V. (Eds). Applications of human performance modelling to system design (1989), Plenum Press, New York 47-64
64. North R.A., and Riley V.A. W/INDEX: a predictive model of operator workload. In: McMillan G.R., Bevis D., Salas E., Strub M.H., Sutton R., and Breda L.V. (Eds). Applications of human performance modelling to system design (1989), Plenum Press, New York 81-90
65. Wetteland C.R., OBrien K., and Spooner D. The human simulation: resolving manning issues onboard DD21. Winter simulation conference (2000)
66. Laughery R. Using discrete event simulation to model human performance in complex systems. Simulation conference (1999)
67. Manning C, Mills S, Fox C, Pfleiderer E, Mogilka H. Using air traffic control taskload measures and communication events to predict subjective workload. Technical report, Washington, DC: US Department of Transportation; 2002.
68. Hanakawa N., Matsumoto K., and Torji K. A communication workload estimation model based on the relationships among shared work for software development projects. Ninth Asia Pacific software engineering conference (2002), IEEE Press, Los Alamitos, CA
69. Rasker P.C., Post W.M., and Schraagen J.M.C. Effects of two types of intra-team feedback on developing a shared mental model in command and control teams. Ergonomics 43 8 (2000) 1167-1189
70. Sarno K.J., and Wickens C.D. Predictive workload models and multiple task performance. Human factors society 36th annual meeting (1992), Human factors Society, Santa Monica, CA 12-16
71. Park K.S., and Jung K.T. Considering performance shaping factors in situation-specific human error probabilities. Int J Ind Ergon 18 4 (1996) 325-331
72. Heckermann D., Wellman M., and Mamdani A. Real-world applications of Bayesian networks. Commun ACM 38 3 (1995)
73. Bobbio A., Portinale L., Minichino M., and Ciancamerla E. Improving the analysis of dependable systems by mapping fault trees into Bayesian networks. Reliab Eng Syst Safety 71 3 (2001) 249-260
74. Bobbio A., Ciancamerla E., Franceschinis G., Gaeta R., Minichino M., and Portinale P. Sequential application of heterogeneous models for the safety analysis of a control system: a case study. Reliab Eng Syst Safety 81 3 (2003) 269-280
75. Card S.K., Thomas T.P., and Newall A. The psychology of human-computer interaction (1983), Lawrence Erbaum Associates, London