A systematic literature review to identify and classify software requirement errors

Information and Software Technology

Volumn 51, Issue 7, 2009, Pages 1087-1109

  Walia, Gursimran Singh ^a   Carver, Jeffrey C ^b  

^a MISSISSIPPI STATE UNIVERSITY   (United States)

^b Department of Computer Science   (United States)

Author keywords

Human errors; Software quality; Systematic literature review

Indexed keywords

HUMAN COGNITIONS; HUMAN ERRORS; INSPECTION PROCESS; REQUIREMENTS PHASE; SOFTWARE LIFE CYCLES; SOFTWARE QUALITY; SOFTWARE REQUIREMENTS; SYSTEMATIC LITERATURE REVIEW;

ERRORS; REQUIREMENTS ENGINEERING; SOFTWARE ENGINEERING; SYSTEMATIC ERRORS; TAXONOMIES;

COMPUTER SOFTWARE SELECTION AND EVALUATION;

EID: 67349095299     PISSN: 09505849     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.infsof.2009.01.004     Document Type: Review

References (92)

1. IEEE Std 610.12-1990, IEEE Standard Glossary of Software Engineering Terminology, 1990.
2. Software Engineering Laboratory: Software Measurement Guidebook, SEL-94-002, NASA/GSFC Software Engineering Laboratory, 1994.
3. Ackerman A.F., Buchwald L.S., and Lewski F.H. Software inspections: an effective verification process. IEEE Software 6 3 (1989) 31-36
4. E.B. Allen, Computer Aided Dispatch System for the London Ambulance Service: Software Requirement Specification, MSU-030429, Department of Computer Science and Engineering, Mississippi State University, 2003.
5. Aurum A., Petersson H., and Wohlin C. State-of-the-art: software inspections after 25 years. Journal of Software Testing Verification and Reliability 12 3 (2002) 133-154
6. Basili V.R., and Weiss D.M. Evaluation of a software requirements document by analysis of change data. Proceedings of the Fifth International Conference on Software Engineering (1981), IEEE Press, San Diego, CA 314-323
7. Basili V.R., and Perricone B.T. Software Errors and Complexity: An Empirical Investigation. Communications of the ACM 27 1 (1984) 42-52
8. Basili V.R., and Rombach H.D. Tailoring the software process to project goals and environments. Proceedings of Ninth International Conference in Software Engineering (1987), IEEE Press, California, United States 345-357
9. Basili V.R., and Rombach H.D. The TAME project: towards improvement-oriented software environments. IEEE Transactions on Software Engineering 14 6 (1988) 758-772
10. Basili V.R. Evolving and packaging reading techniques. Journal of Systems and Software 38 1 (1997) 3-12
11. Basu S., and Ebrahimi N. Estimating the number of undetected errors: bayesian model selection. Proceedings of the Ninth International Symposium on Software Reliability Engineering (1998), IEEE Computer Society, Paderborn, Germany 22-31
12. Batra D. Cognitive complexity in data modeling: causes and recommendations. Requirements Engineering Journal 12 4 (2007) 231-244
13. Beecham S., Hall T., Britton C., Cottee M., and Rainer A. Using an expert panel to validate a requirements process improvement model. The Journal of Systems and Software 76 3 (2005) 251-275
14. Bell T.E., and Thayer T.A. Software requirements: are they really a problem?. Proceedings of Second International Conference on Software Engineering (1976), IEEE Computer Society Press, Los Alamitos, CA 61-68
15. Berling T., and Thelin T. A case study of reading techniques in a software company. Proceedings of the 2004 International Symposium on Empirical Software Engineering (ISESE'04) (2004), IEEE Computer Society 229-238
16. Bhandari I., Halliday M., Tarver E., Brown D., Chaar J., and Chillarege R. A case study of software process improvement during development. IEEE Transactions on Software Engineering 19 12 (1993) 1157-1170
17. Bhandari I., Halliday M.J., Chaar J., Chillarege R., Jones K., Atkinson J.S., Lepori-Costello C., Jasper P.Y., Tarver E.D., Lewis C.C., and Yonezawa M. In process improvement through defect data interpretation. IBM Systems Journal 33 1 (1994) 182-214
18. J. Biolchini, P.G. Mian, A.C. Natatli, G.H. Travassos, Systematic Review in Software Engineering: Relevance and Utility, PESC-COPPE/UFRJ, Brazil, 2005, .
19. Boehm B., and Basili V.R. Software defect reduction top 10 list. IEEE Computer 34 1 (2001) 135-137
20. T. Bove, Development and Validation of Human Error Management Taxonomy in Air Traffic Control, Ph.D. Thesis, Risø National Laboratory and University of Roskilde, 2002.
21. Browne G.J., and Ramesh V. Improving information requirements determination: a cognitive perspective. Journal of Information and Management 39 8 (2002) 625-645
22. Brykczynski B. A survey of software inspection checklists. ACM SIGSOFT Software Engineering Notes 24 1 (1999) 82-89
23. Cacciabue P.C. A methodology of human factors analysis for systems engineering: theory and applications. IEEE Transactions on System, Man and Cybernetics - Part A: Systems and Humans 27 3 (1997) 325-329
24. Card D.N. Learning from our mistakes with defect causal analysis. IEEE Software 15 1 (1998) 56-63
25. Cheng B., and Jeffrey R. Comparing inspection strategies for software requirement inspections. Proceedings of the 1996 Australian Software Engineering Conference (1996), IEEE Computer Society, Melbourne, Australia 203-211
26. Chillarege R., Bhandari I.S., Chaar J.K., Halliday M.J., Moebus D.S., Ray B.K., and Wong M.Y. Orthogonal defect classification - a concept for in-process measurement. IEEE Transactions on Software Engineering 18 11 (1992) 943-956
27. Coughlan J., and Macredie D.R. Effective communication in requirements elicitation: a comparison of methodologies. Requirements Engineering Journal 7 2 (2002) 47-60
28. Cristopher W.J. The cost of errors in software development: evidence from industry. The Journal of System and Software 62 1 (2002) 1-9
29. Debou C., and Combelles A.K. Linking software process improvement to business strategies: experiences from industry. Journal of Software Process: Improvement and Practice 5 1 (2000) 55-64
30. Dyba T. Experiences of Undertaking Systematic Reviews (2005), SINTEF ICT, Queensland
31. Endres A. An analysis of errors and their causes in system programs. IEEE Transactions on Software Engineering 1 2 (1975) 140-149
32. Endres A., and Rombach D. A Handbook of Software and Systems Engineering. first ed. (2003), Pearson Addison Wesley, Harlow, England
33. Endsley M.R. Situation awareness and human error: designing to support human performance. Proceedings of the High Consequence Systems Surety Conference (1999), SA Technologies, Albuquerque, NM 2-9
34. Fenton N.E., and Neil M. A critique of software defect prediction models. IEEE Transactions on Software Engineering 25 5 (1999) 675-689
35. Fitts P.M., and Jones R.E. Analysis of factors contributing to 460 'pilot error' experiences in operating aircrafts control. Proceedings of Selected Papers on Human Factors in the Design and Use of Control Systems (1961), Dover Publications Inc., New York 332-358
36. W.A. Florac, Software Quality Measurement: A Framework for Counting Problems and Defects, CMU/SEI-92-TR-22, Carnegie Mellon Software Engineering Institute, Pittsburgh, PA, 1992, .
37. Freimut B., Denger C., and Ketterer M. An industrial case study of implementing and validating defect classification for process improvement and quality management. Proceedings of the 11th IEEE International Software Metrics Symposium (2005), IEEE Press
38. Fusaro P., Lanubile F., and Visaggio G. A replicated experiment to assess requirements inspection techniques. Journal of Empirical Software Engineering 2 1 (1997) 39-57
39. Gaitros D.A. Common errors in large software development projects. The Journal of Defense Software Engineering 12 6 (2004) 21-25
40. Galliers J., Minocha S., and Sutcliffe A. A causal model of human error for safety critical user interface design. ACM Transactions on Computer-Human Interaction 5 3 (1998) 756-769
41. Grady R.B. Software failure analysis for high-return process improvement. Hewlett-Packard Journal 47 4 (1996) 15-24
42. Hall T., Beecham S., and Rainer A. Requirement problems in twelve software companies: an empirical analysis. IEE Proceedings Software 149 5 (2002) 153-160
43. Hayes J.H. Building a requirement fault taxonomy: experiences from a NASA verification and validation research project. Proceedings of the 14th International Symposium on Software Reliability Engineering (2003), IEEE Computer Society 49-59
44. Hayes J.H., Holbrook E.A., Raphael I., and Pruett D.M. Fault-based analysis: how history can help improve performance and dependability requirements for high assurance systems. Proceedings of Fifth International Workshop on Requirements for High Assurance Systems (RHAS'05) (2005), IEEE Computer Society, Chicago
45. A. Issac, S.T. Shorrock, R. Kennedy, B. Kirwan, H. Andersen, T. Bove, The Human Error in ATM Technique (HERA-JANUS), HRS/HSP-002-REP-03, European Air Traffic Management, 2002.
46. Jacobs J., Moll J.V., Krause P., Kusters R., Trienekens J., and Brombacher A. Exploring defect causes in products developed by virtual teams. Journal of Information and Software Technology 47 6 (2005) 399-410
47. Kan S.H., Basili V.R., and Shapiro L.N. Software quality: an overview from the perspective of total quality management. IBM Systems Journal 33 1 (1994) 4-19
48. B. Kitchenham, Procedures for Performing Systematic Reviews, Technical Report TR/SE-0401, Department of Computer Science, Keele University and National ICT, Australia, Ltd., 2004, .
49. Kitchenham B., Mendes E., and Travassos G.H. A systematic review of cross- vs. within-company cost estimation studies. Proceedings of 10th International Conference on Evaluation and Assessment in Software Engineering (EASE'06) (2006), Keele University
50. Ko A.J., and Myers B.A. Development and evaluation of a model of programming errors. Proceedings of IEEE Symposium on Human Centric Computing Languages and Environments (2003), IEEE Computer Society 7-14
51. Ko A.J., and Myers B.A. A framework and methodology for studying the causes of software errors in programming systems. Journal of Visual Languages and Computing 16 2 (2005) 41-84
52. J. Kramer, A.L. Wolf, in: Succeedings of the Eighth International Workshop on Software Specification and Design, ACM SIGSOFT Software Engineering Notes, vol. 21, no. 5, 1996, pp. 21-35.
53. F. Lanubile, F. Shull, V.R. Basili, Experimenting with error abstraction in requirements documents, in: Proceedings of Fifth International Software Metrics Symposium, METRICS'98, IEEE Computer Society, Bethesda, MD, 1998, pp. 114-121.
54. Lawrence C.P., and Kosuke I. Design error classification and knowledge management. Journal of Knowledge Management Practice 10 9 (2004) 72-81
55. Leszak M., Perry D.E., and Stoll D. A case study in root cause defect analysis. Proceedings of the 22nd International Conference on Software Engineering (2000), ACM Press, Limerick, Ireland 428-437
56. R.R. Lutz, Analyzing software requirements errors in safety-critical, embedded systems, in: Proceedings of the IEEE International Symposium on Requirements Engineering, IEEE Computer Society Press, San Diego, CA, USA, 1993, pp. 126-133.
57. Lutz R.R. Targeting safety-related errors during software requirements analysis. The Journal of Systems and Software 34 3 (1996) 223-230
58. Martin J., and Tsai W.T. N-fold inspection: a requirement analysis technique. Communications of the ACM 33 2 (1990) 225-232
59. Masuck C. Incorporating a fault categorization and analysis process in the software build cycle. Journal of Computing Sciences in Colleges 20 5 (2005) 239-248
60. Mays R.G., Jones C.L., Holloway G.J., and Studinski D.P. Experiences with defect prevention. IBM Systems Journal 29 1 (1990) 4-32
61. Nakashima T., Oyama M., Hisada H., and Ishii N. Analysis of software bug causes and its prevention. Journal of Information and Software Technology 41 15 (1999) 1059-1068
62. Norman D. The Psychology of Every Day Things (1988), Basic Books, New York
63. Norman D.A. Steps towards a cognitive engineering: design rules based on analyses of human error. Communications of the ACM 26 4 (1981) 254-258
64. Norman D.A. Design rules based on analyses of human error. Communications of the ACM 26 4 (1983) 254-258
65. Oliveira K.M., Zlot F., Rocha A.R., Travassos G.H., Galotta C., and Menezes C.S. Domain-oriented software development environment. The Journal of Systems and Software 72 2 (2004) 145-161
66. Paterno F., and Santoro C. Preventing user errors by systematic analysis of deviations from the system task model. International Journal of Human-Computer Studies 56 2 (2002) 225-245
67. Pfleeger S.L., and Atlee J.M. Software Engineering Theory and Practice. third ed. (2006), Prentice Hall, Upper Saddle River, NJ
68. Porter A.A., Votta L.G., and Basili V.R. Comparing detection methods for software requirements inspections: a replicated experiment. IEEE Transactions on Software Engineering 21 6 (1995) 563-575
69. Reason J. Human Error (1990), Cambridge University Press, Cambridge, USA
70. Sakthivel S. A survey of requirement verification techniques. Journal of Information Technology 6 2 (1991) 68-79
71. Sasao K., and Reason J. Team errors: definition and taxonomy. Journal of Reliability Engineering and System Safety 65 1 (1999) 1-9
72. Schneider G.M., Martin J., and Tsai W.T. An experimental study of fault detection in user requirements documents. ACM Transactions on Software Engineering and Methodology 1 2 (1992) 188-204
73. Senders L.W., and Moray N.P. Human Error: Cause, Prediction, and Reduction (1991), Lawrence Erlbaum, Hillslade, NJ
74. Shorrock S.T., and Kirwan B. Development and application of a human error identification tool for air traffic control. Journal of Applied Ergonomics 33 4 (2002) 319-336
75. Shull F., Rus I., and Basili V. How perspective based reading can improve requirement inspection. IEEE Computer 33 7 (2000) 73-79
76. Smith J. The 40 root causes of troubled IT projects. Journal of IEEE Computer and Control Engineering 13 3 (2002) 109-112
77. Sommerville I. Software Engineering. eighth ed. (2007), Addison Wesley, Harlow, England
78. Stanton N.A., and Stevenage S.V. Learning to predict human error: issues of acceptability, reliability and validity. Journal of Ergonomics 41 11 (1998) 1737-1756
79. Stutzke M.A., and Smidts C.S. A stochastic model of fault introduction and removal during software development. IEEE Transactions on Reliability 50 20 (2001) 184-193
80. Sutcliffe A., and Rugg G. A taxonomy of error types for failure analysis and risk assessment. International Journal of Human-Computer Interaction 10 4 (1998) 381-405
81. Sutcliffe A., Economou A., and Markis P. Tracing requirements errors to problems in the requirements engineering process. Requirements Engineering Journal 4 3 (1999) 134-151
82. Sutcliffe A., Gault B., and Maiden N. ISRE: immersive scenario-based requirements engineering with virtual prototypes. Requirements Engineering Journal 10 1 (2004) 95-111
83. Swain A., and Guttman H. Handbook of Human Reliability Analysis with Emphasis on Nuclear Power Plant Applications (1983), Nuclear Regulatory Commission, Washington, DC
84. Thelin T., and Runeson P. Robust estimation of fault content with capture-recapture and detection profile estimators. The Journal of Systems and Software 52 2 (2000) 139-148
85. Thelin T., Runeson P., Wohlin C., Olsson T., and Andersson C. Team based fault content estimation in the software inspection process. Proceedings of the 26th International Conference on Software Engineering (ICSE'04) (2004), IEEE Computer Society 263-272
86. C. Trevor, S. Jim, C. Judith, K. Brain, Human Error in Software Generation Process, University of Technology, Loughborough, England, 1994, .
87. S. Viller, J. Bowers, T. Rodden, Human Factors in Requirement Engineering: A Survey of Human Sciences Literature Relevant to the Improvement of Dependable Systems Development Processes, Cooperative Systems Engineering Group Technical Report, CSEG/8/1997, Computing Department, Lancaster University, Lancaster, 1997, .
88. G. Walia, J. Carver, T. Philip, Requirement error abstraction and classification: a control group replicated study, in: 18th IEEE International Symposium on Software Reliability Engineering, Trollhättan, Sweden, 2007.
89. G.S. Walia, Empirical Validation of Requirement Error Abstraction and Classification: A Multidisciplinary Approach, M.S. Thesis, Computer Science and Engineering, Mississippi, Starkville, 2006.
90. G.S. Walia, J. Carver, T. Philip, Requirement error abstraction and classification: an empirical study, in: Proceedings of IEEE Symposium on Empirical Software Engineering, ACM Press, Brazil, 2006, pp. 336-345.
91. G.S. Walia, J. Carver, Development of a Requirement Error Taxonomy as a Quality Improvement Approach: A Systematic Literature Review MSU-070404, Department of Computer Science and Engineering, Mississippi State University, 2007, .
92. Zhang X., and Pham H. An analysis of factors affecting software reliability. The Journal of Systems and Software 50 1 (2000) 43-56