Component testing is not Enough - A study of software faults in telecom middleware

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4581 LNCS, Issue , 2007, Pages 74-89

  Eldh, Sigrid ^a,b   Punnekkat, Sasikumar ^b   Hansson, Hans ^b   Jönsson, Peter ^a  

^a ERICSSON RESEARCH   (Sweden)

^b MÄLARDALEN UNIVERSITY   (Sweden)

Author keywords

Fault classification; Fault distribution; Software; Testing

Indexed keywords

COMPUTER SYSTEM RECOVERY; DATA REDUCTION; LARGE SCALE SYSTEMS; MIDDLEWARE; TELECOMMUNICATION; TELECOMMUNICATION INDUSTRY; CODES (SYMBOLS); COMPUTER SOFTWARE; SOFTWARE TESTING; TESTING;

FAULT CLASSIFICATION; FAULT DISTRIBUTION; TRACKING FAULTS; COMPONENT LEVELS; COMPONENT TESTING; EFFECTIVE TEST STRATEGIES; LARGE COMPLEX SYSTEMS; MIDDLEWARE SYSTEM; TIME TO MARKET;

SOFTWARE TESTING; INTEGRATION TESTING;

EID: 34548082345     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-73066-8_6     Document Type: Conference Paper

References (35)

1. Eldh, S., Hansson, H., Punnekkat, S., Pettersson, A., Sundmark, D.: A Framework for Comparing Efficiency, Effectiveness and Applicability of Software Testing Techniques. In: Proc. TAIC, IEEE, New York (2006)
2. Juristo, N., Moreno, A.M., Vegas, S.: Reviewing 25 Years of Testing Technique Experiments. Journal of Empirical Softw. Eng., vol. 9(1-2), pp. 7-44. Springer, Heidelberg (2004)
3. Hyunsook, D., Elbaum, S., Rothermel, G.: Infrastructure support for controlled experimentation with software testing and regression testing techniques. In: Proc. Int. Symp. On Empirical Software Engineering, ISESE '04, pp. 60-70. ACM, New York (2004)
4. Apiwattanapong, T., Santelices, R., Chittimalli, P.V., Orso, A., Harrold, M.J.: Tata: MaTRIX: Maintenance-Oriented Test Requirements Identifier and Examiner. In: Proc. From TAIC, IEEE, New York (2006)
5. Basili, V.R., Selby, R.W.: Comparing the Effectiveness of Software Testing Strategies original 1985, revised dec. 87. In: Boehm, B., Rombach, H.D., Zelkowitz, M.V. (eds.) Foundations of Empirical Software Engineering, The Legacy of Victor R. Basili, Springer, Heidelberg (2005)
6. Myers, G.J.: A controlled experiment in program testing and code walkthroughs inspections, Comm. ACM, pp. 760-768 (September 1978)
7. Hetzel, W.C.: An experimental analysis of program verification methods, PhD dissertation, Univ. North Carolina, Chapel Hill (1976)
8. Chillarege, R., Inderpal, S., Bhandari, J.K., Chaar, M.J., Halliday, Moebus, D.S, Ray, B.K, Wong, M.-Y.: Orthogonal defect classification - a concept for in-process measurements. IEEE Trans. on Soft. Eng 18(11), 943-956 (1992)
9. Thane, H., Wall, A.: Testing Reusable Software Components in Safety-Critical Real-Time Systems, vol. 1(1-2) Artech House Publishers (2002)
10. Avižienis, A., Laprie, J.: Dependable computing: From concepts to design diversity. In: Proceedings of the IEEE, vol. 74, pp. 629-638 (May 1986)
11. Basili, V.R., Perricone, B.T.: Software errors and complexity: An empirical investigation. Communications of the ACM 27(1), 42-52 (1984)
12. Beizer, B.: Software Testing and Quality Assurance. Van Nostrand Reinhold electrical/computer science and engineering series. Van Nostrand Reinhold, NY (1984)
13. DeMillo, R.A., Maihur, A.P.: A grammar based fault classification scheme and its application to the classification of the errors of TEX. Technical Report SERC-TR-165-P, Purdue University, West Lafayette, IN 47907 (1995)
14. Endres, A.: An analysis of errors and their causes in system programs. Technical report, IBM Laboratory, Boebligen, Germany (1975)
15. Johnson, C., et al.: Guide to IEEE standard for classification for software anomalies. In: Technical report, IEEE Computer Society, Washington (1995)
16. Goodenough, J.B., Gerhart, S.L.: Toward a theory of test data selection. In: Proceedings of the international conference on Reliable software, pp. 493-510. ACM Press, New York, USA (1975)
17. Gray, J.: Why do computers stop and what can be done about it? Technical Report, vol. 85(7) Tandem Computers (1985)
18. Harrold, M.J., Offutt, A.J., Tewary, K.: An approach to fault modeling and fault seeding using the program dependence graph. Journal of Systems and Software 36(3), 273-296 (1997)
19. Howden, W.E.: Reliability of the path analysis testing strategy. IEEE Trans. on Software Engineering 2(3), 208-215 (1976)
20. Knuth, D.E.: The errors of TEX. Software Practice and Experience 7, 607-685 (1989)
21. Ishoda, S.: A criticism on the capture-and-recapture method for software reliability assurance. In: Proc. Soft. Eng, IEEE, New York (1995)
22. Ostrand, T.J., Weyuker, E.J, Bell, R.M.: Predicting the Location and Number of Faults in Large Software Systems. IEEE Trans. of Soft. Eng., vol. 31(4) (April 2005)
23. Perry, D.E., Steig, C.S.: Software faults in evolving a large, real-time system: a case study. In: Sommerville, I., Paul, M. (eds.) ESEC 1993. LNCS, vol. 717, pp. 48-67. Springer, Heidelberg (1993)
24. Kaner, C. Falk, J., Nguyen, H.Q: Testing Computer Software. 2nd edn. International Thomson Computer Press (1993)
25. Vaidyanathan, K., Kishor, S., Trivedi, A.: A comprehensive model for software rejuvenation. IEEE Trans. on Dependable and Secure Computing 2(2), 124-137 (2005)
26. Zeil, S.J.: Perturbation techniques for detecting domain errors. IEEE Transactions on Software Engineering 15(6), 737-746 (1989)
27. Mohaghegi, P., Conradi, R., Borretzen, J.A.: Revisiting the problem of Using Problem Reports for Quality Assessments, WQSA, ICSE (2006)
28. Henningsson, K., Wohlin, C.: Assuring fault classification agreement - An Empirical Evaluation. In: Proc. of ISESE'04, IEEE, New York (2004)
29. Offut, A.J., Huffman- Hayes, J.: A Semantic Model of Program Faults. In: Proceedings of ISSTA, pp. 195-200 (1996)
30. Damm, L.O, Lundberg, L., Wohlin, C.: Fault-Slip Through - a concept for measuring the efficiency of the test process. Journal of Software Process: Improvements and Practice, vol. 11(1), pp. 47-59. John Wiley and Sons, New York (2006)
31. Murphy, B., Garzia, M., Suri, N.: Closing the Gap in Failure Analysis. Workshop on Applied SW Reliability-DSN (2006)
32. Andrews, J.H., Briand, L.C., Labiche, Y.: Is Mutation an Appropriate Tool for Testing Experiments? In: ICSE 2005, ACM, New York (2005)
33. Frankl, P.G., Iakounenko, O.: Further Empirical Studies of test Effectiveness. In: Proc. 6th ACM SIGSOFT International Symposium on Foundations of Software Engineering, Orlando, FL, USA, pp. 153-162 (1998)
34. Vokolos, F.I., Frankl, P.G.: Empirical evaluation of the textual differencing regression testing technique. In: Proc. IEEE Int. Conference on Soft. Maint. USA, pp. 44-53 (1998)
35. IEEE Std. 1044-1993, Standard for classification for software anomalies. IEEE (1993)