Does hardware configuration and processor load impact software fault observability?

ICST 2010 - 3rd International Conference on Software Testing, Verification and Validation

Volumn , Issue , 2010, Pages 285-294

  Syed, Raza Abbas ^a   Robinson, Brian ^b   Williams, Laurie ^a  

^a North Carolina State University   (United States)

^b ABB INC   (United States)

Author keywords

Empirical study; Failure observability; Observation based testing; Software testing

Indexed keywords

EMPIRICAL STUDIES; EMPIRICAL STUDY; FIELD FAILURE; FIREFOX; HARD DRIVES; HARDWARE CONFIGURATIONS; INTERMITTENT FAILURE; MOZILLA; NONDETERMINISTIC BEHAVIOR; PROCESSOR LOADS; PROCESSOR SPEED; SOFTWARE FAULT; SOFTWARE SYSTEMS; TESTING SOFTWARE;

NANOTECHNOLOGY; OBSERVABILITY; PROGRAM DEBUGGING; SOFTWARE TESTING; VERIFICATION;

COMPUTER SOFTWARE SELECTION AND EVALUATION;

EID: 77954492900     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICST.2010.55     Document Type: Conference Paper

References (30)

1. L.J. White and B. Fei, "Failures of GUI Tests on Different Computer Platforms," ISSRE 2003 Fast Abstract.
2. A. Duarte, G. Wagner, F. Brasileiro and W. Cirne, "Multienvironment software testing on the grid," In Proceedings of 2006 Workshop on Parallel and Distributed Systems: Testing and Debugging, pp.61-68, 2006.
3. Orit Edelstein, Eitan Farchi, Yarden Nir, Gil Ratsaby, and Shmuel Ur, "Multithreaded Java program test generation," IBM Systems Journal, 41(1), 2002.
4. T. Andrews, S. Qadeer, J. Rehof, S. K. Rajamani, and Y. Xie, "Zing: exploiting program structure for model checking concurrent software," International Conference on Concurrency Theory, Sep. 2004
5. M. Musuvathi, S. Qadeer, "CHESS: Systematic stress testing of concurrent software," In Logic-Based Program Synthesis and Transformation, Springer (2006) 15-16 LNCS 4407.
6. Hans van Vliet. Software Engineering: Principles and Practice, 2nd Edition, Wiley, Sept 2000.
7. Wenbing Zhao, "Byzantine Fault Tolerance for Nondeterministic Applications," Third IEEE International Symposium on Dependable, Autonomic and Secure Computin., pp.108-118, 25-26 Sept. 2007.
8. D. Leon, A. Podgurski, and L.J. White, "Multivariate visualization in observation-based testing," In Proceedings of the 22nd International Conference on Software Engineering (Limerick, Ireland, June 2000), ACM Press, 116-125.
9. J. Steven, P. Chandra, B. Fleck, and A. Podgurski., "jRapture: a capture/replay tool for observation-based testing," In Proceedings of the 2000 International Symposium on Software Testing and Analysis (Portland, Oregon, August 2000).
10. W. Dickinson, D. Leon, and A. Podgurski, "Pursuing failure: The distribution of program failures in a profile space," In Proceedings of the Joint 8th European Software Engeneering Conference and 9th ACM SIGSOFT Symposium on the Foundation of Software Engineering, pages 246-255, Sept. 2001.
11. J. Slember and P. Narasimhan, "Nondeterminism in ORBs: The Perception and the Reality," 17th International Conference on Database and Expert Systems Applications, pp.379-384, 2006.
12. M. Mitchell and J. Jolley, Research Design Explained, 4th Edition, New York: Harcourt, 2001.
13. M. B. Cohen, J. Snyder, and G. Rothermel, "Testing across configurations: Implications for combinatorial testing," SIGSOFT Softw. Eng. Notes 31(6), pp. 1-9, 2006.
14. X. Qu, M. B. Cohen, and G. Rothermel, "Configuration-aware regression testing: An empirical study of sampling and prioritization," In Proceedings of the 2008 International Symposium on Software Testing and Analysis, pp.75-86, 2008.
15. R.S. Pressman, Software Engineering: A Practitioner's Approach, 6th edition, McGraw Hill, 2005.
16. D. Kuhn and M. Reilly, "An investigation of the applicability of design of experiments to software testing," In Proceedings of the NASA/IEEE Software Engineering Workshop, pp. 91-95, 2002.
17. D. Kuhn, D. R. Wallace, and A. M. Gallo, "Software fault interactions and implications for software testing," IEEE Transactions on Software Engineering, 30(6), pp. 418-421, 2004.
18. R. Krishnan, S. M. Krishna, and P. S. Nandhan, "Combinatorial testing: Learnings from our experience," SIGSOFT Software Engineering Notes, 32(3), pp. 1-8, 2007.
19. K. Burr and W. Young, "Combinatorial test techniques: Table-based automation, test generation and code coverage," In Proceedings of the International Conference on Software Testing Analysis & Review, 1998.
20. D. Hoskins, R. C. Turban, and C. J. Colbourn, "Experimental designs in software engineering: D-optimal designs and covering arrays," In Proceedings of the 2004 ACM Workshop on Interdisciplinary Software Engineering Research, pp. 55-66, 2004.
21. D. M. Cohen, S. R. Dalal, J. Parelius, and G. C. Patton, "Combinatorial Design Approach to Test Generation", IEEE Software, pp. 83-88, 1996.
22. Atif M. Memon, "An event-flow model of gui-based applications for testing," Software Testing, Verification and Reliability, vol.17, no.3, pp.137-157, 2007.
23. N. Tillman and J. de Halleux, "Pex - white box test generation for. NET," In Proceedings of the International Conference on Tests and Proofs, pp.134-153, 2008.
24. C. Csallner, N. Tillmann, and Y. Smaragdakis, "DySy: Dynamic symbolic execution for invariant inference", In Proceedings of the 30th international conference on Software engineering, pp.281-290, 2008.
25. X. Qu, M. B. Cohen, and G. Rothermel, "Configuration-aware regression testing: An empirical study of sampling and prioritization," In Proceedings of the International Symposium on Software Testing and Analysis, 2008.
26. A. C. Dias Neto, R. Subramanyan, M. Vieira, and G. H. Travassos, "A survey on model-based testing approaches: A systematic review," In Proceedings of the 1st ACM International Workshop on Empirical Assessment of Software Engineering Languages and Technologies.
27. A. Memon, A. Porter, C. Yilmaz, A. Nagarajan, D. Schmidt, and B. Natarajan, "Skoll: distributed continuous quality assurance," In Proceedings of 26th International Conference on Software Engineering, 2004, pp. 459-468, May 2004.
28. C. Yilmaz, M.B. Cohen, and A. Porter, "Covering arrays for efficient fault characterization in complex configuration spaces," In Intl. Symp. on Software Testing and Analysis (ISSTA), pp. 45-54, July 2004.
29. IEEE Standard Glossary of Software Engineering Terminology, IEEE Std 610.12-1990, 1990.
30. P. Amman and J. Offut, Introduction to Software Testing, Cambridge University Press, 2008.