Comparing the effectiveness of equivalence partitioning, branch testing and code reading by stepwise abstraction applied by subjects

Proceedings - IEEE 5th International Conference on Software Testing, Verification and Validation, ICST 2012

Volumn , Issue , 2012, Pages 330-339

  Juristo, N ^a   Vegas, S ^a   Solari, M ^b   Abrahao, S ^c   Ramos, I ^d  

^a UNIVERSIDAD POLITÉCNICA DE MADRID   (Spain)

^b UNIVERSIDAD ORT URUGUAY   (Uruguay)

^c UNIVERSITAT POLITÈCNICA DE VALÈNCIA   (Spain)

^d UNIVERSITY OF SEVILLE   (Spain)

Author keywords

combination of experimental results; experimentation; Verification and validation

Indexed keywords

BRANCH TESTING; COMBINATION OF EXPERIMENTAL RESULTS; CONTEXTUAL VARIABLES; EMPIRICAL STUDIES; EXPERIMENTATION; VERIFICATION AND VALIDATION;

ABSTRACTING; EXPERIMENTS;

SOFTWARE TESTING;

EID: 84862338141     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICST.2012.113     Document Type: Conference Paper

References (58)

1. V. R. Basili, S. Green, O. Laitenberger, F. Lanubile, F. Shull, S. Sorumgard, M. V. Zelkowitz, The Empirical Investigation of Perspective Based Reading. Journal of Empirical Software Engineering. 1(2):133-164, 1996. (Pubitemid 126708443)
2. V.R. Basili, R.W. Selby. Comparing the Effectiveness of Software Testing Strategies. IEEE Transactions on Software Engineering, 13(2):1278-1296. 1987.
3. B. Beizer. Software Testing Techniques. International Thomson Computer Press, Second Edition. 1990.
4. A. Bertolino. Guide to the Knowledge area of Software Testing. Software Engineering Body of Knowledge. IEEE Computer Society. 2004.
5. J. Bible, G. Rothermel, D. Rosenblum. A Comparative Study of Coarse- and Fine-Grained Safe Regression Test Selection. ACM Transactions on Software Engineering and Methodology 10(2):149-183. 2001. (Pubitemid 33602333)
6. J.M. Bieman, J.L. Schultz. An Empirical Evaluation (and Specification) of the All-du-paths Testing Criterion. Software Engineering Journal, January 1992, pp. 43-51.
7. S. Biffl, Analysis of the Impact of Reading Technique and Inspector Capability on Individual Inspection Performance. 7th Asia-Pacific Software Engineering Conference, pp. 136-145. 2000.
8. L.C. Briand, M. Penta, Y. Labiche. Assessing and Improving State-Based Class Testing: A Series of Experiments. IEEE Transactions on Software Engineering. 30(11):770-793. 2004. (Pubitemid 40055829)
9. T.Y. Chen, Y.T. Yu. On the Relationships between Partition and Random Testing. IEEE Transactions on Software Engineering. 20(12): 977-980, 1994.
10. L.A. Clarke, A. Podgurski, D.J. Richardson, S.J. Zeil. A Formal Evaluation of Data Flow Path Selection Criteria. IEEE Transactions on Software Engineering. 15(11):1318-1332, 1989. (Pubitemid 20652937)
11. H. Do, S. Elbaum, G. Rothermel. Supporting Controlled Experimentation with Testing Techniques: An Infrastructure and its Potential Impact. Empirical Software Engineering. 10:405-435, 2005. (Pubitemid 41408554)
12. A. Dunsmore, M. Roper, M. Wood. Further Investigations into the Development and Evaluation of Reading Techniques for Object-oriented Code Inspection. 24th International Conference on Software Engineering, pp. 47-57.2002.
13. J.W. Duran, S.C. Ntafos. An Evaluation of Random Testing. IEEE Transactions on Software Engineering. SE-10(4): 438-444, 1984.
14. S. Elbaum, A.G. Mailshevsky, G. Rothermel. Prioritizing Test Cases for Regression Testing. International Symposium on Software Testing and Analysis. 2000, pp. 102-112.
15. P.G. Frankl, Y. Deng. Comparison of Delivered Reliability of Branch, Data Flow and Operational Testing, a case study. International Symposium on Software Testing and Analysis. 2000.
16. P. Frankl, O. Iakounenko. Further Empirical Studies of Test Effectiveness. International Symposium on Foundations on Software Engineering. Pp 153-162. 1998
17. P.G.Frankl, S.N. Weiss. An Experimental Comparison of the Effectiveness of Branch Testing and Data Flow Testing. IEEE Transactions on Software Engineering, 19(8):774-787. 1993.
18. P.G. Frankl, S.N. Weiss, C. Hu. All-Uses vs Mutation Testing: An Experimental Comparison of Effectiveness. Journal of Systems and Software, 38:235-253. 1997. (Pubitemid 127384432)
19. P.G. Frankl, E.J. Weyuker. Assessing the Fault--Detecting Ability of Testing Methods. International Conference on Software for Critical Systems, pp. 77-91. 1991.
20. O.S. Gómez, N. Juristo, S. Vegas. Replication Types in Experimental Disciplines. International Symposium on Empirical Software Engineering and Measurement (ESEM'10). Pages 19-28. September 16-17, 2010. Bolzano, Italy.
21. T.L. Graves, M.J. Harrold, J. Kim, A. Porter, G. Rothermel. An Empirical Study of Regression Test selection Techniques. ACM Transactions on Software Engineering and Methodology, 10(2):184-208. 2001. (Pubitemid 33602334)
22. th edition. Prentice Hall. 2006.
23. R. Hamlet. Probable correctness theory. Information Processing Letters. 25:17-25, 1987.
24. D. Hamlet, R. Taylor. Partition Testing does not Inspire Confidence. IEEE Transactions on Software Engineering. 16(12): 1402-1411, 1990.
25. M. Hutchins, H. Foster, T. Goradia, T. Ostrand. Experiments on the Effectiveness of Dataflow- and Controlflow-Based Test Adequacy Criteria. 16th International Conference on Software Engineering. Pp. 191-200. 1994.
26. Juristo N, Moreno A.M. Basics of Software Engineering Experimentation. Kluwer. 2001.
27. N. Juristo, A.M. Moreno, S. Vegas, M. Solari. In Search of What We Experimentally Know about Unit Testing. IEEE Software. 23(6):72-80. 2006. (Pubitemid 44824160)
28. E. Kamsties, C.M. Lott. An Empirical Evaluation of Three Defect-Detection Techniques. Fifth European Software Engineering Conference. 1995.
29. J.M. Kim, A. Porter, G. Rothermel. An Empirical Study of Regression Test Application Frequency. 22nd International Conference on Software Engineering. Pp.126-135. 2000.
30. H. Lee, Y. Ma, Y. Kwon. Empirical Evaluation of Orthogonality of Class Mutation Operators. 11th Asia-Pacific Software Engineering Conference. 2004, pp. 512-518.
31. th International Conference on Software Engineering. 2005.
32. R.C. Linger, H.D. Mills, B.I. Witt. Structured Programming: Theory and Practice. Addison-Wesley, 1979.
33. J. Maldonado, J. Carver, F. Shull, S. Fabbri, E. Dória, L. Martimiano, M. Mendonça, V. Basili. Perspective-based Reading: A Replicated Experiment Focused on Individual Reviewer Effectiveness. Empirical Software Engineering. 11(1):119-142, 2006. (Pubitemid 43260556)
34. G.J. Myers. A Controlled Experiment in Program Testing and Code Walkthroughs/Inspections. Communications of the ACM. 21(9): 760-768, 1978.
35. Myers G.J. T. Badgett, C. Sandler. The Art of Software Testing. Wiley-Interscience. 2nd edition. 2004.
36. S. Ntafos. A comparison of some structural testing strategies. IEEE Transactions on Software Engineering. 14(6):368-874, 1988.
37. S.C. Ntafos. On Random and Partition Testing. International Symposium on Software Testing and Analysis, pp. 42-48. 1998.
38. A.J. Offutt, S.D. Lee. An Empirical Evaluation of Weak Mutation. IEEE Transactions on Software Engineering, 20(5):337-344. 1994.
39. A.J. Offutt, A. Lee, G. Rothermel, RH. Untch, C. Zapf. An Experimental Determination of Sufficient Mutant Operators. ACM Transactions on Software Engineering and Methodology, 5(2):99-118. 1996. (Pubitemid 126418670)
40. A. Porter, L. Votta, V.R. Basili. Comparing Detection Methods for Software Requirements Inspection: A Replicated Experiment. IEEE Transactions on Software Engineering, 21(6): 563-575, 1995.
41. S. Rapps, E. Weyuker. Selecting Software Test Data Using Data Flow Information. IEEE Transactions on Software Engineering. SE-11(4):367-375, 1985. (Pubitemid 15491383)
42. M. Roper, M. Wood, J. Miller. An empirical evaluation of defect detection techniques. Information and Software Technology. 39:763-775. 1997. (Pubitemid 127371614)
43. D.S. Rosenblum, E.J. Weyuker. Using Coverage Information to Predict the Cost-Effectiveness of Regression Testing Strategies. IEEE Transactions on Software Engineering. 23(3):146-156, 1997. (Pubitemid 127828283)
44. G. Rothermel, S. Elbaum, A.B. Malishevsky, P. Kallakuri, X. Qiu. On Test Suite Composition and Cost-Effective Regression Testing. ACM Transactions on Software Engineering and Methodology. 13(3):277-331. 2004.
45. G. Rothermel, M.J. Harrold. Analyzing Regression Test Selection Techniques. IEEE Transactions on Software Engineering. 22(8):529-551, 1996. (Pubitemid 126771681)
46. G. Rothermel, M.J. Harrold. Empirical Studies of a Safe Regression Test Selection Technique. IEEE Transactions on Software Engineering. 24(6):401-419. 1998. (Pubitemid 128741964)
47. G. Rothermel, R.H. Untch, C. Chu, M.J. Harrold. Test Case Prioritization: An Empirical Study. International Conference on Software Maintenance. Pp. 179-188. 1999.
48. T. Thelin, P. Runeson, C. Wohlin, T. Olsson, C. Andersson. Evaluation of Usage-Based Reading-Conclusions after Three Experiments. Empirical Software Engineering. 9:77-110, 2004.
49. S. Vegas, N. Juristo, A.M. Moreno, M. Solari, P. Letelier. Analysis of the Influence of Communication between Researchers on Experiment Replication. International Symposium on Empirical Software Engineering. Pp. 28-37. 2006.
50. F. Vokolos, P.G. Frankl. Empirical Evaluation of the Textual differencing Regression Testing Technique. International Conference on Software Maintenance. 1998.
51. M.D. Weiser, J.D. Gannon, P.R. McMullin. Comparison of Structural Test Coverage Metrics. IEEE Software. 2(3):80-85, 1985. (Pubitemid 15465503)
52. E.J. Weyuker. The Complexity of Data Flow Criteria for Test Data Selection. Information Processing Letters. 19(2):103-109. 1984.
53. E.J. Weyuker. The Cost of Data Flow Testing: An Empirical Study. IEEE Transactions on Software Engineering. 16(2): 121-128, 1990.
54. E.J. Weyuker, B. Jeng. Analyzing Partition Testing Strategies. IEEE Transactions on Software Engineering. 17(7): 703-711, 1991. (Pubitemid 21674681)
55. W.E. Wong, J.R. Horgan, S. London, H. Agrawal. A Study of Effective Regression Testing in Practice. 8th International Symposium on Software Reliability Engineering. Pp.264-274. 1998
56. E. Wong, A.P. Mathur. Fault Detection Effectiveness of Mutation and Data-flow Testing. Software Quality Journal, 4:69-83. 1995.
57. T.W Wright. A Treatise on the Adjustment of Observations by the method of Least Squares. Van Nostrand. 1884.
58. S.J. Zeil. Selectivity of Data - Flow and Control - Flow Path Criteria. 2nd Workshop on Software Testing, Verification and Analysis, pp. 215-222. 1988.