Leveraging test generation and specification mining for automated bug detection without false positives

Proceedings - International Conference on Software Engineering

Volumn , Issue , 2012, Pages 288-298

  Pradel, Michael ^a   Gross, Thomas R ^a  

^a ETH ZURICH   (Switzerland)

Author keywords

Bug detection; False positives; Specification mining

Indexed keywords

AUTOMATICALLY GENERATED; BUG DETECTION; DYNAMIC SPECIFICATIONS; FALSE POSITIVE; JAVA PROGRAM; NOVEL TECHNIQUES; SPECIFICATION MINING; TEST CASE; TEST EXECUTION; TEST GENERATIONS; TRUE POSITIVE; USAGE PATTERNS;

AUTOMATIC TEST PATTERN GENERATION; JAVA PROGRAMMING LANGUAGE; PROGRAM DEBUGGING; SOFTWARE ENGINEERING; SOFTWARE TESTING;

SPECIFICATIONS;

EID: 84864256871     PISSN: 02705257     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSE.2012.6227185     Document Type: Conference Paper

References (44)

1. C. Csallner and Y. Smaragdakis, "JCrasher: an automatic robustness tester for Java," Software Pract Exper, vol. 34, no. 11, pp. 1025-1050, Sep. 2004.
2. C. Pacheco, S. K. Lahiri, M. D. Ernst, and T. Ball, "Feedback- directed random test generation," in ICSE, 2007, pp. 75-84.
3. I. Ciupa, A. Leitner, M. Oriol, and B. Meyer, "ARTOO: adaptive random testing for object-oriented software," in ICSE, 2008, pp. 71-80.
4. G. Ammons, R. Bodík, and J. R. Larus, "Mining specifications," in POPL, 2002, pp. 4-16.
5. M. Pradel and T. R. Gross, "Automatic generation of object usage specifications from large method traces," in ASE, 2009, pp. 371-382.
6. M. Pradel, P. Bichsel, and T. R. Gross, "A framework for the evaluation of specification miners based on finite state machines," in ICSM, 2010, pp. 1-10.
7. C. Allan, P. Avgustinov, A. S. Christensen, L. Hendren, S. Kuzins, O. Lhoták, O. de Moor, D. Sereni, G. Sittampalam, and J. Tibble, "Adding trace matching with free variables to AspectJ," in OOPSLA, 2005, pp. 345-364.
8. M. C. Martin, V. B. Livshits, and M. S. Lam, "Finding application errors and security flaws using PQL: A program query language," in OOPSLA, 2005, pp. 365-383.
9. F. Chen and G. Rosu, "MOP: An efficient and generic runtime verification framework," in OOPSLA, 2007, pp. 569-588.
10. S. M. Blackburn et al., "The DaCapo benchmarks: Java benchmarking development and analysis," in OOPSLA, 2006, pp. 169-190.
11. T. A. Henzinger, R. Jhala, and R. Majumdar, "Permissive interfaces," in ESEC/FSE, 2005, pp. 31-40.
12. M. Gabel and Z. Su, "Online inference and enforcement of temporal properties," in ICSE, 2010, pp. 15-24.
13. H. Zhong, L. Zhang, T. Xie, and H. Mei, "Inferring resource specifications from natural language API documentation," in ASE, 2009, pp. 307-318.
14. J. Whaley, M. C. Martin, and M. S. Lam, "Automatic extraction of object-oriented component interfaces," in ISSTA, 2002, pp. 218-228.
15. S. Shoham, E. Yahav, S. Fink, and M. Pistoia, "Static specification mining using automata-based abstractions," in ISSTA, 2007, pp. 174-184.
16. M. Gabel and Z. Su, "Javert: Fully automatic mining of general temporal properties from dynamic traces," in FSE, 2008, pp. 339-349.
17. D. Lorenzoli, L. Mariani, and M. Pezzè, "Automatic generation of software behavioral models," in ICSE, 2008, pp. 501-510.
18. C. Lee, F. Chen, and G. Rosu, "Mining parametric specifications," in ICSE, 2011, pp. 591-600.
19. I. Ciupa, A. Pretschner, A. Leitner, M. Oriol, and B. Meyer, "On the predictability of random tests for object-oriented software," in ICST, 2008, pp. 72-81.
20. A. Bessey, K. Block, B. Chelf, A. Chou, B. Fulton, S. Hallem, C. Henri-Gros, A. Kamsky, S. McPeak, and D. R. Engler, "A few billion lines of code later: Using static analysis to find bugs in the real world," Commun ACM, vol. 53, no. 2, pp. 66-75, 2010.
21. C. Pacheco, S. K. Lahiri, and T. Ball, "Finding errors in .NET with feedback-directed random testing," in ISSTA, 2008, pp. 87-96.
22. R. Vallée-Rai, P. Co, E. Gagnon, L. J. Hendren, P. Lam, and V. Sundaresan, "Soot - a Java bytecode optimization framework," in CASCON, 1999, pp. 125-135.
23. M. D. Ernst, J. Cockrell, W. G. Griswold, and D. Notkin, "Dynamically discovering likely program invariants to support program evolution," IEEE T Software Eng, vol. 27, no. 2, pp. 213-224, 2001.
24. S. Hangal and M. S. Lam, "Tracking down software bugs using automatic anomaly detection," in ICSE, 2002, pp. 291-301.
25. A. Wasylkowski and A. Zeller, "Mining temporal specifications from object usage," in ASE, 2009, pp. 295-306.
26. S. Thummalapenta and T. Xie, "Mining exception-handling rules as sequence association rules," in ICSE, 2009, pp. 496-506.
27. T. T. Nguyen, H. A. Nguyen, N. H. Pham, J. M. Al-Kofahi, and T. N. Nguyen, "Graph-based mining of multiple object usage patterns," in ESEC/FSE, 2009, pp. 383-392.
28. M. Monperrus, M. Bruch, and M. Mezini, "Detecting missing method calls in object-oriented software," in ECOOP, 2010, pp. 2-25.
29. M. Pradel, C. Jaspan, J. Aldrich, and T. R. Gross, "Statically checking API protocol conformance with mined multi-object specifications," in International Conference on Software Engineering (ICSE), 2012.
30. H. Jaygarl, K.-S. Lu, and C. K. Chang, "GenRed: A tool for generating and reducing object-oriented test cases," in COMPSAC, 2010, pp. 127-136.
31. W. Zheng, Q. Zhang, M. R. Lyu, and T. Xie, "Random unit-test generation with MUT-aware sequence recommendation," in ASE, 2010, pp. 293-296.
32. W. Jin, A. Orso, and T. Xie, "Automated behavioral regression testing," in ICST, 2010, pp. 137-146.
33. S. Thummalapenta, T. Xie, N. Tillmann, J. de Halleux, and W. Schulte, "MSeqGen: Object-oriented unit-test generation via mining source code," in ESEC/FSE, 2009, pp. 193-202.
34. T. Xie and D. Notkin, "Automatic extraction of object-oriented observer abstractions from unit-test executions," in ICFEM, 2004, pp. 290-305.
35. S. Thummalapenta, J. de Halleux, N. Tillmann, and S. Wadsworth, "DyGen: Automatic generation of high-coverage tests via mining gigabytes of dynamic traces," in TAP, 2010, pp. 77-93.
36. S. Zhang, D. Saff, Y. Bu, and M. D. Ernst, "Combined static and dynamic automated test generation," in ISSTA, 2011, pp. 353-363.
37. T. Xie and D. Notkin, "Mutually enhancing test generation and specification inference," in FATES, 2003, pp. 60-69.
38. V. Dallmeier, N. Knopp, C. Mallon, S. Hack, and A. Zeller, "Generating test cases for specification mining," in ISSTA, 2010, pp. 85-96.
39. T. Xie and D. Notkin, "Tool-assisted unit test selection based on operational violations," in ASE, 2003, pp. 40-48.
40. M. Renieris and S. P. Reiss, "Fault localization with nearest neighbor queries," in ASE, 2003, pp. 30-39.
41. V. Dallmeier, C. Lindig, and A. Zeller, "Lightweight defect localization for Java," in ECOOP, 2005, pp. 528-550.
42. L. Mariani, F. Pastore, and M. Pezzè, "Dynamic analysis for diagnosing integration faults," IEEE Trans Sw Eng, vol. 37, no. 4, pp. 486-508, 2011.
43. W. Weimer, T. Nguyen, C. Le Goues, and S. Forrest, "Automatically finding patches using genetic programming," in ICSE, 2009, pp. 363-374.
44. Y.Wei, Y. Pei, C. A. Furia, L. S. Silva, S. Buchholz, B. Meyer, and A. Zeller, "Automated fixing of programs with contracts," in ISSTA, 2010, pp. 61-72.