Taming compiler fuzzers

Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI)

Volumn , Issue , 2013, Pages 197-207

  Chen, Yang ^a   Groce, Alex ^b   Zhang, Chaoqiang ^b   Wong, Weng Keen ^b   Fern, Xiaoli ^b   Eide, Eric ^a   Regehr, John ^a  

^a UNIVERSITY OF UTAH   (United States)

^b OREGON STATE UNIVERSITY   (United States)

Author keywords

Automated testing; Bug reporting; Compiler defect; Compiler testing; Fuzz testing; Random testing; Test case reduction

Indexed keywords

AUTOMATED TESTING; BUG REPORTING; COMPILER DEFECTS; COMPILER TESTING; FUZZ TESTING; RANDOM TESTING;

ENGINES; HIGH LEVEL LANGUAGES; SOFTWARE TESTING;

PROGRAM COMPILERS;

EID: 84883128500     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2462156.2462173     Document Type: Conference Paper

References (45)

1. James H. Andrews, Alex Groce, Melissa Weston, and Ru-Gang Xu. Random test run length and effectiveness. In Proc. ASE, pages 19-28, September 2008.
2. Abhishek Arya and Cris Neckar. Fuzzing for security, April 2012. http://blog.chromium.org/2012/04/fuzzing-for-security.html.
3. Mariano Ceccato, Alessandro Marchetto, Leonardo Mariani, Cu D. Nguyen, and Paolo Tonella. An empirical study about the effectiveness of debugging when random test cases are used. In Proc. ICSE, pages 452-462, June 2012.
4. Silvio Cesare and Yang Xiang. Malware variant detection using similarity search over sets of control flow graphs. In Proc. TRUSTCOM, pages 181-189, November 2011.
5. Sagar Chaki, Alex Groce, and Ofer Strichman. Explaining abstract counterexamples. In Proc. FSE, pages 73-82, 2004.
6. Koen Claessen and John Hughes. QuickCheck: a lightweight tool for random testing of Haskell programs. In Proc. ICFP, pages 268-279, 2000.
7. Holger Cleve and Andreas Zeller. Locating causes of program failures. In Proc. ICSE, pages 342-351, May 2005.
8. Shai Fine and Yishay Mansour. Active sampling for multiple output identification. Machine Learning, 69(2-3):213-228, 2007.
9. Patrick Francis, David Leon, Melinda Minch, and Andy Podgurski. Tree-based methods for classifying software failures. In Proc. ISSRE, pages 451-462, November 2004.
10. Teofilo F. Gonzalez. Clustering to minimize the maximum intercluster distance. Theoretical Computer Science, 38:293-306, 1985.
11. Alex Groce. Error explanation with distance metrics. In Proc. TACAS, pages 108-122, March 2004.
12. Alex Groce, Gerard Holzmann, and Rajeev Joshi. Randomized differential testing as a prelude to formal verification. In Proc. ICSE, pages 621-631, May 2007.
13. Alex Groce, Chaoqiang Zhang, Eric Eide, Yang Chen, and John Regehr. Swarm testing. In Proc. ISSTA, pages 78-88, July 2012.
14. Christian Holler, Kim Herzig, and Andreas Zeller. Fuzzing with code fragments. In Proc. USENIX Security, pages 445-458, August 2012.
15. James A. Jones, James F. Bowring, and Mary Jean Harrold. Debugging in parallel. In Proc. ISSTA, pages 16-26, July 2007.
16. James A. Jones and Mary Jean Harrold. Empirical evaluation of the Tarantula automatic fault-localization technique. In Proc. ASE, pages 273-282, November 2005.
17. James A. Jones, Mary Jean Harrold, and John Stasko. Visualization of test information to assist fault localization. In Proc. ICSE, pages 467-477, May 2002.
18. Yungbum Jung, Jaehwang Kim, Jaeho Shin, and Kwangkeun Yi. Taming false alarms from a domain-unaware C analyzer by a Bayesian statistical post analysis. In Proc. SAS, pages 203-217, September 2005.
19. Ted Kremenek and Dawson Engler. Z-ranking: using statistical analysis to counter the impact of static analysis approximations. In Proc. SAS, pages 295-315, June 2003.
20. Vladimir I. Levenshtein. Binary codes capable of correcting deletions, insertions, and reversals. Soviet Physics Doklady, 10:707-710, 1966.
21. Ben Liblit, Alex Aiken, Alice X. Zheng, and Michael I. Jordan. Bug isolation via remote program sampling. In Proc. PLDI, pages 141-154, June 2003.
22. Ben Liblit, Mayur Naik, Alice X. Zheng, Alex Aiken, and Michael I. Jordan. Scalable statistical bug isolation. In Proc. PLDI, pages 15-26, June 2005.
23. Chao Liu and Jiawei Han. Failure proximity: a fault localization-based approach. In Proc. FSE, pages 46-56, November 2006.
24. William M. McKeeman. Differential testing for software. Digital Technical Journal, 10(1):100-107, December 1998.
25. Nicholas Nethercote and Julian Seward. Valgrind: a framework for heavyweight dynamic binary instrumentation. In Proc. PLDI, pages 89-100, June 2007.
26. Dan Pelleg and Andrew Moore. Active learning for anomaly and rare-category detection. In Advances in Neural Information Processing Systems 18, December 2004.
27. Dan Pelleg and Andrew W. Moore. X-means: Extending K-means with efficient estimation of the number of clusters. In Proc. ICML, pages 727-734, June/July 2000.
28. Andy Podgurski, David Leon, Patrick Francis, Wes Masri, Melinda Minch, Jiayang Sun, and Bin Wang. Automated support for classifying software failure reports. In Proc. ICSE, pages 465-475, May 2003.
29. John Regehr, Yang Chen, Pascal Cuoq, Eric Eide, Chucky Ellison, and Xuejun Yang. Test-case reduction for C compiler bugs. In Proc. PLDI, pages 335-346, June 2012.
30. Manos Renieris and Steven Reiss. Fault localization with nearest neighbor queries. In Proc. ASE, pages 30-39, October 2003.
31. Jesse Ruderman. Introducing jsfunfuzz. http://www.squarefree. com/2007/08/02/introducing-jsfunfuzz/.
32. Jesse Ruderman. Mozilla bug 349611. https://bugzilla.mozilla.org/show- bug.cgi?id=349611 (A meta-bug containing all bugs found using jsfunfuzz.).
33. Jesse Ruderman. How my DOM fuzzer ignores known bugs, 2010. http://www.squarefree.com/2010/11/21/how-my-dom-fuzzer-ignores-known-bugs/.
34. G. Salton, A. Wong, and C. S. Yang. A vector space model for automatic indexing. CACM, 18(11):613-620, November 1975.
35. Saul Schleimer, Daniel S. Wilkerson, and Alex Aiken. Winnowing: local algorithms for document fingerprinting. In Proc. SIGMOD, pages 76-85, June 2003.
36. Alexander Strehl and Joydeep Ghosh. Cluster ensembles-a knowledge reuse framework for combining multiple partitions. The Journal of Machine Learning Research, 3:583-617, 2003.
37. Chengnian Sun, David Lo, Siau-Cheng Khoo, and Jing Jiang. Towards more accurate retrieval of duplicate bug reports. In Proc. ASE, pages 253-262, November 2011.
38. Chengnian Sun, David Lo, Xiaoyin Wang, Jing Jiang, and Siau-Cheng Khoo. A discriminative model approach for accurate duplicate bug report retrieval. In Proc. ICSE, pages 45-54, May 2010.
39. Vipindeep Vangala, Jacek Czerwonka, and Phani Talluri. Test case comparison and clustering using program profiles and static execution. In Proc. ESEC/FSE, pages 293-294, August 2009.
40. Pavan Vatturi and Weng-Keen Wong. Category detection using hierarchical mean shift. In Proc. KDD, pages 847-856, June/July 2009.
41. Andrew Walenstein, Mohammad El-Ramly, James R. Cordy, William S. Evans, Kiarash Mahdavi, Markus Pizka, Ganesan Ramalingam, and Jürgen Wolff von Gudenberg. Similarity in programs. In Duplication, Redundancy, and Similarity in Software, Dagstuhl Seminar Proceedings, July 2006.
42. Xiaoyin Wang, Lu Zhang, Tao Xie, John Anvik, and Jiasu Sun. An approach to detecting duplicate bug reports using natural language and execution information. In Proc. ICSE, pages 461-470, May 2008.
43. David B. Whalley. Automatic isolation of compiler errors. TOPLAS, 16(5):1648-1659, September 1994.
44. Xuejun Yang, Yang Chen, Eric Eide, and John Regehr. Finding and understanding bugs in C compilers. In Proc. PLDI, pages 283-294, June 2011.
45. Andreas Zeller and Ralf Hildebrandt. Simplifying and isolating failure-inducing input. IEEE TSE, 28(2):183-200, February 2002.