Concolic Metamorphic Debugging

Proceedings - International Computer Software and Applications Conference

Volumn 2, Issue , 2015, Pages 232-241

  Jin, Hao ^a   Jiang, Yanyan ^a   Liu, Na ^a   Xu, Chang ^a   Ma, Xiaoxing ^a   Lu, Jian ^a  

^a NANJING UNIVERSITY   (China)

Author keywords

Debugging; Fault localization; Metamorphic relation

Indexed keywords

APPLICATION PROGRAMS; COMPUTER DEBUGGING; COMPUTER SOFTWARE; JAVA PROGRAMMING LANGUAGE;

CONCOLIC TESTING; FAULT LOCALIZATION; JAVA PROGRAM; LABOR INTENSIVE; METAMORPHIC RELATIONS; NEW PROGRAMS; REAL-WORLD; TEST RUNS;

PROGRAM DEBUGGING;

EID: 84962164551     PISSN: 07303157     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/COMPSAC.2015.79     Document Type: Conference Paper

References (43)

1. B. Hailpern and P. Santhanam, "Software debugging, testing, and verification," IBM Systems Journal, vol. 41, no. 1, pp. 4-12, 2002
2. R. C. Seacord, D. Plakosh, and G. A. Lewis, Modernizing legacy systems: Software technologies, engineering processes, and business practices, 2003
3. H. Agrawal and J. R. Horgan, "Dynamic program slicing," in Proceedings of the ACM SIGPLAN 1990 Conference on Programming Language Design and Implementation, ser. PLDI '90, 1990, pp. 246-256
4. M. Weiser, "Program slicing," in Proceedings of the 5th International Conference on Software Engineering, ser. ICSE '81, Piscataway, NJ, USA, 1981, pp. 439-449
5. D. Qi, A. Roychoudhury, Z. Liang, and K. Vaswani, "Darwin: An approach to debugging evolving programs," ACM Trans. Softw. Eng. Methodol., vol. 21, no. 3, pp. 19:1-19:29, Jul. 2012
6. A. Zeller, "Isolating cause-effect chains from computer programs," in Proceedings of the 10th ACM SIGSOFT Symposium on Foundations of Software Engineering, ser. SIGSOFT '02/FSE-10, 2002, pp. 1-10
7. A. Zeller and R. Hildebrandt, "Simplifying and isolating failure-inducing input," Software Engineering, IEEE Transactions on, vol. 28, no. 2, pp. 183-200, Feb 2002
8. X. Zhang, N. Gupta, and R. Gupta, "Locating faults through automated predicate switching," in Proceedings of the 28th International Conference on Software Engineering, ser. ICSE '06, 2006, pp. 272-281
9. T. Ball and J. R. Larus, "Efficient path profiling," in Proceedings of the 29th Annual ACM/IEEE International Symposium on Microarchitecture, ser. MICRO 29, Washington, DC, USA, 1996, pp. 46-57
10. T. Chilimbi, B. Liblit, K. Mehra, A. Nori, and K. Vaswani, "Holmes: Effective statistical debugging via efficient path profiling," in Software Engineering, 2009. ICSE 2009. IEEE 31st International Conference on, May 2009, pp. 34-44
11. E. J. Weyuker, "On testing non-testable programs," The Computer Journal, vol. 25, no. 4, pp. 465-470, 1982
12. T. Y. Chen, S. C. Cheung, and S. Yiu, "Metamorphic testing: A new approach for generating next test cases," Department of Computer Science, Hong Kong University of Science and Technology, Tech. Rep. HKUST-CS98-01, 1998
13. C. Cadar, D. Dunbar, and D. Engler, "Klee: Unassisted and automatic generation of high-coverage tests for complex systems programs," in Proceedings of the 8th USENIX Conference on Operating Systems Design and Implementation, ser. OSDI'08, Berkeley, CA, USA, 2008, pp. 209-224
14. P. Godefroid, N. Klarlund, and K. Sen, "Dart: Directed automated random testing," in Proceedings of the 2005 ACM SIGPLAN Conference on Programming Language Design and Implementation, ser. PLDI '05, 2005, pp. 213-223
15. K. Sen, D. Marinov, and G. Agha, "Cute: A concolic unit testing engine for c," in Proceedings of the 10th European Software Engineering Conference Held Jointly with 13th ACM SIGSOFT International Symposium on Foundations of Software Engineering, ser. ESEC/FSE-13, 2005, pp. 263-272
16. K. Havelund and T. Pressburger, "Model checking java programs using java pathfinder," International Journal on Software Tools for Technology Transfer, vol. 2, no. 4, pp. 366-381, 2000
17. C. S. PǍsǍreanu and N. Rungta, "Symbolic pathfinder: Symbolic execution of java bytecode," in Proceedings of the IEEE/ACM International Conference on Automated Software Engineering, ser. ASE '10, 2010, pp. 179-180
18. C. Murphy, K. Shen, and G. Kaiser, "Automatic system testing of programs without test oracles," in Proceedings of the Eighteenth International Symposium on Software Testing and Analysis, ser. ISSTA '09, 2009, pp. 189-200
19. X. Xie, J. W. Ho, C. Murphy, G. Kaiser, B. Xu, and T. Y. Chen, "Testing and validating machine learning classifiers by metamorphic testing," Journal of Systems and Software, vol. 84, no. 4, pp. 544-558, 2011
20. J. L. Bentley, Programming pearls, 2000
21. G. Dong, C. Nie, B. Xu, and L. Wang, "An effective iterative metamorphic testing algorithm based on program path analysis," in Quality Software, 2007. QSIC'07. Seventh International Conference on. IEEE, 2007, pp. 292-297
22. P. Wu, "Iterative metamorphic testing," in Computer Software and Applications Conference, 2005. COMPSAC 2005. 29th Annual International, vol. 1. IEEE, 2005, pp. 19-24
23. H. Liu, F.-C. Kuo, D. Towey, and T. Y. Chen, "How effectively does metamorphic testing alleviate the oracle problem?" Software Engineering, IEEE Transactions on, vol. 40, no. 1, pp. 4-22, Jan 2014
24. K.-M. Chao, R. C. Hardison, and W. Miller, "Recent developments in linear-space alignment methods: A survey," Journal of Computational Biology, vol. 1, no. 4, pp. 271-291, 1994
25. T. Wang and A. Roychoudhury, "Automated path generation for software fault localization," in Proceedings of the 20th IEEE/ACM International Conference on Automated Software Engineering, ser. ASE '05, 2005, pp. 347-351
26. X. Xie, W. E. Wong, T. Y. Chen, and B. Xu, "Metamorphic slice: An application in spectrum-based fault localization," Information and Software Technology, vol. 55, no. 5, pp. 866-879, 2013
27. T. Y. Chen., T. H. Tse, and Z. Q. Zhou, "Semi-proving: An integrated method for program proving, testing, and debugging," Software Engineering, IEEE Transactions on, vol. 37, no. 1, pp. 109-125, Jan 2011
28. N. Jussien, G. Rochart, X. Lorca et al., "Choco: An open source java constraint programming library," in CPAIOR'08 Workshop on Open-Source Software for Integer and Contraint Programming (OSSICP'08), 2008, pp. 1-10
29. C. Barrett and C. Tinelli, "CVC3," in Proceedings of the 19th International Conference on Computer Aided Verification (CAV '07), ser. Lecture Notes in Computer Science, W. Damm and H. Hermanns, Eds., vol. 4590, Jul. 2007, pp. 298-302, berlin, Germany
30. R. A. DeMillo, R. J. Lipton, and F. G. Sayward, "Hints on test data selection: Help for the practicing programmer," Computer, vol. 11, no. 4, pp. 34-41, 1978
31. Z. Q. Zhou, D. Huang, T. Tse, Z. Yang, H. Huang, and T. Chen, "Metamorphic testing and its applications," in Proceedings of the 8th International Symposium on Future Software Technology (ISFST 2004), 2004, pp. 346-351
32. Q. Tao, W. Wu, C. Zhao, and W. Shen, "An automatic testing approach for compiler based on metamorphic testing technique," in Software Engineering Conference (APSEC), 2010 17th Asia Pacific. IEEE, 2010, pp. 270-279
33. Z. Q. Zhou, S. Zhang, M. Hagenbuchner, T. Tse, F.-C. Kuo, and T. Y. Chen, "Automated functional testing of online search services," Software Testing, Verification and Reliability, vol. 22, no. 4, pp. 221-243, 2012
34. T. Y. Chen, J. Feng, and T. Tse, "Metamorphic testing of programs on partial differential equations: A case study," in Computer Software and Applications Conference, 2002. COMPSAC 2002. Proceedings. 26th Annual International. IEEE, 2002, pp. 327-333
35. Y.-S. Ma, J. Offutt, and Y.-R. Kwon, "Mujava: A mutation system for java," in Proceedings of the 28th International Conference on Software Engineering, ser. ICSE '06, 2006, pp. 827-830
36. R. A. DeMillo, H. Pan, and E. H. Spafford, "Critical slicing for software fault localization," in Proceedings of the 1996 ACM SIGSOFT International Symposium on Software Testing and Analysis, ser. ISSTA '96, 1996, pp. 121-134
37. X. Wang, S.-C. Cheung, W. K. Chan, and Z. Zhang, "Taming coincidental correctness: Coverage refinement with context patterns to improve fault localization," in Proceedings of the 31st International Conference on Software Engineering. IEEE Computer Society, 2009, pp. 45-55
38. X. Zhang and R. Gupta, "Cost effective dynamic program slicing," in Proceedings of the ACM SIGPLAN 2004 Conference on Programming Language Design and Implementation, ser. PLDI '04, 2004, pp. 94-106
39. P. Arumuga Nainar, T. Chen, J. Rosin, and B. Liblit, "Statistical debugging using compound boolean predicates," in Proceedings of the 2007 International Symposium on Software Testing and Analysis, ser. ISSTA '07, 2007, pp. 5-15
40. W. N. Sumner and X. Zhang, "Comparative causality: Explaining the differences between executions," in Proceedings of the 2013 International Conference on Software Engineering, ser. ICSE '13, Piscataway, NJ, USA, 2013, pp. 272-281
41. T. Ball, M. Naik, and S. K. Rajamani, "From symptom to cause: Localizing errors in counterexample traces," in Proceedings of the 30th ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages, ser. POPL '03, 2003, pp. 97-105
42. S. Artzi, J. Dolby, F. Tip, and M. Pistoia, "Directed test generation for effective fault localization," in Proceedings of the 19th International Symposium on Software Testing and Analysis, ser. ISSTA '10, 2010, pp. 49-60
43. H. Liu, I. I. Yusuf, H. W. Schmidt, and T. Y. Chen, "Metamorphic fault tolerance: An automated and systematic methodology for fault tolerance in the absence of test oracle," in Companion Proceedings of the 36th International Conference on Software Engineering, ser. ICSE Companion 2014, 2014, pp. 420-423