Improving software diagnosability via log enhancement

ACM Transactions on Computer Systems

Volumn 30, Issue 1, 2012, Pages

  Yuan, Ding ^a,b   Zheng, Jing ^b   Park, Soyeon ^b   Zhou, Yuanyuan ^b   Savage, Stefan ^b  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Debugging; Failure diagnostics; Log; Program analysis; Software diagnosability

Indexed keywords

COMPLEX SOFTWARE SYSTEMS; DIAGNOSABILITY; FAILURE DIAGNOSIS; FAILURE DIAGNOSTICS; LOG; PROGRAM ANALYSIS; REAL-WORLD APPLICATION; RUNTIMES; SOFTWARE FAILURE;

COMPUTER DEBUGGING; COMPUTER SCIENCE; COMPUTER SYSTEMS;

PROGRAM DEBUGGING;

EID: 84859091978     PISSN: 07342071     EISSN: 15577333     Source Type: Journal    
DOI: 10.1145/2110356.2110360     Document Type: Conference Paper

References (58)

1. AGUILERA, M. K.,MOGUL, J. C.,WIENER, J. L., REYNOLDS, P., AND MUTHITACHAROEN, A. 2003. Performance debugging for distributed systems of black boxes. In Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP'03). ACM, New York, 74-89. (Pubitemid 40929689)
2. AHO, A. V., LAM, M. S., SETHI, R., AND ULLMAN, J. D. 2006. Compilers: Principles, Techniques, and Tools 2nd Ed. Addison-Wesley Longman Publishing Co., Inc., Boston, MA.
3. AIKEN, A., BUGRARA, S.,DILLIG, I., DILLIG, T., HACKETT, B., AND HAWKINS, P. 2007. An overview of the saturn project. In Proceedings of the 7th ACM SIGPLAN-SIGSOFT Workshop on Program Analysis for Software Tools and Engineering (PASTE'07). ACM, New York, NY, 43-48. (Pubitemid 350183118)
4. APPLE. 2004. Apple Inc., CrashReport. Tech. rep. TN2123.
5. AYERS, A., SCHOOLER, R., METCALF, C., AGARWAL, A., RHEE, J., AND WITCHEL, E. 2005. Traceback: First fault diagnosis by reconstruction of distributed control flow. In Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI'05). ACM, New York, NY, 201-212.
6. BARHAM, P., DONNELLY, A., ISAACS, R., AND MORTIER, R. 2004. Using magpie for request extraction and workload modelling. In Proceedings of the 6th Conference on Symposium on Opearting Systems Design and Implementation. USENIX Association, Berkeley, CA, 18-18.
7. BHATIA, S., KUMAR, A., FIUCZYNSKI, M. E., AND PETERSON, L. 2008. Lightweight, high-resolution monitoring for troubleshooting production systems. In Proceedings of the 8th USENIX Conference on Operating Systems Design and Implementation (OSDI'08). USENIX Association, Berkeley, CA, 103-116.
8. CADAR, C., DUNBAR, D., AND ENGLER, D. 2008. Klee: Unassisted and automatic generation of highcoverage tests for complex systems programs. In Proceedings of the 8th USENIX Conference on Operating Systems Design and Implementation (OSDI'08). USENIX Association, Berkeley, CA, 209-224.
9. CASTRO, M., COSTA, M., AND MARTIN, J.-P. 2008. Better bug reporting with better privacy. In Proceedings of the 13th International Conference on Architectural Support for Programming Languages and Operating Systems. ACM, New York, NY, 319-328. (Pubitemid 351585417)
10. CHEN, S., KOZUCH, M., STRIGKOS, T., FALSAFI, B., GIBBONS, P. B., MOWRY, T. C., RAMACHANDRAN, V., RUWASE, O., RYAN, M., AND VLACHOS, E. 2008. Flexible hardware acceleration for instructiongrain program monitoring. In Proceedings of the 35th Annual International Symposium on Computer Architecture (ISCA'08). IEEE Computer Society, Los Alamitos, CA, 377-388.
11. CHILIMBI, T. M., LIBLIT, B., MEHRA, K., NORI, A. V., AND VASWANI, K. 2009. HOLMES: Effective statistical debugging via efficient path profiling. In Proceedings of the 31st International Conference on Software Engineering (ICSE'09). IEEE Computer Society, Los Alamitos, CA, 34-44. CISCO. Cisco system log management.
12. COHEN, I., ZHANG, S., GOLDSZMIDT, M., SYMONS, J., KELLY, T., AND FOX, A. 2005. Capturing, indexing, clustering, and retrieving system history. In Proceedings of the 20th ACM Symposium on Operating Systems Principles (SOSP'05). ACM, New York, NY, 105-118. (Pubitemid 44892208)
13. COSTA, M., CASTRO, M., ZHOU, L., ZHANG, L., AND PEINADO, M. 2007. Bouncer: Securing software by blocking bad input. In Proceedings of 21st ACM SIGOPS Symposium on Operating Systems Principles (SOSP'07). ACM, New York, NY, 117-130. (Pubitemid 351429372)
14. CRAMERI, O.,BIANCHINI, R., AND ZWAENEPOEL,W. 2011. Striking a new balance between program instrumentation and debugging time. In Proceedings of the 6th Conference on Computer Systems (EuroSys'11). ACM, New York, NY, 199-214.
15. DELL. 2008. Streamlined troubleshooting with the Dell system E-Support tool. Dell Power Solutions.
16. DETLEFS, D. L., LEINO, K. R. M., RUSTAN, K., LEINO, M., NELSON, G., AND SAXE, J. B. 1998. Extended static checking. Compac SRC Research rep. 159.
17. DEVIETTI, J., LUCIA, B., CEZE, L., AND OSKIN, M. 2009. Dmp: deterministic shared memory multiprocessing. In Proceeding of the 14th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'09). ACM, New York, NY, 85-96.
18. DUNLAP, G.W., LUCCHETTI, D. G., FETTERMAN, M. A., AND CHEN, P. M. 2008. Execution replay of multiprocessor virtual machines. In Proceedings of the 4th ACMSIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE'08). ACM, New York, NY, 121-130.
19. DWARF. The DWARF Debugging Format. http://dwarfstd.org.
20. EMC. 2005. EMC seen collecting and managing log as key driver for 94 percent of customers.
21. ENGLER, D. AND ASHCRAFT, K. 2003. Racerx: Effective, static detection of race conditions and deadlocks. In Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP'03). ACM, New York, NY, 237-252. (Pubitemid 40929700)
22. FLANAGAN, C., LEINO, K. R. M., LILLIBRIDGE, M., NELSON, G., SAXE, J. B., AND STATA, R. 2002. Extended static checking for java. In Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI'02). ACM, New York, NY, 234-245. GCORE.Man page for gcore (Linux section 1). (Pubitemid 34991522)
23. GLERUM, K., KINSHUMANN, K., GREENBERG, S., AUL, G., ORGOVAN, V., NICHOLS, G., GRANT, D., LOIHLE, G., AND HUNT, G. 2009. Debugging in the (very) large: Ten years of implementation and experience. In Proceedings of the ACM SIGOPS 22nd Symposium on Operating Systems Principles (SOSP'09). ACM, New York, NY, 103-116.
24. GOOGLEBREAKPAD.Google Inc., Breakpad. http://code.google.com/p/google- breakpad/.
25. GUO, Z., WANG, X., TANG, J., LIU, X., XU, Z., WU, M., KAASHOEK, M. F., AND ZHANG, Z. 2008. R2: An application-level kernel for record and replay. In Proceedings of the 8th USENIX Conference on Operating Systems Design and Implementation (OSDI'08). USENIX Association, Berkeley, CA, 193-208.
26. HA, J., ROSSBACH, C. J., DAVIS, J. V., ROY, I., RAMADAN, H. E., PORTER, D. E., CHEN, D. L., AND WITCHEL, E. 2007. Improved error reporting for software that uses black-box components. In Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI'07). ACM, New York, NY, 101-111. (Pubitemid 47630679)
27. HACKETT, B. AND AIKEN, A. 2006. How is aliasing used in systems software? In Proceedings of the 14th ACM SIGSOFT International Symposium on Foundations of Software Engineering (SIGSOFT'06/FSE- 14). ACM, New York, NY, 69-80. (Pubitemid 47129386)
28. KADAV, A., RENZELMANN, M. J., AND SWIFT, M. M. 2009. Tolerating hardware device failures in software. In Proceedings of the ACMSIGOPS 22nd Symposium on Operating Systems Principles (SOSP'09). ACM, New York, NY, 59-72.
29. KERNIGHAN, B.W. AND PIKE, R. 1999. The Practice of Programming. Addison-Wesley Longman Publishing Co., Inc., Boston, MA.
30. KING, S. T., DUNLAP, G. W., AND CHEN, P. M. 2005. Debugging operating systems with time-traveling virtual machines. In Proceedings of the USENIX Annual Technical Conference (ATEC'05). USENIX Association, Berkeley, CA, 1-1.
31. LEBLANC, T. J. AND MELLOR-CRUMMEY, J. M. 1987. Debugging parallel programs with instant replay. IEEE Trans. Comput. 36, 471-482.
32. LEE, D.,WESTER, B., VEERARAGHAVAN, K., NARAYANASAMY, S., CHEN, P. M., AND FLINN, J. 2010. Respec: Efficient online multiprocessor replayvia speculation and external determinism. In Proceedings of the 15th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'10). ACM, New York, NY, 77-90.
33. LI, Z., TAN, L.,WANG, X., LU, S., ZHOU, Y., AND ZHAI, C. 2006. Have things changed now?: An empirical study of bug characteristics in modern open source software. In Proceedings of the 1st Workshop on Architectural and System Support for Improving Software Dependability (ASID'06). ACM, New York, NY, 25-33. (Pubitemid 47113410)
34. LIBLIT, B., AIKEN, A., ZHENG, A. X., AND JORDAN,M. I. 2003. Bug isolation via remote program sampling. In Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI'03). ACM, New York, NY, 141-154.
35. MANEVICH, R., SRIDHARAN, M., ADAMS, S., DAS, M., AND YANG, Z. 2004. PSE: explaining program failures via postmortem static analysis. In Proceedings of the 12th International Symposium on the Foundations of Software Engineering. 63-72. (Pubitemid 40787568)
36. MONTESINOS, P., CEZE, L., AND TORRELLAS, J. 2008. Delorean: Recording and deterministically replaying shared-memory multiprocessor execution efficiently. In Proceedings of the 35th Annual International Symposium on Computer Architecture (ISCA'08). IEEE Computer Society, Los Alamitos, CA, 289-300.
37. MOZILLA QFA. Mozilla Quality Feedback Agent. http://kb.mozillazine.org/ Quality-Feedback-Agent.
38. NAIK, M. AND AIKEN, A. 2007. Conditional must not aliasing for static race detection. In Proceedings of the 34th Annual ACMSIGPLAN-SIGACT Symposium on Principles of Programming Languages (POPL'07). ACM, New York, NY, 327-338.
39. NAIK, M., AIKEN, A., AND WHALEY, J. 2006. Effective static race detection for java. In Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI'06). ACM, New York, NY, 308-319.
40. NARAYANASAMY, S., POKAM, G., AND CALDER, B. 2005. Bugnet: Continuously recording program execution for deterministic replay debugging. In Proceedings of the 32nd Annual International Symposium on Computer Architecture (ISCA'05). IEEE Computer Society, Los Alamitos, CA, 284-295. (Pubitemid 41543448)
41. NECULA, G. C.,MCPEAK, S., RAHUL, S. P., AND WEIMER, W. 2002. CIL: Intermediate language and tools for analysis and transformation of c programs. In Proceedings of the 11th International Conference on Compiler Construction (CC'02). Springer-Verlag, Berlin, 213-228.
42. NETAPP. 2007. Proactive health management with auto-support. NetApp white paper. NETAPPSAVECORE. NetApp Inc., Savecore. ONTAP 7.3 Manual Page Reference, Volume 1, 471-472.
43. OLSZEWSKI, M., ANSEL, J., AND AMARASINGHE, S. 2009. Kendo: Efficient deterministic multithreading in software. In Proceeding of the 14th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'09). ACM, New York, NY, 97-108.
44. PARK, S., ZHOU, Y., XIONG, W., YIN, Z.,KAUSHIK, R., LEE, K. H., AND LU, S. 2009. Pres: Probabilistic replay with execution sketching on multiprocessors. In Proceedings of the ACMSIGOPS 22nd Symposium on Operating Systems Principles (SOSP'09). ACM, New York, NY, 177-192.
45. SCHMIDT, S. 2009. 7 more good tips on logging. http://codemonkeyism.com/ 7-more-good-tips-on-logging/.
46. SLOCCOUNT. Sloccount. http://www.dwheeler.com/sloccount/.
47. SUBHRAVETI, D. AND NIEH, J. 2011. Record and transplay: Partial checkpointing for replay debugging across heterogeneous systems. In Proceedings of the ACM SIGMETRICS Joint International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS'11). ACM, New York, NY, 109-120.
48. TUCEK, J., LU, S., HUANG, C., XANTHOS, S., AND ZHOU, Y. 2007. Triage: Diagnosing production run failures at the user's site. In Proceedings of 21st ACMSIGOPS Symposium on Operating Systems Principles (SOSP'07). ACM, New York, NY, 131-144. (Pubitemid 351429373)
49. VEERARAGHAVAN, K., LEE, D.,WESTER, B.,OUYANG, J., CHEN, P.M., FLINN, J., AND NARAYANASAMY, S. 2011. Doubleplay: Parallelizing sequential logging and replay. In Proceedings of the 16th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'11). ACM, New York, NY, 15-26.
50. VLACHOS, E., GOODSTEIN, M. L., KOZUCH, M. A., CHEN, S., FALSAFI, B., GIBBONS, P. B., AND MOWRY, T. C. 2010. Paralog: Enabling and accelerating online parallel monitoring of multithreaded applications. In Proceedings of the 15th Edition of ASPLOS on Architectural Support for Programming Languages and Operating Systems (ASPLOS'10). ACM, New York, NY, 271-284.
51. VMWARE. Using the intergrated virtual debugger for visual studio. http://www.vmware.com/pdf/ws65-manual.pdf.
52. WEERATUNGE, D., ZHANG, X., AND JAGANNATHAN, S. 2010. Analyzing multicore dumps to facilitate concurrency bug reproduction. In Proceedings of the 15th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'10). ACM, New York, NY, 155-166.
53. XU, M., BODIK, R., AND HILL, M. D. 2003. A "flight data recorder" for enabling full-system multiprocessor deterministic replay. In Proceedings of the 30th Annual International Symposium on Computer Architecture (ISCA'03). ACM, New York, NY, 122-135.
54. XU, W., HUANG, L., FOX, A., PATTERSON, D., AND JORDAN, M. I. 2009. Detecting large-scale system problems by mining console logs. In Proceedings of the ACM SIGOPS 22nd Symposium on Operating Systems Principles (SOSP'09). ACM, New York, NY, 117-132.
55. YUAN, D.,MAI, H., XIONG, W., TAN, L., ZHOU, Y., AND PASUPATHY, S. 2010. Sherlog: Error diagnosis by connecting clues from run-time logs. In Proceedings of the 15th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'10). ACM, New York, NY, 143-154.
56. ZAMFIR, C. AND CANDEA, G. 2010. Execution synthesis: A technique for automated software debugging. In Proceedings of the 5th European Conference on Computer Systems (EuroSys'10). ACM, New York, NY, 321-334.
57. ZHANG, X., TALLAM, S., AND GUPTA, R. 2006. Dynamic slicing long running programs through execution fast forwarding. In Proceedings of the 14th ACM SIGSOFT International Symposium on Foundations of Software Engineering (SIGSOFT'06/FSE-14). ACM, New York, NY, 81-91. (Pubitemid 47129387)
58. ZHAO, Q., RABBAH, R., AMARASINGHE, S., RUDOLPH, L., AND WONG, W.-F. 2008. How to do a million watchpoints: Efficient debugging using dynamic instrumentation. In Proceedings of the International Conference on Compiler Construction.