Sampling-based program execution monitoring

ACM SIGPLAN Notices

Volumn 45, Issue 4, 2010, Pages 133-142

  Fischmeister, Sebastian ^a   Ba, Yanmeng ^a  

^a UNIVERSITY OF WATERLOO   (Canada)

Author keywords

Debugging; Embedded system; Monitoring; Sampling; Tracing

Indexed keywords

COMPUTER DEBUGGING; EMBEDDED SYSTEMS; MONITORING; SAMPLING;

EXECUTION MONITORING; MONITORING FRAMEWORKS; OPTIMAL TRADEOFFS; REAL-TIME APPLICATION; SENSITIVE SYSTEMS; SYSTEM DEVELOPMENT; TIMING CONSTRAINTS; TRACING;

PROGRAM DEBUGGING;

EID: 77951228457     PISSN: 15232867     EISSN: None     Source Type: Journal    
DOI: 10.1145/1755951.1755908     Document Type: Article

References (37)

1. IEEE Standard Glossary of Software Engineering Terminology. IEEE Std 610.12-1990, Dec 1990.
2. SAT4J. web page, Oct 2009a. www.sat4j.org.
3. SHARCNET: Shared Hierarchical Academic Research Computing Network. web page, Oct. 2009b. www.sharcnet.ca.
4. M. Arnold and B. G. Ryder. A framework for reducing the cost of instrumented code. In PLDI '01: Proceedings of the ACM SIGPLAN 2001 conference on Programming language design and implementation, pages 168-179, New York, NY, USA, 2001. ACM. ISBN 1-58113-414-2. doi: http://doi.acm.org.proxy.lib.uwaterloo. ca/10.1145/378795.378832.
5. T. Ball and J. R. Larus. Optimally profiling and tracing programs. In POPL '92: Proceedings of the 19th ACM SIGPLAN-SIGACT symposium on Principles of programming languages, pages 59-70, New York, NY, USA, 1992. ACM. ISBN 0-89791-453-8. doi: http://doi.acm.org.proxy. lib.uwaterloo.ca/10.1145/143165. 143180.
6. T. Ball and J. R. Larus. Optimally profiling and tracing programs. ACM Trans. Program. Lang. Syst., 16(4):1319-1360, 1994. ISSN 0164-0925. doi: http://doi.acm.org.proxy.lib.uwaterloo.ca/10.1145/183432.183527.
7. Y. Benjamini and Y. Hochberg. Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B (Methodological), 57(1):289-300, 1995. ISSN 00359246. URL http://www.jstor.org/stable/2346101.
8. M. Biberstein, V. C. Sreedhar, B. Mendelson, D. Citron, and A. Giammaria. Instrumenting annotated programs. In VEE '05: Proceedings of the 1st ACM/USENIX international conference on Virtual execution environments, pages 164-174, New York, NY, USA, 2005. ACM. ISBN 1-59593-047-7. doi: http://doi.acm.org.proxy.lib. uwaterloo.ca/10.1145/ 1064979.1065002.
9. B. Bouyssounouse and J.Sifakis, editors. Embedded Systems Design: The ARTIST Roadmap for Research and Development, volume 3436 of LNCS. Springer, first edition, May 2005.
10. A. Cheung and S. Madden. Performance profiling with endoscope, an acquisitional software monitoring framework. Proc. VLDB Endow., 1 (1):42-53, 2008. doi: http://doi.acm.org.proxy.lib.uwaterloo.ca/10.1145/ 1453856.1453866.
11. I. Chun and C. Lim. Es-debugger : the flexible embedded system debugger based on jtag technology. Advanced Communication Technology, 2005, ICACT 2005. The 7th International Conference on, 2:900-903, 2005. doi: 10.1109/ICACT.2005. 246099.
12. T. H. Cormen, C. E. Leiserson, R. L. Rivest, and C. Stein. Introduction to Algorithms. MIT Press, second edition, 2001.
13. R. Dick, D. Rhodes, and W. Wolf. Tgff: task graphs for free. In Hardware/ Software Codesign, 1998. (CODES/CASHE '98) Proceedings of the Sixth International Workshop on, pages 97-101, Mar 1998. doi: 10.1109/HSC.1998.666245.
14. S. Elbaum, H. N. Chin, M. Dwyer, and M. Jorde. Carving and replaying differential unit test cases from system test cases. Software Engineering, IEEE Transactions on, 35(1):29-45, Jan.-Feb. 2009. ISSN 0098-5589. doi: 10.1109/TSE.2008.103.
15. S. Fischmeister and I. Lee. Handbook on Real-Time Systems, chapter Temporal Control in Real-Time Systems: Languages and Systems, pages 10-11 to 10-18. Information Science Series. CRC Press, 2007.
16. P. Frankl and E.Weyuker. An applicable family of data flow testing criteria. Software Engineering, IEEE Transactions on, 14(10):1483-1498, Oct 1988. ISSN 0098-5589. doi: 10.1109/32.6194.
17. M. Gallaher and B. Kropp. The Economic Impacts of Inadequate Infrastructure for Software Testing. National Institute of Standards & Technologg Planning Report 02-03, May 2002.
18. M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments of the effectiveness of dataflow- and controlflow-based test adequacy criteria. In ICSE '94: Proceedings of the 16th international conference on Software engineering, pages 191-200, Los Alamitos, CA, USA, 1994. IEEE Computer Society Press. ISBN 0-8186-5855-X. Learning From Software Failure. IEEE Spectrum, September 2005.
19. M. Jiang, M. A. Munawar, T. Reidemeister, and P. A. Ward. System monitoring with metric-correlation models: problems and solutions. In ICAC '09: Proceedings of the 6th international conference on Autonomic computing, pages 13-22, New York, NY, USA, 2009. ACM. ISBN 978- 1-60558-564-2. doi: http://doi.acm.org.proxy.lib.uwaterloo.ca/10.1145/ 1555228.1555233.
20. S. H. Kirani, I. A. Zualkernan, and W.-T. Tsai. Evaluation of expert system testing methods. Commun. ACM, 37(11):71-81, 1994. ISSN 0001-0782. doi: http://doi.acm.org/10.1145/188280.188373.
21. N. Kumar, B. R. Childers, and M. L. Soffa. Low overhead program monitoring and profiling. In PASTE '05: Proceedings of the 6th ACM SIGPLAN-SIGSOFT workshop on Program analysis for software tools and engineering, pages 28-34, New York, NY, USA, 2005. ACM. ISBN 1-59593-239-9. doi: http://doi.acm.org.proxy.lib.uwaterloo.ca/10.1145/ 1108792.1108801.
22. J. J. Labrosse. MicroC OS II: The Real Time Kernel. CMP Books, 2002.
23. E. Lee and C. Zilles. Branch-on-random. In CGO '08: Proceedings of the sixth annual IEEE/ACM international symposium on Code generation and optimization, pages 84-93, New York, NY, USA, 2008. ACM. ISBN 978-1-59593-978-4. doi: http://doi.acm.org.proxy.lib.uwaterloo.ca/10. 1145/1356058.1356070.
24. B. Liblit, A. Aiken, A. X. Zheng, and M. I. Jordan. Bug isolation via remote program sampling. In PLDI '03: Proceedings of the ACM SIGPLAN 2003 conference on Programming language design and implementation, pages 141-154, New York, NY, USA, 2003. ACM. ISBN 1-58113- 662-5. doi: http://doi.acm.org.proxy. lib.uwaterloo.ca/10.1145/781131. 781148.
25. B. Liblit, M. Naik, A. X. Zheng, A. Aiken, and M. I. Jordan. Scalable statistical bug isolation. In PLDI '05: Proceedings of the 2005 ACM SIGPLAN conference on Programming language design and implementation, pages 15-26, New York, NY, USA, 2005. ACM. ISBN 1-59593- 056-6. doi: http://doi.acm.org.proxy. lib.uwaterloo.ca/10.1145/1065010. 1065014.
26. C.-K. Luk, R. Cohn, R. Muth, H. Patil, A. Klauser, G. Lowney, S. Wallace, V. J. Reddi, and K. Hazelwood. Pin: building customized program analysis tools with dynamic instrumentation. In PLDI '05: Proceedings of the 2005 ACM SIGPLAN conference on Programming language design and implementation, pages 190-200, New York, NY, USA, 2005. ACM. ISBN 1-59593-056-6. doi: http://doi.acm.org/10.1145/ 1065010. 1065034.
27. E. Metz, R. Lencevicius, and T. F. Gonzalez. Performance data collection using a hybrid approach. In ESEC/FSE-13: Proceedings of the 10th European software engineering conference held jointly with 13th ACMSIGSOFT international symposium on Foundations of software engineering, pages 126-135, New York, NY, USA, 2005. ACM. ISBN 1-59593-014-0. doi: http://doi.acm.org.proxy.lib.uwaterloo. ca/10.1145/ 1081706.1081729.
28. J. Misurda, J. A. Clause, J. L. Reed, B. R. Childers, and M. L. Soffa. Demand-driven structural testing with dynamic instrumentation. In ICSE '05: Proceedings of the 27th international conference on Software engineering, pages 156-165, New York, NY, USA, 2005. ACM. ISBN 1-59593-963-2. doi: http://doi.acm.org.proxy.lib.uwaterloo.ca/10.1145/ 1062455.1062496.
29. W. Orme. Debug and Trace for Multicore SoCs. ARM, September 2008. http://www.arm.com/pdfs/CoresightWhitepaper.pdf.
30. R. Santelices and M. J. Harrold. Efficiently monitoring data-flow test coverage. In ASE '07: Proceedings of the twenty-second IEEE/ACM international conference on Automated software engineering, pages 343- 352, New York, NY, USA, 2007. ACM. ISBN 978-1-59593-882-4. doi: http://doi.acm.org.proxy.lib.uwaterloo. ca/10.1145/1321631.1321682.
31. A. Shye,M. Iyer, V. J. Reddi, and D. A. Connors. Code coverage testing using hardware performance monitoring support. In AADEBUG'05: Proceedings of the sixth international symposium on Automated analysisdriven debugging, pages 159-163, New York, NY, USA, 2005. ACM. ISBN 1-59593-050-7. doi: http://doi.acm.org.proxy.lib.uwaterloo.ca/10. 1145/1085130.1085151.
32. A. Srivastava and A. Eustace. Atom: a system for building customized program analysis tools. SIGPLAN Not., 39(4):528-539, 2004. ISSN 0362-1340. doi: http://doi.acm.org/10.1145/989393.989446.
33. D. Tennenhouse. Proactive computing. Commun. ACM, 43(5):43-50, 2000. ISSN 0001-0782. doi: http://doi.acm.org/10.1145/332833.332837.
34. M. Thorup. All structured programs have small tree width and good register allocation. Inf. Comput., 142(2):159-181, 1998. ISSN 0890-5401. doi: http://dx.doi.org/10.1006/inco.1997.2697.
35. B. L. Titzer and J. Palsberg. Nonintrusive precision instrumentation of microcontroller software. In LCTES '05: Proceedings of the 2005 ACM SIGPLAN/SIGBED conference on Languages, compilers, and tools for embedded systems, pages 59-68, New York, NY, USA, 2005. ACM. ISBN 1-59593-018-3. doi: http://doi.acm.org.proxy.lib.uwaterloo.ca/10.1145/1065910.1065919.
36. T. Zhang, X. Zhuang, S. Pande, andW. Lee. Anomalous path detection with hardware support. In CASES '05: Proceedings of the 2005 international conference on Compilers, architectures and synthesis for embedded systems, pages 43-54, New York, NY, USA, 2005. ACM. ISBN 1-59593- 149-X. doi: http://doi.acm.org. proxy.lib.uwaterloo.ca/10.1145/1086297. 1086305.
37. A. X. Zheng, M. I. Jordan, B. Liblit, M. Naik, and A. Aiken. Statistical debugging: simultaneous identification of multiple bugs. In ICML '06: Proceedings of the 23rd international conference on Machine learning, pages 1105-1112, New York, NY, USA, 2006. ACM. ISBN 1-59593- 383-2. doi: http://doi.acm.org.proxy.lib.uwaterloo.ca/10.1145/1143844. 1143983. (Pubitemid 46966958)