CanaryAdvisor: A statistical-based tool for canary testing (demo)

2015 International Symposium on Software Testing and Analysis, ISSTA 2015 - Proceedings

Volumn , Issue , 2015, Pages 418-422

  Tarvo, Alexander ^a   Sweeney, Peter F ^a   Mitchell, Nick ^a   Rajan, V T ^a   Arnold, Matthew ^a   Baldini, Ioana ^a  

^a IBM RESEARCH   (United States)

Author keywords

Canary testing; Metrics; Performance

Indexed keywords

CLOUD-BASED APPLICATIONS; CPU UTILIZATION; DESIGN AND IMPLEMENTATIONS; ERROR PRONES; METRICS; PERFORMANCE; RAMP UP;

SOFTWARE TESTING;

EID: 84975700688     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2771783.2784770     Document Type: Conference Paper

References (11)

1. http://techblog.netflix.com/2013/08/deploying-netflix-api.html.
2. http://blog.cloudfoundry.org/2013/10/17/canaries-are-great/.
3. http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cm-ht-zookeeper.html.
4. G. Casella and R. L. Berger. Statistical inference, volume 2. Duxbury Pacific Grove, CA, 2002.
5. R. T. Fielding and R. N. Taylor. Principled design of the modern web architecture. ACM Trans. Internet Technol., 2(2):115-150, May 2002.
6. A. Georges, D. Buytaert, and L. Eeckhout. Statistically rigorous java performance evaluation. In Proc. of the 22Nd Annual ACM Conference on Object-oriented Programming Systems and Applications, OOPSLA '07, pages 57-76, 2007.
7. J. Humble and D. Farley. Continuous Delivery: Reliable Software Releases Through Build, Test, and Deployment Automation. 1st edition, 2010.
8. O. Moser, F. Rosenberg, and S. Dustdar. Non-intrusive monitoring and service adaptation for ws-bpel. In Proc. of 17th Intl. Conference on World Wide Web, WWW '08, pages 815-824, 2008.
9. T. Nguyen, B. Adams, Z. M. Jiang, A. Hassan, M. Nasser, and P. Flora. Automated detection of performance regressions using statistical process control techniques. In Proc. of the 3rd ACM. International Conference on Performance Engineering, ICPE '12, pages 299-310, 2012.
10. M. Pradel, M. Huggler, and T. R. Gross. Performance regression testing of concurrent classes. In Proc. of the 2014 International Symposium on Software Testing and Analysis, ISSTA 2014, pages 13-25, 2014.
11. Q. Wang, J. Shao, F. Deng, and Y. Liu. An online monitoring approach for web service requirements. IEEE Trans. on Services Computing, 2:338-351, August 2009.