Bifrost - Supporting continuous deployment with automated enactment of multi-phase live testing strategies

Proceedings of the 17th International Middleware Conference, Middleware 2016

Volumn , Issue , 2016, Pages

  Schermann, Gerald ^a   Schöni, Dominik ^a   Leitner, Philipp ^a   Gall, Harald C ^a  

^a UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

A B testing; Canary releases; Continuous deployment; Microservices; Release engineering

Indexed keywords

A/B TESTING; CANARY RELEASES; CONTINUOUS DELIVERIES; CONTINUOUS DEPLOYMENT; MICROSERVICES; PARALLEL STRATEGIES; PRODUCTION ENVIRONMENTS; PROTOTYPE IMPLEMENTATIONS;

MIDDLEWARE;

EID: 85051074792     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2988336.2988348     Document Type: Conference Paper

References (26)

1. E. Bakshy and E. Frachtenberg. Design and Analysis of Benchmarking Experiments for Distributed Internet Services. In Proceedings of the 24th International Conference on World Wide Web (WWW), pages 108-118, 2015.
2. L. Bass, I. Weber, and L. Zhu. DevOps: A Software Architect's Perspective. Addison-Wesley Professional, jun 2015.
3. A. Begel and T. Zimmermann. Analyze This! 145 Questions for Data Scientists in Software Engineering. In Proceedings of the 36th International Conference on Software Engineering, ICSE 2014, pages 12-23, New York, NY, USA, 2014. ACM.
4. L. Chen. Continuous Delivery: Huge Benefits, but Challenges Too. Software, IEEE, 32(2):50-54, Mar 2015.
5. J. Cito, P. Leitner, T. Fritz, and H. C. Gall. The Making of Cloud Applications: An Empirical Study on Software Development for the Cloud. In Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering (ESEC/FSE), pages 393-403, New York, NY, USA, 2015. ACM.
6. J. Cito, P. Leitner, H. C. Gall, A. Dadashi, A. Keller, and A. Roth. Runtime Metric Meets Developer - Building Better Cloud Applications Using Feedback. In Proceedings of the 2015 ACM International Symposium on New Ideas, New Paradigms, and Reections on Programming & Software (Onward! 2015), New York, NY, USA, 2015. ACM.
7. J. Cito, D. Suljoti, P. Leitner, and S. Dustdar. Web Engineering: 14th International Conference, ICWE 2014, Toulouse, France, July 1-4, 2014. Proceedings, chapter Identifying Root Causes of Web Performance Degradation Using Changepoint Analysis, pages 181-199. 2014.
8. D. G. Feitelson, E. Frachtenberg, and K. L. Beck. Development and Deployment at Facebook. IEEE Internet Computing, 17(4):8-17, 2013.
9. K. C. Foo, Z. M. J. Jiang, B. Adams, A. E. Hassan, Y. Zou, and P. Flora. An Industrial Case Study on the Automated Detection of Performance Regressions in Heterogeneous Environments. In Proceedings of the 37th International Conference on Software Engineering - Volume 2, ICSE '15, pages 159-168, Piscataway, NJ, USA, 2015. IEEE Press.
10. J. Humble and D. Farley. Continuous Delivery: Reliable Software Releases Through Build, Test, and Deployment Automation. Addison-Wesley Professional, 2010.
11. M. Kim, T. Zimmermann, R. De Line, and A. Begel. The Emerging Role of Data Scientists on Software Development Teams. In Proceedings of the 38th International Conference on Software Engineering (ICSE'16), pages 96-107, New York, NY, USA, 2016. ACM.
12. R. Kohavi, A. Deng, B. Frasca, T. Walker, Y. Xu, and N. Pohlmann. Online Controlled Experiments at Large Scale. In Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD).
13. R. Kohavi, R. M. Henne, and D. Sommerfield. Practical guide to controlled experiments on the web: Listen to your customers not to the hippo. In Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '07, pages 959-967, New York, NY, USA, 2007. ACM.
14. P. Leitner and J. Cito. Patterns in the Chaos - a Study of Performance Variation and Predictability in Public IaaS Clouds. ACM Transactions on Internet Technology, 2016.
15. J. Lewis and M. Fowler. Microservices. http://martinfowler.com/articles/microservices.html, Mar. 2014.
16. M. Mernik, J. Heering, and A. M. Sloane. When and How to Develop Domain-specific Languages. ACM Computing Surveys, 37(4):316-344, Dec. 2005.
17. F. Provost and T. Fawcett. Data Science and its Relationship to Big Data and Data-Driven Decision Making. Big Data, 1(1):51-59, 2013.
18. A. A. U. Rahman, E. Helms, L. Williams, and C. Parnin. Synthesizing Continuous Deployment Practices Used in Software Development. In Proceedings of the Agile Conference (AGILE), pages 1-10, Aug 2015.
19. P. Rodríguez, A. Haghighatkhah, L. E. Lwakatare, S. Teppola, T. Suomalainen, J. Eskeli, T. Karvonen, P. Kuvaja, J. M. Verner, and M. Oivo. Continuous Deployment of Software Intensive Products and Services: A Systematic Mapping Study. Journal of Systems and Software, 2016. To appear.
20. T. Savor, M. Douglas, M. Gentili, L. Williams, K. Beck, and M. Stumm. Continuous Deployment at Facebook and OANDA. In Proceedings of the 38th International Conference on Software Engineering Companion (ICSE'16), pages 21-30, New York, NY, USA, 2016. ACM.
21. G. Schermann, J. Cito, and P. Leitner. All the Services Large and Micro: Revisiting Industrial Practice in Services Computing. In Proceedings of the 11th International Workshop on Engineering Service Oriented Applications (WESOA'15), 2015.
22. G. Schermann, J. Cito, P. Leitner, U. Zdun, and H. Gall. An Empirical Study on Principles and Practices of Continuous Delivery and Deployment. PeerJ Preprints 4:e1889v1 https://doi.org/10.7287/peerj.preprints.1889v1, 2015.
23. G. Tamburrelli and A. Margara. Towards Automated A/B Testing. In Proceedings of the 6th International Symposium on Search-Based Software Engineering (SSBSE), volume 8636 of Lecture Notes in Computer Science, pages 184-198. Springer, 2014.
24. C. Tang, T. Kooburat, P. Venkatachalam, A. Chander, Z. Wen, A. Narayanan, P. Dowell, and R. Karl. Holistic Configuration Management at Facebook. In Proceedings of the 25th Symposium on Operating Systems Principles, SOSP '15, pages 328-343, New York, NY, USA, 2015. ACM.
25. A. Tarvo, P. F. Sweeney, N. Mitchell, V. Rajan, M. Arnold, and I. Baldini. CanaryAdvisor: A Statistical-based Tool for Canary Testing (Demo). In Proceedings of the 2015 International Symposium on Software Testing and Analysis (ISSTA), pages 418-422, New York, NY, USA, 2015. ACM.
26. A. van Hoorn, J. Waller, and W. Hasselbring. Kieker: A Framework for Application Performance Monitoring and Dynamic Software Analysis. In Proceedings of the 3rd ACM/SPEC International Conference on Performance Engineering (ICPE'12), pages 247-248, New York, NY, USA, 2012. ACM.