The performance cockpit approach: A framework for systematic performance evaluations

Proceedings - 36th EUROMICRO Conference on Software Engineering and Advanced Applications, SEAA 2010

Volumn , Issue , 2010, Pages 31-38

  Westermann, Dennis ^a   Happe, Jens ^a   Hauck, Michael ^b   Heupel, Christian ^c  

^a SAP RESEARCH   (Germany)

^b FZI RESEARCH CENTER FOR INFORMATION TECHNOLOGY   (Germany)

^c KARLSRUHE INSTITUTE OF TECHNOLOGY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ENTERPRISE APPLICATIONS; KNOWLEDGE-SHARING; LEGACY APPLICATIONS; MULTIPLE FACTORS; PERFORMANCE ENGINEERING; PERFORMANCE EVALUATION; PLUG-INS; RESOURCE UTILIZATIONS; SOFTWARE SYSTEMS; SYSTEM UNDER TEST; THIRD PARTY SERVICES;

MIDDLEWARE;

SOFTWARE ENGINEERING;

EID: 78449292112     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SEAA.2010.24     Document Type: Conference Paper

References (21)

1. S. Becker, T. Dencker, and J. Happe. Model-Driven Generation of Performance Prototypes. In SIPEW 2008: SPEC International Performance Evaluation Workshop, volume 5119, pages 79-98, 2008.
2. A. Bertolino, G. Angelis, L. Frantzen, and A. Polini. The plastic framework and tools for testing service-oriented applications. pages 106-139, 2009.
3. M. Fowler. Inversion of control containers and the dependency injection pattern. http://www.martinfowler.com/articles/injection.html, Jan. 2004.
4. J. H. Friedman. Multivariate adaptive regression splines. Annals of Statistics, 19(1):1-141, 1991.
5. E. Gamma, R. Helm, R. Johnson, and J. Vlissides. Design Patterns: Elements of Reusable Object-Oriented Software. Addison Wesley, Massachusetts, 1994.
6. J. Happe, D. Westermann, K. Sachs, and L. Kapova. Statistical inference of software performance models for parametric performance completions. In 6th International Conference on the Quality of Software Architectures, QoSA 2010, Prague, Czech Republic, , June 23-25, 2010, Proceedings. To Appear.
7. R. Jain. The art of computer systems performance analysis. Wiley Interscience, New York, 1991.
8. T. Kalibera, L. Bulej, and P. Tuma. Generic environment for full automation of benchmarking. In S. Beydeda, V. Gruhn, J. Mayer, R. Reussner, and F. Schweiggert, editors, SOQUA/TECOS, volume 58 of LNI, pages 125-132. GI, 2004.
9. H. Koziolek. Performance evaluation of component-based software systems: A survey. Performance Evaluation, In Press, Corrected Proof, 2009.
10. M. Meyerhöfer. Testejb: response time measurement and call dependency tracing for ejbs. In MAI '07: Proceedings of the 1st workshop on Middleware-application interaction, pages 55-60, New York, NY, USA, 2007. ACM.
11. A. Mos and J. Murphy. A framework for performance monitoring, modelling and prediction of component oriented distributed systems. In WOSP '02: Proceedings of the 3rd international workshop on Software and performance, pages 235-236, New York, NY, USA, 2002. ACM.
12. T. Parsons. A framework for detecting performance design and deployment antipatterns in component based enterprise systems. In DSM '05: Proceedings of the 2nd international doctoral symposium on Middleware, pages 1-5, New York, NY, USA, 2005. ACM.
13. R Development Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, 2010. ISBN 3-900051-07-0.
14. K. Sachs, S. Kounev, J. Bacon, and A. Buchmann. Performance evaluation of message-oriented middleware using the SPECjms2007 benchmark. Performance Evaluation, 66(8):410-434, Aug 2009.
15. J. Sankarasetty, K. Mobley, L. Foster, T. Hammer, and T. Calderone. Software performance in the real world: personal lessons from the performance trauma team. In V. Cortellessa, S. Uchitel, and D. Yankelevich, editors, WOSP, pages 201-208. ACM, 2007.
16. M. Sopitkamol and D. A. Menascé. A method for evaluating the impact of software configuration parameters on e-commerce sites. In WOSP, pages 53-64. ACM, 2005.
17. D. Thakkar, A. E. Hassan, G. Hamann, and P. Flora. A framework for measurement based performance modeling. In WOSP '08: Proceedings of the 7th international workshop on Software and performance, pages 55-66, New York, NY, USA, 2008. ACM.
18. D. Westermann and J. Happe. Towards performance prediction of large enterprise applications: An approach based on systematic measurements. In R. H. Reussner, C. Szyperski, W. Weck, and B. Buhnova, editors, Proceedings of the 15th International Workshop on Component Oriented Programming (WCOP 2010), Interne Berichte, Karlsruhe, Germany, 2010. Karlsruhe Institute of Technology (KIT). To appear.
19. C. M. Woodside, V. Vetland, M. Courtois, and S. Bayarov. Resource function capture for performance aspects of software components and sub-systems. In Performance Engineering, State of the Art and Current Trends, pages 239-256, London, UK, 2001. Springer-Verlag.
20. X. Wu and M. Woodside. A calibration framework for capturing and calibrating software performance models. In EPEW '08: Proceedings of the 5th European Performance Engineering Workshop on Computer Performance Engineering, pages 32-47, Berlin, Heidelberg, 2008. Springer-Verlag.
21. C. Yilmaz, A. S. Krishna, A. M. Memon, A. A. Porter, D. C. Schmidt, A. S. Gokhale, and B. Natarajan. Main effects screening: a distributed continuous quality assurance process for monitoring performance degradation in evolving software systems. In G.-C. Roman, W. G. Griswold, and B. Nuseibeh, editors, ICSE, pages 293-302. ACM, 2005.