Repeated results analysis for middleware regression benchmarking

Performance Evaluation

Volumn 60, Issue 1-4, 2005, Pages 345-358

  Bulej, Lubomír ^a,b   Kalibera, Tomáš ^a   Tůma, Petr ^a  

^a CHARLES UNIVERSITY   (Czech Republic)

^b INSTITUTE OF COMPUTER SCIENCE   (Czech Republic)

Author keywords

Middleware benchmarking; Regression benchmarking; Regression testing

Indexed keywords

AUTOMATION; BENCHMARKING; COMPUTATIONAL COMPLEXITY; COMPUTER SOFTWARE; QUALITY ASSURANCE; REGRESSION ANALYSIS;

MIDDLEWARE BENCHMARKING; REGRESSION BENCHMARKING; REGRESSION TESTING; SOFTWARE SYSTEMS;

MIDDLEWARE;

EID: 14544267167     PISSN: 01665316     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.peva.2004.10.013     Document Type: Article

References (24)

1. K. Beck Extreme Programming Explained: Embrace Change 1999 Addison Wesley Professional Boston
2. L. Boszormenyi, A. Wickener, H. Wolf, Performance evaluation of object oriented middleware - development of a benchmarking toolkit, in: Proceedings of the Euro-Par'99, Lecture Notes in Computer Science, vol. 1685, Springer, Berlin, 1999, pp. 258-261.
3. L. Bulej, T. Kalibera, and P. Tůma Regression benchmarking with simple middleware benchmarks Proceedings of the IPCCC'04, IEEE CS New Jersey 2004 771 776
4. E.J. Chen, and W.D. Kelton Simulation-based estimation of quantiles Proceedings of the WSC'99 1999 ACM Press New York 428 434
5. V. Faber Clustering and continuous k-means algorithm Los Alamos Sci. 22 1994 138 144
6. A.S. Gokhale, and D.C. Schmidt Measuring and optimizing CORBA latency and scalability over high-speed networks IEEE Trans. Comput. 47 1998 391 414
7. M.B. Juric, I. Rozman, and M. Hericko Performance comparison of CORBA and RMI Inform. Software Technol. J. 42 2000 915 933
8. A.S. Krishna, J. Balasubramanian, A. Gokhale, D.C. Schmidt, D. Devilla, G. Thaker, Empirically evaluating CORBA component model implementations, in: Proceedings of the OOPSLA'03 Middleware Benchmarking Workshop, USA, 2003. http://nenya.ms.mff.cuni.cz/projects/corba/oopsla-workshop.
9. F. Leisch Bagged clustering Adapt. Inform. Syst. Model. Econom. Manage. Sci. 51 1999
10. F. Plášil, P. Tůma, A. Buble, Charles University Response to the Benchmark RFI, OMG bench/98-10-04, 1998.
11. P. Tůma, and A. Buble Open CORBA benchmarking Proceedings of the SPECTS'01 SCS, San Diego 2001
12. AT&T Laboratories Cambridge, omniORB: Free High Performance ORB. http://omniorb.sourceforge.net.
13. Distributed Systems Research Group, Open CORBA Benchmarking Project. http://nenya.ms.mff.cuni.cz/∼bench.
14. Distributed Systems Research Group, Vendor CORBA Benchmarking Project. http://nenya.ms.mff.cuni.cz/projects.phtml?p=cbench.
15. Distributed Object Computing Group, TAO Performance Scoreboard. http://www.dre.vanderbilt.edu/stats/performance.shtml.
16. Distributed Object Computing Group, The ACE Orb. http://www.dre. vanderbilt.edu/tao.
17. ExoLab Group, OpenORB Community, The Community OpenORB Project. http://openorb.sourceforge.net.
18. Object Management Group, CORBA Specification 3.0.2, OMG formal/02-12-02, 2002.
19. ObjectWeb Consortium, CAROL: Common Architecture for RMI ObjectWeb Layer. http://carol.objectweb.org.
20. ObjectWeb Consortium, RUBiS: Rice University Bidding System. http://rubis.objectweb.org.
21. Sun Microsystems, ECperf Specification, version 1.1, 2002. http://www.theserverside.com/ecperf.
22. Sun Microsystems, Enterprise JavaBeans Specification, version 2.1, 2003. http://java.sun.com/products/ejb/docs.html.
23. Sun Microsystems, Java Remote Method Invocation Specification. http://java.sun.com/j2se/1.4.2/docs/guide/rmi/spec/rmitoc.html.
24. Transaction Processing Performance Council, TPC Benchmark Web Commerce Specification 1.8, 2002. http://www.tpc.org.