Experience and challenges with UML-driven performance engineering of a Distributed Real-Time System

Information and Software Technology

Volumn 52, Issue 6, 2010, Pages 625-640

  Garousi, Vahid ^a  

^a UNIVERSITY OF CALGARY   (Canada)

Author keywords

Distributed Real Time Systems; Experiment; Performance tuning; Software Performance Engineering; Stress testing; UML

Indexed keywords

DISTRIBUTED REAL TIME SYSTEM; DISTRIBUTED REAL-TIME SYSTEMS; PERFORMANCE TUNING; SOFTWARE PERFORMANCE ENGINEERINGS; STRESS TESTING;

COMPUTER SOFTWARE; ENGINEERING; EXPERIMENTS; NUCLEAR PROPULSION; NUCLEAR REACTORS; QUALITY ASSURANCE; SAFETY ENGINEERING; TOTAL QUALITY MANAGEMENT; TUNING;

REAL TIME SYSTEMS;

EID: 77950370077     PISSN: 09505849     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.infsof.2010.01.003     Document Type: Article

References (44)

1. Tsai J.J.P., Bi Y., Yang S.J.H., and Smith R.A.W. Distributed Real-Time Systems: Monitoring, Visualization, Debugging, and Analysis (1996), John Wiley and Sons
2. Weyuker E., and Vokolos F.I. Experience with performance testing of software systems: issues, an approach and case study. IEEE Transactions on Software Engineering 26 12 (2000) 1147-1156
3. Kuhn R. Sources of failure in the public switched telephone network. IEEE Computer 30 4 (1997) 31-36
4. Chan E.-K., and Ebenhoh H. The implementation and evolution of a SCADA system for a large distribution network. IEEE Transactions on Power Systems 7 1 (1992) 320-326
5. Y. Ebata, H. Hayashi, Y. Hasegawa, S. Komatsu, K. Suzuki, Development of the intranet-based SCADA for power system, in: Proceeding of IEEE Power Engineering Society Winter Meeting, 2000, pp. 1656-1661.
6. M. Hirsh and D. Klaidman, Blackout 2003: What Went Wrong, Newsweek, 25 August, 2003.
7. V. Garousi, L. Briand, Y. Labiche, Traffic-aware stress testing of distributed systems based on UML models, in: Proceedings of International Conference on Software Engineering, 2006. pp. 391-400.
8. V. Garousi, Traffic-aware stress testing of distributed real-time systems based on UML models in the presence of time uncertainty, in: Proceedings of IEEE International Conference on Software Testing, Verification and Validation, 2008, pp. 92-101.
9. Garousi V., Briand L., and Labiche Y. Traffic-aware stress testing of distributed real-time systems based on UML models using genetic algorithms. Elsevier Journal of Systems and Software 81 2 (2008) 161-185 (Special Issue on Model-Based Software Testing)
10. Object Management Group (OMG), UML 2.1.1 Superstructure specification, 2007.
11. V. Garousi, Empirical analysis of a genetic algorithm-based stress test technique for distributed real-time systems, in: Proceedings of the Genetic and Evolutionary Computation Conference, Search-Based Software Engineering (SBSE) track, 2008, pp. 1743-1750.
12. V. Garousi, A genetic algorithm-based stress test requirements generator tool and its empirical evaluation, IEEE Transactions on Software Engineering, Special Issue on Search-Based Optimization, in press, doi:10.1109/TSE.2010.5.
13. M.S. Gittens, The Extended Operational Profile Model for Usage-Based Software Testing, Doctoral thesis, University of Western Ontario, 2004.
14. Smith C.U. Performance Engineering of Software Systems (1990), Addison-Wesley
15. Smith C.U., and Williams L.G. Software performance engineering. Encyclopedia of Software Engineering. second ed. (2002), John Wiley and Sons
16. A. Mos, J. Murphy, Performance management in component-oriented systems using a model driven architecture: the SPL trade approach, in: Proceedings of International Enterprise Distributed Object Computing Conference, 2002, pp. 227-237.
17. Franks G., Hubbard A., Majumdar S., Neilson J.E., Petriu D.C., Rolia J.A., and Woodside C.M. A toolset for performance engineering and software design of client-server systems. Journal of Performance Evaluation vol. 24 (1995) 117-136
18. G. Franks, S. Majumdar, J. Neilsony, D. Petriu, J. Rolia, M. Woodside, Performance analysis of distributed server systems, in: Proceedings of International Conference on Software Quality, 1996, pp. 15-26.
19. V. Garousi, Iterative stress-test performance engineering of distributed real-time systems, Technical report, University of Calgary, SERG-2007-03, 2007, .
20. Smith C.U., and Williams L.G. Performance Solutions: A Practical Guide to Creating Responsive, Scalable Software (2001), Addison-Wesley Professional
21. M. Woodside, G. Franks, D.C. Petriu, The future of software performance engineering, in: International Conference on Software Engineering, Future of Software Engineering, 2007, pp. 171-187.
22. Rolia J.A., and Sevcik K.C. The method of layers. IEEE Transactions on Software Engineering 21 8 (1995) 689-700
23. C.U. Smith, L.G. Williams, Will your new distributed system require performance adjustments?, 2007, . (accessed: May).
24. Douglass B. Doing Hard Time, Developing Real-Time Systems with UML Objects, Frameworks, and Patterns (1999), Addison-Wesley
25. Object Management Group (OMG), UML Profile for Schedulability, Performance, and Time (v1. 1), 2005.
26. Object Management Group (OMG), UML profile for modeling and analysis of real-time and embedded systems (MARTE), version 2.0 beta, 2008, . (accessed January 2010).
27. V. Garousi, Measuring the cost effectiveness of stress test orders for distributed real-time systems based on fault criticalities, Technical report, University of Calgary, SERG-2007-01, 2007, .
28. Gomaa H. Designing Concurrent, Distributed, and Real-Time Applications with UML (2000), Addison-Wesley
29. Korel B. Automated software test data generation. IEEE Transactions on Software Engineering 16 8 (1990) 870-879
30. Willebeek-LeMair M.H., and Reeves A.P. Strategies for dynamic load balancing on highly parallel computers. EEE Transactions on Parallel and Distributed Systems 4 6 (1993) 979-993
31. P. Maheshwari, T.N. Kien, A. Erradi, QoS-based message-oriented middleware for web services, in: Proceedings of Workshop on Web Information Systems, 2004, pp. 241-251.
32. M. Motsko, T. Oberndorf, E.-J. Pairo, J. Smith, Rules of Thumb for the Use of COTS Products, Technical report, Carnegie Mellon University, CMU/SEI-2002-TR-032, 2002.
33. G. Ruhe, Software engineering decision support: methodology and applications, in: Tonfoni, Jain (Ed.), Innovations in Decision Support Systems, International Series on Advanced Intelligence, vol. 3, 2003, pp. 143-174.
34. Aurum B.S.A., Boehm B.W., Erdogmus H., and Grünbacher P. Value-Based Software Engineering (2005), Springer Verlag
35. Ramler R., Grünbacher P., and Biffl S. Value-based management of software testing. Value-Based Software Engineering (2005), Springer Verlag 225-244
36. Arnold R.S. Software Change Impact Analysis (1996), IEEE Computer Society Press
37. A. Daneels, W. Salter, What is SCADA?, in: Proceeding of International Conference on Accelerator and Large Experimental Physics Control Systems, 1999, pp. 39-343.
38. V. Garousi, L. Briand, Y. Labiche, Traffic-Aware Stress Testing of Distributed Systems Based on UML Models, Technical report SCE-05-13, Carleton University, 2005, .
39. J. Hammond, R. Rawlings, A. Hall, Will it work?, in: Proceedings of IEEE International Symposium on Requirements Engineering, 2001, pp. 102-109.
40. Hayes B. Cloud computing. Communications of the ACM 51 7 (2008) 9-11
41. S. Barber, Beyond Performance Testing, parts 1-14, IBM developer works, rational technical library, 2004, . (accessed: Jan. 2010).
42. M.H. Klein, State of the Practice Report: Problems in the Practice of Performance Engineering, Technical report, Software Engineering Institute, CMU/SEI-95-TR-020, 1996.
43. M. Stockdale, Performance Tuning: an Agile Approach, in: Agile Vancouver Conference Much Ado About Agile IV, talk video, 2009, .
44. Poppendieck M., and Poppendieck T. Lean Software Development: An Agile Toolkit (2003), Addison-Wesley Professional