The future of software performance engineering

FoSE 2007: Future of Software Engineering

Volumn , Issue , 2007, Pages 171-187

  Woodside, Murray ^a   Franks, Greg ^a   Petriu, Dorina C ^a  

^a CARLETON UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER OPERATING SYSTEMS; COMPUTER SOFTWARE SELECTION AND EVALUATION; MIDDLEWARE; REQUIREMENTS ENGINEERING; TELECOMMUNICATION NETWORKS; UBIQUITOUS COMPUTING;

PREDICTIVE MODELS; SOFTWARE PERFORMANCE ENGINEERING; SOFTWARE QUALITY;

SOFTWARE ENGINEERING;

EID: 34748855838     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/FOSE.2007.32     Document Type: Conference Paper

References (85)

1. B. Abrahao, V. Almeida, J. Almeida, A. Zhang, D. Beyer, F. Safai, "Self-Adaptive SLA-Driven Capacity Management for Internet Services", Proc. 10th IEEE/IFIP Net Operations and Management Symp., 2006, pp. 557- 568.
2. M. Arlitt, D. Krishnamurthy, J. Rolia, "Characterizing the Scalability of a Large Web-based Shopping System", ACM Trans. on Internet Technology, v 1, 2001, pp. 44-69.
3. A. Avritzer, E.J. Weyuker, "Deriving Workloads for Performance Testing", Software: Practice and Experience, v 26, 1996, pp. 613-633
4. A. Avritzer, J. Kondek, D. Liu, and E. J. Weyuker, "Software performance testing based on workload characterization," in Proc. WOSP'2002, Rome, pp. 17-24.
5. R. L. Bagrodia and C.-C. Shen, "MIDAS: Integrated Design and Simulation of Distributed Systems," IEEE Trans. Software Engineering, v. 17, 1991, pp. 1042-1058.
6. S. Balsamo and M. Marzolla. "Simulation Modeling of UML Software Architectures", Proc. ESM'03, Nottingham (UK), June 2003
7. S. Balsamo, A. DiMarco, P. Inverardi, and M. Simeoni, "Model-based Performance Prediction in Software Development", IEEE Trans. on Software Eng., vol. 30, 2004, pp. 295-310.
8. S. Barber, "Creating Effective Load Models for Performance Testing with Incomplete Empirical Data", in Proc. 6th IEEE Int. Workshop on Web Site Evolution, 2004, pp. 51-59.
9. S. Barber, "Beyond performance testing", parts 1-14, IBM DeveloperWorks, Rational Technical Library, 2004, www-128.ibm.com/ developerworks/rational/library/4169.html
10. S. Barber, "User Community Modeling Language for performance test workloads", http://www-128.ibm.com/ developerworks/rational/library/5219. html, July 2004
11. S. Barber, "Tester PI: Performance Investigator", Better Software, March 2006, pp 20-25.
12. A. Bertolino, R. Mirandola. "Software performance engineering of component-based systems", Proc. Workshop on Software and Performance, WOSP '2004, pp 238-242.
13. T.L. Booth, C.A. Wiecek, "Performance Abstract Data Types as a Tool in Software Performance Analysis and Design", IEEE Trans. Software Engineering, v 6, 1980, pp. 138-151.
14. L. Chung, B. A. Nixon, E. Yu, J. Mylopoulos, Non-Functional Requirements in Software Engineering, Kluwer, 2000.
15. Compuware, Applied Performance Management Survey, Oct. 2006.
16. V. Cortellessa and R. Mirandola, "Deriving a Queueing Network based Performance Model from UML Diagrams", in Proc. WOSP '2000, Ottawa, 2000, pp. 58-70.
17. V. Cortellessa, A. Di Marco, P. Inverardi, "Non-functional Modeling and Validation in Model-Driven Architecture", Proc 6th Working IEEE/IFIP Conference on Software Architecture (WICSA 2007), Mumbai, India, 2007.
18. Czarnecki, K. and U. Eisenecker, Generative Programming, Addison Wesley, 2000.
19. M. Debusmann and K. Geihs, "Efficient and Transparent Instrumentation of Application Components Using an Aspect-Oriented Approach", in Self-Managing Distributed Systems, vol. LNCS 2867 Springer, 2003, pp. 209-220.
20. R. France, B. Rumpe, "Model-driven Development of Complex Systems: A Research Roadmap", in Future of Software Engineering 2007, L. Briand and A. Wolf (eds), IEEE-CS Press, 2007.
21. rd Int. Conf. on Quantitative Evaluation of Systems, Riverside, CA, Sept. 2006.
22. V. Garousi, L. Briand, Y. Labiche, "Traffic-aware Stress Testing of Distributed Real-Time Systems based on UML Models", Proc. Int. Conference on Software Engineering, Shanghai, China, 2006, pp. 391-400.
23. C. Gill, R. Cytron, and D. Schmidt, "Middleware Scheduling Optimization Techniques for Distributed Real-Time and Embedded Systems", in Proc 7th Workshop on Object-Oriented Real-time Dependable Systems, San Diego, Jan. 2002.
24. C. E. Hrischuk, C. M. Woodside, and J. A. Rolia, "Trace-Based Load Characterization for Generating Software Performance Models", IEEE Trans. on Software Eng., v 25, n 1, Jan 1999, pp. 122-135.
25. C. E. Hrischuk and C. M. Woodside, "Logical clock requirements for reverse engineering scenarios from a distributed system", IEEE Trans. Software Eng., 28(4), Apr. 2002, 321-339.
26. IBM, IBM Rational PurifyPlus, Purify, PureCoverage, and Quantify: Getting Started, May 2002. G126-5339-00.
27. T. Israr, M. Woodside, G. Franks, "Interaction Tree Algorithms to Extract Effective Architecture and Layered Performance Models from Traces", Journal of Systems and Software, to appear 2007.
28. X. Jia, D. Li, H. Du, J. Cao, "On Optimal Replication of Data Object at Hierarchical and Transparent Web Proxies", IEEE Transactions on Parallel and Distributed Systems, vol. 16, no. 8, 2005, pp. 673 - 685.
29. M. W. Johnson, Monitoring and diagnosing application response time with ARM, in Proc. IEEE 3rd Int. Workshop on Systems Management, Newport, RI, USA, Apr. 1998, pp. 4-13.
30. L. Kerber, "Scenario-Based Performance Evaluation of SDL/MSC-Specified Systems", in Performance Engineering: State of the Art and Current Trends, LNCS vol. 2047, Springer, 2001.
31. D. E. Knuth, "An empirical study of FORTRAN programs", Software Practice and Experience, vol 1 no 2, Apr. 1971.
32. J. Kramer, J. Magee, "Self-Managed Systems: An Architectural Challenge", in Future of Software Engineering 2007, L. Briand and A. Wolf (eds), IEEE-CS Press, 2007.
33. D. Krishnamurthy, J.A. Rolia, S. Majumdar, "A Synthetic Workload Generation Technique for Stress Testing Session-Based Systems", IEEE Trans. on Software Engineering, v 32, 2006.
34. M. Litoiu, J.A. Rolia, "Object Allocation for Distributed Applications with Complex Workloads", in Proc. 11th Int. Conf Computer Performance Evaluation, Techniques and Tools, LNCS 1786, 2000, pp. 25-39.
35. J. W. S. Liu, Real-Time Systems, Prentice-Hall, 2000.
36. Y. Liu, I. Gorton, A. Fekete, "Design-level performance prediction of component-based applications", IEEE Trans. Software Engineering, v 31, pp 928 - 941, 2005.
37. J. P. López-Grao, J. Merseguer, and J. Campos, "From UML Activity Diagrams To Stochastic Petri Nets", in Proc. WOSP '2004, Redwood City, CA, 2004, pp. 25-36.
38. Y. Lu, T. Abdelzaher, C. Lu, L. Sha, X. Liu, "Feedback Control with Queueing-Theoretic Prediction for Relative Delay Guarantees in Web Servers", in Proc. 9th IEEE Real-Time and Embedded Technology and Applications Symposium, Washington, 2003, pp. 208-218.
39. H. Lucas Jr, "Performance evaluation and monitoring", ACM Computing Surveys, 3(3), Sept. 1971, pp 79-91.
40. M. Lyu: Software Reliability Engineering: A Roadmap, in Future of Software Engineering 2007, L. Briand and A. Wolf (eds), IEEE-CS Press, 2007.
41. P. Maly, C.M. Woodside, "Layered Modeling of Hardware and Software, with Application to a LAN Extension Router", in Proc 11th Int Conf Performance Evaluation Techniques and Tools, 2000, pp. 10-24.
42. A. D. Malony, B. R. Helm, "A theory and architecture for automating performance diagnosis", Future Generation Computer Systems, 18(1), Sept. 2001, pp 189-200.
43. P. Martin, W. Powley, X. Xu, W. Tian, "Automated Configuration of Multiple Buffer Pools", Computer Journal, vol. 49, 2006, pp. 487-499.
44. Stephen J. Mellor, "Agile MDA", Addison Wesley online article, July 23, 2004.
45. D. Menasce and H. Gomaa, "A Method for Design and Performance Modeling of Client/Server Systems", IEEE Trans. Software Engineering, v. 26, 2000, pp. 1066-1085.
46. D. Mensace, H. Ruan, H. Gommaa, "A Framework for QoS-Aware Software Components", Proc. WOSP'2004, Redwood Shores, CA, 2004, pp. 186-196.
47. Merson, P. and Hissam, S. "Predictability by construction" Posters of OOPSLA 2005, pp 134-135, San Diego, ACM Press, Oct. 2005.
48. B.P. Miller, M.D. Callaghan, J.M. Cargille, J.K. Hollingsworth, R.B. Irvin, K.L. Karavanic, K. Kunchithapadam, and T. Newhall, "The Paradyn Parallel Performance Measurement Tool", IEEE Computer, v. 28, 1995, pp. 37-46.
49. A. Mitschele-Theil, B. Muller-Clostermann, "Performance Engineering of SDL/MSC Systems", Journal on Computer Networks and ISDN Systems, v. 31, 1999, pp. 1801-1815.
50. N. Nethercote and J. Seward, "Valgrind: a program supervision framework" Electronic Notes in Theoretical Computer Science, 89(2), Oct. 2003, pp. 1-23.
51. Object Management Group, MDA Guide, Version 1.0.1, OMG document omg/2003-06-01, 2003
52. Object Management Group, UML Profile for Schedulability, Performance, and Time Specification, Version 1.1, OMG document formal/05-01 -02, Jan 2005.
53. Object Management Group, UML Profile for Modeling and Analysis of Real-Time and Embedded systems (MARTE) RFP, OMG doc. realtime/05-02-06, 2005.
54. Object Management Group, Software Process Engineering Metamodel Specification, formal/05-01-06, 2006.
55. A.L. Opdahl, "Sensitivity analysis of combined software and hardware performance models: Open queueing networks", Performance Evaluation, 22, 1995, pp. 75-92.
56. D.B. Petriu, CM. Woodside, "Analysing Software Requirements Specifications for Performance", Proc. 3rd Int. Workshop on Software and Performance, Rome, 2002.
57. Dorin B. Petriu, C.M. Woodside, "An intermediate metamodel with scenarios and resources for generating performance models from UML designs", Software and Systems Modeling, vol. 5, no. 4, 2006.
58. Dorina C Petriu, H. Shen, "Applying the UML Performance Profile: Graph Grammar based derivation of LQN models from UML specifications", in Proc. Computer Performance Evaluation - Modelling Techniques and Tools, LNCS Vol. 2324, Springer, 2002, pp.159-177.
59. R. H. Reussner, V. Firus, S. Becker, "Parametric Performance Contracts for Software Components and their Compositionality", in 9th Int. Workshop on Component-Oriented Programming, Oslo, June 2004.
60. th Int. Workshop on Software and Performance, Buenos Aires, Feb. 2007.
61. P. C Roth, B. P. Miller, "On-line Automated Performance Diagnosis on Thousands of Processes", Proc. ACM Symposium on Principles and Practice of Parallel Programming, New York, 2006, pp. 69-80
62. P. K. Sharma, J. Loyall, R. E. Schantz, J. Ye, P. Manghwani, M. Gillen, G. T. Heineman, "Managing End-to-End QoS in Distributed Embedded Applications", IEEE Internet Computing, vol. 10, no. 3, 2006, pp. 16-23.
63. H. A. Sholl and T. L. Booth, "Software Performance Modeling Using Computation Structures", IEEE Trans on Software Engineering, v. 1, no. 4 Dec. 1975.
64. H. Shen, D.C Petriu, "Performance Analysis of UML Models using Aspect Oriented Modeling Techniques", In MoDELS 2OO5 (L. Briand and C Williams, Eds.), LNCS Vol. 3713, Springer, 2005, pp. 156-170.
65. C.U. Smith, Performance Engineering of Software Systems, Addison Wesley, 1990.
66. C.U. Smith, L. G. Williams, Performance Solutions, Addison-Wesley, 2002.
67. C.U. Smith, "Software Performance Engineering", Encyclopedia of Software Engineering, Wiley, 2002.
68. C.U. Smith, C. M. Liado. "Performance model interchange format (PMIF 2.0): XML definition and implementation", In Proc. of 1st Int. Conference on the Quantative Evaluation of Systems (QEST), Enschede, The Netherlands, Sept. 2004, pp 38-47.
69. C.U. Smith, C. M. Liado, V. Cortellessa, A. diMarco, L. Williams, "From UML models to software performance results: an SPE process based on XML interchange formats", in Proc WOSP '2005, Palma de Mallorca, 2005, pp. 87-98.
70. M. Sopitkamol and D.A. Menasce, "A Method for Evaluating the Impact of Software Configuration Parameters on E-commerce Sites," Proc. WOSP'2005, Palma de Mallorca, Spain, 2005, pp.53-64.
71. C. Szypersky, D. Gruntz, S. Murer, Component Software: Beyond Object Oriented Programming, Addison-Wesley, 2002.
72. A.T. Tai, J.F. Meyer, A. Avizienis., Software Performability: From Concepts to Applications, Springer, 1995.
73. T. Verdickt, B. Dhoedt, F. Gielen, and P. Demeester "Automatic inclusion of Middleware Performance Attributes into Architectural UML Software Models", IEEE Trans. Software Eng., v. 31, 2005, pp.695-711.
74. K. M. Wasserman, G. Michailidis, and N. Bambos, "Optimal processor allocation to differentiated job flows", Performance Evaluation, vol. 63, 2006, pp. 1-14.
75. E. J. Weyuker and F. I. Vokolos, "Experience with Performance Testing of Software Systems: Issues, an Approach, and Case Study", IEEE Trans. on Software Engineering, vol. 26, no. 12 pp. 1147-1156, Dec 2000.
76. G. Weikum, A. Moenkeberg, C. Hasse, P. Zabback, "Self-tuning database technology and information services: from wishful thinking to viable engineering", Proc. 28th International Conference on Very Large Data Bases (VLDB 2002), pp. 20-31, Hong Kong, CN, 2002.
77. M. Woodside, "A Three-View Model for Performance Engineering of Concurrent Software", IEEE Transactions on Software Engineering, vol. 21, no. 9 pp. 754-767, Sept. 1995.
78. M. Woodside, C. Hrischuk, B. Selic, and S. Bayarov, "Automated Performance Modeling of Software Generated by a Design Environment", Performance Evaluation, vol. 45, no. 2-3 pp. 107-124, 2001.
79. M. Woodside, D.B. Petriu, K. Siddiqui, "Performance-related Completions for Software Specifications", Proc 24th Int. Conf. on Software Engineering, Orlando, 2002.
80. M. Woodside, D.C. Petriu, D.B. Petriu, H. Shen, T. Israr, J. Merseguer, "Performance by Unified Model Analysis (PUMA)", Proc. WOSP '2005, Mallorca, pp 1-12.
81. C.M. Woodside, T. Zheng, and M. Litoiu, "The Use of Optimal Filters to Track Parameters of Performance Models", in Proc. 2nd Int. Conf. on Quantitative Evaluation of Systems, Torino, Italy, 2005, pp. 74-84.
82. X. Wu and M. Woodside, "Performance Modeling from Software Components", in Proc. WOSP '2004, Redwood Shores, Calif, 2004, pp. 290-301.
83. J. Xu, M. Woodside, and D.C. Petriu, "Performance Analysis of a Software Design using the UML Profile for Schedulability, Performance and Time", in Proc. 13th Int. Conf. Modeling Techniques and Tools for Computer Performance Evaluation, Urbana, USA, Sept. 2003
84. C. Yilmaz, A. Krishna, A. Memon, A. Porter, D. C. Schmidt, A. Gokhale, and B. Natarajan, "Main Effects Screening: A Distributed Continuous Quality Assurance Process for Monitoring Performance Degradation in Evolving Software Systems", in Proc. 27th International Conference on Software Engineering (ICSE '05), St. Louis, MO, May 2005.
85. T. Zheng, M. Woodside, "Heuristic Optimization of Scheduling and Allocation for Distributed Systems with Soft Deadlines", in Proc. 13th Int. Conf. Modelling Techniques and Tools for Computer Performance Evaluation, Urbana, USA, 2003.