Automated scalability testing of software as a service

2013 8th International Workshop on Automation of Software Test, AST 2013 - Proceedings

Volumn , Issue , 2013, Pages 8-14

  Moura, Paulo ^a   Kon, Fabio ^a  

^a UNIVERSITY OF SÃO PAULO   (Brazil)

Author keywords

[No Author keywords available]

Indexed keywords

EXTENSIBLE FRAMEWORK; HYPOTHESIS TESTS; SOFTWARE SYSTEMS; TESTING AND EVALUATION;

AUTOMATION; SCALABILITY; SOFTWARE AS A SERVICE (SAAS);

SOFTWARE TESTING;

EID: 84885009875     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IWAST.2013.6595784     Document Type: Conference Paper

References (27)

1. W.-T. Tsai, Y. Huang, and Q. Shao, "Testing the scalability of SaaS applications," IEEE International Conference on Service-Oriented Computing and Applications (SOCA), pp. 1-4, Dec. 2011.
2. Y. Luo, S. Luo, J. Guan, and S. Zhou, "A RAMCloud storage system based on HDFS: Architecture, implementation and evaluation," Journal of Systems and Software, vol. 86, no. 3, pp. 744-750, 2013.
3. M. Andreolini, M. Colajanni, and M. Pietri, "A scalable architecture for real-time monitoring of large information systems," in IEEE Second Symposium on Network Cloud Computing and Applications, 2012.
4. J. Mizher, M. Dunham, L. Lu, and Y. Xiao, "Scalability of oat," in Computer Systems and Applications, 2005. The 3rd ACS/IEEE International Conference on, 2005, p. 48.
5. Z. Kenan, Y. Baolin, C. Xi, and C. Li, "A highly scalable evaluation system with service-based architecture," in Education Technology and Computer Science (ETCS), 2010 Second International Workshop on, vol. 1, march 2010, pp. 230-233.
6. M. Kamra and R. Manna, "Performance of cloud-based scalability and load with an automation testing tool in virtual world," in IEEE Eighth World Congress on Services (SERVICES), june 2012, pp. 57-64.
7. Y. Chen and X.-H. Sun, "Stas: A scalability testing and analysis system," in Cluster Computing, 2006 IEEE International Conference on, sept. 2006, pp. 1-10.
8. P. Jogalekar and M. Woodside, "Evaluating the scalability of distributed systems," IEEE Transactions on Parallel and Distributed Systems, vol. 11, no. 6, pp. 589-603, jun 2000.
9. N. Snellman, A. Ashraf, and I. Porres, "Towards automatic performance and scalability testing of rich internet applications in the cloud," in 37th EUROMICRO Conference on Software Engineering and Advanced Applications (SEAA), 30 2011-sept. 2 2011, pp. 161-169.
10. E. de Almeida, G. Sunye, Y. Le Traon, and P. Valduriez, "A framework for testing peer-to-peer systems," in 19th International Symposium on Software Reliability Engineering, nov. 2008, pp. 167-176.
11. M. Klems, D. Bermbach, and R. Weinert, "A runtime quality measurement framework for cloud database service systems," in Proceedings of the 8th International Conference on the Quality of Information and Communications Technology. IEEE, September 2012, Inproceedings, pp. 38-46.
12. W.-T. Tsai, Y. Huang, X. Bai, and J. Gao, "Scalable Architectures for SaaS," IEEE 15th International Symposium on Object/Component/Service- Oriented Real-Time Distributed Computing Workshops, pp. 112-117, Apr. 2012.
13. C. Binnig, D. Kossmann, T. Kraska, and S. Loesing, "How is the weather tomorrow?: towards a benchmark for the cloud," in Proceedings of the Second International Workshop on Testing Database Systems, ser. DBTest '09. ACM, 2009, pp. 9:1-9:6.
14. X. Guerin, W. Tan, Y. Liu, S. Seelam, and P. Dube, "Evaluation of Multi-core Scalability Bottlenecks in Enterprise Java Workloads," IEEE 20th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, pp. 308-317, Aug. 2012.
15. L. Duboc, E. Letier, and D. S. Rosenblum, "Death, Taxes, & Scalability," IEEE Software, vol. 27, no. 4, pp. 20-21, Jul. 2010.
16. D. R. Law, "Scalable means more than more: a unifying definition of simulation scalability," in Winter Simulation Conference Proceedings, vol. 1, dec 1998, pp. 781-788 vol.1.
17. D. Jayasinghe, G. Swint, S. Malkowski, J. Li, Q. Wang, J. Park, and C. Pu, "Expertus: A generator approach to automate performance testing in IaaS clouds," in IEEE 5th International Conference on Cloud Computing (CLOUD), june 2012, pp. 115-122.
18. Z. Li, L. O'Brien, H. Zhang, and R. Cai, "On a catalogue of metrics for evaluating commercial cloud services," in ACM/IEEE 13th International Conference on Grid Computing (GRID), sept. 2012, pp. 164-173.
19. P. Jogalekar and M. Woodside, "Evaluating the scalability of distributed systems," in System Sciences, 1998., Proceedings of the Thirty-First Hawaii International Conference on, vol. 7, jan 1998, pp. 524-531 vol.7.
20. F. Kon et al., "D3.2.2 : CHOReOS middleware implementation," The CHOReOS Consortium, Tech. Rep., 2012.
21. F. Besson, P. Moura, F. Kon, and D. Milogicic, "Rehearsal: a framework for automated testing of web service choreographies," in Tool session of the 3rd Brazilian Conference on Software: Theory and Practice, sep 2012.
22. J. Rehr, F. Vila, J. Gardner, L. Svec, and M. Prange, "Scientific computing in the cloud," Computing in Science Engineering, vol. PP, no. 99, p. 1, 2011.
23. B. Cornea, J. Bourgeois, T. Nguyen, and D. El-Baz, "Scalable performance predictions of distributed peer-to-peer applications," in IEEE 14th International Conference on High Performance Computing and Communication, IEEE 9th International Conference on Embedded Software and Systems (HPCC-ICESS), june 2012, pp. 193-201.
24. Z. Hill, J. Li, M. Mao, A. Ruiz-Alvarez, and M. Humphrey, "Early observations on the performance of Windows Azure," Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing-HPDC '10, p. 367, 2010.
25. H. Liu and S. Wee, "Web server farm in the cloud: Performance evaluation and dynamic architecture," in Proceedings of the 1st International Conference on Cloud Computing, ser. CloudCom '09. Berlin, Heidelberg: Springer-Verlag, 2009, pp. 369-380.
26. G. Casella and R. Berger, Statistical Inference, 2nd ed., ser. The Wadsworth & Brooks/Cole Statistics/Probability series. Wadsworth & Brooks/Cole Advanced Books & Software, 2002.
27. R. Buyya, C. S. Yeo, S. Venugopal, J. Broberg, and I. Brandic, "Cloud computing and emerging IT platforms: Vision, hype, and reality for delivering computing as the 5th utility," Future Generation Computer Systems, vol. 25, no. 6, pp. 599-616, 2009.