Cloud testing tools

Proceedings - 6th IEEE International Symposium on Service-Oriented System Engineering, SOSE 2011

Volumn , Issue , 2011, Pages 1-12

  Bai, Xiaoying ^a,b   Li, Muyang ^a   Chen, Bin ^a   Tsai, Wei Tek ^a,c   Gao, Jerry ^a,d  

^a TSINGHUA UNIVERSITY   (China)

^b BEIHANG UNIVERSITY   (China)

^c ARIZONA STATE UNIVERSITY   (United States)

^d SAN JOSE STATE UNIVERSITY   (United States)

Author keywords

Cloud Computing; Cloud Testing; Testing Tool

Indexed keywords

COMMERCIAL TOOLS; DYNAMIC CONFIGURATION; FUTURE TRENDS; LARGE SCALE SIMULATIONS; PAY-PER-USE; RESEARCH AND DEVELOPMENT; RESEARCH TOOLS; RESOURCE SHARING; SOFTWARE SYSTEMS; TEST ENVIRONMENT; TESTING TOOL; TESTING TOOLS;

CLOUD COMPUTING; SURVEYS; SYSTEMS ENGINEERING;

SOFTWARE TESTING;

EID: 84863167222     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SOSE.2011.6139087     Document Type: Conference Paper

References (58)

1. B. P. Rimal, E. Choi, and I. Lumb, "A Taxonomy and Survey of Cloud Computing Systems," in Proceedings of Fifth Int. Joint Conf. INC, IMS and IDC NCM '09, 2009, pp. 44-51.
2. W. Tsai, Q. Shao, Y. Huang, and X. Bai, "Towards a Scalable and Robust Multi-Tenancy SaaS," in Proceedings of the Second Asia-Pacific Symposium on Internetware, 2010, p. 8.
3. W. Tsai, Y. Huang, and Q. Shao, "EasySaaS: A SaaS development framework," in SOCA '11, 2011.
4. Amazon Web Service. [Online]. Available: http://aws.amazon.com/
5. "News Briefs," Computer, vol. 44, pp. 18-20, 2011.
6. J. Gao, X. Bai, and W. T. Tsai, "Cloud-Testing:Issues, Challenges, Needs and Practice," Software Engineering: An International Journal, vol. 1, no. 1, pp. 9-23, 2011.
7. G. Candea, S. Bucur, and C. Zamfir, "Automated Software Testing as a Service," in Proceedings of the 1st ACM symposium on Cloud computing, 2010, pp. 155-160.
8. L. Ciortea, C. Zamfir, S. Bucur, V. Chipounov, and G. Candea, "Cloud9: A Software Testing Service," ACM SIGOPS Operating Systems Review, vol. 43, no. 4, pp. 5-10, 2010.
9. T. King and A. Ganti, "Migrating Autonomic Self-Testing to the Cloud," in Third International Conference on Software Testing, Verification, and Validation Workshops, 2010, pp. 438-443.
10. J. Moreno, D. Kossmann, T. Kraska, and S. Loesing, "A Testing Framework for Cloud Storage Systems," Master's thesis, Swiss Federal Institute of Technology Zurich, 2010.
11. M. Oriol and F. Ullah, "YETI on the cloud," in Third International Conference on Software Testing, Verification, and Validation Workshops, 2010, pp. 434-437.
12. L. Yu, W. Tsai, X. Chen, L. Liu, Y. Zhao, L. Tang, and W. Zhao, "Testing as a Service over Cloud," in 2010 Fifth IEEE International Symposium on Service Oriented System Engineering, 2010, pp. 181-188.
13. Z. Ganon and I. E. Zilbershtein, "Cloud-based Performance Testing of Network Management Systems," in Proceedings of IEEE 14th Int. Workshop Computer Aided Modeling and Design of Communication Links and Networks (CAMAD '09), 2009, pp. 1-6.
14. S. Baride and K. Dutta, "A Cloud Based Software Testing Paradigm for Mobile Aapplications," ACM SIGSOFT Software Engineering Notes, vol. 36, no. 3, pp. 1-4, 2011.
15. B. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears, "Benchmarking Cloud Serving Systems with YCSB," in Proceedings of the 1st ACM symposium on Cloud computing, 2010, pp. 143-154.
16. W. Sobel, S. Subramanyam, A. Sucharitakul, J. Nguyen, H. Wong, S. Patil, A. Fox, and D. Patterson, "CloudStone: Multi-platform, Multi-language Benchmark and Measurement Tools for Web 2.0," in Proceedings of Cloud Computing and Its Applications, 2008.
17. C. Binnig, D. Kossmann, T. Kraska, and S. Loesing, "How is the Weather Tomorrow? Towards a Benchmark for the Cloud," in Proceedings of the Second International Workshop on Testing Database Systems, 2009, pp. 9:1-9:6.
18. D. Borthakur. The Hadoop Distributed File System: Architecture and Design. [Online]. Available: http://hadoop.apache.org/common/docs/r0.18.0/hdfs design.pdf
19. S. Ghemawat, H. Gobioff, and S. Leung, "The Google File System," in ACM SIGOPS Operating Systems Review, vol. 37, no. 5, 2003, pp. 29-43.
20. W. Tsai, G. Qi, and X. Bai, "AgileSaaS: An agile SaaS development framework," Arizona State University, Tempe, AZ, USA, 2011.
21. W. Tsai, Q. Shao, and W. Li, "OIC: Ontology-based intelligent customization framework for SaaS," in Proceedings of SOCA, 2010, pp. 1-8.
22. X. Bai, W. T. Tsai, Y. Gong, and J. Huang, "Massive Scalability and Dynamic Reconfiguration: Challenges to Software System Testing Introduced by Service-Oriented Computing," Communications of the CCF, vol. 9, pp. 35-41, 2010.
23. C. Frye. Cloud Computing Creates Software Testing Challenges. [Online]. Available: http://http://searchcloudcomputing.techtarget.com/ news/1355198/Cloud-computing-creates-software-testing-challenges
24. T. Parveen and S. Tilley, "When to Migrate Software Testing to the Cloud?" in Third International Conference on Software Testing, Verification, and Validation Workshops, 2010, pp. 424-427.
25. L. Riungu, O. Taipale, and K. Smolander, "Research Issues for Software Testing in the Cloud," in 2010 IEEE Second International Conference on Cloud Computing Technology and Science (CloudCom), 2010, pp. 557-564.
26. K. Yim, D. Hreczany, and R. Iyer, "HTAF: Hybrid Testing Automation Framework to Leverage Local and Global Computing Resources," in Computational Science and Its Applications - ICCSA 2011. Springer Berlin / Heidelberg, 2011, vol. 6784, pp. 479-494. [Online]. Available: http://dx.doi.org/10.1007/978-3-642-21931-3 37
27. Taobao. [Online]. Available: http://www.Taobao.com/
28. W. Tsai, Y. Huang, Q. Shao, and M. Barrett, "Testing the scalability of SaaS applications," in IEEE RTSOAA '11, 2011.
29. W. Tsai, Y. Huang, Q. Shao, and X. Bai, "Data partitioning and redundancy management for robust multi-tenancy SaaS," Int J Software Informatics, vol. 4, no. 4, 2010.
30. W. Tsai, X. Zhou, Y. Chen, and X. Bai, "On Testing and Evaluating Service-Oriented Software," Computer, vol. 41, no. 8, pp. 40-46, 2008.
31. W. Tsai, W. Li, H. Sarjoughian, and Q. Shao, "SimSaaS: simulation software-as-a-service," in Proceedings of the 44th Annual Simulation Symposium, 2011, pp. 77-86.
32. P. Brebner and A. Liu, "Performance and Cost Assessment of Cloud Services," in Proceedings of the 2010 international conference on Service-oriented computing, 2011, pp. 39-50.
33. A. Li, X. Yang, S. Kandula, and M. Zhang, "CloudCmp: Comparing Public Cloud Providers," in Proceedings of the 10th annual conference on Internet measurement, 2010, pp. 1-14.
34. W. Tsai, R. Paul, L. Yu, A. Saimi, and Z. Cao, "Scenario-based Web Services Testing with Distributed Agents," IEICE Transactions on Information and Systems, vol. 86, no. 10, pp. 2130-2144, 2003.
35. W. T. Tsai, Y. Chen, R. Paul, N. Liao, and H. Huang, "Cooperative and Group Testing in Verification of Dynamic Composite Web Services," in Proceedings of 28th Annual Int. Computer Software and Applications Conf. (COMPSAC 2004), vol. 2, 2004, pp. 170-173.
36. W. T. Tsai, R. Paul, Z. Cao, L. Yu, and A. Saimi, "Verification of Web Services using an enhanced UDDI server," in Proceedings of 8th Int. Workshop Object-Oriented Real-Time Dependable Systems (WORDS 2003), 2003, pp. 131-138.
37. X. Bai, Z. Cao, and Y. Chen, "Design of a Trustworthy Service Broker and Dependence-based Progressive Group Testing," International Journal of Simulation and Process Modelling, vol. 3, no. 1, pp. 66-79, 2007. (Pubitemid 47470958)
38. X. Bai, Y. Wang, G. Dai, W.-T. Tsai, and Y. Chen, "A Framework for Contract-Based Collaborative Verification and Validation of Web Services," in Component-Based Software Engineering. Springer Berlin / Heidelberg, 2007, vol. 4608, pp. 258-273.
39. L. Riungu, O. Taipale, and K. Smolander, "Software Testing as an Online Service: Observations from Practice," in Third International Conference on Software Testing, Verification, and Validation Workshops, 2010, pp. 418-423.
40. Tieto. [Online]. Available: http://www.tieto.com/
41. Sogeti. [Online]. Available: http://www.sogeti.com/testing
42. T. King, A. Ramirez, R. Cruz, and P. Clarke, "An Integrated Self-Testing Framework for Autonomic Computing Systems," Journal of Computers, vol. 2, no. 9, pp. 237-249, 2007.
43. T. King, "A Self-Testing Approach for Autonomic Software," Ph.D. dissertation, Florida International University, 2010.
44. R. Calheiros, R. Ranjan, A. Beloglazov, C. De Rose, and R. Buyya, "CloudSim: a Toolkit for Modeling and Simulation of Cloud Computing Environments and Evaluation of Resource Provisioning Algorithms," Software: Practice and Experience, vol. 41, no. 1, pp. 23-50, 2011.
45. T. Banzai, H. Koizumi, R. Kanbayashi, T. Imada, T. Hanawa, and M. Sato, "D-Cloud: Design of a Software Testing Environment for Reliable Distributed Systems using Cloud Computing Technology," in Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing, 2010, pp. 631-636.
46. P. Joshi, H. S. Gunawi, and K. Sen, "PreFail: a Programmable Tool for Multiple-Failure Injection," in Proceedings of the 2011 ACM international conference on Object oriented programming systems languages and applications, 2011, pp. 171-188.
47. H. S. Gunawi, T. Do, P. Joshi, P. Alvaro, J. Yun, J.-s. Oh, J. M. Hellerstein, A. C. Arpaci-Dusseau, R. H. Arpaci-Dusseau, K. Sen, and D. Borthakur, "FATE and DESTINI: A Framework for Cloud Recovery Testing," EECS Department, University of California, Berkeley, Tech. Rep. UCB/EECS-2010-127, Sep 2010. [Online]. Available: http: //www.eecs.berkeley.edu/ Pubs/TechRpts/2010/EECS-2010-127.html
48. J. Penix, "Panel presentation," in 33rd International Conference on Software Engineering. Google, 2011.
49. A. Duarte, W. Cirne, F. Brasileiro, P. Duarte, and L. Machado, "Using the Computational Grid to Speed Up Software Testing," in Proceedings of 19th Brazilian symposium on software engineering, 2005.
50. A. Duarte, W. Cirne, F. Brasileiro, and P. Machado, "GridUnit: Software Testing on the Grid," in Proceedings of the 28th international conference on Software engineering, 2006, pp. 779-782.
51. A. Duarte, G. Wagner, F. Brasileiro, and W. Cirne, "Multi- Environment Software Testing on the Grid," in Proceedings of the 2006 workshop on Parallel and distributed systems: testing and debugging, 2006, pp. 61-68.
52. A. Lastovetsky, "Parallel Testing of Distributed Software," Information and Software Technology, vol. 47, no. 10, pp. 657-662, 2005.
53. T. Parveen, S. Tilley, N. Daley, and P. Morales, "Towards a Distributed Execution Framework for JUnit Test Cases," in IEEE International Conference on Software Maintenance, 2009., sept. 2009, pp. 425-428.
54. R. L. Grossman, Y. Gu, M. Sabala, C. Bennett, J. Seidman, and J. Mambretti, "The Open Cloud Testbed: A Wide Area Testbed for Cloud Computing Utilizing High Performance Network Services," CoRR, vol. abs/0907.4810, 2009.
55. C. Bennett, R. L. Grossman, D. Locke, J. Seidman, and S. Vejcik, "MalStone: Towards a Benchmark for Analytics on Large Data Clouds," in Proceedings of the 16th ACM International Conference on Knowledge Discovery and Data mining (SIGKDD '10), 2010, pp. 145-152.
56. SOASTA. [Online]. Available: http://www.SOASTA.com/
57. ITKO. [Online]. Available: http://www.itko.com/
58. Cloud Testing. [Online]. Available: http://www.CloudTesting.com/