A survey of software testing in the cloud

Proceedings of the 2012 IEEE 6th International Conference on Software Security and Reliability Companion, SERE-C 2012

Volumn , Issue , 2012, Pages 18-23

  Inçki, Koray ^a,b   Ari, Ismail ^b   Sözer, Hasan ^b  

^a SCIENTIFIC AND TECHNOLOGICAL RESEARCH COUNCIL OF TURKEY   (Turkey)

^b OZYEGIN UNIVERSITY   (Turkey)

Author keywords

Cloud computing; Cloud testing; Cloud based software testing; Software testing; Testing as a service; Testing cloud services

Indexed keywords

CLOUD SERVICES; COMPUTING PARADIGM; NOVEL TESTING; RESEARCH DIRECTIONS; RESEARCH FIELDS; SOFTWARE TESTING TECHNIQUES;

C (PROGRAMMING LANGUAGE); CLOUD COMPUTING; RESEARCH; SECURITY OF DATA; SOFTWARE RELIABILITY; SURVEYS; TESTING;

SOFTWARE TESTING;

EID: 84866935316     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SERE-C.2012.32     Document Type: Conference Paper

References (57)

1. Ibm cp-40 project. http://en.wikipedia.org/wiki/IBM CP-40, 2012. [Online; accessed 12-Feb-2012].
2. Won Kim, Soo Dong Kim, Eunseok Lee, and Sungyoung Lee. Adoption issues for cloud computing. In Proc. of the 7th International Conference on Advances in Mobile Computing and Multimedia, pages 2-5, New York, NY, USA, 2009.
3. Youssef Ridene and Franck Barbier. A model-driven approach for automating mobile applications testing. In Proc. of the 5th European Conference on Software Architecture: Companion Volume, pages 9:1-9:7, New York, NY, USA, 2011.
4. Peter Mell and Timothy Grance. The nist definition of cloud computing (draft) recommendations of the national institute of standards and technology. Nist Special Publication, 145(6):7, 2011.
5. Mladen A Vouk. Cloud computing: Issues, research and implementations. ITI 2008 30th International Conference on Information Technology Interfaces, 16(4):31-40, 2008.
6. Leah Muthoni Riungu, Ossi Taipale, and Kari Smolander. Software testing as an online service: Observations from practice. IEEE International Conference on Software Testing Verification and Validation Workshop, 0:418-423, 2010.
7. Lian Yu, Wei-Tek Tsai, Xiangji Chen, Linqing Liu, Yan Zhao, Liangjie Tang, and Wei Zhao. Testing as a service over cloud. In Service Oriented System Engineering (SOSE), 2010 Fifth IEEE International Symposium on, pages 181-188, June 2010.
8. Srikanth Baride and Kamlesh Dutta. A cloud based software testing paradigm for mobile applications. ACM SIGSOFT Software Engineering Notes, 36(3):1-4, 2011.
9. Matt Staats and Corina Pǎsǎreanu. Parallel symbolic execution for structural test generation. In Proc. of the 19th International Symposium on Software Testing and Analysis, pages 183-194, New York, NY, USA, 2010.
10. Zhen Ming Jiang. Automated analysis of load testing results. In Proc. of the 19th International Symposium on Software Testing and Analysis, pages 143-146, New York, NY, USA, 2010.
11. George Candea, Stefan Bucur, and Cristian Zamfir. Automated software testing as a service. In Proc. of the 1st ACM Symposium on Cloud Computing, pages 155-160, New York, NY, USA, 2010.
12. Jan S. Rellermeyer, Michael Duller, and Gustavo Alonso. Engineering the cloud from software modules. In Proc. of the 2009 ICSE Workshop on Software Engineering Challenges of Cloud Computing, pages 32-37, Washington, DC, USA, 2009.
13. Liang Zhao, Anna Liu, and Jacky Keung. Evaluating cloud platform architecture with the care framework. In Proc. of the 2010 Asia Pacific Software Engineering Conference, pages 60-69, Washington, DC, USA, 2010.
14. W.K. Chan, Lijun Mei, and Zhenyu Zhang. Modeling and testing of cloud applications. In Services Computing Conference, 2009. IEEE Asia-Pacific, pages 111-118, Dec. 2009.
15. A.I. Avetisyan, R. Campbell, I. Gupta, M.T. Heath, S.Y. Ko, G.R. Ganger, M.A. Kozuch, D. O'Hallaron, M. Kunze, T.T. Kwan, K. Lai, M. Lyons, D.S. Milojicic, Hing Yan Lee, Yeng Chai Soh, Ng Kwang Ming, J-Y. Luke, and Han Namgoong. Open cirrus: A global cloud computing testbed. Computer, 43(4):35-43, April 2010.
16. Leah Riungu-kalliosaari, Ossi Taipale, and Kari Smolander. Testing in the cloud: Exploring the practice. IEEE Software, PP:1, 2011.
17. Nianjun Zhou, Da Peng An, Liang-Jie Zhang, and Chih-Hong Wong. Leveraging cloud platform for custom application development. In Proc. of the 2011 IEEE International Conference on Services Computing, pages 584-591, Washington, DC, USA, 2011.
18. T. Vengattaraman, P. Dhavachelvan, and R. Baskaran. A model of cloud based application environment for software testing. CoRR, abs/1004.1773:XX, 2010.
19. Wang Jun and Fanpeng Meng. Software testing based on cloud computing. In Proc. of the 2011 International Conference on Internet Computing and Information Services, pages 176-178, Washington, DC, USA, 2011.
20. Niclas Snellman, Adnan Ashraf, and Ivan Porres. Towards automatic performance and scalability testing of rich internet applications in the cloud. In Proc. of the 2011 37th EUROMICRO Conference on Software Engineering and Advanced Applications, pages 161-169, Washington, DC, USA, 2011.
21. Toshihiro Hanawa, Hitoshi Koizumi, Takayuki Banzai, Mitsuhisa Sato, Shin'ichi Miura, Tadatoshi Ishii, and Hidehisa Takamizawa. Customiz- ing virtual machine with fault injector by integrating with specc device model for a software testing environment d-cloud. In Proc. of the 2010 IEEE 16th Pacific Rim International Symposium on Dependable Computing, pages 47-54, Washington, DC, USA, 2010.
22. Takayuki Banzai, Hitoshi Koizumi, Ryo Kanbayashi, Takayuki Imada, Toshihiro Hanawa, and Mitsuhisa Sato. D-cloud: Design of a software testing environment for reliable distributed systems using cloud computing technology. In Proc. of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing, pages 631-636, Washington, DC, USA, 2010.
23. Toshihiro Hanawa, Takayuki Banzai, Hitoshi Koizumi, Ryo Kanbayashi, Takayuki Imada, and Mitsuhisa Sato. Large-scale software testing environment using cloud computing technology for dependable parallel and distributed systems. In Proc. of the 2010 Third International Conference on Software Testing, Verification, and Validation Workshops, pages 428-433, Washington, DC, USA, 2010.
24. Simone R. S. Souza, Maria A. S. Brito, Rodolfo A. Silva, Paulo S. L. Souza, and Ed Zaluska. Research in concurrent software testing: A systematic review. In Proc. of the Workshop on Parallel and Distributed Systems: Testing, Analysis, and Debugging, pages 1-5, New York, NY, USA, 2011.
25. Wei-Tek Tsai, Peide Zhong, J. Balasooriya, Yinong Chen, Xiaoying Bai, and J. Elston. An approach for service composition and testing for cloud computing. In Autonomous Decentralized Systems (ISADS), 2011 10th International Symposium on, pages 631-636, March 2011.
26. C.R. Senna, L.F. Bittencourt, and E.R.M. Madeira. An environment for evaluation and testing of service workflow schedulers in clouds. In High Performance Computing and Simulation (HPCS), 2011 International Conference on, pages 301-307, July 2011.
27. Atif Farid Mohammad and Hamid Mcheick. Cloud services testing: An understanding. Procedia CS, 5:513-520, 2011.
28. Linghao Zhang, Tao Xie, Nikolai Tillmann, Jonathan de Halleux, Xiaoxing Ma, and Jian Lu. Environment modeling for automated testing of cloud applications. IEEE Software, Special Issue on Software Engineering for Cloud Computing, 1:xx, March/April 2012.
29. Tariq M. King and Annaji Sharma Ganti. Migrating autonomic self-testing to the cloud. In Proc. of the 2010 Third International Conference on Software Testing, Verification, and Validation Workshops, pages 438-443, Washington, DC, USA, 2010.
30. Thomas Rings, Jens Grabowski, and Stephan Schulz. On the standardization of a testing framework for application deployment on grid and cloud infrastructures. In Proc. of the 2010 Second International Conference on Advances in System Testing and Validation Lifecycle, pages 99-107, Washington, DC, USA, 2010.
31. L.M. Riungu, O. Taipale, and K. Smolander. Research issues for software testing in the cloud. In Cloud Computing Technology and Science (CloudCom), 2010 IEEE Second International Conference on, pages 557-564, 30 2010-Dec. 3 2010.
32. Wei-Tek Tsai, Qihong Shao, Yu Huang, and Xiaoying Bai. Towards a scalable and robust multi-tenancy saas. In Proc. of the Second Asia-Pacific Symposium on Internetware, pages 8:1-8:15, New York, NY, USA, 2010.
33. Guanying Wang, Ali R. Butt, Prashant Pandey, and Karan Gupta. Using realistic simulation for performance analysis of map-reduce setups. In Proc. of the 1st ACM Workshop on Large-Scale System and Application Performance, pages 19-26, New York, NY, USA, 2009.
34. Sebastian Gaisbauer, Johannes Kirschnick, Nigel Edwards, and Jerry Rolia. Vats: Virtualized-aware automated test service. In Proc. of the 2008 Fifth International Conference on Quantitative Evaluation of Systems, pages 93-102, Washington, DC, USA, 2008.
35. Yongzhi Wang and Jinpeng Wei. Viaf: Verification-based integrity assurance framework for map-reduce. 2011 IEEE 4th International Conference on Cloud Computing, pages 300-307, 2011.
36. Philipp Zech. Risk-based security testing in cloud computing environments. 2011 Fourth IEEE International Conference on Software Testing Verification and Validation, pages 411-414, 2011.
37. Xiaofei Zhang, Hui Liu, Bin Li, Xing Wang, Haiqiang Chen, and Shizhong Wu. Application-oriented remote verification trust model in cloud computing. 2010 IEEE Second International Conference on Cloud Computing Technology and Science, pages 405-408, 2010.
38. Van Tran, Jacky Keung, Anna Liu, and Alan Fekete. Application migration to cloud: A taxonomy of critical factors. In Proc. of the 2nd International Workshop on Software Engineering for Cloud Computing, pages 22-28, New York, NY, USA, 2011.
39. Xiaoning Ding, Hai Huang, Yaoping Ruan, Anees Shaikh, Brian Peterson, and Xiaodong Zhang. Splitter: A proxy-based approach for postmigration testing of web applications. In Proc. of the 5th European conference on Computer systems, pages 97-110, New York, NY, USA, 2010.
40. Tauhida Parveen and Scott R. Tilley. When to migrate software testing to the cloud? In ICST Workshops, pages 424-427, 2010.
41. Parastoo Mohagheghi and Thor Saether. Software engineering challenges for migration to the service cloud paradigm: Ongoing work in the remics project. In Proc. of the 2011 IEEE World Congress on Services, pages 507-514, Washington, DC, USA, 2011.
42. Ji Ho Kim, Sang Min Lee, Dong Seong Kim, and Jong Sou Park. Performability analysis of iaas cloud. In Proc. of the 2011 Fifth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing, pages 36-43, Washington, DC, USA, 2011.
43. Pallavi Joshi, Haryadi S. Gunawi, and Koushik Sen. Prefail: A programmable tool for multiple-failure injection. SIGPLAN Not., 46:171-188, Oct. 2011.
44. Cuong Pham, Daniel Chen, Zbigniew Kalbarczyk, and Ravishankar K. Iyer. Cloudval: A framework for validation of virtualization environment in cloud infrastructure. In Proc. of the 2011 IEEE/IFIP 41st International Conference on Dependable Systems & Networks, pages 189-196, Washington, DC, USA, 2011.
45. Lorenzo Martignoni, Roberto Paleari, Giampaolo Fresi Roglia, and Danilo Bruschi. Testing system virtual machines. In Proc. of the 19th International Symposium on Software Testing and Analysis, pages 171-182, New York, NY, USA, 2010.
46. Jason S. Bolin, James Bret Michael, and Man tak Shing. Cloud computing support for collaboration and communication in enterprise-wide workflow processes. In SERVICES, pages 589-593, 2011.
47. Liviu Ciortea, Cristian Zamfir, Stefan Bucur, Vitaly Chipounov, and George Candea. Cloud9: A software testing service. SIGOPS Oper. Syst. Rev., 43:5-10, Jan. 2010.
48. Stefan Bucur, Vlad Ureche, Cristian Zamfir, and George Candea. Parallel symbolic execution for automated real-world software testing. In Proc. of The Sixth Conference on Computer Systems, pages 183-198, New York, NY, USA, 2011.
49. Yunho Kim and Moonzoo Kim. Score: A scalable concolic testing tool for reliable embedded software. In Proc. of the 19th ACM SIGSOFT Symposium and the 13th European Conference on Foundations of Software Engineering, pages 420-423, New York, NY, USA, 2011.
50. George Chang, Emily Law, and Shan Malhotra. Demonstration of lmmp automated performance testing using cloud computing architecture. In Proc. of the 2nd International Workshop on Software Engineering for Cloud Computing, pages 71-71, New York, NY, USA, 2011.
51. Huan Liu and Dan Orban. Remote network labs: An on-demand network cloud for configuration testing. SIGCOMM Comput. Commun. Rev., 40:83-91, Jan. 2010.
52. Lian Yu, Xiaohu Li, and Zhongjie Li. Testing tasks management in testing cloud environment. In Proc. of the 2011 IEEE 35th Annual Computer Software and Applications Conference, pages 76-85, Washington, DC, USA, 2011.
53. James Michael Ferris. Systems and methods for software test management in cloud-based network, 2009.
54. Shigeru Hosono, He Huang, Tatsunori Hara, Yoshiki Shimomura, and Tamio Arai. A lifetime supporting framework for cloud applications. In Proc. of the 2010 IEEE 3rd International Conference on Cloud Computing, pages 362-369, Washington, DC, USA, 2010.
55. Yuriy Brun, Reid Holmes, Michael D. Ernst, and David Notkin. Speculative analysis: Exploring future development dtates of software. In Proc. of the FSE/SDP workshop on Future of Software Engineering Research, pages 59-64, New York, NY, USA, 2010.
56. M. Oriol and F. Ullah. Yeti on the cloud. In Proc. of the Third International Conference on Software Testing, Verification, and Validation, pages 434-437, April 2010.
57. Online software testing services community. http://www.utest.com/, 2012. [Online; accessed 12-Feb-2012].