A metamorphic relation-based approach to testing web services without oracles

International Journal of Web Services Research

Volumn 9, Issue 1, 2012, Pages 51-73

  Sun, Chang Ai ^a   Wang, Guan ^a   Mu, Baohong ^a   Liu, Huai ^b   Wang, ZhaoShun ^a   Chen, T Y ^a  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY BEIJING   (China)

^b SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

Author keywords

Metamorphic Testing; Service Oriented Architecture (SOA); Software Testing; Test Oracle; Web Services

Indexed keywords

APPLICATION DEVELOPMENT; METAMORPHIC TESTING; ORACLE PROBLEM; SOURCE CODES; TEST CASE; TEST ORACLES; TEST TECHNIQUES; TESTABILITY; UNIQUE FEATURES;

INFORMATION SERVICES; SERVICE ORIENTED ARCHITECTURE (SOA); SOFTWARE TESTING; TESTING; WEBSITES;

WEB SERVICES;

EID: 84870268295     PISSN: 15457362     EISSN: 15465004     Source Type: Journal    
DOI: 10.4018/jwsr.2012010103     Document Type: Article

References (35)

1. Andrews, J. H., Briand, L. C., & Labiche, Y. (2005). Is mutation an appropriate tool for testing experiments? In Proceedings of the 27th International Conference on Software Engineering, St. Louis, MO (pp. 402-411
2. Bai, X., Lee, S., Tsai, W.-T., & Chen, Y. (2008). Ontology-based test modelling and partitioning testing of web services. In Proceedings of the 6th International Conference on Web Services, Beijing, China (pp. 465-472
3. Bartolini, C., Bertolino, A., Elbaum, S., & Marchetti, E. (2009). Whitening SOA testing. In Proceedings of the 7th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering, Amsterdam, The Netherlands (pp. 161-170
4. Bartolini, C., Bertolino, A., Marchetti, E., & Polini, A. (2009). WS-TAXI: A WSDL-based testing tool of web services. In Proceedings of the 2nd International Conference on Software Testing Verification and Validation, Denver, CO (pp. 326-335
5. Canfora, G., & Di Penta, M. (2009). Service Oriented Architecture testing: A survey. In A. De Lucia & F. Ferrucci (Eds.), Proceedings of the International Summer Schools Lectures on Software Engineering (LNCS 5413, pp. 78-105
6. Chan, W. K., Cheung, S. C., & Leung, K. R. P. H. (2007). A metamorphic testing approach for online testing of service oriented software applications. International Journal of Web Services Research, 4(2), 61-81. doi:10.4018/jwsr.2007040103
7. Chen, T. Y. (2010). Metamorphic testing: A simple approach to alleviate the oracle problem. In Proceedings of the 5th IEEE International Symposium on Service Oriented System Engineering, Nanjing, China (pp. 1-2
8. Chen, T. Y., Cheung, S. C., & Yiu, S. M. (1998). Metamorphic testing: A new approach for generating next test cases (Tech. Rep. No. HKUST-CS98-01). Clear Water Bay, NT, Hong Kong: Hong Kong University of Science and Technology.
9. Chen, T. Y., Ho, J. W. K., Liu, H., & Xie, K. (2009). An innovative approach for testing bioinformatics programs using metamorphic testing. BMC Bioinformatics, 10, 14. doi:10.1186/1471-2105-10-24
10. Chen, T. Y., Huang, D. H., Tse, T. H., & Zhou, Z. Q. (2004). Case studies on the selection of useful relations in metamorphic testing. In Proceedings of the 4th Ibero-American Symposium on Software Engineering and Knowledge Engineering, Madrid, Spain (pp. 569-583
11. Chen, T. Y., Kuo, F. C., Liu, Y., & Tang, A. (2004). Metamorphic testing and testing with special values. In Proceedings of the 5th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing, Beijing, China (pp. 128-134
12. Chen, T. Y., Tse, T. H., & Zhou, Z. Q. (2003). Fault-based testing without the need of oracle. Information and Software Technology, 45(1), 1-9. doi:10.1016/S0950-5849(02)00129-5
13. Chen, T. Y., Tse, T. H., & Zhou, Z. Q. (2011). Semi-proving: An integrated method for program proving, testing, and debugging. IEEE Transactions on Software Engineering, 37(1), 109-125. doi:10.1109/TSE.2010.23
14. DeMillo, R. A., Lipton, R. J., & Sayward, F. G. (1978). Hints on test data selection: Help for the practicing programmer. IEEE Computer, 1(4), 31-41.
15. Dong, G. W., Xu, B. W., Chen, L., Nie, C. H., & Wang, L. L. (2009). Survey of metamorphic testing. Journal of Frontiers of Computer Science and Technology, 3(2), 130-143.
16. Farooq, A., Georgieva, K., & Dumke, R. R. (2008). Challenges in evaluating SOA test processes. In R. R. Dumke, R. Braungarten, G. Büren, A. Abran, & J. J. Cuadrado-Gallego (Eds.), Proceedings of the International Conferences IWSM, Metrikon and Mensura on Software Process and Product Measurement (LNCS 5338, pp. 107-113
17. Haas, H., & Brown, A. (2004). Web services glossary. Retrieved from http://www.w3.org/TR/ws-gloss/
18. Heckel, R., & Lohmann, M. (2004). Towards contract-based testing of web services. In Proceedings of the International Workshop on Test and Analysis of Component Based Systems, Barcelona, Spain (pp. 145-456
19. Knight, J. C., & Leveson, N. G. (1986). An experimental evaluation of the assumption of independence in multi-version programmings. IEEE Transactions on Software Engineering, 12(1), 96-109.
20. Lenz, C., Chimiak-Opoka, J., & Breu, R. (2007). Model driven testing of SOA-based software. In Proceedings of the Workshop on Software Engineering Methods for Service-Oriented Architecture, Hannover, Germany (pp. 99-110
21. Murphy, C., Kaiser, G., Hu, L., & Wu, L. (2008). Properties of machine learning applications for use in metamorphic testing. In Proceedings of the 20th International Conference on Software Engineering and Knowledge Engineering, San Francisco Bay, CA (pp. 867-872
22. Offutt, J., Ma, Y. S., & Kwon, Y. R. (2004). An experimental mutation system for Java. ACM SIGSOFT Software Engineering Notes, 29(5), 1-4. doi:10.1145/1022494.1022537
23. Offutt, J., & Xu, W. (2004). Generating test cases for web services using data perturbation. ACM SIGSOFT Software Engineering Notes, 29(5), 1-10. doi:10.1145/1022494.1022529
24. Papazoglou, M., Traverso, P., Dustdar, S., & Leymann, F. (2008). Service-oriented computing: A research roadmap. International Journal on Cooperative Information Systems, 17(2), 223-255. doi:10.1142/S0218843008001816
25. Peltz, C. (2003). Web services orchestration: A review of emerging technologies, tools, and standards (Tech. Rep.). Palo Alto, CA: Hewlett-Packard Company. Retrieved from http://devresource.hp.com/drc/
26. Ruth, M., & Tu, S. (2007). A safe regression test selection technique for web services. In Proceedings of the 2nd International Conference on Internet and Web Application and Services, Mauritius, République de Maurice (p. 47
27. Sosnoski, D. (2009). Electronic source with authors and publication time. Retrieved from http://www.ibm.com/developerworks/java/library/j-jws6/index.html
28. Sun, C. (2011). On open issues on SOA-based software development. Journal of China Science Paper Online. Retrieved from http://www.paper.edu.cn/index. php/default/releasepaper/content/201107-461
29. Sun, C., Khoury, E., & Aiello, M. (2011). Transaction management in service-oriented systems: Requirements and a proposal. IEEE Transactions on Services Computing, 4(2), 167-180.
30. Sun, C., Wang, G., & Zhao, Y. (2011). Web service development: A process framework and case study. Journal of China Science Paper Online. Retrieved from http://www.paper.edu.cn/index.php/default/releasepaper/content/ 201104-18
31. Tsai, W. T., Chen, Y., Paul, R., Huang, H., Zhou, X., & Wei, X. (2005). Adaptive testing, oracle generation, and test case generation for web services. In Proceedings of the 29th International Computer Software and Applications Conference, Edinburgh, UK (Vol. 2, pp. 101-106 (Pubitemid 46744863)
32. Weyuker, E. J. (1982). On testing non-testable programs. The Computer Journal, 25(4), 465-470.
33. Wu, P., Shi, X. C., Tang, J. J., Lin, H. M., & Chen, T. Y. (2005). Metamorphic testing and special case testing: A case study. Journal of Software, 16(7), 1210-1220. doi:10.1360/jos161210 (Pubitemid 41134576)
34. Zhang, J. (2011). A Mobile Agent-Based Tool Supporting Web Services Testing. Wireless PersonalCommunications, 56(1), 147-172.
35. Zhang, J. and Qiu, R.G. (2006). Fault Injection-based Test Case Generation for SOA-oriented Software. In Proceedings 2006 IEEE International Conference on Service Operations and Logistics, and Informatics, Shanghai, China (pp. 1070-1078). (Pubitemid 350080764)