Artificial Neural Networks as multi-networks automated test oracle

Automated Software Engineering

Volumn 19, Issue 3, 2012, Pages 303-334

  Shahamiri, Seyed Reza ^a   Wan Kadir, Wan M N ^b   Ibrahim, Suhaimi ^b   Hashim, Siti Zaiton Mohd ^b  

^a UNIVERSITY OF MALAYA   (Malaysia)

^b UNIVERSITI TEKNOLOGI MALAYSIA   (Malaysia)

Author keywords

Artificial Neural Networks; Automated software testing; Mutation testing; Software test oracle

Indexed keywords

AUTOMATED SOFTWARE TESTING; AUTOMATED TEST; MISCLASSIFICATION ERROR; MUTATION TESTING; OUTPUT DOMAIN; SOFTWARE TEST; TEST ORACLES;

AUTOMATION; INTELLIGENT NETWORKS; NEURAL NETWORKS; TESTING;

SOFTWARE TESTING;

EID: 84863642080     PISSN: 09288910     EISSN: 15737535     Source Type: Journal    
DOI: 10.1007/s10515-011-0094-z     Document Type: Article

References (51)

1. Aggarwal, K.K., Singh, Y., Kaur, A., Sangwan, O.P.: A neural net based approach to test oracle. ACM SIGSOFT Softw. Eng. Notes 29(3), 1-6 (2004)
2. Ammann, P., Offutt, J.: Introduction to Software Testing, 1st edn. Cambridge University Press, New York (2008)
3. Bourlard, H.A., Morgan, N.: Connectionist Speech Recognition: A Hybrid Approach. Kluwer Academic, Norwel (1994)
4. Briand, L.C., Labiche, Y., He, S.: Automating regression test selection based on UML designs. Inf. Softw. Technol. 51(1), 16-30 (2009). doi:10.1016/j.infsof.2008.09.010
5. Hall, R.J.: A method and tools for large scale scenarios. Autom. Softw. Eng. 15(2), 113-148 (2008). doi:10.1007/s10515-008-0026-8
6. Heiat, A.: Comparison of artificial neural network and regression models for estimating software development effort. Inf. Softw. Technol. 44(15), 911-922 (2002). doi:10.1016/s0950-5849(02)00128-3 (Pubitemid 35276496)
7. Jin, H., Wang, Y., Chen, N.-W., Gou, Z.-J., Wang, S.: Artificial neural network for automatic test oracles generation. Paper presented at the Proceedings of the 2008 International Conference on Computer Science and Software Engineering, Wuhan, Hubei, 12-14 Dec. (2008)
8. Jorgensen, P.C.: Software Testing: A Craftsman's Approach, 2nd edn. CRC Press LLC, Boca Raton (2002)
9. Kessentini, M.K.M., Sahraoui, H., Boukadoum,M.: Example-based model-transformation testing. Autom. Softw. Eng. 18(2), 199-224 (2011a). doi:10.1007/s10515-010-0079-3
10. Kessentini, M., Sahraoui, H., Boukadoum, M.: Example-based model-transformation testing. Autom. Softw. Eng. 18(2), 199-224 (2011b). doi:10.1007/s10515-010-0079-3
11. Khoshgoftaar, T.M., Pandya, A.S., More, H.B.: A neural network approach for predicting software development faults. In: Pandya, A.S. (ed.) Third International Symposium on Software Reliability Engineering, Research Triangle Park, NC, pp. 83-89 (1992)
12. Khoshgoftaar, T.M., Szabo, R.M., Guasti, P.J.: Exploring the behavior of neural network software quality models. Softw. Eng. J. 10(3), 89-96 (1995)
13. Khoshgoftaar, T.M., Allen, E.B., Xu, Z.: Predicting testability of program modules using a neural network. In: Allen, E.B. (ed.) 3rd IEEE Symposium on Application-Specific Systems and Software Engineering Technology, Richardson, TX, USA, pp. 57-62 (2000)
14. Last, M., Freidman, M.: Black-box testing with info-fuzzy networks. In: Last, M., Kandel, A., Bunke, H. (eds.) Artificial Intelligence Methods in Software Testing. Series in Machine Perceprion and Artificial Intelligence, vol. 56, pp. 21-50. World Scientific, Singapore (2004)
15. Last,M., Friendman, M., Kandel, A.: Using data mining for automated software testing. Int. J. Softw. Eng. Knowl. Eng. 14(4), 369-393 (2004)
16. Lu, Y., Ye, M.: Oracle model based on RBF neural networks for automated software testing. Inf. Technol. J. 6(3), 469-474 (2007) (Pubitemid 46707259)
17. Manolache, L.I., Kourie, D.G.: Software testing using model programs. Softw. Pract. Exp. 31(13), 1211-1236 (2001) (Pubitemid 33080539)
18. Mao, Y., Boqin, F., Li, Z., Yao, L.: Neural networks based automated test oracle for software testing. In: Proceedings of the 13th International Conference Neural Information Processing, Hong Kong, China, 2006. Lecture Notes in Computer Science, pp. 498-507. Springer, Heidelberg (2006)
19. McCaffrey, J.D.: Software Testing: Fundamental Principles and Essential Knowledge. BookSurge Publishing, Charleston (2009)
20. Memon, A.M.: Automated GUI regression testing using AI planning. In: Last, M., Kandel, A., Bunke, H. (eds.) Atificial Intelligence Methods in Software Testing. Series in Machine Perception and Artificial Intelligence, vol. 56, pp. 51-99. World Scientific, Singapore (2004)
21. Memon, A.M., Pollack, M.E., Soffa, M.L.: Automated test oracles for GUIs. SIGSOFT Softw. Eng. Notes 25(6), 30-39 (2000). http://doi.acm.org/10.1145/ 357474.355050 (Pubitemid 32399969)
22. Memon, A., Nagarajan, A., Xie, Q.: Automating regression testing for evolving GUI software. J. Softw. Maint. Evol. 17(1 Spec Iss.), 27-64 (2005) (Pubitemid 40245389)
23. Menhaj, M.B.: Basics of Neural Networks, 1st edn. Amirkabir Technology University, Tehran (2001)
24. Michael, C., McGraw, G.: Automated software test data generation for complex programs. Paper presented at the Proceedings of the 13th IEEE International Conference on Automated Software Engineering, Honolulu, Hawaii, October (1998)
25. Michael, C.C., McGraw, G., Schatz, M.A.: Generating software test data by evolution. IEEE Trans. Softw. Eng. 27(12), 1085-1110 (2001) (Pubitemid 34035564)
26. Myers, G.J.: The Art of Software Testing, 2nd edn. Wiley, New York (2004)
27. Ntafos, S.C.: On comparisons of random, partition, and proportional partition testing. IEEE Trans. Softw. Eng. 27(10), 949-960 (2001). doi:10.1109/32.962563 (Pubitemid 33048253)
28. Patton, R.: Software Testing, 2nd edn. Sams Publishing, Indianapolis (2005)
29. Peters, D., Parnas, D.L.: Generating a test oracle from program documentation. In: Proceedings of the 1994 ACM SIGSOFT International Symposium on Software Testing and Analysis, Seattle, WA, USA, p. 58. ACM, New York (1994)
30. Peters, D.K., Parnas, D.L.: Using test oracles generated from program documentation. IEEE Trans. Softw. Eng. 24(3), 161-173 (1998) (Pubitemid 128740273)
31. Pfleeger, S.L., Hatton, L.: Investigating the influence of formal methods. Computer 30(2), 33-43 (1997). doi:10.1109/2.566148 (Pubitemid 127556434)
32. Ran, L., Dyreson, C., Andrews, A.A., Bryce, R., Mallery, C.: Building test cases and oracles to automate the testing of web database applications. Inf. Softw. Technol. 51(2), 460-477 (2009). doi:10.1016/j.infsof.2008.05.016
33. Richardson, D.J., Aha, S.L., O'Malley, T.O.: Specification-based test oracles for reactive systems. In: Proceedings of the 14th International Conference on Software Engineering, Melbourne, Australia, pp. 105-118. ACM, New York (1992)
34. Saraph, P., Last, M., Kandell, A.: Test case generation and reduction by automated input-output analysis. In: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics,Washington DC, United States, pp. 768-773. IEEE, New York (2003)
35. Schalkoff, R.J.: Artificial Neural Networks. McGraw-Hill, New York (1997)
36. Schroeder, P.J., Korel, B.: Black-box test reduction using input-output analysis. SIGSOFT Softw. Eng. Notes 25(5), 173-177 (2000). http://doi.acm.org/ 10.1145/347636.349042
37. Schroeder, P.J., Faherty, P., Korel, B.: Generating expected results for automated black-box testing. In: Proceedings 17th IEEE International Conference on Automated Software Engineering ASE, Edinburgh, UK, pp. 139-148 (2002)
38. Shahamiri, S.R.,Wan,M.N.W.K.: Intelligent and automated software testingmethods classification. In: 4th Postgraduate Annual Research Seminar (PARS'08), UTM Skudai, Malaysia, 1-3 July 2008 (2008)
39. Shahamiri, S.R., Kadir, W.M.N.W., Mohd-Hashim, S.Z.: A comparative study on automated software test oracle methods. In: Proceedings of the 2009 Fourth International Conference on Software Engineering Advances, Porto, Portugal, September 20-25, 2009, pp. 140-145. IEEE Computer Society, Los Alamitos (2009)
40. Shahamiri, S.R., Kadir, W.M.N.W., Ibrahim, S.: An automated oracle approach to test decision-making structures. In: Proceedings of the 2010 3rd IEEE International Conference on Computer Science and Information Technology, Chengdu, China, July 9-11, 2010, pp. 30-34. IEEE, New York (2010a)
41. Shahamiri, S.R., Kadir, W.M.N.W., Ibrahim, S.: A single-network ANN-based oracle to verify logical software modules. In: Proceedings of the 2010 2nd International Conference on Software Technology and Engineering, Puerto Rico, USA, October 3-5, 2010, pp. 272-276. IEEE, New York (2010b)
42. Shahamiri, S.R., Kadir, W.M.N.W., Ibrahim, S., Hashim, S.Z.M.: An automated framework for software test oracle. Inf. Softw. Technol. 53(7), 774-788 (2011). doi:10.1016/j.infsof.2011.02.006
43. Sofokleous, A.A., Andreou, A.S.: Automatic evolutionary test data generation for dynamic software testing. J. Syst. Softw. 81(11), 1883-1898 (2008). doi:10.1016/j.jss.2007.12.809
44. Spillner, A., Linz, T., Schaefer, H.: Software Testing Foundations, 2nd edn. Rocky Nook Inc, Santa Barbara (2007)
45. Stocks, P., Carrington, D.: A framework for specification-based testing. IEEE Trans. Softw. Eng. 22(11), 777-793 (1996). doi:10.1109/32.553698 (Pubitemid 126773877)
46. Su, Y., Huang, C.: Neural-network-based approaches for software reliability estimation using dynamic weighted combinational models. J. Syst. Softw. 80(4), 606-615 (2007) (Pubitemid 46329123)
47. Sun, Y., Bosch, L.T., Boves, L.: Hybrid HMM/BLSTM-RNN for robust speech recognition. Paper presented at the Proceedings of the 13th International Conference on Text, Speech and Dialogue, Brno, Czech Republic (2010)
48. Vanmali, M., Last, M., Kandel, A.: Using a neural network in the software testing process. Int. J. Intell. Syst. 17(1), 45-62 (2002) (Pubitemid 34103766)
49. Whittaker, J.A.: What is software testing? And why is it so hard? IEEE Softw. 17(1), 70-79 (2000) (Pubitemid 30527451)
50. Woodward, M.R.: Mutation testing-its origin and evolution. Inf. Softw. Technol. 35(3), 163-169 (1993). doi:10.1016/0950-5849(93)90053-6
51. Woodward, M.R., Hennell, M.A.: On the relationship between two control-flow coverage criteria: all JJpaths and MCDC. Inf. Softw. Technol. 48(7), 433-440 (2006). doi:10.1016/j.infsof.2005.05.003 (Pubitemid 43740479)