An automated framework for software test oracle

Information and Software Technology

Volumn 53, Issue 7, 2011, Pages 774-788

  Shahamiri, Seyed Reza ^a,b   Kadir, Wan Mohd Nasir Wan ^a   Ibrahim, Suhaimi ^a   Hashim, Siti Zaiton Mohd ^a  

^a UNIVERSITI TEKNOLOGI MALAYSIA   (Malaysia)

^b Jalan Sentul Indah ^*  (Malaysia)

Author keywords

Artificial neural networks; I O Relationship Analysis; Mutation testing; Software test oracle

Indexed keywords

ARTIFICIAL NEURAL NETWORK; AUTOMATED TEST; COMPARATIVE STUDIES; EVALUATION FRAMEWORK; GENERATION PROCESS; I/O RELATIONSHIP ANALYSIS; MISCLASSIFICATION ERROR; MUTATION TESTING; OUTPUT DOMAIN; RELATIONSHIP ANALYSIS; SOFTWARE TEST; SOFTWARE TEST ORACLE; TEST ORACLES;

AUTOMATION; COMPARATORS (OPTICAL); COMPUTER SOFTWARE SELECTION AND EVALUATION; SOFTWARE TESTING; TESTING;

NEURAL NETWORKS;

EID: 79955055107     PISSN: 09505849     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.infsof.2011.02.006     Document Type: Article

References (52)

1. A.M.J. Hass Guide to Advanced Software Testing 2008 Artech House Boston
2. J.A. Whittaker What is software testing? And why is it so hard? IEEE Software 17 2000 70 79 (Pubitemid 30527451)
3. L. Ran, C. Dyreson, A. Andrews, R. Bryce, and C. Mallery Building test cases and oracles to automate the testing of web database applications Information and Software Technology 51 2009 460 477
4. P. Ammann, and J. Offutt Introduction to Software Testing first ed. 2008 Cambridge University Press New York
5. Q. Xie, and A.M. Memon Designing and comparing automated test oracles for GUI-based software applications ACM Transactions on Software Engineering and Methodology 16 2007 4
6. S.R. Shahamiri, W.M.N.W. Kadir, S.Z. Mohd-Hashim, A comparative study on automated software test oracle methods, in: Proceedings of the 2009 Fourth International Conference on Software Engineering Advances, IEEE Computer Society, Porto, Portugal, 2009, pp. 140-145.
7. S.R. Shahamiri, W.M.N.W. Kadir, S. Ibrahim, An automated oracle approach to test decision-making structures, in: Proceedings of the 2010 3rd IEEE International Conference on Computer Science and Information Technology, IEEE Publication, Chengdu, China, 2010, pp. 30-34.
8. S.R. Shahamiri, W.M.N.W. Kadir, S. Ibrahim, A single-network ANN-based oracle to verify logical software modules, in: Proceedings of the 2010 2nd International Conference on Software Technology and Engineering, IEEE Publication, Puerto Rico, USA, 2010, pp. 272-276.
9. M.R. Woodward Mutation testing: its origin and evolution Information and Software Technology 35 1993 163 169
10. M.S. Phadke Planning efficient software tests CrossTalk 10 10 1997 11 15
11. S.R.J. Dalal, A. Karunanithi, N. Leaton, J.M. Lott, C.M., Model-based testing of a highly programmable system, in: The Ninth International Symposium on Software Reliability Engineering, IEEE, Paderborn, 1998, pp. 174-178.
12. T.Y. Chen On the expected number of failures detected by subdomain testing and random testing IEEE Transactions on Software Engineering 22 2 1996 109 119 (Pubitemid 126771661)
13. B. Korel, and P.J. Schroeder Maintaining the quality of black-box testing The Journal of Defense Software Engineering 14 5 2001 24 28
14. P.J. Schroeder, and B. Korel Black-box test reduction using input-output analysis SIGSOFT Software Engineering Notes 25 2000 173 177
15. P.J. Schroeder, P. Faherty, B. Korel, Generating expected results for automated black-box testing, in: Proceedings 17th IEEE International Conference on Automated Software Engineering ASE, Edinburgh, UK, 2002, pp. 139-148.
16. A. Spillner, T. Linz, and H. Schaefer Software Testing Foundations 2nd ed. 2007 Rocky Nook Inc. Santa Barbara
17. S.C. Ntafos On comparisons of random, partition, and proportional partition testing IEEE Transactions on Software Engineering 27 2001 949 960 (Pubitemid 33048253)
18. P.C. Jorgensen Software Testing: a Craftsman"s Approach second ed. 2002 CRC Press LLC
19. P. Stocks, and D. Carrington A framework for specification-based testing IEEE Transactions on Software Engineering 22 1996 777 793 (Pubitemid 126773877)
20. D.J. Richardson, S.L. Aha, T.O. O"Malley, Specification-based test oracles for reactive systems, in: Proceedings of the 14th International Conference on Software Engineering, ACM, Melbourne, Australia, 1992, pp. 105-118.
21. D. Peters, D.L. Parnas, Generating a test oracle from program documentation, in: Proceedings of the 1994 ACM SIGSOFT International Symposium on Software Testing and Analysis, ACM, Seattle, WA, USA, 1994, pp. 58.
22. D.K. Peters, and D.L. Parnas Using test oracles generated from program documentation IEEE Transactions on Software Engineering 24 1998 161 173 (Pubitemid 128740273)
23. S.L. Pfleeger, and L. Hatton Investigating the influence of formal methods Computer 30 1997 33 43 (Pubitemid 127556434)
24. L.I. Manolache, and D.G. Kourie Software testing using model programs Software, Practice and Experience 31 2001 1211 1236 (Pubitemid 33080539)
25. M. Last, M. Freidman, Black-box testing with info-fuzzy networks, in: M. Last, A. Kandel, H. Bunke (Eds.), Artificial Intelligence Methods in Software Testing, World Scientific, 2004, pp. 21-50.
26. M. Last, M. Friendman, and A. Kandel Using data mining for automated software testing International Journal of Software Engineering and Knowledge Engineering 14 2004 369 393
27. L.C. Briand, Y. Labiche, and S. He Automating regression test selection based on UML designs Information and Software Technology 51 2009 16 30
28. M.R. Woodward, and M.A. Hennell On the relationship between two control-flow coverage criteria: all JJ-paths and MCDC Information and Software Technology 48 2006 433 440 (Pubitemid 43740479)
29. C. Michael, G. McGraw, Automated software test data generation for complex programs, in: Proceedings of the 13th IEEE International Conference on Automated Software Engineering, IEEE Computer Society, Honolulu, Hawaii, 1998, pp. 136-146.
30. C.C. Michael, G. McGraw, and M.A. Schatz Generating software test data by evolution IEEE Transactions on Software Engineering 27 2001 1085 1110 (Pubitemid 34035564)
31. A.A. Sofokleous, and A.S. Andreou Automatic, evolutionary test data generation for dynamic software testing Journal of Systems and Software 81 2008 1883 1898
32. A. Memon, A. Nagarajan, and Q. Xie Automating regression testing for evolving GUI software Journal of Software Maintenance and Evolution 17 2005 27 64 (Pubitemid 40245389)
33. A.M. Memon, Automated GUI regression testing using AI planning, in: M. Last, A. Kandel, H. Bunke (Eds.), Artificial Intelligence Methods in Software Testing, World Scientific, 2004, pp. 51-99.
34. A.M. Memon, M.E. Pollack, and M.L. Soffa Automated test oracles for GUIs SIGSOFT Software Engineering Notes 25 2000 30 39 (Pubitemid 32399969)
35. S.R. Shahamiri, M.N.W.K. Wan, Intelligent and automated software testing methods classification, in: 4th Postgraduate Annual Research Seminar (PARS"08), UTM Skudai, Malaysia, 2008.
36. Y.-S. Su, and C.-Y. Huang Neural-network-based approaches for software reliability estimation using dynamic weighted combinational models Journal of Systems and Software 80 2007 606 615 (Pubitemid 46329123)
37. P. Saraph, M. Last, A. Kandell, Test case generation and reduction by automated input-output analysis, in: IEEE International Conference on Systems, Man and Cybernetics, IEEE, Washington DC, United States, 2003, pp. 768-773.
38. T.M. Khoshgoftaar, A.S. Pandya, H.B. More, A neural network approach for predicting software development faults, in: A.S. Pandya (Ed.), Third International Symposium on Software Reliability Engineering, Research Triangle Park, NC 1992, pp. 83-89.
39. T.M. Khoshgoftaar, R.M. Szabo, and P.J. Guasti Exploring the behavior of neural network software quality models Software Engineering Journal 10 1995 89 96
40. T.M. Khoshgoftaar, E.B. Allen, Z. Xu, Predicting testability of program modules using a neural network, in: E.B. Allen (Ed.) 3rd IEEE Symposium on Application-Specific Systems and Software Engineering Technology, Richardson, TX, USA, 2000, pp. 57-62.
41. M. Vanmali, M. Last, and A. Kandel Using a neural network in the software testing process International Journal of Intelligent Systems 17 2002 45 62 (Pubitemid 34103766)
42. K.K. Aggarwal, Y. Singh, A. Kaur, and O.P. Sangwan A neural net based approach to test oracle ACM SIGSOFT Software Engineering Notes 29 2004 1 6
43. J. Hu, W. Yi, C. Nian-Wei, G. Zhi-Jian, W. Shuo, Artificial Neural Network for Automatic Test Oracles Generation, in: Proceedings of the 2008 International Conference on Computer Science and Software Engineering, IEEE Computer Society, Wuhan, Hubei, 2008.
44. Y. Mao, F. Boqin, Z. Li, L. Yao, Neural networks based automated test oracle for software testing, in: Proceedings of the 13th International Conference Neural Information Processing, Springer Verlag, Heidelberg, D-69121, Germany, Hong Kong, China, 2006, pp. 498-507.
45. Y. Lu, and M. Ye Oracle model based on RBF neural networks for automated software testing Information Technology Journal 6 2007 469 474 (Pubitemid 46707259)
46. S.R. Shahamiri, W.M.N.W. Kadir, S. Ibrahim, S.Z. Mohd-Hashim, Artificial neural networks as multi-networks automated test oracle, Automated Software Engineering, in preparation.
47. R.J. Schalkoff, Artificial Neural Networks, McGraw-Hill, 1997.
48. M.B. Menhaj Basics of Neural Networks first ed. 2001 Amirkabir Technology University Tehran
49. A. Heiat Comparison of artificial neural network and regression models for estimating software development effort Information and Software Technology 44 2002 911 922 (Pubitemid 35276496)
50. J.D. McCaffrey, Software Testing: Fundamental Principles and Essential Knowledge, BookSurge Publishing, 2009.
51. G.J. Myers, The Art of Software Testing, second ed., Wiley, 2004.
52. R. Patton, Software Testing, second ed., Sams Publishing, 2005.