Automated metamorphic testing on the analyses of feature models

Information and Software Technology

Volumn 53, Issue 3, 2011, Pages 245-258

  Segura, Sergio ^a   Hierons, Robert M ^b   Benavides, David ^a   Ruiz Cortés, Antonio ^a  

^a UNIVERSITY OF SEVILLE   (Spain)

^b BRUNEL UNIVERSITY   (United Kingdom)

Author keywords

Automated analysis; Feature models; Metamorphic testing; Mutation testing; Product lines; Test data generation

Indexed keywords

AUTOMATED ANALYSIS; FEATURE MODELS; METAMORPHIC TESTING; MUTATION TESTING; PRODUCT-LINES; TEST DATA GENERATION;

AUTOMATION; DATA COMMUNICATION SYSTEMS; SOFTWARE TESTING; TESTING;

ABILITY TESTING;

EID: 79251616991     PISSN: 09505849     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.infsof.2010.11.002     Document Type: Article

References (62)

1. Ahead tool suite. < http://userweb.cs.utexas.edu/users/schwartz/ATS. html > (accessed June 2010).
2. D. Batory Feature models, grammars, and propositional formulas Software Product Lines Conference Lecture Notes in Computer Sciences vol. 3714 2005 Springer-Verlag 7 20
3. D. Batory, D. Benavides, and A. Ruiz-Cortés Automated analysis of feature models: challenges ahead Communications of the ACM 2006 45 47
4. D. Benavides, A. Ruiz-Cortés, and P. Trinidad Automated reasoning on feature models Advanced Information Systems Engineering: 17th International Conference, CAiSE 2005 Lecture Notes in Computer Sciences vol. 3520 2005 Springer-Verlag 491 503
5. D. Benavides, S. Segura, and A. Ruiz-Cortés Automated analysis of feature models 20 years later: a literature review Information Systems 35 6 2010 615 636
6. S. Beydeda. Self-metamorphic-testing components, in: Computer Software and Applications Conference, Annual International, September 2006, pp. 265-272.
7. BigLever. Biglever software gears. < http://www.biglever.com/ > (accessed June 2010).
8. W. Chan, S. Cheung, and K. Leung A metamorphic testing approach for online testing of service-oriented software applications International Journal of Web Services Research 4 2 2007 61 81
9. W.K. Chan, T.Y. Chen, and H. Lu A metamorphic approach to integration testing of context-sensitive middleware-based applications QSIC '05: Proceedings of the Fifth International Conference on Quality Software 2005 IEEE Computer Society Washington, DC, USA 241 249
10. W.K. Chan, S.C. Cheung, and K. Leung Towards a metamorphic testing methodology for service-oriented software applications QSIC '05: Proceedings of the Fifth International Conference on Quality Software 2005 IEEE Computer Society Washington, DC, USA 470 476
11. T. Chen, J. Ho, H. Liu, and X. Xie An innovative approach for testing bioinformatics programs using metamorphic testing BMC Bioinformatics 10 1 2009
12. T.Y. Chen, S.C. Cheung, and S.M. Yiu Metamorphic Testing: A New Approach for Generating Next Test Cases Technical Report HKUST-CS98-01 1998 University of Science and Technology Hong Kong
13. T.Y. Chen, J. Feng, T.H. Tse, Metamorphic testing of programs on partial differential equations: a case study, in: Proceedings of the 26th International Computer Software and Applications Conference, 2002, pp. 327-333
14. T.Y. Chen, D.H. Huang, T.H. Tse, Z.Q. Zhou, Case studies on the selection of useful relations in metamorphic testing, in: Proceedings of the 4th Ibero-American Symposium on Software Engineering and Knowledge Engineering (JIISIC 2004), 2004, pp. 569-583
15. T.Y. Chen, F. Kuo, Y. Liu, A. Tang, Metamorphic testing and testing with special values, in: Proceedings of the 5th International Conference on Software Engineering, Artificial Intelligence, Networking and Paralell/Distributed Computing, 2004.
16. T.Y. Chen, T.H. Tse, and Z. Zhou Semi-proving: an integrated method based on global symbolic evaluation and metamorphic testing Proceedings of the 2002 ACM SIGSOFT International Symposium on Software Testing and Analysis 2002 ACM 191 195
17. T.Y. Chen, T.H. Tse, and Z. Zhou Fault-based testing without the need of oracles Information and Software Technology 45 1 2003 1 9
18. Choco. < http://www.emn.fr/z-info/choco-solver/ > (accessed June 2010).
19. P. Clements, and L. Northrop Software Product Lines: Practices and Patterns SEI Series in Software Engineering 2001 Addison-Wesley
20. K. Czarnecki, P. Kim. Cardinality-based feature modeling and constraints: a progress report, in: Proceedings of the International Workshop on Software Factories at OOPSLA 2005, 2005.
21. R.A. DeMillo, R.J. Lipton, and F.G. Sayward Hints on test data selection: help for the practicing programmer IEEE Computer 11 4 1978 34 41
22. FaMa Framework. < http://www.isa.us.es/fama/ > (accessed May 2010).
23. S. Fan, N. Zhang, Feature model based on description logics, in: Knowledge-based Intelligent Information and Engineering Systems, 2006.
24. D. Fernandez-Amoros, R. Heradio, J. Cerrada, Inferring information from feature diagrams to product line economic models, in: Proceedings of the Sofware Product Line Conference, 2009.
25. Feature model plug-in. < http://gp.uwaterloo.ca/fmp/ > (accessed June 2010).
26. R. Gheyi, T. Massoni, P. Borba, A theory for feature models in alloy. in: Proceedings of the ACM SIGSOFY First Alloy Workshop, Portland, United States, November 2006, pp. 71-80.
27. A. Gotlieb, and B. Botella Automated metamorphic testing COMPSAC '03: Proceedings of the 27th Annual International Conference on Computer Software and Applications 2003 IEEE Computer Society Washington, DC, USA 34
28. Graphviz. < http://www.graphviz.org/ > (accessed June 2010).
29. Draft IEEE Standard for Software and System Test Documentation (revision of IEEE 829-1998). Technical Report, 2007.
30. JaCoP. < http://jacop.osolpro.com/ > (accessed May 2010).
31. JavaBDD. < http://javabdd.sourceforge.net/ > (accessed May 2010).
32. K. Kang, S. Cohen, J. Hess, W. Novak, S. Peterson, Feature-oriented Domain Analysis (FODA) Feasibility Study. Technical Report CMU/SEI-90-TR-21, SEI, 1990.
33. Y. Ma, J. Offutt, and Y. Kwon MuJava: a mutation system for java ICSE '06: Proceedings of the 28th International Conference on Software Engineering 2006 ACM New York, NY, USA 827 830
34. M. Mannion, and J. Camara Theorem proving for product line model verification Software Product-Family Engineering (PFE) Lecture Notes in Computer Science vol. 3014 2003 Springer Berlin/Heidelberg 211 224
35. M. Mendonca, M. Branco, D. Cowan, SPLOT, Software Product Lines Online Tools, in: Companion to the 24th ACM SIGPLAN International Conference on Object-oriented Programming, Systems, Languages, and Applications, OOPSLA 2009, ACM, Orlando, Florida, USA, 2009, pp. 761-762.
36. M. Mendonca, A. Wasowski, K. Czarnecki. SAT-based analysis of feature models is easy, in: Proceedings of the Sofware Product Line Conference, 2009.
37. Moskitt feature modeler. < http://www.pros.upv.es/mfm (accessed June 2010).
38. C. Murphy, G. Kaiser, Metamorphic Runtime Checking of Non-testable Programs, Technical Report Cucs-012-09, Dept. of Computer Science, Columbia University, 2009.
39. C. Murphy, K. Shen, and G. Kaiser Automatic system testing of programs without test oracles ISSTA '09: Proceedings of the Eighteenth International Symposium on Software Testing and Analysis 2009 ACM New York, NY, USA 189 200
40. C. Murphy, K. Shen, and G. Kaiser Using JML runtime assertion checking to automate metamorphic testing in applications without test oracles Conference on Software Testing, Verification, and Validation vol. 0 2009 IEEE Computer Society Los Alamitos, CA, USA 436 445
41. G.J. Myers, and C. Sandler The Art of Software Testing 2004 John Wiley & Sons
42. Pure-systems. pure::variants. < http://www.pure-systems.com/ > (accessed May 2010).
43. Sat4j. < http://www.sat4j.org/ > (accessed May 2010).
44. P. Schobbens, J.C. Trigaux, P. Heymans, and Y. Bontemps Generic semantics of feature diagrams Computer Networks 51 2 2007 456 479
45. S. Segura, D. Benavides, A. Ruiz-Cortés. FaMa Test Suite v1.2, Technical Report ISA-10-TR-01, ISA Research Group, 2010. < http://www.isa.us.es/ >.
46. S. Segura, D. Benavides, A. Ruiz-Cortés, Functional testing of feature model analysis tools: a test suite. IET Software, in press, doi:10.1049/iet-sen.2009.0096.
47. S. Segura, R.M. Hierons, D. Benavides, and A. Ruiz-Cortés Automated test data generation on the analyses of feature models: a metamorphic testing approach International Conference on Software Testing Verification and Validation 2010 IEEE press Paris, France 35 44)
48. S. Segura, R.M. Hierons, D. Benavides, A. Ruiz-Cortés, Mutation testing on an object-oriented framework: an experience report, in: Information and Software Technology Special Issue on Mutation Testing, in press.
49. S. Segura, R.M. Hierons, D. Benavides, A. Ruiz-Cortés, Mutation Testing on an Object-oriented Framework: An Experience Report, Technical Report ISA-10-TR-02, ISA Research Group, June 2010. < http://www.isa.us.es/ >.
50. B.H. Smith, and L. Williams On guiding the augmentation of an automated test suite via mutation analysis Empirical Software Engineering 14 3 2009 341 369
51. SPLOT Software Product Lines Online Tools. < http://www.splot- research.org/ > (accessed May 2010).
52. P. Trinidad, D. Benavides, A. Durán, A. Ruiz-Cortés, and M. Toro Automated error analysis for the agilization of feature modeling Journal of Systems and Software 81 6 2008 883 896
53. P. Trinidad, A. Ruiz-Cortés, Abductive reasoning and automated analysis of feature models: how are they connected? in: Third International Workshop on Variability Modelling of Software-intensive Systems. Proceedings, 2009, pp. 145-153.
54. P. van den Broek, I. Galvao, Analysis of feature models using generalised feature trees, in: Third International Workshop on Variability Modelling of Software-intensive Systems, Number 29 in ICB-Research Report, Universitäe Duisburg-Essen, Essen, Germany, January 2009, pp. 29-35.
55. T. van der Storm Generic feature-based software composition Software Composition LNCS vol. 4829 2007 Springer pp. 66-80
56. A. van Deursen, and P. Klint Domain-specific language design requires feature descriptions Journal of Computing and Information Technology 10 1 2002 1 17
57. H. Wang, Y.F. Li, J. Sun, H. Zhang, and J. Pan Verifying feature models using OWL Journal of Web Semantics 5 June 2007 117 129
58. E.J. Weyuker On testing non-testable programs The Computer Journal 25 4 1982 465 470
59. J. White, D. Benavides, D.C. Schmidt, P. Trinidad, B. Dougherty, and A. Ruiz-Cortes Automated diagnosis of feature model configurations Journal of Systems and Software 83 7 2010 1094 1107
60. X. Xie, W.E. Wong, T.Y. Chen, B. Xu. Spectrum-based Fault Localization Without Test Oracles, Technical Report, UTDCS-7-10, Department of Computer Science, University of Texas at Dallas, 2010.
61. W. Zhang, H. Mei, and H. Zhao Feature-driven requirement dependency analysis and high-level software design Requirements Engineering 11 3 2006 205 220
62. Z.Q. Zhou, DH. Huang, TH. Tse, Z. Yang, H. Huang, TY. Chen, Metamorphic testing and its applications, in: Proceedings of the 8th International Symposium on Future Software Technology, 2004, pp. 346-351.