Mutating database queries

Information and Software Technology

Volumn 49, Issue 4, 2007, Pages 398-417

  Tuya, Javier ^a   Suárez Cabal, Ma José ^a   la Riva, Claudio de ^a  

^a UNIVERSITY OF OVIEDO   (Spain)

Author keywords

Database testing; Fault based testing; Mutation testing; Software testing; SQL testing; Test adequacy criteria

Indexed keywords

COMPUTER SOFTWARE SELECTION AND EVALUATION; DATABASE SYSTEMS; FAULT TOLERANT COMPUTER SYSTEMS; INFORMATION RETRIEVAL; SPECTRUM ANALYSIS;

DATABASE TESTING; FAULT BASED TESTING; MUTATION TESTING; SQL TESTING; TEST ADEQUACY CRITERIA;

QUERY LANGUAGES;

EID: 33846467766     PISSN: 09505849     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.infsof.2006.06.009     Document Type: Article

References (59)

1. Andrews J., Briand L., and Labiche Y. Is mutation an appropriate tool for testing experiments?. Proceedings of the 27th International Conference on Software Engineering (2005), ACM Press, New York 402-411
2. Borthick A.F., Bowen P.L., Jones D.R., and Tse M.H.K. The effects of information request ambiguity and construct incongruence on query development. Decision Support Systems 32 1 (2001) 3-25
3. Borthick A.F., Bowen P.L., Liew S.T., and Rohde F.H. The effects of normalization on end-user query errors: an experimental evaluation. International Journal of Accounting Information Systems 2 4 (2001) 195-221
4. Bowen P.L., and Rohde F.H. Further evidence of the effects of normalization on end-user query errors: an experimental evaluation. International Journal of Accounting Information Systems 3 4 (2002) 255-290
5. Brass S., and Goldberg C. Proving the safety of SQL queries. Proceedings of the fifth International Conference on Quality Software (2005), IEEE Computer Society Press, Los Alamitos, CA 197-205
6. Brass S., and Goldberg C. Semantic errors in SQL Queries: a quite complete list. Journal of Systems and Software 79 5 (2006) 630-644
7. Chan H.C., and Wei K.K. User-database interface: the effect of abstraction levels on query performance. MIS Quarterly 17 4 (1993) 441-464
8. H.C. Chan, L. Xiang, Evaluation of the Impacts of data model and query language on query performance, in: Proceedings of the Second, Annual Workshop on HCI Research in MIS, Seattle, WA, 2003, pp. 12-13.
9. Chan M.Y., and Cheung S.C. Testing database applications with SQL semantics. Proceedings of the 2nd International Symposium on Cooperative Database Systems for Advanced Applications (1999), Springer, Singapore 363-374
10. Chan W.K., Cheung S.C., and Tse T.H. Fault-based testing of database application programs with conceptual data model. Proceedings of the fifth International Conference on Quality Software (2005), IEEE Computer Society Press, Los Alamitos, CA 187-196
11. Chays D., Deng Y., Frankl P.G., Dan S., Vokolos F.I., and Weyuker E.J. An AGENDA for testing relational database applications, Software Testing. Verification and Reliability 14 1 (2004) 17-44
12. Davies R.A., Beynon R.J.A., and Jones B.F. Automating the testing of databases. Proceedings of the First, International Workshop on Automated Program Analysis, Testing and Verification (2000), IEEE Computer Society 15-20
13. DeMillo R.A., Lipton R.J., and Sayward F.G. Hints on test data selection: help for the practicing programmer. IEEE Computer 11 4 (1978) 34-43
14. DeMillo R.A., and Offutt A.J. Constraint-based automatic test data generation. IEEE Transactions on Software Engineering 17 9 (1991) 900-910
15. Deng Y., Frankl P., and Chays D. Testing database transactions with AGENDA. Proceedings of the 27th International Conference on Software Engineering (2005), ACM Press, New York, NY, USA 78-87
16. Deng Y., Frankl P., and Wang J. Testing web database applications, Workshop on Testing. Analysis and Verification of Web Services (2004), ACM Press, New York 1-10
17. Elbaum S., Rothermel G., Karre S., and Fisher II M. Leveraging user-session data to support web application testing. IEEE Transactions on Software Engineering 31 3 (2005) 187-202
18. Elbaum S., Malishevssky A.G., and Rothermel G. Test case priorization: A family of empirical studies. IEEE Transactions on Software Engineering 28 2 (2002) 159-182
19. Hamlet R.G. Testing programs with the aid of a compiler. IEEE Transactions on Software Engineering 3 4 (1977) 270-290
20. Haraty R.A., Mansour N., and Daou B.A. Regression testing of database applications. Journal of Database Management 13 2 (2002) 31-42
21. Imielinski T., and Lipski Jr. W. Incomplete information in relational databases. Journal of the Association for Computing Machinery 31 4 (1984) 761-779
22. International Standards Organisation, Information technology - Database languages - SQL, ISO/IEC 9075:1992, third edition.
23. Kapfhammer G.M., and Soffa M.L. A family of test adequacy criteria for database-driven applications. Proceedings of the 9th European Software Engineering Conference and the 11th ACM SIGSOFT International Symposium on Foundations of Software Engineering (2003), ACM Press, New York 98-107
24. King K.N., and Offutt A.J. A Fortran language system for mutation-based software testing. Software Practice and Experience 21 7 (1991) 686-718
25. Klein H.J. How to Modify SQL Queries in Order to Guarantee Sure Answers. ACM SIGMOD Record 23 3 (1994) 14-20
26. Kuhn D.R. Fault Classes and Error Detection Capability of Specification-Based Testing. ACM Transactions on Software Engineering and Methodology 8 4 (1999) 411-424
27. Liao C., and Palvia P.C. The impact of data models and task complexity on end-user performance: an experimental investigation. International Journal of Human-Computer Studies 52 (2000) 831-845
28. Lu H., Chan H.C., and Wei K.K. A survey on usage of SQL. ACM SIGMOD Record 22 4 (1993) 60-65
29. Ma Y.S., Offutt J., and Kwon Y.R. MuJava: an automated class mutation system, Software Testing. Verification and Reliability 15 2 (2005) 97-133
30. Mannila H., and Räihä K.J. Test data for relational queries. Proceedings of the fifth ACM SIGACT-SIGMOD Symposium on Principles of Database Systems (1986), ACM Press, New York, NY, USA 217-223
31. Mansour N., and Houri M. Testing web applications. Information and Software Technology 48 1 (2005) 31-42
32. A.P. Mathur, Performance, effectiveness, and reliability issues in software testing, in: Proceedings of the 15th Annual International Computer Software and Applications Conference, 1991, pp. 604-605.
33. National Institute of Standards and Technology, Software Diagnostics and Conformance Testing Division, Conformance Test Suite Software (http://www.itl.nist.gov/div897/ctg/software.htm), accessed July 2005.
34. Offutt A.J. Investigations on the Software Testing Coupling Effect. ACM Transactions on Software Engineering and Methodology 1 1 (1992) 5-20
35. Offutt A.J., Lee A., Rottermel T., Untch R.H., and Zapf C. An experimental determination of sufficient mutant operators. ACM Transactions on Software Engineering and Methodology 5 2 (1996) 99-118
36. A.J. Offutt, R.H. Untch RH. Mutation 2000: uniting the orthogonal, in: Mutation 2000: Mutation Testing in the Twentieth and the Twenty First, Centuries, San Jose, CA, 2000, pp. 45-55.
37. A.J. Offut, W. Xu, Generating test cases for web services using Data Perturbation, in: Workshop on Testing, Analysis and Verification of Web Services, ACM Press, New York, NY, USA, 2004, pp. 1-10.
38. A.J. Offutt, J. Pan, J.M. Voas, Procedures for Reducing the Size of Coverage based Test Sets, in: Proceedings of the 12th International Conference on Testing Computer Software, Washington, DC, 1995, pp. 111-123.
39. Okun V., Black P.E., and Yesha Y. Comparison of fault classes in specification-based testing. Information and Software Technology 46 8 (2004) 525-533
40. R. Pönighaus, 'Favourite' SQL-Statements - an empirical analysis of SQL-Usage in commercial applications, in: Proceedings of the sixth International Conference on Information Systems and Management of Data, Lecture Notes in Computer Science, vol. 1006, Springer, 1995, pp. 75-91.
41. Reisner P. Use of psychological experimentation as an aid to Development of a query language. IEEE Transactions on Software Engineering 3 3 (1977) 218-229
42. Robbert M.A., and Maryanski F.J. Automated test plan generator for database application systems. Proceedings of the ACM SIGSMALL/PC Symposium on Small systems (1991), ACM Press, New York, NY, USA 100-106
43. Rothermel G., and Elbaum S. Putting your best tests forward. IEEE Software 20 5 (2003) 74-77
44. Rothermel1 G., Mary Jean Harrold M.J., von Ronne J., and Hong C. Empirical studies of test-suite reduction, Software Testing. Verification and Reliability 12 4 (2002) 219-249
45. Rothermel G., Untch R.H., and Harrold M.J. Prioritizing test cases for regression testing. IEEE Transactions on Software Engineering 27 10 (2001) 929-948
46. Siau K.L., Chan H.C., and Wei K.L. Effects of query complexity and learning on novice user query performance with conceptual and logical database interfaces. IEEE Transactions on Systems, Man and Cybernetics-Part A: Systems and Humans 34 2 (2004) 276-281
47. Slutz D. Massive stochastic testing of SQL. Proceedings of the 24th International Conference on Very Large Data Bases (1998), Morgan Kaufman, San Francisco, CA 618-622
48. Suárez-Cabal M.J., and Tuya J. Using an SQL coverage measurement for testing database Applications. Proceedings of the ACM SIGSOFT Symposium on the Foundations of Software Engineering (2004), ACM Press, New York 253-262
49. Sullivan J. SQL test suite goes online. Computer 30 6 (1997) 103-105
50. Tsai W.T., Volovik D., and Keefe T.F. Automated test case generation for programs specified by relational algebra queries. IEEE Transactions on Software Engineering 16 3 (1990) 316-324
51. Vassiliou Y. Null values in database management. A denotational semantics approach, Proceedings of the ACM SIGMOD international conference on Management of data (1979), ACM Press, New York 162-169
52. D. Willmor, S.M. Embury, A safe regression test selection technique for database driven applications, in: Proceedings of the IEEE International Conference on Software Maintenance, September 2005.
53. D. Willmor, S.M. Embury, Exploring test adequacy for database systems, in: Proceedings of the 3rd UK Software Testing Research Workshop, September 2005.
54. Willmor D., and Embury S.M. An intensional approach to the specification of test cases for database applications. Proceedings of the 28th International Conference on Software Engineering (2006), ACM Press, New York
55. Woodward M.R. Insights into software testing. Software Focus 2 3 (2001) 93-103
56. Woodward M.R. Mutation testing - Its origin and evolution. Information and Software Technology 35 3 (1993) 163-169
57. Wu X., Wang Y., and Zheng Y. Privacy preserving database application testing. Proceedings of the ACM Workshop on Privacy in Electronic Society (2003), ACM Press, New York 118-128
58. Zhang J., Xu C., and Cheung S.C. Automatic generation of database instances for white-box testing. Proceedings of the 25th Annual International Computer Software and Applications Conference (2001), IEEE Computer Society Press, Los Alamitos, CA 161-165
59. Zhu H., Hall P.A.V., and May J.H.R. Software unit test coverage and adequacy. ACM Computing Surveys 29 4 (1997) 366-427