Testing software components for integration: A survey of issues and techniques

Software Testing Verification and Reliability

Volumn 17, Issue 2, 2007, Pages 95-133

  Rehman, Muhammad Jaffar Ur ^a   Jabeen, Fakhra ^a   Bertolino, Antonia ^b   Polini, Andrea ^b  

^a CAPITAL UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Pakistan)

^b ISTI CNR   (Italy)

Author keywords

Component testing; Integration testing; Metadata; Software components

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTER SOFTWARE SELECTION AND EVALUATION; VERIFICATION;

COMPONENT TESTING; INTEGRATION TESTING; SOFTWARE COMPONENTS;

SOFTWARE ENGINEERING;

EID: 34249906788     PISSN: 09600833     EISSN: 10991689     Source Type: Journal    
DOI: 10.1002/stvr.357     Document Type: Article

References (84)

1. Garlan D, Allen J, Ockerbloom J. Architectural mismatch or why it's hard to build systems out of existing parts. Proceedings of the 17th International Conference on Software Engineering (ICSE 1995), Seattle, WA, April 1995. ACM Press: New York, 1995; 179-185.
2. Lions JL. ARIANE 5, Flight 501 Failure, Report by the Inquiry Board, 1996. http://sunnyday.mit.edu/accidents/Ariane5accidentreport.html [20 October 2006].
3. Jézéquel J-M, Meyer B. Design by contract: The lessons of Ariane. IEEE Computer 1997; 30(1):129-130.
4. Meyer B, Mingins C. Component-based development: From buzz to spark. Guest editors' introduction. IEEE Computer (Special Section on Component-Based Development) 1999; 32(7):35-37.
5. Crnkovic I, Schmidt H, Stafford J, Wallnau K. Guest editorial. The Journal of Systems and Software (Special Issue on Component-Based Software Engineering) 2003; 65(3):169-171.
6. Szyperski C, Gruntz D, Murer S. Component Software: Beyond Object-Oriented Programming (2nd edn). Addison-Wesley: Boston, MA, 2002.
7. Crnkovic I, Larsson M (eds.). Building Reliable Component-Based Software Systems. Artech House: Norwood, MA, 2002.
8. Beydeda S, Gruhn V (eds.). Testing Commercial-off-the-Shelf Components and Systems. Springer: Berlin, 2005.
9. McIllroy D. Mass produced software components. Software Engineering: Report on a Conference by the NATO Science Committee, Naur P, Randall B (eds.), 1969; 138-155.
10. Crnkovic I. Component-based software engineering - new challenges in software development. Software Focus 2001; 2(4):127-133.
11. Brown AW. Large Scale, Component-Based Development. Prentice-Hall: Englewood Cliffs, NJ, 2000.
12. Orso A, Harrold MJ, Rosenblum DS. Component metadata for software engineering tasks. Proceedings of the 2nd International Workshop on Engineering Distributed Objects (EDO 2000), Davis, CA, November 2000 (Lecture Notes in Computer Science, vol. 1999). Springer: Berlin, 2000; 129-144.
13. Carney D, Long F. What do youby COTS? Finally, a useful answer. IEEE Software 2000; 17(2):83-86.
14. Morisio M, Torchiano M. Definition and classification of COTS: A proposal. Proceedings of the 1st International Conference on COTS-Based Software Systems (ICCBSS 2002), Orlando, FL, February 2002 (Lecture Notes in Computer Science, vol. 2255). Springer: Berlin, 2002; 165-175.
15. Brereton P, Budgen D. Component-based systems: A classification of issues. IEEE Computer 2000; 33(11):54-62.
16. Meyer B. Applying 'design by contract'. IEEE Computer 1992; 25(10):40-51.
17. Beugnard A, Jézéquel JM, Plouzeau N, Watkins D. Making components contract aware. IEEE Computer 1999; 32(7):38-45.
18. Bernstein PA. Middleware: A model for distributed system services. Communications of the ACM 1996; 39(2):86-98.
19. Emmerich W. Engineering Distributed Objects. Wiley: Chichester, U.K., 2000.
20. Component Object Model Technologies. COM: Component Object Model Technologies. http://www.microsoft.com/com/default.mspx [20 October 2006].
21. Sun Microsystems. JavaBeans technologies. http://java.sun.com/products/ javabeans/ [20 October 2006].
22. Oberleitner J, Gschwind T, Jazayeri M. The Vienna Component Framework: Enabling composition across component models. Proceedings of the 25th International Conference on Software Engineering (ICSE 2003), Portland, OR, May 2003. IEEE Computer Society Press: Los Alamitos, CA, 2003; 25-35.
23. Corba Component Model Specifications. CORBA Component Model specifications, Object Management Group, 1997. http://www.omg.org/ technology/documents/formal/components.htm [20 October 2006].
24. Monson-Haefel R. Enterprise JavaBeans: Developing Enterprise Java Components (3rd edn). O'Reilly: Sebastopol, CA, 2001.
25. Bertolino A, Polini A. Re-thinking the development process of component-based software. Proceedings of the Workshop on Component-Based Software Engineering (at ECBS 2002), Lund, Sweden, April 2002.
26. Cai X, Lyu MR, Wong KF. A generic environment for COTS testing and quality prediction. Testing Commercial-off-the-Shelf Components and Systems, Beydeda S, Gruhn V (eds.). Springer: Berlin, 2005; 315-348.
27. Dogru AH, Tanik MM. A process model for component-oriented software engineering. IEEE Software 2003; 20(2):34-41.
28. Morisio M, Seaman CB, Parra AT, Basili VR, Kraft SE, Condon SE. Investigating and improving a COTS-based software development process. Proceedings of the 22nd International Conference on Software Engineering (ICSE 2000), Limerick, Ireland, June 2000. ACM Press: New York, 2000; 31-40.
29. Harrold MJ, Liang D, Sinha S. An approach to analyzing and testing component based systems. Proceedings of the 1st International Workshop on Testing Distributed Component-Based Systems (at ICSE 1999), Los Angeles, CA, May 1999.
30. Harrold MJ. Testing: A roadmap. Proceedings of the Conference on The Future of Software Engineering (at ICSE 2000), Limerick, Ireland, June 2000. ACM Press: New York, 2000; 61-72.
31. Gao J, Espinoza R, He J. Testing coverage analysis for software component validation. Proceedings of the 29th Annual International Computer Software and Applications Conference (COMPSAC 2005), Edinburgh, U.K., July 2005, vol. 1. IEEE Computer Society Press: Los Alamitos, CA, 2005; 463-470.
32. Institute of Electrical and Electronics Engineers. IEEE Standard Glossary of Software Engineering Terminology: ANSI/IEEE Standard 610-12-1990. IEEE Press: New York, 1990.
33. Councill WT. Third-party testing and the quality of software components. IEEE Software 1999; 16(4):55-57.
34. Binder RV. Testing Object-Oriented Systems: Models, Patterns, and Tools. Addison-Wesley: Boston, MA, 2000.
35. Gao J. Challenges and problems in testing software components. Proceedings of the 3rd International Workshop on Component-Based Software Engineering: Reflection on Practice (at ICSE 2000), Limerick, Ireland, June 2000.
36. Gao JZ, Tsao H-SJ, Wu Y. Testing and Quality Assurance for Component-Based Software. Artech House: Norwood, MA, 2003.
37. Freedman RS. Testability of software components. IEEE Transactions on Software Engineering 1991; 17(6):553-564.
38. Gao J, Shih M-C. A component testability model for verification and measurement. Proceedings of the 29th Annual International Computer Software and Applications Conference (COMPSAC 2005), Edinburgh, U.K., July 2005, vol. 2. IEEE Computer Society Press: Los Alamitos, CA, 2005; 211-218.
39. Wu Y, Pan D, Chen M-H. Techniques for testing component-based software. Proceedings of the 7th International Conference on Engineering of Complex Computer Systems (ICECCS 2001), Skövde, Sweden, June 2001. IEEE Computer Society Press, Los Alamitos, CA, 2001; 222-232.
40. Memon AM. A process and role-based taxonomy of techniques to make testable COTS components. Testing Commercial-off-the-Shelf Components and Systems, Beydeda S, Gruhn V (eds.). Springer: Berlin, 2005; 109-140.
41. Weyuker EJ. Testing component-based software: A cautionary tale. IEEE Software 1998; 15(5):54-59.
42. Edwards SH. A framework for practical, automated black-box testing of component-based software. Software Testing, Verification and Reliability 2001; 11(2):97-111.
43. Wang Y, King G, Wickburg H. A method for built-in tests in component-based software maintenance. Proceedings of the 3rd European Conference on Software Maintenance and Reengineering (CSMR 1999), Amsterdam, The Netherlands, March 1999. IEEE Computer Society Press: Los Alamitos, CA, 1999; 186-189.
44. Martins E, Toyota CM, Yanagawa RL. Constructing self-testable software components. Proceedings of the IEEE International Conference on Dependable Systems and Networks (DSN 2001), Göteborg, Sweden, July 2001. IEEE Computer Society Press: Los Alamitos, CA, 2001; 151-160.
45. Siegel S. Object-Oriented Software Testing: A Hierarchical Approach. Wiley: New York, 1996.
46. Toyota CM. Improving class testability using the self-testing concept. MSc Dissertation, Institute of Computing, State University of Campinas, 2000.
47. Beydeda S, Gruhn V. Merging components and testing tools: The Self-TEsting COTS Components (STECC) strategy. Proceedings of the 29th EUROMICRO Conference (EUROMICRO 2003), Belek-Antalya, Turkey, September 2003. IEEE Computer Society Press: Los Alamitos, CA, 2003; 107-115.
48. Barbier F, Belloir N. Component behavoir prediction and monitoring through built-in test. Proceeding of the 10th IEEE International Conference on Engineering of Computer-Based Systems (ECBS 2003), Huntsville, AL, April 2003. IEEE Computer Society Press: Los Alamitos, CA, 2003; 17-22.
49. Momotko M, Zalewska L. Component+ built-in testing: A technology for testing software components. Foundations of Computing and Decision Sciences 2004; 29(1-2):133-148.
50. Bhor A. Software component testing strategies. Technical Report, Department of Information and Computer Science, University of California, Irvine, 2001.
51. Gao J, Gupta K, Gupta S, Shim S. On building testable software components. Proceedings of the 1st International Conference on COTS-based Software Systems (ICCBSS 2002), Orlando, FL, February 2002 (Lecture Notes in Computer Science, vol. 2255). Springer: Berlin, 2002; 108-121.
52. Atkinson C, Gross H-G. Built-in contract testing in model-driven component-based development. Proceedings of the Workshop on Component-Based Development Processes, Austin, TX, April 2002. Available at: http://www.idt.mdh.se/CBprocesses/ [20 October 2006].
53. Atkinson C, Bayer J, Bunse C, Kamsties E, Laitenberger O, Laqua R, Muthig D, Paech B, Wüst J, Zettel J. Component-based Product Line Engineering with UML. Addison-Wesley: Boston, MA, 2002.
54. Jabeen F, Rehman MJ. A framework for object oriented component testing. Proceedings of the IEEE International Conference on Emerging Technologies (ICET 2005), Islamabad, Pakistan, September 2005. IEEE Computer Society Press: Los Alamitos, CA, 2005.
55. Orso A, Harrold MJ, Rosenblum D, Rothermel G, Soffa ML, Do H. Using component metacontent to support the regression testing of component-based software. Proceedings of the 17th International Conference on Software Maintenance (ICSM 2001), Florence, Italy, November 2001. Computer Society Press: Los Alamitos, CA, 2001; 716-725.
56. Liang D, Harrold MJ. Reuse-driven interprocedural slicing in the presence of pointers and recursion. Proceedings of the 15th International Conference on Software Maintenance (ICSM 1999), Oxford, U.K., September 1999. IEEE Computer Society Press: Los Alamitos, CA, 1999; 421-430.
57. Stafford JA, Wolf AL. Annotating components to support component-based static analyses of software systems. Proceedings of the Grace Hopper Celebration of Women in Computing, Hyannis, MA, September 2000. Also available as Technical Report CU-CS-896-99, Department of Computer Science, University of Colorado at Boulder.
58. Whaley J, Martin MC, Lam MS. Automatic extraction of object-oriented component interfaces. Proceedings of the ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2002), Roma, Italy, July 2002. Published as Software Engineering Notes 2002; 27(4):221-231.
59. Wu Y, Chen M-H, Offutt J. UML-based integration testing for component-based software. Proceedings of the 2nd International Conference on COTS-Based Software Systems (ICCBSS 2003), Ottawa, Canada, February 2003 (Lecture Notes in Computer Science, vol. 2580). Springer: Berlin, 2003; 251-260.
60. Gallagher L, Offutt J, Cincotta A. Integration testing of object-oriented components using finite state machines. Software Testing, Verification and Reliability 2006; 16(4):211-263.
61. Redolfi G, Spagnoli L, Hemesath P, Bastos RM, Ribeiro MB, Cristal M, Espindola A. A reference model for reusable components description. Proceedings of the 38th Hawaii International Conference on System Sciences (HICSS 2005), Big Island, HI, January 2005, vol. 9. IEEE Computer Society Press: Los Alamitos, CA, 2005; 282-291.
62. Brucker AD, Wolff B. Checking OCL constraints in distributed systems using J2EE/EJB. Technical Report 157, University of Freiburg, 2001.
63. Belli F, Budnik CJ. Towards self-testing of component-based software. Proceedings of the 29th Annual International Computer Software and Applications Conference (COMPSAC 2005), Edinburgh, U.K., July 2005, vol. 2. IEEE Computer Society Press: Los Alamitos, CA, 2005; 205-210.
64. Briand L, Labiche Y. A UML-based approach to system testing. Software and System Modeling 2002; 1(1):10-42.
65. Cechich A, Polo M. COTS component testing through aspect-based metadata. Testing Commercial-off-the-Shelf Components and Systems, Beydeda S, Gruhn V (eds.). Springer: Berlin, 2005; 71-88.
66. Voas JM. Certifying off-the-shelf software components. IEEE Computer 1998; 31(6):53-59.
67. Morris J, Lee G, Parker K, Bundell GA, Lam CP. Software component certification. IEEE Computer 2001; 34(9):30-36.
68. Ma Y-S, Oh S-U, Bae D-H, Kwon Y-R. Framework for third party testing of component software. Proceedings of the 8th Asia-Pacific Software Engineering Conference (APSEC 2001), Macao, China, December 2001. IEEE Computer Society Press: Los Alamitos, CA, 2001; 431-434.
69. Voas JM. Developing a usage-based software certification process. IEEE Computer 2000; 33(8):32-37.
70. Centre for Intelligent Information Processing Systems. W3C Extensible Markup Language, 2001. http://www.w3.org/TR/xml [20 October 2006].
71. Korel B. Black-box understanding of COTS components. Proceedings of the 7th International Workshop on Program Comprehension (IWPC 1999), Pittsburgh, PA, May 1999. IEEE Computer Society Press: Los Alamitos, CA, 1999; 92-99.
72. Andrews A, Ghosh S, Choi EM. A model for understanding software components. Proceedings of the 18th International Conference on Software Maintenance (ICSM 2002), Montréal, Canada, October 2002. IEEE Computer Society Press: Los Alamitos, CA, 2002; 359-369.
73. Polini A, Bertolino A. A user-oriented framework for component deployment testing. Testing Commercial-off-the-Shelf Components and Systems, Beydeda S, Gruhn V (eds.). Springer: Berlin, 2005; 169-194.
74. Gamma E, Beck K. JUnit a cook's tour. http://www.junit.org [20 October 2006].
75. Mariani L, Pezzè M. Behavior capture and test: Automated analysis of component integration. Proceedings of the 10th IEEE International Conference on Engineering of Complex Computer Systems (ICECCS 2005), Shanghai, China, June 2005. IEEE Computer Society Press: Los Alamitos, CA, 2005; 292-301.
76. Liu C, Richardson D. Software components with retrospectors. Proceedings of the 1998 International Workshop on the Role of Software Architecture in Testing and Analysis (ROSATEA 1998), Marsala, Sicily, Italy, July 1998; 63-68. Available at: http://www.ics.uci.edu/~djr/ rosatea/ [20 October 2006].
77. Buy U, Ghezzi C, Orso A, Pezzè M, Valsasna M. A framework for testing object-oriented components. Proceedings of the 1st International Workshop on Testing Distributed Component-Based Systems (at ICSE 1999), Los Angeles, CA, May 1999.
78. Harrold MJ, Rothermel G. Performing data flow testing on classes. Proceedings of the 2nd ACM SIGSOFT Symposium on the Foundations of Software Engineering, New Orleans, LA, December 1994. Published as Software Engineering Notes 1994; 19(5):154-163.
79. Beydeda S, Gruhn V. State of the art in testing components. Proceedings of the 3rd International Conference on Quality Software (QSIC 2003), Dallas, TX, November 2003. IEEE Computer Society Press: Los Alamitos, CA, 2003; 146-153.
80. Edwards SH. Toward reflective metadata wrappers for formally specified software components. Proceedings of the Workshop on Specification and Verification of Component-Based Systems (at OOPSLA 2001), Tampa Bay, FL, October 2001; 14-21. Available at: http://www.cs.iastate.edu/ ~leavens/SAVCBS/2001/papers-2001/TR.pdf.
81. Bundell GA, Lee G, Morris J, Parker K, Lam P. A software component verification tool. Proceedings of the International Conference on Software Methods and Tools (SMT 2000), Wollongong, Australia, November 2000. IEEE Computer Society Press: Los Alamitos, CA, 2000; 137-146.
82. Vincenzi AMR, Maldonado JC, Delamaro ME, Spoto ES, Wong WE. Component-based software: An overview of testing. Component-Based Software Quality: Methods and Techniques (Lecture Notes in Computer Science, vol. 2693), Cechich A, Piattini M, Vallecillo A (eds.). Springer: Berlin, 2003; 99-127.
83. Rosenblum DS. Adequate testing of component based software. Technical Report UCI-ICS-97-34, Department of Information and Computer Science, University of California, Irvine, 1997.
84. Meyer B, Mingins C, Schmidt H. Trusted components for the software industry. http://www.trusted-components.org/documents/ tc∨iginal¶per.html [20 October 2006].