Test development for communication protocols: Towards automation

Computer Networks

Volumn 31, Issue 17, 1999, Pages 1835-1872

  Dssouli, R ^a   Saleh, K ^b   Aboulhamid, E ^a   En Nouaary, A ^a   Bourhfir, C ^a  

^a UNIVERSITÉ DE MONTRÉAL   (Canada)

^b KUWAIT UNIVERSITY   (Kuwait)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SOFTWARE SELECTION AND EVALUATION; DISTRIBUTED COMPUTER SYSTEMS; SEQUENTIAL MACHINES;

FINITE STATE MACHINES (FSM); SOFTWARE TESTING;

NETWORK PROTOCOLS;

EID: 0033295929     PISSN: 13891286     EISSN: None     Source Type: Journal    
DOI: 10.1016/S1389-1286(99)00063-8     Document Type: Article

References (100)

1. A. Aho et al., An optimization technique for protocol conformance test generation based on uio sequences and rural chinese postman tours, in: S. Aggarwal, K.K. Sabnani (Eds.), Protocol Specification, Testing and Verification VIII, North-Holland, Amsterdam, 1988.
2. B. Algayres, Y. Lejeune, F. Hugonnet, GOAL: observing SDL behaviors with object code, in: Proc. 7th SDL Forum, Oslo, Norway, September 1995.
3. R. Alur, C. Courcoubetis, N. Halbwachs, D. Dill, H. Wong-Toi, Minimization of timed transition systems, in: Third International Conference on Concurrency Theory, 1992, pp. 340-354.
4. R. Alur, D. Dill, Automata for modeling real-time systems, in: 17th ICALP (International Colloquium on Automata, Languages, and Programming), 1990, pp. 322-335.
5. R. Alur, D. Dill, A theory of timed automata, Theoretical Computer Science 126 (1994) 183-235.
6. B. Beizer, Software Testing Techniques, Van Nostrand Reinhold Electrical/Computer Science and Engineering Series, 1983.
7. G. Bernot, M.C. Gaudel, B. Marre, Software testing based on formal specifications: a theory and a tool, Software Engineering Journal (1991) 387-405.
8. G. v. Bochmann, Protocol specification for OSL, Computer Networks and ISDN Systems 18 (1989) 167-184.
9. G. v. Bochmann et al., Fault model in testing, in: R.J. Heijink, J. Kroon, E. Brinksma (Eds.), IFIP Transactions, Protocol Test Systems, IV (Proc. IFIP TC6 4th International Workshop on Protocol Test Systems, 1991) North-Holland, Amsterdam, 1992, pp. 17-30.
10. G. v. Bochmann, A. Das, R. Dssouli, M. Dubuc, A. Ghedamsi, G. Luo, Fault model in testing, in: Proc. International Workshop on Protocol Test System (IWPTS'91), Leidschendam, the Netherlands, 1991.
11. G. v. Bochmann, R. Dssouli, J.R. Zhao, Trace analysis for conformance and arbitration testing, IEEE Transactions on Software Engineering SE-15 (1989) 1347-1356.
12. G. v. Bochmann, A. Petrenko, O. Bellal, S. Maguiraga, Automating the process of test derivation from SDL specifications, in: Proc. Eighth SDL Forum, Evry, France, September 1997.
13. C. Bourhfir, R. Dssouli, El M. Aboulhamid, N. Rico, A guided incremental test case generation procedure for conformance testing CEFSM specified protocols, in: A. Petrenko, N. Yevtushenko (Eds.), IFIP International Workshop on Testing Communicating Systems 98, Chapman and Hall, London, 1998.
14. E. Brinksma, A theory of the derivation of tests, in: S. Aggarwal, K.K. Sabnani (Eds.), Protocol Specification, Testing and Verification VIII, North-Holland, Amsterdam, 1988, pp. 63-74.
15. L. Bromstrup, D. Hogrefe, TESDL: Experience with generating test cases from SDL specifications, in: Proc. 4th SDL Forum, 1989.
16. A. Cavalli, B.M. Chin, K. Chon, Testing methods for SDL systems, Computer Networks and ISDN Systems 28 (1996) 1669-1683.
17. A. Cavalli, J-P. Favreau, M. Falippou, Standardization of formal methods in conformance testing of communication protocols, Computer Networks and ISDN Systems 29 (1996) 3-14.
18. A. Cavalli, B. Lee, T. Macavei, Test generation for the SSCOP-ATM network protocol, in: Proc. SDL FORUM'97, Evry, France, Elsevier, 1997.
19. A.R. Cavalli, R. Anido, Verification and testing techniques based on finite state machine model, Research Report 97-09-02 INT, France, 1997.
20. CCITT, Specification and Description Language (SDL), Recommendation Z.100, International Standard Z.100, CCITT, Genève, 1993.
21. S.T. Chanson, J. Zhu, A unified approach to protocol test sequence generation, in: IEEE INFOCOM, San Francisco, CA, 1993.
22. S.T. Chanson, J. Zhu, Automatic protocol test suite derivation, in: IEEE, 1994.
23. O. Charles, Application des hypothès de test à une définition de la couverture, PhD thesis, Université Henri Poincaré-Nancy 1, 1997.
24. T.S. Chow, Testing software design modeled by finite-state machines, IEEE Transactions on Software Engineering SE-4 (1978) 178-187.
25. W. Chun, P.D. Amer, Test case generation for protocols specified in ESTELLE, in: FORTE'90, Madrid, Spain, 1990.
26. D. Clarke, I. Lee, Automatic generation of tests for timing constraints from requirements, in: Proc. Third International Workshop on Object-Oriented Real-Time Dependable Systems, Newport Beach, CA, February 1997.
27. L.A. Clarke, D.J. Richardson, Applications of symbolic evaluation, Journal of Systems and Software 5 (1985) 15-35.
28. M. Clatin, R. Groz, M. Phalippou, R. Thummel, Two approaches linking a test generation tool with verification techniques, in: Proc. International Workshop on Protocol Test System IFIP, North-Holland, Amsterdam, September 1995.
29. B. Dasarathy, Timing constraints of real-time systems: constructs for expressing them, IEEE Transactions on Software Engineering 11 (1985) 80-86.
30. J. De Kleer, B.C. Williams, Diagnosing multiple faults, Artificial Intelligence 32 (1984) 97-130.
31. R. Dechter, J. Pearl, Tree clustering for constraint networks, Artificial Intelligence 38 (1989) 353-366.
32. R.A. DeMillo, J. Offutt, Constraint-based automatic test data generation, IEEE Transactions on Software Engineering SE-17 (1991).
33. D. Dill, Timing assumptions and verification of finite-state concurrent systems, in: 1st CAV (Conference on Computer-Aided Verification) 1989, pp. 197-212.
34. R. Dssouli, Etude des méthodes de test pour les implantations de protocoles de communication basées sur les spécifications formelles, PhD thesis, Université de Montréal, 1986.
35. R. Dssouli, Les facteurs influancant l'observation de fautes dans les logiciels de communication. in: O. Rafiq (Ed.), Actes du Colloque Francophone pour l'Ingénierie des Protocoles CFIP'91 (Pau, France), Paris, September 1991.
36. A. En-Nouaary, R. Dssouli, A. Elqortobi, Génération de tests temporisés, in: Proc. 6th Colloque Francophone de l'Ingénierie des Protocoles, 1997.
37. A. En-Nouaary, R. Dssouli, F. Khendek, A. Elqortobi, Timed test cases generation based on state characterisation technique, in: 19th IEEE Real-Time Systems Symposium (RTSS'98), Madrid, Spain, December 1998.
38. A. En-Nouaary, H. Fouchal, A. Elqortobi, R. Dssouli, E. Petitjean, Timed testing using clock zone vertices, Technical Report, 1998.
39. R.E. Fikes, A system for solving problems stated as procedures, Artificial Intelligence 1 (1970) 27-120.
40. S. Fujiwara, G. v. Bochmann, F. Khendek, M. Amalou, A. Ghedamsi, Test selection based on finite state models, IEEE Transactions on Communications 17 (1991) 591-603.
41. M.C. Gaudel, Testing can be formal, too, TAPSOFT, 1995.
42. M.C. Gaudel, Test selection based on ADT specifications, in: Proc. 5th International Workshop on Protocol Test Systems (IWPTS'92), Montreal, Canada, 1998.
43. A. Ghedamsi, G. v. Bochmann, R. Dssouli, Diagnosing distributed systems modeled by CFSMs, Journal Réseaux et Informatique Répartie, France, 1993.
44. A. Gill, Introduction to the Theory of Finite State Machines, McGraw-Hill, New York, 1962.
45. G. Gonenc, A method for the design of fault detection experiments, IEEE Transactions on Computers C-19 (1970) 551-558.
46. J. Grabowski, D. Hogrefe, R. Nahm, A method for the generation of test cases based on SDL and MSC, Technical Report Institut für Informatik, Universität Bern, April 1993.
47. R. Groz, M. Phalippou, La génération automatique de tests est-elle possible, in: C. Jard, P. Rolin (Eds.), Colloque Francophone sur l'Ingenierie des Protocols CFIP'95, 1995.
48. T. Higashino, G. v. Bochmann, X. Li, K. Yasumoto, K. Taniguchi, Test system for a restricted class of LOTOS expressions with data parameters, in: Proc. Fifth IFIP International Workshop On Protocol Test Systems (IWPTS'92), North-Holland, Amsterdam, 1992, pp. 205-216.
49. D. Hogrefe, MUTEST: OSI Formal Specification Case Study: The INRES Protocol and Service, Internal Report, 1992.
50. W.E. Howden, Reliability of the path analysis testing strategy, IEEE Transactions on Software Engineering SE-2 (3) (1976).
51. W.E. Howden, An evaluation of the effectiveness of symbolic testing, Software Practice and Experience 8 (1978) 381-397.
52. E. Htite, R. Dssouli, G. v. Bochmann, Sélection des tests à partir de spécifications orientées objets, in: Proc. Third Maghrebian Conf. on Software Eng. and Art. Intelligence, Rabat, Maroc, April 1994.
53. S. Htite, R. Dssouli, A. Ghedamsi, Diagnostique automatic avec l'outil MFDT, in: Proc. 6th bi-Annual Colloque Francophone de l'ingénierie des Protocoles, Lièges, Belgique, 1997.
54. C.M. Huang, Y.C. Lin, M.Y. Jang, Executable data flow and control flow protocol test sequence generation for EFSM-specified protocol, in: International Workshop on Protocol Test Systems (IWPTS), Evry, France, 1995.
55. ISO, Information Processing Systems - Open Systems Interconnection - LOTOS - A Formal Description Technique Based on the Temporal Ordering of Observational Behaviour, ISO/TC97/SC21/N DIS8807, 1987.
56. ISO9646, International Standard 9646, International Organization for Standardization - Information Technology - Open Systems Interconnection, Genève 1991.
57. J. Jaffar, J.L. Lassez, Constraint logic programming system, in: Proc. 14th ACM POPL Conference, Munich, Germany, 1987.
58. J.C. King, T.J. Watson, Symbolic execution and program testing, Communications of the ACM 19 (7) (1976).
59. Z. Kohavi, Switching and Finite Automata Theory, McGraw-Hill Computer Science Series, New York, 1978.
60. K.G. Larsen, W. Yi, Time abstracted bisimulation: implicit specifications and decidability, in: Proc. Mathematical Foundations of Programming Semantics (MFPS 9), Lecture Notes in Computer Science, vol. 802, Springer, Berlin, 1993.
61. G. Leduc, On the role of implementation relations in the design of distributed system, PhD thesis, Publications de la Faculté des Sciences Appliquées de l'Université de Liège, vol. 130, Liège 1991.
62. D.Y. Lee, J.Y. Lee, A well-defined ESTELLE specification for automatic test generation, IEEE Transactions on Communications 40 (1991) 526-542.
63. L.P. Lima, A. Cavalli, A pragmatic approach to generating test sequences for embedded systems, in: Proc. IWTCS'97, Cheju Islands, Korea, 1997.
64. F. Liu, Test generation based on an FSM model with timers and counters, Master thesis, Département d'Informatique et de Recherche Opérationnelle, Université de Montréal, 1993.
65. G. Luo, G. v. Bochmann, A. Petrenko, Test selection based on communicating nondeterministic finite state machines using a generalised WP-method, IEEE Transactions on Software Engineering SE-20 (2) (1994).
66. G. Luo, R. Dssouli, G. v. Bochmann, P. Vankataram, A. Ghedamsi, Test generation with respect to distributed interfaces, Computer Standards and Interfaces 16 (1994) 119-132.
67. G. Luo, A. Petrenko, G. v. Bochmann, Selecting test sequences for communicating partially-specified nondeterministic finite state machines, Technical report TR-864 IRO, Université de Montréal, 1993.
68. A.K. Mackworth, Consistency of network relations, Artificial Intelligence 8 (1977) 99-118.
69. D. Mandrioli, S. Morasca, A. Morzenti, Generating test cases for real-time systems from logic specifications, ACM Transactions on Computer Systems 13 (1995) 365-398.
70. R.E. Miller, S. Paul, Generating conformance test sequences for combined control and data flow of communication protocols, in: Proc. Protocol Specification, Testing, and Verification (PSTV'92), Florida, USA, 1992.
71. R. Milner, A Calculus of Communicating Systems, Lecture Notes in Computer Science, vol. 92, Springer, Berlin, 1980.
72. R. Milner, Communication and Concurrency, Prentice-Hall International, Englewood Cliffs, NJ, 1989.
73. U. Montanari, Networks of constraints: fundamental properties and applications to picture processing, Information Science 7 (1974) 95-132.
74. L.J. Morell, A theory of fault-based testing, IEEE Transactions on Software Engineering SE-16 (8) (1990).
75. S. Naito, M. Tsunoyama, Fault detection for sequential machines by transition tours, in: Proc. Fault Tolerant Computer Systems, 1981, pp. 238-243.
76. A. Petrenko, Checking experiments with protocol machines, in: J. Kroon, R. Heijink, E. Brinksma (Eds.), IFIP International Workshop on Protocol Test Systems IV, North-Holland, Amsterdam, 1991.
77. A. Petrenko, N. Yevtushenko, G. v. Bochmann, R. Dssouli, Testing in context: A framework and test derivation, Special Issue on Protocol Engineering of Computer Communication, 1997.
78. M. Phalippou, Relation d'implantation et hypothèses de test sur des automates à entrées et sorties, PhD thesis, Université de Bordeaux I, 1994.
79. D. Pountain, Constraint logic programming, Byte Magazine, February 1995.
80. T. Ramalingom, A. Das, K. Thulasiraman, A unified test case generation method for the EFSM model using context independent unique sequences, in: Proc. International Workshop on Protocol Test System (IWPTS'95), Evry, France, 1995.
81. C.V. Ramamoorthy, S.B.F. Ho, W.T. Chan, On the automated generation of program test data, IEEE Transactions on Software Engineering SE-2 (4) (1976).
82. D. Rayner, OSI conformance testing, Computer Networks and ISDN Systems 14 (1987) 79-98.
83. K. Sabnani, A.T. Dahbura, A protocol testing procedure, Computer Networks and ISDN Systems 15 (1988) 285-297.
84. B. Sarikaya, G. v. Bochmann, Synchronization and specification issues in protocol testing, IEEE Transaction on Communications 32 (1984) 389-395.
85. B. Sarikaya, G. v. Bochmann, E. Cerny, A test methodology for protocol testing, IEEE Transactions on Software Engineering SE-13 (1987) 518-531.
86. Y.N. Shen et al., Protocol conformance testing using multiple UIO sequences, in: Protocol Specification, Testing and Verification IX, Twente, Netherlands, 1989.
87. D.P. Sidhu, T.K. Leung, Formal methods for protocol testing: a detailed study, IEEE Transactions on Software Engineering SE-15 (4) (1989).
88. J. Springintveld, F. Vaandrager, P.R. d'Argenio, Testing timed automata, invited talk at TAPSOFT'97, 1997, http://www.cs.kun.nl/fvaan/publications.html.
89. B. Taylor, Introducing real-time constraints into requirements and high level design of operating systems, in: Proc. 1980 Nat. Telecommunications Conference, Houston, TX, 1980, vol. 1, pp. 18.5.1-18.5.5.
90. Telelogic, ITEX User Manual, 1995.
91. Telelogic, SDT User Manual, 1995.
92. J. Tretmans, A formal approach to conformance testing, in: Proc. 6th International Workshop on Protocol Test Systems (IWPTS'93), Pau, France, 1993.
93. J. Tretmans, Testing labelled transition systems with inputs and outputs, Technical report 95-26, University of Twente, August 1995.
94. H. Ural, B. Yang, A test sequence selection method for protocol testing, IEEE Transactions on Communication 39 (4) (1991).
95. S.T. Vuong, W.W.L. Chan, M.R. Ito, The UIOV method for protocol test sequence generation, in: Proc. 2nd International Workshop on Protocol Test Systems, Berlin, Germany, 1989.
96. E.J. Weyuker, S. Rapps, Selecting software test data using data flow information, IEEE Transactions on Software Engineering SE-11 (4) (1985).
97. J.P. Wu, S.T. Chanson, Test sequence derivation based on external behavior expression, in: Proc. 2nd International Workshop on Protocol Test Systems, 1989.
98. B. Yang, H. Ural, Protocol conformance test generation ising multiple UIO sequences with overlapping, Computer Communication Review 4 (1997) 118-125.
99. M. Yao, On the development of conformance test suites in view of their fault coverage, PhD thesis, Université de Montréal, Département IRO, 1995.
100. L.D. Zhang et al., A further optimization technique for conformance testing based on multiple UIO sequences, in: G. v. Bochmann, R. Dssouli, A. Das (Eds.), Protocol Test Systems V (Montreal 1992), North-Holland, Amsterdam, 1993.