A framework for the competitive evaluation of model inference techniques

MIIT 2010 - Proceedings of the 1st International Workshop on Model Inference In Testing, Held in Conjunction with ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2010

Volumn , Issue , 2010, Pages 1-9

  Walkinshaw, Neil ^a   Bogdanov, Kirill ^a   Damas, Christophe ^b   Lambeau, Bernard ^b   Dupont, Pierre ^b  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

^b UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

EVALUATION AND IMPROVEMENT; LARGE ALPHABETS; MODEL INFERENCE; REGULAR GRAMMAR; RELATIVE ACCURACY; SOFTWARE MODEL; SOFTWARE SYSTEMS; TARGET MODEL; TRAINING AND TESTING;

COMPETITION; SOFTWARE TESTING;

COMPUTER SOFTWARE SELECTION AND EVALUATION;

EID: 78649767690     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1868044.1868045     Document Type: Conference Paper

References (28)

1. G. Ammons, R. Bodík, and J. Larus. Mining Specifications. In 29th SIGPLAN-SIGACT Symposium on Principles of Programming Languages (POPL), pages 4-16, Portland, Oregon, 2002.
2. D. Angluin. Learning Regular Sets from Queries and Counterexamples. Information and Computation, 75:87-106, 1987.
3. A. Biermann and J. Feldman. On the Synthesis of Finite-State Machines from Samples of their Behavior. IEEE Transactions on Computers, 21:592-597, 1972.
4. A. W. Biermann and R. Krishnaswamy. Constructing programs from example computations. IEEE Trans. on Software Engineering, SE-2:141-153, 1976.
5. K. Bogdanov and N. Walkinshaw. Computing the Structural Difference between State-Based Models. In 16th IEEE Working Conference on Reverse Engineering (WCRE), 2009.
6. D. Combe, C. de la Higuera, and J. Janodet. Zulu: An interactive learning competition, 2009.
7. J. Cook and A. Wolf. Discovering Models of Software Processes from Event-Based Data. ACM Transactions on Software Engineering and Methodology, 7(3):215-249, 1998.
8. C. Damas, B. Lambeau, P. Dupont, and A. van Lamsweerde. Generating Annotated Behavior Models from End-User Scenarios. IEEE Transactions on Software Engineering, 31(12):1056-1073, 2005.
9. P. Dupont, B. Lambeau, C. Damas, and A. van Lamsweerde. The QSM Algorithm and its Application to Software Behavior Model Induction. Applied Artificial Intelligence, 22:77-115, 2008.
10. P. Dupont, L. Miclet, and E. Vidal. What is the search space of the regular inference? In Proceedings of the International Colloqium on Grammatical Inference and Applications (ICGI'94), volume 862 of LNAI, pages 25-37. Springer Verlag, 1994.
11. J. Hopcroft, R. Motwani, and J. Ullman. Introduction to Automata Theory, Languages, and Computation, Third Edition. Addison-Wesley, 2007.
12. J. Kleinberg. Authoritative sources in a hyperlinked environment. JACM: Journal of the ACM, 46, 1999.
13. K. Lang, B. Pearlmutter, and R. Price. Results of the Abbadingo One DFA Learning Competition and a New Evidence-Driven State Merging Algorithm. In Proceedings of the International Colloquium on Grammar Inference (ICGI), volume 1433, pages 1-12, 1998.
14. J. Leskovec, J. Kleinberg, and C. Faloutsos. Graph evolution: Densi-cation and shrinking diameters. 1(1), 2007.
15. D. Lo and S. Khoo. SMArTIC: towards building an accurate, robust and scalable speci-cation miner. In SIGSOFT FSE, pages 265-275, 2006.
16. D. Lorenzoli, L. Mariani, and M. Pezzè. Automatic generation of software behavioral models. In ICSE '08: Proceedings of the 30th international conference on Software engineering, pages 501-510, New York, NY, USA, 2008. ACM.
17. S. Lucas. Gecco 2004 noisy dfa results, 2005. http://cswww.essex.ac.uk/ sta-/sml/gecco/results/NoisyDFA/NoidyDFAResults.html.
18. J. Oncina and P. Garcia. Inferring Regular Languages in Polynomial Update Time. In Pattern Recognition and Image Analysis, volume 1, pages 49-61. 1992.
19. S. Reiss and M. Renieris. Encoding program executions. In ICSE, pages 221-230. IEEE Computer Society, 2001.
20. M. Sokolova and G. Lapalme. A systematic analysis of performance measures for classification tasks. Inf. Process. Manage, 45(4):427-437, 2009.
21. B. Starkie, F. Coste, and M. van Zaanen. The omphalos context-free grammar learning competition. In G. Paliouras and Y. Sakakibara, editors, Grammatical Inference: Algorithms and Applications; 7th International Colloquium, ICGI 2004, volume 3264 of LNCS/LNAI, pages 16-27. Springer, 2004.
22. B. Starkie, F. Coste, and M. van Zaanen. Progressing the state-of-the-art in grammatical inference by competition: The omphalos context-free language learning competition. AI Communications, 18(2):93-115, 2005.
23. B. Starkie, M. van Zaanen, and D. Estival. The tenjinno machine translation competition. In Grammatical Inference: Algorithms and Applications, 8th International Colloquium, ICGI 2006, Tokyo, Japan, September 20-22, 2006, Proceedings, volume 4201 of Lecture Notes in Artificial Intelligence, pages 214-226, Berlin, 2006. Springer.
24. G. Sutcliffee and C. Suttner. The State of CASC. AI Communications, 19(1):35-48, 2006.
25. T. Trapane and E. Lattman, editors. Proteins: Structure, Function, and Bioinformatics, volume 69. Wiley, 2007. CASP7 Proceedings.
26. M. van Zaanen and J. Geertzen. Problems with evaluation of unsupervised empirical grammatical inference systems. In International Colloquium on Grammatical Inference: Algorithms and Applications, (ICGI), volume 5278 of Lecture Notes in Computer Science, pages 301-303. Springer, 2008.
27. N. Walkinshaw, K. Bogdanov, M. Holcombe, and S. Salahuddin. Reverse Engineering State Machines by Interactive Grammar Inference. In 14th IEEE International Working Conference on Reverse Engineering (WCRE), 2007.
28. N. Walkinshaw, K. Bogdanov, and K. Johnson. Evaluation and Comparison of Inferred Regular Grammars. In Proceedings of the International Colloquium on Grammar Inference (ICGI), St. Malo, France, 2008.