Creating and visualizing test data from programming exercises

Informatics in Education

Volumn 6, Issue 1, 2007, Pages 81-102

  Ihantola, Petri ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

Automatic assessment; Computer science education; Programming exercises; Software visualization; Test data; Testing

Indexed keywords

EID: 34249104497     PISSN: 16485831     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (28)

1. Ahmadzadeh, M., D. Elliman and C. Higgins (2005). An analysis of patterns of debugging among novice computer science students. In ITiCSE '05: Proceedings of the 10th Annual SIGCSE Conference on Innovation and Technology in Computer Science Education. New York, NY, USA, ACM Press, pp. 84-88.
2. Ala-Mutka, K., T. Uimonen and H.-M. Järvinen (2004). Supporting students in C++ programming courses with automatic program style assessment. Journal of Information Technology Education, 3, 245-262.
3. Artho, C., D. Drusinksy, A. Goldberg, K. Havelund, M. Lowry, C. Pǎsǎreanu, G. Rosu and W. Visser (2003). Experiments with test case generation and runtime analysis. In Proceedings of Abstract State Machines 2003. Advances in Theory and Practice: 10th International Workshop. Vol. 2589 of LNCS. Springer-Verlag, pp. 87-108.
4. Barnett, M., W. Grieskamp, W. Schulte, N. Tillmann and M. Veanes (2003). Validating use-cases with the AsmL test tool. In Proceedings of 3rd International Conference on Quality Software. IEEE Computer Society, pp. 238-246.
5. Benford, S., E. Burke, E. Foxley, N. Gutteridge and A. M. Zin (1993). Ceilidh: A course administration and marking system. In Proceedings of the 1st International Conference of Computer Based Learning. Vienna, Austria.
6. Brat, G., W. Visser, K. Havelund and S. Park (2000). Java PathFinder - second generation of a Java model checker. In Proceedings of the Workshop on Advances in Verification. Chicago, Illinois.
7. Bridgeman, S., M. T. Goodrich, S. G. Kobourov and R. Tamassia. Pilot: an interactive tool for learning and grading. In SIGCSE '00: Proceedings of the Thirty-first SIGCSE Technical Symposium on Computer Science Education. New York, NY, USA, ACM Press, pp. 139-143.
8. Clarke, L.A. (1976). A system to generate test data and symbolically execute programs. IEEE Trans. Software Eng., 2(3), 215-222.
9. Coward, D. (1991). Symbolic execution and testing. Inf. Softw. Technol., 33(1), 53-64.
10. Edvardsson, J. (1999). A survey on automatic test data generation. In Proceedings of the 2nd Conference on Computer Science and Engineering in Linköping. ECSEL, pp. 21-28.
11. English, J. (2004). Automated assessment of gui programs using JEWL. In Proceedings of the 9th Annual SIGCSE Conference on Innovation and Technology in Computer Science Education. ACM Press, pp. 137-141.
12. Grindal, M., J. Offutt, and S.F. Andler (2005). Combination testing strategies: a survey. Software Testing, Verification and Reliability, bf 15(3), 167-199.
13. Ihantola, P. (2007). Test data generation for programming exercises with symbolic execution in java pathfinder. In Proceedings of the Koli Calling, Sixth Finnish/Baltic Sea Conference on Computer Science Education. Accepted for publication.
14. Jackson, D., and M. Usher (1997). Grading student programs using assyst. In SIGCSE '97: Proceedings of the Twenty-eighth SIGCSE Technical Symposium on Computer Science Education. New York, NY, USA, ACM Press, pp. 335-339.
15. Jessop, W.H., J.R. Kane, S. Roy and J.M. Scanlon (1976). ATLAS - an automated software testing system. ICSE, 629-635.
16. Khurshid, S., and D. Marinov (2004). TestEra: Specification-based testing of Java programs using SAT. Autom. Softw. Eng., 11(4), 403-434.
17. Khursid, S., C.S. Pǎsǎreanu and W. Visser (2003). Generalized symbolic execution for model checking and testing. In Proceedings 9th International Conference on Tools and Algorithms for Construction and Analysis. Vol. 2619 of LNCS. Springer-Verlag, pp. 553-568.
18. King, J.C. (1976). Symbolic execution and program testing. Commun. ACM, 19(7), 385-394.
19. Korhonen, A., L. Malmi and P. Silvasti (2003). TRAKLA2: a framework for automatically assessed visual algorithm simulation exercises. In Proceedings of the 3rd Annual Finnish/Baltic Sea Conference on Computer Science Education. Joensuu, Finland, pp. 48-56.
20. Mitrovic, A., and S. Ohlsson (1999). Evaluation of a constraint-based tutor for a database language. International Journal of Artificial Intelligence in Education, 10, 238-256.
21. Pǎsǎreanu, C.S., and W. Visser. Verification of Java programs using symbolic execution and invariant generation. In Proceedings of 11th International SPIN Workshop. Vol. 2989 of LNCS. Springer-Verlag, pp. 164-181.
22. Ramamoorthy, C.V., S.-B.F. Ho and W.T. Chen (1976). On the automated generation of program test data. IEEE Trans. Software Eng., 2(4), 293-300.
23. Saikkonen, R., L. Malmi and A. Korhonen. Fully automatic assessment of programming exercises. In Proceedings of the 6th Annual Conference on Innovation and Technology in Computer Science Education. Canterbury, UK, ACM Press, New York, pp. 133-136.
24. Salmela, L., and J. Tarhio (2004). ACE: Automated compiler exercises. In Proceedings of the 4th Finnish/Baltic Sea Conference on Computer Science Education. Joensuu, Finland, pp. 131-135.
25. Truong, N., P. Roe and P. Bancroft (2004). Static analysis of students' Java programs. In Proceedings of the Sixth Conference on Australian Computing Education. Australian Computer Society, Inc., pp. 317-325.
26. Visser, W., K. Havelund, G. Brat, S. Park and F. Lerda. Model checking programs. Autom. Softw. Eng, 10(2), 203-232.
27. Visser, W., C.S. Pǎsǎreanu and S. Khurshid (2004). Test input generation with Java PathFinder. In Proceedings of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis. ACM Press, pp. 97-107.
28. Xie, T., D. Marinov, W. Schulte and D. Notkin (2005). Symstra: A framework for generating object-oriented unit tests using symbolic execution. In Proceedings of the 11th International Conference on Tools and Algorithms for the Construction and Analysis of Systems, pp. 365-381.