Research in concurrent software testing: A systematic review

Workshop on Parallel and Distributed Systems: Testing, Analysis, and Debugging, PADTAD 2011 - Proceedings

Volumn , Issue , 2011, Pages 1-5

  Souza, Simone R S ^a   Brito, Maria A S ^a   Silva, Rodolfo A ^a   Souza, Paulo S L ^a   Zaluska, Ed ^b  

^a UNIVERSITY OF SÃO PAULO   (Brazil)

^b UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

Bug classification; Concurrent program testing; Testing tools

Indexed keywords

BUG CLASSIFICATION; CONCURRENT PROGRAM; CONCURRENT PROGRAM TESTING; CONCURRENT PROGRAMMING; CONCURRENT SOFTWARE; CONCURRENT TESTING; DISTRIBUTED APPLICATIONS; RESEARCH TEAMS; SYSTEMATIC REVIEW; TESTING METHODOLOGY; TESTING TOOLS;

CLOUD COMPUTING; COMPUTER SOFTWARE SELECTION AND EVALUATION; COMPUTER SYSTEMS; PROGRAM DEBUGGING; RESEARCH; USER INTERFACES; WEB SERVICES;

SOFTWARE TESTING;

EID: 80052156731     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2002962.2002964     Document Type: Conference Paper

References (59)

1. A. Bechini, J. Cutajar, and C. Prete. A tool for testing of parallel and distributed programs in message-passing environments. In Electrotechnical Conference, 1998. MELECON 98., 9th Mediterranean, volume 2, pages 1308 -1312 vol.2, may 1998.
2. M. A. S. Brito, K. Felizardo, P. S. L. Souza, and S. R. S. Souza. Concurrent software testing: A systematic review. Technical Report 359, ICMC/USP, 2010.
3. J. Cao, A. T. S. Chan, S. C. F. Chan, and N. K. C. Cheung. A robust monitor construct with runtime fault detection. Concurrency Computation Practice and Experience, 18(5):471-500, 2006.
4. J. Cao, N. Cheung, and A. Chan. Run-time fault detection in monitor based concurrent programming. In Dependable Systems and Networks, 2001. DSN 2001. International Conference on, pages 357 -366, july 2001.
5. R. Carver and J. Lei. A stateful approach to testing monitors in multithreaded programs. In High-Assurance Systems Engineering (HASE), 2010 IEEE 12th International Symposium on, pages 54 -63, nov. 2010.
6. R. Carver and K. C. Tai. Deterministic execution testing of concurrent ada programs. In Proceedings of the conference on Tri-Ada'89: Ada technology in context: application, development, and deployment, TRI-Ada'89, pages 528-544, New York, NY, USA, 1989. ACM.
7. R. Carver and K.-C. Tai. Replay and testing for concurrent programs. Software, IEEE, 8(2):66 -74, mar 1991. (Pubitemid 21647571)
8. R. H. Carver and Y. Lei. A general model for reachability testing of concurrent programs. Lecture Notes in Computer Science, 3308:76-98, 2004. (Pubitemid 39750926)
9. J. Chen and S. MacDonald. Towards a better collaboration of static and dynamic analyses for testing concurrent programs. In Proceedings of the 6th Workshop on Parallel and Distributed Systems: Testing, Analysis, and Debugging 2008, PADTAD'08, 2008.
10. M. Christakis and K. Sagonas. Detection of asynchronous message passing errors using static analysis. Lecture Notes in Computer Science, 6539 LNCS:5-18, 2011.
11. S. Copty and S. Ur. Multi-threaded testing with AOP is easy, and it finds bugs! In Lecture Notes in Computer Science, volume 3648, pages 740-749, 2005. (Pubitemid 41490874)
12. J. Devietti, B. Lucia, L. Ceze, and M. Oskin. DMP: deterministic shared memory multiprocessing. In Proceeding of the 14th international conference on Architectural support for programming languages and operating systems, ASPLOS'09, pages 85-96, New York, NY, USA, 2009. ACM.
13. O. Edelstein, E. Farchi, E. Goldin, Y. Nir, G. Ratsaby, and S. Ur. Framework for testing multi-threaded java programs. Concurrency Computation Practice and Experience, 15(3-5 SPEC.):485-499, 2003.
14. E. Farchi, Y. Nir, and S. Ur. Concurrent bug patterns and how to test them. In Parallel and Distributed Processing Symposium, 2003. Proceedings. International, page 7 pp., april 2003.
15. M. Gligoric, V. Jagannath, and D. Marinov. Mutmut: Efficient exploration for mutation testing of multithreaded code. In Software Testing, Verification and Validation (ICST), 2010 Third International Conference on, pages 55 -64, april 2010.
16. X. Gong, Y. Wang, Y. Zhou, and B. Li. on testing multi-threaded java programs. In SoftwareEngineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing, 2007. SNPD 2007. Eighth ACIS International Conference on, volume 1, pages 702 -706, aug 2007. (Pubitemid 47533115)
17. S. Gradara, A. Santone, M. L. Villani, and G. Vaglini. Model checking multithreaded programs by means of reduced models. Electronic Notes in Theoretical Computer Science, 110:55-74, 2004. (Pubitemid 41081880)
18. H.-F. Ho, G.-H. Chen, and T.-S. Kuo. Branch testing of concurrent programs using petri net models. Computer Systems Science and Engineering, 5(2):116-125, 1990.
19. G.-H. Hwang, K.-C. Tai, and T.-L. Huang. Reachability testing: An approach to testing concurrent software. International Journal of Software Engineering and Knowledge Engineering, 5:493-510, 1995.
20. V. Jagannath, M. Gligoric, S. Lauterburg, D. Marinov, and G. Agha. Mutation operators for actor systems. In ICSTW 2010 - 3rd International Conference on Software Testing, Verification, and Validation Workshops, pages 157-162, 2010.
21. B. Kitchenham and S. Charters. Guidelines for performing systematic literature reviews in software engineering. Technical Report EBSE 2007-001, Keele University and Durham University, 2007.
22. H. Kojima, Y. Kakuda, J. Takahashi, and T. Ohta. A model for concurrent states and its coverage criteria. In International Symposium on Autonomous Decentralized Systems, ISADS, pages 1 -6, march 2009.
23. P. V. Koppol, R. H. Carver, and K.-C. Tai. Incremental integration testing of concurrent programs. IEEE Transactions on Software Engineering, 28(6):607-623, 2002. (Pubitemid 34835480)
24. P. V. Koppol and K.-C. Tai. An incremental approach to structural testing of concurrent software. In Proceedings of the 1996 ACM SIGSOFT international symposium on Software testing and analysis, ISSTA '96, pages 14-23, New York, NY, USA, 1996. ACM.
25. H. Krawczyk and B. Wiszniewski. A method for determining testing scenarios for parallel and distributed software, 1996.
26. B. Krena, Z. Letko, R. Tzoref, S. Ur, and T. Vojnar. Healing data races on-the-fly. In Proceedings of the 2007 ACM Workshop on Parallel and Distributed Systems: Testing and Debugging, PADTAD'07, pages 54-64, 2007. (Pubitemid 47325131)
27. B. Krena, Z. Letko, T. Vojnar, and S. Ur. A platform for search-based testing of concurrent software. In PADTAD 2010 - International Workshop on Parallel and Distributed Systems: Testing, Analysis, and Debugging, pages 48-58, 2010.
28. Y. Lei and R. Carver. Reachability testing of semaphore-based programs. In Computer Software and Applications Conference, 2004. COMPSAC 2004. Proceedings of the 28th Annual International, pages 312 -317 vol.1, sept. 2004. (Pubitemid 40673870)
29. Y. Lei and R. H. Carver. Reachability testing of concurrent programs. IEEE Transactions on Software Engineering, 32(6):382-403, 2006. (Pubitemid 44194206)
30. Y. Lei, R. H. Carver, R. Kacker, and D. Kung. A combinatorial testing strategy for concurrent programs. Software Testing Verification and Reliability, 17(4):207-225, 2007. (Pubitemid 350268689)
31. J. Li, D. Hei, and L. Yan. Correctness analysis based on testing and checking for openmp programs. In ChinaGrid Annual Conference, 2009. ChinaGrid '09. Fourth, pages 210 -215, aug. 2009.
32. S. Q. Li, H. Y. Chen, and Y. X. Sun. A framework of reachability testing for java multithread programs. In Systems, Man and Cybernetics, 2004 IEEE International Conference on, volume 3, pages 2730 - 2734 vol.3, oct. 2004. (Pubitemid 40408578)
33. J. Loureņco and G. Cunha. Testing patterns for software transactional memory engines. In Proceedings of the 2007 ACM workshop on Parallel and distributed systems: testing and debugging, PADTAD '07, pages 36-42, New York, NY, USA, 2007. ACM. (Pubitemid 47325129)
34. S. Lu, S. Park, E. Seo, and Y. Zhou. Learning from mistakes: A comprehensive study on real world concurrency bug characteristics. SIGOPS Oper. Syst. Rev., 42:329-339, March 2008. (Pubitemid 351585418)
35. M. Musuvathi and S. Qadeer. Iterative context bounding for systematic testing of multithreaded programs. SIGPLAN Not., 42:446-455, June 2007. (Pubitemid 47630711)
36. M. Musuvathi and S. Qadeer. Fair stateless model checking. In In PLDI 08: Programming Language Design and Implementation, 2008.
37. M. Musuvathi, S. Qadeer, and T. Ball. CHESS: A systematic testing tool for concurrent software. Technical report, MSR-TR-2007-149, Microsoft Research, 2007.
38. M. Musuvathi, S. Qadeer, T. Ball, G. Basler, P. A. Nainar, and I. Neamtiu. Finding and reproducing heisenbugs in concurrent programs. In Proceedings of the 8th USENIX conference on Operating systems design and implementation, OSDI'08, pages 267-280, Berkeley, CA, USA, 2008. USENIX Association.
39. M. Olszewski, J. Ansel, and S. Amarasinghe. Kendo: efficient deterministic multithreading in software. SIGPLAN Not., 44:97-108, March 2009.
40. M.-Y. Park, S. J. Shim, Y.-K. Jun, and H.-R. Park. MPIRace-check: Detection of message races in MPI programs. Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 4459 LNCS:322-333, 2007.
41. E. Pozniansky and A. Schuster. Efficient on-the-fly data race detection in multithreaded C++ programs. In Parallel and Distributed Processing Symposium, page 8 pp., april 2003.
42. F. Pu and H.-Y. Xu. A feasible strategy for reachability testing of internet-based concurrent programs. In Networking, Sensing and Control, 2008. ICNSC 2008. IEEE International Conference on, pages 1559 -1564, april 2008.
43. F. S. Sarmanho, P. S. L. Souza, S. R. S. Souza, and A. Sim̃ao. Structural testing for semaphore-based multithread programs. Lecture Notes in Computer Science, 5101 LNCS:337-346, 2008.
44. A. Sen and M. Abadir. Coverage metrics for verification of concurrent systemc designs using mutation testing. In IEEE International High Level Design Validation and Test Workshop (HLDVT), pages 75 -81, june 2010.
45. K. Sen and G. Agha. A race-detection and flipping algorithm for automated testing of multi-threaded programs. In Haifa Verification Conference, pages 166-182, 2006.
46. H.-S. Seo, I. S. Chung, B. M. Kim, and Y. R. Kwou. The design and implementation of automata-based testing environment for java multi-thread programs. In Software Engineering Conference, 2001. APSEC 2001. Eighth Asia-Pacific, pages 221 - 228, dec. 2001. (Pubitemid 34079208)
47. P. L. Souza, E. T. Sawabe, A. S. Sim̃ao, S. R. Vergilio, and S. R. S. Souza. ValiPVM - a graphical tool for structural testing of PVM programs. Lecture Notes in Computer Science, 5205 LNCS:257-264, 2008.
48. S. Souza, S. R. Vergilio, P. S. L. Souza, A. Sim̃ao, and A. C. Hausen. Structural testing criteria for message-passing parallel programs. Concurrency Computation Practice and Experience, 20(16):1893-1916, 2008.
49. J. Takahashi, H. Kojima, and Z. Furukawa. Coverage based testing for concurrent software. In 28th International Conference on Distributed Computing Systems, ICDCS '08, pages 533 -538, june 2008.
50. R. N. Taylor, D. L. Levine, and C. D. Kelly. Structural testing of concurrent programs. IEEE Transactions on Software Engineering, 18(3):206-215, 1992.
51. R. Vuduc, M. Schulz, D. Quinlan, B. D. Supinski, and A. Sæbjørnsen. Improving distributed memory applications testing by message perturbation. In In Proceedings of Parallel and Distributed Systems: Testing and Debugging (PADTAD), 2006.
52. W. E. Wong and Y. Lei. Reachability graph-based test sequence generation for concurrent programs. International Journal of Software Engineering and Knowledge Engineering, 18(6):803-822, 2008.
53. W. E. Wong, Y. Lei, and X. Ma. Effective generation of test sequences for structural testing of concurrent programs. In Proceedings of the IEEE International Conference on Engineering of Complex Computer Systems, ICECCS, pages 539-548, 2005. (Pubitemid 41495782)
54. Yang,, C. s. D. Yang, and L. L. Pollock. An algorithm for all-du-path testing coverage of shared memory parallel programs. In In Sixth Asian Test Symposium, pages 263-268, 1997.
55. C.-S. D. Yang. Program-Based, Structural Testing of Shared Memory Parallel Programs. PhD thesis, University of Delaware, 1999.
56. C.-S. D. Yang, A. L. Souter, and L. L. Pollock. All-du-path coverage for parallel programs. In Proceedings of the 1998 ACM SIGSOFT international symposium on Software testing and analysis, ISSTA '98, pages 153-162, New York, NY, USA, 1998. ACM.
57. R.-D. Yang and C.-G. Chung. A path analysis approach to concurrent program testing. In Computers and Communications, 1990. Conference Proceedings., Ninth Annual International Phoenix Conference on, pages 425-432, mar 1990.
58. R.-D. Yang and C.-G. Chung. Path analysis testing of concurrent programs. Information and Software Technology, 34(1):43-56, 1992.
59. Y. Yang, X. Chen, and G. Gopalakrishnan. Inspect: A runtime model checker for multithreaded C programs. Technical report, UUCS-08-004, School of Computing, University of Utah, 2008.