On effective testing of health care simulation software

Proceedings - International Conference on Software Engineering

Volumn , Issue , 2011, Pages 40-47

  Murphy, Christian ^a   Raunak, M S ^b   King, Andrew ^a   Chen, Sanjian ^a   Imbriano, Christopher ^a   Kaiser, Gail ^c   Lee, Insup ^a   Sokolsky, Oleg ^a   Clarke, Lori ^d   Osterweil, Leon ^d  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b LOYOLA UNIVERSITY MARYLAND   (United States)

^c Fu Foundation School of Engineering and Applied Science   (United States)

^d The Manning College of Information and Computer Sciences   (United States)

Author keywords

metamorphic testing; oracle problem; software testing

Indexed keywords

EFFECTIVE TESTING; HEALTH CARE PROFESSIONALS; HUMAN BODIES; METAMORPHIC TESTING; ORACLE PROBLEM; REAL-WORLD ACTIVITIES; RESOURCE UTILIZATIONS; SIMULATION SOFTWARE; TEST ORACLES;

ABILITY TESTING; COMPUTER SIMULATION; COMPUTER SOFTWARE SELECTION AND EVALUATION; DECISION MAKING; HEALTH CARE; MODELS; SOFTWARE ENGINEERING;

SOFTWARE TESTING;

EID: 79959420442     PISSN: 02705257     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1987993.1988003     Document Type: Conference Paper

References (34)

1. J. H. Andrews, L. C. Briand, and Y. Labiche. Is mutation an appropriate tool for testing experiments? In Proc. of the 27th International Conference on Software Engineering (ICSE), pages 402-411, 2005.
2. D. Arney, M. Pajic, J. M. Goldman, I. Lee, R. Mangharam, and O. Sokolsky. Toward patient safety in closed-loop medical device systems. In Proceedings of the 1st ACM/IEEE International Conference on Cyber-Physical Systems, ICCPS '10, pages 139-148, New York, NY, USA, 2010. ACM.
3. N. Arshad, A. Akhtar, S. Khan, and D. Sabih. Software engineering for simulation systems in medical training - some initial experiences. In Proc. of 2nd Wkshp on Software Engineering in Health Care, 2010.
4. O. Balci. Verification, validation and accreditation of simulation models. In Proc. of the 29th conference on winter simulation, pages 135-141, 1997.
5. J. Banks, B. L. Nelson, and D. M. Nicol. Discrete-Event System Simulation, 5th ed. Pearson/Prentice Hall, 2010.
6. A. G. Cass, B. S. Lerner, E. K. McCall, L. J. Osterweil, S. M. Sutton Jr., and A. Wise. Little-JIL/Juliette: A process definition language and interpreter. In Proc. of the 22nd International Conference on Software Engineering (ICSE), pages 754-757, 2000.
7. W. K. Chan, S. C. Cheung, and K. R. P. H. Leung. A metamorphic testing approach for online testing of service-oriented software applications. International Journal of Web Services Research, 4(1):60-80, April-June 2007.
8. L. Chen and A. Avizienis. N-version programming: A fault-tolerance approach to reliability of software operation. In Proc. of the 8th Symposium on Fault-Tolerance Computing, pages 3-9, 1978.
9. T. Y. Chen, S. C. Cheung, and S. Yiu. Metamorphic testing: a new approach for generating next test cases. Technical Report HKUST-CS98-01, Dept. of Computer Science, Hong Kong Univ. of Science and Technology, 1998.
10. T. Y. Chen, J. W. K. Ho, H. Liu, and X. Xie. An innovative approach for testing bioinformatics programs using metamorphic testing. BMC Bioinformatics, 10(24), 2009.
11. T. Y. Chen, T. H. Tse, and Z. Q. Zhou. Fault-based testing without the need of oracles. Information and Software Technology, 44(15):923-931, 2002.
12. T. Y. Chen, T. H. Tse, and Z. Q. Zhou. Semi-proving: an integrated method based on global symbolic evaluation and metamorphic testing. In Proc. of the International Symposium on Software Testing and Analysis (ISSTA), pages 191-195, 2002.
13. D. Chodos et al. Healthcare education with virtual-world simulations. In Proc. of 2nd Workshop on Software Engineering in Health Care, 2010.
14. M. D. Davis and E. J. Weyuker. Pseudo-oracles for non-testable programs. In Proc. of the ACM '81 Conference, pages 254-257, 1981.
15. G. W. Evans, T. B. Gor, and E. Unger. A simulation model for evaluating personnel schedules in a hospital emergency department. In Proc. of 28th Conf. on Winter Simulation, pages 1205-1209, 1996.
16. R. Guderlei and J. Mayer. Statistical metamorphic testing - testing programs with random output by means of statistical hypothesis tests and metamorphic testing. In Proc. of the Seventh International Conference on Quality Software, pages 404-409, 2007.
17. M. A. Heroux and J. M. Willenbring. Barely sufficient software engineering: 10 practices to improve your CSE software. In Proc. of the 2009 ICSE Workshop on Software Engineering for Computational Science and Engineering, pages 15-21, 2009.
18. D. Hook and D. Kelly. Testing for trustworthiness in scientific software. In Proc. of the 2009 ICSE Workshop on Software Engineering for Computational Science and Engineering, pages 59-64, 2009.
19. R. Hovorka et al. Nonlinear model predictive control of glucose concentration in subjects with type 1 diabetes. Physiological Measurement, 25(4), 2004.
20. Z. Jiang, M. Pajic, A. T. Connolly, S. Dixit, and R. Mangharam. Real-time heart model for implantable cardiac device validation and verification. In Proc. of 22nd Euromicro Conference on Real-Time Systems, 2010.
21. J. P. C. Kleijnen. Verification and validation of simulation models. European Journal of Operational Research, 82(1):145-162, April 1995.
22. J. Knight and N. Leveson. An experimental evaluation of the assumption of independence in multi-version programming. IEEE Transactions on Software Engineering, 12(1):96-109, 1986.
23. Y.-S. Ma, J. Offutt, and Y. R. Kwon. MuJava: An automated class mutation system. Journal of Software Testing, Verification and Reliability, 15(2):97-133, June 2005.
24. C. Murphy, G. Kaiser, L. Hu, and L. Wu. Properties of machine learning applications for use in metamorphic testing. In Proc. of the 20th International Conference on Software Engineering and Knowledge Engineering (SEKE), pages 867-872, 2008.
25. C. Murphy, K. Shen, and G. Kaiser. Automated metamorphic system testing. In Proc. of the 2009 ACM International Conference on Software Testing and Analysis (ISSTA), pages 189-199, 2009.
26. M. Raunak, L. Osterweil, and A. Wise. Developing discrete event simulations from rigorous process definitions. In Proc. of the 2011 conference on Theory of Modeling and Simulation/Discrete Events Simulation (TMS/DEVS11), 2011.
27. M. Raunak, L. Osterweil, A. Wise, L. Clarke, and P. Henneman. Simulating patient flow through an emergency department using process-driven discrete event simulation. In Proc. of the 2009 ICSE Workshop on Software Engineering in Health Care, pages 73-83, 2009.
28. M. S. Raunak. Resource Management in Complex, Dynamic Environments. PhD thesis, University of Massachusetts Amherst, 2009.
29. R. G. Sargent. Verification and validation of simulation models. In Proc. of the 37th conference on winter simulation, pages 130-143, 2005.
30. S. Su and C. L. Shih. Modeling an emergency medical services system using computer simulation. International Journal of Medical Informatics, 72(1-3):57-72, Dec 2003.
31. W. T. Tsai, X. Liu, Y. Chen, and R. Paul. Simulation verification and validation by dynamic policy enforcement. In Proc. of the 38th annual Symposium on Simulation, pages 91-98, 2005.
32. E. J. Weyuker. On testing non-testable programs. Computer Journal, 25(4):465-470, November 1982.
33. N. Wilson, K. Wang, and R. W. Dutton. A software framework for creating patient specific geometric models from medical imaging data for simulation based medical planning of vascular surgery. LNCS, 2208/2001:449-456, 2001.
34. A. Wise. JSim agent behavior specification language. http://laser.cs. umass.edu/documentation/jsim.