Fault Injection for Dependability Validation: A Methodology and Some Applications

IEEE Transactions on Software Engineering

Volumn 16, Issue 2, 1990, Pages 166-182

  Arlat, Jean ^a   Aguera, Martine ^a   Amat, Louis ^a   Crouzet, Yves ^a   Fabre, Jean Charles ^a   Laprie, Jean Claude ^a   Martins, Eliane ^a   Powell, David ^a  

^a LAAS CNRS   (France)

Author keywords

Coverage evaluation; Experimental dependability validation; Fault simulation; Fault tolerant computing systems; Fault error injection

Indexed keywords

RELIABILITY--EVALUATION;

FAULT INJECTION; MESSALINE; PIN LEVEL FAULT INJECTION TOOL; SOFTWARE DEPENDABILITY VALIDATION;

COMPUTER SYSTEMS, DIGITAL;

EID: 0025384345     PISSN: 00985589     EISSN: None     Source Type: Journal    
DOI: 10.1109/32.44380     Document Type: Article

References (43)

1. J. C. Laprie. “Dependable computing and fault-tolerance: Concepts and terminology,” in Proc. FTCS-I5, Ann Arbor, MI, June 1985, pp. 2–11.
2. J. Arlat, Y. Crouzet, and J. C. Laprie, “Fault-injection for dependability validation of fault-tolerant computing systems,” in Proc. FTCS-19, Chicago, IL, June 1989, pp. 348–355.
3. W. C. Carter and J. Abraham, “Design and evaluation tools for fault-tolerant systems,” in Proc. AIAA Computers in Aerospace Conf., 1987, pp. 70–77.
4. J. R. Armstrong, J. G. Tront, and K. W. Li, “Modeling and simulation of the effects of internal transient upsets on microprocessors,” Trans. Soc. Compul. Simulation, vol. 2, no. 1, pp. 73–93, 1985.
5. J. P. Gérardin, “Aid to the design of reliable and safe systems: The tool DEFI,” Electronique Industrielle, no. 116, pp. 58–63, Nov. 1986 (in French).
6. Z. Segall, D. Vrsalovic, D. Siewiorek, D. Yaskin, J. Kownacki, J. Barton, D. Rancey, A. Robinson, and T. Lin, “FIAT—Fault injection based automated testing environment,” in Proc. FTCS-18, Tokyo, Japan, June 1988, pp. 102–107.
7. G. S. Choi, R. K. Iyer, and V. Carreno, “A fault behavior model for an avionic microprocessor: A case study,” in Proc. 1st Int. Working Conf. Dependable Computing for Critical Applications, Santa Barbara, CA, Aug. 1989, pp. 71–77.
8. D. Powell, “A hierarchical approach to distribution computing system dependability evaluation,” J. Syst. Software, vol. 1, no. 2, pp. 183–198, 1986.
9. M. M. Alidrisi, “A simulation approach for computing system reliability,” Microelectron. Rel., vol. 27, no. 3, pp. 463–467, 1987.
10. A. T. Acree, “On mutation,” Ph.D. dissertation, Georgia Inst. Technol., Atlanta, ICS Rep. 80/12, Aug. 1980.
11. R. A. DeMillo, R. J. Lipton, and F. G. Sayward, “Hints on test data selection: Help for the practicing programmer,” Computer, pp. 34–41. Apr. 1978.
12. W. E. Howden, “Weak mutation testing and completeness of test sets,” IEEE Trans. Software Eng., vol. SE-8, pp. 371–379, July 1982.
13. A. Mahmood. D. M. Andrews, and E. J. McCluskey, “Executable assertions and flight software,” in Proe. 6th AIAA/IEEE Digital Avionics Systems Conf., Baltimore, MD, Dec. 1984, pp. 346–351.
14. Raytheon Co., “Brassboard fault-tolerant spaceborne computer (3FTSC),” Final Rep., Dec. 1978.
15. Y. Crouzet and B. Decouty, “Measurements of fault detection mechanisms efficiency: Results,” in Proc. FTCS-12, Santa Monica, CA, June 1982, pp. 373–376.
16. F. Morillon, “Physical fault simulation,” in Proc. Int. Symp. FUROCON’82, Copenhagen, Denmark, June 1982, pp. 489–492.
17. J. H. Lala, “Fault detection, isolation and reconfiguration in FTMP: Methods and experimental results,” in Proc. AIAA/IEEE Digitals Avionics Systems Conf., Nov. 1983, pp. 21.3.1—21.3.9.
18. A. Damm, “Experimental evaluation of error-detection and self-checking coverage of components of a distributed real-time system,” Doctorate thesis. Tech. Univ. Vienna, Oct. 1988.
19. M. E. Schmid, R. L. Trapp, A. E. Davidoff, and G. Masson, “Upset exposure by means of abstraction verification,” in Proc. FTCS-12, Santa Monica, CA. June 1982, pp. 237–244.
20. M. A. Schuette, J. P. Shen, D. P. Siewiorek, and Y. X. Zhu, “Experimental evaluation of two concurrent error detection schemes,” in Proc. FTCS-16, Vienna, Austria, July 1986, pp. 138–143.
21. M. L. Cortes, S. D. Millman, H. A. Goosen, and E. J. McCluskey, “Techniques for injecting non stuck-at faults,” Stanford Univ., CRC Tech. Rep. 87–21, Mar. 1987.
22. U. Gunneflo, J. Karlsson, and J. Torin, “Evaluation of error detect on schemes using fault injection by heavy-ion radiation,” in Proc. FTCS-19. Chicago, IL, June 1989, pp. 340–347.
23. W. G. Bouricius, W. C. Carter, and P. R. Schneider, “Reliability modeling techniques for self-repairing computer systems,” in Proc. 24:h ACM Nat. Conf., 1969, pp. 295–309.
24. M. K. Joseph and J. Bannister. “Coverage estimation and validation,” Aerospace Corp. Rep., Aug. 1988.
25. A. Avizienis and J. C. Laprie. “Dependable computing: From concepts to design diversity,” Proc. IEEE, pp. 629–638, May 1986.
26. W. N. Toy. “Fault-tolerant design of local ESS processors.” Proc. IEEE, vol. 66, pp. 1126–1145, Oct. 1978.
27. D. C. Bossen and M. Y. Hsiao. “Model for transient and permanent error-detection and fault-isolation coverage,” IBM J. Res. Develop., Vol. 26, no. 1, pp. 67–77, Jan. 1982.
28. J W. Duran and J. Wiorkowski, “Capture-recapture sampling for estimating software error content,” IEEE Trans. Software Eng., vol. SE-7, no. 1, pp. 147–148, Jan. 1981.
29. F. G. Shin and Y. H. Lee, “Measurement and application of fault latency,” IEEE Trans. Comput., vol. C-35, pp. 370–375, Apr. 1986.
30. F. Chillarege and R. K. Iyer. “Measurement-ba.sed analysis of error latency,” IEEE Trans. Comput., vol. C-36, pp. 529–537, May 1987.
31. J. McGough, “Effects of near-coincident faults in multiprocessor systems,” in Proc. AIAA/IEEE Digitals Avionics Systems Conf., Nov. 1983, pp. 16.6.1–16.6.7.
32. J. F. Lawless. Statistical Models and Methods for Lifetime Data. New York: Wiley, 1982.
33. J. B. Dugan and K. S. Trivedi, “Coverage modeling for dependabil-i y analysis of fault-tolerant systems,” IEEE Trans. Comput., vol. 38, pp. 775–787, June 1989.
34. J. Ariat and J. C. Laprie. “On the dependability evaluation of high safety systems,” in Proc. FTCS-15, Ann Arbor. MI, June 1985, pp. 318–323.
35. C. Carter, “Hardware and software dependability evaluation: System dependability,” in Proc. IFIP 11th World Computer Congress, San Francisco, CA, Aug. 1989, p. 118.
36. V. D. Agrawal, “Sampling techniques for determining fault coverage in LSI circuits,” J. Digital Syst., vol. 5, no. 3, pp. 189–202, 1981.
37. N. R. Mann, R. E. Schaffer, and N. D. Singpurwalla, Methods for Statistical Analysis of Reliability and Life Data. New York: Wiley, 1974.
38. F. Chillarege and N. S. Bowen. “Understanding large system failures—A fault injection experiment.” in Proc. FTCS-I9, Chicago, IL. June 1989, pp. 356–363.
39. F. Traverse, “On the dependability validation by mutation—Design of an error injection tool.” Doctor-Engineer thesis, INP Toulouse. Dec. 1983 (in French).
40. M. Sevestre. “Validation of a microprocessor-based railway lafety system,” in Proc. 4th Int. Conf. Ret. and Maim., Perros-Guirec and Trégastel, France, May 1984, pp. 586–589 (in French).
41. D. Powell, P. Verissimo, G. Bonn, F. Waeselynck, and D. Seaton, “The Delta-4 approach to dependability in open distributed computing systems,” in Proc. FTCS-18, Tokyo. Japan, June 1988, pp. 246–251.
42. J. Arlat, Y. Crouzet, and L. Amat, “Dependability validation by means of fault-injection: Application of MESSALINE for the validation of the processing unit of a computerized interlocking systrm,” LAAS Res. Rep. 87–108, Mar. 1987 (in French).
43. M. Aguera, J. Arlat, Y. Crouzet, J. C. Fabre, E. Martins, and D. Powell, “Results of fault-injection into an MCS network attachment controller with limited self-checking,” LAAS Res. Rep. 89–071, Mar. 1989.