A new approach and a related tool for dependability measurements on distributed systems

IEEE Transactions on Instrumentation and Measurement

Volumn 59, Issue 4, 2010, Pages 820-831

  Bondavalli, Andrea ^a   Ceccarelli, Andrea ^a   Falai, Lorenzo ^b   Vadursi, Michele ^c  

^a UNIVERSITY OF FLORENCE   (Italy)

^b ResilTech Srl   (Italy)

^c UNIVERSITY OF NAPLES PARTHENOPE   (Italy)

Author keywords

Dependability measurements; Measurement uncertainty; Measurements on distributed systems; Mresilience measurements; Verification and validation (V V)

Indexed keywords

DEPENDABILITY MEASUREMENTS; DISTRIBUTED SYSTEMS; EXPERIMENTAL MEASUREMENTS; HIGHLY-PORTABLE; IN-LINE; MEASUREMENT RESULTS; MEASUREMENT UNCERTAINTY; NEW APPROACHES; UNCERTAINTY OF MEASUREMENT; VERIFICATION AND VALIDATION;

UNCERTAINTY ANALYSIS;

MEASUREMENTS;

EID: 77949424962     PISSN: 00189456     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIM.2009.2023815     Document Type: Article

References (46)

1. A. Avizienis, J. Laprie, B. Randell, and C. Landwehr, "Basic concepts and taxonomy of dependable and secure computing," IEEE Trans. Dependable Secure Comput., vol.1, no.1, pp. 11-33, Jan. 2004
2. A. Bondavalli, A. Ceccarelli, L. Falai, and M. Vadursi, "Foundations of measurement theory applied to the evaluation of dependability attributes," in Proc. 37th Annu. IEEE/IFIP Int. Conf. DSN, Edinburgh, U.K., Jun. 25-28, 2007, pp. 522-531
3. A. Bondavalli, A. Ceccarelli, and L. Falai, "Assuring resilient time synchronization," in Proc. 27th IEEE SRDS, Napoli, Italy, Oct. 6-8, 2008, pp. 3-12
4. L. Falai, A. Bondavalli, and F. Di Giandomenico, "Quantitative evaluation of distributed algorithms using the Neko framework: The Nekostat extension," in Proc. LADC, Salvador, Brazil, Oct. 25-28, 2005, pp. 35-51
5. J. Carreira, H. Madeira, and J. Silva, "Xception: Software fault injection and monitoring in processor functional units," in Proc. 5th Int. Working Conf. DCCA, 1995, pp. 135-149. Pre-prints
6. J. Aidemark, J. Vinter, P. Folkesson, and J. Karlsson, "Goofi: Generic object-oriented fault injection tool," in Proc. Int. Conf. Dependable Syst. Netw. (formerly: FTCS), Washington, DC, 2001, pp. 83-88
7. J.-C. Fabre, F. Salles, M. R. Moreno, and J. Arlat, "Assessment of COTS microkernels by fault injection," in Proc. Conf. DCCA, Washington, DC, 1999, pp. 25-44
8. M. Rodriguez, A. Albinet, and J. Arlat, "MAFALDA-RT: A tool for dependability assessment of real-time systems," in Proc. Int. Conf. Dependable Syst. Netw., Washington, DC, 2002, pp. 267-272
9. J. Arlat, M. Aguera, L. Amat, Y. Crouzet, J.-C. Fabre, J.-C. Laprie, E. Martins, and D. Powell, "Fault injection for dependability validation: A methodology and some applications," IEEE Trans. Softw. Eng., vol.16, no.2, pp. 166-182, Feb. 1990
10. T. K. Tsai and R. K. Iyer, "FTAPE: A fault injection tool to measure fault tolerance," in Proc. 10th AIAA, Comput. Aerosp. Conf., San Antonio, TX, 1995, pp. 339-346
11. R. Chandra, R. M. Lefever, M. Cukier, and W. H. Sanders, "Loki: A state-driven fault injector for distributed systems," in Proc. Int. Conf. Dependable Syst. Netw. (formerly FTCS-30/DCCA-8), Washington, DC, 2000, pp. 237-242
12. P. Urban, A. Schiper, and X. Defago, "Neko: A single environment to simulate and prototype distributed algorithms," in Proc. 15th Int. Conf. Inf. Netw., Washington, DC, 2001, pp. 503-511
13. S. Dawson, F. Jahanian, T. Mitton, and T.-L. Tung, "Testing of faulttolerant and real-time distributed systems via protocol fault injection," in Proc. 26th Annu. FTCS, Washington, DC, 1996, p. 404
14. S. Dawson and F. Jahanian, "Probing and fault injection of protocol implementations," in Proc. Int. Conf. Distrib. Comput. Syst., 1995, pp. 351-359
15. A. Kalakech, T. Jarboui, J. Arlat, Y. Crouzet, and K. Kanoun, "Benchmarking operating system dependability: Windows 2000 as a case study," in Proc. 10th IEEE PRDC, Washington, DC, 2004, pp. 261-270
16. N. Ignat, B. Nicolescu, Y. Savaria, and G. Nicolescu, "Soft-error classification and impact analysis on real-time operating systems," in Proc. Conf. Des., Autom. Test Eur., Leuven, Belgium, 2006, pp. 182-187
17. T. K. Tsai, R. K. Iyer, and D. Jewitt, "An approach towards benchmarking of fault-tolerant commercial systems," in Proc. 26th Annu. FTCS, Washington, DC, 1996, p. 314
18. C. Fetzer and F. Cristian, "FORTRESS: A system to support fail-aware real-time applications," in Proc. IEEE Workshop Middleware Distrib. Real-Time Syst. Services, San Francisco, CA, Dec. 1997
19. M. Balakrishnan, K. Birman, and A. Phanishayee, "Plato: Predictive latency-aware total ordering," in Proc. 25th IEEE SRDS,Washington, DC, 2006, pp. 175-188
20. JCGM 100:2008, "Evaluation of measurement data-Guide to the expression of uncertainty in measurement," 2008
21. D. Mills, "Internet time synchronization: The network time protocol," IEEE Trans. Commun., vol.39, no.10, pp. 1482-1493, Oct. 1991
22. P. Verissimo and L. Rodriguez, Distributed Systems for System Architects. Norwell, MA: Kluwer, 2001
23. JCGM 200:2008, "International vocabulary of metrology-Basic and general concepts and associated terms (VIM)," 2008
24. D. Avresky, J. Arlat, J. C. Laprie, and Y. Crouzet, "Fault injection for formal testing of fault tolerance," IEEE Trans. Rel., vol.45, no.3, pp. 443-455, Sep. 1996
25. Y. Jiang, C. Tham, and C. Ko, "Challenges and approaches in providing QoS monitoring," Int. J. Netw. Manag., vol.10, no.6, pp. 323-334, Nov./Dec. 2000
26. D. K. Pradhan, Fault-Tolerant Computer Systems Design. Englewood Cliffs, NJ: Prentice-Hall
27. K. Kanoun, H. Madeira, Y. Crouzet, M. Dal Cin, F. Moreira, and J.-C. Ruiz Garcia, Eds., "DBench dependability benchmarks," DBench Project Full Final Report, Project IST-2000-25425, May 2004, p. 233
28. S. Brocklehurst and B. Littlewood, "New ways to get accurate reliability measures," IEEE Softw., vol.9, no.4, pp. 34-42, Jul. 1992
29. N. Fenton, "Software measurement: A necessary scientific basis," IEEE Trans. Softw. Eng., vol.20, no.3, pp. 199-206, Mar. 1994
30. K. Fowler, "Dependability," IEEE Instrum. Meas. Mag., vol.8, no.4, pp. 55-58, Oct. 2005
31. [Online]. Available: http://www.amber-project.eu/
32. W. R. Dunn, Practical Design of Safety Critical Computer Systems. Solvang, CA: Reliability Press, 2002, p. 9
33. K. B. Lee and R. D. Schneeman, "Internet-based distributed measurement and control applications," IEEE Instrum. Meas. Mag., vol.2, no.2, pp. 23-27, Jun. 1999
34. L. Angrisani, L. Battaglia, and F. Delfino, "GRID-based power measurement in digital wireless communication systems," IEEE Trans. Instrum. Meas., vol.56, no.5, pp. 1565-1572, Oct. 2007
35. D. Grimaldi, L. Pupo, and F. Nigro, "Java-based distributed measurement systems," IEEE Trans. Instrum. Meas., vol.47, no.1, p. 100, Feb. 1998
36. P. Arpaia, A. Baccigalupi, F. Cennamo, and P. Daponte, "A measurement laboratory on geographic network for remote test experiments," IEEE Trans. Instrum. Meas., vol.49, no.5, pp. 992-997, Oct. 2000
37. D. Castaldo, D. Gallo, C. Landi, R. Langella, and A. Testa, "Power quality analysis: A distributed measurement system," in Proc. IEEE Power Tech Conf., Bologna, Italy, Jun. 23-26, 2003, vol.3, p. 6
38. L. Falai and A. Bondavalli, "Experimental evaluation of the QoS of failure detectors on wide area network," in Proc. 35th Annu. IEEE/IFIP Int. Conf. DSN, Yokohama, Japan, Jun. 28-Jul. 1, 2005, pp. 624-633
39. R. Prasad, C. Dovrolis,M.Murray, and K. Claffy, "Bandwidth estimation: Metrics, measurement techniques, and tools," IEEE Netw., vol.17, no.6, pp. 27-35, Nov./Dec. 2003
40. L. Angrisani, S. D'Antonio, M. Esposito, and M. Vadursi, "Techniques for available bandwidth measurement in IP networks: A performance comparison," Comput. Netw., vol.50, no.3, pp. 332-349, Feb. 22, 2006
41. L. Angrisani and M. Vadursi, "Cross-layer measurements for a comprehensive characterization of wireless networks in the presence of interference," IEEE Trans. Instrum. Meas., vol.56, no.4, pp. 1148-1156, Aug. 2007
42. W. Chen, S. Toueg, and M. K. Aguilera, "On the quality of service of failure detectors," IEEE Trans. Comput., vol.51, no.1, pp. 13-32, Jan. 2002
43. L. Falai, "Observing, monitoring and evaluating distributed systems," Ph.D. dissertation, Univ. Firenze, Florence, Italy, 2008
44. P. Felber, X. Defago, R. Guerraoui, and P. Oser, "Failure detectors as first class objects," in Proc. Int. Symp. DOA, Edinburgh, U.K., 1999, pp. 132-141
45. A. Coccoli, P. Urban, A. Bondavalli, and A. Schiper, "Performance analysis of a consensus algorithm combining stochastic activity networks and measurements," in Proc. 32nd Annu. IEEE/IFIP Int. Conf. DSN, Jun. 23-26, 2002, pp. 551-560
46. H. Madeira, J. Costa, and M. Vieira, "The OLAP and data warehousing approaches for analysis and sharing of results from dependability evaluation experiments," in Proc. 33rd Annu. IEEE/IFIP Int. Conf. DSN, Jun. 22-25, 2003, pp. 86-91