Benchmarking operating system dependability: Windows 2000 as a case study

Proceedings - IEEE Pacific Rim International Symposium on Dependable Computing

Volumn , Issue , 2004, Pages 261-270

  Kalakech, Ali ^a   Jarboui, Tahar ^a   Arlat, Jean ^a   Crouzet, Yves ^a   Kanoun, Karama ^a  

^a LAAS CNRS   (France)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARK TARGET (BT); SOFTWARE EXECUTIVES; SYSTEM UNDER BENCHMARKING (SUB);

BENCHMARKING; COMPUTER HARDWARE; COMPUTER SOFTWARE; COSTS; FAULT TOLERANT COMPUTER SYSTEMS; MAINTENANCE; MARKETING; PERSONNEL;

COMPUTER OPERATING SYSTEMS;

EID: 2642513952     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/PRDC.2004.1276576     Document Type: Conference Paper

References (28)

1. TPC, Transaction Processing Performance Council, http://www.tpc.org.
2. SPEC, Standard Performance Evaluation Corporation, http://www.spec.org.
3. T. K. Tsai, R. K. Iyer and D. Jewitt, "An Approach Towards Benchmarking of Fault-Tolerant Commercial Systems", in Proc. 26th Int. Symp. on Fault-Tolerant Computing (FTCS-26), Sendai, Japan, 1996, pp. 314-323.
4. A. Brown, "Availability Benchmarking of a Database System", EECS Computer Science Division, University of California at Berkley, 2002.
5. A. Brown, L. C. Chung and D. A. Patterson, "Including the Human Factor in Dependability Benchmarks", in Proc. of the 2002 DSN Workshop on Dependability Benchmarking, Washington, DC, USA, 2002.
6. 3): Rate, Robustness, and Recovery - An Availability Benchmark Framework", no. TR-2002-109, Sun Microsystems Lab.
7. K. Kanoun, J. Arlat, D. J. G. Costa, M. Dal Cin, P. Gil, J.-C. Laprie, H. Madeira and N. Suri, "DBench - Dependability Benchmarking", in Supplement of the 2001 Int. Conf. on Dependable Systems and Networks (DSN-2001), Göteborg, Sweden, 2001, pp. D.12-D.15.
8. H. Madeira et al., "Dependability Benchmark Definition: DBench Prototypes", Dependability Benchmarking Project (IST-2000-25425), www.laas.fr/DBench, 2002.
9. J. Arlat, K. Kanoun, Y. Crouzet, H. Madeira, M. D. Cin, P. Gil and D. Costa, "The DBench Framework for Dependability Benchmarking", Dependability Benchmarking Project (IST-2000-25425), www.laas.fr/DBench, 2002.
10. A. Mukherjee and D. P. Siewiorek, "Measuring Software Dependability by Robustness Benchmarking", IEEE Trans, of Soft. Eng., vol. 23, no. 6, pp. 366-378, 1997.
11. P. Chevochot and I. Puaut, "Experimental Evaluation of the Fail-Silent Behavior of a Distributed Real-Time Run-Time Support Built from COTS Components", in Proc. Int. Conf. on Dependable Systems and Networks (DSN-2001). Göteborg, Sweden, 2001, pp. 304-313.
12. J. Arlat, J.-C. Fabre, M. Rodríguez and F. Salles, "Dependability of COTS Microkernel-Based Systems", IEEE Trans. on Computers, vol. 51, no. 2, pp. 138-163, 2002.
13. P. Koopman and J. DeVale, "Comparing the Robustness of POSIX Operating Systems", in Proc. 29th Int. Symp. on Fault-Tolerant Computing (FTCS-29), Madison, WI, USA. 1999, pp. 30-37.
14. J. Pan, P. J. Koopman, D. P. Siewiorek, Y. Huang, R. Gruber and M. L. Jiang, "Robustness Testing and Hardening of CORBA ORB Implementations", in Proc. 2001 Int. Conf. on Dependable Systems and Networks (DSN-2001), Göteborg, Sweden, 2001, pp. 141-150.
15. E. Marsden, J.-C. Fabre and J. Arlat, "Dependability of CORBA Systems: Service Characterization by Fault Injection", in Proc. 21st Int. Symp. on Reliable Distributed Systems (SRDS-2002), Osaka, Japan, 2002, pp. 276-285.
16. C. Shelton, P. Koopman and K. D. Vale, "Robustness Testing of the Microsoft Win32 API", in Proc. Int. Conf. on Dependable Systems and Networks (DSN'2000), New York, NY, USA, 2000, pp. 261-270.
17. J. Durães and H. Madeira, "Characterization of Operating Systems Behavior in the Presence of Faulty Drivers through Software Fault Emulation", in 2002 Pacific Rim Int. Sym. on Dependable Computing, Tsukuba City, Ibaraki, Japan, 2002, pp. 201-209.
18. TPC-C, TPC Benchmark C, Standard Specification 5.0, 2001.
19. M. Vieira and H. Madeira, "Definition of Faultloads Based on Operator Faults for DBMS Recovery Benchmarking", in 2002 Pacific Rim Int. Symp. on Dependable Computing, Tsukuba City, Ibaraki, Japan, 2002.
20. K. Buchacker, M. Dal Cin, H. J. Höxer, R. Karch, V. Sieh and O. Tschäche, "Reproducible Dependability Benchmarking Experiments Based on Unambiguous Benchmark Setup Descriptions", in Int. Conf. on Dependable Systems and Networks, San Francisco, CA, USA, 2003, pp. 469-478.
21. M. Rodriguez, A. Albinet and J. Arlat, "MAFALDA-RT: A Tool for Dependability Assessment of Real Time Systems", in Proc. Int. Conf. on Dependable Systems and Networks (DSN-2002), Washington, DC, USA, 2002, pp. 267-272.
22. L. W. McVoy and C. Staelin, "lmbench: Portable Tools for Performance Analysis", in USENIX Annual Technical Conference, San Diego, CA, USA, 1996, pp. 279-295.
23. T. Jarboui, J. Arlat, Y. Crouzet, K. Kanoun and T. Marteau, "Analysis of the Effects of Real and Injected Software Faults: Linux as a Case Study", in Proc. 2002 Pacific Rim International Symposium on Dependable Computing (PRDC 2002), Tsukuba, Japan, 2002.
24. P. J. Koopman, J. Sung, C. Dingman, D. P. Siewiorek and T. Marz, "Comparing Operating Systems using Robustness Benchmarks", in Proc. 16th Int. Symp. on Reliable Distributed Systems (SRDS-16), Durham, NC, USA, 1997, pp. 72-79.
25. D. A. Solomon and M. E. Russinovich, Inside Microsoft Windows 2000, Third Edition, 2000.
26. M. Vieira and H. Madeira. "Benchmarking the Dependability Benchmark of different OLTP systems", in Int. Conf. on Dependable Systems and Networks, San Francisco, CA, USA, 2003, pp. 305-310.
27. G. Hunt and D. Brubaher, "Detours: Binary Interception of Win32 Functions", in 3rd USENIX Windows NT Symposium, Seattle, Washington, USA, 1999, pp. 135-144.
28. A. Kalakech, K. Kanoun, Y. Crouzet and J. Arlat. "Benchmarking the Dependability of Windows NT4, 2000 and XP", LAAS Report no 03501, Dec. 2003.