On the use of emulab testbeds for scientifically rigorous experiments

IEEE Communications Surveys and Tutorials

Volumn 15, Issue 2, 2013, Pages 929-942

  Siaterlis, Christos ^a   Garcia, Andres Perez ^a   Genge, Bela ^a  

^a JOINT RESEARCH CENTRE   (Italy)

Author keywords

Emulation; fidelity; network testbeds; repeatability; testbeds

Indexed keywords

CONFIGURATION PARAMETERS; EMERGING BEHAVIORS; EMULATION; FIDELITY; MEASUREMENT ACCURACY; NETWORK TESTBEDS; REPEATABILITY; RESPONSE MECHANISMS;

C (PROGRAMMING LANGUAGE); COMPLEX NETWORKS; INTERNET; TESTBEDS;

EXPERIMENTS;

EID: 84877579085     PISSN: None     EISSN: 1553877X     Source Type: Journal    
DOI: 10.1109/SURV.2012.0601112.00185     Document Type: Article

References (30)

1. G. Huston, M. Rossi, and G. Armitage, "Securing BGP-a literature survey, " IEEE Commun. Surveys Tuts., vol. 13, no. 2, pp. 199-222, quarter 2011.
2. B. Genge and C. Siaterlis, "Developing cyber-physical experimental capabilities for the security analysis of the future Smart Grid, " in Proc. 2011 IEEE Innovative Smart Grid Technologies, 2011, pp. 1-7.
3. X. Fang, S. Misra, G. Xue, and D. Yang, "Smart grid-the new and improved power grid: A survey, " IEEE Commun. Surveys Tuts., vol. PP, no. 99, pp. 1-37, 2011.
4. Emulab, "Emulab bibliography, " http://www.emulab.net/expubs. php/, 2012, [Online; accessed March 2012].
5. C. Siaterlis and M. Masera, "A survey of software tools for the creation of networked testbeds, " International Journal On Advances in Security, vol. 4, no. 1-2, pp. 1-12, 2010, ISSN. 1942-2636.
6. B. White, J. Lepreau, L. Stoller, R. Ricci, S. Guruprasad, M. Newbold, M. Hibler, C. Barb, and A. Joglekar, "An integrated experimental environment for distributed systems and networks, " SIGOPS Oper Syst. Rev., vol. 36, no. SI, pp. 255-270, Dec. 2002. [Online]. Available: http://doi.acm.org/10.1145/ 844128.844152
7. DETER, "DETER. cyber-DEfense Technology Experimental Research laboratory Testbed, " http://www.isi.edu/deter/, 2012, [Online; accessed March 2012].
8. J. Mirkovic, A. Hussain, S. Fahmy, P. Reiher, and R. Thomas, "Accurately measuring denial of service in simulation and testbed experiments, " IEEE Trans. Dependable Secure Computing, vol. 6, no. 2, pp. 81-95, april-june 2009.
9. D. S. Anderson, M. Hibler, L. Stoller, T. Stack, and J. Lepreau, "Automatic online validation of network configuration in the emulab network testbed, " in Proc. 2006 IEEE International Conference on Autonomic Computing, ser. ICAC '06. Washington, DC, USA: IEEE Computer Society, 2006, pp. 134-142. [Online]. Available: http://dx.doi.org/10.1109/ICAC.2006.1662391
10. R. Chertov, S. Fahmy, and N. B. Shroff, "Fidelity of network simulation and emulation: A case study of tcp-targeted denial of service attacks, " ACM Trans. Model. Comput. Simul., vol. 19, no. 1, pp. 4:1-4:29, Jan. 2009. [Online]. Available: http://doi.acm.org/10.1145/1456645.1456649
11. Emulab, "Emulab tutorial, " https://users.emulab.net/trac/ emulab/wiki/Tutorial, 2008, [Online; accessed March 2012].
12. "Emulab tutorial-a more advanced example, " https://users. emulab.net/trac/emulab/wiki/AdvancedExample, 2010, [Online; accessed March 2012].
13. B. Genge, I. N. Fovino, C. Siaterlis, and M. Masera, "Analyzing cyber-physical attacks on networked industrial control systems, " in Critical Infrastructure Protection, 2011, pp. 167-183.
14. ISI, "The network simulator-ns-2, " http://www.isi.edu/nsnam/ ns/, 2012, [Online; accessed March 2012].
15. Emulab, "Emulab-testbed ns command extensions, " http://users. emulab.net/trac/emulab/wiki/nscommands, 2012, [Online; accessed March 2012].
16. L. Rizzo, "Dummynet: a simple approach to the evaluation of network protocols, " SIGCOMM Comput. Commun. Rev., vol. 27, no. 1, pp. 31-41, Jan. 1997. [Online]. Available: http://doi.acm.org/10.1145/251007.251012
17. A. Garcia, C. Siaterlis, and M. Masera, "Testing the fidelity of an emulab testbed, " in Distributed Computing Systems Workshops (ICDCSW), 2010 IEEE 30th International Conference on, june 2010, pp. 307-312.
18. NLANR/DAST, "Iperf: The TCP/UDP bandwidth measurement tool, " http://sourceforge.net/projects/iperf/, 2012, [Online; accessed March 2012].
19. A. Turner, "TCPReplay tool, " http://tcpreplay.synfin.net/trac/ , 2012, [Online; accessed March 2012].
20. W chang Feng, A. Goel, A. Bezzaz, W chi Feng, and J. Walpole, "Tcpivo: A high-performance packet replay engine, " in In Proc. ACM SIGCOMM workshop on Models, methods, 2003, pp. 57-64.
21. "Tcpdump: Traffic analyzer, " http://tcpreplay.synfin.net/trac/ , 2012, [Online; accessed March 2012].
22. CISCO, "Cisco switched port analyzer (SPAN), " http://www. cisco.com/en/US/products/hw/switches/ps708/products-tech- note09186a008015c612. shtml, 2007, [Online; accessed March 2012].
23. M. C. Weigle, P. Adurthi, F Hernandez-Campos, K. Jeffay, and F D. Smith, "Tmix: a tool for generating realistic tcp application workloads in ns-2, " SIGCOMM Comput. Commun. Rev., vol. 36, no. 3, pp. 65-76, Jul. 2006. [Online]. Available: http://doi.acm.org/10.1145/1140086.1140094
24. K. Vishwanath and A. Vahdat, "Swing: Realistic and responsive network traffic generation, " IEEE/ACM Trans. Netw., vol. 17, no. 3, pp. 712-725, june 2009.
25. M. Carbone and L. Rizzo, "Dummynet revisited, " SIGCOMM Comput. Commun. Rev., vol. 40, no. 2, pp. 12-20, Apr. 2010. [Online]. Available: http://doi.acm.org/10.1145/1764873.1764876
26. K. Cho, "WIDE-TRANSIT 150 Megabit Ethernet Trace 2008-03-18 (Anonymized) (collection), " http://imdc.datcat.org, 2012, [Online; accessed March 2012].
27. R. Ricci, C. Alfeld, and J. Lepreau, "A solver for the network testbed mapping problem, " SIGCOMM Comput. Commun. Rev., vol. 33, no. 2, pp. 65-81, Apr. 2003. [Online]. Available: http://doi.acm.org/10.1145/956981. 956988
28. Q. Jia, Z. Wang, and A. Stavrou, "The heisenberg measuring uncertainty in lightweight virtualization testbeds, " in Proc. 2nd conference on Cyber security experimentation and test, ser. CSET'09. Berkeley, CA, USA: USENIX Association, 2009, pp. 4-4. [Online]. Available: http://dl.acm.org/citation.cfm?id=1855481.1855485
29. W. J. Conover, Practical Nonparametric Statistics. New York: John Wiley & Sons, 1971, pp. 295-301;309-314.
30. S. Agarwal, J. Sommers, and P. Barford, "Scalable network path emulation, " in Proc. 13th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, ser. MASCOTS '05. Washington, DC, USA: IEEE Computer Society, 2005, pp. 219-228. [Online]. Available: http://dx.doi.org/10.1109/MASCOT.2005.61