Census and survey of the visible Internet

Proceedings of the ACM SIGCOMM Internet Measurement Conference, IMC

Volumn , Issue , 2008, Pages 169-182

  Heidemann, John ^a,b   Pradkin, Yuri ^a   Govindan, Ramesh ^b   Papadopoulos, Christos ^c   Bartlett, Genevieve ^a,b   Bannister, Joseph ^d  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^c Veterinary Dentistry and Oral Surgery   (United States)

^d AEROSPACE CORPORATION   (United States)

Author keywords

Census; Firewalls; Internet address allocation; IPv4; Survey

Indexed keywords

ACTIVE PROBING; ADDRESS SPACES; BLOCK SIZES; CENSUS; FIREWALLS; INTERNET HOSTS; IPV4; NEW APPROACHES; PRIOR MEASUREMENTS; SUB-NETS; UNICAST;

COMPUTER SYSTEM FIREWALLS; INTERNET PROTOCOLS; POPULATION STATISTICS; PROBES; SAMPLING; SEMICONDUCTING INTERMETALLICS; SPACE PROBES; SURVEYS;

INTERNET;

EID: 63049115876     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1452520.1452542     Document Type: Conference Paper

References (50)

1. M. Allman, W. M. Eddy, and S. Ostermann. Estimating loss rates with TCP. ACM Performance Evaluation Review, 31(3):12-24, Dec. 2003.
2. G. Bartlett, J. Heidemann, and C. Papadopoulos. Understanding passive and active service discovery. In Proc. of the ACM Internet Measurement Conference. ACM, Oct. 2007.
3. R. Beck. Passive-aggressive resistance: OS fingerprint evasion. The Linux Journal, Sept. 2001.
4. R. Braden. Requirements for Internet hosts - communication layers. RFC 1122, Internet Request For Comments, Oct. 1989.
5. T. Bu, L. Gao, and D. Towsley. On characterizing BGP routing table growth. Proc. of the IEEE Global Internet, Nov. 2002.
6. S. Deering and R. Hinden. Internet protocol, IP version 6 specification. RFC 2460, Internet Request For Comments, Dec. 1998.
7. X. Dimitropoulos, D. Krioukov, M. Fomenkov, B. Huffaker, Y. Hyun, kc claffy, and G. Riley. AS relationships: Inference and validation. ACM Computer Communication Review, 37(1):29-40, Jan. 2007.
8. N. Duffield and M. Grossglauser. Trajectory sampling for direct traffic observation. In Proc. of the ACM SIGCOMM Conference, pages 179-191, Stockholm, Sweeden, Aug. 2000. ACM.
9. Ed3f. Firewall spotting and networks analysis with a broken CRC. http://www.phrack.org/archives/60/p60-0x0c.txt, Dec. 2002.
10. M. Faloutsos, P. Faloutsos, and C. Faloutsos. On power-law relationships of the internet topology. In Proc. of the ACM SIGCOMM Conference, pages 251-262, Cambridge, MA, USA, Sept. 1999. ACM.
11. V. Fuller, T. Li, J. Yu, and K. Varadhan. Classless inter-domain routing (CIDR): an address assignment and aggregation strategy. RFC 1519, Internet Request For Comments, Sept. 1993.
12. L. Gao. On inferring automonous system relationships in the internet. ACM/IEEE Transactions on Networking, 9(6):733-745, Dec. 2001.
13. R. Govindan and H. Tangmunarunkit. Heuristics for Internet Map Discovery. In Proc. of the IEEE Infocom, Tel-Aviv, Israel, Mar. 2000.
14. K. P. Gummadi, R. J. Dunn, S. Saroiu, S. D. Gribble, H. M. Levy, and J. Zahorjan. Measurement, modelling, and analysis of a peer-to-peer file-sharing workload. In Proc. of the 19th Symposium on Operating Systems Principles, pages 314-329, Bolton Landing, NY, USA, Oct. 2003. ACM.
15. T. Hain. A pragmatic report on IPv4 address space consumption. The Internet Protocol Journal, 8(3), 2004.
16. B. He, M. Patel, Z. Zhang, and K. C.-C. Chang. Accessing the deep web. Communications of the ACM, 50(5):94-101, May 2007.
17. A. S. Hedayat and B. K. Sinha. Design and Inference in Finite Population Sampling. John Wiley & Sons, Inc., 1991.
18. J. Heidemann, Y. Pradkin, R. Govindan, C. Papadopoulos, G. Bartlett, and J. Bannister. Census and survey of the visible internet (extended). Technical Report ISI-TR-2008-649b, USC/Information Sciences Institute, Feb. 2008. (Updated August 2008.).
19. B. Huffaker, D. Plummer, D. Moore, and K. C. Claffy. Topology Discovery by Active Probing. In Proc. of the Symposium on Applications and the Internet, Jan. 2002.
20. G. Huston. Analyzing the Internet's BGP routing table. Internet Protocol Journal, 4(1), Mar. 2001.
21. G. Huston. IPv4 address report. http://bgp.potaroo.net/ipv4/, June 2006.
22. IANA. Internet protocol v4 address space. web page http://www.iana.org/ assignments/ipv4-address-space, Sept. 2002.
23. IANA. ICMP type numbers. web page http://www.iana.org/assignments/icmp- parameters, Mar. 2007.
24. Internet Software Consortium. Internet domain survey. web page http://www.isc.org/ds.
25. M. Khadilkar, N. Feamster, M. Sanders, and R. Clark. Usage-based DHCP lease time optimization. In Proc. of the 7th ACM Internet Measurement Conference, pages 71-76, Oct. 2007.
26. E. Kohler, J. Li, V. Paxson, and S. Shenker. Observed structure of addresses in IP traffic. In Proc. of the 2nd ACM Internet Measurement Workshop, pages 253-266, Nov. 2002.
27. C. Labovitz, A. Ahuja, A. Abose, and F. Jahanian. Delayed Internet routing convergence. In Proc. of the ACM SIGCOMM Conference, pages 175-187, Stockholm, Sweeden, Aug. 2000. ACM.
28. W. Leland, M. Taqqu, W. Willinger, and D. Wilson. On the self-similar nature of Ethernet traffic (extended version). ACM/IEEE Transactions on Networking, 2(1):1-15, Feb. 1994.
29. L. Li, D. Alderson, W. Willinger, and J. Doyle. A first-principles approach to understanding the Internet's router-level topology. In Proc. of the ACM SIGCOMM Conference, pages 3-14, Portland, Oregon, USA, Aug. 2004.
30. M. Lottor. Internet growth (1981-1991). RFC 1296, Internet Request For Comments, Jan. 1992.
31. X. Meng, Z. Xu, B. Zhang, G. Huston, S. Lu, and L. Zhang. IPv4 address allocation and the BGP routing table evolution. ACM Computer Communication Review, 35(1):71-80, Jan. 2005.
32. W. Mühlbauer, O. Maennel, S. Uhlig, A. Feldmann, and M. Roughan. Building an AS-topology model that captures route diversity. In Proc. of the ACM SIGCOMM Conference, pages 195-204, Pisa, Italy, Sept. 2006.
33. H. Narayan, R. Govindan, and G. Varghese. On the impact of routing and address allocation on the structure and implementation of routing tables. In Proc. of the ACM SIGCOMM Conference, Aug. 2003.
34. NJABL. Not just another bogus list. http://www.njabl.org/, 2007.
35. p0f Project. p0f passive OS fingerprinting. http://lcamtuf.coredump.cx/ p0f.shtml, Sept. 2006.
36. V. Paxson. End-to-end Internet packet dynamics. ACM/IEEE Transactions on Networking, 7(3):277-292, June 1999.
37. V. Paxson and S. Floyd. Why we don't know how to simulate the Internet. In Proc. of the 29th SCS Winter Simulation Conference, pages 1037-1044, Atlanta, Georga, USA, Dec. 1997.
38. N. Project. Nmap network security scanner. http://www.insecure.org/nmap/, 1997.
39. Y. Rekhter, B. Moskowitz, D. Karrenberg, G. J. de Groot, and E. Lear. Address allocation for private internets. RFC 1918, IETF, Feb. 1996.
40. Y. Shavitt and E. Shir. Dimes: let the Internet measure itself. SIGCOMM Comput. Commun. Rev., 35(5):71-74, 2005.
41. D. Smallberg. Who talks TCP? RFC 832, Internet Request For Comments, Dec. 1982.
42. M. Smart, G. R. Malan, and F. Jahanian. Defeating TCP/IP stack fingerprinting. In Proc. of the USENIX Security Symposium, pages 229-240, Denver, Colorado, USA, Aug. 2000. USENIX.
43. F. D. Smith, F. Hernandez, K. Jeffay, and D. Ott. What TCP/IP protocol headers can tell us about the web. In Proc. of the ACM SIGMETRICS, pages 245-256, Cambridge, MA, USA, June 2001. ACM.
44. SORBS. Sorbs dynamic user and host list. http://www.au.sorbs.net/faq/dul. shtml, 2004.
45. N. Spring, R. Mahajan, D. Wetherall, and T. Anderson. Measuring ISP topologies with Rocketfuel. ACM/IEEE Transactions on Networking, 12(1):2-16, 2004.
46. L. Subramanian, S. Agarwal, J. Rexford, and R. H. Katz. Characterizing the Internet hierarchy from multiple vantage points. In Proc. of the IEEE Infocom, pages 618-627, New York, NY, USA, June 2002. IEEE.
47. H. Tangmunarunkit, R. Govindan, S. Jamin, and S. S. W. Willinger. Network Topology Generators: Degree-Based vs. Structural. In Proceedings of ACM SIGCOMM, pages 188-195, Pittsburgh, PA, 2002.
48. P. F. Tsuchiya and T. Eng. Extending the IP Internet through address reuse. ACM Computer Communication Review, 23(1):16-33, Jan. 1993.
49. R. Whittle. Probing the density of ping-responsive-hosts in each /8 IPv4 prefix and in different sizes of BGP advertised prefix. Web page http://www.firstpr.com.au/ip/host-density-per-prefix/, Nov. 2007.
50. Y. Xie, F. Yu, K. Achan, E. Gillum, M. Goldszmidt, and T. Wobber. How dynamic are IP addresses? In Proc. of the ACM SIGCOMM Conference, Kyoto, Japan, Aug. 2007. ACM.