Crowdsourcing service-level network event monitoring

SIGCOMM'10 - Proceedings of the SIGCOMM 2010 Conference

Volumn , Issue , 2010, Pages 387-398

  Choffnes, David R ^a   Bustamante, Fabián E ^a   Ge, Zihui ^b  

^a NORTHWESTERN UNIVERSITY   (United States)

^b AT AND T LABS RESEARCH   (United States)

Author keywords

anomaly detection; crowdsourcing; P2P; service level network events

Indexed keywords

EID: 78149353011     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1851182.1851228     Document Type: Conference Paper

References (37)

1. AMAZON. Amazon mechanical turk. http://www.mturk.com/.
2. ANDERSEN, D., BALAKRISHNAN, H., KAASHOEK, F., AND MORRIS, R. Resilient overlay networks. In Proc. ACM SOSP (2001).
3. CASADO, M., GARFINKEL, T., CUI, W., PAXSON, V., AND SAVAGE, S. Opportunistic measurement: Extracting insight from spurious traffic. In Proc. HotNets (2005).
4. CASTRO, M., DRUSCHEL, P., GANESH, A., ROWSTRON, A., AND WALLACH, D. Secure routing for structured peer-to-peer overlay networks. In Proc. USENIX OSDI (2002).
5. CHEN, K., CHOFFNES, D., POTHARAJU, R., CHEN, Y., BUSTAMANTE, F., AND ZHAO, Y. Where the sidewalk ends: Extending the Internet AS graph using traceroutes from P2P users. In Proc. ACM CoNEXT (2009).
6. CHEN, X., ZHANG, M., MAO, Z. M., AND BAHL, P. Automating network application dependency discovery: Experiences, limitations, and new solutions. In Proc. USENIX OSDI (2008).
7. CHOFFNES, D., AND BUSTAMANTE, F. Pitfalls for testbed evaluations of Internet systems. SIGCOMM Comput. Commun. Rev. 40, 2 (April 2010).
8. CHOFFNES, D. R., AND BUSTAMANTE, F. E. Taming the torrent: A practical approach to reducing cross-ISP traffic in peer-to-peer systems. In Proc. ACM SIGCOMM (2008).
9. COOKE, E., MORTIER, R., DONNELLY, A., BARHAM, P., AND ISAACS, R. Reclaiming network-wide visibility using ubiquitous endsystem monitors. In Proc. USENIX ATC (2006).
10. DASH, D., KVETON, B., AGOSTA, J. M., SCHOOLER, E., CHANDRASHEKAR, J., BACHARCH, A., AND NEWMAN, A. When gossip is good: Distributed probabilistic inference for detection of slow network intrusions. In Proc. AAAI (2006).
11. DISCHINGER, M., MARCON, M., GUHA, S., GUMMADI, K. P., MAHAJAN, R., AND SAROIU, S. Glasnost: Enabling end users to detect traffic differentiation. In Proc. USENIX NSDI (2010).
12. FEAMSTER, N., ANDERSEN, D., BALAKRISHNAN, H., AND KAASHOEK, M. F. Measuring the effect of Internet path faults on reactive routing. In Proc. ACM SIGMETRICS (2003).
13. IANNACCONE, G., NEE CHUAH, C., MORTIER, R., BHATTACHARYYA, S., AND DIOT, C. Analysis of link failures in an IP backbone. In Proc. ACM IMW (2002).
14. ISDAL, T., PIATEK, M., KRISHNAMURTHY, A., AND ANDERSON, T. Leveraging BitTorrent for end host measurements. In Proc. PAM (2007).
15. KANDULA, S., MAHAJAN, R., VERKAIK, P., AGARWAL, S., PADHYE, J., AND BAHL, P. Detailed diagnosis in enterprise networks. In Proc. ACM SIGCOMM (2009).
16. KATZ-BASSETT, E., MADHYASTHA, H. V., JOHN, J. P., KRISHNAMURTHY, A., WETHERALL, D., AND ANDERSON, T. Studying black holes in the Internet with Hubble. In Proc. USENIX NSDI (2008).
17. KEYNOTE. http://www.keynote.com/.
18. LABOVITZ, C., AHUJA, A., AND JAHANIAN, F. Experimental study of Internet stability and wide-area backbone failure. Tech. Rep. CSE-TR-382-98, U. of Michigan, 1998.
19. LAKHINA, A., CROVELLA, M., AND DIOT, C. Diagnosing network-wide traffic anomalies. In Proc. ACM SIGCOMM (2004).
20. MADHYASTHA, H. V., ISDAL, T., PIATEK, M., DIXON, C., ANDERSON, T., KIRSHNAMURTHY, A., AND VENKATARAMANI, A. iPlane: an information plane for distributed systems. In Proc. USENIX OSDI (2006).
21. MAHAJAN, R., WETHERALL, D., AND ANDERSON, T. Understanding BGP misconfiguration. In Proc. ACM SIGCOMM (2002).
22. MAHAJAN, R., ZHANG, M., POOLE, L., AND PAI, V. Uncovering performance differences among backbone ISPs with Netdiff. In Proc. USENIX NSDI (2008).
23. MAHIMKAR, A., GE, Z., SHAIKH, A., WANG, J., YATES, J., ZHANG, Y., AND ZHAO, Q. Towards automated performance diagnosis in a large IPTV network. In Proc. ACM SIGCOMM (2009).
24. MAYMOUNKOV, P., AND MAZIERES, D. Kademlia: A peer-to-peer information system based on the XOR metric. In Proc. IPTPS (2002).
25. MILLER, G. D. Programming techniques: An algorithm for the probability of the union of a large number of events. Commun. ACM 11, 9 (1968).
26. PADMANABHAN, V. N., RAMABHADRAN, S., AND PADHYE, J. NetProfiler: profiling wide-area networks using peer cooperation. In Proc. IPTPS (2005).
27. RABINOVICH, M., TRIUKOSE, S., WEN, Z., AND WANG, L. Dipzoom: The internet measurements marketplace. In Proc. IEEE INFOCOM (2006).
28. RINGBERG, H., SOULE, A., AND REXFORD, J. WebClass: adding rigor to manual labeling of traffic anomalies. SIGCOMM Comput. Commun. Rev. 38, 1 (2008).
29. ROUGHAN, M., GRIFFIN, T., MAO, Z. M., GREENBERG, A., AND FREEMAN, B. IP forwarding anomalies and improving their detection using multiple data sources. In Proc. of the ACM SIGCOMM workshop on Network troubleshooting (2004).
30. SCHULZE, H., AND MOCHALSKI, K. Internet study 2008/2009, 2009.
31. SHAVITT, Y., AND SHIR, E. DIMES: let the Internet measure itself. SIGCOMM Comput. Commun. Rev. 35, 5 (2005).
32. SIMPSON, JR, C. R., AND RILEY, G. F. Neti@home: A distributed approach to collecting end-to-end network performance measurements. In Proc. PAM (2004).
33. VON AHN, L. Human computation. In Proc. DAC (2009).
34. VUZE, INC. Vuze. http://www.vuze.com.
35. WU, J., MAO, Z. M., REXFORD, J., AND WANG, J. Finding a needle in a haystack: Pinpointing significant BGP routing changes in an IP network. In Proc. USENIX NSDI (2005).
36. ZHANG, M., ZHANG, C., PAI, V., PETERSON, L., AND WANG, R. PlanetSeer: Internet path failure monitoring and characterization in wide-area services. In Proc. USENIX OSDI (2004).
37. ZHANG, Y., MAO, Z. M., AND ZHANG, M. Effective diagnosis of routing disruptions from end systems. In Proc. USENIX NSDI (2008).