Network monitoring: Present and future

Computer Networks

Volumn 65, Issue , 2014, Pages 84-98

  Lee, Sihyung ^a   Levanti, Kyriaki ^b   Kim, Hyong S ^c  

^a Seoul Women University   (South Korea)

^b AMAZON   (United States)

^c CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Design; Management; Measurements; Monitoring; Network configuration

Indexed keywords

BUDGET CONTROL; DESIGN; DIGITAL STORAGE; MANAGEMENT; MEASUREMENT;

CURRENT BEHAVIORS; EFFICIENT MANAGEMENTS; EFFICIENT MONITORING; MANAGEMENT OPERATION; MANUAL OPERATIONS; NETWORK BEHAVIORS; NETWORK CONFIGURATION; NETWORK MONITORING;

MONITORING;

EID: 84898076824     PISSN: 13891286     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.comnet.2014.03.007     Document Type: Short Survey

References (122)

1. Evaluating high availability mechanisms, Agilent Technologies WhitePaper, 2005. < http://cp.literature.agilent.com/litweb/pdf/5989-4388EN.pdf > (accessed 12.08.13).
2. Network Lifecycle Management: A Solution Approach to Managing Networks, Hewlett-Packard, White Paper, October 2007.
3. A.A. Team, Summary of the Amazon EC2 and Amazon RDS Service Disruption in the US East Region, April 2011. < http://aws.amazon.com/ko/message/65648/ > (accessed 12.08.13).
4. M.A. Brown, T. Underwood, and E. Zmijewski The day the Youtube dies NANOG 43 2008 June
5. Z. Kerravala, As the Value of Enterprise Networks Escalates, so does the Need for Configuration Management, Enterprise Computing and Networking, Yankee Group, 2004.
6. A. Kind, X. Dimitropoulos, S. Denazis, and B. Claise Advanced network monitoring brings life to the awareness plane IEEE Commun. Mag. 46 10 2008 140 146
7. M. Steinder, and A.S. Sethi A survey of fault localization techniques in computer networks Elsevier Sci. Comput. Programming 53 2 2004 165 194
8. A. Pras, J. Schonwalder, M. Burgess, O. Festor, G.M. Perez, R. Stadler, and B. Stiller Key research challenges in network management IEEE Commun. Mag. 45 10 2007
9. J. Schonwalder, A. Pras, and J.P. Martin-Flatin On the future of internet management technologies IEEE Commun. Mag. 41 10 2003 90 97
10. M.J. Wright Using policies for effective network management Int. J. Network Manage 9 2 1999 118 125
11. R. Mahajan, D. wetherall, T. Anderson, Understanding BGP misconfigurations, in: Proc. ACM SIGCOMM, August 2002, pp. 3-16.
12. A. Feldmann, and J. Rexford IP network configuration for intradomain traffic-engineering IEEE Network Mag. 15 5 2001 46 57
13. N. Feamster, H. Balakrishnan, Detecting BGP configuration faults with static analysis, in: Proc. USENIX NSDI, May 2005, pp. 43-56.
14. S. Lee, T. Wong, and H.S. Kim NetPiler: detection of ineffective router configurations IEEE J. Sel. Areas Commun. Special Issue Network Inf. Conf. 27 3 2009 291 301
15. S. Lee, T. Wong, and H.S. Kim Improving manageability through reorganization of routing-policy configurations Elsevier Comput. Networks 56 14 2012 3192 3205
16. S. Lee, and H.S. Kim Correlation, visualization, and usability analysis of routing policy configurations IEEE Trans. Netw. Serv. Manage. 7 1 2010 28 41
17. K.G. Anagnostakis, M. Greenwald, R.S. Ryger, cing: measuring network-internal delays using only existing infrastructure, in: Proc. IEEE INFOCOM, March 2003, pp. 2112-2121.
18. Clink, < http://allendowney.com/research/clink/ > (accessed 12.08.13).
19. N. Hu, L. Li, Z.M. Mao, P. Steenkiste, J. Wang, Locating internet bottlenecks: algorithms, measurements, and implications, in: Proc. ACM SIGCOMM, October 2004, pp. 41-54.
20. R.S. Prasad, M. Murray, C. Dovrolis, and k. claffy Bandwidth estimation: metrics, measurement techniques, and tools IEEE Network Mag. 17 6 2003 27 35 November/December 2003
21. S. Saroiu, P.K. Gummadi, S.D. Gribble, Sprobe: a fast technique for measuring bottleneck bandwidth in uncooperative environments, in: Proc. IEEE INFOCOM, June 2002.
22. B. Floering, B. Brothers, Z. Kalbarczyk, R.K. Iyer, An adaptive architecture for monitoring and failure analysis of high-speed networks, in: Proc. IEEE/IFIP DSN, 2002.
23. G.L. dos Santos, V.T. Guimaraes, J.G. Silveira, A.T. Vieira, J.A. de Oliveira Neto, R.I.T. da Filho, R. Balbinot, UAMA: a unified architecture for active measurements in IP networks; End-to-end objective quality indicators, in: Proc. IEEE/IFIP IM, 2007.
24. M. Karsten, J. Schmitt, Packet marking for integrated load control, in: Proc. IEEE/IFIP IM, 2005.
25. R. Kompella, K. Levchenko, A.C. Snoeren, G. Varghese, Every microsecond counts: tracking fine-grain latencies with a lossy difference aggregator, in: Proc. ACM SIGCOMM, August 2009.
26. M.J. Luckie, A.J. McGregor, H. Braun, Towards improving packet probing techniques, in: Proc. ACM SIGCOMM IMW, 2001.
27. S. Machiraju, D. Veitch, A measurement-friendly network (MFN) architecture, in: Proc. ACM SIGCOMM Workshop on INM, 2006.
28. P. Papageorge, J. McCann, and M. Hicks Passive aggressive measurement with MGRP ACM SIGCOMM Comput. Commun. Rev. 39 4 2009 279 290
29. C. Estan, K. Keys, D. Moore, G. Varghese, Building a better NetFlow, in: Proc. ACM SIGCOMM, 2004.
30. E.A. Hernandez, M.C. Chidester, and A.D. George "Adaptive sampling for network management" J. Netw. Syst. Manage. 9 4 2001
31. C. Barakat, G. Iannaccone, C. Diot, Ranking flows from sampled traffic, in Proc. ACM CoNEXT, 2005.
32. RRDTool. < http://oss.oetiker.ch/rrdtool/ > (accessed 12.08.13).
33. N. Duffield, and M. Grossglauser Trajectory sampling with unreliable reporting IEEE/ACM Trans. Networking 16 1 2008 37 50
34. N.G. Duffield, and M. Grossglauser Trajectory sampling for direct traffic observation IEEE/ACM Trans. Networking 9 3 2001 280 292
35. V. Sekar, M.K. Reiter, W. Willinger, H. Zhang, R.R. Kompella, D.G. Andersen, CSAMP: a system for network-wide flow monitoring, in: Proc. USENIX NSDI, 2008.
36. A Simple Network Management Protocol (SNMP), RFC-1157, May 1990.
37. Network Configuration Protocol (NETCONF), RFC-6241, June 2011.
38. YANG - A Data Modeling Language for the Network Configuration Protocol (NETCONF), RFC-6020, October 2010.
39. CIM Standards, < http://www.dmtf.org/standards/cim/ > (accessed 12.08.13).
40. IP Flow Information Export (ipfix), < http://datatracker.ietf.org/wg/ ipfix/charter/ > (accessed 12.08.13).
41. C. Fraleigh, S. Moon, B. Lyles, C. Cotton, M. Khan, D. Moll, R. Rockell, T. Seely, and S.C. Diot Packet-level traffic measurements from the Sprint IP backbone IEEE Network Mag. 17 6 2003 6 16
42. Y. Lin, and M.C. Chan A scalable monitoring approach based on aggregation and refinement IEEE J. Sel. Areas Commun. 20 4 2002 677 690
43. M. Cheikhrouhou, J. Labetoulle, An efficient polling layer for SNMP, in: Proc. IEEE/IFIP NOMS, 2000.
44. D. Plonka, FlowScan: a network traffic flow reporting and visualization tool, in: Proc. USENIX LISA, 2000.
45. B. Trammell, C. Gates, NAF: the NetSA aggregated flow tool suite, in: Proc. USENIX LISA, 2006.
46. S. Romig, The OSU flow-tools package and CISCO NetFlow logs, in: Proc. USENIX LISA, 2000.
47. J. Sellens, Thresh - a data-directed SNMP threshold poller, in: Proc. USENIX LISA, 2000.
48. S.S. Kim, A.L. Reddy, NetViewer: a network traffic visualization and analysis tool, in: Proc. USENIX LISA, 2005.
49. R. Beverly, RTG: A Scalable SNMP Statistics Architecture for Service Providers, in: Proc. USENIX LISA, 2002.
50. A. Feldmann, A. Greenberg, C. Lund, N. Reingold, J. Rexford, and F. True Deriving traffic demands for operational IP networks: methodology and experience IEEE/ACM Trans. Networking 9 3 2001 265 279
51. A. Soule, A. Nucci, R.L. Cruz, E. Leonardi, and N. Taft Estimating dynamic traffic matrices by using viable routing changes IEEE/ACM Trans. Networking 15 3 2007 485 498
52. Y. Zhang, M. Roughan, W. Willinger, and L. Qiu Spatio-temporal compressive sensing and internet traffic matrices ACM SIGCOMM CCR 39 4 2009 267 278
53. M. Crovella, E. Kolaczyk, Graph wavelets for spatial traffic analysis, in: Proc. IEEE INFOCOM, 2003.
54. K. Papagiannaki, N. Taft, Z.L. Zhang, C. Diot, Long-term forecasting of Internet backbone traffic: observations and initial models, in: Proc. IEEE INFOCOM, 2003.
55. Y. Zhang, Z. Ge, Finding critical traffic matrices, in: Proc. IEEE/IFIP Dependable Systems and Networks, 2005.
56. H. Kim, K. Claffy, M. Fomenkov, D. Barman, M. Faloutsos, K. Lee, Internet traffic classification demystified: myths, caveats, and the best practices, in: Proc. ACM CONEXT, 2008.
57. A. Moore, K Papagiannaki, Toward the Accurate Identification of Network Applications, in: Proc. PAM, March 2001.
58. T.S. Choi, C.H. Kim, S. Yoon, J.S. Park, B.J. Lee, H.H. Kim, H.S. Chung, T.S. Jeong, Content-aware Internet application traffic measurement and analysis, in: Proc. IEEE/IFIP NOMS, 2004.
59. S. Sen, O. Spatscheck, D. Wang, Accurate, scalable in-network identification of p2p traffic using application signatures, in: Proc. WWW, 2004.
60. F. Risso, M. Baldi, O. Morandi, A. Baldini, P. Monclus, Lightweight, payload-based traffic classification: an experimental evaluation, in: Proc. IEEE ICC, 2008.
61. L. Bernaille, R. Teixeira, Early recognition of encrypted application, in: Proc. PAM, 2007.
62. T. Karagiannis, K. Papagiannaki, M. Faloutsos, BLINC: multilevel traffic classification in the dark, in: Proc. ACM SIGCOMM, 2005.
63. K. Xu, Z. Zhang, S. Bhattacharyya, Profiling internet backbone traffic: behavior models and applications, in: Proc. ACM SIGCOMM, 2005.
64. M. Iliofotou, P. Pappu, M. Faloutsos, M. Mitzenmacher, S. Singh, G. Varghese, Network monitoring using traffic dispersion graphs (tdgs), in: Proc. IMC, 2007.
65. T. Nguyen, and G. Armitage A survey of techniques for Internet traffic classification using machine learning IEEE Commun. Surv. Tutorials 10 4 2008 56 76
66. J. Zhang, Y. Xiang, Y. Wang, W. Zhou, Y. Xiang, and Y. Guan Network traffic classification using correlation information IEEE Trans. Parallel Distrib. Syst. 24 1 2013
67. Z. Li, R. Yuan, X. Guan, Accurate classification of the Internet traffic based on the SVM Method, in: Proc. IEEE ICC, 2007.
68. A.W. Moore, D. Zuev, Internet traffic classification using Bayesian analysis techniques, in: Proc. ACM SIGMETRICS, 2005.
69. C. Estan, S. Savage, G. Varghese, Automatically inferring patterns of resource consumption in network traffic, in: Proc. ACM SIGCOMM, 2003.
70. M. Baldi, E. Baralis, F. Risso, Data mining techniques for effective and scalable traffic analysis, in: Proc. IEEE/IFIP IM, 2005.
71. S. Kandula, R. Chandra, D. Katabi, What's going on? Learning communication rules in edge networks, in: Proc. ACM SIGCOMM, 2008.
72. R.R. Kompella, J. Yates, A. Greenberg, A.C. Snoeren, Detection and localization of network black holes, in: Proc. IEEE INFOCOM, 2007.
73. I. Cunha, R. Teixeira, N. Feamster, C. Diot, Measurement methods for fast and accurate blackhole identification with binary tomography, in: Proc. ACM IMC, 2009.
74. P. Bahl, R. Chandra, A. Greenberg, S. Kandula, D. Maltz, and M. Zhang Towards highly reliable enterprise network services via inference of multi-level dependencies ACM. SIGCOMM CCR 37 4 2007 13 24
75. S. Kandula, R. Mahajan, P. Verkaik, S. Agarwal, J. Padhye, and P. Bahl Detailed diagnosis in enterprise networks ACM SIGCOMM CCR 39 4 2009 243 254
76. A. Turner, H.S. Kim, T. Wong, Automatic discovery of relationships across multiple network layers, in: Proc. ACM SIGCOMM Workshop on INM, 2007.
77. A. Mahimkar, J. Yates, Y. Zhang, A. Shaikh, J. Wang, Z. Ge, C.T. Ee, Troubleshooting chronic conditions in large IP networks, in: Proc. ACM CONEXT, 2008.
78. R.R. Kompella, J. Yates, A. Greenberg, A.C. Snoeren, IP fault localization via risk modeling, in: Proc. USENIX NSDI, 2005.
79. S. Kandula, D. Katabi, J. Vasseur, Shrink: a tool for failure diagnosis in IP networks, in: Proc. ACM SIGCOMM MineNet, 2005.
80. X. Wu, D. Turner, C. Chen, D. A. Maltz, X. Yang, L. Yuan, M. Zhang, NetPilot: automating datacenter network failure mitigation, in: Proc. ACM SIGCOMM, August 2012.
81. C.J. Tengi, J.M. Roberts, J.R. Crouthamel, C.M. Miller, C.M. Sanchez, autoMAC: a tool for automating network moves, adds, and changes, in: Proc. USENIX LISA, November 2004.
82. J.R. Crouthamel, J.M. Roberts, C.M. Sanchez, C.J. Tengi, PatchMaker: a physical network patch manager tool, in: Proc. USENIX LISA, November 2004.
83. R.M. Oliveira, S. Lee, H.S. Kim, Automatic detection of firewall misconfigurations using firewall and network routing policies, in: IEEE DSN Workshop on Proactive Failure Avoidance, Recovery, and Maintenance (PFARM), Lisbon, Portugal, June 2009.
84. D. Caldwell, A. Gilbert, J. Gottlieb, A. Greenberg, G. Hjalmtysson, J. Rexford, The cutting EDGE of IP router configuration, in: Proc. Workshop on Hot Topics in Networks (HotNets), November 2003.
85. K. Levanti, H.S. Kim, T. Wong, NetPolis: Modeling of inter-domain routing policies, in: Proc. IEEE GLOBECOM, 2008.
86. M. Soni, V.R. Madduri, M. Gupta, P. De, Tracking configuration changes proactively in large IT environments, in: Proc. IEEE/IFIP NOMS, April 2012.
87. T. Oetiker, MRTG: the Multi Router Traffic Grapher, in: Proc. USENIX LISA, 1998.
88. SNAPP, < http://sourceforge.net/projects/snapp/ > (accessed 12.08.13).
89. J. Oberheide, M. Goff, M. Karir, Flamingo: visualizing internet traffic, in: Proc. IEEE/IFIP NOMS, 2006.
90. W. Yurcik, Visualizing NetFlows for security at line speed: the SIFT tool suite, in: Proc. USENIX LISA, 2005.
91. F. Fischer, F. Mansmann, D.A. Keim, S. Pietzko, M. Waldvogel, Large-scale network monitoring for visual analysis of attacks, in: Proc. IEEE Symposium on Visualization for Cyber Security (VizSec), 2008.
92. A. Yelizarov, D. Gamayunov, Visualization of complex attacks and state of attacked network, in: Proc. IEEE Symposium on Visualization for Cyber Security (VizSec), 2009.
93. B. Choi, S. Moon, R. Cruz, Z. Zhang, C. Diot, Practical delay monitoring for ISPs, in: Proc. ACM CONEXT, 2005.
94. A.G. Prieto, and R. Stadler A-GAP: an adaptive protocol for continuous network monitoring with accuracy objectives IEEE Trans. Netw. Serv. Manage. 4 1 2007 2 12
95. M. Dilman, and D. Raz Efficient reactive monitoring IEEE J. Sel. Areas Commun. 20 4 2002 668 676
96. J. Jiao, S. Naqvi, D. Raz, and B. Sugla Toward efficient monitoring IEEE J. Sel. Areas Commun. 18 5 2000 723 732
97. D. Breitgand, D. Dolev, D. Raz, G. Shaviner, Facilitating efficient and reliable monitoring through HAMSA, in: Proc. IEEE/IFIP IM, 2003.
98. Y. Bejerano, and R. Rastogi Robust monitoring of link delays and faults in IP networks IEEE/ACM Trans. Networking 14 5 2006 1092 1103
99. C. Chaudet, E. Fleury, I.G. Lassous, H. Rivano, M. Voge, Optimal positioning of active and passive monitoring devices, in: Proc. ACM CoNEXT, 2005.
100. L. Li, M. Thottan, B. Yao, S. Paul, Distributed network monitoring with bounded link utilization in IP networks, in: Proc. IEEE INFOCOM, 2003.
101. G. Huang, C. Chang, C. Chuah, and B. Lin Measurement-aware monitor placement and routing: a joint optimization approach for network-wide measurements IEEE Trans. Netw. Serv. Manage. 9 1 2012 48 59
102. Y. Choi, and I. Hwang In-service QoS monitoring of real-time applications using SM MIB Int. J. Network Manage. 15 1 2005 31 42
103. G.A. Winters, D.A. Muntz, and T.J. Teorey Using RMON matrix group extensions to analyze internetworking problems J. Netw. Syst. Manage. 6 2 1998 179 196
104. L. Yuan, C.-N. Chuah, P. Mohapatra, ProgME: towards programmable network measurement, in: Proc. ACM SIGCOMM, 2007.
105. P. de Meer, A. La Corte, A. Puliafito, and O. Tomarchio Programmable agents for flexible QoS management in IP networks IEEE J. Sel. Areas Commun. 18 2 2000 256 267
106. A. Liotta, G. Pavlou, and G. Knight Exploiting agent mobility for large-scale network monitoring IEEE Network Mag. 16 3 2002 3 15
107. N. Spring, D. Wetherall, T. Anderson, Scriptroute: a public internet measurement facility, in: Proc. USITS, 2002.
108. E.P. Duarte, M.A. Musicante, and H.H. Fernandes ANEMONA: a programming language for network monitoring applications Int. J. Network Manage. 18 4 2008
109. J. Francois, C. Wagner, R. State, T. Engel, SAFEM: scalable analysis of flows with entropic measures and SVM, in: Proc. IEEE/IFIP NOMS, April 2012.
110. N. Bonelli, A.D. Pietro, S. Giordano, G. Procissi, On multi-gigabit packet capturing with multi-core commodity hardware, in: Proc. PAM, 2012.
111. T. Samak, D. Gunter, V. Hendrix, Scalable analysis of network measurements with Hadoop and Pig, in: Proc. IEEE/IFIP NOMS, April 2012.
112. J. Dean, and S. Ghemawat Mapreduce: simplified data processing on large clusters Commun. ACM 51 1 2008 107 113
113. D. Simoncelli, M. Dusi, F. Gringoli, and S. Niccolini "Stream-monitoring with BlockMon: convergence of network measurements and data analytics platforms" ACM SIGCOMM CCR 43 2 2013 30 35 April 2013
114. L. Neumeyer, B. Robbins, A. Nair, A. Kesari, S4: distributed stream computing platform, in: Proc. IEEE International Conference on Data Mining Workshops (ICDMW), 2010.
115. Storm, < http://storm-project.net > (accessed 12.08.13).
116. S.A. Baset, L. Wang, C. Tang, Towards an understanding of oversubscription in cloud, in: Proceedings of USENIX Workshop on Hot Topics in Management of Internet, Cloud, and Enterprise Networks and Services (Hot-ICE), 2012.
117. P. Singh, M. Lee, S. Kumar, R.R. Kompella, Enabling flow-level latency measurements across routers in data centers, in: Proceedings of USENIX Hot-ICE, 2011.
118. S. Sarkar, R. Mahindru, R.A. Hosn, N. Vogl, H.V. Ramasamy, Automated incident management for a platform-as-a-service cloud, in: Proceedings of USENIX Hot-ICE, 2011.
119. H. Kang, X. Zhu, J.L. Wong, DAPA: diagnosing application performance anomalies for virtualized infrastructure, in: Proceedings of USENIX Hot-ICE, 2012.
120. F. Dinu, T.S. Eugene Ng, Synergy2Cloud: introducing cross-sharing of application experiences into the cloud management cycle, in: Proceedings of USENIX Hot-ICE, 2012.
121. B. Trammell, E. Boschi, L. Mark, T. Zseby, A. Wagner, Specification of the IP Flow Information Export (IPFIX) File Format, RFC-5655, October. 2009.
122. NANOG (North American Network Operators' Group) Mail List, < http://www.nanog.org/list > (accessed 16.12.13).