Internet path behavior prediction via data mining: Conceptual framework and case study

Journal of Universal Computer Science

Volumn 13, Issue 2, 2007, Pages 287-316

  Borzemski, Leszek ^a  

^a WROCLAW UNIVERSITY OF TECHNOLOGY   (Poland)

Author keywords

Data mining; End to end performance; Grids; Internet performance; Knowledge management; Network behavior prediction

Indexed keywords

EID: 34147093596     PISSN: 0958695X     EISSN: 09486968     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (68)

1. Aberer, K., Alima, O., Ghodsi, A., Girdzijauskas, S., Haridi, S., Hauswirth, M.: "The Essence of P2P: A Reference Architecture for Overlay Networks"; P2P2005, The 5th IEEE International Conference on Peer-to-Peer Computing, Konstanz, Germany, (August 31-September 2, 2005).
2. Abusina, Z.U.M., Zabir, S.M.S., Asir, A., Chakraborty, D., Suganuma, T., Shiratori, N.: "An Engineering Approach to Dynamic Prediction of Network Performance from Application Logs"; Int. Network Mgmt 15(3) (2005), 151-162.
3. Andersen, D.G.: "Improving End-to-End Availability Using Overlay Networks"; Ph. D Dissertation, Massachusetts Institute of Technology, (February 2005).
4. Andersen, D., Balakrishnan, H., Kaashoek, F., Morris, R.: "Resilient Overlay Networks"; Proc. of 18th ACM Symp. on Operating Systems Principles, Banff, Canada (2001), 131-145.
5. Arlit, M., Krishnamurthy, B., Mogul, J.C.: "Predicting Short-Transfer Latency from TCP Arcane: A Trace-Based Validation"; Proc. of International Measurement Conference IMC'05. USENIX Association, Berkeley (2005), 119-124.
6. Avery, P., Foster, I.: "The GriPhyN Project: Towards Petascale Virtual-Data Grids"; GriPhyN TR2001-14, http://www.griphyn.org (2001).
7. Ballintijn, G., Van Steen, M., Tanenbaumn, A. S.: "Characterizing Internet Performance to Support Wide-Area Application Development"; Operating Systems Review, 34 (4) (2000), 41-47.
8. Baragoin, C., Andersen, C.M., Bayerl, S., Bent, G., Lee, J., Schommer, C.: "Mining Your Own Business in Telecoms Using DB2 Intelligent Miner for Data"; IBM Redbooks, SG24-6273-00 (2002).
9. Barford, P., Bestavros, A., Byers, J., Crovella, M.: "On the Marginal Utility of Network Topology Measurements"; ACM SIGCOMM Internet Measurement Workshop, San Francisco, ACM Press, New York (2001), 5-17.
10. Borzemski, L.: "Data Mining in Evaluation of Internet Path Performance"; Lecture Notes in Artificial Intelligence, Vol. 3029, Springer-Verlag Berlin (2004), 643-652.
11. Borzemski, L.: "Mining Internet Data Sets for Computational Grids"; Lecture Notes in Artificial Intelligence, Vol. 3683, Springer-Verlag, Berlin (2005), 268-274.
12. Borzemski, L.: "Testing, Measuring and Diagnosing Web Sites from the User's Perspective"; Intl J. of Enterprise Information Systems, 2(1) (2006), 54-66.
13. Borzemski, L.: "The Use of Data Mining to Predict Web Performance"; Cybernetics & Systems: An International Journal, 37(6), (September 2006), 587-608.
14. st KES Symposium on Agent and Multi-Agent Systems - Technologies and Applications, Lecture Notes in Artificial Intelligence, Springer-Verlag, Berlin (2007), to appear.
15. Borzemski, L., Nowak, Z.: "WING: A Web Probing, Visualization and Performance Analysis Service"; Lecture Notes in Computer Science. Vol. 3140. Springer-Verlag Berlin (2004), 601-602.
16. Borzemski, L., Nowak, Z.: "An Empirical Study of Web Quality: Measuring the Web from the Wroclaw University of Technology Campus"; Matera, M., Cornai, S. eds. Engineering Advanced Web Applications. Rinton Publishers, Princeton (2004), 307-320.
17. Borzemski, L., Nowak, Z.: "Using the Geographic Distance for Selecting the Nearest Agent in Intermediary-Based Access to Internet Resources"; Lecture Notes in Artificial Intelligence, Vol. 3683, Springer-Verlag, Berlin (2005), 261-267.
18. Breiman, L., Friedman, J.H., Olshen, R.A., Stone, C.J.: "Classification and Regression Trees"; Wadsworth International Group (1984).
19. Brownlee, N., Loosley, C.: "Fundamentals of Internet Measurement: A Tutorial"; Keynote Systems, USA (2001).
20. Cabena, P., Choi, H. H., Kim, I. S., Otsuka, S., Reinschmidt, J., Saarenvirta, G.: "Intelligent Miner for Data Application Guide"; IBM Redbooks, SG24-5252-00 (1999).
21. The Cooperative Association for Internet Data Analysis; http://www.caida.org/tools/taxonomy/performance.xml (2006).
22. Cardellini, V., Casalicchio, E., Colajanni, M., Yu, P.S.: "The State of the Art in Locally Distributed Web-Server Systems" ACM Computing Surveys, Vol. 34, No. 2, June (2002), 263-311.
23. Cavalcanti F., Belo, O.: "Improving Effectiveness of Web Sites Using Incremental Data Mining over Clickstreams"; Data Mining VI: Data Mining, Text Mining and their Business Applications, Vol. 35. Zanasi, A., Brebbia, C.A.,Ebecken, N. (eds.), WIT Press, Southampton (2005), 533-542.
24. Chakrabarti, S.: "Mining the Web: Analysis of Hypertext and Semi Structured Data". Morgan Kaufmann, San Francisco (2003).
25. Despotovic, Z., Aberer, K.: "Probabilistic Prediction of Peers' Performances in P2P Networks"; Lecture Notes in Computer Science. Vol. 3191. Springer-Verlag Berlin (2004), 62-76.
26. Eposito, F., Malerba, D., Semeraro, G.:"A Comparative Analysis of Methods for Pruning Decision Trees"; IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no 5, May (1997), 476-491.
27. Eswaradass, A., Sun, X-H., Wu, M.: "Network Bandwidth Predictor (NBP):A System for Online Network Performance Forecasting"; Proc. of Sixth IEEE Symposium on Cluster Computing and the Grid (CCGRID'06), IEEE CS Press, Los Alamitos (2006), 265-268.
28. Faloutsos, M., Faloutsos, Ch.: "Data-Mining the Internet: What We Know, What We Don't, and How We Can Learn More" Full day Tutorial ACM SIGCOMM 2002 Conference, Pittsburgh (2002).
29. Foster, I., Kesselman, C.: "Globus: A Metacomputing Infrastructure Toolkit"; Intl J. Super-computer Applications, 11(2), (1997), 115-128.
30. Foster I., Kesselman, C. (Eds.): "The Grid: Blueprint for a New Computing Infrastructure"; Second Edition, Morgan Kaufmann, Elsevier, San Francisco (2003).
31. Fürnkranz, J.: "Web Mining"; Maimon, O., Lior, R., eds. Data Mining and Knowledge Discovery Handbook. Springer-Verlag, Berlin (2005), 899-920.
32. http://www.gnutellahosts.com (2005).
33. Grossman, R. L., Kamath, Ch., Kegelmeyer, P., Kumar, V., Namburu, R. R. (Eds.): "Data Mining for Scientific and Engineering Applications"; Kluwer Academic Publishers, Boston, Dordrecht, London (2001).
34. Gummadi, K. P., Saroiu, S., Gribble, S. D.: "King: Estimating Latency between Arbitrary Internet End Hosts"; SIGCOMM Internet Measurement Workshop, Marseille, France, ACM Press, New York (2002), 5-18.
35. Han, J., Kamber, M.: "Data Mining: Concepts and Techniques"; The Morgan Kaufmann Series in Data Management Systems, Jim Gray, Series Editor, Morgan Kaufmann Publishers, San Francisco (2000).
36. He, Q., Dovrolis, C., Ammar, M.: "On the Predictability of Large Transfer TCP Throughput"; Proc. SIGCOMM'05. New York: ACM Press, New York (2005), 145-156.
37. Hellerstein, J., Zhang, F., Shahabuddin, P.: "A Statistical Approach to Predictive Detection"; Computer Networks 35 (2001), 77-95.
38. "GUI Guide for Data Mining"; United States Patent 6108004, http://www.freepatentsonline.com/6108004.html (2000).
39. IBM developerWorks: "Developing Grid Computing Applications and Web Services"; http://www-106.ibm.com/developerworks/ (2005).
40. "Using the Intelligent Miner for Data V8 Rel. 1"; IBM Redbooks, SH12-6394-00 (2002).
41. "Data Mining with Easy Mining procedures Version 8.2"; IBM Redbooks, SH12-6771-00 (2004).
42. Johnston, W. E.: "Computational and Data Grids in Large-Scale Science and Engineering"; LBNL and NASA Ames Research Center, Meeting of the Japanese National Research Grid Initiative project, Tokyo, Japan, http://www-itg.lbl.gov/~wej/ (2003).
43. Keynote Systems; http://www.keynote.com (2006).
44. King, R.D., Feng, C., Sutherland, A.:"Statlog: Comparison of Classification Algorithms on Large Real-World Problems"; Applied Artificial Intelligence, 9 (1995), 289-333.
45. Leese, M., Tyer, R., Tasker, R.: "Network Performance Monitoring for the Grid"; UK e-Science, 2005 All Hands Meeting (2005).
46. Luckie, M. J., McGregor, A. J., Braun, H.-W.: "Towards Improving Packet Probing Techniques" ACM SIGCOMM Internet Measurement Workshop, San Francisco, ACM Press, New York (2001), 145-150.
47. Mehta, M., Agrawal, R., Rissanen, J.: "SLIQ: A Fast Scalable Classifier for Data Mining"; Lecture Notes in Computer Science. Vol. 1057. Springer-Verlag Berlin (1996), 18-32.
48. Menzies, T,. Hu, Y.: "Data Mining for Very Busy People"; Computer October (2003), 18-25.
49. Mogul, J., "Clarifying the Fundamentals of HTTP"; Proc. of WWW11 Conference, Honolulu, ACM Press, New York (2002), 25-36.
50. Paxson, V.: "End-to-End Routing Behavior in the Internet"; IEEE/ACM Transactions on Networking, 5(5), (1997), 601-615.
51. Paxson, V.: "Strategies for Sound Internet Measurement"; Proc. ACM SIGCOMM Internet Measurement Conference, Taormina, Italy, ACM Press, New York (October 2004), 263-271.
52. Pisharath, J., Zambreno, J., Ozisikyilmaz, B., Choudhary, A.: "Accelerating Data Mining Workloads: Current Approaches and Future Challenges in System Architecture Design"; 9th International Workshop on High Performance and Distributed Mining, Bethesda April 22 (2006).
53. "Predictive Model Markup Language (PMML)"; Data Mining Group, http://www.dmg.org/ (2006).
54. Prasad,R. S., Murray, M., Dovrolis, C., Claffy, K.: "Bandwidth Estimation: Metrics, Measurement Techniques, and Tools", IEEE Network, November/December 17(6) (2003), 27-35.
55. Saroiu, S., Gummadi, K. P., Dunn, R. J., Gribble, S. D., Levy, H. M.: "An Analysis of Internet Content Delivery System" Proc. of the Fifth Symposium on Operating Systems Design and Implementation (OSDI2002), Boston (2002), 315-327.
56. [Schulz et al. 2001] Schulz, J., Hochberger, C., Tavangarian, D.: "Prediction of Communication Performance for Wide Area Computing Systems"; Proc. of Ninth Euromicro Workshop on Parallel and Distributed Processing (PDP'Ol), IEEE CS Press, Las Alamitos (2001), 480-486.
57. Stanford Linear Accelerator Center; http://www.slac.stanford.edu (2006).
58. Srikant, R., Yang, Y.: "Mining Web Logs to Improve Website Organization"; Proc. of WWW10 Conference, Hong Kong, ACM Press, New York (2001), 430-437.
59. Swany, M., Wolski, R.: "Multivariate Resource Performance Forecasting in the Network Weather Service"; Proceedings of the IEEE/ACM SC2002 Conference, Baltimore, ACM Press, New York (2002), 1-10.
60. Talia, D.:"Grid-Based Distributed Data Mining Systems, Algorithms and Services"; 9th International Workshop on High Performance and Distributed Mining, Bethesda April 22 (2006).
61. Tsuru, M., Oie, Y.: "Introduction to the Network Tomography"; GENESIS Technical Report IEICE Tech. Rep., IN2001-106 (2001).
62. Walid, G.A., Elfeky, M.G., Elmagarmid A.K.: " Incremental, Online, and Merge Mining of Partial Periodic Patterns in Time-Series Databases"; IEEE Trans. On Knowledge and Data Engineering, 16(2) (2004), 1-11.
63. Wang, M., Madhyastha, T., Chan, N.H., Papadimitriou, S., Faloutsos, C.: "Data Mining Meets Performance Evaluation: Fast Algorithms for Modeling Bursty Traffic"; Proc. of 18th International Conference on Data Engineering, San Jose, ACM Press, New York (2002), 507-516.
64. Williams, S.: "JANET Development Programme 2004-2005. Performance Measurement Overview"; www.ja.net/development/mm/ (2005).
65. Wolski, R.: "Dynamically Forecasting Network Performance Using the Network Weather Service"; Cluster Computing, 1(1) (1998), 119-132.
66. Yousaf, M. M., Welzl, M. "A Reliable Network Measurement and Prediction Architecture for Grid Scheduling"; 1st IEEE/IFIP International Workshop on Autonomic Grid Networking and Management AGNM'05, Barcelona (2005).
67. Zhang, H., Keahey, K., Allock W., "Providing Data Transfer with QoS as Agreement-Based Service"; Proc. IEEE International Conference on Services Computing SCC'04, (2004), 344-353.
68. Zhang, Y., Duffield, N., Paxson, V., Shenker, S.: "On the Constancy of Internet Path Properties"; ACM SIGCOMM Internet Measurement Workshop, San Francisco, ACM Press, New York (2001), 197-211.