Resource bundles: Using aggregation for statistical large-scale resource discovery and management

IEEE Transactions on Parallel and Distributed Systems

Volumn 21, Issue 8, 2010, Pages 1089-1102

  Cardosa, Michael ^a   Chandra, Abhishek ^a  

^a University of Minnesota   (United States)

Author keywords

aggregation; machine learning; Resource discovery; resource management

Indexed keywords

APPLICATION FAILURE; APPLICATION REQUIREMENTS; DATA ANALYSIS; DISTRIBUTED SYSTEMS; HOT SPOT; LARGE SYSTEM; LEVEL CHARACTERISTIC; MACHINE-LEARNING; PLANETLAB; RESOURCE AGGREGATION; RESOURCE CAPACITY; RESOURCE DISCOVERY; RESOURCE HETEROGENEITY; RESOURCE MANAGEMENT; RESOURCE USAGE; STATISTICAL GUARANTEE; TRACE DRIVEN SIMULATION;

ADAPTIVE ALGORITHMS; DATA REDUCTION; KNOWLEDGE BASED SYSTEMS; LEARNING SYSTEMS; NATURAL RESOURCES MANAGEMENT; RESOURCE ALLOCATION; SCALABILITY; STATISTICAL METHODS; TRACE ANALYSIS;

GROUP TECHNOLOGY;

EID: 77954313784     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2009.143     Document Type: Article

References (30)

1. D. Anderson, "BOINC: A System for Public-Resource Computing and Storage," Proc. IEEE/ACM Int'l Workshop Grid Computing (GRID), 2004.
2. V. Lo, D. Zappala, D. Zhou, Y. Liu, and S. Zhao, "Cluster Computing on the Fly: P2P Scheduling of Idle Cycles in the Internet," Proc. IEEE Fourth Int'l Conf. Peer-to-Peer Systems, 2004.
3. Grid2: Blueprint for a New Computing Infrastructure, I. Foster and C. Kesselman, eds. M. Kauffman, 2004.
4. Y. Chawathe, S. Ratnasamy, L. Breslau, N. Lanham, and S. Shenker, "Making Gnutella Like P2P Systems Scalable," Proc. ACM SIGCOMM, Aug. 2003.
5. B. Cohen, "Incentives Build Robustness in Bittorrent," Proc. First Workshop the Economics of P2P Systems, June 2003.
6. S. Guha, N. Daswani, and R. Jain, "An Experimental Study of the Skype Peer-to-Peer Voip System," Proc. Int'l Workshop Peer-to-Peer Systems (IPTPS), 2006.
7. B. Chun, D. Culler, T. Roscoe, A. Bavier, L. Peterson, M. Wawrzoniak, and M. Bowman, "PlanetLab: An Overlay Testbed for Broad-Coverage Services," ACM SIGCOMM Computer Comm. Rev., vol.33, no.3, pp. 3-12, July 2003.
8. A. Iamnitchi and I. Foster, "On Fully Decentralized Resource Discovery in Grid Environments," Proc. IEEE/ACM Int'l Workshop Grid Computing (GRID), 2001.
9. D. Oppenheimer, J. Albrecht, D. Patterson, and A. Vahdat, "Distributed Resource Discovery on PlanetLab with SWORD," Proc. Workshop Real, Large Distributed Systems (WORLDS '04), Dec. 2004.
10. J.-S. Kim, P. Keleher, M. Marsh, B. Bhattacharjee, and A. Sussman, "Using Content-Addressable Networks for Load Balancing in Desktop Grids," Proc. Int'l Symp. High Performance Distributed Computing (HPDC '07), June 2007.
11. R. Raman, M. Livny, and M. Solomon, "Matchmaking: Distributed Resource Management for High Throughput Computing," Proc. Int'l Symp. High Performance Distributed Computing (HPDC '98), July 1998.
12. D. Oppenheimer, B. Chun, D. Patterson, A.C. Snoeren, and A. Vahdat, "Service Placement in a Shared Wide Area Platform," Proc. USENIX Ann. Technical Conf., June 2006.
13. P. Yalagandula and M. Dahlin, "A Scalable Distributed Information Management System," Proc. ACM SIGCOMM, 2004.
14. B. Chun, J.M. Hellerstein, R. Huebsch, P. Maniatis, and T. Roscoe, "Design Considerations for Information Planes," Proc. Workshop Real, Large Distributed Systems (WORLDS '04), Dec. 2004.
15. S. Zhong and J. Ghosh, "A Comparative Study of Generative Models for Document Clustering," Proc. SIAM Int'l Conf. Data Mining (SDM) Workshop Clustering High Dimensional Data and Its Applications, 2003.
16. K. Park and V.S. Pai, "Comon: A Mostly-Scalable Monitoring System for Planetlab," ACM SIGOPS Operating Systems Rev., vol.40, no.1, pp. 65-74, 2006.
17. J.M. Schopf, "A Practical Methodology for Defining Histograms for Predictions and Scheduling," NU technical report, 1999.
18. S. Zhong http://www.cse.fau.edu/~;zhong/software/index.htm, 2009.
19. "PeerSim," http://peersim.sourceforge.net, 2010.
20. B. Urgaonkar, P. Shenoy, and T. Roscoe, "Resource Overbooking and Application Profiling in Shared Hosting Platforms," Proc. Symp. Operating Systems Design and Implementation (OSDI '02), Dec. 2002.
21. T. Sandholm and K. Lai, "A Statistical Approach to Risk Mitigation in Computational Markets," Proc. Int'l Symp. High Performance Distributed Computing (HPDC), 2007.
22. A. Gupta, D. Agrawal, and A.E. Abbadi, "Distributed Resource Discovery in Large Scale Computing Systems," Proc. Int'l Symp. Applications and the Internet (SAINT), 2005.
23. Y.-S. Kee, D. Logothetis, R. Huang, H. Casanova, and A.A. Chien, "Efficient Resource Description and High Quality Selection for Virtual Grids," Proc. IEEE Int'l Symp. Cluster Computing and the Grid (CCGRID '05), pp. 598-606, 2005.
24. R.V. Renesse, K.P. Birman, and W. Vogels, "Astrolabe: A Robust and Scalable Technology for Distributed System Monitoring, Management, and Data Mining," ACM Trans. Computer Systems, vol.21, no.2, pp. 164-206, 2003.
25. J. Cappos and J.H. Hartman, "San Fermín: Aggregating Large Data Sets Using a Binomial Swap Forest," Proc. USENIX Symp. Networked Systems Design and Implementation (NSDI), 2008.
26. J. Mickens and B. Noble, "Exploiting Availability Prediction in Distributed Systems," Proc. USENIX Symp. Networked Systems Design and Implementation (NSDI '06), May 2006.
27. J. Rolia, X. Zhu, M. Arlitt, and A. Andrzejak, "Statistical Service Assurances for Applications in Utility Grid Environments," Technical Report HPL-2002-2155, HP Labs, 2002.
28. B. Urgaonkar, P. Shenoy, A. Chandra, and P. Goyal, "Dynamic Provisioning of Multi-Tier Internet Applications," Proc. Int'l Conf. Autonomic Computing (ICAC '05), 2005.
29. R. Wolski, "Experiences with Predicting Resource Performance Online in Computational Grid Settings," Proc. ACM SIGMETRICS '03, 2003.
30. "Network Weather Service," http://nws.cs.ucsb.edu/ewiki/, 2010.