Optimizing data aggregation for cluster-based internet services

Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPOPP

Volumn , Issue , 2003, Pages 119-130

  Chu, Lingkun ^a   Tang, Hong ^a   Yang, Tao ^a   Shen, Kai ^b  

^a University of California   (United States)

^b University of Rochester   (United States)

Author keywords

Cluster based network services; Fault tolerance; Load adaptive tree formation; Response time; Scalable data aggregation; Throughput

Indexed keywords

COMPUTER SIMULATION; DATA TRANSFER; FAULT TOLERANT COMPUTER SYSTEMS; THROUGHPUT;

DATA AGGREGATION;

INTERNET;

EID: 0038378384     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/781498.781517     Document Type: Conference Paper

References (26)

1. S. F. Altschul, W. Gish, W. Miller, E. W. Myers, and D. J. Lipman. Basic Local Alignment Search Tool. Journal of Molecular Biology, 215:403-410, 1990.
2. D. Andresen, T. Yang, V. Holmedahl, and O. Ibarra. SWEB: Towards a Scalable WWW Server on MultiComputers. In Proc. of the 10th IEEE Intl. Parallel Processing Symposium, Honolulu, HI, Apr. 1996.
3. M. Banikazemi, V. Moorthy, and D. K. Panda. Efficient Collective Communication on Heterogeneous Networks of Workstations. In Proc. of International Conference on Parallel Processing, 1998.
4. C. Chang, T. Kurc, A. Sussman, U. Catalyurek, and J. Saltz. A hypergraph-based workload partitioning strategy for parallel data aggregation. In SIAM PPSC, Portsmouth, Virginia, Mar. 2001.
5. A. Fox and E. A. Brewer. Harvest, Yield, and Scalable Tolerant Systems. In Proc. of HotOS-VII, Rio Rico, AZ, Mar. 1999.
6. A. Fox, S. D. Gribble, Y. Chawathe, E. A. Brewer, and P. Gauthier. Cluster-Based Scalable Network Services. In ACM SOSP, Saint Malo, Oct. 1997.
7. S. D. Gribble, M. Welsh, E. A. Brewer, and D. Culler. The MultiSpace: An Evolutionary Platform for Infrastructural Services. In USENIX Annual Technical Conf., Monterey, CA, June 1999.
8. W. Gropp, E. Lusk, N. Doss, and A. Skjellum. A High-performance, Portable Implementation of the MPI Message Passing Interface Standard. Parallel Computing, 22(6):789-828, Sept. 1996.
9. N. T. Karonis, B. R. de Supinski, I. Foster, W. Gropp, E. Lusk, and J. Bresnahan. Exploiting hierarchy in parallel computer networks to optimize collective operation performance. In Proceedings of the 14th International Parallel and Distributed Processing Symposium (IPDPS'2000), Cancun, Mexico, May 2000.
10. T. Kielmann, R. F. H. Hofman, H. E. Bal, A. Plaat, and R. A. F. Bhoedjang. MagPIe: MPI's collective communication operations for clustered wide area systems. In ACM PPoPP. ACM, May 1999.
11. S. R. Madden, M. J. Franklin, J. M. Hellerstein, and W. Hong. Tag: a tiny aggregation service for ad-hoc sensor networks. In OSDI, Boston, MA, Dec. 2002.
12. M. Mitzenmacher. On the Analysis of Randomized Load Balancing Schemes. In Proc. of the 9th ACM Symposium on Parallel Algorithms and Architectures, pages 292-301, Newport, RI, June 1997.
13. V. S. Pai, M. Aron, G. Banga, M. Svendsen, P. Druschel, W. Zwaenepoel, and E. Nahum. Locality-Aware Request Distribution in Cluster-based Network Servers. In ACM ASPLOS, San Jose, CA, Oct. 1998.
14. V. S. Pai, P. Druschel, and W. Zwaenepoel. Flash: An Efficient and Portable Web Server, In Proc. of 1999 Annual USENIX Technical Conf., Monterey, CA, June 1999.
15. Y. Saito, B. N. Bershad, and H. M. Levy. Manageability, Availability, and Performance in Porcupine: a Highly Scalable, Cluster-based Mail Service. In ACM SOSP, Charleston, SC, Dec. 1999.
16. A. Shatdal and J. F. Naughton. Adaptive parallel aggregation algorithms. In ACM SIGMOD, San Jose, CA, USA, May 1995.
17. K. Shen, H. Tang, T. Yang, and L. Chu. Integrated Resource Management for Cluster-based Internet Services. In Proc. of the 5th USENIX Symposium on Operating Systems Design and Implementation, Boston, MA, Dec. 2002.
18. K. Shen, T. Yang, and L. Chu. Cluster Load Balancing for Fine-grain Network Services. In Proc. of International Parallel & Distributed Processing Symposium, Fort Lauderdale, FL, Apr. 2002.
19. K. Shen, T. Yang, L. Chu, J. L. Holliday, D. A. Kuschner, and H. Zhu. Neptune: Scalable Replication Management and Programming Support for Cluster-based Network Services. In USITS, San Francisco, CA, Mar. 2001.
20. M. Snir, S. Otto, S. Huss-Lederman, D. Walker, and J. Dongarra. MPI: The Complete Reference. MIT Press, 1996.
21. H. Tang and T. Yang. Optimizing Threaded MPI Execution on SMP Clusters. In Proc. of 15th ACM International Conference on Supercomputing, Naples, Italy, June 2001.
22. M. Turk and A. Pentland. Eigenfaces for recognition. Journal of Neuroscience, 3(1):71-86, 1991.
23. WebLogic and Tuxedo Transaction Application Server White Papers. http://www.bea.com/products/tuxedo/papers.html.
24. J. R. von Behren, E. A. Brewer, N. Borisov, M. Chen, M. Welsh, J. MacDonald, J. Lau, S. Gribble, and D. Culler. Ninja: A Framework for Network Services. In Proc. of 2002 Annual USENIX Technical Conf., Monterey, CA, June 2002.
25. M. Welsh, D. Culler, and E. Brewer. SEDA: An Architecture for Well-Conditioned, Scalable Internet Services. In ACM SOSP, Banff, Canada, Oct. 2001.
26. S. Zhou. An Experimental Assessment of Resource Queue Lengths as Load Indices. In Proc. of the Winter USENIX Technical Conf., pages 73-82, Washington, DC, Jan. 1987.