Dynamic load distribution in the borealis stream processor

Proceedings - International Conference on Data Engineering

Volumn , Issue , 2005, Pages 791-802

  Xing, Ying ^a   Zdonik, Stan ^a   Hwang, Jeong Hyon ^a  

^a BROWN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LOAD DISTRIBUTION; STREAM PROCESSING SYSTEMS;

DYNAMIC LOADS; OPTIMIZATION; PARALLEL PROCESSING SYSTEMS; QUERY LANGUAGES;

PROGRAM PROCESSORS;

EID: 28444458432     PISSN: 10844627     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDE.2005.53     Document Type: Conference Paper

References (20)

1. D. Abadi, Y. Ahmad, H. Balakrishnan, M. Balazinska, U. Cetintemel, M. Cherniack, J. Hwang, J. Jannotti, W. Lindner, S. Madden, A. Rasin, M. Stonebraker, N. Tatbul, Y. Xing, S. Zdonik, The Design of the Borealis Stream Processing Engine. In Proc. of the Second Biennial Conference on Innovative Data Systems Research (CIDR), Jan. 2005.
2. D. Abadi, D. Carney, U. Cetintemel, M. Cherniack, C. Convey, S. Lee, M. Stonebraker, N. Tatbul and Stan Zdonik. Aurora: A New Model and Architecture for Data Stream Management. VLDE Journal, Sep. 2003.
3. A. Adas, Traffic models in broadband networks. IEEE Communications, 35(7):82-89, July 1997.
4. M. Balazinska, H. Balakrishnan, and M. Stonebraker. Contract-based load management in federated distributed systems. In USENIX Symposium on Net-worked Systems Design and Implementation (NSDI), March 2004.
5. S. Chandrasekaran, A. Deshpande, M. Franklin, J. Hellerstein, W. Hong, S. Krishnamurthy, S. Madden, V. Raman, F. Reiss, and M. Shah. TelegraphCQ: Continuous dataflow processing for an uncertain world. In Proc. of the CIDR Conference, Jan. 2003.
6. M. Cherniack, H. Balakrishnan, M. Balazinska, D. Carney, U. Cetintemel, Y. Xing and S. Zdonik. Scalable Distributed Stream Processing. In Proc. of the CIDR Conference, 2003.
7. R. Diekmann, B. Monien, and R. Preis, Load balancing strategies for distributed memory machines. Multi-Scale Phenomena and Their Simulation, 255-266. World Scientific, 1997
8. A. Foong, T. Huff, H. Hum, J. Patwardhan, G. Regnier, TCP performance re-visited. In Proc. of IEEE Intl Symposium on Performance of Systems and Software, March 2003.
9. A. Gallatin, J. Chase, and K. Yocum, Trapeze/IP: TCP/IP at near-gigabit speeds. In Proc. of USENIX Technical Conference, June 1999.
10. M. R. Garey and D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, Freeman, New York, 1979.
11. D. Gupta and P. Bepari, Load sharing in distributed systems, In Proc. of the National Workshop on Distributed Computing, January 1999.
12. Mesquite Software, Inc. CSIM 18 Simulation Engine. http://www.mesquite. com/
13. R. Motwani, J. Widom, A. Arasu, B. Babcock, S. Babu, M. Datar, G. Manku, C. Olston, J. Rosenstein, and R. Varma. Query processing, approximation, and resource management in a data stream management system. In Proc. of the CIDR Conference, 2003.
14. M.A. Shah, J.M. Hellerstein, S. Chandrasekaran, and M.J. Franklin. Flux: An Adaptive Partitioning Operator for Continuous Query Systems. In Proc. of the ICDE Conference, pages 25-36, 2003.
15. K. Schloegel, George Karypis and Vipin Kumar. Graph Partitioning for High Performance Scientific Simulations. CRPC Parallel Computing Handbook. Morgan Kaufmann, 2000.
16. B. A. Shirazi, A. R. Hurson, and K. M. Kavi. Scheduling and load balancing in parallel and distributed systems. IEEE Computer Science Press, 1995.
17. C. Walshaw, M. Cross, and M. G. Everett, Dynamic load balancing for parallel adaptive unstructured meshes. Parallel Processing for Scientific Computing, 1997. 10
18. W. Willinger, M.S. Taqqu, R. Sherman, and D.V. Wilson, Self-similarity through high variability: statistical analysis of Ethernet LAN traffic at the source level. IEEE/ACM Transactions on Networking, 5(1):71-86, 1997.
19. Ying Xing. Load Distribution for Distributed Stream Processing. In Proc. of the ICDE Ph.D. Workshop, 2004.
20. C. Xu, B. Monien, R. Luling, and F. Lau. Nearest neighbor algorithms for load balancing in parallel computers. Concurrency: Practice and Experience, 9(12):1351-1376, 1997.