Load shedding and distributed resource control of stream processing networks

Performance Evaluation

Volumn 64, Issue 9-12, 2007, Pages 1102-1120

  Feng, Hanhua ^a   Liu, Zhen ^b   Xia, Cathy H ^b   Zhang, Li ^b  

^a Columbia University ^*  (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Admission control; Distributed control; Resource allocation; Stream processing network; Utility maximization

Indexed keywords

ACCESS CONTROL; COMMUNICATION SYSTEMS; DISTRIBUTED PARAMETER CONTROL SYSTEMS; INFORMATION TECHNOLOGY; OPTIMIZATION; TELECOMMUNICATION TRAFFIC;

LOAD SHEDDING; STREAM PROCESSING NETWORKS; UTILITY MAXIMIZATION;

RESOURCE ALLOCATION;

EID: 34548133056     PISSN: 01665316     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.peva.2007.06.023     Document Type: Article

References (28)

1. D.J. Abadi, Y. Ahmad, M. Balazinska, U. Çetintemel, M. Cherniack, J.-H. Hwang, W. Lindner, A. Maskey, A. Rasin, E. Ryvkina, N. Tatbul, Y. Xing, S.B. Zdonik, The design of the Borealis stream processing engine, in: Proc. of CIDR, 2005, pp. 277-289
2. B. Awerbuch, F. Leighton, A simple local-control approximation algorithm for multicommodity flow, Proc. of FOCS, 1993, pp.459-468
3. B. Babcock, S. Babu, M. Datar, R. Motwani, Chain: Operator scheduling for memory minimization in data stream systems, in: Proc. of SIGMOD, 2003, pp. 253-264
4. B. Babcock, M. Datar, R. Motwani, Load shedding for aggregation queries over data streams, in: Proc. of ICDE Conf., 2004
5. Bazaraa M.S., Jarvis J.J., and Sherali H.D. Linear Programming and Network Flows (1977), John Wiley & Sons
6. J.A. Broberg, Z. Liu, C.H. Xia, L. Zhang, A multicommodity flow model for distributed streaming processing, in: Proc. of SIGMETRICS, 2006
7. L. Bui, A. Eryilmaz, R. Srikant, X. Wu, Joint asynchronous congestion control and distributed scheduling for multihop wireless networks, in: Proc. of INFOCOM, 2006
8. S. Chandrasekaran, M.J. Franklin, Remembrance of streams past: Overload-sensitive management of archived streams, in: Proc. of 30th VLDB Conf., 2004
9. L. Chen, K. Reddy, G. Agrawal, GATES: A gridbased middleware for processing distributed data streams, in: Proc. of HPDC, 2004
10. M. Cherniack, H. Balakrishnan, M. Balazinska, D. Carney, U. Çetintemel, Y. Xing, S. Zdonik, Scalable distributed stream processing, in: Proc. of CIDR, 2003
11. Dai J.G., and Lin W. Maximum pressure policies in stochastic processing networks. Operations Research 53 2 (2005) 197-218
12. Eryilmaz A., and Srikant R. Joint congestion control, routing and MAC for stability and fairness in wireless networks. IEEE Journal on Selected Areas in Communications 24 8 (2006) 1514-1524
13. Gibbons P.B., Karp B., Ke Y., Nath S., and Seshan S. IrisNet: An architecture for a world-wide sensor web. IEEE Pervasive Computing 2 4 (2003) 22-33
14. N. Jain, L. Amini, H. Andrade, R. King, Y. Park, P. Selo, C. Venkatramani, Design, implementation, and evaluation of the linear road benchmark on the stream processing core, in: Proc. of SIGMOD, 2006, pp. 431-442
15. Kelly F., Maulloo A., and Tan D. Rate control in communication networks: Shadow prices proportional fairness and stability. Journal of the Operational Research Society 49 3 (1998) 237-252
16. Khalil H. Nonlinear Systems. 3rd ed. (2002), Prentice Hall
17. X. Lin, N.B. Shroff, The impact of imperfect scheduling on crosslayer rate control in multihop wireless networks, in: Proc. of INFOCOM, 2005
18. Mo J., and Walrand J. Fair end-to-end window-based congestion control. IEEE/ACM Transactions on Networking 8 5 (2000) 556-567
19. R. Motwani, J. Widom, A. Arasu, B. Babcock, S. Babu, M. Datar, G. Manku, C. Olston, J. Rosenstein, R. Varma, Query processing, approximation, and resource management in a data stream management system, in: Proc. of CIDR, 2003
20. P. Pietzuch, J. Ledlie, J. Shneidman, M. Roussopoulos, M. Welsh, M. Seltzer, Network-aware operator placement for stream-processing systems, in: Proc. of ICDE Conf., 2006
21. Srikant R. The Mathematics of Internet Congestion Control (2004), Birkhauser, Boston, MA
22. U. Srivastava, K. Munagala, J. Widom, Operator placement for in-network stream query processing, in: Proc. of PODS, 2005, pp. 250-258
23. Stolyar A. Maximizing queueing network utility subject to stability: Greedy primal-dual algorithm. Queueing Systems: Theory and Applications 50 4 (2005) 401-457
24. Tassiulas L., and Ephremides A. Stability properties of constrained queueing systems and scheduling for maximum throughput in multihop radio networks. IEEE Transactions on Automatic Control 37 12 (1992) 1936-1949
25. N. Tatbul, U. Çetintemel, S. Zdonik, M. Cherniack, M. Stonebraker, Load shedding in a data stream manager, in: Proc. of 29th VLDB Conf., 2003, pp. 309-320
26. Y.C. Tu, S. Liu, S. Prabhakar, B. Yao, Load shedding in stream databases: A control-based approach, in: Proc. of 32th VLDB Conf., 2006, pp. 787-798
27. S. Viglas, J. Naughton, Rate-based query optimization for streaming information sources, in: Proc. of SIGMOD, 2002, pp. 37-48
28. Xiao L., Johansson M., and Boyd S. Simultaneous routing and resource allocation via dual decomposition. IEEE Transactions on Communications 52 7 (2004) 1136-1144