Resource allocation for multiple concurrent in-network stream-processing applications

Parallel Computing

Volumn 37, Issue 8, 2011, Pages 331-348

  Benoit, Anne ^a   Casanova, Henri ^b   Rehn Sonigo, Veronika ^c   Robert, Yves ^a  

^a UNIVERSITÉ DE LYON   (France)

^b UNIVERSITY OF HAWAII   (United States)

^c INP Grenoble ENSIMAG   (France)

Author keywords

In network stream processing; Multiple concurrent applications; Operator mapping; Polynomial heuristics; Trees of operators

Indexed keywords

COMPLEXITY RESULTS; DATA SETS; IN-NETWORK STREAM-PROCESSING; INTEGER LINEAR PROGRAMS; INTERMEDIATE RESULTS; MAPPING OPERATORS; MAPPING PROBLEM; MULTIPLE CONCURRENT APPLICATIONS; NP-HARD; OPERATOR MAPPING; POLYNOMIAL TIME HEURISTICS; STEADY STATE MODE; SUBTREES; TREES OF OPERATORS;

DISTRIBUTED COMPUTER SYSTEMS; INTEGER PROGRAMMING; MAPPING; PLANT EXTRACTS;

COMPUTER RESOURCE MANAGEMENT;

EID: 79960561111     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.parco.2010.09.005     Document Type: Conference Paper

References (29)

1. Diagrams of all experiments. Available from: .
2. Source code for the heuristics. Available from: .
3. D.J. Abadi, Y. Ahmad, M. Balazinska, U. Cetintemel, M. Cherniack, J.-H. Hwang, W. Lindner, A.S. Maskey, A. Rasin, E. Ryvkina, N. Tatbul, Y. Xing, S. Zdonik, The Design of the borealis stream processing Engine, in: Second Biennial Conference on Innovative Data Systems Research (CIDR 2005), Asilomar, CA, January 2005.
4. S. Babu, and J. Widom Continuous queries over data streams SIGMOD Record 30 3 2001
5. B. Badcock, S. Babu, M. Datar, R. Motwani, J. Widom, Models and issues in data stream systems, in: Proceedings of the International Conference on Very Large Data Bases, pp. 456-467, 2004.
6. A. Benoit, H. Casanova, V. Rehn-Sonigo, Y. Robert, Resource allocation strategies for constructive in-network stream processing, in: Proceedings of APDCM'09, the 11th Workshop on Advances in Parallel and Distributed Computational Models, IEEE, 2009.
7. P. Bonnet, J. Gehrke, P. Seshadri, Towards sensor database systems, in: Proceedings of the Conference on Mobile Data Management, 2001.
8. J. Chen, D. DeWitt, F. Tian, Y. Wang, NiagaraCQ: a scalable continuous query system for internet databases, in: Proceedings of the SIGMOD International Conference on Management of Data, pp. 379-390, 2000.
9. J. Chen, D.J. DeWitt, J.F. Naughton, Design and evaluation of alternative selection placement strategies in optimizing continuous queries, in: Proceedings of ICDE, 2002.
10. L. Chen, K. Reddy, G. Agrawal, GATES: a grid-based middleware for processing distributed data streams, High performance distributed computing, in: Proceedings. 13th IEEE International Symposium on, pp. 192-201, 4-6 June, 2004.
11. M. Cherniack, H. Balakrishnan, M. Balazinska, D. Carney, U. Cetintemel, Y. Xing, S. Zdonik, Scalable distributed stream processing, in: Proc. of the CIDR Conference, January 2003.
12. E. Cooke, R. Mortier, A. Donnelly, P. Barham, R. Isaacs, Reclaiming network-wide visibility using ubiquitous end system monitors, in: Proceedings of the USENIX Annual Technical Conference, 2006.
13. Ilog cplex: high-performance software for mathematical programming and optimization. Available from: .
14. C. Cranor, Y. Gao, T. Johnson, V. Shkapenyuk, O. Spatscheck, Gigascope: high-performance network monitoring with an SQL interface, in: Proceedings of the ACM SIGMOD International Conference on Management of Data, pp. 623-633, 2002.
15. M.R. Garey, and D.S. Johnson Computers and Intractability Guide to the Theory of NP-Completeness 1979 W.H. Freeman and Company
16. B. Hong, V. Prasanna, Distributed adaptive task allocation in heterogeneous computing environments to maximize throughput, in: International Parallel and Distributed Processing Symposium IPDPS'2004, IEEE Computer Society Press, 2004.
17. R. Huebsch, J.M. Hellerstein, N.L. Boon, T. Loo, S. Shenker, I. Stoica, Querying the Internet with PIER, September 2003.
18. Y.E. Ioannidis Query optimization ACM Computing Surveys 28 1 1996 121 123 (Pubitemid 126499040)
19. J. Kräme, B. Seeger, A temporal foundation for continuous queries over data streams, in: Proceedings of the International Conference on Management of Data, pages 70-82, 2005.
20. L. Liu, C. Pu, and W. Tang Continual queries for internet scale event-driven information delivery IEEE Transactions on Knowledge and Data Engineering 11 4 1999 610 628 (Pubitemid 30517119)
21. D. Logothetis K. Yocum, Wide-scale data stream management, in: Proceedings of the USENIX Annual Technical Conference, 2008.
22. S. Madden, M. Franklin, J. Hellerstein, W. Hong, The design of an acquisitional query processor for sensor networks, in: Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data, pp. 491-502, 2003.
23. S. Nath, A. Deshpande, Y. Ke, P.B. Gibbons, B. Karp, S. Seshan, IrisNet: An Architecture for Internet-scale Sensing Services.
24. V. Pandit, H. Ji, Efficient in-network evaluation of multiple queries, in: HiPC, pp. 205-216, 2006.
25. P. Pietzuch, J. Leflie, J. Shneidman, M. Roussopoulos, M. Welsh, M. Seltzer, Network-aware operator placement for stream-processing systems, in: Proceedings of the 22nd International Conference on Data Engineering (ICDE'06), pp. 49-60, 2006.
26. B. Plale, and K. Schwan Dynamic querying of streaming data with the dQUOB system IEEE Transactions on Parallel and Distributed Systems 14 4 2003 422 432
27. V. Rehn-Sonigo, Multi-criteria Mapping and Scheduling of Workflow Applications onto Heterogeneous Platforms, PhD thesis, École Normale Supérieure de Lyon and Universität Passau, 2009.
28. U. Srivastava, K. Munagala, J. Widom, Operator placement for in-network stream query processing, in: Proceedings of the 24th ACM International Conference on Principles of Database Systems, pp. 250-258, 2005. (Pubitemid 43275487)
29. R. van Rennesse, K. Birman, D. Dumitriu, W. Vogels, Scalable management and data mining using astrolabe, in: Proceedings from the First International Workshop on Peer-to-Peer Systems, pp. 280-294, 2002.