Modeling performance of a parallel streaming engine: Bridging theory and costs

ICPE 2013 - Proceedings of the 2013 ACM/SPEC International Conference on Performance Engineering

Volumn , Issue , 2013, Pages 173-184

  Bedini, Ivan ^a   Sakr, Sherif ^a   Theeten, Bart ^a   Sala, Alessandra ^a   Cogan, Peter ^a  

^a not available

Author keywords

distributed stream processing engine; measurement; performance model

Indexed keywords

BIG DATA; COSTS; DATA FLOW ANALYSIS; DATA TRANSFER; INFORMATION MANAGEMENT; PARALLEL ARCHITECTURES; STORMS;

ACTOR MODELS; DISTRIBUTED STREAM PROCESSING; DISTRIBUTED STREAM PROCESSING ENGINE; MODEL THEORY; MODELING PERFORMANCE; PERFORMANCE MODELING; STORM SYSTEMS; STREAM PROCESSING ENGINES; STREAMING DATA; STREAMING ENGINES;

DATA HANDLING;

EID: 84878195954     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2479871.2479895     Document Type: Conference Paper

References (27)

1. ABADI, D. J., ET AL. Aurora: A Data Stream Management System. In SIGMOD Conference (2003), p. 666.
2. ABADI, D. J., ET AL. The Design of the Borealis Stream Processing Engine. In CIDR (2005), pp. 277-289.
3. AGHA, G. Actors: a model of concurrent computation in distributed systems. MIT Press, Cambridge, MA, USA, 1986.
4. 3: Stream Processing on Main-Memory MapReduce. In ICDE (2012).
5. AMDAHL, G. M. Validity of the single processor approach to achieving large scale computing capabilities. In Proceedings of AFIPS '67, Spring Joint Computer Conference (1967), pp. 483-485.
6. BHATOTIA, P., ET AL. Incoop: MapReduce for Incremental Computations. In SOCC (2011).
7. CHERKASOVA, L. Performance modeling in mapreduce environments: challenges and opportunities. In ICPE (2011), pp. 5-6.
8. CLINGER, W. D. Foundations of Actor Semantics. Tech. rep., Cambridge, MA, USA, 1981.
9. CONDIE, T., ET AL. MapReduce Online. In NSDI (2010), pp. 313-328.
10. CUCINOTTA, T. Optimum scalability point for parallelisable real-time components. In Proceedings of SOMRES (2011).
11. DE GOOIJER, T., ET AL. An industrial case study of performance and cost design space exploration. In ICPE (2012), pp. 205-216.
12. DEAN, J., AND GHEMAWAT, S. MapReduce: Simplified Data Processing on Large Clusters. In OSDI (2004), pp. 137-150.
13. GEDIK, B., ET AL. Spade: the system s declarative stream processing engine. In SIGMOD Conference (2008), pp. 1123-1134.
14. GIURGIU, I. Understanding performance modeling for modular mobile-cloud applications. In ICPE (2012), pp. 259-262.
15. HERODOTOU, H., ET AL. MapReduce Programming and Cost-based Optimization? Crossing this Chasm with Starfish. PVLDB 4, 12 (2011), 1446-1449.
16. HERODOTOU, H., ET AL. Starfish: A Self-tuning System for Big Data Analytics. In CIDR (2011), pp. 261-272.
17. HEWITT, C. ORGs for Scalable, Robust, Privacy-Friendly Client Cloud Computing. IEEE Internet Computing 12, 5 (2008), 96-99.
18. HEWITT, C. ActorScript(TM): Industrial strength integration of local and nonlocal concurrency for Client-cloud Computing. CoRR abs/0907.3330 (2009).
19. HEWITT, C. Actor Model for Discretionary, Adaptive Concurrency. CoRR abs/1008.1459 (2010).
20. HEWITT, C., ET AL. A Universal Modular ACTOR Formalism for Artificial Intelligence. In IJCAI (1973), pp. 235-245.
21. LOESING, S., ET AL. Stormy: an elastic and highly available streaming service in the cloud. In EDBT/ICDT Workshops (2012), pp. 55-60.
22. MESEGUER, J., AND TALCOTT, C. L. A partial order event model for concurrent objects. In Proceedings of CONCUR (1999).
23. MÜHL, G., ET AL. Stochastic Analysis of Hierarchical Publish/Subscribe Systems. In Euro-Par (2009).
24. SACHS, K., ET AL. Benchmarking of message-oriented middleware. In DEBS (2009).
25. SACHS, K., ET AL. Performance evaluation of message-oriented middleware using the SPECjms2007 benchmark. Perform. Eval. 66, 8 (2009).
26. SAKR, S., ET AL. A Survey of Large Scale Data Management Approaches in Cloud Environments. IEEE Communications Surveys and Tutorials 13, 3 (2011), 311-336.
27. SCHRÖTER, A., ET AL. Stochastic performance analysis and capacity planning of publish/subscribe systems. In DEBS (2010).