A mechanism for stream program performance recovery in resource limited compute clusters

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 7826 LNCS, Issue PART 2, 2013, Pages 164-178

  Dayarathna, Miyuru ^a   Suzumura, Toyotaro ^a,b  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

^b IBM RESEARCH   (United States)

Author keywords

Auto scaling; Automatic code generation; Autonomic computing; Data intensive computing; Highly availability; Performance; Reliability; Stream computing

Indexed keywords

AUTO-SCALING; AUTOMATIC CODE GENERATIONS; AUTONOMIC COMPUTING; DATA-INTENSIVE COMPUTING; PERFORMANCE; STREAM COMPUTING;

CONNECTORS (STRUCTURAL); DATABASE SYSTEMS; DISTRIBUTED PARAMETER CONTROL SYSTEMS; MIDDLEWARE; RELIABILITY;

APPLICATION PROGRAMS;

EID: 84892879556     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-37450-0_12     Document Type: Conference Paper

References (18)

1. Andrade, H., Gedik, B., Wu, K.-L., Yu, P.S.: Scale-up strategies for processing high-rate data streams in systems. In: IEEE 25th International Conference on Data Engineering, ICDE 2009, March 29-April 2, pp. 1375-1378 (2009)
2. Babcock, B., Datar, M., Motwani, R.: Load shedding in data stream systems. In: Data Streams, vol. 31, pp. 127-147. Springer US (2007)
3. Catley, C., et al.: A framework to model and translate clinical rules to support complex real-time analysis of physiological and clinical data. In: Proceedings of the 1st ACM International Health Informatics Symposium, IHI 2010, pp. 307-315. ACM, New York (2010)
4. Dayarathna, M., Suzumura, T.: Hirundo: a mechanism for automated production of optimized data stream graphs. In: Proceedings of the Third Joint WOSP/SIPEW International Conference on Performance Engineering, ICPE 2012, pp. 335-346. ACM, New York (2012)
5. Furht, B., Escalante, A.: Handbook of Cloud Computing. Springer-Verlag New York, Inc. (2010)
6. Gedik, B., et al.: Spade: the system s declarative stream processing engine. In: SIGMOD 2008, pp. 1123-1134. ACM, New York (2008)
7. Gu, Y., Zhang, Z., Ye, F., Yang, H., Kim, M., Lei, H., Liu, Z.: An empirical study of high availability in stream processing systems. In: Middleware 2009, pp. 23:1-23:9. Springer-Verlag New York, Inc., New York (2009)
8. Hwang, J.-H., Cetintemel, U., Zdonik, S.: Fast and highly-available stream processing over wide area networks, pp. 804-813 (April 2008)
9. Hwang, J.-H., et al.: High-availability algorithms for distributed stream processing. In: Proceedings of the 21st International Conference on Data Engineering, ICDE 2005, pp. 779-790. IEEE Computer Society, Washington, DC (2005)
10. IBM. Ibm infosphere streams version 1.2.1: Installation and administration guide (October 2010)
11. Ishii, A., Suzumura, T.: Elastic stream computing with clouds. In: 2011 IEEE International Conference on Cloud Computing (CLOUD), pp. 195-202 (July 2011)
12. Khandekar, R., Hildrum, K., Parekh, S., Rajan, D., Wolf, J., Wu, K.-L., Andrade, H., Gedik, B.: COLA: Optimizing stream processing applications via graph partitioning. In: Bacon, J.M., Cooper, B.F. (eds.) Middleware 2009. LNCS, vol. 5896, pp. 308-327. Springer, Heidelberg (2009)
13. Kleiminger, W., Kalyvianaki, E., Pietzuch, P.: Balancing load in stream processing with the cloud. In: Data Engineering Workshops (ICDEW), pp. 16-21 (April 2011)
14. Logothetis, D., Trezzo, C., Webb, K.C., Yocum, K.: In-situ mapreduce for log processing. In: USENIXATC 2011, Berkeley, CA, USA, p. 9. USENIX Association, Berkeley (2011)
15. Tanenbaum, A.S., Steen, M.V.: Distributed Systems. Pearson Education, Inc. (2007)
16. White, T.: Hadoop: The Definitive Guide. O'Reilly Media, Inc. (2010)
17. Wolf, J., et al.: Soda: an optimizing scheduler for large-scale stream-based distributed computer systems. In: Middleware 2008, pp. 306-325. Springer-Verlag New York, Inc., New York (2008)
18. Zhang, Z., et al.: A hybrid approach to high availability in stream processing systems. In: Distributed Computing Systems (ICDCS), pp. 138-148 (June 2010)