Project hoover: Auto-scaling streaming map-reduce applications

MBDS'12 - Proceedings of the 2012 Workshop on Management of Big Data Systems, Co-located with ICAC'12

Volumn , Issue , 2012, Pages 7-12

  Ramesh, Rajalakshmi ^a   Hu, Liting ^a   Schwan, Karsten ^a  

^a Georgia Institute of Technology   (United States)

Author keywords

Flume OG; Pastry; Queuing model; Scribe

Indexed keywords

DISTRIBUTED METHODS; EXPERIMENTAL EVALUATION; FLUME OG; LOG PRODUCTION; MAP-REDUCE; ON CURRENTS; ONLINE SOURCES; ONLINE-CONFIGURATIONS; PASTRY; QUEUING MODELS; REAL-TIME DATA PROCESSING; SCALE-DOWN; SCALE-UP; SCRIBE;

DATA PROCESSING; ELASTICITY; MIDDLEWARE;

INFORMATION MANAGEMENT;

EID: 84867726564     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2378356.2378359     Document Type: Conference Paper

References (15)

1. Amazon Cloudwatch. http://aws.amazon.com/cloudwatch/.
2. Cloudera Flume. https://github.com/cloudera/flume/.
3. Facebook Scribe. https://github.com/facebook/scribe/.
4. Ganglia Monitoring System. http://ganglia.sourceforge.net/.
5. http://hbase.apache.org/.
6. HDFS. http://hadoop.apache.org/hdfs/.
7. Jolokia. http://www.jolokia.org/.
8. Java Management Extensions (JMX) Technology. http://www.oracle.com/ technetwork/java/javase/tech/javamanagement-140525.html/.
9. Remote Method Invocation. http://www.oracle.com/technetwork/java/javase/ tech/index-jsp-136424.html/.
10. J. Boulon, A. Konwinski, R. Qi, A. Rabkin, E. Yang, and M. Yang. Chukwa: A Large Scale Monitoring System. Cloud Computing And Its Applications, 2008.
11. M. Castro, P. Druschel, A-M. Kermarrec and A. Rowstron, SCRIBE: A large-scale and decentralised application-level multicast infrastructure, IEEE Journal on Selected Areas in Communication (JSAC), Vol. 20, No, 8, October 2002.
12. L. Hu, K. D. Ryu, D. D. Silva, K. Schwan. v-Bundle: Flexible Resource Offerings in Clouds. In Proceedings of the 32nd IEEE ICDCS Conference, Macau, China, June 2012.
13. J. Kreps, N. Narkhede, J. Rao. Kafka: A Distributed Messaging System for Log Processing. NetDB workshop, 2011.
14. A. Rowstron and P. Druschel. Pastry: Scalable, distributed object location and routing for large-scale peer-to-peer systems. IFIP/ACM International Conference on Distributed Systems Platforms (Middleware), Heidelberg, Germany, pages 329-350, November, 2001.
15. C. Wang, K. Schwan, V. Talwar, G. Eisenhauer, L. Hu, M. Wolf. "A Flexible Architecture Integrating Monitoring and Analytics for Managing Large-Scale Data Centers." In Proceedings of the 8th International Conference on Autonomic Computing (ICAC 2011), June, 2011.