Otus: Resource attribution in data-intensive clusters

MapReduce'11 - Proceedings of the 2nd International Workshop on MapReduce and Its Applications

Volumn , Issue , 2011, Pages 1-8

  Ren, Kai ^a   López, Julio ^a   Gibson, Garth ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

data intensive systems; metrics correlation; monitoring; resource attribution

Indexed keywords

APPLICATION PERFORMANCE; DATA-INTENSIVE APPLICATION; DATA-INTENSIVE SYSTEMS; DISTRIBUTED APPLICATIONS; DISTRIBUTED COMPONENTS; METRICS CORRELATION; MONITORING TOOLS; PERFORMANCE ANALYSIS; PERFORMANCE CHARACTERISTICS; PERFORMANCE METRICS; RESOURCE ATTRIBUTION; RESOURCE REQUIREMENTS; RESOURCE USAGE;

COBALT; DISTRIBUTED COMPUTER SYSTEMS; TIME SERIES ANALYSIS;

COBALT COMPOUNDS;

EID: 79961088461     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1996092.1996094     Document Type: Conference Paper

References (25)

1. Apache (ASF). Hadoop MapReduce and HDFS. http://hadoop.apache.org/core.
2. Apache (ASF). HBase. http://hbase.apache.org.
3. Sapan Bhatia et al. Lightweight, high-resolution monitoring for troubleshooting production systems. In OSDI, 2008.
4. Fay Chang et al. Bigtable: A distributed storage system for structured data. In OSDI, 2006.
5. Collectd: The system statistics collection daemon. http://collectd.org.
6. Gabriela F. Cretu-Ciocarlie et al. Hunting for problems with Artemis. In USENIX WASL, 2008.
7. Jeffrey Dean and Sanjay Ghemawat. MapReduce: Simplified data processing on large clusters. In OSDI, 2004.
8. Flume. https://github.com/cloudera/flume.
9. Rodrigo Fonseca et al. X-trace: A pervasive network tracing framework. In NSDI, 2007.
10. M. Isard and M. Budiu. Dryad: distributed data-parallel programs from sequential building blocks. In EuroSys, 2007.
11. Charles Loboz et al. DataGarage: Warehousing massive performance data on commodity servers. VLDB, 2010.
12. Matthew L. Massie et al. The Ganglia distributed monitoring system: Design, implementation and experience. Parallel Computing, 2003.
13. Tobi Oetiker. RRDTool. http://www.mrtg.org/rrdtool.
14. Christopher Olston et al. Pig latin: A not-so-foreign language for data processing. In SIGMOD, 2008.
15. Ariel Rabkin and Randy H. Katz. Chukwa: A large-scale monitoring system. In Cloud Computing and Its Applications (CCA), 2008.
16. Raja R. Sambasivan et al. Diagnosing performance changes by comparing system behaviours. In NSDI, 2011.
17. Scribe. https://github.com/facebook/scribe.
18. B. Sigelman et al. Dapper, a large-scale distributed systems tracing infrastructure. Technical report, Google, 2010.
19. StumbleUpon. OpenTSDB: Open time series database. http://opentsdb.net.
20. Tan et al. SALSA: Analysing logs as state machines. In USENIX Workshop on Analysis of System Logs, 2008.
21. Tan et al. Mochi: Visual log-analysis based tools for debugging Hadoop. In HotCloud, 2009.
22. Eno Thereska et al. Stardust: tracking activity in a distributed storage system. In SIGMETRICS, 2006.
23. Ashish Thusoo et al. Hive: A petabyte scale data warehouse using hadoop. In ICDE, 2010.
24. v. G. Pohl and M. Renner. Munin: Graphisches Netzwerk-und System-Monitoring. opensource press, 2008.
25. Wei Xu et al. Detecting large-scale system problems by mining console logs. In SOSP, 2009.