State monitoring in cloud datacenters

IEEE Transactions on Knowledge and Data Engineering

Volumn 23, Issue 9, 2011, Pages 1328-1344

  Meng, Shicong ^a   Liu, Ling ^a   Wang, Ting ^a  

^a Georgia Institute of Technology   (United States)

Author keywords

aggregation; cloud; datacenter; distributed; State monitoring; tuning

Indexed keywords

COMMUNICATION COST; COMMUNICATION EFFICIENCY; DATA CENTERS; DATACENTER; DESIGN RATIONALE; DISTRIBUTED; DISTRIBUTED PARAMETER; EMPIRICAL STUDIES; ERROR RATE; GLOBAL INFORMATIONS; GLOBAL STATE; MONI-TORING NODES; MONITORING APPROACH; MONITORING PARAMETERS; OPTIMIZATION TECHNIQUES; PARAMETER-TUNING; PERFORMANCE OPTIMIZATIONS; STATE MONITORING; TECHNICAL CONTRIBUTION; TIME WINDOWS; USAGE MODELS; WINDOW-BASED;

ARCHITECTURAL DESIGN; COMMUNICATION; OPTIMIZATION; SCALABILITY;

MONITORING;

EID: 79960911439     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2011.70     Document Type: Article

References (26)

1. Amazon, "Amazon Elastic Computer Cloud(Amazon ec2)," 2008.
2. S. Bhatia, A. Kumar, M.E. Fiuczynski, and L.L. Peterson, "Lightweight, High-Resolution Monitoring for Troubleshooting Production Systems," Proc. Eighth USENIX Conf. Operating Systems Design and Implementation (OSDI), pp. 103-116, 2008.
3. N. Jain, M. Dahlin, Y. Zhang, D. Kit, P. Mahajan, and P. Yalagandula, "Star: Self-Tuning Aggregation for Scalable Monitoring," Proc. 33rd Int'l Conf. Very Large Data Bases (VLDB), 2007.
4. S. Mengy, S.R. Kashyap, C. Venkatramani, and L. Liu, "Remo: Resource-Aware Application State Monitoring for Large-Scale Distributed Systems," Proc. Int'l Conf. Distributed Computing Systems (ICDCS), 2009.
5. N. Jain, P. Mahajan, D. Kit, P. Yalagandula, M. Dahlin, and Y. Zhang, "Network Imprecision: A New Consistency Metric for Scalable Monitoring," Proc. Eighth USENIX Symp. Operating Systems Design and Implementation (OSDI), pp. 87-102, 2008.
6. B. Babcock and C. Olston, "Distributed Topk Monitoring," Proc. ACM SIGMOD Int'l Conf. Management of Data, 2003.
7. C. Olston, J. Jiang, and J. Widom, "Adaptive Filters for Continuous Queries over Distributed Data Streams," Proc. ACM SIGMOD Int'l Conf. Management of Data, 2003.
8. G. Cormode, M.N. Garofalakis, S. Muthukrishnan, and R. Rastogi, "Holistic Aggregates in a Networked World: Distributed Tracking of Approximate Quantiles," Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 25-36, 2005. (Pubitemid 43038914)
9. S. Krishnamurthy, C. Wu, and M.J. Franklin, "On-the-Fly Sharing for Streamed Aggregation," Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 623-634, 2006. (Pubitemid 46946545)
10. "Amazon Cloudwatch Beta," http://aws.amazon.com/cloudwatch/, 2011.
11. A. Bulut and A.K. Singh, "A Unified Framework for Monitoring Data Streams in Real Time," Proc. 21st Int'l Conf. Data Eng. (ICDE), 2005.
12. S. Madden, M.J. Franklin, J.M. Hellerstein, and W. Hong, "Tinydb: An Acquisitional Query Processing System for Sensor Networks," ACM Trans. Database Systems, vol. 30, no. 1, pp. 122-173, 2005. (Pubitemid 41201813)
13. A. Manjhi, S. Nath, and P.B. Gibbons, "Tributaries and Deltas: Efficient and Robust Aggregation in Sensor Network Streams," Proc. ACM SIGMOD Int'l Conf. Management of Data, 2005.
14. M. Li, Y. Liu, and L. Chen, "Non-Threshold Based Event Detection for 3D Environment Monitoring in Sensor Networks," Proc. Int'l Conf. Distributed Computing Systems (ICDCS '07), 2007.
15. A. Deligiannakis, V. Stoumpos, Y. Kotidis, V. Vassalos, and A. Delis, "Outlier-Aware Data Aggregation in Sensor Networks," Proc. IEEE 24th Int'l Conf. Data Eng. (ICDE), 2008.
16. L. Huang, M.N. Garofalakis, A.D. Joseph, and N. Taft, "Communication-Efficient Tracking of Distributed Cumulative Triggers," Proc. 27th Int'l Conf. Distributed Computing Systems (ICDCS), p. 54, 2007.
17. A. Silberstein, K. Munagala, and J. Yang, "Energy-Efficient Monitoring of Extreme Values in Sensor Networks," Proc. ACM SIGMOD Int'l Conf. Management of Data, 2006.
18. M. Dilman and D. Raz, "Efficient Reactive Monitoring," Proc. IEEE INFOCOM '01, 2001.
19. R. Keralapura, G. Cormode, and J. Ramamirtham, "Communication- Efficient Distributed Monitoring of Threshold Counts," Proc. ACM SIGMOD Int'l Conf. Management of Data, 2006.
20. I. Sharfman, A. Schuster, and D. Keren, "A Geometric Approach to Monitor Threshold Functions over Distributed Data Streams," Proc. ACM SIGMOD Int'l Conf. Management of Data, 2006.
21. S. Agrawal, S. Deb, K.V.M. Naidu, and R. Rastogi, "Efficient Detection of Distributed Constraint Violations," Proc. IEEE 23rd Int'l Conf. Data Eng. (ICDE), 2007.
22. S.R. Kashyap, J. Ramamirtham, R. Rastogi, and P. Shukla, "Efficient Constraint Monitoring Using Adaptive Thresholds," Proc. IEEE 24th Int'l Conf. Data Eng. (ICDE), 2008.
23. S. Meng, T. Wang, and L. Liu, "Monitoring Continuous State Violation in Datacenters: Exploring the Time Dimension," Proc. IEEE 26th Int'l Conf. Data Eng. (ICDE), 2010.
24. M. Arlitt and T. Jin, "1998 World Cup Website Access Logs," http://www.acm.org/sigcomm/ITA/,Aug. 1998.
25. L.A. Adamic and B.A. Huberman, "Zipfs Law and the Internet," Glottometrics, 2002.
26. A. Jain, J.M. Hellerstein, S. Ratnasamy, and D. Wetherall, "The Case for Distributed Triggers," Proc. ACM Workshop Hot Topics in Networks (HotNets), 2004.