Enhanced monitoring-as-a-service for effective cloud management

IEEE Transactions on Computers

Volumn 62, Issue 9, 2013, Pages 1705-1720

  Meng, Shicong ^a   Liu, Ling ^a  

^a Georgia Institute of Technology   (United States)

Author keywords

Cloud monitoring; Monitoring service; Multitenancy; State monitoring; Violation likelihood

Indexed keywords

CLOUD MONITORING; MONITORING SERVICES; MULTI TENANCIES; STATE MONITORING; VIOLATION LIKELIHOOD;

COSTS; SCALABILITY;

MONITORING;

EID: 84881144407     PISSN: 00189340     EISSN: None     Source Type: Journal    
DOI: 10.1109/TC.2012.165     Document Type: Article

References (42)

1. B. Raghavan, K.V. Vishwanath, S. Ramabhadran, K. Yocum, and A.C. Snoeren, "Cloud Control with Distributed Rate Limiting," Proc. ACM SIGCOMM, pp. 337-348, 2007. (Pubitemid 350239796)
2. L. Raschid, H.F. Wen, A. Gal, and V. Zadorozhny, "Monitoring the Performance of Wide Area Applications Using Latency Profiles," Proc. Int'l Conf. World Wide Web (WWW '03), 2003.
3. G. Gu, R. Perdisci, J. Zhang, and W. Lee, "Botminer: Clustering Analysis of Network Traffic for Protocol- and Structure- Independent Botnet Detection," Proc. USENIX Security Symp., pp. 139-154, 2008.
4. G. Ren, E. Tune, T. Moseley, Y. Shi, S. Rus, and R. Hundt, "Google-Wide Profiling: A Continuous Profiling Infrastructure for Data Centers," IEEE Micro, vol. 30, no. 4, pp. 65-79, July 2010.
5. N. Jain, P. Mahajan, D. Kit, P. Yalagandula, M. Dahlin, and Y. Zhang, "Network Imprecision: A New Consistency Metric for Scalable Monitoring," Proc. Eighth USENIX Conf. Operating Systems Design and Implementation, pp. 87-102, 2008.
6. Amazon, CloudWatch, http://aws.amazon.com/cloudwatch/, 2013.
7. C. Estan and G. Varghese, "New Directions in Traffic Measurement and Accounting," Proc. ACM SIGCOMM, pp. 323-336, 2002. (Pubitemid 43843793)
8. "Ec2 Auto-Scaling,"Amazon, http://aws.amazon.com/autoscaling/, 2013.
9. "Cloudkick," Wikipedia, http://en.wikipedia.org/wiki/Cloudkick, 2012.
10. Cloudyn, http://cloudyn.com/how-it-works/under-the-hood, 2012.
11. M. Dilman and D. Raz, "Efficient Reactive Monitoring," Proc. IEEE INFOCOM, pp. 1012-1019, 2001. (Pubitemid 32478432)
12. R. Keralapura, G. Cormode, and J. Ramamirtham, "Communication- Efficient Distributed Monitoring of Thresholded Counts," Proc. ACM SIGMOD Int'l Conf. Management of Data (SIGMOD), 2006.
13. S. Agrawal, S. Deb, K.V.M. Naidu, and R. Rastogi, "Efficient Detection of Distributed Constraint Violations," Proc. Int'l Conf. Data Eng. (ICDE), pp. 1320-1324, 2007. (Pubitemid 47422147)
14. "1998 Worldcup Website Logs," http://www.acm.org/sigcomm/ITA/, 2013.
15. NTP, http://www.eecis.udel.edu/mills/ntp/html/index.html, 2013.
16. S. Meng, T. Wang, and L. Liu, "Monitoring Continuous State Violation in Datacenters: Exploring the Time Dimension," Proc. Int'l Conf. Data Eng. (ICDE), pp. 968-979, 2010.
17. S. Meng, A. Iyengar, I. Rouvellou, L. Liu, K. Lee, B. Palanisamy, and Y. Tang, "Reliable State Monitoring in Cloud Datacenters," Proc. IEEE Fifth Int'l Conf. Cloud Computing, 2012.
18. G. Grimmett and D. Stirzaker, Probability and Random Processes, third ed. Oxford Univ. Press, 2001.
19. D.E. Knuth, The Art of Computer Programming: Seminumerical Algorithms, third ed., vol. 2. Addison-Wesley, 1998.
20. S. Madden et al., "Tag: A Tiny Aggregation Service for Ad-Hoc Sensor Networks," Proc. Symp. Operating Systems Design and Implementation, pp. 131-146, 2002.
21. P. Yalagandula and M. Dahlin, "A Scalable Distributed Information Management System," Proc. ACM SIGCOMM, pp. 379-390, 2004. (Pubitemid 40954895)
22. S. Meng, S.R. Kashyap, C. Venkatramani, and L. Liu, "Remo: Resource-Aware Application State Monitoring for Large-Scale Distributed Systems," Proc. IEEE Int'l Conf. Distributed Computing Systems, pp. 248-255, 2009.
23. "Quartz," http://www.quartz-scheduler.org/, 2013.
24. B. White, J. Lepreau, L. Stoller, R. Ricci, S. Guruprasad, M. Newbold, M. Hibler, C. Barb, and A. Joglekar, "An Integrated Experimental Environment for Distributed Systems and Networks," Proc. Symp. Operating Systems Design and Implementation, Dec. 2002.
25. Y. Zhao, Y. Tan, Z. Gong, X. Gu, and M. Wamboldt, "Self- Correlating Predictive Information Tracking for Large-Scale Production Systems," Proc. Int'l Conf. Autonomic Computing, pp. 33-42, 2009.
26. L.L. Peterson, "Planetlab: Evolution vs. Intelligent Design in Planetary-Scale Infrastructure," Proc. USENIX Ann. Technical Conf., 2006.
27. Internet2, http://www.internet2.edu/observatory/archive, 2013.
28. L.A. Adamic and B.A. Huberman, "Zipfs Law and the Internet," Glottometrics, vol. 3, pp. 143-150, 2002.
29. C. Olston, J. Jiang, and J. Widom, "Adaptive Filters for Continuous Queries over Distributed Data Streams," Proc. ACM SIGMOD Int'l Conf. Management of Data (SIGMOD), pp. 563-574, 2003.
30. C. Olston and J. Widom, "Offering a Precision-Performance Tradeoff for Aggregation Queries over Replicated Data," Proc. Int'l Conf. Very Large Data Bases, pp. 144-155, 2000.
31. A. Silberstein, R. Braynard, and J. Yang, "Constraint Chaining: On Energy-Efficient Continuous Monitoring in Sensor Networks," Proc. ACM SIGMOD Int'l Conf. Management of Data (SIGMOD), pp. 157-168, 2006. (Pubitemid 46946510)
32. D. Chu, A. Deshpande, J.M. Hellerstein, and W. Hong, "Approximate Data Collection in Sensor Networks Using Probabilistic Models," Proc. Int'l Conf. Data Eng. (ICDE), p. 48, 2006. (Pubitemid 44539840)
33. R.Z. 0003, N. Koudas, B.C. Ooi, and D. Srivastava, "Multiple Aggregations over Data Streams," Proc. ACM SIGMOD Int'l Conf. Management of Data (SIGMOD), pp. 299-310, 2005. (Pubitemid 43038936)
34. S. Krishnamurthy, C. Wu, and M.J. Franklin, "On-the-Fly Sharing for Streamed Aggregation," Proc. ACM SIGMOD Int'l Conf. Management of Data (SIGMOD), pp. 623-634, 2006. (Pubitemid 46946545)
35. J. Li, D. Maier, K. Tufte, V. Papadimos, and P.A. Tucker, "No Pane, No Gain: Efficient Evaluation of Sliding-Window Aggregates over Data Streams," SIGMOD Record, vol. 34, no. 1, pp. 39-44, 2005. (Pubitemid 40750026)
36. S. Madden et al., "Continuously Adaptive Continuous Queries over Streams," Proc. ACM SIGMOD Int'l Conf. Management of Data (SIGMOD), pp. 49-60, 2002. (Pubitemid 34985535)
37. R. Huebsch et al., "Sharing Aggregate Computation for Distributed Queries," Proc. ACM SIGMOD Int'l Conf. Management of Data (SIGMOD), pp. 485-496, 2007. (Pubitemid 47630830)
38. R. Gupta and K. Ramamritham, "Optimized Query Planning of Continuous Aggregation Queries in Dynamic Data Dissemination Networks," Proc. Int'l Conf. World Wide Web (WWW), pp. 321-330, 2007. (Pubitemid 47582261)
39. N. Trigoni et al., "Multi-Query Optimization for Sensor Networks," Proc. Int'l Conf. Distributed Computing in Sensor Systems (DCOSS), pp. 307-321, 2005. (Pubitemid 41425125)
40. A. Silberstein and J. Yang, "Many-to-Many Aggregation for Sensor Networks," Proc. Int'l Conf. Data Eng. (ICDE), pp. 986-995, 2007. (Pubitemid 47422102)
41. S. Xiang, H.-B. Lim, K.-L. Tan, and Y. Zhou, "Two-Tier Multiple Query Optimization for Sensor Networks," Proc. 27th Int'l Conf. Distributed Computing Systems (ICDCS '07), p. 39, 2007.
42. R. Huebsch et al., "The Architecture of Pier: An Internet-Scale Query Processor," Proc. Biennial Conf. Innovative Data Systems Research (CIDR), pp. 28-43, 2005.