TideWatch: Fingerprinting the cyclicality of big data workloads

Proceedings - IEEE INFOCOM

Volumn , Issue , 2014, Pages 2031-2039

  Williams, Dan ^a   Zheng, Shuai ^b   Zhang, Xiangliang ^b   Jamjoom, Hani ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b KING ABDULLAH UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Saudi Arabia)

Author keywords

[No Author keywords available]

Indexed keywords

INFRASTRUCTURE AS A SERVICE (IAAS);

BLACK BOXES; CLOUD PROVIDERS; CYCLICALITY; ITERATIVE MAPREDUCE; MIGRATION TIME; PERIOD LENGTH; RESOURCE UTILIZATIONS; VM MIGRATIONS;

BIG DATA;

EID: 84904438498     PISSN: 0743166X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/INFOCOM.2014.6848144     Document Type: Conference Paper

References (36)

1. "Amazon Web Services," http://aws.amazon.com/ec2/.
2. "Hadoop MapReduce Programming Model, Documentation and Implementation," http://hadoop.apache.org/mapreduce.
3. M. Andreolini, S. Casolari, M. Colajanni, and M. Messori, "Dynamic load management of virtual machines in a cloud architecture," in Proc. of ICST CLOUDCOMP, Munich, Germany, Oct. 2009.
4. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield, "Xen and the Art of Virtualization," in Proc. of ACM SOSP, Bolton Landing, NY, Oct. 2003.
5. J. Beringer and E. Hüllermeier, "Online clustering of parallel data streams," Data & Knowledge Engineering, vol. 58, no. 2, pp. 180-204, 2006.
6. D. Berndt and J. Clifford, "Using dynamic time warping to find patterns in time series," in AAAI-94 workshop on knowledge discovery in databases, vol. 2, 1994.
7. C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield, "Live Migration of Virtual Machines," in Proc. of USENIX NSDI, Boston, MA, May 2005.
8. J. Dean and S. Ghemawat, "MapReduce: simplified data processing on large clusters," Communications of the ACM, vol. 51, no. 1, pp. 107-113, Jan. 2008.
9. P. Denning, "Working sets past and present," Software Engineering, IEEE Transactions on, vol. 6, no. 1, pp. 64-84, 1980.
10. D. Ellis, "Dynamic time warp (dtw) in matlab," http://labrosa.ee.columbia.edu/matlab/dtw/.
11. M. Ester, H. Kriegel, J. Sander, and X. Xu, "A density-based algorithm for discovering clusters in large spatial databases with noise," in Proceedings of the 2nd International Conference on Knowledge Discovery and Data mining, vol. 1996. AAAI Press, 1996, pp. 226-231.
12. J. Foote et al., "Methods for the automatic analysis of music and audio," in In Multimedia Systems. Citeseer, 1999.
13. A. Ganapathi, Y. Chen, A. Fox, R. Katz, and D. Patterson, "Statisticsdriven workload modeling for the cloud," in Data Engineering Workshops (ICDEW), 2010 IEEE 26th International Conference on. IEEE, 2010, pp. 87-92.
14. E. Gardner Jr, "Exponential smoothing: The state of the art," Journal of Forecasting, vol. 4, no. 1, pp. 1-28, 1985.
15. F. Hermenier, X. Lorca, J.-M. Menaud, G. Muller, and J. Lawall, "Entropy: a consolidation manager for clusters," in Proc. of ACM VEE, Washington, DC, Mar. 2009.
16. M. Hines and K. Gopalan, "Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning," in Proc. of ACM VEE, Washington, DC, Mar. 2009.
17. U. Kang, C. E. Tsourakakis, and C. Faloutsos, "PEGASUS: A Peta-Scale Graph Mining System Implementation and Observations," in Proc. of IEEE ICDM, 2009, pp. 229-238.
18. E. Keogh and C. Ratanamahatana, "Exact indexing of dynamic time warping," Knowledge and information systems, vol. 7, no. 3, pp. 358-386, 2005.
19. G. Khanna, K. Beaty, G. Kar, and A. Kochut, "Application performace management in virtualized server environments," in Proc. of IEEE/IFIP NOMS, Vancouver, Canada, Apr. 2006.
20. A. Kivity, Y. Kamay, and D. Laor, "KVM: The Kernel-Based Virtual Machine for Linux," in Proc. of Ottawa Linux Symposium, Ottawa, Canada, Jun. 2007.
21. X. Meng, V. Pappas, and L. Zhang, "Improving the scalability of data center networks with traffic-aware virtual machine placement," in Proceedings of IEEE INFOCOM, 2010.
22. M. Nelson, B.-H. Lim, and G. Hutchins, "Fast Transparent Migration for Virtual Machines," in Proc. of USENIX Annual Technical Conf., Anaheim, CA, Apr. 2005.
23. L. Page, S. Brin, R. Motwani, and T. Winograd, "The PageRank Citation Ranking: Bringing Order to the Web," http://ilpubs.stanford.edu: 8090/422/, 2001.
24. T. Ristenpart, E. Tromer, H. Shacham, and S. Savage, "Hey, you, get off of my cloud: exploring information leakage in third-party compute clouds," in Proceedings of the 16th ACM conference on Computer and communications security. ACM, 2009, pp. 199-212.
25. M. Satyanarayanan, B. Gilbert, M. Toups, N. Tolia, D. O'Hallaron, A. Surie, A. Wolbach, J. Harkes, A. Perrig, D. Farber et al., "Pervasive personal computing in an internet suspend/resume system," IEEE Internet Computing, pp. 16-25, 2007.
26. B. Schmidt, "Supporting ubiquitous computing with stateless consoles and computation caches," Ph.D. dissertation, Stanford University, 2000.
27. V. Shrivastava, P. Zerfos, K. won Lee, H. Jamjoom, Y.-H. Liu, and S. Banerjee, "Application-aware Virtual Machine Migration in Data Centers," in Proceedings of IEEE INFOCOM Mini-conference, Shanghai, China, April 2011.
28. A. Stage and T. Setzer, "Network-aware migration control and scheduling of differentiated virtual machine workloads," in Proc. of ICSE Workshop on Software Engineering Challenges of Cloud Computing, Vancouver, Canada, May 2009.
29. F. Standard, "1037c. telecommunications: Glossary of telecommunication terms," Institute for Telecommunications Sciences, vol. 7, 1996.
30. C. Tang, M. Steinder, M. Spreitzer, and G. Pacifici, "A scalable application placement controller for enterprise data centers," in WWW '07: Proceedings of the 16th international conference on World Wide Web. New York, NY, USA: ACM, 2007, pp. 331-340.
31. R. Turetsky and D. Ellis, "Ground-truth transcriptions of real music from force-aligned midi syntheses," in Proc. Int. Conf. on Music Info. Retrieval ISMIR, vol. 3, 2003.
32. H. N. Van, F. D. Tran, and J.-M. Menaud, "Autonomic virtual resource management for service hosting platforms," in Proc. of ICSE Workshop on Software Engineering Challenges of Cloud Computing, Vancouver, Canada, May 2009.
33. D. Williams, H. Jamjoom, Y.-H. Liu, and H. Weatherspoon, "Overdriver: Handling memory overload in an oversubscribed cloud," in Proc. of ACM VEE, Newport Beach, CA, Mar. 2011.
34. T. Wood, L. Cherkasova, K. Ozonat, and P. Shenoy, "Predicting application resource requirements in virtual environment," 2008.
35. T. Wood, P. Shenoy, and A. Venkataramani, "Black-box and gray-box strategies for virtual machine migration," in Proc. of USENIX NSDI, Cambridge, MA, Apr. 2007.
36. T. Wood, G. Tarasuk-Levin, P. Shenoy, P. Desnoyers, E. Cecchet, and M. D. Corner, "Memory buddies: Exploiting page sharing for smart colocation in virtualized data centers," in Proc. of ACM VEE, Washington, DC, Mar. 2009.