Power grid time series data analysis with pig on a Hadoop cluster compared to multi core systems

Proceedings of the 2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing, PDP 2013

Volumn , Issue , 2013, Pages 208-212

  Bach, Felix ^a   Çakmak, Hueseyin K ^a   Maass, Heiko ^a   Kuehnapfel, Uwe ^a  

^a KARLSRUHE INSTITUTE OF TECHNOLOGY   (Germany)

Author keywords

big data; data analysis; Hadoop; LSDF; multicore; Pig; Power system; time series

Indexed keywords

BIG DATUM; HADOOP; LSDF; MULTI CORE; PIG;

DATA PROCESSING; DATA REDUCTION; DISTRIBUTED COMPUTER SYSTEMS; MAMMALS; METADATA; MICROPROCESSOR CHIPS; STANDBY POWER SYSTEMS;

TIME SERIES;

EID: 84877650283     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/PDP.2013.37     Document Type: Conference Paper

References (14)

1. J. Depablos, V. Centeno, A. G. Phadke, und M. Ingram, "Comparative testing of synchronized phasor measurement units", in IEEE Power Engineering Society General Meeting, 2004, 2004, S. 948-954 Vol.1.
2. H. Maass, H. K. Çakmak, W. Suess, A. Quinte, W. Jakob, K. U. Stucky, U. Kuehnapfel, "Introducing the Electrical Data Recorder as a New Capturing Device for Power Grid Analysis", in AMPS 2012 PROCEEDINGS, 2012.
3. H. Maass, H. K. Çakmak, W. Suess, A. Quinte, W. Jakob, E. Müller, K. Boehm, K. U. Stucky, U. Kuehnapfel, "Introducing a New Voltage Time Series Approach for Electrical Power Grid Analysis", presented at the 2nd IEEE ENERGYCON Conference & Exhibition, 2012 / ICT for Energy Symposium, 2012, S. 143-148.
4. "The Smart Grid: Hadoop at the Tennessee Valley Authority (TVA) - cloudera, Josh Patterson", Cloudera. [Online]. Available: http://www.cloudera.com/blog/2009/06/smart-grid-hadoop-tennessee-valley- authority-tva/. [Accessed: 15-Aug-2012].
5. "Grid Protection Alliance (OpenPDC, OpenHist., ...)". [Online]. Available: http://www.gridprotectionalliance.org/gsdefault.htm. [Accessed: 13-Sep-2012].
6. "iPDC - Free Phasor Data Concentrator". [Online]. Available: http://ipdc.codeplex.com/. [Accessed: 15-Aug-2012].
7. "Lumberyard- Time Series Indexing at Scale". .
8. J. Shieh und E. Keogh, "iSAX: disk-aware mining and indexing of massive time series datasets", Data Mining and Knowledge Discovery, Bd. 19, Nr. 1, S. 24-57, 2009.
9. E. Keogh, J. Lin, und A. Fu, "Hot sax: Efficiently finding the most unusual time series subsequence", in Data Mining, Fifth IEEE International Conference on, 2005, S. 8-pp.
10. A. O. Garcia, S. Bourov, A. Hammad, V. Hartmann, T. Jejkal, J. C. Otte, S. Pfeiffer, T. Schenker, C. Schmidt, P. Neuberger, und others, "Data-intensive analysis for scientific experiments at the Large Scale Data Facility", in Large Data Analysis and Visualization (LDAV), 2011 IEEE Symposium on, 2011, S. 125-126.
11. D. P. Chassin, K. Schneider, und C. Gerkensmeyer, "GridLAB-D: An open-source power systems modeling and simulation environment", in Transmission and Distribution Conference and Exposition, 2008. T #x00026;D. IEEE/PES, 2008, S. 1 -5.
12. L. Wei, E. Keogh, X. Xi, und S. Lonardi, "Integrating Lite-Weight but Ubiquitous Data Mining into GUI Operating Systems", Journal of Universal Computer Science, Bd. 11, Nr. 11, S. 1820-1834, 2005. (Pubitemid 43004324)
13. "VizTree". [Online]. [Accessed:07-Nov-2012]. Available: http://www.cs.gmu.edu/~jessica/viztree.htm.
14. W. Aigner, S. Miksch, W. Müller, H. Schumann, und C. Tominski, "Visualizing time-oriented data - A systematic view", Computers & Graphics, Bd. 31, Nr. 3, S. 401-409, Juni 2007. (Pubitemid 46726592)