Study on hybrid storage method of AMI mass data

China International Conference on Electricity Distribution, CICED

Volumn 2014-December, Issue , 2014, Pages 1288-1293

  Xu, Daqing ^a   Lei, Ming ^a   Zhou, Fenqquan ^a   Luan, Wenpeng ^b  

^a XJ Group Corporation China   (China)

^b CHINA ELECTRIC POWER RESEARCH INSTITUTE   (China)

Author keywords

AMI; Hybrid Storage; Mass Data; Smart Grid

Indexed keywords

ADVANCED METERING INFRASTRUCTURES; DATA HANDLING; DIGITAL STORAGE; ELECTRIC UTILITIES; FILE ORGANIZATION; RELATIONAL DATABASE SYSTEMS;

COMPARATIVE TESTS; DETAILED CLASSIFICATION; EXTRACTION PROCESS; HADOOP DISTRIBUTED FILE SYSTEM (HDFS); HYBRID STORAGES; MASS DATA; RELATIONAL DATABASE; SMART GRID;

INFORMATION MANAGEMENT;

EID: 84942319430     PISSN: 21617481     EISSN: 2161749X     Source Type: Conference Proceeding    
DOI: 10.1109/CICED.2014.6991915     Document Type: Conference Paper

References (14)

1. Welcome Page: What is Apache Hadoop, 2014 [Online]. Available: http://hadoop. apache. orgl
2. Jia-heng Lu, 2012, Hadoop in Action, China Machine Press, Beijing, PR China. (in Chinese)
3. Apache HBase Project-Overview, 2014 [Online]. Available: http://hbase. apache. org/
4. Hong-wei Bai, Zhi-wei Ma, Ya-qi Song, 2011, "Processing of smart grid monitoring data based on cloud computing", East China Electric Power, vo1. 39, No. 9, pp. 1485-1488. (in Chinese)
5. Shu-ren Liu, Ya-qi Song, Yong-Li Zhu, Dewen Wang, 2013, "Research on data storage for smaIt gIid condition monitoring using Hadoop", Computer Science, vo1. 40, No. 1, pp. 81-84. (in Chinese)
6. Xing-chen Heng, Li Zhou, 2013, "Application of disttibuted technologies in the power big data high-perfonnance processing", Electric Power Information and Communication Technology, vo1. 11, No. 9, pp. 40-43. (in Chinese)
7. De-wen Wang, Kai Xiao, Lei Xiao, 2013, "Data warehouse of electric power equipment condition infonnation based on Hive", Power System Protection and Control, vo1. 41, No. 9, pp. 125-130. (in Chinese)
8. Ya-qi Song, Guo-liang Zhou, Yong-li Zhu, 2013, "Present status and challenges of big data processing in smalt gtid", Power System Technology, vo1. 37, No. 4, pp. 927-93 5. (in Chinese)
9. S. Salvini, P. Lopatka; D. Wallom, 2011, "IntegI'ating the hardware and software computational platfol1ll for the HiPerDNO (high perfOlmance distt'ibution network operation) project", in HiPCNA-PG'l1: Proceedings of the first international workshop on High performance computing, networking and analytics for the power grid. New York, NY, USA: ACM, pp. 75-82.
10. M. Arenas-Martinez et al. , 2010, "A Comparative study of data storage and processing architectures for the smalt grid", in Proceedings of the 1st IEEE International Conference on Smart Grid Communications, Gaithersburg, MD, pp. 285-290.
11. The Smart Glid: Hadoop at the Tennessee Valley Authority (TVA), 2009 [Online]. Available: http:// blog. cloudera. comlblogi2009/06/smalt-gridhadoop-tennessee-valley-authOlity-tva/
12. Cloudera Energizes Opower's Big Data Insights, 2012 [Online]. Available: http://finance. yahoo. comlnews/cloudera-energizes-opowers-bigdata-165700779. html
13. How Map and Reduce operations are actually canied out, 2011 [Online]. Available: http://wiki. apache. orgihadoop/HadoopMapReduce
14. Zhu Bin-mo, Du Wei-hua, Li Rui, 2011, "Data analysis and processing technology for power consumption information acquisition system", East China Electric Power, vo1. 39, No. 10, pp. 1682-1686. (in Chinese)