A Big Data Architecture Design for Smart Grids Based on Random Matrix Theory

IEEE Transactions on Smart Grid

Volumn 8, Issue 2, 2017, Pages 674-686

  He, Xing ^a   Ai, Qian ^a   Qiu, Robert Caiming ^b   Huang, Wentao ^a   Piao, Longjian ^a   Liu, Haichun ^a  

^a Shanghai Jiao Tong University   (China)

^b Tennessee Technological University   (United States)

Author keywords

Architecture; big data; group work mode; high dimension; large scale distributed system; mean spectral radius (MSR); random matrix; smart grid

Indexed keywords

ARCHITECTURE; COMPUTER ARCHITECTURE; DATA FLOW ANALYSIS; ELECTRIC POWER TRANSMISSION NETWORKS; LARGE SCALE SYSTEMS; MATRIX ALGEBRA; RANDOM VARIABLES; SMART POWER GRIDS;

GROUP WORK; HIGH DIMENSIONS; LARGE-SCALE DISTRIBUTED SYSTEM; RANDOM MATRIX; SMART GRID; SPECTRAL RADII;

BIG DATA;

EID: 85027724243     PISSN: 19493053     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSG.2015.2445828     Document Type: Article

References (48)

1. Nature. (Sep. 2008). Big Data (Specials). [Online]. Available: http://www.nature.com/news/specials/bigdata/index.html
2. Science. (Feb. 2011). Special Online Collection: Dealing With Data. [Online]. Available: http://www.sciencemag.org/site/special/data/
3. IBM. (Jul. 1, 2015). The Four V's of Big Data. [Online]. Available: http://www.ibmbigdatahub.com/infographic/four-vs-big-data
4. R. Qiu and P. Antonik, Smart Grid and Big Data. Hoboken, NJ, USA: Wiley, 2014.
5. Managing Big Data for Smart Grids and Smart Meters, IBM, Armonk, NY, USA, May 2009.
6. M. Kezunovic, L. Xie, and S. Grijalva, "The role of big data in improving power system operation and protection," in Proc. Symp. Bulk Power Syst. Dyn. Control-IX Optim. Security Control Emerg. Power Grid (IREP), Rethymno, Greece, 2013, pp. 1-9.
7. T. A. Brody et al., "Random-matrix physics: Spectrum and strength fluctuations," Rev. Modern Phys., vol. 53, no. 3, pp. 396-480, 1981.
8. L. Laloux, P. Cizeau, M. Potters, and J.-P. Bouchaud, "Random matrix theory and financial correlations," Int. J. Theor. Appl. Finance, vol. 3, no. 3, pp. 391-397, 2000.
9. H. Chen, R. H. Chiang, and V. C. Storey, "Business intelligence and analytics: From big data to big impact," MIS Quart., vol. 36, no. 4, pp. 1165-1188, 2012.
10. D. Howe et al., "Big data: The future of biocuration," Nature, vol. 455, no. 7209, pp. 47-50, 2008.
11. R. Qiu and M. Wicks, Cognitive Networked Sensing and Big Data. New York, NY, USA: Springer, 2013.
12. C. Zhang and R. C. Qiu, "Data modeling with large random matrices in a cognitive radio network testbed: Initial experimental demonstrations with 70 nodes," ArXiv e-prints, Apr. 2014. [Online]. Available: http://arxiv.org/pdf/1404.3788.pdf
13. X. Li, F. Lin, and R. C. Qiu, "Modeling massive amount of experimental data with large random matrices in a real-time UWB-MIMO system," ArXiv e-prints, Apr. 2014. [Online]. Available: http://arxiv.org/pdf/1404.4078.pdf
14. A. Phadke and R. M. de Moraes, "The wide world of wide-area measurement," IEEE Power Energy Mag., vol. 6, no. 5, pp. 52-65, Sep./Oct. 2008.
15. V. Terzija et al., "Wide-area monitoring, protection, and control of future electric power networks," Proc. IEEE, vol. 99, no. 1, pp. 80-93, Jan. 2011.
16. L. Xie, Y. Chen, and H. Liao, "Distributed online monitoring of quasistatic voltage collapse in multi-area power systems," IEEE Trans. Power Syst., vol. 27, no. 4, pp. 2271-2279, Nov. 2012.
17. N. Kanao et al., "Power system harmonic analysis using state-estimation method for Japanese field data," IEEE Trans. Power Del., vol. 20, no. 2, pp. 970-977, Apr. 2005.
18. D. Alahakoon and X. Yu, "Advanced analytics for harnessing the power of smart meter big data," in Proc. IEEE Int. Workshop Intell. Energy Syst. (IWIES), Vienna, Austria, 2013, pp. 40-45.
19. W. Xu and J. Yong, "Power disturbance data analytics-New application of power quality monitoring data," Proc. CSEE, vol. 33, no. 19, pp. 93-101, 2013.
20. R. C. Qiu, Z. Hu, H. Li, and M. C. Wicks, Cognitive Radio Communication and Networking: Principles and Practice. Hoboken, NJ, USA: Wiley, 2012.
21. R. C. Qiu, "The foundation of big data: Experiments, formulation, and applications," ArXiv e-prints, Dec. 2014. [Online]. Available: http://arxiv.org/pdf/1412.6570.pdf
22. V. A. Mar?cenko and L. A. Pastur, "Distribution of eigenvalues for some sets of random matrices," Sbornik Math., vol. 1, no. 4, pp. 457-483, 1967.
23. G. Pan, Q. Shao, and W. Zhou, "Universality of sample covariance matrices: Clt of the smoothed empirical spectral distribution," ArXiv e-prints, Nov. 2011. [Online]. Available: http://arxiv.org/pdf/1111.5420.pdf
24. A. Guionnet, M. Krishnapur, and O. Zeitouni, "The single ring theorem," ArXiv e-prints, Sep. 2009. [Online]. Available: http://arxiv.org/pdf/0909.2214.pdf
25. F. Benaych-Georges and J. Rochet, "Outliers in the single ring theorem," Probab. Theory Related Fields, pp. 1-51, May 2015. [Online]. Available: http://dx.doi.org/10.1007/s00440-015-0632-x
26. J. R. Ipsen and M. Kieburg, "Weak commutation relations and eigenvalue statistics for products of rectangular random matrices," Phys. Rev. E, vol. 89, no. 3, 2014, Art. ID 032106.
27. X. Zhou, S. Chen, and Z. Lu, "Review and prospect for power system development and related technologies: A concept of three-generation power systems," Proc. CSEE, vol. 33, no. 22, pp. 1-11, 2013.
28. S. Mei, Y. Gong, and F. Liu, "The evolution model of three generation power systems and characteristic analysis," Proc. CSEE, vol. 34, no. 7, pp. 1003-1012, 2014.
29. X. He, Q. Ai, Z. Yu, Y. Xu, and J. Zhang, "Power system evolution and aggregation theory under the view of power ecosystem," Power Syst. Protect. Control, vol. 42, no. 22, pp. 100-107, 2014.
30. R. C. Qiu et al., "Cognitive radio network for the smart grid: Experimental system architecture, control algorithms, security, and microgrid testbed," IEEE Trans. Smart Grid, vol. 2, no. 4, pp. 724-740, Dec. 2011.
31. H. Li et al., "Efficient and secure wireless communications for advanced metering infrastructure in smart grids," IEEE Trans. Smart Grid, vol. 3, no. 3, pp. 1540-1551, Sep. 2012.
32. H. Li, L. Lai, and R. C. Qiu, "Scheduling of wireless metering for power market pricing in smart grid," IEEE Trans. Smart Grid, vol. 3, no. 4, pp. 1611-1620, Dec. 2012.
33. D. Baigent, M. Adamiak, and R. Mackiewicz, "IEC 61850 communication networks and systems in substations: An overview for users," Protect. Control J., vol. 8, pp. 61-68, Jul. 2009. [Online]. Available: http://www.gedigitalenergy.com/multilin/journals/issues/PCJ-Spring2009.pdf
34. R. Yuan, Q. Ai, and X. He, "Research on dynamic load modelling based on power quality monitoring system," IET Gener. Transm. Distrib., vol. 7, no. 1, pp. 46-51, Jan. 2013.
35. Q. Ai, X. Wang, and X. He, "The impact of large-scale distributed generation on power grid and microgrids," Renew. Energy, vol. 62, pp. 417-423, Feb. 2014.
36. Z. Hong, D. Zhao, C. Gu, F. Li, and B. Wang, "Economic optimization of smart distribution networks considering real-time pricing," J. Modern Power Syst. Clean Energy, vol. 2, no. 4, pp. 350-356, 2014.
37. Y. Ji, "Multi-agent system based control of virtual power plant and its application in smart grid," M.S. thesis, School Electron. Inf. Elect. Eng., Shanghai Jiaotong Univ., Shanghai, China, 2011.
38. X. He, Q. Ai, P. Yuan, and X. Wang, "The research on coordinated operation and cluster management for multi-microgrids," in Proc. IET Int. Conf. Sustain. Power Gener. Supply (SUPERGEN), Hangzhou, China, 2012, pp. 1-3.
39. X. Ni, Q. Ruan, S. Mei, and G. He, "A new network partitioning algorithm based on complex network theory and its application in Shanghai power grid," Power Syst. Technol., vol. 31, no. 9, pp. 6-12, May 2007.
40. R. Zimmerman, C. Murillo-Sánchez, and D. Gan, Matpower User's Manual, Version 4.1, Power Syst. Eng. Res. Center, Tempe, AZ, USA, 2011.
41. Y. Zhao, Y. An, and Q. Ai, "Research on size and location of distributed generation with vulnerable node identification in the active distribution network," IET Gener. Transm. Distrib., vol. 8, no. 11, pp. 1801-1809, Nov. 2014.
42. W. Huang et al., "An impedance protection scheme for feeders of active distribution networks," IEEE Trans. Power Del., vol. 29, no. 4, pp. 1591-1602, Aug. 2014.
43. J. Xu, G. Yang, Y. Yin, H. Man, and H. He, "Sparse-representationbased classification with structure-preserving dimension reduction," Cogn. Comput., vol. 6, no. 3, pp. 608-621, 2014.
44. G. E. Pfander, H. Rauhut, and J. Tanner, "Identification of matrices having a sparse representation," IEEE Trans. Signal Process., vol. 56, no. 11, pp. 5376-5388, Nov. 2008.
45. I. Jana, K. Saha, and A. Soshnikov, "Fluctuations of linear eigenvalue statistics of random band matrices," ArXiv e-prints, Dec. 2014. [Online]. Available: http://arxiv.org/pdf/1412.2445.pdf
46. X. He et al., "3d power-map for smart grids-An integration of highdimensional analysis and visualization," ArXiv e-prints, Mar. 2015. [Online]. Available: http://arxiv.org/pdf/1503.00463.pdf
47. X. He, Q. Ai, R. C. Qiu, W. Huang, and J. Long. "An unsupervised learning method for early event detection in smart grid with big data," ArXiv e-prints, Jan. 2015. [Online]. Available: http://arxiv.org/pdf/1502.00060.pdf
48. Y. Cao et al., "A random matrix theoretical approach to early event detection using experimental data," ArXiv e-prints, Mar. 2015. [Online]. Available: http://arxiv.org/pdf/1503.08445.pdf