Automated load curve data cleansing in power systems

IEEE Transactions on Smart Grid

Volumn 1, Issue 2, 2010, Pages 213-221

  Chen, Jiyi ^a   Li, Wenyuan ^b   Lau, Adriel ^b   Cao, Jiguo ^a   Wang, Ke ^a  

^a SIMON FRASER UNIVERSITY   (Canada)

^b British Columbia Transmission Corporation   (Canada)

Author keywords

Load management; load modeling; power quality; power systems; smoothing methods

Indexed keywords

B-SPLINE; BRITISH COLUMBIA TRANSMISSION CORPORATIONS; CORRUPTED DATA; DATA CLEANSING; DAY-TO-DAY OPERATIONS; DELIVERY POINT; ELECTRIC ENERGY CONSUMPTION; END USERS; ENERGY SAVING; KERNEL SMOOTHING; LOAD CURVES; LOAD MANAGEMENT; LOAD MODELING; MISSING DATA; POWER SYSTEMS; RANDOM FAILURES; SMOOTHING METHODS; SYSTEM ANALYSIS; SYSTEM PLANNING; SYSTEM RELIABILITY; SYSTEM VISUALIZATION; TIME INTERVAL; TRANSFER PROCESS;

ELECTRIC LOAD MANAGEMENT; ENERGY UTILIZATION; RELIABILITY ANALYSIS; SPLINES; VISUALIZATION;

DATA VISUALIZATION;

EID: 77956062338     PISSN: 19493053     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSG.2010.2053052     Document Type: Article

References (29)

1. W. Li, Risk Assessment of Power Systems: Models, Methods, and Applications. New York: IEEE Press-Wiley, 2005.
2. Smart Grid, U.S. Dept. Energy [Online]. Available: http://www.oe.energy. gov/smartgrid.htm
3. R. Sridhar, R. Rajeev, and S.Kyuseok, "Efficient algorithms for mining outliers from large data sets," ACM SIGMOD Rec., vol.29, no.2, pp. 427-438, Jun. 2000.
4. A. Nairac, N. Townsend, R. Carr, S. King, P. Cowley, and L. Tarassenko, "A system for the analysis of jet engine vibration data," Integr. Comput.-Aided Eng., vol.6, no.1, pp. 53-66, Jan. 1999.
5. S. Hawkins, H. He, G. Williams, and R. Baxter, "Outlier detection using replicator neural networks," in Proc. 4th Int. Conf. Data Warehousing Knowledge Discovery, 2002, pp. 170-180.
6. V. J. Hodge and J. Austin, "A survey of outlier detection methodologies," Artif. Intell. Rev., vol.22, no.2, pp. 85-126, Oct. 2004.
7. L. Wei, E. Keogh, and X. Xi, "SAXually explicit images: Finding unusual shapes," ICDM 2006.
8. D. Yankov, E. Keogh, and U. Rebbapragada, "Disk aware discord discovery: Finding unusual time series in terabyte sized datasets," in Proc. 6th Int. Conf. Data Mining, 2007, pp. 711-720.
9. P. K. Chan and M. V. Mahoney, "Modeling multiple time series for anomaly detection," in Proc. 5th Int. Conf. Data Mining, 2005, pp. 90-97.
10. M. V. Mahoney and P. K. Chan, "Trajectory boundary modeling of time series for anomaly detection," presented at the KDD Workshop Data Mining Methods Anomaly Detection, Chicago, IL, 2005.
11. S. Salvador, P. Chan, and J. Brodie, "Learning states and rules for time series anomaly detection," in Proc. 17th Int. FLAIRS Conf., 2005, pp. 300-305.
12. E. Keogh, J. Lin, and A. Fu, "HOT SAX: Finding the most unusual time series subsequence: Algorithms and applications," in Proc. 5th Int. Conf. Data Mining, 2005, pp. 226-233.
13. Y. Bu, T.-W. Leung, A. W.-C. Fu, E. Keogh, J. Pei, and S. Meshkin, "WAT: Finding top-K discords in time series database," presented at the 2007 SIAM Int. Conf. Data Mining, Minneapolis, MN.
14. A. W.-C. Fu, O. T.-W. Leung, E. Keogh, and J. Lin, "Finding time series discords based on Haar Transform," in Proc. 2nd Int. Conf. Adv. Data Mining Appl, 2006, pp. 31-41.
15. E. Keogh, S. Lonardi, and C. A. Ratanamahatana, "Towards parameterfree data mining," in Proc. 10th Int. Conf. Knowledge Discovery and Data Mining, 2004, pp. 206-215.
16. A. Fallon and C. spada, "Detection and accommodation of outliers in normally distributed data sets," [Online]. Available: http://www.cee.vt. edu/ewr/environmental/teach/smprimer/outlier/outlier.html
17. A. J. Fox, "Outliers in time series," J. Roy. Stat. Soc. B, Methodological, vol.34, pp. 350-363, 1972.
18. G. M. Ljung, "On outlier detection in time series," J. Roy. Stat. Soc. B, Methodological, vol.55, pp. 559-567, 1993.
19. W. Hrdle, Applied Nonparametric Regression. Cambridge, U.K: Cambridge Univ. Press, 1990.
20. J. O. Ramsay and B. W. Silverman, Functional Data Analysis, 2nd ed. New York: Springer, 2005.
21. C. de Boor, A Practical Guide to Splines. New York: Springer, 2001.
22. M. P. Wand and M. C. Jones, Kernel Smoothing. London, U.K.: Chapman & Hall, 1995.
23. V. Barnett and T. Lewis, Outliers in Statistical Data, 3rd ed. New York: Wiley, 1994, pp. 397-415.
24. B. Abraham and N. Yatawara, "A score test for detection of time series outliers," J. Time Ser. Anal., vol.9, pp. 109-119, 1988.
25. B. Abraham and A. Chuang, "Outlier detection and time series modeling," Technometrics, vol.31, pp. 241-248, 1989.
26. W. Schmid, "The multiple outlier problem in time series analysis," Australian. J. Stat., vol.28, pp. 400-413, 1986.
27. G. E. P. Box, G. M. Jenkins, and G. C. Reinsel, Time Series Analysis: Forecasting and Control, 4th ed. Hoboken, NJ: Wiley, 2008.
28. M. H. Kutner, C. J. Nachtsheim, J. Neter, and W. Li, Applied Linear Statistical Models, 5th ed. New York: McGraw-Hill/Irwin, 2004.
29. J. W. Taylor, "An evaluation of methods for very short-term load forecasting, using minute-by-minute British data," Int. J. Forecasting, vol.24, pp. 645-658, 2008.