Processing smart meter data streams in the cloud

IEEE PES Innovative Smart Grid Technologies Conference Europe

Volumn , Issue , 2011, Pages

  Lohrmann, Bjorn ^a   Kao, Odej ^a  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

Author keywords

Cloud Computing; Real Time Pricing; Smart Metering; Stream Processing

Indexed keywords

COMMUNICATION INFRASTRUCTURE; COMPUTING FRAMEWORKS; DATA STREAM; DEMAND RESPONSE PROGRAMS; IT INFRASTRUCTURES; PARALLEL STREAMS; POWER GRIDS; POWER PRODUCTION; POWER UTILITY; PRIVATE CLOUDS; REAL TIME PRICING; RENEWABLE ENERGY SOURCE; SMART METERING; SMART METERS; STREAM PROCESSING; TWO WAY COMMUNICATIONS;

CLOUD COMPUTING; COSTS; DATA COMMUNICATION SYSTEMS; EXHIBITIONS; RENEWABLE ENERGY RESOURCES;

SMART POWER GRIDS;

EID: 84860773274     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISGTEurope.2011.6162747     Document Type: Conference Paper

References (31)

1. M. Albadi and E. El-Saadany, "Demand response in electricity markets: An overview," in Power Engineering Society General Meeting. IEEE, june 2007, pp. 1-5.
2. B. Rimal, E. Choi, and I. Lumb, "A taxonomy and survey of cloud computing systems," in NCM 2009 Fifth International Joint Conference on INC, IMS and IDC. IEEE, 2009, pp. 44-51.
3. "Amazon elastic compute cloud," http://aws.amazon.com/de/ec2/, 2011.
4. "The rackspace cloud," http://www.rackspace.com/cloud/, 2011.
5. "Google app engine," http://code.google.com/intl/en-US/ appengine/, 2011.
6. "Windows azure platform," http://www.microsoft.com/ windowsazure/, 2011.
7. "Eucalyptus cloud," http://www.eucalyptus.com/, 2011.
8. "Openstack cloud software," http://www.openstack.org/, 2011.
9. D. Warneke and O. Kao, "Nephele: efficient parallel data processing in the cloud," in Proceedings of the 2nd Workshop on Many-Task Computing on Grids and Supercomputers, ser. MTAGS '09, New York, NY, USA, 2009, pp. 8:1-8:10.
10. D. Battŕe, M. Hovestadt, B. Lohrmann, A. Stanik, and D. Warneke, "Detecting bottlenecks in parallel dag-based data flow programs," in Many-Task Computing on Grids and Supercomputers (MTAGS), 2010 IEEE Workshop on. IEEE, pp. 1-10.
11. "Apache hadoop," http://hadoop.apache.org/, 2011.
12. K. Shvachko, H. Kuang, S. Radia, and R. Chansler, "The hadoop distributed file system," Mass Storage Systems and Technologies, IEEE/NASA Goddard Conference on, vol. 0, pp. 1-10, 2010.
13. F. Chang, J. Dean, S. Ghemawat, W. Hsieh, D. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. Gruber, "Bigtable: A distributed storage system for structured data," ACM Transactions on Computer Systems (TOCS), vol. 26, no. 2, pp. 1-26, 2008.
14. B. Cooper, R. Ramakrishnan, U. Srivastava, A. Silberstein, P. Bohannon, H. Jacobsen, N. Puz, D. Weaver, and R. Yerneni, "Pnuts: Yahoo!'s hosted data serving platform," Proceedings of the VLDB Endowment, vol. 1, no. 2, pp. 1277-1288, 2008.
15. E. Brewer, "Towards robust distributed systems," in Proceedings of the Annual ACM Symposium on Principles of Distributed Computing, vol. 19, 2000, pp. 7-10.
16. A. Kivity, Y. Kamay, D. Laor, U. Lublin, and A. Liguori, "kvm: the linux virtual machine monitor," in Proceedings of the Linux Symposium, vol. 1, 2007, pp. 225-230.
17. P. Samadi, A. Mohsenian-Rad, R. Schober, V. Wong, and J. Jatskevich, "Optimal real-time pricing algorithm based on utility maximization for smart grid," in Smart Grid Communications (SmartGridComm), 2010 First IEEE International Conference on. IEEE, 2010, pp. 415-420.
18. D. Abadi, D. Carney, U. Ç etintemel, M. Cherniack, C. Convey, S. Lee, M. Stonebraker, N. Tatbul, and S. Zdonik, "Aurora: A new model and architecture for data stream management," The VLDB Journal, vol. 12, no. 2, pp. 120-139, 2003.
19. S. Babu and J. Widom, "Continuous queries over data streams," SIGMOD Rec., vol. 30, pp. 109-120, September 2001.
20. R. Motwani, J. Widom, A. Arasu, B. Babcock, S. Babu, M. Datar, G. Manku, C. Olston, J. Rosenstein, and R. Varma, "Query processing, approximation, and resource management in a data stream management system," in First Biennial Conference on Innovative Data Systems Research (CIDR 2003), 2003, pp. 245-256.
21. M. Cherniack, H. Balakrishnan, M. Balazinska, D. Carney, U. Cetintemel, Y. Xing, and S. Zdonik, "Scalable distributed stream processing," in Proceedings of the First Biennial Conference on Innovative Data Systems Research (CIDR 2003), 2003.
22. D. Abadi, Y. Ahmad, M. Balazinska, U. Cetintemel, M. Cherniack, J. Hwang, W. Lindner, A. Maskey, A. Rasin, E. Ryvkina et al., "The design of the borealis stream processing engine," in Second Biennial Conference on Innovative Data Systems Research (CIDR 2005), 2005, pp. 277-289.
23. T. Condie, N. Conway, P. Alvaro, J. M. Hellerstein, K. Elmeleegy, and R. Sears, "Mapreduce online," in Proceedings of the 7th USENIX conference on Networked systems design and implementation. USENIX Association, 2010, pp. 21-21.
24. S. Pallickara, J. Ekanayake, and G. Fox, "Granules: A lightweight, streaming runtime for cloud computing with support for map-reduce," in IEEE International Conference on Cluster Computing and Workshops. IEEE, 2009, pp. 1-10.
25. S. Pallickara and G. Fox, "Naradabrokering: A distributed middleware framework and architecture for enabling durable peer-to-peer grids," in Proceedings of the ACM/IFIP/USENIX 2003 International Conference on Middleware. Springer-Verlag New York, Inc., 2003, pp. 41-61.
26. D. Zinn, Q. Hart, T. M. McPhillips, B. Lud̈ascher, Y. Simmhan, M. Giakkoupis, and V. K. Prasanna, "Towards reliable, performant workflows for streaming-applications on cloud platforms," in 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing. IEEE, 2011, pp. 235-244.
27. Y. Simmhan, B. Cao, M. Giakkoupis, and V. Prasanna, "Adaptive rate stream processing for smart grid applications on clouds," in Proceedings of the 2nd international workshop on Scientific cloud computing. ACM, 2011, pp. 33-38.
28. Y. Simmhan, M. Giakkoupis, B. Cao, and V. Prasanna, "On using cloud platforms in a software architecture for smart energy grids," in IEEE International Conference on Cloud Computing (CloudCom). IEEE, 2010.
29. Y. Simmhan, S. Aman, B. Cao, M. Giakkoupis, A. Kumbhare, Q. Zhou, D. Paul, C. Fern, A. Sharma, and V. Prasanna, "An informatics approach to demand response optimization in smart grids," Computer Science Department, University of Southern California, Tech. Rep., 2011.
30. "Restflow documentation," https://sites.google.com/site/ restflowdocs/, 2011.
31. E. Goutard, "Renewable energy resources in energy management systems," in Innovative Smart Grid Technologies Conference Europe (ISGT Europe). IEEE, 2010, pp. 1-6.