Scalable and elastic realtime click stream analysis using StreamMine3G

DEBS 2014 - Proceedings of the 8th ACM International Conference on Distributed Event-Based Systems

Volumn , Issue , 2014, Pages 198-205

  Martin, André ^a   Brito, Andrey ^b   Fetzer, Christof ^a  

^a DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

^b FEDERAL UNIVERSITY OF CAMPINA GRANDE   (Brazil)

Author keywords

click stream analysis; ESP; migration; scalability; state management

Indexed keywords

DATA COMMUNICATION SYSTEMS; SCALABILITY; SOCIAL NETWORKING (ONLINE); SOFTWARE ARCHITECTURE;

BUSINESS OPPORTUNITIES; CLICKSTREAMS; DELEGATION MECHANISMS; ESP; MIGRATION; POTENTIAL CUSTOMERS; SOCIAL NETWORK SITES; STATE MANAGEMENT;

ENGINES;

EID: 84903149269     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2611286.2611304     Document Type: Conference Paper

References (22)

1. Amazon aws. https://aws.amazon.com, February, 15th 2014.
2. Apache httpd piped logs. https://httpd.apache.org/docs/2.2/logs. html#piped, February, 15th 2014.
3. Boost.asio. http://www.boost.org/doc/libs/1-55-0/doc/html/boost-asio. html, February, 15th 2014.
4. hadoop. http://hadoop.apache.org/, February, 15th 2014.
5. netty.io. http://netty.io/, February, 15th 2014.
6. Storm. http://storm-project.net/, February, 15th 2014.
7. Streammine3g. https://streammine3g.inf.tu-dresden.de/, February, 15th 2014.
8. zeromq. http://zeromq.org/, February, 15th 2014.
9. D. J. Abadi, Y. Ahmad, M. Balazinska, U. Cetintemel, M. Cherniack, J.-H. Hwang, W. Lindner, A. S. Maskey, A. Rasin, E. Ryvkina, N. Tatbul, Y. Xing, and S. Zdonik. The design of the borealis stream processing engine. In Proceedings of the 2nd Biennial Conference on Innovative Data Systems Research (CIDR'05), Asilomar, CA, January 2005.
10. A. Brito, A. Martin, T. Knauth, S. Creutz, D. Becker, S. Weigert, and C. Fetzer. Scalable and low-latency data processing with stream mapreduce. In Cloud Computing Technology and Science (CloudCom), 2011 IEEE Third International Conference on, pages 48-58, 2011.
11. R. Castro Fernandez, M. Migliavacca, E. Kalyvianaki, and P. Pietzuch. Integrating scale out and fault tolerance in stream processing using operator state management. In Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data, SIGMOD '13, pages 725-736, New York, NY, USA, 2013. ACM.
12. J. Dean and S. Ghemawat. Mapreduce: simplified data processing on large clusters. Commun. ACM, 51(1):107-113, Jan. 2008.
13. Y. Gu, Z. Zhang, F. Ye, H. Yang, M. Kim, H. Lei, and Z. Liu. An empirical study of high availability in stream processing systems. In Proceedings of the 10th ACM/IFIP/USENIX International Conference on Middleware, Middleware '09, pages 23:1-23:9, New York, NY, USA, 2009. Springer-Verlag New York, Inc.
14. V. Gulisano, R. Jimenez-Peris, M. Patino-Martinez, C. Soriente, and P. Valduriez. Streamcloud: An elastic and scalable data streaming system. IEEE Transactions on Parallel and Distributed Systems, 23:2351-2365, 2012.
15. T. Heinze, A. Martin, M. Pasin, R. Barazzutti, C. Fetzer, P. Felber, Z. Jerzak, E. Onica, and E. Riviere. estreamhub: Elastic scaling of a high-throughput content-based publish/subscribe engine. ICDCS '14, Washington, DC, USA, 2014. IEEE Computer Society.
16. P. Hunt, M. Konar, F. P. Junqueira, and B. Reed. Zookeeper: Wait-free coordination for internet-scale systems. In In USENIX Annual Technical Conference.
17. Y. Kwon, M. Balazinska, and A. Greenberg. Fault-tolerant stream processing using a distributed, replicated file system. volume 1, pages 574-585. VLDB Endowment, Aug. 2008.
18. A. Martin, A. Brito, and C. Fetzer. Active replication at (almost) no cost. In SRDS '11: Proceedings of the 2011 30th IEEE International Symposium on Reliable Distributed Systems, pages 21-30, Washington, DC, USA, Oct 2011. IEEE Computer Society.
19. A. Martin, R. Marinho, A. Brito, and C. Fetzer. Grand challenge: Predicting energy consumption with streammine3g. In Proceedings of the 8th ACM International Conference on Distributed Event-based Systems, DEBS '14, New York, NY, USA, 2014. ACM.
20. L. Neumeyer, B. Robbins, A. Nair, and A. Kesari. S4: Distributed stream computing platform. In ICDM Workshops, pages 170-177, 2010.
21. D. L. Quoc, A. Martin, and C. Fetzer. Scalable and real-time deep packet inspection. In Workshop on Distributed Cloud Computing (DCC 2013), UCC '13, pages 446-451, Washington, DC, USA, 2013. IEEE Computer Society.
22. M. A. Shah, J. M. Hellerstein, S. Chandrasekaran, and M. J. Franklin. Flux: An adaptive partitioning operator for continuous query systems. In Proceeding of the 19th Internationsal Conference on Data Engineering, pages 25-36, 2003.