Predictable Low-Latency Event Detection With Parallel Complex Event Processing

IEEE Internet of Things Journal

Volumn 2, Issue 4, 2015, Pages 274-286

  Mayer, Ruben ^a   Koldehofe, Boris ^b   Rothermel, Kurt ^a  

^a UNIVERSITY OF STUTTGART   (Germany)

^b DARMSTADT UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Complex event processing (CEP); data parallelization; quality of service; self adaptation; stream processing

Indexed keywords

QUALITY OF SERVICE;

COMPLEX EVENT PROCESSING; COMPLEX EVENT PROCESSING (CEP); DATA PARALLELIZATION; DEGREE OF PARALLELISM; DISTRIBUTED INTELLIGENCE; INTERNET OF THING (IOT); SELF ADAPTATION; STREAM PROCESSING;

INTERNET OF THINGS;

EID: 84938857409     PISSN: None     EISSN: 23274662     Source Type: Journal    
DOI: 10.1109/JIOT.2015.2397316     Document Type: Article

References (50)

1. International Data Corporation (IDC). (2014, Apr.). "The digital universe of opportunities: Rich data and the increasing value of the Internet of Things" [Online]. Available: http://www.emc.com/leadership/digitaluniverse/2014iview/internet-of-things.htm
2. L. Atzori, A. Iera, and G. Morabito, "The internet of things: A survey," Comput. Netw., vol. 54, no. 15, pp. 2787-2805, Oct. 2010.
3. D. Miorandi, S. Sicari, F. D. Pellegrini, and I. Chlamtac, "Internet of Things: Vision, applications and research challenges," Ad Hoc Netw., vol. 10, no. 7, pp. 1497-1516, 2012.
4. Y. Simmhan, B. Cao, M. Giakkoupis, and V. K. Prasanna, "Adaptive rate stream processing for smart grid applications on clouds," in Proc. 2nd Int. Workshop Sci. Cloud Comput. (ScienceCloud'11), 2011, pp. 33-38.
5. Z. Jerzak and H. Ziekow, "The debs 2014 grand challenge," in Proc. 8th ACM Int. Conf. Distrib. Event-Based Syst. (DEBS'14), 2014, pp. 266-269.
6. R. C. Fernandez, M. Weidlich, P. Pietzuch, and A. Gal, "Scalable stateful stream processing for smart grids," in Proc. 8th ACM Int. Conf. Distrib. Event-Based Syst. (DEBS'14), 2014, pp. 276-281.
7. D. C. Luckham, The Power of Events: An Introduction to Complex Event Processing in Distributed Enterprise Systems. Reading, MA, USA: Addison-Wesley, 2001.
8. A. Buchmann and B. Koldehofe, Eds., IT-Information Technology. Munich, Germany: Oldenbourg Verlag, Oct. 2009, vol. 51.
9. G. Cugola and A. Margara, "Tesla: A formally defined event specification language," in Proc. 4th ACM Int. Conf. Distrib. Event-Based Syst. (DEBS'10), 2010, pp. 50-61.
10. G. G. Koch, B. Koldehofe, and K. Rothermel, "Cordies: Expressive event correlation in distributed systems," in Proc. 4th ACM Int. Conf. Distrib. Event-Based Syst. (DEBS'10), 2010, pp. 26-37.
11. G. Cugola and A. Margara, "Processing flows of information: From data stream to complex event processing," ACM Comput. Surv., vol. 44, no. 3, pp. 15:1-15:62, Jun. 2012.
12. R. Mayer, B. Koldehofe, and K. Rothermel, "Meeting predictable buffer limits in the parallel execution of event processing operators," in Proc. IEEE Int. Conf. Big Data (BigData'14), 2014, pp. 402-411.
13. S. Chakravarthy and D. Mishra, "Snoop: An expressive event specification language for active databases," Data Knowl. Eng., vol. 14, no. 1, pp. 1-26, 1994.
14. M. Cherniack et al., "Scalable distributed stream processing," in Proc. CIDR 1st Biennial Conf. Innovative Data Syst. Res., Asilomar, CA, USA, Jan. 2003.
15. B. Koldehofe, R. Mayer, U. Ramachandran, K. Rothermel, and M. Völz, "Rollback-recovery without checkpoints in distributed event processing systems," in Proc. 7th ACM Int. Conf. Distrib. Event-Based Syst. (DEBS'13), 2013, pp. 27-38.
16. B. Ottenwälder, R. Mayer, and B. Koldehofe, "Distributed complex event processing for mobile large-scale video applications," in Proc. Posters Demos Session, 2014, pp. 5-6.
17. B. Ottenwälder et al., "Mcep: A mobility-aware complex event processing system," ACM Trans. Internet Technol., vol. 14, no. 1, pp. 6:1-6:24, Aug. 2014.
18. B. Ottenwälder, B. Koldehofe, K. Rothermel, and U. Ramachandran, "Migcep: Operator migration for mobility driven distributed complex event processing," in Proc. 7th ACM Int. Conf. Distrib. Event-based Syst. (DEBS'13), 2013, pp. 183-194.
19. B. Ottenwälder, B. Koldehofe, K. Rothermel, K. Hong, and U. Ramachandran, "Recep: Selection-based reuse for distributed complex event processing," in Proc. 8th ACM Int. Conf. Distrib. Event-Based Syst. (DEBS'14), 2014, pp. 59-70.
20. B. Koldehofe, B. Ottenwälder, K. Rothermel, and U. Ramachandran, "Moving range queries in distributed complex event processing," in Proc. 6th ACM Int. Conf. Distrib. Event-Based Syst. (DEBS'12), 2012, pp. 201-212.
21. S. Chakravarthy and Q. Jiang, "Load shedding in data stream management systems," in Stream Data Processing: A Quality of Service Perspective, vol. 36. New York, NY, USA: Springer, 2009, pp. 137-166.
22. E. Kalyvianaki, T. Charalambous, M. Fiscato, and P. Pietzuch, "Overload management in data stream processing systems with latency guarantees," in Proc. 7th IEEE Int. Workshop Feedback Comput. (Feedback Computing'12), 2012.
23. S. Suhothayan et al., "Siddhi: A second look at complex event processing architectures," in Proc. ACM Workshop Gateway Comput. Environ. (GCE'11), 2011, pp. 43-50.
24. C. Balkesen, N. Dindar, M. Wetter, and N. Tatbul, "Rip: Run-based intra-query parallelism for scalable complex event processing," in Proc. 7th ACM Int. Conf. Distrib. Event-Based Syst. (DEBS'13), 2013, pp. 3-14.
25. A. Martin, A. Brito, and C. Fetzer, "Scalable and elastic realtime click stream analysis using streammine3g," in Proc. 8th ACMInt. Conf. Distrib. Event-Based Syst. (DEBS'14), 2014, pp. 198-205.
26. T. Condie et al., "Mapreduce online," in Proc. 7th USENIX Conf. Netw. Syst. Des. Implementation (NSDI'10), 2010, pp. 21-21.
27. A. Brito et al., "Scalable and low-latency data processing with stream mapreduce," in Proc. IEEE 3rd Int. Conf. Cloud Comput. Technol. Sci. (CloudCom'11), 2011, pp. 48-58.
28. D. Battré et al., "Nephele/pacts: A programming model and execution framework for web-scale analytical processing," in Proc. 1st ACM Symp. Cloud Comput. (SoCC'10), 2010, pp. 119-130.
29. (2014, Sep.) "Storm" [Online]. Available: http://storm-project.net/
30. L. Neumeyer, B. Robbins, A. Nair, and A. Kesari, "S4: Distributed stream computing platform," in Proc. IEEE Int. Conf. Data Min. Workshops (ICDMW'10), Dec. 2010, pp. 170-177.
31. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly, "Dryad: Distributed data-parallel programs from sequential building blocks," in Proc. 2nd ACM SIGOPS/EuroSys Eur. Conf. Comput. Syst. (EuroSys '07), 2007, pp. 59-72.
32. S. Schneider, M. Hirzel, B. Gedik, and K.-L. Wu, "Auto-parallelizing stateful distributed streaming applications," in Proc. 21st Int. Conf. Parallel Archit. Compilation Tech. (PACT'12), 2012, pp. 53-64.
33. P. Bhatotia, U. A. Acar, F. P. Junqueira, and R. Rodrigues, "Slider: Incremental sliding window analytics," in Proc. 15th Int. Middleware Conf. (Middleware'14), 2014, pp. 61-72.
34. M. Hirzel, R. Soulé, S. Schneider, B. Gedik, and R. Grimm, "A catalog of stream processing optimizations," ACM Comput. Surv., vol. 46, no. 4, pp. 46:1-46:34, Mar. 2014.
35. R. Castro Fernandez, M. Migliavacca, E. Kalyvianaki, and P. Pietzuch, "Integrating scale out and fault tolerance in stream processing using operator state management," in Proc. ACM SIGMOD Int. Conf. Manage. Data (SIGMOD'13), 2013, pp. 725-736.
36. B. Gedik, S. Schneider, M. Hirzel, and K.-L. Wu, "Elastic scaling for data stream processing," IEEE Trans. Parallel Distrib. Syst., vol. 25, no. 6, pp. 1447-1463, Jun. 2014.
37. C. f, N. Tatbul, and M. T. Özsu, "Adaptive input admission and management for parallel stream processing," in Proc. 7th ACM Int. Conf. Distrib. Event-Based Syst. (DEBS'13), 2013, pp. 15-26.
38. S. Kounev, "Performance modeling and evaluation of distributed component-based systems using queueing petri nets," IEEE Trans. Softw. Eng., vol. 32, no. 7, pp. 486-502, Jul. 2006.
39. B. Chandramouli, J. Goldstein, R. Barga, M. Riedewald, and I. Santos, "Accurate latency estimation in a distributed event processing system," in Proc. IEEE 27th Int. Conf. Data Eng. (ICDE'11), 2011, pp. 255-266.
40. A. Arasu, S. Babu, and J. Widom, "The cql continuous query language: Semantic foundations and query execution," VLDB J., vol. 15, no. 2, pp. 121-142, Jun. 2006.
41. R. Adaikkalavan and S. Chakravarthy, "Seamless event and data stream processing: Reconciling windows and consumption modes," in Proc. 16th Int. Conf. Database Syst. Adv. Appl. (DASFAA'11), 2011, pp. 341-356.
42. D. Gross, J. Shortle, J. Thompson, and C. Harris, Fundamentals of Queueing Theory. Hoboken, NJ, USA: Wiley, 2011.
43. N. R. Herbst, N. Huber, S. Kounev, and E. Amrehn, "Self-adaptive workload classification and forecasting for proactive resource provisioning," Concurrency Comput. Pract. Exper., vol. 26, no. 12, pp. 2053-2078, 2014.
44. D. G. Feitelson, Workload Modeling for Computer Systems Performance Evaluation. Cambridge, U.K.: Cambridge Univ. Press, 2015.
45. M. A. Stephens, "Edf statistics for goodness of fit and some comparisons," J. Amer. Stat. Assoc., vol. 69, no. 347, pp. 730-737, 1974.
46. T. M. Franke, T. Ho, and C. A. Christie, "The chi-square test: Often used and more often misinterpreted," Amer. J. Eval., vol. 33, no. 3, pp. 448-458, 2012.
47. S. K. Bose. (2014). M/m/m/inf Queue [Online]. Available: http://nptel.ac.in/courses/117103017/6.
48. H. Tijms, "New and old results for the m/d/c queue," AEU-Int. J. Electron. Commun., vol. 60, no. 2, pp. 125-130, 2006.
49. V. Guerriero, "Power law distribution: Method of multi-scale inferential statistics," J. Mod. Math. Frontier (JMMF), vol. 1, pp. 21-28, 2012.
50. R. Mao and G. Mao, "Road traffic density estimation in vehicular networks," in Proc. IEEE Wireless Commun. Netw. Conf. (WCNC'13), Apr. 2013, pp. 4653-4658.