Challenges and experience in prototyping a multi-modal stream analytic and monitoring application on system S

33rd International Conference on Very Large Data Bases, VLDB 2007 - Conference Proceedings

Volumn , Issue , 2007, Pages 1185-1196

  Wu, Kun Lung ^a   Yu, Philip S ^a   Gedik, Buǧra ^a   Hildrum, Kirsten W ^a   Aggarwal, Charu C ^a   Bouillet, Eric ^a   Fan, Wei ^a   George, David A ^a   Gu, Xiaohui ^a   Luo, Gang ^a   Wang, Haixun ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DISASTERS; DISTRIBUTED PARAMETER CONTROL SYSTEMS; FLOW GRAPHS; MIDDLEWARE;

CRITICAL CHALLENGES; DESIGN AND IMPLEMENTS; DISTRIBUTED CLUSTERS; DISTRIBUTED STREAM PROCESSING; MONITORING APPLICATIONS; PROCESSING ELEMENTS; PROGRAMMING SUPPORT; RESOURCE ADAPTIVE COMPUTATION;

SOFTWARE PROTOTYPING;

EID: 85011101226     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. D. J. Abadi, Y. Ahmad, M. Balazinska, U. Cetintemel, M. Cherniack, J.-H. Hwang, W. Lindner, A. S. Maskey, A. Rasin, E. Ryvkina, N. Tatbul, Y. Xing, and Z. Zdonik. The design of the Borealis stream processing engine. In Proc. of CIDR, 2005.
2. C. C. Aggarwal, J. Han, J. Wang, and P. S. Yu. A framework for projected clustering of high dimensional streams. In Proc. of VLDB, 2004.
3. C. C. Aggarwal, J. Han, J. Wang, and P. S. Yu. On-demand classification of evolving data streams. In Proc. of ACM SIGKDD, 2004.
4. K. S. Anderson, J. P. Bigus, E. Bouillet, P. Dube, N. Halim, Z. Liu, and D. Pendarakis. SWORD: Scalable and flexible workload generator for distributed data processing systems. In Proc. of the 2006 Winter Simulation Conference, 2006.
5. A. Arasu, B. Babcock, M. Datar, K. Ito, I. Nishizawa, J. Rosenstein, and J. Widom. STREAM: The Stanford stream data manager (demo proposal). In Proc. of ACM SIGMOD, 2003.
6. S. Chandrasekaran, O. Cooper, A. Deshpande, M. J. Franklin, J. M. Hellerstein, W. Hong, S. Krishnamurthy, S. Madden, V. Raman, F. Reiss, and M. Shah. TelegraphCQ: Continuous dataflow processing for an uncertain world. In Proc. of CIDR, 2003.
7. Y. Chi, P. S. Yu, H. Wang, and R. R. Muntz. Loadstar: A load shedding scheme for classifying data streams. In Proc. of SIAM Data Mining, 2005.
8. W. Fan, E. Greengrass, J. McClosky, K. Drummey, and P. S. Yu. Effectiveness estimation of posterior probabilities: Explaining the accuracy of randomized decision tree approaches. In Proc. of IEEE ICDM, 2005.
9. W. Fan, J. McClosky, and P. S. Yu. A general framework for fast and accurate regression by data summarization in random decision trees. In Proc. of ACM SIGKDD, 2006.
10. B. Gedik, K.-L. Wu, P. S. Yu, and L. Liu. Adaptive load shedding for windowed stream joins. In Proc. of ACM CIKM, 2005.
11. B. Gedik, K.-L. Wu, P. S. Yu, and L. Liu. A load shedding framework and optimizations for M-way windowed stream joins. In Proc. of IEEE ICDE, 2007.
12. X. Gu, Z. Wen, C.-Y. Lin, and P. S. Yu. Design and implementation of an adaptive distributed on-line video correlation system. In ACM Multimedia, 2006.
13. X. Gu and P. S. Yu. Adaptive load diffusion for stream joins. In Middleware, 2005.
14. X. Gu, P. S. Yu, and H. Wang. Adaptive load diffusion for multiway windowed stream joins. In Proc. of IEEE ICDE, 2007.
15. K. W. Hildrum and P. S. Yu. Focused community discovery. In Proc. of IEEE ICDM, 2005.
16. IBM. UIMA. http://www.research.ibm.com/UIMA/.
17. IBM. Cell broadband engine architecture, technical report version 1.0. IBM Systems and Technology Group, 2005.
18. N. Jain, L. Amini, H. Andrade, R. King, Y. Park, P. Selo, and C. Venkatramani. Design, implementation and evaluation of the linear road benchmark on the stream processing core. In Proc. of ACM SIGMOD, 2006.
19. G. Luo, C. Tang, and P. S. Yu. Resource-adaptive real-time new event detection. In Proc. of ACM SIGMOD, 2007.
20. G. Luo, K.-L. Wu, and P. S. Yu. SAO: A stream index for answering linear optimization queries. In Proc. of IEEE ICDE, 2007.
21. S. R. Madden, M. A. Shah, J. M. Hellerstein, and V. Raman. Continuously adaptive continuous queries over streams. In Proc. of ACM SIGMOD, 2002.
22. Streambase. http://www.streambase.com.
23. K.-L. Wu, S.-K. Chen, and P. S. Yu. Query indexing with containment-encoded intervals for efficient stream processing. Knowledge and Information Systems, 9(1): 62-90, Jan. 2006.
24. S. Zdonik, M. Stonebraker, M. Cherniak, U. Cetintemel, M. Balazinska, and H. Balakrishnan. The Aurora and Medusa projects. IEEE Technical Committee on Data Engineering, Mar. 2003.