Stream processing in data-driven computational science

Proceedings - IEEE/ACM International Workshop on Grid Computing

Volumn , Issue , 2006, Pages 160-167

  Liu, Ying ^a   Vijayakumar, Nithya N ^a   Plale, Beth ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA MINING; FORECASTING; GRID COMPUTING; RIVERS; WEATHER FORECASTING;

ARCHITECTURAL FRAMEWORKS; COMPUTATIONAL SCIENCES; DATA ACCESSING; DATA DRIVEN (DD); DATA STREAM PROCESSING; EFFECTIVE THROUGHPUT; EVENT PROCESSING; INTERNATIONAL CONFERENCES; LARGE-SCALE DATA; REAL TIME DATA STREAMING; SCIENTIFIC APPLICATIONS; STREAM PROCESSING; WEATHER PREDICTION;

DATA PROCESSING;

EID: 46149120154     PISSN: 15505510     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICGRID.2006.311011     Document Type: Conference Paper

References (29)

1. M. Stonebraker, U. Cetintemel, and S. Zdonik, "The 8 requirements of real-time stream processing," SIGMOD Rec, vol. 34, no. 4, 2005.
2. A. Arasu, B. Babcock, S. Babu, J. Cieslewicz, M. Datar, K. Ito, R. Motwani, U. Srivastava, and J. Widom, "Stream: The Stanford data stream management system," in Data Stream Management, 2004.
3. T Johnson, C. D. Cranor, and O. Spatscheck, "Gigascope: a stream database for network application," in ACM SIGMOD International Conference on Management of Data, 2003.
4. M.G.Koparanova and T.Risch, "High-performance stream-oriented grid database manager for scientific data," in 1st European Across Grids Conference, 2003.
5. A. Arasu, S. Babu, and J. Widom, "The CQL continuous query language: Semantic foundations and query execution," In Very Large Database (VLDB) Journal, vol. 14, no. 1, 2005.
6. D. Luckham, The Power of Events. Addison Wesley, 2002.
7. L. Brownston, R. Farrell, E. Kant, and N. Martin, Programming Expert Systems in OPS5. Addison Wesley, 1985.
8. D. C. Luckham and J. Vera, "An event-based architecture definition language," IEEE Transactions on Software Engineering, vol. 21, no. 9, pp. 717-734, 1995.
9. M. Altinel and M. J. Franklin, "Efficient filtering of XML documents for selective dissemination of information," in The Very Large Database VLDB Conference, 2000.
10. B. Nguyen, S. Abiteboul, G. Cobena, and M. Preda, "Monitoring XML data on the Web," SIGMOD Record, vol. 30, no. 2, pp. 437-448, 2001.
11. R. Avnur and J. M. Hellerstein, "Eddies: continuously adaptive query processing," in ACM SIGMOD International Conference on Management of Data, 2000.
12. S. Chandrasekaran, O. Cooper, A. Deshpande, M. J. Franklin, J. M. Hellerstein, W. Hong, S. Krishnamurthy, S. R. Madden, F. Reiss, and M. A. Shah, "Telegraphcq: Continuous dataflow processing for an uncertain world," in Conference on Innovative Database systems Research (CIDR), 2003.
13. N. Vijayakumar, Y. Liu, and B. Plale, "Calder query grid service: Insights and experimental evaluations," in CCGrid Conference, 2006.
14. D. J. Abadi, Y. Ahmad, M. Balazinska, U. Cetintemel, M. Cherniack, J.-H. Hwang, W. Lindner, A. S. Maskey, A. Rasin, E. Ryvkina, N. Tatbul, Y. Xing, and S. Zdonik, "The Design of the Borealis Stream Processing Engine," in Second Biennial Conference on Innovative Data Systems Research (CIDR) Conference, 2005.
15. U. V. Catalyurek, "Supporting large scale data driven science in distributed environments," in Minisymposium on Distributed Data Management Infrastructures for Scalable Computational Science and Engineering Applications, SIAM Conference on Computational Science and Engineering (SIAM CSE '05), 2005.
16. B. Plale, "Leveraging run time knowledge about event rates to improve memory utilization in wide area data stream filtering," in IEEE International Symposium on High Performance Distributed Computing, 2002.
17. B. Plale and N. Vijayakumar, "Evaluation of rate-based adaptivity in joining asynchronous data streams," in 19th IEEE International Parallel and Distributed Processing Symposium, April 2005.
18. D. Abadi, D. Carney, U. Cetintemel, M. Cherniack, C. Convey, S. Lee, M. Stonebraker, N. Tatbul, and S. Zdonik, "Aurora: A new model and architecture for data stream management," In Very Large Database (VLDB) Journal, vol. 12, no. 2, pp. 120-139, 2003.
19. B. Domenico, "Unidata internet data distribution: Real-time data on the desktop," in Science Information Systems Interoperability Conference (SISIC), 2005.
20. K. K. Droegemeier, V. Chandrasekar, R. Clark, D. Gannon, S. Graves, E. Joseph, M. Ramamurthy, R. Wilhelmson, K. Brewster, B. Domenico, T. Leyton, V. Morris, D. Murray, B. Plale, R. Ramachandran, D. Reed, J. Rushing, D. Weber, A. Wilson, M. Xue, and S. Yalda, "Linked environments for atmospheric discovery (LEAD): A cyberinfrastructure for mesoscale meteorology research and education," in 20th Conf. on Interactive Information Processing Systems for Meteorology, Oceanography, and Hydrology, Seattle, WA, 2004.
21. B. Plale, "Using global snapshots to access data streams on the grid," in Lecture Notes in Computer Science, Volume 3165. Springer Verlag, 2004, 2nd European Across Grids Conference (AxGrids).
22. N. Vijayakumar and B. Plale, "dQUOBEC event channel communication system," Computer Science Department of Indiana University, Tech. Rep. TR614, 2005.
23. D. McMullen, et al., "Instruments and sensors on the grid: Issues and challenges," in GlobusWorld, 2005.
24. Y Liu, B. Plale, and N. Vijayakumar, "Realization of ggf dais data service interface for grid access to data streams," Indiana University, Computer Science Department, Tech. Rep. TR613, 2005.
25. B. Plale, D. Gannon, Y. Huang, G. Kandaswamy, S. L. Pallickara, and A. Slominski, "Cooperating services for data-driven computational experimentation," in Computing in Science and Engineering (CiSE), 2005.
26. J. Rushing, R. Ramachandran, U. Nair, S. Graves, R. Welch, and A. Lin, "ADaM: A data mining toolkit for scientists and engineers," Computers and Geosciences, vol. 31, 2005.
27. "TeraGrid," 2005, http://www.teragrid.org. [Online]. Available: http://www.teragrid.org
28. B. Plale, "Usage study for data storage repository in LEAD," 2005, LEAD TR001.
29. B. Plale and K. Schwan, "Dynamic querying of streaming data with the dquob system," IEEE Transactions on Parallel and Distributed Systems, vol. 14, no. 4, April, 2003.