Dynamic querying of streaming data with the dQUOB system

IEEE Transactions on Parallel and Distributed Systems

Volumn 14, Issue 4, 2003, Pages 422-432

  Plale, Beth ^a   Schwan, Karsten ^b  

^a INDIANA UNIVERSITY   (United States)

^b Georgia Institute of Technology   (United States)

Author keywords

Data streams; Data intensive computations; Database query processing; Grid computing; Publish subscribe event channels; Relational data model; SQL

Indexed keywords

DATA TRANSFER; DATABASE SYSTEMS; FOURIER TRANSFORMS; QUERY LANGUAGES; ROBOTS;

DATA STREAMING;

PARALLEL PROCESSING SYSTEMS;

EID: 0038633579     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2003.1195413     Document Type: Article

References (37)

1. A. Afjeh, P. Homer, H. Lewandowski, J. Reed, and R. Schlichting, "Development of an Intelligent Monitoring and Control System for a Heterogeneous Numerical Propulsion System Simulation," Proc. 28th Ann. Simulation Symp., Apr. 1995.
2. R. Avnur and J.M. Hellerstein, "Eddies: Continuously Adaptive Query Processing," Proc. Int'l Conf. Management of Data (SIGMOD), 2000.
3. S. Babu and J. Widom, "Continuous Queries over Data Streams," Proc. Int'l Conf. Management of Data (SIGMOD), 2001.
4. G. Banavar, T. Chandra, B. Mukherjee, J. Nagarajarao, R. Storm, and D. Sturman, "An Efficient Multicast Protocol for Content-Based Publish-Subscribe Systems," Proc. Int'l Conf. Distributed Computing Systems (ICDCS '99), 1999.
5. R. Bramley, K. Chiu, S. Diwan, D. Gannon, M. Govindaraju, N. Mukhi, B. Temko, and M. Yechuri, "A Component Based Services Architecture for Building Distributed Applications," Proc. IEEE Int'l High Performance Distributed Computing Symp. (HPDC), Aug. 2000.
6. P.E. Bustamante and K. Schwan, "Active I/O Streams for Heterogeneous High Performance Computing," Proc. Parallel Computing (ParCo) '99, Aug. 1999.
7. A. Carzaniga, D.S. Rosenblum, and A.L. Wolf, "Design and Evaluation of a Wide-Area Event Notification Service," ACM Trans. Computer Systems, vol. 19, no. 3, pp. 332-383, Aug. 2001.
8. A. Chervenak, I. Foster, C. Kesselman, C. Salisbury, and S. Tuecke, "The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Data Sets," J. Network and Comput. Appl. (to appear).
9. E. Deelman, K. Blackburn, P. Ehrens, C. Kesselman, S. Koranda, and A. Lazzarin, "Griphyn and Ligo, Building a Virtual Data Grid for Gravitational Wave Scientists," Proc. 11th IEEE Int'l High Performance Distributed Computing (HPDC), Aug. 2002.
10. P.A. Dinda and D.R. O'Hallaron, "An Extensible Toolkit for Resource Prediction in Distributed Systems," technical report, Carnegie Mellon Univ., 1999.
11. G. Eisenhauer, F. Bustamente, and K. Schwan, "Event Services for High Performance Computing," Proc. Ninth IEEE Int'l High Performance Distributed Computing Symp. (HPDC), Aug. 2000.
12. R Ferreira, T. Kurc, M. Beynon, C. Chang, and J. Saltz, "Object-Relational Queries into Multidimensional Databases with the Active Data Repository," J. Supercomputer Applications and High Performance Computing (IJSA), 1999.
13. I. Foster, J. Insley, G. von Laszewski, C. Kesselman, and M. Thiebaux, "Distance Visualization: Data Exploration on the Grid," Computer, vol. 32, no. 12, pp. 36-43, Dec. 1999.
14. The Grid: Blueprint for a New Computing Infrastructure. I. Foster and C. Kesselman, eds. Morgan Kaufmann, 1999.
15. I. Foster, C. Kesselman, and S. Tuecke, "The Anatomy of the Grid: Enabling Scalable Virtual Organizations," Int'l J. Supercomputer Applications, 2001.
16. G. Fox and S. Pallickara, "An Event Service to Support Grid Computational Environments," J. Concurrency and Computation: Practice and Experience - Special Issue on Grid Computing Environments, 2002.
17. D. Gunter, B. Tierney, B. Crowley, K. Jackson, J. Lee, and M. Stoufer, "Dynamic Monitoring of High-Performance Distributed Applications," Proc. 11th IEEE Int'l High Performance Distributed Computing Symp. (HPDC), Aug. 2002.
18. M.J. Harrold and G. Rothermel, "Performing Dataflow Testing on Classes," Proc, ACM Symp, Foundations of Software Eng., Dec. 1994.
19. W. Hibbard, "VisAD: Connecting People to Computations and People to People," Computer Graphics, vol. 32, no. 3, pp. 10-12, 1998.
20. C. Isert and K. Schwan, "ACDS: Adapting Computational Data Streams for High Performance," Proc. Int'l Parallel and Distributed Processing Symp. (IPDPS), May 2000.
21. C.E. Kilpatrick and K. Schwan, "Using Languages for Describing Capture, Analysis, and Display of Performance Information for Parallel and Distributed Applications," Proc. IEEE Int'l Conf. Computer Languages, Mar. 1990.
22. F. Kon, R. Campbell, M. Mickunas, K. Nahrstedt, and F. Ballesteros, "2K: A Distributed Operating System for Dynamic Heterogeneous Environments," Proc. IEEE Int'l High Performance Distributed Computing Symp. (HPDC), 2000.
23. L. Liu, C. Pu, and W. Tang, "Continual Queries for Internet Scale Event-Driven Information Delivery," IEEE Trans. Knowledge and Data Eng., Special issue on Web technologies, Jan. 1999.
24. S. Madden and M.J., Franklin, "Fjording the Stream: An Architecture for Queries Over Streaming Sensor Data," Proc. Int'l Conf. Data Eng. (ICDE), 2002.
25. D. Ogle, K. Schwan, and R. Snodgrass, "Application-Dependent Dynamic Monitoring of Distributed and Parallel Systems," IEEE Trans, Parallel and Distributed Systems, vol. 4, no. 7, pp. 762-778, July 1993.
26. G. Piatetsky-Shapiro and C. Connell, "Accurate Estimation of the Number of Tuples Satisfying a Condition," Proc. ACM. SIGMOD Conf., pp. 256-276, June 1984.
27. B. Plale, "Leveraging Run Time Knowledge about Event Rates to Improve Memory Utilization in Wide Area Data Stream Filtering," Proc. 11th IEEE Int'l High Performance Distributed Computing Symp. (HPDC), Aug. 2002.
28. B. Plale, V. Elling, G. Eisenhauer, K. Schwan, D. King, and V. Martin, "Realizing Distributed Computational Laboratories," Int'l J. Parallel and Distributed Systems and Networks, vol. 2, no. 3, pp. 180-190, 1999.
29. B. Plale and K. Schwan, "Run-Time Detection in Parallel and Distributed Systems: Application to Safety-Critical Systems," Proc. Int'l Conf. Distributed Computing Systems (ICDCS), pp. 163-170, June 1999.
30. B. Plale and K. Schwan, "dQUOB: Managing Large Data Flows Using Dynamic Embedded Queries," Proc. Ninth IEEE Int'l High Performance Distributed Computing Symp. (HPDC), Aug. 2000.
31. R. Ribler, J. Vetter, H. Simitci, and D. Reed, "Autopilot: Adaptive Control of Distributed Applications," Proc. IEEE Int'l High Performance Distributed Computing Symp. (HPDC), Aug. 1999.
32. B. (Plale) Schroeder, S. Aggarwal, and K. Schwan, "Software Approach to Hazard Detection Using On-Line Analysis of Safety Constraints," Proc. 16th Symp. Reliable and Distributed Systems (SRDS '97), pp. 80-87, Oct. 1997.
33. S. Smallen, H. Casanova, and F. Berman, "Applying Scheduling and Tuning to On-Line Parallel Tomography," Proc. ACM/IEEE Supercomputing 2001, 2001.
34. R. Snodgrass, "A Relational Approach to Monitoring Complex Systems," IEEE Trans. Computers, vol. 37, no. 2, pp. 156-196, May 1988.
35. D. Terry, D. Goldberg, D. Nichols, and B. Oki, "Continuous Queries over Append-Only Databases," Proc. Int'l Conf. Management of Data (SIGMOD), 1992.
36. Active Database Systems. J. Widom and S. Ceri, eds. Morgan Kaufmann, 1996.
37. R. Wolski, "Dynamically Forecasting Network Performance to Support Dynamic Scheduling Using the Network Weather Service," Proc. IEEE Int'l High Performance Distributed Computing Symp. (HPDC), Aug. 1997.