Design and analysis of a multi-dimensional data sampling service for large scale data analysis applications

20th International Parallel and Distributed Processing Symposium, IPDPS 2006

Volumn 2006, Issue , 2006, Pages

  Xi, Zhang ^a,b   Kurc, Tahsin ^a   Saltz, Joel ^a,b   Parthasarathy, Srinivasan ^a,b  

^a OHIO STATE UNIVERSITY   (United States)

^b Ohio State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA REDUCTION; DISTRIBUTED DATABASE SYSTEMS; LARGE SCALE SYSTEMS; TREES (MATHEMATICS);

DATA SAMPLING; HILBERT SPACE FILLING CURVES; R-TREE BASED TECHNIQUES; SPATIAL LOCALITY;

DATA MINING;

EID: 33847164107     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2006.1639315     Document Type: Conference Paper

References (22)

1. L. T. Chen and D. Rotem. Declustering objects for visualization, pages 85-96, Dublin, Ireland, Aug. 1993.
2. D. DeWitt and J. Gray. Parallel database systems: the future of high performance database systems. Commun. ACM, 35(6):85-98, June 1992.
3. P. Domingos and G. Hulten. A general method for scaling up machine learning algorithms and its applications to clustering. In Proceedings of the International Conference on Machine Learning, 2001.
4. H. Du and J. Sobolewski. Disk allocation for Cartesian product files on multiple-disk systems. ACM Transactions on Database Systems, 7(1):82-101, Mar. 1982.
5. C. Faloutsos and P. Bhagwat. Declustering using fractals. pages 18-25, San Diego, CA, Jan. 1993.
6. M. Fang, R. Lee, and C. Chang. The idea of de-clustering and its applications, pages 181-188, Kyoto, Japan, 1986.
7. A. Guttman. R-Trees: A dynamic index structure for spatial searching, pages 47-57, Boston, MA, June 1984.
8. H. V. Jagadish. Linear clustering of objects with multiple attributes. In SIGMOD '90: Proceedings of the 1990 ACM SIGMOD international conference on Management of data, pages 332-342, New York, NY, USA, 1990. ACM Press.
9. C. Jermaine, A. Pol, and S. Arumugam. Online maintenance of very large random samples. In Proceedings of the International Conference on Management of Data, 2004.
10. I. Jolliffe. Principle Component Analysis. Spring-Verlag, New York, NY, USA, 1986.
11. J. K. Lawder and P. J. H. King. Querying multi-dimensional data indexed using the hilbert space-filling curve. SIGMOD Rec., 30(1): 19-24, 2001.
12. D.-R. Liu and S. Shekhar. A similarity graph-based approach to declustering problems and its applications towards parallelizing grid files, pages 373-381, Taipei, Taiwan, Mar. 1995.
13. B. Moon, A. Acharya, and J. Saltz. Study of scalable declustering algorithms for parallel grid files, pages 434-440, Honolulu, Hawaii, Apr. 1996. Extended version is available as CS-TR-3589 and UMIACS-TR-96-4.
14. B. Moon, H. V. Jagadish, C. Faloutsos, and J. H. Saltz. Analysis of the clustering properties of the hilbert space-filling curve. Knowledge and Data Engineering, 13(1):124-141, 2001.
15. F. Olken and D. Rotem. Random sampling from database files: A survey. In Proceedings of the International Conference on Scientific and Statistical Database Management, 1990.
16. F. Olken and D. Rotem. Sampling from spatial databases. In ICDE, pages 199-208, 1993.
17. S. Parthasarathy. Efficient progressive sampling for association rules. In Proceedings of the International Conference on Data Mining, 2002.
18. B. Plale, D. Cannon, D. A. Reed, S. J. Graves, K. Droegemeier, B. Wilhelmson, and M. Ramamurthy. Towards dynamically adaptive weather analysis and forecasting in lead. In International. Conference on Computational Science (2), pages 624-631, 2005.
19. F. Provost, D. Jensen, and T. Oates. Efficient progressive sampling. In Proceedings of the International Conference on Knowledge Discovery and Data Mining, 1999.
20. H. Toivonen. Sampling large databases for associations. In Proceedings of the International Conference on Very Large Databases, 1996.
21. J. Vitter. Random sampling with a reservoir. ACM Transactions on Mathematical. Software, 1985.
22. H. Wang, S. Parthasarathy, A. Ghoting, S. Tatikonda, G. Buehrer, T. Kurc, and J. Saltz. Design of a next generation sampling service forlarge scale data analysis applications. In ICS '05: Proceedings of the 19th annual international, conference on Supercomputing, pages 91-100, New York, NY, US A, 2005. ACM Press.