A grid-based approach for enterprise-scale data mining

Future Generation Computer Systems

Volumn 23, Issue 1, 2007, Pages 48-54

  Natarajan, Ramesh ^a   Sion, Radu ^b   Phan, Thomas ^c  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b Stony Brook University   (United States)

^c IBM ALMADEN RESEARCH CENTER   (United States)

Author keywords

Data mining; Grid computing; Parallel databases; Predictive modeling

Indexed keywords

ADMINISTRATIVE DATA PROCESSING; ALGORITHMS; COMPUTATION THEORY; DATA MINING; DATA TRANSFER; DATABASE SYSTEMS; PARALLEL PROCESSING SYSTEMS; STATISTICAL METHODS;

COMMODITY PROCESSORS; GRID COMPUTING; PARALLEL DATABASE TECHNOLOGY; STATISTICAL COMPUTATIONS;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 33748453304     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2006.04.003     Document Type: Article

References (27)

1. Apte C., Liu B., Pednault E.P.D., and Smyth P. Business applications of data mining. Communications of the ACM 45 8 (2002) 49-53
2. Johnston W.E. Computational and data grids in large-scale science and engineering. Future Generation Computer Systems 8 (2002) 1085-1100
3. Arnold D., Vadhiyar S., and Dongarra J. On the convergence of computational and data grids. Parallel Processing Letters 11 (2001) 187-202
4. The IBM DB2 Universal Database V8.1 (2004). http://www.ibm.com/software/data/db2
5. The IBM DB2 Information Integrator (2004). http://www.ibm.com/software/integration
6. ISO/IEC 13249 Final Committee Draft, Information Technology-Database Languages-SQL Multimedia and Application Packages (2002). http://www.iso.org
7. Predictive Modeling Markup Language (2002). http://www.dmg.org
8. DeGroot M.H., and Schervish M.J. Probability and Statistics. third ed. (2002), Addison Wesley
9. Prodromides A., Chan P., and Stolfo S. Meta learning in distributed data systems - issues and approaches. In: Kargupta H., and Chan P. (Eds). Advances in Distributed Data Mining (2000), AAAI Press
10. Cannataro M., Talia D., and Trunfio P. Distributed data mining on the grid. Future Generation Computer Systems 18 (2002) 1101-1112
11. Breiman L. Bagging predictors. Machine Learning 24 2 (1996) 123-140
12. Giudici P., and Castelo R. Improving Markov chain Monte Carlo model search for data mining. Machine Learning 50 (2003) 127-158
13. Graefe G., Fayyad U., and Chaudhuri S. On the efficient gathering of sufficient statistics for classification from large SQL databases. Proceedings Fourth International Conference on Knowledge Discovery and Data Mining (1998), AAAI Press, Menlo Park 204-208
14. Caragea D., Silvescu A., and Honavar V. A framework for learning from distributed data using sufficient statistics and its application to learning decision trees. International Journal of Hybrid Intelligent Systems 1 (2004) 80-89
15. Moore A., and Lee M.S. Cached sufficient statistics for efficient machine learning with massive datasets. Journal of Artificial Intelligence Research 8 (1998) 67-91
16. R. Natarajan, E.P.D. Pednault, Using simulated pseudo data to speed up statistical predictive modeling from large data sets, in: Proceedings of the 1st SIAM Conference on Data Mining, Chicago IL, 2000
17. N. Friedman, L. Getoor, Efficient learning using constrained sufficient statistics, in: Proceedings of the 7th International Workshop on Artificial Intelligence and Statistics, 1999
18. Apte C., Natarajan R., Pednault E., and Tipu F. A probabilistic framework for predictive modeling analytics. IBM Systems Journal 41 3 (2002)
19. Apte C., Grossman E., Pednault E., Rosen B., Tipu F., and White B. Probabilistic estimation based data mining for discovering insurance risks. IEEE Intelligent Systems 14 6 (1999)
20. R. Natarajan, E.P.D. Pednault, Segmented regression estimators for massive data sets, in: Proceedings of the 2nd SIAM Conference on Data Mining, Crystal City, VA, 2002
21. A. Dorneich, E. Pednault, R. Natarajan, F. Tipu, Embedded predictive modeling in a parallel relational database, in: Proceedings of the 21st ACM Symposium on Applied Computing, Dijon, France, 2006
22. M. Jaedicke, B. Mitschang, On parallel processing of aggregate and scalar function in object-relational DBMS, in: Proceedings of the ACM SIGMOD Int. Conf. on Management of Data, Seattle, WA, 1998
23. Atkinson M., Chervenak A.L., Kunszt P., Narang I., Paton N.W., Pearson D., Shoshani A., and Wilson P. Data access, integration and management. In: Foster I., and Kesselman C. (Eds). The Grid: Blueprint for a New Computing Infrastructure. second ed. (2003), Morgan Kaufman (Chapter 22)
24. M. Rodriguez-Martinez, N. Roussopoulos, MOCHA: A self-extensible database middleware system for distributed data sources, in: Proceedings of the ACM SIGMOD International Conference for Distributed Data Sources, Dallas, TX, 2000, pp. 213-224
25. Kossmann D., Franklin M.J., and Drasch G. Cache investment: Integrating query optimization and distributed data placement. ACM Transactions on Database Systems 25 (2000) 517-558
26. The IBM DB2 XML Extender (2004). http://www.ibm.com/software/data/db2/extender/xmlext
27. R. Sion, R. Natarajan, I. Narang, W. Li, T. Phan, XG: A data-driven computational grid for enterprise-scale mining, in: Proceedings of the 16th International Conference on Database and Expert Systems Applications, Copenhagen, Denmark, 2005