Efficient parallel data mining for massive datasets: Parallel random forests classifier

Proceedings of the 2005 International Conference on Parallel and Distributed Processing Techniques and Applications, PDPTA'05

Volumn 3, Issue , 2005, Pages 1142-1148

  Dai, Jianyong ^a   Lee, Joohan ^a   Wang, Morgan C ^b  

^a University of Central Florida   (United States)

^b UNIVERSITY OF CENTRAL FLORIDA   (United States)

Author keywords

Cluster computing; Data mining; Parallel processing; Random forests

Indexed keywords

DATA MINING ALGORITHMS; DATA SET SIZES; DATA SETS; HIDDEN PATTERNS; MAJORITY VOTING; MASSIVE DATA SETS; PARALLEL AND DISTRIBUTED PROCESSING; PARALLEL DATA MININGS; PARALLEL PROCESSING; PARALLELIZATION; RANDOM FORESTS; RUN-TIME SYSTEMS; DATA MINING ALGORITHM; DATA SET SIZE; PARALLEL DATA MINING; PARALLELIZATIONS; RUNTIME SYSTEMS;

CLUSTER COMPUTING; DATA MINING; DECISION TREES; DISTRIBUTED PARAMETER NETWORKS; HIDDEN MARKOV MODELS; INFORMATION MANAGEMENT;

PARALLEL ALGORITHMS; CLUSTERING ALGORITHMS;

EID: 60749085012     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Jiawei Han, Micheline Kamber, "Data Mining Cencepts and Techniques", pp 5-9, Morgan Kaufmann Publishers, August 2000
2. T. Cover, P. Hart, "Nearest Neighborhood Pattern Classification", IEEE Transactions on Information Theory, Vol 13, pp21-27, 1967
3. R., D. E., G. E. Hinton, and R. J. Williams, "Learning representations by back-propagating errors", Nature, vol 323,1986, pp533-536.
4. Breiman, L. "Random Forests", Machine Learning,45, 5-32, Kluwer Academic Publishers, 2001
5. D.Barbara, W.DuMouchel, C.Faloutsos, PJ.Haas, J.H.Hellerstein, Y.Ioannidis, H.V.Jagadish, T.Johnson, R.Ng, V.Poosala, K.A.Ross, and K.C.Servcik. ""The New Jersey data reduction report", "Bulletin of the Technical Committee on Data Engineering", 20:3-45, Dec. 1997
6. M. J. Zaki, C. Ho, R. Agrawal, "Parallel Classification for Data Mining on Shared-Memory Multiprocessors", 15th Internation Conference on Data Engineering, Sydney, Australia, March 23-26,1999
7. D. W. Cheung, Y. Xiao, "Effect of Data Distribution in Parallel Mining of Associations", High Performance Data Mining, Kluwer Academic Publishers, 1999.
8. A. A. Freitas, "A survey on parallel data mining", Proc. 2nd Int. Conf. on the Practical Applications of Knowledge Discovery and Data Mining, London, UK, Mar. 1998, pp 287-300.
9. D. L.A. Araujo, H. S. Lopes, A. A. Freitas, "Rule Discovery with a Parallel Genetic Algorithm", Proc. 2000 Genetic and Evolutionary Computation Workshop, Las Vegas, July 2000, pp 89-92.
10. Inderjit S. Dhillon , Dharmendra S. Modha, A Data-Clustering Algorithm on Distributed Memory Multiprocessors, Revised Papers from Large-Scale Parallel Data Mining, Workshop on Large-Scale Parallel KDD Systems, SIGKDD, August 15,1999, pp 245-260.
11. Z., S., W., M., Klauer, B., W., K., "Pipelining and parallel training of neural networks on distributed-memory multiprocessors", IEEE World Congress on Computational Intelligence, 4(27), June 1994, pp 2052-2057.
12. Joohan Lee, Muazzam Siddiqui, "High Performance Data Mining for Network Intrusion Detection Using Cluster Computing", International Conference on Parallel and Distributed Computing and Systems (PDCS 2004), MIT Cambridge, November 2004.
13. Joohan Lee, Hua Zhang, Ratan Guha, "Portable and Scalable Parallel Applications with VCluster", 19th European Simulation Multiconference, Performance Computing & Simulation (HPC&S) Conference, Riga, Latvia, June 2005.
14. Joohan Lee, Hua Zhang, Ratan Guha, "Virtual Cluster Computing Architecture", The International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA), Las Vegas, June 2005.
15. J.R.Quinlan, "Induction of decision trees", "Machine Learning", 1:81-106,1986
16. J.R.Quinlan, "C4.5:Programs for Machine Learning", San Mateo, CA:Morgan Kaufmann, 1993
17. L.Breiman, J.Friedman, R.Olshen, and C.Stone. "Classification and Regression Trees", Monterey, CA:Wadsworth International Group, 1984
18. G.V.Kass, "An exploratory technique for investigating large quantities of categorical data", "Applied Statistics", 29:119-127,1980
19. Bauer, E. and Kohavi, R "An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting and Variants", "Machine Learning", 1999
20. Breiman, L. "Bagging Prediction", Machine Learning, 26,123-140,1996
21. Breiman, L. "Arcing Classifier", Annals of Statistics, 26, 801-824, 1998
22. H.Euihon, K.Vipin, S.Vineet, "Parallel Formulations of Decision-Tree Classification Algorithms", Data Mining and Knowledge Discovery, 3.237-261, Kluwer Academic Publishers, 1999