Parallel data mining from multicore to cloudy grids

Advances in Parallel Computing

Volumn 18, Issue , 2009, Pages 311-340

  Fox, Geoffrey ^a,b   Bae, Seung Hee ^b   Ekanayake, Jaliya ^b   Qiu, Xiaohong ^b   Yuan, Huapeng ^b  

^a INDIANA UNIVERSITY   (United States)

^b INDIANA UNIVERSITY   (United States)

Author keywords

CCR; Clustering; MapReduce; MPI; Multidimensional Scaling; Performance

Indexed keywords

EID: 84906534654     PISSN: 09275452     EISSN: None     Source Type: Book Series    
DOI: 10.3233/978-1-60750-073-5-311     Document Type: Conference Paper

References (47)

1. F. Darema, SPMD model: past, present and future, Recent Advances in Parallel Virtual Machine and Message Passing Interface, 8th European PVM/MPI Users' Group Meeting, Santorini/Thera, Greece, 2001
2. MPI (Message Passing Interface), http://www-unix.mcs.anl.gov/mpi/
3. J. Dean and S. Ghemawat, Mapreduce: Simplified data processing on large clusters, ACM Commun., vol. 51, Jan. 2008, pp. 107-113.
4. Geoffrey Fox and Marlon Pierce Grids Challenged by a Web 2.0 and Multicore Sandwich Special Issue of Concurrency&Compuitation: Practice&Experience on Seventh IEEE International Symposium on Cluster Computing and the Grid-CCGrid 2007, Keynote Talk Rio de Janeiro Brazil May 15 2007 http://grids.ucs.indiana.edu/ptliupages/publications/CCGridDec07-Final.pdf
5. Dennis Gannon and Geoffrey Fox, Workflow in Grid Systems Concurrency and Computation: Practice & Experience 18 (10), 1009-19 (Aug 2006), Editorial of special issue prepared from GGF10 Berlin
6. Taverna Open Source Workflow code produced by OMII-OK http://taverna.sourceforge.net/
7. C. Chu, S. Kim, Y. Lin, Y. Yu, G. Bradski, A. Ng, and K. Olukotun. Map-reduce for machine learning on multicore. In B. Scholkopf, J. Platt, and T. Hoffman, editors, Advances in Neural Information Processing Systems 19, pages 281-288. MIT Press, Cambridge, MA, 2007
8. Apache Hama Open Source project for MapReduce and matrix and machine learning algorithms http://incubator.apache.org/hama/
9. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly, Dryad: Distributed data-parallel programs from sequential building blocks, European Conference on Computer Systems, March 2007
10. Seung-Hee Bae Parallel Multidimensional Scaling Performance on Multicore Systems at workshop on Advances in High-Performance E-Science Middleware and Applications in Proceedings of eScience 2008 Indianapolis IN December 7-12 2008 http://grids.ucs.indiana.edu/ptliupages/publications/eScience2008-bae3.pdf
11. Xiaohong Qiu, Geoffrey Fox, H. Yuan, Seung-Hee Bae, George Chrysanthakopoulos, Henrik Frystyk Nielsen High Performance Multi-Paradigm Messaging Runtime Integrating Grids and Multicore Systems September 23 2007 published in proceedings of eScience 2007 Conference Bangalore India December 10-13 2007 http://grids.ucs.indiana.edu/ptliupages/publications/CCRSept23- 07eScience07.pdf
12. Xiaohong Qiu, Geoffrey C. Fox, Huapeng Yuan, Seung-Hee Bae, George Chrysanthakopoulos, Henrik Frystyk Nielsen PARALLEL CLUSTERING AND DIMENSIONAL SCALING ON MULTICORE SYSTEMS Invited talk at the 2008 High Performance Computing & Simulation Conference (HPCS 2008) In Conjunction With The 22nd EUROPEAN CONFERENCE ON MODELLING AND SIMULATION (ECMS 2008) Nicosia, Cyprus June 3-6, 2008; Springer Berlin/Heidelberg Lecture Notes in Computer Science Volume 5101/2008 "Computational Science: ICCS 2008" ISBN 978-3-540-69383-3 Pages 407-416 DOI: http://dx.doi.org/10.1007/978-3-540-69384-0-46
13. Xiaohong Qiu, Geoffrey C. Fox, Huapeng Yuan, Seung-Hee Bae, George Chrysanthakopoulos, Henrik Frystyk Nielsen Performance of Multicore Systems on Parallel Data Clustering with Deterministic Annealing ICCS 2008: "Advancing Science through Computation" Conference; ACC CYFRONET and Institute of Computer Science AGH University of Science and Technology Kraków, POLAND; June 23-25, 2008. Springer Lecture Notes in Computer Science Volume 5101, pages 407-416, 2008. DOI: http://dx.doi.org/10.1007/978-3-540-69384-0-46
14. Xiaohong Qiu, Geoffrey C. Fox, Huapeng Yuan, Seung-Hee Bae, George Chrysanthakopoulos, Henrik Frystyk Nielsen Parallel Data Mining on Multicore Clusters 7th International Conference on Grid and Cooperative Computing GCC2008 Shenzhen China October 24-26 2008 http://grids.ucs.indiana.edu/ptliupages/ publications/qiu-ParallelDataMiningMulticoreClusters.pdf
15. Home Page for SALSA Project at Indiana University http://www.infomall. org/salsa.
16. Kenneth Rose, Eitan Gurewitz, and Geoffrey C. Fox Statistical mechanics and phase transitions in clustering Phys. Rev. Lett. 65, 945-948 (1990)
17. Rose, K. Deterministic annealing for clustering, compression, classification, regression, and related optimization problems, Proceedings of the IEEE Vol. 86, pages 2210-2239, Nov 1998
18. T Hofmann, JM Buhmann Pairwise data clustering by deterministic annealing, IEEE Transactions on Pattern Analysis and Machine Intelligence 19, pp1-13 1997
19. Apache Hadoop, http://hadoop.apache.org/core/
20. Microsoft Robotics Studio is a Windows-based environment that includes end-to-end Robotics Development Platform, lightweight service-oriented runtime, and a scalable and extensible platform. For details, see http://msdn.microsoft. com/robotics/
21. Georgio Chrysanthakopoulos and Satnam Singh An Asynchronous Messaging Library for C#, Synchronization and Concurrency in Object-Oriented Languages (SCOOL) at OOPSLA October 2005 Workshop, San Diego, CA.
22. S. Ghemawat, H. Gobioff, and S. Leung, The Google file system, Symposium on Operating Systems Principles 2003, pp 29-43, 2003
23. Disco project, http://discoproject.org/
24. Erlang programming language, http://www.erlang.org/
25. S. Pallickara and G. Fox, "NaradaBrokering: A Distributed Middleware Framework and Architecture for Enabling Durable Peer-to-Peer Grids, " Middleware 2003, pp. 41-61.
26. Y. Yu, M. Isard, D. Fetterly, M. Budiu, U. Erlingsson, P. Kumar and J. Currey, DryadLINQ: A System for General-Purpose Distributed Data-Parallel Computing Using a High-Level Language Symposium on Operating System Design and Implementation (OSDI), San Diego, CA, December 8-10, 2008.
27. J. B. MacQueen, Some Methods for classification and Analysis of Multivariate Observations, Proceedings of 5-th Berkeley Symposium on Mathematical Statistics and Probability, Berkeley, University of California Press, vol. 1, pp. 281-297.
28. Jaliya Ekanayake, Shrideep Pallickara, and Geoffrey Fox Map-Reduce for Data Intensive Scientific Analyses Proceedings of the IEEE International Conference on e-Science. Indianapolis. 2008. December 7-12 2008 http://grids.ucs.indiana.edu/ptliupages/publications/ekanayake-MapReduce.pdf
29. M. Svenśen. GTM: The Generative Topographic Mapping. PhD thesis, Neural Computing Research Group, Aston University, Birmingham, U.K., 1998.
30. T. Kohonen. Self-Organizing Maps. Springer-Verlag, Berlin, Germany, 2001.
31. J. B. Kruskal and M.Wish. Multidimensional Scaling. Sage Publications Inc., Beverly Hills, CA, U.S.A., 1978.
32. I. Borg and P. J. Groenen. Modern Multidimensional Scaling: Theory and Applications. Springer, New York, NY, U.S.A., 2005.
33. J. de Leeuw. Applications of convex analysis to multidimensional scaling. Recent Developments in Statistics, pages 133-145, 1977.
34. J. de Leeuw. Convergence of the majorization method for multidimensional scaling. Journal of Classification, 5(2):163-180, 1988.
35. Douglas Gregor and Andrew Lumsdaine. Design and Implementation of a High-Performance MPI for C# and the Common Language Infrastructure. Principles and Practice of Parallel Programming (PPoPP), pages 133-142, February 2008. ACM.
36. MPI.NET Home Page http://www.osl.iu.edu/research/mpi.net
37. Alkes L. Price, Eleazar Eskin and Pavel A. Pevzner, Whole-genome analysis of Alu repeat elements reveals complex evolutionary history. Genome Res. 2004 14: 2245-2252 DOI: http://dx.doi.org/10.1101/gr.2693004
38. Bell JF, Wilson JS, Liu GC. Neighborhood greenness and 2-year changes in body mass index of children and youth. Am J Prev Med. Dec 2008;35(6):547-553.
39. J. B. Kruskal. Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika, 29(1):1-27, 1964.
40. Y. Takane, F. W. Young, and J. de Leeuw. Nonmetric individual differences multidimensional scaling: an alternating least squares method with optimal scaling features. Psychometrika, 42(1):7-67, 1977.
41. Hansjorg Klock, Joachim M. Buhmann Multidimensional scaling by deterministic annealing in Energy Minimization Methods in Computer Vision and Pattern Recognition, Eds Pelillo M. and Hancock E.R., Proc. Intl. Workshop EMMCVPR Venice Italy, Springer Lecture Notes in Computer Science 1223 ppg. 246-260 May 1997
42. Hansjorg Klock, Joachim M. Buhmann, Data visualization by multidimensional scaling: a deterministic annealing approach, Pattern Recognition 33 (2000) 651-669
43. Anthony J. Kearsley, Richard A. Tapia, Michael W. Trosset The Solution of the Metric STRESS and SSTRESS Problems in Multidimensional Scaling Using Newton's Method, technical report 1995.
44. Dempster, A.P., Laird, N.M., & Rubin, D.B. (1977). Maximum-likelihood from incomplete data via the EM algorithm. J. R. Statist. Soc. Ser. B (methodological), 39, 1-38.
45. Naonori Ueda and Ryohei Nakano Deterministic annealing EM algorithm Neural Networks Volume 11, Issue 2, 31 March 1998, Pages 271-282 http://dx.doi.org/10.1016/S0893-6080(97)00133-0
46. Jong Youl Choi, Indiana University, Private Communication 2009.
47. Seung-Hee Bae, Indiana University, Private Communication 2009.