Beyond online aggregation: Parallel and incremental data mining with online Map-Reduce

ACM International Conference Proceeding Series

Volumn , Issue , 2010, Pages

  Böse, Joos Hendrik ^a   Andrzejak, Artur ^b   Högqvist, Mikael ^b  

^a INTERNATIONAL COMPUTER SCIENCE INSTITUTE   (United States)

^b ZUSE INSTITUTE BERLIN   (Germany)

Author keywords

machine learning; Map Reduce; stream mining

Indexed keywords

DATA MINING ALGORITHM; EXPERIMENTAL EVALUATION; INCREMENTAL DATA; INTERACTIVE ANALYSIS; LARGE DATA; LARGE DATASETS; MACHINE LEARNING; ONLINE VERSIONS; PROGRAMMING MODELS; STREAM MINING;

ALGORITHMS; HYDRAULICS; LEARNING SYSTEMS; WORLD WIDE WEB;

DATA MINING;

EID: 77954518625     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1779599.1779602     Document Type: Conference Paper

References (20)

1. ANDRZEJAK, A., KONDO, D., AND ANDERSON, D. P. Exploiting non-dedicated resources for cloud computing. In 12th IEEE/IFIP Network Operations & Management Symposium (NOMS 2010) (Osaka, Japan, Apr 19-23 2010).
2. ARASU, A., BABU, S., AND WIDOM, J. The CQL continuous query language: semantic foundations and query execution. VLDB J 15, 2 (2006), 121-142.
3. CHEN, S., AND SCHLOSSER, S. W. Map-reduce meets wider varieties of applications. Tech. Rep. IRP-TR-08-05, Intel Labs Pittsburgh Tech Report, May 2008.
4. CHU, C.-T., KIM, S. K., LIN, Y.-A., YU, Y., BRADSKI, G. R., NG, A. Y., AND OLUKOTUN, K. Map-reduce for machine learning on multicore. In NIPS (2006), pp. 281-288.
5. COHEN, J., DOLAN, B., DUNLAP, M., HELLERSTEIN, J. M., AND WELTON, C. MAD skills: New analysis practices for big data. PVLDB 2, 2 (2009), 1481-1492.
6. CONDIE, T., CONWAY, N., ALVARO, P., HELLERSTEIN, J. M., ELMELEEGY, K., AND SEARS, R. Mapreduce online. Tech. Rep. UCB/EECS-2009-136, EECS Department, University of California, Berkeley, Oct 2009.
7. DEAN, J., AND GHEMAWAT, S. MapReduce: simplified data processing on large clusters. CACM 51, 1 (2008), 107-113.
8. DHILLON, I. S., AND MODHA, D. S. A data-clustering algorithm on distributed memory multiprocessors. In Workshop on Large-Scale Parallel KDD Systems, SIGKDD (London, UK, 2000), pp. 245-260.
9. DOMENICONI, C., AND GUNOPULOS, D. Incremental support vector machine construction. In ICDM'01 (Washington, DC, USA, 2001), pp. 589-592.
10. DOMINGOS, P., AND HULTEN, G. Mining high-speed data streams. In Knowledge Discovery and Data Mining (2000), pp. 71-80.
11. ESTER, M., KRIEGEL, H.-P., SANDER, J., WIMMER, M., AND XU, X. Incremental clustering for mining in a data warehousing environment. In VLDB'98 (San Francisco, CA, USA, 1998), pp. 323-333.
12. GRAF, H. P., COSATTO, E., BOTTOU, L., DURDANOVIC, I., AND VAPNIK, V. Parallel support vector machines: The cascade SVM. In NIPS (2004).
13. HELLERSTEIN, AVNUR, CHOU, HIDBER, OLSTON, RAMAN, ROTH, AND HAAS. Interactive data analysis: The control project. COMPUTER: IEEE Computer 32 (1999).
14. HELLERSTEIN, J. M., HAAS, P. J., AND WANG, H. J. Online aggregation. In Proc. ACM SIGMOD Int. Conf. Management of Data (13-15 May 1997), vol. 26(2), pp. 171-182.
15. ISARD, M., BUDIU, M., YU, Y., BIRRELL, A., AND FETTERLY, D. Dryad: distributed data-parallel programs from sequential building blocks. In EuroSys (2007), ACM, pp. 59-72.
16. MA, J., SAUL, L. K., SAVAGE, S., AND VOELKER, G. M. Identifying suspicious URLs: an application of large-scale online learning. In ICML (2009), vol. 382, ACM, p. 86.
17. OLSON. Parallel algorithms for hierarchical clustering. PARCOMP: Parallel Computing 21 (1995).
18. OLSTON, C., BORTNIKOV, E., ELMELEEGY, K., JUNQUEIRA, F., AND REED, B. Interactive analysis of web-scale data. In CIDR (2009), www.crdrdb.org.
19. PHAM, D. T., DIMOV, S. S., AND NGUYEN, C. D. An incremental k-means algorithm. Journal of Mechanical Engineering Science 218, 7 (2004), 783-795.
20. PIKE, R., DORWARD, S., GRIESEMER, R., AND QUINLAN, S. Interpreting the data: Parallel analysis with Sawzall. Scientific Programming 13, 4 (2005), 277-298.