Large complex data: Divide and recombine (D&R) with RHIPE

Stat

Volumn 1, Issue 1, 2012, Pages 53-67

  Guha, Saptarshi ^a   Hafen, Ryan ^b   Rounds, Jeremiah ^c   Xia, Jin ^d   Li, Jianfu ^c   Xi, Bowei ^c   Cleveland, William S ^c  

^a Mozilla Corporation   (United States)

^b PACIFIC NORTHWEST NATIONAL LABORATORY   (United States)

^c PURDUE UNIVERSITY   (United States)

^d GE GLOBAL RESEARCH   (United States)

Author keywords

Big data; Computer cluster; Data visualization; Deep analysis; Hadoop; Mathematical statistics; Statistical computing

Indexed keywords

EID: 84937859714     PISSN: None     EISSN: 20491573     Source Type: Journal    
DOI: 10.1002/sta4.7     Document Type: Article

References (18)

1. Anderson, D, Xi, B & Cleveland, WS (2012). 'Multifractal and Gaussian fractional sum-difference models for internet traffic', Technical Report, Department of Statistics, Purdue University.
2. Becker, RA, Cleveland, WS & Shyu, MJ (1996), 'The design and control of trellis display', Journal of Computational and Statistical Graphics 5, 123-155.
3. Cleveland, WS (1993), Visualizing Data, Hobart Press, Chicago.
4. Cleveland, WS & Devlin, SJ (1988), 'Locally-weighted regression: An approach to regression analysis by local fitting', Journal of the American Statistical Association, 83, 596-610.
5. Fuentes, M, Xi, B & Cleveland, WS (2011), 'Trellis display for modeling data from designed experiments', Statistical Analysis and Data Mining, 4, 133-145.
6. Glass, GV (1976), 'Primary, secondary, and meta-analysis of research', Educational Researcher, 5, 3-8.
7. Guha, S (2010), 'Computing environment for the statistical analysis of large and complex data', Ph.D. Thesis, Purdue University Department of Statistics.
8. Guha, S, Hafen, RP, Kidwell, P & Cleveland, WS (2009), 'Visualization databases for the analysis of large complex datasets', Journal of Machine Learning Research, 5, 193-200.
9. Guha, S, Kidwell, P, Barthur, A, Cleveland, WS, Gerth, J & Bullard, C. (2011). 'A streaming statistical algorithm for detection of SSH keystroke packets in TCP connections', In Operations Research, Computing, and Homeland Defense, Wood, RK & Dell, RF (eds.), Institute for Operations Research and Management Sciences, Hanover, Maryland, USA.
10. Hafen, RP, Anderson, DE, Cleveland, WS, Maciejewski, R, Ebert, DS, Abusalah, A, Yakout, M, Ouzzani, SM, & Grannis, S (2009), 'Syndromic surveillance: STL for modeling, visualizing, and monitoring disease counts', BMC Medical Informatics and Decision Making, 9:21, doi: 10.1186/1472-6947-9-21.
11. Hornik, K (2011), 'The R FAQ', World Wide Web, http://CRAN.R-project.org/doc/FAQ/R-FAQ.html [Accessed on September 1, 2012].
12. Pinheiro, JC & Bates, DM (2000), Mixed-Effects Models in S and S-Plus, Springer, New York.
13. RHIPE (2011a), 'Core Development Group', World Wide Web, http://github.com/saptarshiguha/rhipe/.
14. RHIPE (2011b), 'Google Discussion Group', World Wide Web, http://groups.google.com/group/rhipe.
15. Sarkar, D (2008), Lattice: Multivariate Data Visualization with R, Springer, New York.
16. Tukey, JW. (1983). 'Another look at the future', In Computer Science and Statistics: Proceedings of the 14th Symposium on the Interface, Heiner, KW, Sacher, RS & Wilkinson, JW (eds.), Springer, New York, 2-8.
17. White, T (2011), Hadoop: The Definitive Guide, second edition, O'Reilly, Sebastopol, CA.
18. Xi, B, Chen, H, Cleveland, WS & Telkamp, T (2010), 'Statistical analysis and modeling of internet VoIP traffic for network engineering', Electronic Journal of Statistics, 4, 58-116.