Applying statistical thinking to 'Big Data' problems

Wiley Interdisciplinary Reviews: Computational Statistics

Volumn 6, Issue 4, 2014, Pages 222-232

  Hoerl, Roger W ^a   Snee, Ronald D ^b   De Veaux, Richard D ^c  

^a UNION COLLEGE   (United States)

^b Snee Associates   (United States)

^c WILLIAMS COLLEGE   (United States)

Author keywords

Analytics; Data mining; Machine learning; Statistical engineering

Indexed keywords

ARTIFICIAL INTELLIGENCE; DATA MINING; LEARNING SYSTEMS; STATISTICAL METHODS;

ANALYTICS; DATA PROBLEMS; HIGGS BOSON; HIGH QUALITY; LARGE MODELS; STATISTICAL ENGINEERING; STATISTICAL THINKING; SUBJECT MATTERS;

BIG DATA;

EID: 84903270767     PISSN: 19395108     EISSN: 19390068     Source Type: Journal    
DOI: 10.1002/wics.1306     Document Type: Article

References (52)

1. Anderson C. The end of theory: the data deluge makes the scientific method obsolete. Wired Magazine, June 23, 2008. Available at: www.wired.com/science/discoveries/magazine/16-07/pb_theory. (Accessed January 11, 2014).
2. Naik G. Analytical trend troubles scientists. Wall St J 2012, May 4:A1.
3. Vu D. Beware the Hype Over Big Data Analytics. Seeking Alpha, March 12, 2012. Available at: http://seekingalpha.com/article/441171-beware-the-hype-over-big-data-analytics. (Accessed January 11, 2014).
4. Mayer-Schönberger V, Cukier K. Big Data: A Revolution that Will Transform How We Live, Work and Think. Boston, MA: Eamon Dolan/Houghton Mifflin Harcourt; 2013.
5. Ebbers M. 5 Things to know about big data in motion. IBM developerWorks blog, IBM, 2013. Available at: www.ibm.com/developerworks/community/blogs/5things/entry/5_things_to_know_about_big_data_in_motion?lang=en.
6. Wired Magazine. The Peta-age. 2008. Available at: http://www.wired.com/images/press/pdf/petaage.pdf. (Accessed January 11, 2014).
7. Snee RD, De Veaux RD, Hoerl RW. Follow the Fundamentals: Four Data Analysis Basics Will Help You Do Big Data Projects the Right Way. Quality Progress; 2014, January: 24-28.
8. Available at: http://en.wikipedia.org/wiki/big_data. (Accessed January 11, 2014).
9. Hastie T, Tibshirani R, Friedman J. The Elements of Statistical Learning. 2nd ed. New York: Springer; 2009.
10. National Research Council. Frontiers in Massive Data Analysis. Washington, DC: The National Academies Press; 2009.
11. Tan PN, Steinbach M, Kumar V. Introduction to Data Mining. Boston, MA: Pearson Education; 2006.
12. Davenport TH, Harris JG. Competing on Analytics: The New Science of Winning. Cambridge, MA: Harvard Business Review Press; 2007.
13. Amartriain X, Basilico, J. Netflix recommendations: beyond the 5 stars, part I. Netflix Tech Blog, April 6, 2012. Available at: http://techblog.netflix.com/2012/04/netflix-recommendations-beyond-5-stars.html. (Accessed January 3, 2014).
14. Available at: http://kaggle.com. (Accessed January 28, 2014).
15. Available at: http://www-03.ibm.com/innovation/us/watson/. (Accessed January 4, 2014).
16. Feigelson ED, Babu GJ. Big data in astronomy. Significance 2012, 9:22-25.
17. Hesla L. Particle physics tames big data. Symmetry; Dimensions of Particle Physics, August 1, 2012. Available at: http://www.symmetrymagazine.org/article/august-2012/particle-physics-tames-big-data. (Accessed January 4, 2014).
18. Kalil T, Zhao F. Unleashing the power of big data, White House Office of Science and Technology. Office of Science and Technology Blog, April 18, 2013. Available at: www.whitehouse.gov/blog/2013/04/18/unleashing-power-big-data. (Accessed January 12, 2014).
19. Available at: http://www.cnn.com/2013/05/14/showbiz/angelina-jolie-double-mastectomy/. (Accessed January 4, 2014).
20. Cleveland WS. Data science: an action plan for expanding the technical areas of the field of statistics. Int Stat Rev 2001, 69:21-26.
21. Greenhouse JB. Statistical thinking: the bedrock of data science. The Huffington Post, July 26, 2013. http://www.huffingtonpost.com/american-statistical-association/statistical-thinking-the-bedrock-of-data-science_b_3651121.html. (Accessed January 11, 2014).
22. Press G. A very short history of data science. Forbe, May 28, 2013. Available at: http://www.forbes.com/sites/gilpress/2013/05/28/a-very-short-history-of-data-science/. (Accessed January 11, 2014).
23. Baggerly KA, Coombes KR. Deriving chemosensitivity from cell lines: forensic bioinformatics and reproducible research in high-throughput biology. Ann Appl Stat 2009, 3:1309-1334.
24. Kolata G. How bright promise in cancer testing fell apart. The New York Times, July 7, 2012. Available at: http://www.nytimes.com/2011/07/08/health/research/08genes.html. (Accessed January 4, 2014).
25. Wikipedia. Lehman Brothers bankruptcy, 2011. http://en.wikipedia.org/wiki/Bankruptcy_of_Lehman_Brothers. (Accessed January 11, 2014).
26. Hoerl RW, Snee RD. Post-financial meltdown: what do the services industries need from us now? Appl Stoch Models Bus Ind 2009, 25:509-521.
27. Lawrence PA. The Making of a Fly: The Genetics of Animal Design. Hoboken: Wiley-Blackwell; 1992.
28. Slavin K. How algorithms shape our world, TED Conference Presentation, July 21, 2011. www.ted.com/talks/kevin_slavin_how_algorithms_shape_our_world.html. (Accessed January 11, 2014).
29. Reinhart CM, Rogoff KS. Growth in time of debt. Am Econ Rev: Pap Proceed 2010, 100:573-578.
30. Herndon T, Ash M, Pollin R. Does high public debt consistently stifle economic growth? A critique of Reinhart and Rogoff, Working Paper Series 322, Political Commentary Research Institute, 2013. Available at: http://www.peri.umass.edu/fileadmin/pdf/working_papers/working_papers_301-350/WP322.pdf. (Accessed February 4, 2014).
31. Reinhart CM, Rogoff KS. Response to Herndon, Ash, and Pollin. New York Times, April 18, 2013. Available at: http://www.nytimes.com/interactive/2013/04/17/business/17economix-response.html. (Accessed February 4, 2014).
32. Fung K. The pending marriage of big data and statistics. Significance, 2013, 25.
33. De Veaux RD, Hand DJ. How to lie with bad data. Stat Sci 2005, 20:231-38.
34. Liu S. Breaking down barriers. Quality Progress, January 2014, 16-22.
35. Statistics Division of the American Society for Quality. Glossary and Tables for Statistical Quality Control. 3rd ed. Milwaukee, WI: Quality Press; 1996.
36. Box GEP, Hunter WG, Hunter JS. Statistics for Experimenters. 2nd ed. Hoboken, NJ: John Wiley and Sons; 2005.
37. Snee RD, Hoerl RW. Inquiry on pedigree - do you know the quality and origin of your data? Quality Progress, December, 2012, 66-68.
38. Tan PN, Steinbach M, Kumar V. Introduction to Data Mining. Boston, MA: Pearson Education; 2006, 36.
39. Little RJA, Rubin DB. Statistical Analysis with Missing Data. 2nd ed. New York: Wiley Interscience; 2002.
40. Box GEP, Hunter WG, Hunter JS. Statistics for Experimenters. Hoboken, NJ: John Wiley & Sons; 1978, 291.
41. Hoerl RW, Snee RD. Statistical Thinking: Improving Business Performance. 2nd ed. Hoboken, NJ: John Wiley & Sons; 2012.
42. Hoerl RW, Snee RD. Moving the statistics profession forward to the next level. Am Stat 2010, 64:1.
43. Snee RD. Validation of regression models: methods and examples. Technometrics 1977, 19:415-428.
44. Snee RD, Hoerl RW. What's the next big thing in quality management? Qual Manag Forum 2010, 36:3.
45. Snee RD, Hoerl RW. Leading Six Sigma: A Step by Step Guide Based on experience with GE and Other Six Sigma Companies. Upper Saddle River, NJ: Pearson Education; 2003.
46. Available at: http://stat.duke.edu/datafest. (Accessed 1/24/2014).
47. Montgomery DC, Peck EA, Vining GG. Introduction to linear regression analysis. 5th ed. Hoboken, NJ: John Wiley & Sons; 2012.
48. Ince D. The problem of reproducibility. CHANCE 2012, 25:4-7. Available at: http://chance.amstat.org/2012/09/prob-reproducibility/. (Accessed January 28, 2014).
49. Baggerly KA. Disclose all data in publications. Nature 2010, 23:467.
50. Available at: http://www.stat.uni-muenchen.de/leisch/Sweave/. (Accessed 4/23/2014).
51. Hoerl RW, Hooper JH, Jacobs PJ, Lucas JM. Skills for industrial statisticians to survive and prosper in the emerging quality environment. Am Stat 1993, 47:280-291.
52. Available at: http://www.pfizer.com/research/clinical_trials/phases_of_development. (Accessed 4/23/2014).