Elliptical insights: Understanding statistical methods through elliptical geometry

Statistical Science

Volumn 28, Issue 1, 2013, Pages 1-39

  Friendly, Michael ^a   Monette, Georges ^a   Fox, John ^b  

^a YORK UNIVERSITY   (Canada)

^b MCMASTER UNIVERSITY   (Canada)

Author keywords

Added variable plots; Bayesian estimation; Concentration ellipse; Data ellipse; Discriminant analysis; Francis Galton; Hypothesis error plots; Kissing ellipsoids; Measurement error; Mixed effect models; Multivariate meta analysis; Regression paradoxes; Ridge regression; Statistical geometry

Indexed keywords

EID: 84878978384     PISSN: 08834237     EISSN: None     Source Type: Journal    
DOI: 10.1214/12-STS402     Document Type: Article

References (55)

1. ALKER, H. R. (1969). A typology of ecological fallacies. In Social Ecology (M. Dogan and S. Rokkam, eds.) 69-86. MIT Press, Cambridge, MA.
2. ANDERSON, E. (1935). The irises of the Gaspé peninsula. Bulletin of the American Iris Society 35 2-5.
3. ANTCZAK-BOUCKOMS, A., JOSHIPURA, K., BURDICK, E. and TULLOCH, J. F. (1993). Meta-analysis of surgical versus nonsurgical methods of treatment for periodontal disease. J. Clin. Periodontol. 20 259-268.
4. BEATON, A. E. JR (1964). The use of special matrix operators in statistical calculus. Ph.D. thesis, Harvard Univ., ProQuest LLC, Ann Arbor, MI.
5. BELSLEY, D. A., KUH, E., and WELSCH, R. E. (1980). Regression Diagnostics: Identifying Influential Data, and Sources of Collinearity. Wiley, New York. MR0576408
6. BERKEY, C. S., HOAGLIN, D. C., ANTCZAK-BOUCKOMS, A., MOSTELLER, F., and COLDITZ, G. A. (1998). Meta-analysis of multiple outcomes by regression with random effects. Stat. Med. 17 2537-2550.
7. BOYER, C. B. (1991). Apollonius of Perga. In A History of Mathematics, 2nd ed. 156-157. Wiley, New York.
8. BRAVAIS, A. (1846). Analyse mathématique sur les probabilités des erreurs de situation d'un point. Mémoires Présentés Par Divers Savants à L'Académie Royale des Sciences de l'Institut de France 9 255-332.
9. BRYANT, P. (1984). Geometry, statistics, probability: Variations on a common theme. Amer. Statist. 38 38-48.
10. BRYK, A. S., and RAUDENBUSH, S. W. (1992). Hierarchical Linear Models: Applications, and Data Analysis Methods. Sage, Thousand Oaks, CA.
11. CAMPBELL, N. A., and ATCHLEY, W. R. (1981). The geometry of canonical variate analysis. Systematic Zoology 30 268-280.
12. CRAMÉR, H. (1946). Mathematical Methods of Statistics. Princeton Mathematical Series 9. Princeton Univ. Press, Princeton, NJ. MR0016588
13. DEMPSTER, A. P. (1969). Elements of Continuous Multivariate Analysis. Addison-Wesley, Reading, MA.
14. DENIS, D. (2001). The origins of correlation, and regression: Francis Galton or Auguste Bravais, and the error theorists. History, and Philosophy of Psychology Bulletin 13 36-44.
15. DIEZ-ROUX, A. V. (1998). Bringing context back into epidemiology: Variables, and fallacies in multilevel analysis. Am. J. Public Health 88 216-222.
16. FISHER, R. A. (1936). The use of multiple measurements in taxonomic problems. Annals of Eugenics 8 379-388.
17. FOX, J. (2008). Applied Regression Analysis, and Generalized Linear Models, 2nd ed. Sage, Thousand Oaks, CA.
18. FOX, J., and SUSCHNIGG, C. (1989). A note on gender, and the prestige of occupations. Canadian Journal of Sociology 14 353-360.
19. FOX, J., and WEISBERG, S. (2011). An R Companion to Applied Regression, 2nd ed. Sage, Thousand Oaks, CA.
20. FRIENDLY, M. (1991). SAS System for Statistical Graphics, 1st ed. SAS Institute, Cary, NC.
21. FRIENDLY, M. (2007a). A.-M. Guerry's Moral statistics of France: Challenges for multivariable spatial analysis. Statist. Sci. 22 368-399. MR2399897
22. FRIENDLY, M. (2007b). HE plots for multivariate linear models. J. Comput. Graph. Statist. 16 421-444. MR2370948
23. FRIENDLY, M. (2013). The generalized ridge trace plot: Visualizing bias, and precision. J. Comput. Graph. Statist. 22. To appear.
24. FRIENDLY, M.,MONETTE, G., and FOX, J. (2012). Supplement to "Elliptical Insights: Understanding Statistical Methods Through Elliptical Geometry." DOI:10.1214/12-STS402SUPP.
25. GALTON, F. (1886). Regression towards mediocrity in hereditary stature. Journal of the Anthropological Institute 15 246-263.
26. GALTON, F. (1889). Natural Inheritance. Macmillan, London.
27. GASPARRINI, A. (2012). MVMETA: multivariate meta-analysis, and meta-regression. R package version 0.2.4.
28. GUERRY, A. M. (1833). Essai sur la statistique morale de la France. Crochard, Paris. [English translation: Hugh P. Whitt, and Victor W. Reinking, Edwin Mellen Press, Lewiston, NY (2002).]
29. HENDERSON, C. R. (1975). Best linear unbiased estimation, and prediction under a selection model. Biometrics 31 423-448.
30. HOERL, A. E., and KENNARD, R. W. (1970a). Ridge regression: Biased estimation for nonorthogonal problems. Technometrics 12 55-67.
31. HOERL, A. E., and KENNARD, R. W. (1970b). Ridge regression: Applications to nonorthogonal problems. Technometrics 12 69-82. [Correction: 12 723.]
32. HOTELLING, H. (1933). Analysis of a complex of statistical variables into principal components. Journal of Educational Psychology 24 417-441.
33. JACKSON, D., RILEY, R., and WHITE, I. R. (2011). Multivariate meta-analysis: Potential, and promise. Stat. Med. 30 2481-2498. MR2843472
34. KRAMER, G. H. (1983). The ecological fallacy revisited: Aggregate-versus individual-level findings on economics, and elections,, and sociotropic voting. The American Political Science Review 77 92-111.
35. LAIRD, N. M., and WARE, J. H. (1982). Random-effects models for longitudinal data. Biometrics 38 963-974.
36. LICHTMAN, A. J. (1974). Correlation, regression,, and the ecological fallacy: A critique. The Journal of Interdisciplinary History 4 417-433.
37. LONGLEY, J. W. (1967). An appraisal of least squares programs for the electronic computer from the point of view of the user. J. Amer. Statist. Assoc. 62 819-841. MR0215440
38. MARQUARDT, D. W. (1970). Generalized inverses, ridge regression, biased linear estimation,, and nonlinear estimation. Technometrics 12 591-612.
39. MONETTE, G. (1990). Geometry of multiple regression, and interactive 3-D graphics. In Modern Methods of Data Analysis, Chapter 5 (J. Fox, and S. Long, eds.) 209-256. Sage, Beverly Hills, CA.
40. NAM, I.-S.,MENGERSEN, K., and GARTHWAITE, P. (2003). Multivariate meta-analysis. Stat. Med. 22 2309-2333.
41. PEARSON, K. (1896). Contributions to the mathematical theory of evolution-III, regression, heredity, and panmixia. Philosophical Transactions of the Royal Society of London 187 253-318.
42. PEARSON, K. (1901). On lines, and planes of closest fit to systems of points in space. Philosophical Magazine 6 559-572.
43. PEARSON, K. (1920). Notes on the history of correlation. Biometrika 13 25-45.
44. RAUDENBUSH, S.W., and BRYK, A. S. (2002). Hierarchical Linear Models: Applications, and Data Analysis Methods, 2nd ed. Sage, Newbury Park, CA.
45. RILEY, M. W. (1963). Special problems of sociological analysis. In Sociological Research I: A Case Approach (M.W. Riley, ed.) 700-725. Harcourt, Brace,, and World, New York.
46. ROBINSON, W. S. (1950). Ecological correlations, and the behavior of individuals. American Sociological Review 15 351-357.
47. ROBINSON, G. K. (1991). That BLUP is a good thing: The estimation of random effects. Statist. Sci. 6 15-32. MR1108815
48. SAVILLE, D. andWOOD, G. (1991). Statistical Methods: The Geometric Approach. Springer Texts in Statistics. Springer, New York.
49. SIMPSON, E. H. (1951). The interpretation of interaction in contingency tables. J. Roy. Statist. Soc. Ser. B. 13 238-241. MR0051472
50. SPEED, T. (1991). That BLUP is a good thing: The estimation of random effects: Comment. Statist. Sci. 6 42-44.
51. STIGLER, S. M. (1986). The History of Statistics: The Measurement of Uncertainty Before 1900. The Belknap Press of Harvard Univ. Press, Cambridge, MA. MR0852410
52. TIMM, N. H. (1975). Multivariate Analysis with Applications in Education, and Psychology. Brooks/Cole Publishing Co., Monterey, CA. MR0443216
53. VELLEMAN, P. F. andWELSH, R. E. (1981). Efficient computing of regression diagnostics. Amer. Statist. 35 234-242.
54. VON HUMBOLDT, A. (1811). Essai Politique sur le Royaume de la Nouvelle-Espagne. (Political Essay on the Kingdom of New I: Founded on Astronomical Observations,, and Trigonometrical, and Barometrical Measurements), Vol. 1. Riley, New York.
55. WICKENS, T. D. (1995). The Geometry of Multivariate Statistics. Lawrence Erlbaum Associates, Hillsdale, NJ.