Doing least squares: Perspectives from Gauss and Yule

International Statistical Review

Volumn 66, Issue 1, 1998, Pages 61-81

  Aldrich, John ^a  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

Aitken; Elimination; Fisher; Gauss; Least squares; Orthogonalisation; Partial Correlation; Projection; Yule

Indexed keywords

EID: 0032380578     PISSN: 03067734     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1751-5823.1998.tb00406.x     Document Type: Review

References (99)

1. Aitken, A.C. (1933). On Fitting Polynomials to Data with Weighted and Correlated Errors. Proceedings of the Royal Society of Edinburgh, 54, 12-16.
2. Aitken, A.C. (1935). On Least Squares and Linear Combinations of Observations. Proceedings of the Royal Society of Edinburgh, 55, 42-48.
3. Aitken, A.C. (1939). Determinants and Matrices. Edinburgh: Oliver & Boyd.
4. Aitken, A.C. (1945). Studies in Practical Mathematics. IV. On Linear Approximation by Least Squares. Proceedings of the Royal Society of Edinburgh, 62, 138-146.
5. Aldrich, J. (1995). Correlations Genuine and Spurious in Pearson and Yule. Statistical Science, 10, 364-376.
6. Aldrich, J. (1997). R.A. Fisher and the Making of Maximum Likelihood 1912-22. Statistical Science, 12, 162-176.
7. Anderson, T.W. (1996). R.A. Fisher and Multivariate Analysis. Statistical Science, 11, 20-34.
8. Bartlett, M.S. (1933). On the Theory of Statistical Regression. Proceedings of the Royal Society of Edinburgh, 53, 260-283.
9. Bartlett, M.S. (1933/4). The Vector Representation of a Sample. Proceedings of the Cambridge Philosophical Society, 30, 327-340.
10. Benôit, E. (1924). Note sur une Étude de Résolution des Équations Normales etc. Bullétin Géodésique, 67-77.
11. Bienaymé, I.J.(1853). Remarques sur les Différences qui Distinguent L'Interpolation de M. Cauchy de la Méthode des Moindres Carrés etc. Compte Rendu de l'Academie des Sciences de Paris, 37, 5-13.
12. Birkhoff, G. & Kreysig, E. (1984). The Establishment of Functional Analysis. Historia Mathematica, 11, 258-321.
13. Bôcher, M. (1907). Introduction to Higher Algebra. New York: Macmillan.
14. Bose, R.C. (1944). The Fundamental Theorem of Linear Estimation. Proceedings of the 31st Indian Scientific Congress, (abstract) 2-3.
15. Brunt, D. (1917). The Combination of Observations. Cambridge: Cambridge University Press.
16. Cauchy, A. (1836). On a New Formula for Solving the Problem of Interpolation in a Manner Applicable to Physical Investigations. Philosophical Magazine, 49, 459-468.
17. Chauvenet, W. (1867). A Manual of Spherical and Practical Astronomy, volume 2, fifth edition (1891). Reprinted by Dover, New York 1960.
18. Chebyshev, P.L. (1858). Sur les Fractions Continues. Journal de Mathématiques Pures et Appliquées, II, 3, 289-323. Chapter 11 in Œuvres Tome 1.
19. Chebyshev, P.L. (1858). Sur les Fractions Continues. Journal de Mathématiques Pures et Appliquées, II, 3, 289-323. Chapter 11 in Œuvres Tome 1.
20. Chebyshev, P.L. (1859). Sur l'Interpolation par la Méthode des Moindres Carrés. Mémoires de l'Académie des Sciences de St.-Pétersbourg, VII, série, 1, 1-24. Chapter 18 in Œuvres Tome 1, reprinted by Chelsea, New York 1961.
21. Chebyshev, P.L. (1859). Sur l'Interpolation par la Méthode des Moindres Carrés. Mémoires de l'Académie des Sciences de St.-Pétersbourg, VII, série, 1, 1-24. Chapter 18 in Œuvres Tome 1, reprinted by Chelsea, New York 1961.
22. Cochran, W.G. (1934). The Distribution of Quadratic Forms in a Normal System, with Applications to the Analysis of Covariance. Proceedings of the Cambridge Philosophical Society, 30, 178-191.
23. Cochran, W.G. (1938). The Omission or Addition of an Independent Variable in Multiple Linear Regression. Supplement to Journal of the Royal Statistical Society, 5, 171-176.
24. Craig, A.T. (1943). Note on the Independence of Certain Quadratic Forms. Annals of Mathematical Statistics, 18, 195-197.
25. David, F.N. & Neyman, J. (1938). Extension of the Markoff Theorem on Least Squares. Statistical Research Memoirs, University College London, 2, 105-116.
26. Davidson, R. & MacKinnon, J.G.(1993). Estimation and Inference in Econometrics. Oxford: Oxford University Press.
27. Deming, W.E. (1943). Statistical Adjustment of Data. Reprinted by Dover, New York 1964.
28. Dempster, A.P. (1969). Elements of Continuous Multivariate Analysis. Reading, Massachusetts: Addison-Wesley.
29. Dieudonné, J.(1981). History of Functional Analysis. Amsterdam: North-Holland.
30. Draper, N.R. & Smith, H. (1966). Applied Regression Analysis. New York: Wiley.
31. Durbin, J.& Kendall, M.G. (1951). The Geometry of Estimation. Biometrika, 38, 150-158.
32. Durbin, J. & Watson, G.S (1950). Testing for Serial Correlation in Least Squares Regression. Biometrika, 37, 409-428.
33. Dwyer, P.S. (1941). The Doolittle Technique. Annals of Mathematical Statistics, 14, 449-458.
34. Dwyer, P.S. (1944). A Matrix Presentation of Least Squares and Correlation Theory with Matrix Justification of Improved Methods of Solution. Annals of Mathematical Statistics, 17, 82-89.
35. Dwyer, P.S. (1951). Linear Computations. New York: Wiley.
36. Encke, J.F. (1835). Über die Methode der kleinsten Quadrate. Berliner Astronomiches Jahrbuch, 253-320.
37. Farebrother, R.W. (1988). Linear Least Squares Computations. New York: Dekker.
38. Fisher, R.A. (1915). Frequency Distribution of the Values of the Correlation Coefficient in Samples from an Indefinitely Large Population. Biometrika, 10, 507-521.
39. Fisher, R.A. (1922). The Goodness of Fit of Regression Formulae, and the Distribution of Regression Coefficients. Journal of the Royal Statistical Society, 85, 597-612.
40. Fisher, R.A. (1924). The Distribution of the Partial Correlation Coefficient. Metron, 3, 329-332.
41. Fisher, R.A. (1925/38). Statistical Methods for Research Workers. Edinburgh: Oliver & Boyd. Seventh edition in 1938.
42. Fisher, R.A. (1925a). Applications of 'Student's' Distribution. Metron, 5, 90-104.
43. Frisch, R. (1929). Correlation and Scatter in Statistical Variables. Nordic Statistical Journal, 8, 36-102.
44. Frisch, R. & Waugh, F.V. (1933). Partial Time Regressions as Compared with Individual Trends. Econometrica, 1, 387-401.
45. Gauss, C.F. (1801). Disquisitiones Arithmeticae. English translation by A.A. Clarke (1965), New Haven: Yale University Press.
46. Gauss, C.F. (1809). Theoria Motus Corporum Coelestium. English translation by C.H. Davis, reprinted 1963 Dover, New York.
47. Gauss, C.F. (1811). Disquisitio de Elementis Ellipticis Palladis. English translation of extract in pp. 148-155 of Trotter, H. F. (1957). Gauss's Work (1803-26) on the Theory of Least Squares, Technical Report 5, Statistical Techniques Research Group, Princeton University. A translation of Méthodes des Moindres Carrés, the authorised French translation of Gauss's writings on least squares by J. Bertrand (1855), Paris: Mallet-Bachelier.
48. Gauss, C.F. (1811). Disquisitio de Elementis Ellipticis Palladis. English translation of extract in pp. 148-155 of Trotter, H. F. (1957). Gauss's Work (1803-26) on the Theory of Least Squares, Technical Report 5, Statistical Techniques Research Group, Princeton University. A translation of Méthodes des Moindres Carrés, the authorised French translation of Gauss's writings on least squares by J. Bertrand (1855), Paris: Mallet-Bachelier.
49. Gauss, C.F. (1811). Disquisitio de Elementis Ellipticis Palladis. English translation of extract in pp. 148-155 of Trotter, H. F. (1957). Gauss's Work (1803-26) on the Theory of Least Squares, Technical Report 5, Statistical Techniques Research Group, Princeton University. A translation of Méthodes des Moindres Carrés, the authorised French translation of Gauss's writings on least squares by J. Bertrand (1855), Paris: Mallet-Bachelier.
50. Gauss, C.F. (1821/-3/-6). Theoria Combinationis Observationum Erroribus Minimus Obnoxiae, in two parts with a supplement. Reprinted with an English translation and notes by G.W. Stewart, (1995), Philadelphia: SIAM.
51. Goedseels, E. (1902). Sur l'Application de la Méthode de Cauchy aux Moindres Carrés. Annales de la Société Scientifique de Bruxelles, 26, 148-156.
52. Gram, J.P.(1883). Ueber die Entwicklung reeller Functionen in Reihen mittelst der Methode der kleinsten Quadrate. Journal für die reine und angewandte Mathematik, 94, 41-73.
53. Halmos, P.R. (1942). Finite Dimensional Vector Spaces. Princeton: Princeton University Press.
54. Hawkins, T. (1977). Another Look at Cayley and the Theory of Matrices. Archives Internationales d'Histoire des Sciences, 26, 82-112.
55. Herr, D.G. (1980). On the History of the Use of Geometry in the General Linear Model. The American Statistician, 34, 43-47.
56. Heyde, C.C. & Seneta, E. (1977). I.J. Bienayme: Statistical Theory Anticipated. New York: Springer-Verlag.
57. Horn, R.A. & Johnson, C.R. (1985). Matrix Analysis. Cambridge: Cambridge University Press.
58. Kempthorne, O. (1952). The Design and Analysis of Experiments. New York: Wiley.
59. Kendall, M.G. (1961). A Course in the Geometry of n Dimensions. London: Griffin.
60. Kline, M. (1972). Mathematical Thought from Ancient to Modern Times. New York: Oxford University Press.
61. Kolmogorov, A.N. (1939). Sur l'Interpolation et Extrapolation des Suites Stationnaires. Compte Rendu de l'Academie des Sciences de Paris, 208, 2043-2045.
62. Kowalewski, G. (1909). Einführung in die Determinantentheorie. Leipzig.
63. Kruskal, W. (1961). The Coordinate-Free Approach to Gauss-Markov Estimation, and its Application to Missing and Extra Observations. Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, 1, 435-451.
64. Lagrange, J.L. (1759). Recherches sur la Méthode de Maximis et Miniminis, reprinted in Œuvres, vol. 1, pp. 3-20. Gauthiers-Villars, Paris 1867.
65. Lagrange, J.L. (1759). Recherches sur la Méthode de Maximis et Miniminis, reprinted in Œuvres, vol. 1, pp. 3-20. Gauthiers-Villars, Paris 1867.
66. Laplace, P.S. (1812). Théorie Analytiques des Probabilités, Third edition (1820) with introduction and three supplements reprinted in Œuvres, vol. 7, Imprimérie Royale, Paris 1847.
67. Laplace, P.S. (1812). Théorie Analytiques des Probabilités, Third edition (1820) with introduction and three supplements reprinted in Œuvres, vol. 7, Imprimérie Royale, Paris 1847.
68. Legendre, A.M. (1805). Nouvelles Méthodes pour la Détermination des Orbites des Comètes. Paris: Courcier.
69. Lidstone, G.J. (1933). Notes on Orthogonal Polynomials and their Application to Least-Square Methods etc. Journal of the Institute of Actuaries, 64, 128-64.
70. Longley, J.W. (1984). Least Squares Computations using Orthogonalization Methods. New York: Dekker.
71. Lovell, M.S. (1963). Seasonal Adjustment of Economic Time Series. Journal of the American Statistical Association, 58, 993-1010.
72. Morgan, M.S. (1990). The History of Econometric Ideas. New York: Cambridge University Press.
73. Olkin, I. (1989). A Conversation with Maurice Bartlett. Statistical Science, 4, 151-163.
74. Pearson, K. (1896). Mathematical Contributions to the Theory of Evolution. III. Regression, Heredity and Panmixia. Philosophical Transactions of the Royal Society A, 187, 253-318.
75. Pearson, K. (1916). On Some Novel Properties of Partial and Multiple Correlation in a Universe of Manifold Characteristics. Biometrika, 11, 231-238.
76. Pearson, K. & Filon, L.N.G. (1898). Mathematical Contributions to the Theory of Evolution IV. On the Probable Errors of Frequency Constants and on the Influence of Random Selection on Variation and Correlation. Philosophical Transactions of the Royal Society A, 191, 229-311.
77. Plackett, R.L.(1949). A Historical Note on the Method of Least Squares. Biometrika, 36, 458-460.
78. Plackett, R.L.(1972). The Discovery of the Method of Least Squares. Biometrika, 59, 239-251.
79. Rainsford, H.F.(1957). Survey Adjustments and Least Squares. London: Constable.
80. Romanovsky, V. (1925). Sur une Méthode d'Interpolation de Tchebycheff. Compte Rendu de l'Academie des Sciences de Paris, 181, 595-597.
81. Schmidt, E. (1908). Über die Auflösung linearer Gleichungen mit unendlich vielen Unbekannten. Rendiconti del Circulo Matematico di Palermo, 25, 53-77.
82. Seal, H.L. (1967). The Historical Development of the Gauss Linear Model, Biometrika, 54, 1-24.
83. Seber, G.A.F. (1977). Linear Regression Analysis. New York: Wiley.
84. Sheppard, W.F. (1912). Reduction of Errors by Means of Negligible Differences. Proceedings of the Fifth International Congress of Mathematicians (Cambridge), 2, 348-384.
85. Smart, W.M. (1958). The Combination of Observations. Cambridge: Cambridge University Press.
86. Stewart, G.W. (1995). Gauss, Statistics, and Gaussian Elimination. Journal of Computational and Graphical Statistics, 4, 1-11.
87. Stigler, S.M. (1986). The History of Statistics. Cambridge: Harvard University Press.
88. Stone, M.H. (1932). Linear Transformations in Hilbert Space. New York: American Mathematical Society.
89. Todhunter, I. (1865). On the Method of Least Squares. Proceedings of the Cambridge Philosophical Society, 11, 219-238.
90. Turnbull, H.W. & Aitken, A.C. (1932). An Introduction to the Theory of Canonical Matrices. London: Blackie.
91. Whittaker, J.M. & Bartlett, M.S. (1968). Alexander Craig Aitken, 1895-1967. Obituary Notices of Fellows of the Royal Society, 24, 1-14.
92. Wold, H. (1938). A Study in the Analysis of Stationary Time Series. Uppsala: Almqvist & Wiksells.
93. Wright, T.W. & Hayford, J.F. (1906). The Adjustment of Observations. New York: Van Nostrand.
94. Yates, F. & Hale, R.W. (1939). The Analysis of Latin Squares when Two or More Rows, Columns or Treatments are Missing. Journal of the Royal Statistical Society B, 6, 67-79.
95. Yule, G.U. (1897). On the Theory of Correlation. Journal of the Royal Statistical Society, 60, 812-854.
96. Yule, G.U. (1907). On the Theory of Correlation for any Number of Variables, treated by a New System of Notation. Philosophical Transactions of the Royal Society A, 79, 182-193.
97. Yule, G.U. (1909). The Applications of the Method of Correlation to Social and Economic Statistics. Journal of the Royal Statistical Society, 72, 721-730.
98. Yule, G.U. (1911). An Introduction to the Theory of Statistics. London: Griffin.
99. Yule, G.U. & Kendall, M.S. (1937). An Introduction to the Theory of Statistics. London: Griffin.