Rao's score, Neyman's C(α) and Silvey's LM tests: An essay on historical developments and some new results

Journal of Statistical Planning and Inference

Volumn 97, Issue 1, 2001, Pages 9-44

  Bera, Anil K ^a   Bilias, Yannis ^b  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b UNIVERSITY OF CYPRUS   (Cyprus)

Author keywords

62F03; 62J20; 62P20; LM test; Neyman's C( ) test; Rao's score test

Indexed keywords

EID: 0009607846     PISSN: 03783758     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0378-3758(00)00343-8     Document Type: Article

References (130)

1. Aitchison J., Silvey S.D. Maximum-likelihood estimation of parameters subject to restraints. Ann. Math. Statist. 29:1958;813-828.
2. Aitchison J., Silvey S.D. Maximum-likelihood estimation procedures and associated tests of significance. J. Roy. Statist. Soc. B 22:1960;154-171.
3. Akritas M.G. An asymptotic derivation of Neyman's. C(α) test Statist. Probab. Lett. 6:1988;363-367.
4. Amemiya T. Advanced Econometrics. 1985;Harvard University Press, Cambridge.
5. Anderson T.W. R.A. Fisher and multivariate analysis. Statist. Sci. 11:1996;20-34.
6. Anselin L., Bera A.K. Spatial dependence in linear regression models with an introduction to spatial econometrics. Ullah A., Giles D.E.A. Handbook of Applied Economic Statistics. 1998;237-289 Marcel Dekker, New York.
7. Barnard G.A. Introduction to Pearson. (1990) 'On the criterion that a given system of deviation from the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random sampling'. Kotz S., Johnson N.L. Breakthroughs in Statistics, Vol. II. 1992;1-11 Springer, New York.
8. Bartlett M.S. Approximate confidence intervals. Biometrika. 40:1953;12-19.
9. Bartlett M.S. Approximate confidence interval II. More than one unknown parameter. Biometrika. 40:1953;306-317.
10. Bartlett M.S. Approximate confidence intervals III. A bias correction. Biometrika. 42:1955;201-204.
11. Bartlett M.S. Egon Sharpe Pearson. Mem. Fellows Roy. Soc. London. 27:1981;425-443.
12. Basawa I.V. Generalized score tests for composite hypotheses. Godambe V.P. Estimating Functions. 1991;121-131 Clarendon Press, Oxford.
13. Bera, A.K., 1982. Aspects of econometric modeling. Unpublished Ph.D. Dissertation, The Australian National University, Canberra.
14. Bera, A.K., Jarque, C.M., 1981. An efficient large-sample test for normality of observations and regression residuals. Working Paper in Economics and Econometrics, No. 40, The Australian National University, Canberra.
15. Bera A.K., McKenzie C.R. Alternative forms and properties of the score test. J. Appl. Statist. 13:1986;13-25.
16. Bera A.K., Ullah A. Rao's score test in econometrics. J. Quant. Econom. 7:1991;189-220.
17. Bishop Y.M.M., Fienberg S.E., Holland P.W. Discrete Multivariate Analysis: Theory and Practice. 1975;MIT Press, Cambridge, MA.
18. 2 Biometrika. 62:1975;243-250.
19. Bradley R.A. Some statistical methods in taste testing and quality evaluation. Biometrics. 9:1953;22-38.
20. Breusch T.S., Pagan A.R. The Lagrange multiplier test and its applications to model specification in econometrics. Rev. Econom. Stud. 47:1980;239-253.
21. Breusch T.S., Schmidt P. Alternative forms of the Wald test: how long a piece of string? Comm. Stat. Theor. Method. 17:1988;2789-2795.
22. Bühler W.J., Puri P.S. On optimal asymptotic tests for composite hypotheses with several constraints. Z. Wahr. Verw. Geb. 5:1966;71-88.
23. Byron R.P. Methods for estimating demand equations using prior information: a series of experiments with Australian data. Austral. Econom. Papers. 7:1968;227-248.
24. Chesher A., Smith R. Likelihood ratio specification tests. Econometrica. 65:1997;627-646.
25. Chibisov D.M. Transition to the limiting process for deriving asymptotically optimal tests. Sankhyā A 31:1969;241-258.
26. Choi S., Hall W.J., Schick A. Asymptotically uniformly most powerful tests in parametric and semiparametric models. Ann. Statist. 24:1996;841-861.
27. Cox D.R. Tests of separate families of hypotheses. Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, Vol. 11. 1961;University of California Press, Berkeley, CA.
28. Cox D.R. Further results on tests of separate families of hypotheses. J. Roy. Statist. Soc. B 24:1962;406-424.
29. Cox D.R. Professor S.D. Silvey, 1924-90. J. Roy. Statist. Soc. A 154:1991;354-355.
30. Cox D.R., Hinkley D.V. Theoretical Statistics. 1974;Chapman & Hall, London.
31. Cramér H. Mathematical Methods of Statistics. 1946;Princeton University Press, Princeton, NJ.
32. Cressie N., Read T.R.C. Multinomial goodness-of-fit tests. J. Roy. Statist. Soc. B 46:1984;440-464.
33. Critchley F., Marriott P., Salmon M. On the differential geometry of the Wald test with nonlinear restrictions. Econometrica. 64:1996;1213-1222.
34. Dagenais M.G., Dufour J.-M. Invariance, nonlinear models, and asymptotic tests. Econometrica. 59:1991;1601-1615.
35. 1 . Biometrica 60, 613-622. (Correction (1974) , 61, 637).
36. 1 . Biometrica 60, 613-622. (Correction (1974) , 61, 637).
37. Das Gupta S. Discriminant analysis. Fienberg S.E., Hinkley D.V. R.A. Fisher: An Appreciation. 1980;161-170 Springer, Berlin.
38. Davidson R., MacKinnon J.G. Small sample properties of alternative forms of the Lagrange multiplier test. Econom. Lett. 12:1983;269-275.
39. Davidson R., MacKinnon J.G. Convenient specification tests for logit and probit models. J. Econometrics. 25:1984;241-262.
40. Davidson R., MacKinnon J.G. Artificial regressions and. C(α) tests Econom. Lett. 35:1991;149-153.
41. Davidson R., MacKinnon J.G. Estimation and Inference in Econometrics. 1993;Oxford University Press, Oxford.
42. DeGroot M.H. A conversation with C.R. Rao. Statist. Sci. 2:1987;53-67.
43. Dufour J.-M., Dagenais M.G. Nonlinear models, rescaling and test invariance. J. Statist. Plann. Inference. 32:1992;111-135.
44. Ferrari S.L.P., Cribari-Neto F. On the corrections to the Wald test of non-linear restrictions. Econom. Lett. 42:1993;321-326.
45. Fisher R.A. Theory of statistical estimation. Proc. Cambridge Philos. Soc. 22:1925;700-725.
46. Fisher R.A. Statistical Methods for Research Workers. 1925;Oliver and Boyd, Edinburgh.
47. Fisher R.A. The moments of the distribution for normal samples of measures of departure from normality. Proc. Roy. Soc. A 130:1930;16-28.
48. Fisher R.A. The detection of linkage with 'dominant' abnormalities. Ann. Eugen. 6:1935;187-201.
49. Fisher R.A. The use of multiple measurements in taxonomic problems. Ann. Eugen. 7:1936;179-188.
50. Fisher R.A. The statistical utilization of multiple measurements. Ann. Eugen. 8:1938;376-386.
51. Fisher R.A. A system of scoring linkage data, with special reference to the pied factors in mice. Amer. Nat. 80:1946;568-578.
52. Godfrey L.G. Misspecification Tests in Econometrics, The Lagrange Multiplier Principle and Other Approaches. 1988;Cambridge University Press, Cambridge.
53. Godfrey, L.G., Orme, C.D., 1998. On improving the robustness and reliability of Rao's score test, this issue.
54. Greenwood P.E., Nikulin M.S. A Guide to Chi-Squared Testing. 1996;Wiley, New York.
55. Gregory A.W., Veall M.R. Formulating Wald tests of nonlinear restrictions. Econometrica. 53:1985;1465-1468.
56. Hacking I. Trial by number. Science. 84(5):1984;67-70.
57. Hagenaars J.A. Categorical Longitudinal Data: Log-Linear Panel, Trend and Cohort Analysis. 1990;Sage Publications, Newbury Park.
58. Hall W.J., Mathiason D. On large-sample estimation and testing in parametric models. Internat. Statist. Rev. 58:1990;77-97.
59. Hiemstra C., Jones J.D. Another look at long memory in common stock returns. J. Emp. Finance. 4:1997;373-401.
60. Horowitz J.L. Bootstrap methods in econometrics: theory and numerical performance. Kreps D.M., Wallis K.F. Advances in Economics and Econometrics: Theory and Applications, Vol. 3. 1997;188-222 Cambridge University Press, Cambridge.
61. Hotelling H. The generalization of Student's ratio. Ann. Math. Statist. 2:1931;360-378.
62. Hurst H. Long term storage capacity of reservoirs. Trans. Amer. Soc. Civil Eng. 116:1951;770-779.
63. Jarque C.M., Bera A.K. Test for normality of observations and regression residuals. Internat. Statist. Rev. 55:1987;163-172.
64. Jensen U. A review of the derivation and calculation of Rao distances with an application to portfolio theory. Maddala G.S., Phillip P.C.B., Srinivasan T.N. Advances in Econometrics and Quantitative Economics. 1995;413-462 Blackwell, Oxford.
65. Kendall M.G., Stuart A. The Advanced Theory of Statistics, Vol. 1. 1977;Griffin, London.
66. Kiefer N.M., Salmon M. Testing normality in econometric model. Econom. Lett. 11:1983;123-127.
67. Koehler K.J. Goodness-of-fit tests for log-linear models in sparse contingency tables. J. Amer. Statist. Assoc. 81:1986;483-493.
68. Krishnankutty, N., 1996. Putting Chance to Work: A Biography of C.R. Rao. Dialogue, State College.
69. Lafontaine F., White K. Obtaining any Wald statistic you want. Econom. Lett. 21:1986;35-40.
70. Lancaster H.O. The Chi-Squared Distribution. 1969;Wiley, New York.
71. 2 test statistics in small samples of one-way multinomials Biometrika. 71:1984;415-418.
72. Le Cam L. Locally asymptotically normal families of distributions. Univ. California Publ. Statist. 3:1960;37-98.
73. Lee J.H.H. A Lagrange multiplier test for GARCH models. Econom. Lett. 37:1991;265-271.
74. Li, B., 1997. Discussion of the session '50 years of Rao's score test', Joint Statistical Meetings, August 1997, Anaheim, California.
75. Lin C.-C., Mudholkar G.S. A simple test for normality against asymmetric alternatives. Biometrika. 67:1980;455-461.
76. Lo A. Long-term memory in stock market prices. Econometrica. 59:1991;1279-1313.
77. Lombardi, G.J., 1951. The sequential selection of judges for organoleptic testing. Unpublished Ph.D. Dissertation, Virginia Polytechnic Institute.
78. Maddala G.S. Limited Dependent and Qualitative Variables in Econometrics. 1983;Cambridge University Press, Cambridge.
79. Maddala G.S., Phillips P.C.B., Srinivasan T.N. (Eds.) Advances in Econometrics and Quantitative Economics. 1995;Blackwell, Oxford.
80. Mahalanobis P.C. Analysis of race mixture in Bengal. J. Proc. Asiatic Soc. Bengal. 23:1927;301-333.
81. Mahalanobis P.C. On tests and measures of group divergence. J. Proc. Asiatic Soc. Bengal. 26:1930;541-588.
82. Mahalanobis P.C. Editorial. Sankhyā 1:1933;1-4.
83. Mahalanobis P.C. On the generalized distance in statistics. Proc. Natl. Inst. Sci. India. 2:1936;49-55.
84. Mahalanobis P.C. Statistics as a key technology. Amer. Statist. 19:1965;43-46.
85. Mandelbrot B., Wallis J. Robustness of rescaled range R. / S in the measurement of noncyclic long run statistical dependence Water Resour. Res. 5:1969;967-988.
86. Mardia K.V. Tests of univariate and multivariate normality. Krishnaiah P.R. Handbook of Statistics, Vol. 1. 1980;279-320 North-Holland, Amsterdam.
87. Moore D.S. Tests of chi-squared type. D'Agostino R.B., Stephens M.A. Goodness-of-fit-Techniques. 1986;63-95 Marcel Dekker, New York.
88. Moran P.A.P. A test for the serial independence of residuals. Biometrika. 37:1950;178-181.
89. Mukerjee R. Rao's score test: recent asymptotic results. Maddala G.S., Rao C.R., Vinod H.D. Handbook of Statistics, Vol. 11. 1993;363-379 North-Holland, Amsterdam.
90. Nelder J.A. Log linear models for contingency tables: a generalization of classical least squares. Appl. Statist. 23:1974;323-329.
91. Neyman J. Optimal asymptotic test of composite statistical hypothesis. Grenander U. Probability and Statistics, the Harald Cramér Volume. 1959;213-234 Almqvist and Wiksell, Uppsala.
92. Neyman J. C(α) tests and their use Sankhyā A 41:1979;1-21.
93. Neyman J., Pearson E.S. On the use of interpretation of certain test criteria for purpose of statistical inference. Biometrika. 20:1928;175-240.
94. Neyman J., Pearson E.S. On the problem of the most efficient tests of statistical hypotheses. Philos. Trans. Roy. Soc. A 231:1933;289-337.
95. Pearson E.S. A further development of tests for normality. Biometrika. 22:1930;239-249.
96. Pearson K. Contribution to the mathematical theory of evolution - II. Skewed variation in homogeneous material. Philos. Trans. Roy. Soc. A 186:1895;343-414.
97. Pearson K. On the criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random sampling. Philos. Mag. Ser. 5. 50:1900;157-175.
98. Pearson K. Mathematical contribution to the theory of evolution - XIX. Second supplement to a memoir on skewed variations. Philos. Trans. Roy. Soc. A 207:1916;429-437.
99. Pérez-Amaral, T., 1990. M-tests and dynamic information matrix tests with an application to linear regression. Discussion Paper, Departmento de Economia Cuantitativa, Universidad Complutense de Madrid.
100. Phillips P.C.B, Park J.Y. On the formulation of Wald tests of nonlinear restrictions. Econometrica. 56:1988;1065-1083.
101. Poskitt D.S., Tremayne A.R. Testing the specification of a fitted autoregressive-moving average model. Biometrika. 67:1980;359-363.
102. Rao C.R. Information and accuracy attainable in the estimation of statistical parameters. Bull. Calcutta Math. Soc. 37:1945;81-91.
103. Rao C.R. Large sample tests of statistical hypotheses concerning several parameters with applications to problems of estimation. Proc. Cambridge Philos. Soc. 44:1948;50-57.
104. Rao C.R. Tests of significance in multivariate analysis. Biometrika. 35:1948;58-79.
105. Rao C.R. The utilization of multiple measurements in problems of biological classification. J. Roy. Statist. Soc. 10:1948;159-203.
106. Rao C.R. Sequential tests of null hypotheses. Sankhyā 10:1950;361-370.
107. Rao C.R. Sir Ronald Fisher - the architect of multivariate analysis. Biometrics. 20:1964;286-300.
108. Rao C.R. Linear Statistical Inference and its Applications. 1973;Wiley, New York.
109. Rao C.R. Statistics as a last resort. Ghosh J.K., Mitra S.K., Parthasarathy K.R. Glimpses of India's Statistical Heritage. 1992;151-213 Wiley Easten, New Delhi.
110. Rao C.R, Mukerjee R. Tests based on score statistics: power properties and related results. Math. Methods. Statist. 3:1994;46-61.
111. Rao C.R., Poti S.J. On locally most powerful tests when alternative are one sided. Sankhyā 7:1946;439.
112. Rayner J.C.W., Best D.J. Smooth Tests of Goodness of Fit. 1989;Oxford University Press, New York.
113. Reid C. Neyman - From Life. 1982;Springer, New York.
114. Roussas G.G. Contiguity of Probability Measures: Some Applications in Statistics. 1972;Cambridge University Press, Cambridge.
115. Rudra A. Prasanta Chandra Mahalanobis - A Biography. 1996;Oxford University Press, Oxford.
116. Sen P.K. Introduction to Rao. (1948) 'Large sample tests of statistical hypotheses concerning several parameters with applications to problems of estimation'. Kotz S., Johnson N.L. Breakthroughs in Statistics, Vol. III. 1997;89-98 Springer, New York.
117. Serfling R.J. Approximation Theorems of Mathematical Statistics. 1980;Wiley, New York.
118. Smith R. Alternative asymptotically optimal tests and their application to dynamic specification. Rev. Econom. Stud. 54:1987;665-680.
119. Silvey S.D. The Lagrange multiplier test. Ann. Math. Statist. 30:1959;389-407.
120. Silvey S.D. Statistical Inference. 1975;Chapman & Hall, London.
121. Wald A. Some examples of asymptotically most powerful tests. Ann. Math. Statist. 12:1941;396-408.
122. Wald A. Tests of statistical hypothesis concerning several parameters when the number of observation is large. Trans. Amer. Math. Soc. 54:1943;426-482.
123. Wald A. Sequential Analysis. 1947;Wiley, New York.
124. Wald A. Note on the consistency of the maximum likelihood estimate. Ann. Math. Statist. 20:1949;595-601.
125. White H. Maximum likelihood estimation of misspecified models. Econometrica. 50:1982;1-25.
126. White H. Comment on 'Tests of specification in econometrics'. Econometric Rev. 3:1984;261-267.
127. White H. Estimation, Inference and Specification Analysis. 1994;Cambridge University Press, Cambridge.
128. White H., MacDonald G.M. Some large sample tests for non-normality in the linear regression model. J. Amer. Statist. Assoc. 75:1980;16-28.
129. Wilks S.S. The large-sample distribution of the likelihood ratio for testing composite hypotheses. Ann. Math. Statist. 9:1938;60-62.
130. Williams K. The failure of Pearson's goodness of fit statistic. Statistician. 25:1976;49.