On tests for global maximum of the log-likelihood function

IEEE Transactions on Information Theory

Volumn 53, Issue 7, 2007, Pages 2510-2525

  Blatt, Doron ^a   Hero III, Alfred O ^b  

^a DRW Trading Group   (United States)

^b UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Array processing; Gaussian mixtures; Global optimization; Local maxima; Maximum likelihood (ML); Parameter estimation; Superimposed exponentials in noise

Indexed keywords

GAUSSIAN MIXTURES; KULLBACK-LEIBLER DIVERGENCE; LOG-LIKELIHOOD FUNCTION; RENYI DIVERGENCE;

ASYMPTOTIC ANALYSIS; GLOBAL OPTIMIZATION; MAXIMUM LIKELIHOOD; PARAMETER ESTIMATION;

ARRAY PROCESSING;

EID: 34447338024     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2007.899537     Document Type: Article

References (45)

1. S. M. Kay, Fundamentals of Statistical Signal Processing: Estimation Theory. Upper Saddle River, NJ: Prentice-Hall, 1993.
2. P. Huber, Robust Statistics. New York: Wiley, 1981.
3. H. L. V. Trees, Detection, Estimation, and Modulation Theory. New York: Wiley, 2001.
4. C. Andrieu and A. Doucet, "Simulated annealing for maximum a posteriori parameter estimation of hidden Markov models," IEEE Trans. Inf. Theory, vol. 46, no. 3, pp. 994-1004, May 2000.
5. C. Bon-Sen, L. Bore-Kuen, and P. Sen-Chueh, "Maximum likelihood parameter estimation of F-ARIMA processes using the genetic algorithm in the frequency domain," IEEE Trans. Signal Process., vol. 50, no. 9, pp. 2208-2220, Sep. 2002.
6. C. H. Slump and B. J. Hoenders, "The determination of the location of the global maximum of a function in the presence of several local extrema," IEEE Trans. Inf. Theory, vol. IT-31, no. 4, pp. 490-497, Jul. 1985.
7. S. F. Yau and Y. Bresler, "Maximum likelihood parameter estimation of superimposed signals by dynamic programming," IEEE Trans. Signal Process., vol. 41, no. 2, pp. 804-820, Feb. 1993.
8. I. Ziskind and M.Wax, "Maximum likelihood localization of diversely polarized sources by simulated annealing," IEEE Trans. Antennas Propagat., vol. 38, no. 7, pp. 1111-1114, Jul. 1990.
9. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data using the EM algorithm," J. Roy. Statist. Soc. Ser. B, vol. 39, no. 1, pp. 1-38, 1977.
10. G. J. McLachlan and T. Krishnan, The EM Algorithm and Extensions. New York: Wiley, 1997.
11. D. Starer and A. Nehorai, "Newton algorithms for conditional and unconditional maximum likelihood estimation of the parameters of exponential signals in noise," IEEE Trans. Signal Process., vol. 40, no. 6, pp. 1528-1534, Jun. 1992.
12. H. Erdogan and J. A. Fessler, "Monotonic algorithms for transmission tomography," IEEE Trans. Med. Imag., vol. 18, no. 9, pp. 801-814, Sep. 1999.
13. D. R. Hunter and K. Lange, "A tutorial on MM algorithms," Amer. Statist., vol. 58, no. 1, pp. 30-37, Feb. 2004.
14. S. J. Finch, N. R. Mendell, and H. C. Thode Jr., "Probabilistic measure of adequacy of a numerical search for a global maximum," J. Amer. Statist. Assoc., vol. 84, no. 408, pp. 1020-1023, Dec. 1989.
15. P. J. Bickel and J. A. Yahav, "On estimating the total probability of the unobserved outcomes of an experiment," in Adaptive Statistical Procedures and Related Topics, J. van Ryzin, Ed. Hayward, CA: Inst. Math. Statist., 1986.
16. M. R. Veall, "Testing for a glomal maximum in an econometric context," Econometrica, vol. 58, no. 6, pp. 1459-1465, Nov. 1990.
17. L. de Haan, "Estimation of the minimum of a function using order statistics," J. Amer. Statist. Assoc., vol. 76, no. 374, pp. 467-469, Jun. 1981.
18. R. E. Dorsey and W. J. Mayer, "Detection of spurious maxima through random draw tests and specification tests," Computat. Econ., vol. 16, pp. 237-256, 2000.
19. L. Gan and J. Jiang, "A test for global maximum," J. Amer. Statist. Assoc., vol. 94, no. 447, pp. 847-854, Sep. 1999.
20. H. White, "Maximum likelihood estimation of misspecified models," Econometrica, vol. 50, no. 1, pp. 1-26, Jan. 1982.
21. C. Biernacki, "Un test pour le maximum global de vraisemblance," in 35ièmes Journées de Statistiques, SFdS'2003, Lyon, France, Jun. 2003.
22. C. Biernacki, "Testing for a global maximum of the likelihood," J. Comput. Graph. Statist., vol. 14, no. 3, pp. 657-674, Sep. 2005.
23. D. R. Cox, "Tests of separate families of hypotheses," in Proc. 4th Berkeley Symp. Mathematical Statistics and Probability, Berkeley, CA, 1961, vol. 1, pp. 105-123.
24. D. R. Cox, "Further results on tests of separate families of hypotheses," J. Roy. Statist. Soc. Ser. B, vol. 24, no. 2, pp. 406-424, 1962.
25. C. G. Small, J. Wang, and Z. Yang, "Eliminating multiple root problems in estimation," Statist. Sci., vol. 15, no. 4, pp. 313-341, 2000.
26. W. K. Newey, "Maximum likelihood specification testing and conditional moment tests," Econometrica, vol. 55, pp. 1047-1070, 1985.
27. G. Tauchen, "Diagnostic testing and evaluation of maximum likelihood models," J. Econometrics, vol. 30, pp. 415-444, 1985.
28. H. White, "Specification testing in dynamic models," in Advances in Econometrics, T. Bewley, Ed. New York: Cambridge Univ. Press, 1987.
29. H. White, Estimation, Inference and Specification Analysis. New York: Cambridge Univ. Press, 1994.
30. H. White, "Consequences and detection of misspecified nonlinear regression models," J. Amer. Statist. Assoc., vol. 76, no. 374, pp. 419-433, Jun. 1981.
31. R. I. Jennrich, "Asymptotic properties of non-linear least squares estimators," Ann. Math. Statist., vol. 40, no. 2, pp. 633-643, Apr. 1969.
32. N. L. Johnson, S. Kotz, and A. Balkrishnan, Continuous Univariate Distributions. New York: Wiley, 1994, vol. 2.
33. W. Xu, A. B. Baggeroer, and K. L. Bell, "A bound on mean-square estimation error with background parameter mismatch," IEEE Trans. Inf. Theory, vol. 50, no. 4, pp. 621-632, Apr. 2004.
34. S. Amari, Differential-Geometrical Methods in Statistics. Berlin, Germany: Springer-Verlag, 1990.
35. A. Hero et al., "Highlights of statistical signal and array processing," IEEE Signal Processing Mag., vol. 15, no. 5, pp. 21-64, Sep. 1998.
36. H. Krim and M. Viberg, "Two decades of array signal processing research: The parametric approach," IEEE Signal Processing Mag., vol. 13, no. 4, pp. 67-94, Jul. 1996.
37. J. Friedmann, E. Fishler, and H. Messer, "General asymptotic analysis of the generalized likelihood ratio test for a Gaussian point source under statistical or spatial mismodeling," IEEE Trans. Signal Process., vol. 50, no. 11, pp. 2617-2631, Nov. 2002.
38. P. Stoica and A. Nehorai, "MUSIC, maximum likelihood, and Cramér Rao bound," IEEE Trans. Acoust., Speech, Signal Process., vol. 37, no. 5, pp. 720-741, May 1989.
39. V. Nagesha and S. Kay, "Maximum likelihood estimation for array processing in colored noise," IEEE Trans. Signal Process., vol. 44, no. 2, pp. 169-180, Feb. 1996.
40. B. C. Levy and R. Nikoukhah, "Robust least-squares estimation with a relative entropy constraint," IEEE Trans. Inf. Theory, vol. 50, no. 1, pp. 89-104, Jan. 2004.
41. R. D. Nowak, "Distributed EM algorithms for density estimation and clustering in sensor networks," IEEE Trans. Signal Process., vol. 51, no. 8, pp. 2245-2253, Aug. 2003.
42. M. A. T. Figueiredo and A. K. Jain, "Unsupervised learning of finite mixture models," IEEE Trans. Pattern Anal. Machine Intell., vol. 24, no. 3, pp. 381-396, Mar. 2002.
43. C. R. Rao and L. C. Zhao, "Asymptotic behavior of maximum likelihood estimates of superimposed exponential signals," IEEE Trans. Signal Process., vol. 41, no. 3, pp. 1461-1464, Mar. 1993.
44. P. Billingsley, Probability and Measure. New York: Wiley, 1995.
45. H. White, "Nonlinear regression on cross-section data," Econometrica, vol. 48, no. 3, pp. 721-746, Apr. 1980.