Hessian matrix vs. Gauss-Newton Hessian matrix

SIAM Journal on Numerical Analysis

Volumn 49, Issue 4, 2011, Pages 1417-1435

  Chen, Pei ^a  

^a SUN YAT SEN UNIVERSITY   (China)

Author keywords

Gauss Newton Hessian matrix; Hessian matrix; Least squares problem

Indexed keywords

AFFINE SUBSPACES; APPROXIMATION FUNCTION; ASYMPTOTIC CONVERGENCE RATE; CRITICAL PROPERTIES; GAUSS-NEWTON; GAUSS-NEWTON ALGORITHM; HESSIAN MATRICES; INITIAL POINT; LEAST SQUARES PROBLEMS; LEVENBERG-MARQUARDT; MINIMAL VALUE; NEWTON ALGORITHM; NEWTON-TYPE METHODS; NONLINEAR LEAST SQUARES PROBLEMS; OBJECTIVE FUNCTIONS; QUADRATIC APPROXIMATION;

ALGORITHMS; CONVERGENCE OF NUMERICAL METHODS; LAGRANGE MULTIPLIERS; LEAST SQUARES APPROXIMATIONS;

GAUSSIAN DISTRIBUTION;

EID: 80052760869     PISSN: 00361429     EISSN: None     Source Type: Journal    
DOI: 10.1137/100799988     Document Type: Article

References (37)

1. S. BAKER AND I. MATTHEWS, Lucas-Kanade 20 years on: A unifying framework, Int. J. Comput. Vision, 56(2004), pp. 221-255.
2. J. R. BERGEN, P. ANANDAN, K. J. HANNA, AND R. HINGORANI, Hierarchical model-based motion estimation, in Proceedings of the European Conference on Computer Vision, 1992, pp. 237-252.
3. A. BJORCK, Numerical Methods for Least Squares Problems, SIAM, Philadelphia, 1996.
4. M. BLACK AND A. JEPSON, Eigen-tracking: Robust matching and tracking of articulated objects using a view-based representation, Int. J. Comput. Vision, 36(1998), pp. 101-130.
5. S. BOYD AND L. VANDENBERGHE, Convex Optimization, Cambridge University Press, London, 2004.
6. A. M. BUCHANAN AND A. W. FITZGIBBON, Damped Newton algorithms for matrix factorization with missing data, in Proceedings of the IEEE Computer Vision and Pattern Recognition, 2005, pp. 316-322.
7. J.-F. CAI, E. J. CANDES, AND Z. SHEN, A singular value thresholding algorithm for matrix completion, SIAM J. Optim., 20(2008), pp. 1956-1982.
8. E. J. CANDES AND T. TAO, The power of convex relaxation: Near-optimal matrix completion, IEEE Trans. Inform. Theory, 56(2010), pp. 2053-2080.
9. E. J. CANDES AND Y. PLAN, Matrix completion with noise, Proc. IEEE, 98(2010), pp. 925-936.
10. P. CHEN, Optimization algorithms on subspaces: Revisiting missing data problem in low-rank matrix, Int. J. Comput. Vision, 80(2008), pp. 125-142.
11. P. CHEN, Why not use the LM method for fundamental matrix estimation?, IET Computer Vision, 4(2010), pp. 286-294.
12. P. CHEN AND D. SUTER, Recovering the missing components in a large noisy low-rank matrix: Application to sfm, IEEE Trans. Pattern Anal. Mach. Intell., 26(2004), pp. 1051-1063.
13. G. E. CHRISTENSEN AND H. J. JOHNSON, Image consistent registration, IEEE Trans. Medical Imaging, 20(2001), pp. 568-582.
14. J. E. DENNIS AND R. B. SCHNABEL, Numerical Methods for Unconstrained Optimization and Nonlinear Equations, 1983. Reprinted as Classics in Applied Mathematics 16, SIAM, Philadelphia, 1996.
15. R. FLETCHER, Practical Methods of Optimization, 2nd ed., John Wiley & Sons, New York, 1987.
16. G. H. GOLUB AND C. F. V. LOAN, Matrix Computations, 3rd ed., Johns Hopkins University Press, Baltimore, MD, 1996.
17. E. HABER, U. M. ASCHER, AND D. OLDENBURG, On optimization techniques for solving nonlinear inverse problems, Inverse Problems, 16(2000), pp. 1263-1280. (Pubitemid 33661705)
18. G. D. HAGER AND P. N. BELHUMEUR, Efficient region tracking with parametric models of geometry and illumination, IEEE Trans. Pattern Anal. Mach. Intell., 20(1998), pp. 1025-1039. (Pubitemid 128741363)
19. R. I. HARTLEY, In defense of the eight-point algorithm, IEEE Trans. Pattern Anal. Mach. Intell., 19(1997), pp. 580-593. (Pubitemid 127762252)
20. R. I. HARTLEY AND A. ZISSERMAN, Multiple View Geometry in Computer Vision, 2nd ed., Cambridge University Press, London, 2003.
21. Y. HUA, M. NIKPOUR, AND P. STOICA, Optimal reduced-rank estimation and filtering, IEEE Trans. Signal Process., 49(2001), pp. 457-469. (Pubitemid 32583149)
22. K. KANATANI, Statistical bias of conic fitting and renormalization, IEEE Trans. Pattern Anal. Mach. Intell., 16(1994), pp. 320-326.
23. K. KANATANI, Statistical Optimization for Geometric Computation: Theory and Practice, Elsevier, Amsterdam, 1996.
24. H. C. LONGUET-HIGGINS, A computer algorithm for reconstructing a scene from two projections, Nature, 293(1981), pp. 133-135.
25. W. S. LU, S. C. PEI, AND P. H. WANG, Weighted low-rank approximation of general complex matrices and its application in the design of 2-d digital filter, IEEE Trans. Circuits Syst. I Regul. Pap., 44(1997), pp. 650-655.
26. B. LUCAS AND T. KANADE, An iterative image registration technique with an application to stereo vision, in Proceedings of the International Joint Conference on Artificial Intelligence, 1981, pp. 674-679. (Pubitemid 14478744)
27. I. MATTHEWS AND S. BAKER, Active appearance models revisited, Int. J. Comput. Vision, 60(2004), pp. 135-164.
28. J. J. MORÉ AND S. J. WRIGHT, Optimization software guide, Frontiers Appl. Math. 14, SIAM, Philadelphia, 1993.
29. J. NOCEDAL AND S. J. WRIGHT, Numerical Optimization, Springer Series in Operations Research, 2nd ed., Springer, New York, 2006.
30. C. POELMAN AND T. KANADE, A paraperspective factorization method for shape and motion recovery, IEEE Trans. Pattern Anal. Mach. Intell., 19(1997), pp. 206-219.
31. W. H. PRESS, S. A. TEUKOLSKY, W. T. VETTERLING, AND B. P. FLANNERY, Numerical Recipes in C, 2nd ed., Cambridge University Press, London, 1992.
32. P. D. SAMPSON, Fitting conic sections to "very scattered" data: An iterative refinement of the Bookstein algorithm, Comput. Graphics Image Process., 18(1982), pp. 97-108.
33. H. SHUM, K. IKEUCHI, AND R. REDDY, Principal component analysis with missing data and its applications to polyhedral object modeling, IEEE Trans. Pattern Anal. Mach. Intell., 17(1995), pp. 854-867.
34. H. SHUM AND R. SZELISKI, Construction of panoramic image mosaics with global and local alignment, Int. J. Comput. Vision, 16(2000), pp. 63-84.
35. C. TOMASI AND T. KANADE, Shape and motion from image streams under orthography: A factorization method, Int. J. Comput. Vision, 9(1992), pp. 137-154. (Pubitemid 23621943)
36. Z. ZHANG, On the optimization criteria used in two-view motion analysis, IEEE Trans. Pattern Anal. Mach. Intell., 20(1998), pp. 717-729. (Pubitemid 128744856)
37. Z. ZHU, A. M.-C. SO, AND Y. YE, Fast and near-optimal matrix completion via randomized basis pursuit, preprint, 2009.