A convex relaxation of a dimension reduction problem using the nuclear norm

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2012, Pages 2852-2857

  Lyzell, Christian ^a   Andersen, Martin ^a   Enqvist, Martin ^a  

^a LINKÖPING UNIVERSITY   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

DIMENSIONALITY REDUCTION; RELAXATION PROCESSES; STRUCTURAL OPTIMIZATION;

COMPUTATIONALLY EFFICIENT; CONVEX RELAXATION; DIMENSION REDUCTION; DIMENSION REDUCTION METHOD; INVERSE REGRESSION; NONCONVEX OPTIMIZATION PROBLEM; OPTIMIZATION PROBLEMS; STATISTICAL PROPERTIES;

INVERSE PROBLEMS;

EID: 84874283302     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2012.6426097     Document Type: Conference Paper

References (24)

1. K. C. Li, "Sliced inverse regression for dimension reduction," Journal of the American Statistical Association, vol. 86, no. 414, pp. 316-327, 1991.
2. E. Bura, "Using linear smoothers to assess the structural dimension of regressions," Statistica Sinica, vol. 13, 2003.
3. E. Bura and J. Yang, "Dimension estimation in sufficient dimension reduction: A unifying approach," Journal of Multivariate Analysis, vol. 102, no. 1, pp. 130-142, 2011.
4. C. Lyzell and M. Enqvist, "Sliced inverse regression for the identification of dynamical systems," in Proceedings of the 16th IFAC Symposium on System Identification, Brussels, Belgium, July 2012.
5. -, "Inverse regression for the Wiener class of systems," in Proceedings of the 16th IFAC Symposium on System Identification, Brussels, Belgium, July 2012.
6. Y. Xia, H. Tong, W. K. Li, and L. X. Zhu, "An adaptive estimation of dimension reduction subspace," Journal of the Royal Statistical Society: Series B, vol. 64, pp. 363-410, 2002.
7. S. Boyd and L. O. Chua, "Fading memory and the problem of approximating nonlinear operators with Volterra series," IEEE Trans. Circuits Syst., vol. 32, no. 11, 1985.
8. M. Schetzen, "Nonlinear system modelling and analysis from the Volterra and Wiener perspective," in Block-Oriented Nonlinear System Identification, ser. Lecture Notes in Control and Information Sciences, F. Giri and E. Bai, Eds. Springer Verlag, 2010.
9. J. Fan and I. Gijbels, Local Polynomial Modelling and Its Applications. Chapman & Hall, 1996.
10. A. Edelman, A. Tomás, and T. Steven, "The geometry of algorithms with orthogonality constraints," SIAM Journal on Matrix Analysis and Applications, vol. 20, no. 2, pp. 303-353, 1998.
11. P. A. Absil, R. Mahony, and R. Sepulchre, Optimization Algorithms on Matrix Manifolds. Princeton University Press, 2008.
12. J. Nocedal and S. J. Wright, Numerical Optimization. Springer, 2000.
13. P. Jain, R. Meka, and I. Dhillon, "Guaranteed rank minimization via singular value projection," in Proceedings of the 23rd Annual Conference on Advances in Neural Information Processing Systems, 2010, pp. 937-945.
14. M. Fazel, H. Hindi, and S. Boyd, "A rank minimization heuristic with application to minimum order system approximation," in Proceedings of the American Control Conference, 2001.
15. R. Tibshirani, "Regression shrinkage and selection via the Lasso," Journal of the Royal Statistical Society: Series B, vol. 58, no. 1, pp. 267-288, 1996.
16. Z. Liu and L. Vandenberghe, "Interior-point method for nuclear norm approximation with applications to system identification," SIAM Journal on Matrix Analysis and Applications, vol. 31, no. 3, pp. 1235-1256, 2009.
17. S. Ji and J. Ye, "An accelerated gradient method for trace norm minimization," in Proceedings of the 26th International Conferance on Machine Learning, 2009, pp. 457-464.
18. K. C. Toh and S. Yun, "An accelerated proximal gradient algorithm for nuclear norm regularized linear least squares problems," Optimization online, 2009.
19. L. Ljung, System Identification: Theory for the User, 2nd ed. Prentice Hall, 1999.
20. D. Westwick and M. Verhaegen, "Identifying MIMO Wiener systems using subspace model identification methods," Signal Processing, vol. 52, no. 2, 1996.
21. S. Y. Kung, "A new identification and model reduction algorithm via singular value decomposition," in Proceedings of the 12th Asilomar Conference on Circuits, Systems and Computers, Pacific Grove, CA, USA, 1978, pp. 705-714.
22. R. D. Cook and L. Ni, "Sufficient dimension reduction via inverse regression: A minimum discrepancy approach," Journal of the American Statistical Association, vol. 100, no. 470, pp. 410-428, 2011.
23. B. Li and Y. Dong, "Dimension reduction for nonelliptically distributed predictors," The Annals of Statistics, vol. 37, no. 3, pp. 1272-1298, 2009.
24. Y. Dong and B. Li, "Dimension reduction for non-elliptically distributed regressors: Second-order methods," Biometrica, vol. 97, no. 2, pp. 279-294, 2010.