A hidden process regression model for functional data description. Application to curve discrimination

Neurocomputing

Volumn 73, Issue 7-9, 2010, Pages 1210-1221

  Chamroukhi, Faicel ^a,b   Samé, Allou ^a   Govaert, Gérard ^b   Aknin, Patrice ^a  

^a Laboratory of New Technologies   (France)

^b UNIVERSITÉ DE TECHNOLOGIE DE COMPIÈGNE   (France)

Author keywords

Curve classification; EM algorithm; Functional data description; Hidden process; Maximum likelihood; Regression

Indexed keywords

CURVE DISCRIMINATION; CURVE MODELING; EM ALGORITHM; EM ALGORITHMS; EXPECTATION-MAXIMIZATION ALGORITHMS; FUNCTIONAL DATAS; GENERATIVE MODEL; LOGISTIC PROCESS; MAXIMUM A POSTERIORI; MODEL PARAMETERS; NEW APPROACHES; PIECEWISE REGRESSION; REGRESSION MODEL; SWITCH OPERATION; TO CURVE;

DATA DESCRIPTION; REGRESSION ANALYSIS;

MAXIMUM LIKELIHOOD;

ALGORITHM; ARTICLE; CLUSTER ANALYSIS; CONCEPTUAL FRAMEWORK; DATA ANALYSIS; DISCRIMINANT ANALYSIS; MATHEMATICAL ANALYSIS; PRIORITY JOURNAL; REGRESSION ANALYSIS;

EID: 77649231983     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2009.12.023     Document Type: Article

References (28)

1. Bellman R. On the approximation of curves by line segments using dynamic programming. Communications of the Association for Computing Machinery (CACM) 6 4 (1961) 284
2. Brailovsky V.L., and Kempner Y. Application of piece-wise regression to detecting internal structure of signal. Pattern Recognition 25 11 (1992) 1361-1370
3. Breiman L., Friedman J.H., Olshen R.A., and Stone C.J. Classification and Regression Trees (1984), Wadsworth
4. Chamroukhi F., Samé A., Govaert G., and Aknin P. Time series modeling by a regression approach based on a latent process. Neural Networks 22 5-6 (2009) 593-602
5. F. Chamroukhi, A. Samé, G. Govaert and P. Aknin, A regression model with a hidden logistic process for signal parameterization, in: Proceedings of XVIIth European Symposium on Artificial Neural Networks (ESANN), Bruges, Belgium, April 2009, pp. 503-508.
6. Chen K., Xu L., and Chi H. Improved learning algorithms for mixture of experts in multiclass classification. IEEE Transactions on Neural Networks 12 9 (1999) 1229-1252
7. Dempster A.P., Laird N.M., and Rubin D.B. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society B 39 1 (1977) 1-38
8. G. Ferrari-Trecate, M. Muselli, A new learning method for piecewise linear regression, in: International Conference on Artificial Neural Networks (ICANN), Madrid, Spain, August 2002, pp. 28-30.
9. Fisher W.D. On grouping for maximum homogeneity. Journal of the American Statistical Association 53 (1958) 789-798
10. Green P. Iteratively reweighted least squares for maximum likelihood estimation, and some robust and resistant alternatives. Journal of the Royal Statistical Society B 46 2 (1984) 149-192
11. Hastie T., Tibshirani R., and Friedman J. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. second ed. (2009), Springer, Berlin
12. Hastie T., and Tibshirani R. Discriminant analysis by Gaussian mixtures. Journal of the Royal Statistical Society B 58 (1996) 155-176
13. B. Hugueney, G. Hébrail, Y. Lechevallier, F. Rossi, Simultaneous clustering and segmentation for functional data, in: Proceedings of XVIIth European Symposium on Artificial Neural Networks (ESANN), Bruges, Belgium, April 2009, pp. 281-286.
14. James G. Generalized linear models with functional predictor variables. Journal of the Royal Statistical Society B 64 (2002) 411-432
15. James G., and Hastie T. Functional linear discriminant analysis for irregularly sampled curves. Journal of the Royal Statistical Society Series B 63 (2001) 533-550
16. Jordan M.I., and Jacobs R.A. Hierarchical mixtures of experts and the EM algorithm. Neural Computation 6 (1994) 181-214
17. Krishnapuram B., Carin L., Figueiredo M.A.T., and Hartemink A.J. Sparse multinomial logistic regression: fast algorithms and generalization bounds. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 6 (2005) 957-968
18. Y. Lechevalier, Optimal clustering on ordered set, Technical Report, The French National Institute for Research in Computer Science and Control (INRIA), 1990.
19. McGee V.E., and Carleton W.T. Piecewise regression. Journal of the American Statistical Association 65 (1970) 1109-1124
20. McLachlan G.J., and Krishnan T. The EM Algorithm and Extensions, Wiley Series in Probability and Statistics (1997), Wiley, New York
21. Picard F., Robin S., Lebarbier E., and Daudin J.-J. A segmentation/clustering model for the analysis of array CGH data. Biometrics 63 3 (2007) 758-766
22. Quandt R.E., and Ramsey J.B. Estimating mixtures of normal distributions and switching regressions. Journal of the American Statistical Association 73 (1978) 730-738
23. Ramsay J.O., and Silverman B.W. Functional Data Analysis, Springer Series in Statistics. second ed. (2005), Springer, Berlin
24. Ramsay J.O., and Silverman B.W. Applied Functional Data Analysis Methods and Case Studies, Springer Series in Statistics (2002), Springer, Berlin
25. Rossi F., and Villa N. Support vector machine for functional data classification. Neurocomputing 69 7-9 (2006) 730-742
26. Rossi F., and Conan-Guez B. Functional multi-layer perceptron: a nonlinear tool for functional data analysis. Neural Networks 18 1 (2005) 45-60
27. Schwarz G. Estimating the dimension of a model. Annals of Statistics 6 (1978) 461-464
28. S.R. Waterhouse, Classification and regression using mixtures of experts, Ph.D. Thesis, Department of Engineering, Cambridge University, 1997.