Multinomial logistic regression-based feature selection for hyperspectral data

International Journal of Applied Earth Observation and Geoinformation

Volumn 14, Issue 1, 2012, Pages 214-220

  Pal, Mahesh ^a  

^a NATIONAL INSTITUTE OF TECHNOLOGY   (India)

Author keywords

Classification accuracy; Feature selection; Multinomial logistic regression; Support vector machines

Indexed keywords

ACCURACY ASSESSMENT; AVIRIS; DATA SET; REGRESSION ANALYSIS; SPECTRAL ANALYSIS;

EID: 84864409930     PISSN: 15698432     EISSN: 1872826X     Source Type: Journal    
DOI: 10.1016/j.jag.2011.09.014     Document Type: Article

References (51)

1. Aviris NW Indiana's Indian Pines, 1992. Data set Available Online: ftp://ftp.ecn.purdue.edu/biehl/MultiSpec/92AV3C (original files) and ftp://ftp.ecn.purdue.edu/biehl/PC MultiSpec/ThyFiles.zip (ground truth).
2. Bajcsy, P., Groves, P., 2004. Methodology for hyperspectral band selection. Photogrammetric Engineering and Remote Sensing 70, 793-802.
3. Benediktsson, J.A., Sveinsson, J.R., 1997. Feature extraction for multisource data classification with artificial neural networks. International Journal of Remote Sensing 18, 727-740.
4. Borges, J.S., Bioucas-Dias, J.M., Marcaļ, A.R.S., 2006. Fast sparse multinomial regression applied to hyperspectral data. In: Campilho, A., Kamel, M. (Eds.), ICIAR 2006, LNCS, 4142., pp. 700-709.
5. Boser, B.E., Guyon, I.M., Vapnik, V.N., 1992. Training algorithm for optimal margin classifiers. In: Haussler, D. (Ed.), Proceedings of the 5th Annual Workshop on Computational Learning Theory. ACM Press, Pittsburgh, PA, pp. 144-152.
6. Cawley, G.C., Talbot, N.L.C., 2006. Gene selection in cancer classification using sparse logistic regression with Bayesian regularisation. Bioinformatics 22, 2348-2355.
7. Cawley, G.C., Talbot, N.L.C., Girolami, M., 2007. Sparse multinomial logistic regression via Bayesian L1 regularisation. In: Schölkopf, B., Platt, J.C., Hoffmann, T. (Eds.), Advances in Neural Information Processing Systems, vol. 19. MIT Press, Cambridge, MA, USA.
8. Chang, C.-I., 2007. Hyperspectral Data Exploitation: Theory and Applications. John Wiley and Sons, New Jersey.
9. Cheng, Q., Varshney, P.K., Arora, M.K., 2006. Logistic regression for feature selection and soft classification of remote sensing data. IEEE Geoscience and Remote Sensing Letters 3, 491-494.
10. Chi, M., Bruzzone, L., 2005. A semilabeled-sample-driven bagging technique for illposed classification problems. IEEE Geosciences and Remote Sensing Letters 2, 69-73.
11. Cortes, C., Vapnik, V., 1995. Support-vector networks. Machine Learning 20, 273-297.
12. Cover, T.M., 1974. The best two independent measurements are not the two best. IEEE Transactions on Systems, Man, and Cybernetics 4, 116-117.
13. Cristianini, N., Shawe-Taylor, J., 2000. An Introduction to Support Vector Machines and other Kernel-based Learning Methods. Cambridge University Press, Cambridge, UK.
14. Dietterich, T.G., 1998. Approximate statistical tests for comparing supervised classification learning algorithms. Neural Computation 10, 1895-1923.
15. Hughes, G.F., 1968. On the mean accuracy of statistical pattern recognizers. IEEE Transactions on Information Theory IT-14, 55-63.
16. Jefferys, H., 1946. An invariant form for the prior probability in estimation problems. Proceedings of the Royal Society of London A: Mathematical and Physical Sciences 186 (1007), 453-461.
17. Foody, G.M., 2004. Thematic map comparison: evaluating the statistical significance of differences in classification accuracy. Photogrammetric Engineering and Remote Sensing 70, 627-633.
18. Foody, G.M., Mathur, A., 2004. Toward intelligent training of supervised image classifications: directing training data acquisition for SVM classification. Remote Sensing of Environment 93, 107-117.
19. Gradshteyn, I.S., Ryzhic, I.M., 2007. Table of Integrals, Series and Products, seventh edition. Academic Press, Oxford.
20. Guyon, I., Weston, J., Barnhill, S., Vapnik, V., 2002. Gene selection for cancer classification using support vector machines. Machine Learning 46, 389-422.
21. Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H., 2009. The WEKA data mining software: an update. SIGKDD Explorations 11, 10-18.
22. Hastie, T., Tibshirani, R., Friedman, J., 2001. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer, New York, USA.
23. Jain, A., Zongker, D., 1997. Feature selection: evaluation, application, and small sample performance. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 153-158.
24. Kavzoglu, T., Mather, P.M., 2002. The role of feature selection in artificial neural network applications. International Journal of Remote Sensing 23, 2787-2803.
25. Knerr, S., Personnaz, L., Dreyfus, G., 1990. Single-layer learning revisited: a stepwise procedure for building and training neural network. In: Neurocomputing: Algorithms, Architectures and Applications. NATO ASI, Springer-Verlag, Berlin.
26. Kohavi, R., John, G.H., 1997. Wrappers for feature subset selection. Artificial Intelligence 97, 273-324.
27. Korycinski, D., Crawford, M.M., Barnes, J.W., Ghosh, J., 2003. Adaptive feature selection for hyperspectral data analysis using a binary hierarchical classifier and tabu search. In: Proceedings of the 2003 International Geoscience and Remote Sensing Symposium, Toulouse, France, July 21-25, pp. 297-299.
28. Krishnapuram, B., Carin, L., Figueiredo, M.A.T., Hartemink, A.J., 2005. Sparse multinomial logistic regression: fast algorithms and generalization bounds. IEEE Transactions on Pattern Analysis and Machine Intelligence 27, 957-968.
29. Landgrebe, D.A., 2003. Signal Theory Methods in Multispectral Remote Sensing. John Wiley and Sons, Hoboken, New Jersey.
30. Liu, H., 2005. Evolving feature selection. IEEE Intelligent Systems 20, 64-76.
31. Loughrey, J., Cunningham, P., 2004. Overfitting in wrapper-based feature subset selection: the harder you try the worse it gets. In: Max Bramer, Frans Coenen, Tony Allen (Eds.), Research and Development in Intelligent Systems, vol. XXI. Springer, London, pp. 33-43.
32. Mather, P.M., Koch, M., 2011. Computer Processing of Remotely-Sensed Images: An Introduction, fourth edition. John Wiley and Sons, Chichester, UK.
33. Osuna, E.E., Freund, R., Girosi, F., 1997. Support vector machines: training and applications. A.I. Memo No. 1602, CBCL paper No. 144, Artificial Intelligence Laboratory, Massachusetts Institute of Technology, ftp://publications.ai.mit.edu/aipublications/pdf/AIM-1602.pdf.
34. Pal, M., 2002. Factors influencing the accuracy of remote sensing classifications: a comparative study. PhD Thesis, University of Nottingham. Available online at: http://etheses.nottingham.ac.uk/314/.
35. Pal, M., Mather, P.M., 2004. Assessment of the effectiveness of support vector machines for hyperspectral data. Future Generation Computer Systems 20, 1215-1225.
36. Pal, M., Mather, P.M., 2005. Support vector machines for classification in remote sensing. International Journal of Remote Sensing 26, 1007-1011.
37. Pal, M., Mather, P.M., 2006. Some issues in the classification of remote sensing data: a case study with DIAS hyperspectral data. International Journal of Remote Sensing 27, 2895-2916.
38. Pal, M., 2005. Multiclass approaches for support vector machine based land cover classification. In: 8th Annual International conference, Map India, http://www.mapindia.org/2005/papers/pdf/54.pdf (accessed 15.01.11).
39. Pal, M., 2006. Support vector machine-based feature selection for land cover classification: a case study with DAIS hyperspectral data. International Journal of Remote Sensing 27, 2877-2894.
40. Pal, M., 2009. Margin based feature selection for hyperspectral data. International Journal of Applied Earth Observations and Geoinformation 11, 212-220.
41. Pal, M., Foody, G.M., 2010. Feature selection for classification of hyperspectral data by SVM. IEEE Transactions on Geoscience and Remote Sensing 48, 2297-2306.
42. Saeys, Y., Inza, I., Larranaga, P., 2007. A review of feature selection techniques in bioinformatics. Bioinformatics 23, 2507-2517.
43. Serpico, S.B., Bruzzone, L., 2001. A new search algorithm for feature selection in hyperspectral remote sensing images. IEEE Transactions on Geoscience and Remote Sensing 39, 1360-1367.
44. Shevade, S.K., Keerthi, S.S., 2003. A simple and efficient algorithm for gene selection using sparse logistic regression. Bioinformatics 19, 2246-2253.
45. Strobl, P., Richter, R., Lehmann, F., Mueller, A., Zhukov, B., Oertel, D., 1996. Preprocessing for the airborne imaging spectrometer DAIS 7915. SPIE Proceedings 2758, 375-382.
46. Su, H., Sheng, Y., Du, P., 2008. A new band selection algorithm for hyperspectral data based on fractal dimension. In: The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XXXVII. Part B7, Beijing, pp. 279-284.
47. Tadjudin, S., Landgrebe, D.A., 1999. Covariance estimation with limited training samples. IEEE Transactions on Geoscience and Remote Sensing 37, 2113-2118.
48. Vapnik, W.N., Chervonenkis, A.Y., 1971. On the uniform convergence of relative frequencies of events to their probabilities. Theory of Probability and its Applications 17, 264-280.
49. Vapnik, V.N., 1995. The Nature of Statistical Learning Theory. Springer-Verlag, New York.
50. Williams, P.M., 1995. Bayesian regularization and pruning using a Laplace prior. Neural Computation 7, 117-143.
51. Zhong, P., Zhang, P., Wang, R., 2008. Dynamic learning of SMLR for feature selection and classification of hyperspectral data. IEEE Geoscience and Remote Sensing Letters 5, 280-284.