Discriminative dimensionality reduction for multi-dimensional sequences

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 40, Issue 1, 2018, Pages 77-91

  Su, Bing ^a   Ding, Xiaoqing ^b   Fellow, Life ^b   Wang, Hao ^a   Wu, Ying ^c  

^a INSTITUTE OF SOFTWARE   (China)

^b TSINGHUA UNIVERSITY   (China)

^c Northwestern University   (United States)

Author keywords

character recognition; Dimensionality reduction; Discriminant analysis; metric learning; Sequence classification

Indexed keywords

CHARACTER RECOGNITION;

DIMENSIONAL SUBSPACE; DIMENSIONALITY REDUCTION; DIMENSIONALITY REDUCTION METHOD; DYNAMICAL STRUCTURE; INDEPENDENT SAMPLES; METRIC LEARNING; SEQUENCE CLASSIFICATION; SEQUENCE STATISTICS;

DISCRIMINANT ANALYSIS;

EID: 85021765726     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2017.2665545     Document Type: Article

References (56)

1. R. Haeb-Umbach and H. Ney, "Linear discriminant analysis for improved large vocabulary continuous speech recognition, " in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., 1992, vol. 1, pp. 13-16.
2. R. A.-H. Mohamad, L. Likforman-Sulem, and C. Mokbel, "Combining slanted-frame classifiers for improved HMM-based Arabic handwriting recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 7, pp. 1165-1177, Jul. 2009.
3. F. Zhou and F. De la Torre, "Generalized time warping for multimodal alignment of human motion, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 1282-1289.
4. I. Jolliffe, Principal Component Analysis. New York, NY, USA: Springer-Verlag, 1986.
5. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding, " Science, vol. 290, no. 5500, pp. 2323-2326, 2000.
6. B. Su and X. Ding, "Linear sequence discriminant analysis: A model-based dimensionality reduction method for vector sequences, " in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 889-896.
7. E. Kokiopoulou and Y. Saad, "Orthogonal neighborhood preserving projections: A projection-based dimensionality reduction technique, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 12, pp. 2143-2156, Dec. 2007.
8. R. A. Fisher, "The use of multiple measurements in taxonomic problems, " Ann. Eugenics, vol. 7, no. 2, pp. 179-188, 1936.
9. M. Loog, R. P. W. Duin, and R. Haeb-Umbach, "Multiclass linear dimension reduction by weighted pairwise Fisher criteria, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 7, pp. 762-766, Jul. 2001.
10. O. Hamsici and A. Martinez, "Bayes optimality in linear discriminant analysis, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 4, pp. 647-657, Apr. 2008.
11. M. Loog and R. Duin, "Linear dimensionality reduction via a heteroscedastic extension of LDA: The Chernoff criterion, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 6, pp. 732-739, Jun. 2004.
12. M. Zhu and A. Martinez, "Subclass discriminant analysis, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 8, pp. 1274-1286, Aug. 2006.
13. W. Bian and D. Tao, "Max-min distance analysis by using sequential SDP relaxation for dimension reduction, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 5, pp. 1037-1050, May 2011.
14. B. Su, X. Ding, C. Liu, and Y. Wu, "Heteroscedastic max-min distance analysis, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 4539-4547.
15. H. Wang and C. Schmid, "Action recognition with improved trajectories, " in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 3551-3558.
16. A. Tefas, A. Iosifidis, and I. Pitas, "Multidimensional sequence classification based on fuzzy distances and discriminant analysis, " IEEE Trans. Knowl. Data Eng., vol. 25, no. 11, pp. 2564-2575, Nov. 2013.
17. Z. Xing, J. Pei, and E. Keogh, "A brief survey on sequence classification, " ACM SIGKDD Explorations Newslett., vol. 12, no. 1, pp. 40-48, 2010.
18. J. Durbin, "The fitting of time-series models, " Revue de l'Institut International de Statistique, vol. 28, pp. 233-244, 1960
19. J. Frank, S. Mannor, J. Pineau, and D. Precup, "Time series analysis using geometric template matching, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 3, pp. 740-754, Mar. 2013.
20. L. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition, " Proc. IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989.
21. J. Lafferty, A. McCallum, and F. C. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data, " in Proc. Int. Conf. Mach. Learning, 2001, pp. 282-289.
22. H. Sakoe and S. Chiba, "Dynamic programming algorithm optimization for spoken word recognition, " IEEE Trans. Acoust. Speech Signal Process., vol. 26, no. 1, pp. 43-49, Feb. 1978.
23. C. A. Ratanamahatana and E. Keogh, "Making time-series classification more accurate using learned constraints, " in Proc. SIAM Int. Conf. Data Mining, 2004, pp. 11-22.
24. M. Vlachos, M. Hadjieleftheriou, D. Gunopulos, and E. Keogh, "Indexing multidimensional time-series, " VLDB J.-Int. J. Very Large Data Bases, vol. 15, no. 1, pp. 1-20, 2006.
25. J. Rodriguez-Serrano and F. Perronnin, "A model-based sequence similarity with application to handwritten word-spotting, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2108-2120, Nov. 2012.
26. C. Faloutsos and R. T. Snodgrass, "Fast subsequence matching in time-series databases, " in Proc. Int. Conf. ACM SIGMOD, 1994, pp. 419-429.
27. K.-P. Chan and A. W.-C. Fu, "Efficient time series matching by wavelets, " in Proc. Int. Conf. Data Eng., 1999, pp. 126-133.
28. L. Ye and E. Keogh, "Time series shapelets: A new primitive for data mining, " in Proc. ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2009, pp. 947-956.
29. M. Baydogan, G. Runger, and E. Tuv, "A bag-of-features framework to classify time series, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 11, pp. 2796-2802, Nov. 2013.
30. M. S. Ryoo, B. Rothrock, and L. Matthies, "Pooled motion features for first-person videos, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 896-904.
31. B. Fernando, E. Gavves, J. M. Oramas, A. Ghodrati, and T. Tuytelaars, "Modeling video evolution for action recognition, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 5378-5387.
32. F. Zhou and F. Torre, "Canonical time warping for alignment of human behavior, " in Proc. Adv. Neural Inform. Process. Syst., 2009, pp. 2286-2294.
33. A. Shyr, R. Urtasun, and M. I. Jordan, "Sufficient dimension reduction for visual sequence classification, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recog., 2010, pp. 3610-3617.
34. H. Cao, R. Prasad, and P. Natarajan, "OCR-driven writer identification and adaptation in an HMM handwriting recognition system, " in Proc. Int. Conf. Document Anal. Recog., 2011, pp. 739-743.
35. A. Graves, A.-R. Mohamed, and G. Hinton, "Speech recognition with deep recurrent neural networks, " in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., 2013, pp. 6645-6649.
36. I. Sutskever, O. Vinyals, and Q. V. Le, "Sequence to sequence learning with neural networks, " in Proc. 27th Int. Conf. Adv. Neural Inform. Process. Syst., 2014, pp. 3104-3112.
37. J. Yue-Hei Ng , M. Hausknecht, S. Vijayanarasimhan, O. Vinyals, R. Monga, and G. Toderici, "Beyond short snippets: Deep networks for video classification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 4694-4702.
38. R. Lotlikar and R. Kothari, "Fractional-step dimensionality reduction, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 6, pp. 623-627, Jun. 2000.
39. M. Cuturi, "Fast global alignment kernels, " in Proc. 28th Int. Conf. Mach. Learn., 2011, pp. 929-936.
40. L. J. Rodriguez and I. Torres, "Comparative study of the Baum-Welch and Viterbi training algorithms applied to read and spontaneous speech recognition, " in Pattern Recognition and Image Analysis, F. J. Perales, A. J. C. Campilho, N. P. de la Blanca, and A. Sanfeliu, Eds. Berlin, Germany: Springer, 2003, pp. 847-857.
41. K. Bache and M. Lichman, UCI Machine Learning Repository. Irvine, CA, USA: School Inform. and Comput. Sci., Univ. California, Irvine, 2013.
42. M. W. Kadous, "Temporal classification: Extending the classification paradigm to multivariate time series, " Ph.D. dissertation, School Comput. Sci. and Eng., Univ. New South Wales, Sydney NSW, Australia, 2002.
43. S. Young, et al., The HTK Book. Cambridge, U.K.: Cambridge Univ. Eng. Dept., 2001.
44. S. Escalera, et al., "Multi-modal gesture recognition challenge 2013: Dataset and results, " in Proc. 15th ACM Int. Conf. Multimodal Interaction, 2013, pp. 445-452.
45. J. Wu, J. Cheng, C. Zhao, and H. Lu, "Fusing multi-modal features for gesture recognition, " in Proc. 15th ACM Int. Conf. Multimodal Interaction, 2013, pp. 453-460.
46. T. Pfister, J. Charles, and A. Zisserman, "Domain-Adaptive discriminative one-shot learning of gestures, " in Proc. Eur. Conf. Comput. Vis., 2014, pp. 814-829.
47. A. Björck and G. H. Golub, "Numerical methods for computing angles between linear subspaces, " Math. Comput., vol. 27, no. 123, pp. 579-594, 1973.
48. M. Werman and D. Weinshall, "Similarity and affine invariant distances between 2D point sets, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 17, no. 8, pp. 810-814, Aug. 1995.
49. F. Slimane, R. Ingold, S. Kanoun, A. M. Alimi, and J. Hennebert, "A new Arabic printed text image database and evaluation protocols, " in Proc. Int. Conf. Document Anal. Recog., 2009, pp. 946-950.
50. I. Alkhoury, A. Gimenez, and A. Juan, "Arabic handwriting recognition using Bernoulli HMMs, " in Guide to OCR for Arabic Scripts, V. Märgner and H. Abed, Eds. Berlin, Germany: Springer, 2012, pp. 255-272.
51. B. Su, X. Ding, L. Peng, and C. Liu, "A novel baseline-independent feature set for Arabic handwriting recognition, " in Proc. Int. Conf. Document Anal. Recog., 2013, pp. 1250-1254.
52. F. Slimane, R. Ingold, S. Kanoun, A. M. Alimi, and J. Hennebert, "Impact of character models choice on Arabic text recognition performance, " in Proc. Int. Conf. Frontiers Handwriting Recog., 2010, pp. 670-675.
53. M. Pechwitz, S. S. Maddouri, V.Märgner, N. Ellouze, and H. Amiri, "IFN/ENIT-database of handwritten Arabic words, " in Proc. Colloque Int. Francophone sur l'Ecrit et le Document, 2002, vol. 2, pp. 127-136.
54. V. Märgner and H. Abed, "ICDAR 2011 Arabic handwriting recognition competition, " in Proc. Int. Conf. Document Anal. Recog., 2011, pp. 1444-1448.
55. V. Margner and H. E. Abed, "ICFHR 2010-Arabic handwriting recognition competition, " in Proc. Int. Conf. Frontiers Handwriting Recog., 2010, pp. 709-714.
56. P. Dreuw, D. Rybach, G. Heigold, and H. Ney, "RWTH OCR: A large vocabulary optical character recognition system for Arabic scripts, " in Guide to OCR for Arabic Scripts, V. Märgner and H. Abed, Eds. Berlin, Germany: Springer, 2012, pp. 215-254.