Discover novel visual categories from dynamic hierarchies using multimodal attributes

IEEE Transactions on Industrial Informatics

Volumn 9, Issue 3, 2013, Pages 1688-1696

  Zhang, Jianhua ^a   Zhang, Jianwei ^a   Chen, Shengyong ^a  

^a BIRLA INSTITUTE OF TECHNOLOGY   (India)

Author keywords

Constrained topic model; dynamic category hierarchies; multimodal object attributes; multimodal sensor; novel visual category discovery; RGB D data

Indexed keywords

MULTIMODAL SENSOR; NOVEL VISUAL CATEGORY DISCOVERY; OBJECT ATTRIBUTES; RGB-D DATA; TOPIC MODELING;

DATA PROCESSING;

IMAGE CLASSIFICATION;

EID: 84883034956     PISSN: 15513203     EISSN: None     Source Type: Journal    
DOI: 10.1109/TII.2013.2248741     Document Type: Article

References (32)

1. M. A. Callanan, "How parents label objects for young children: The role of input in the acquisition of category hierarchies," Child Dev., vol. 56, no. 2, pp. 508-523, 1985.
2. G. L. Murphy and M. E. Lassaline, "Ierarchical structure in concepts and the basic level of categorization," in Knowledge, Concepts and Categories: Studies in Cognition, K. Lamberts,Ed. et al. Cambridge, MA, USA: MIT, 1997, pp. 93-131.
3. F. Gosselin and P. G. Schyns, "Why do de slip to the basic level? Computational constraints and their implementation," Psychol. Rev., vol. 108, no. 4, pp. 735-758, 2001. (Pubitemid 33604144)
4. R. Kiani, H. Esteky, K. Mirpour, and K. Tanaka, "Object category structure in response patterns of neuronal population in monkey inferior temporal cortex," J. Neurophys., vol. 97, no. 64, pp. 4296-4309, 2007. (Pubitemid 47080657)
5. N. Kriegeskorte, M. Mur, D. Ruff, R. Kiani, J. Bodurka, H. Esteky, K. Tanaka, and P. Bandettini, "Matching categorical object representations in inferior temporal cortex of man and monkey," Neuron, vol. 60, no. 6, pp. 1126-1141, 2008.
6. M. Marsza and C. Schmid, "Constructing category hierarchies for visual recognition," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 479-491.
7. M. Marsza and C. Schmid, "Semantic hierarchies for visual object recognition," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., 2007, pp. 1-7.
8. L. Li, C.Wang, Y. Lim, D. Blei, and L. Fei-Fei, "Building and using a semantivisual image hierarchy," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., 2010, pp. 3336-3343.
9. A. Farhadi, I. Endres, D. Hoiem, and D. Forsyth, "Describing objects by their attributes," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., 2009, pp. 1778-1785.
10. C. H. Lampert, H. Nickisch, and S. Harmeling, "Learning to detect unseen object classes by between-class attribute transfer," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., 2009, pp. 951-958.
11. D. Blei, T. Griffiths, and M. Jordan, "The nested Chinese restaurant process and Bayesian nonparametric inference of topic hierarchies," J. ACM, vol. 57, no. 2, 2010.
12. D. Blei, A. Ng, and M. Jordan, "Latent Dirichlet allocation," J. Mach. Learning Res., vol. 3, no. 3, pp. 993-1022, 2003.
13. L. Hannah, D. Blei, andW. Powell, "Dirichlet processmixtures of generalized linear models," J. Mach. Learning Res., vol. 11, no. 12, pp. 1923-1953, 2011.
14. D. Bruckner, C. Picus, R. Velik, W. Herzner, and G. Zucker, "Hierarchical semantic processing architecture for smart sensors in surveillance networks," IEEE Trans. Ind. Inf., vol. 8, no. 2, pp. 291-301,May 2012.
15. S. Livatino, F. Banno, and G. Muscato, "3-D integration of robot vision and laser data with semiautomatic calibration in augmented reality stereoscopic visual interface," IEEE Trans. Ind. Inf., vol. 8, no. 1, pp. 69-77, Feb. 2012.
16. K. Lai, L. Bo, X. Ren, and D. Fox, "A large-scale hierarchical multiview RGB-D object dataset," in Proc. IEEE Int. Conf. Robot. Autom., 2011, pp. 1817-1824.
17. S. Chen, J. Zhang, Y. Li, and J. Zhang, "A hierarchical model incorporating segmented regions and pixel descriptors for video background subtraction," IEEE Trans. Ind. Inf., vol. 8, no. 1, pp. 118-127, Feb. 2012.
18. A. Zweig and D. Weinshall, "Exploiting object hierarchy: Combining models from different category levels," in Proc. Int. Conf. Comput. Vis., 2007, pp. 1-8.
19. M. Palatucci, D. Pomerleau, G. Hinton, and T. M. Mitchell, "Zeroshot learning with semantic output codes," in Proc. Adv. Neural Inf. Process. Syst., 2009, pp. 1410-1418.
20. M. Rohrbach,M. Stark,G. Szarvas, I. Gurevych, and B. Schiele, "What helps where and why: Semantic relatedness for knowledge transfer," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., 2010, pp. 910-917.
21. J. Sivic, B. C. Russell, A. Zisserman, W. T. Freeman, and A. A. Efros, "Unsupervised discovery of visual object class hierarchies," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
22. Y. J. Lee and K. Grauman, "Object-graphs for context-aware visual category discovery," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 2, pp. 346-358, Feb. 2012.
23. A. J. Smola, L. Song, and C. Teo, "Relative novelty detection," in Proc. 12th Int. Conf. AI Stat., 2009, pp. 536-543.
24. H. Hoffmann, "Kernel PCA for novelty detection," Pattern Recognit., vol. 40, no. 3, pp. 863-874, 2007. (Pubitemid 44667761)
25. M. Kortgen, G. Park, M. Novotni, and R. Klein, "3D shape matching with 3D shape contexts," in Proc. Central Eur. Seminar Comput. Graphics, 2003, vol. 3, p. 5.
26. R. B. Rusu, Z. C. Marton, N. Blodow,M. Dolha, and M. Beetz, "Towards 3D point cloud based object maps for household environments," Robot. Auton. Syst. J., vol. 56, no. 11, pp. 927-941, 2008.
27. A. N. Bradshaw, J. D. Kennedy, and J. Correia, "The principal axes transformation-a method for image registration," J. Nucl. Med., vol. 31, no. 10, p. 1717, 1990.
28. C. Chang and C. Lin, "LIBSVM: A library for support vector machines," ACM Trans. Intell. Syst. Technol., vol. 2, no. 3, pp. 27:1-27:27, 2011.
29. T. Tuytelaars, C. H. Lampert, M. B. Blaschko, and W. Buntine, "Unsupervised object discovery: A comparison," Int. J. Comput. Vis., vol. 88, no. 2, pp. 284-302, 2010.
30. G. Tzortzis and A. Likas, "The global kernel K-means algorithm for clustering in feature space," IEEE Trans. Neural Netw., vol. 20, no. 7, pp. 1181-1194, Jul. 2009.
31. A. L. Christensen, R. O'Grady, M. Birattari, and M. Dorigo, "Fault detection in autonomous robots based on fault injection and learning," Auton. Robot., vol. 24, no. 1, pp. 49-67, 2008. (Pubitemid 50003970)
32. S. Zhou, J.Xi, M. W. McDaniel, T.Nishihata, P. Salesses, and K. Iagnemma, "Self-supervised learning to visually detect terrain surfaces for autonomous robots operating in forested terrain," J. Field Robot., vol. 29, no. 2, pp. 277-297, 2012.