Places clustering of full-length film key-frames using latent aspect modeling over SIFT matches

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 19, Issue 6, 2009, Pages 832-841

  Héritier, Maguelonne ^a   Gagnon, Langis ^a   Foucher, Samuel ^a  

^a Cent de Recherche Informatique de Montreal   (Canada)

Author keywords

Duplicate detection; Scene categorization; Scene matching; Video description; Video indexing

Indexed keywords

DUPLICATE DETECTION; SCENE CATEGORIZATION; SCENE MATCHING; VIDEO DESCRIPTION; VIDEO INDEXING;

ALARM SYSTEMS; FEATURE EXTRACTION; IMAGE MATCHING; INDEXING (OF INFORMATION); NAVIGATION;

MOTION PICTURES;

EID: 67649604831     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2009.2017304     Document Type: Article

References (42)

1. A. Aner and J. R. Kender, "Video summaries through mosaic-based shot and scene clustering," in Proc. 7th Eur. Conf. Comput. Vision, London, U.K.: Springer-Verlag, 2002, pp. 388-402.
2. S. Arya, D. M. Mount, N. S. Netanyahu, R. Silverman, and A. Y. Wu, "An optimal algorithm for approximate nearest neighbor searching fixed dimensions," J. ACM, vol. 45, no. 6, pp. 891-923, 1998.
3. M. Brown and D. Lowe, "Automatic panoramic image stitching using invariant features," Int. J. Comput. Vision, vol. 74, no. 1, pp. 59-73, 2007.
4. D. Blei and J. Lafferty, "A correlated topic model of science," Ann. Appl. Statist., submitted for publication.
5. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent dirichlet allocation," J. Mach. Learning Res., vol. 3, pp. 993-1022, Mar. 2003.
6. A. Bosch, A. Zisserman, and X. Munoz, "Scene classification via pLSA," in Proc. Eur. Conf. Comput. Vision, 2006.
7. M. Brown and D. G. Lowe, "Automatic panoramic image stitching using invariant features," Int. J. Comput. Vision, submitted for publication.
8. M. Brown and D. G. Lowe, "Unsupervised 3-D object recognition and reconstruction in unordered datasets," in Proc. 5th Int. Conf. 3-D Imaging Modeling, Ottawa, ON, Canada, 2005, pp. 56-63.
9. M. Brown, R. Szeliski, and S. Winder, "Multi-image matching using multi-scale oriented patches," in Proc. Int. Conf. Comput. Vision Pattern Recognition, San Diego, CA, Jun. 2005, pp. 510-517.
10. G. Csurka, C. R. Dance, L. Fan, J. Willamowski, and C. Bray, "Visual categorization with, bags of keypoints," in Proc. Eur. Conf. Comput. Vision, Prague, Czech Republic, 2004, pp. 1-22.
11. L. Fei-Fei, R. Fergus, and P. Perona, "Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories," in Proc. Workshop Generative-Model Based Vision, Washington, D.C., 2004, pp. 178-187.
12. L. Fei-Fei and P. Perona, "A Bayesian hierarchical model for learning natural scene categories," in Proc. Int. Conf. Comput. Vision Pattern Recognition, San Diego, CA, 2005, pp. 524-531.
13. A. M. Ferman, A. Krishnamachari, A. M. Tekalp, M. Abdel-Mottaleb, and R. Mehrotra, "Group-of-frame/picture color histogram descriptors for multimedia applications," in Proc. ICIP, Vancouver, BC, Canada, 2000, pp. 65-68.
14. M. A. Fischler and R. C. Bolles, "Random sample consensus: A paradigm, for model fitting with applications to image analysis and automated cartography," Comm. ACM, vol. 24, pp. 381-395, Jun. 1981.
15. S. Foucher, M. Héritier, M. Lalonde, and D. Byrns, "Literature review, design, prototyping and preliminary tests of processing algorithms for the extraction of visual content adapted to descriptive video and video mining," Comput. Res. Inst. Montréal, QC, Canada, Tech. Rep CRIM-06-05/11, May 2006.
16. L. Gagnon, S. Foucher, F. Laliberté, M. Lalonde, and M. Beaulieu, "Toward an application of content-based video indexing to computer-assisted descriptive video," in Proc. Canadian Conf. Comput. Robot Vision, Quebec City, QC, Canada, Jun. 2006, pp. 731-734.
17. T. Hofmann, "Probabilistic Latent Semantic Indexing," in Proc. SIGIR, Berkeley, CA, 1999, pp. 50-57.
18. M. Jia, X. Fan, X. Xie, M. Li, and W-Y. Ma, "Photo-to-Search: Using camera phones to inquire of the surrounding world," in Proc. 7th Int. Conf. Mobile Data Manage., Nara, Japan, 2006, pp. 46.
19. Y. Ke and R. Suthankar, "Efficient near-duplicate detection and sub-image retrieval," in Proc. ACM Multimedia Conf., New York, 2004, pp. 869-876.
20. Y. Ke, R. Suthankar, and L. Hutson, "PCA-SIFT: A more distinctive representation for local image descriptors," in Proc. CVPR, Washington, D.C., 2004, pp. 11-506-11-513.
21. R. Lienhart, S. Pfeiffer, and W. Effelsberg, "Scene determination based on video and audio features," in Proc. IEEE Conf. Multimedia Comput. Syst., Florence, Italy, Jun. 1999, pp. 685-690.
22. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vision, vol. 60, no. 2, pp. 91-110, 2004.
23. J. Matas, O. Chum, M. Urban, and T. Pajdla, "Robust wide baseline stereo from maximally stable extremal regions," in Proc. BMVC, Cardiff, U.K., Sep. 2002, pp. 384-393.
24. K. Mikolajczyk, and C. Schmid, "A performance evaluation of local descriptor," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 10, pp. 1615-1630, Oct. 2005.
25. S. Porter, M. Mirmehdi, and B. Thomas, "Video indexing using motion estimation," in Proc. 14th Brit. Mach. Vision Conf., Norwich, U.K., Sep. 2003, pp. 659-668.
26. P. Quelhas, F. Monay, J.-M. Odobez, D. Gatica-Perez, T. Tuytelaars, and L. Van Gool, "Modeling scenes with local descriptors and latent aspects," in Proc. ICCV, Beijing, China, 2005, pp. 883-890.
27. P. J. Rousseau. "Least median of squares regression," J. Amer. Statist. Assoc., vol. 79, no. 388, pp. 871-880, 1984.
28. S. Satoh, M. Takimoto, and J. Adachi, "Video retrieval and annotation: Scene duplicate detection from, videos based on trajectories of feature points," in Proc. Int. Workshop Multimedia Retrieval MIR, Augsburg, Germany, 2007, pp. 237-244.
29. F. Schaffalitzky, and A. Zisserman, "Automated location matching in movies," Comp. Vision Image Understand., vol. 42, no. 2-3, pp. 236-264, Nov.-Dec. 2003.
30. F. Schaffalitzky, and A. Zisserman, "Multi-view matching for unordered image sets, or How do I organize my holiday snaps?" in Proc. 7th Eur. Conf. Comput. Vision, Copenhagen, Denmark, 2002, pp. 414-431.
31. J. Sivic, B. C. Russell, A. A. Efros, A. Zisserman, and W. T. Freeman, "Discovering objects categories in image collection," in Proc. IEEE Inter. Conf. Comput. Vision, Beijing, China, Oct. 2005.
32. J. Sivic, F. Schaffalitzky, and A. Zisserman, "Object level grouping for video shots," Int. J. Comput. Vision vol. 67, no. 2, pp. 189-210, Apr. 2006.
33. J. Sivic and A. Zisserman, "Video data mining using configurations of viewpoint invariant regions," in Proc. CVPR, Washington, D.C., 2004, pp. I-488-I-495.
34. J. Sivic, and A. Zisserman, "Video google: A text retrieval approach to object matching in videos," in Proc. ICCV, Nice, France, 2003, pp. 1470-1477.
35. N. Snavely, S. M. Seitz, and R. Szeliski, "Photo tourism: Exploring photo collections in 3-D," in Proc. ACM Trans. Graph., vol. 25, no. 3, pp. 835-846, Jul.-Aug. 2006.
36. W. Tavanapong and J. Zhou, "Shot clustering techniques for story browsing," IEEE Trans. Multimedia, vol. 6, no. 4, pp. 517-527, Aug. 2004.
37. Y. W. Teh, M. I. Jordan, M. J. Beal, and D. M. Blei, "Hierarchical Dirichlet processes," J. Amer. Stat. Assoc., vol. .101, no. 476, pp. 1566-1581, 2006.
38. R. Unnikrishnan, and M. Hebert. "Extracting scale and illuminant invariant regions through color," in Proc. 17th Brit. Mach. Vision Conf., Edinburgh, Scotland, Sep. 2006.
39. J. Van de Weijer and C. Schmid, "Coloring local feature extraction," in Proc. ECCV2006, Part II, Graz, Austria, pp. 334-348.
40. J. Vendrig, "Systematic evaluation of logical story unit segmentation," IEEE Trans. Multimedia, vol. 4, no. 4, pp. 492-499, Dec. 2002.
41. G. Wang, Y. Zhang, and L. Fei-Fei, "Using dependent regions for object categorization in a generative framework," in Proc. CVPR, vol. 2. New York, NY, Jun. 2006, pp. 1597-1604.
42. J. Yao and W. K. Cham. "Robust multi-view feature matching from multiple unordered views," Pattern Recognit., vol. 40, no. 1.1, pp. 3081-3099, 2007.