Context-aware person identification in personal photo collections

IEEE Transactions on Multimedia

Volumn 11, Issue 2, 2009, Pages 220-228

  O'Hare, Neil ^a   Smeaton, Alan F ^a  

^a DUBLIN CITY UNIVERSITY   (Ireland)

Author keywords

Context and content; Person identification; Personal photo management

Indexed keywords

COMPUTATIONAL LINGUISTICS;

CONTENT-BASED ANALYSIS; CONTENT-BASED FEATURES; CONTEXT AND CONTENT; CONTEXT-AWARE; CONTEXT-BASED; EMPIRICAL STUDIES; IMAGE COLORS; IMAGE CONTENTS; LANGUAGE MODELLING; NEAREST-NEIGHBOR APPROACHES; PERSON IDENTIFICATION; PERSONAL PHOTO COLLECTIONS; PERSONAL PHOTO MANAGEMENT; PHOTO COLLECTIONS; SEMI-AUTOMATIC ANNOTATIONS;

FACE RECOGNITION;

EID: 59049107689     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2008.2009679     Document Type: Article

References (37)

1. K. Toyama, R. Logan, and A. Roseway, "Geographic location tags on digital images," in MULTIMEDIA'03: Proc. Eleventh ACM Int. Conf. on Multimedia, New York, Nov. 2003, pp. 156-166.
2. K. Rodden and K. R. Wood, "How do people manage their digital photographs?," in CHI'05: Proc. SIGCHI Conf. on Human Factors in Computing Systems, Fort Lauderdale, FL, 2003, pp. 409-416.
3. M.-H. Yang, D. J. Kriegman, and N. Ahuja, "Detecting faces in images: A survey," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 1, pp. 34-58, 2002.
4. W. Zhao, R. Chellappa, P. J. Phillips, and A. Rosenfeld, "Face recognition: A literature survey," ACM Comput. Surv., vol. 35, no. 4, pp. 399-458, 2003.
5. A. Girgensohn, J. Adcock, and L. Wilcox, "Leveraging face recognition technology to find and organize photos," in MIR-04: Proc. 6th ACM SIGMM International Workshop on Multimedia Information Retrieval, New York, Oct. 2004, pp. 99-106.
6. A. Kuchinsky, C. Pering, M. L. Creech, D. Freeze, B. Serra, and J. Gwizdka, "FotoFile: A consumer multimedia organization and retrieval system," in CHI'99: Proc. SIGCHI Conf. on Human Factors in Computing Systems, Pittsburgh, PA, May 2001, pp. 496-503.
7. L. Zhang, L. Chen, M. Li, and H. Zhang, "Automated annotation of human faces in family albums," in MULTIMEDIA-03: Proc. Eleventh ACM Int. Conf. on Multimedia, Berkeley, CA, 2003, pp. 355-358.
8. S. Cooray, N. O'Connor, C. Gurrin, G. Jones, N. O'Hare, and A. F. Smeaton, "Identifying person re-occurrences for personal photo management applications," in Int. Conf. on Visual Information Engineering, Bangalore, India, Sep. 2006, pp. 144-149.
9. J. Sivic, C. Zitnick, and R. Szeliski, "Finding people in repeated shots of the same scene," in Proc. British Machine Vision Conf., Edinburgh, U.K., 2006, pp. 909-918.
10. D. Anguelov, K. Lee, S. B. Gokturk, and B. Sumengen, "Contextual identity recognition in personal photo albums," in Proc. Int. Conf. on Computer Vision and Pattern Recognition, Minneapolis, MN, Jun. 2007.
11. M. Naaman, R. B. Yeh, H. Garcia-Molina, and A. Paepcke, "Leveraging context to resolve identity in photo albums," in JCDL'05: Proc. 5th ACM/IEEE-CS Joint Conf. on Digital Libraries, Denver, CO, Jun. 2005, pp. 178-187.
12. M. Zhao, Y. Teo, M. Zhao, M. Zhao, Y. Teo, S. Liu, T.-S. Chua, and R. Jain, "Automatic person annotation of family photo album," in 5th Int. Conf. on Image and Video Retrieval (CTVR 2006), Tempe, AZ, 2006, pp. 163-172.
13. A. C. Gallagher and T. Chen, "Using group prior to identify people in consumer images," in Proc. Int. Conf. on Computer Vision and Pattern Recognition, Minneapolis, MN, Jun. 2007.
14. M. Davis, M. Smith, F. Stentiford, A. Bambidele, J. Canny, N. Good, S. King, and R. Janakiraman, "Using context and similarity for face and location identification," in Proc. IS&T/SPIE 18th Annu. Symp. Electronic Imaging Science and Technology, San Jose, CA, 2006.
15. A. Graham, H. Garcia-Molina, A. Paepcke, and T. Winograd. "Time as essence for photo browsing through personal digital libraries," in JCDL'02: Proc. 2nd ACM/IEEE-CS Joint Conf. on Digital Libraries, Portland, OR, Jul. 2002, pp. 326-335.
16. M. Naaman, S. Harada, Q. Wang, H. Garcia-Molina, and A. Paepcke, "Context data in geo-referenced digital photo collections," in MULTIMEDIA'04: Proc. 12th Annu. ACM Int. Conf. on Multimedia, New York, Oct. 2004, pp. 196-203.
17. M. R. Boutell and J. Luo, "Beyond pixels: Exploiting camera metadata for photo classification," Pattern Recognit., vol. 38, no. 6, pp. 935-946, 2005.
18. N. O'Hare, H. Lee, S. Cooray, C. Gurrin, G. Jones, J. Malobabic, N. O'Connor, A. F. Smeaton, and B. Uscilowski, "MediAssist: Using content-based analysis and context to manage personal photo collections," in CTVR2006-5th Int. Conf. on Image and Video Retrieval, Tempe, AZ, 2006, pp. 529-532.
19. J. Malobabic, H. LeBorgne, N. Murphy, and N. E. O'Connor, "Detecting the presence of large buildings in natural images," in Proc. CBMI2005-4th International Workshop on Content-Based Multimedia Indexing, Riga, Latvia, Jun. 2005.
20. S. Cooray and N. O'Connor, "A hybrid technique for face detection in color images," in AVSS-Int. Conf. on Advanced Video and Signal Based Surveillance, Como, Italy, 2005, pp. 253-258.
21. B. Suh and B. B. Bederson, "Semi-automatic photo annotation strategies using event based clustering and clothing based person recognition," Interacting with Computers, vol. 19, no. 4, pp. 524-544, 2007.
22. Y. Tian, W. Liu, R. Xiao, F. Wen, and X. Tang, "A face annotation framework with partial clustering and interactive labeling," in IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR), Minneapolis, MN, 2007, IEEE Computer Society.
23. J. M. Ponte and W. B. Croft, "A language modeling approach to information retrieval," in Proc. 21st Annu. Int. ACM SIGIR Conf. on Research and Development in Information Retrieval (SIGIR-98), Melbourne, Australia, 1998, pp. 275-281.
24. C. D. Manning and H. Schutze, Foundations of Statistical Natural Language Processing. Cambridge, MA: The MIT Press, 1999.
25. T. Westerveld, A. de Vries, and A. van Ballegooij, "CWI at the TREC-2002 video track," in The Eleventh Text REtrieval Conf. (TREC-2002), Gaithersburg, MD, 2003, pp. 207-216.
26. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, 2nd ed. New York: Wiley-Interscience, 2000.
27. B. S. Manjunath, J. R. Ohm, V. V. Vasudevan, and A. Yamada, "Color and texture tescriptors," IEEE Transactions on Circuits and Systems for Video Technology, vol. 11, no. 6, pp. 703-715, 2001.
28. M. S. Bartlett, J. R. Movellan, and T. J. Sejnowski, "Face recognition by independent component analysis," IEEE Trans. Neural Netw., vol. 13, no. 6, pp. 1450-1464, Nov. 2002.
29. J. H. Lee, "Analyses of multiple evidence combination," in Proc. 20th Annu. Int. ACM SIGIR Conf. on Research and Development in Information Retrieval (SIGIR-97), Philadelphia, PA, 1997, pp. 267-276.
30. W. B. Croft, Combining Approaches to Information Retrieval. Berlin, Germany: Springer, 2002, pp. 1-36.
31. K. Mc Donald and A. F. Smeaton, "A comparison of score, rank and probability-based fusion methods for video shot retrieval," in CIVR 2005-Int. Conf. on Image and Video Retrieval, Singapore, 2005, pp. 61-70.
32. E. A. Fox and J. A. Shaw, "Combination of multiple searches," in Proc. Third Text REtreival Conf. (TREC-1994), Gaithersburg, MD, 1994, pp. 243-252.
33. N. O'Hare, "Semi-Automatic Person-Annotation in Context-Aware Personal Photo Collections," Ph.D. Dissertation, Sch. Computing, Dublin City University, Dublin, Ireland, 2007.
34. L. Chen, B.-G. Hu, L. Zhang, M. Li, and H. Zhang, "Face annotation for family photo album management," International Journal of Image and Graphics vol. 3, no. 1. pp. 81-94, 2003 [Online], Available: http://ejournals.wspc.com.sg/ijig/03/0301/S0219467803000920.html, [Online], Available
35. P. A. Devijver and J. Kittler, Pattern Recognition: A Statistical Approach. London, U.K.: Prentice-Hall, 1982.
36. O. Kempthorne and T. E. Doerfler, "The behaviour of some significance tests under experimental randomization," Biometrika, vol. 56, no. 2, pp. 231-248, 1969.
37. N. Dalai and B. Triggs, S. S. Cordelia Schmid and C. Tomasi, Eds., "Histograms of oriented gradients for human detection," in CVPR-05: Proc. 2005 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, 2005, vol. 2, pp. 886-893.