Multimedia semantics: Interactions between content and community

Proceedings of the IEEE

Volumn 100, Issue 9, 2012, Pages 2737-2758

  Sundaram, Hari ^a   Xie, Lexing ^b,c   De Choudhury, Munmun ^d   Lin, Yu Ru ^e   Natsev, Apostol ^a,f  

^a ARIZONA STATE UNIVERSITY   (United States)

^b IBM RESEARCH   (United States)

^c AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

^d MICROSOFT RESEARCH   (United States)

^e NORTHEASTERN UNIVERSITY   (United States)

^f GOOGLE INC   (United States)

Author keywords

Emergence; large scale; semantics

Indexed keywords

ECONOMIC AND SOCIAL EFFECTS; SEMANTICS; SOCIAL ASPECTS; UBIQUITOUS COMPUTING;

COMMUNICATION TECHNOLOGIES; EMERGENCE; INTER-RELATIONSHIPS; LARGE SCALE; MULTIMEDIA APPLICATIONS; MULTIMEDIA RESEARCH; MULTIMEDIA SEMANTICS; SCALABLE DATA ANALYSIS;

SOCIAL NETWORKING (ONLINE);

EID: 84865426243     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2012.2191529     Document Type: Article

References (110)

1. D. Gruhl, R. Guha, D. Liben-Nowell, and A. Tomkins, "Information diffusion through blogspace," in Proc. 13th WWW, 2004, pp. 491-501. (Pubitemid 40752783)
2. D. Liben-Nowell and J. Kleiberg, "Tracing information flow on a global scale using internet chain-letter data," Proc. Nat. Acad. Sci., vol. 105, no. 12, pp. 4633-4638, 2008. (Pubitemid 351753798)
3. A. Anagnostopoulos, R. Kumar, and M. Mahdian, "Influence and correlation in social networks," in Proc. 14th ACM KIGKDD KDD, 2008, pp. 7-15.
4. E. Sun, I. Rosenn, C. Marlow, and T. Lento, "Gesundheit! modeling contagion through facebook news feed," in Proc. 3rd Int. Conf. Weblogs Social Media, San Jose, CA, May 2009.
5. E. Bakshy, B. Karrer, and L. A. Adamic, "Social influence and the diffusion of user-created content," in Proc. 10th ACM EC, 2009, pp. 325-334.
6. Cisco, San Jose, CA, Cisco Visual Networking Index: Forecast and Methodology, 2010-2015, Jun. 2011. [Online]. Available: http://www.cisco.com/en/ US/solutions/collateral/ns341/ns525/ns537/ns705/ns827/white-paper-c11-481360- ns827-Networking-Solutions-White-Paper.html.
7. M. S. Lew, N. Sebe, C. Djeraba, and R. Jain, "Content-based multimedia information retrieval," Trans. Multimedia Comput., Commun., Appl., vol. 2, no. 1, pp. 1-19, Feb. 2006.
8. A. Hauptmann, R. Yan, and W.-H. Lin, "How many high-level concepts will fill the semantic gap in news video retrieval?" in Proc. 6th ACM Int. Conf. Image Video Retrieval, 2007, pp. 627-634. (Pubitemid 350229681)
9. P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proc. IEEE CVPR, 2001, vol. 1, pp. 511-518.
10. R. Fergus, P. Perona, and A. Zisserman, 'Object class recognition by unsupervised scale-invariant learning," in Proc. IEEE CVPR, 2003, pp. 264-271.
11. J. Xiao, J. Hays, K. Ehinger, A. Oliva, and A. Torralba, "SUN database: Large-scale scene recognition from abbey to zoo," in Proc. IEEE CVPR, 2010, pp. 3485-3492.
12. Y. Zheng, M. Zhao, Y. Song, H. Adam, U. Buddemeier, A. Bissacco, F. Brucher, T. Chua, and H. Neven, "Tour the world: Building a web-scale landmark recognition engine," in Proc. IEEE CVPR, 2009, pp. 1085-1092.
13. M. Marszaek and C. Schmid, "Semantic hierarchies for visual object recognition," in Proc. IEEE CVPR, Minneapolis, MN, 2007, pp. 1-7.
14. Y. Wu, B. Tseng, and J. Smith, 'Ontology-based multi-classification learning for video concept detection," in Proc. IEEE ICME, 2005, vol. 2, pp. 1003-1006.
15. M. Naphade, J. Smith, J. Tesic, S. Chang, W. Hsu, L. Kennedy, A. Hauptmann, and J. Curtis, "Large-scale concept ontology for multimedia," IEEE Multimedia, vol. 13, no. 3, pp. 86-91, Jul.-Sep. 2006. (Pubitemid 44263760)
16. D. Shamma, R. Shaw, P. Shafton, and Y. Liu, "Watch what i watch: Using community activity to understand content," in Proc. ACM Int. Workshop Multimedia Inf. Retrieval, 2007, pp. 275-284.
17. N. Garg and I. Weber, "Personalized, interactive tag recommendation for Flickr," in Proc. ACM RecSys, 2008, pp. 67-74.
18. B. Sigurbjörnsson and R. van Zwol, "Flickr tag recommendation based on collective knowledge," in Proc. 17th WWW, 2008, pp. 327-336.
19. R. Negoescu and D. Gatica-Perez, "Analyzing Flickr groups," in Proc. CIVR, 2008, pp. 417-426.
20. A. Zunjarward, H. Sundaram, and L. Xie, "Contextual wisdom: Social relations and correlations for multimedia event annotation," in Proc. 15th MULTIMEDIA, 2007, pp. 615-624.
21. L. Kennedy, M. Naaman, S. Ahern, R. Nair, and T. Rattenbury, "How Flickr helps us make sense of the world: Context and content in community-contributed media collections," in Proc. 15th MULTIMEDIA, 2007, pp. 631-640.
22. N. Ramzan, M. Larson, F. Dufaux, and K. Clüver, "The participation payoff: Challenges and opportunities for multimedia access in networked communities," in Proc. ACM Int. Conf. Multimedia Inf. Retrieval, 2010, pp. 487-496.
23. M. De Choudhury, H. Sundaram, Y. Lin, A. John, and D. Seligmann, "Connecting content to community in social media via image content, user tags and user communication," in Proc. IEEE ICME, 2009, pp. 1238-1241.
24. S. Gupta, D. Phung, B. Adams, T. Tran, and S. Venkatesh, "Nonnegative shared subspace learning and its application to social media retrieval," in Proc. 16th ACM SIGKDD KDD, 2010, pp. 1169-1178.
25. E. Adar, D. S. Weld, B. N. Bershad, and S. S. Gribble, "Why we search: Visualizing and predicting user behavior," in Proc. 16th WWW, New York, 2007, pp. 161-170. (Pubitemid 47582248)
26. M. De Choudhury, H. Sundaram, A. John, and D. D. Seligmann, "Can blog communication dynamics be correlated with stock market activity?" in Proc. 19th ACM HT, 2008, pp. 55-60.
27. D. Gruhl, R. Guha, R. Kumar, J. Novak, and A. Tomkins, "The predictive power of online chatter," in Proc. 11th ACM SIGKIDD, 2005, pp. 78-87. (Pubitemid 43218270)
28. Y. Liu, X. Huang, A. An, and X. Yu, "ARSA: A sentiment-aware model for predicting sales performance using blogs," in Proc. 30th Annu. ACM SIGIR, 2007, pp. 607-614. (Pubitemid 350165010)
29. W. Antweiler and M. Z. Frank, "Is all that talk just noise? The information content of Internet stock message boards," J. Finance, vol. 59, no. 3, pp. 1259-1294, Jun. 2004. (Pubitemid 38799762)
30. Y.-R. Lin, Y. Chi, S. Zhu, H. Sundaram, and B. L. Tseng, "Analyzing communities andtheir evolutions in dynamics networks,"Trans. Knowl. Discovery Data, vol. 3, no. 2,Apr. 2009, Article no. 8.
31. Y.-R. Lin, H. Sundaram, M. De Choudhury, and A. Kelliher, "Discovery multirelational structure in social media streams," Trans. Multimedia Comput., Commun., Appl., vol. 8, no. 1, 2011, Article no. 4.
32. Z. Xiao, Z. Hou, C. Miao, and J. Wang, "Using phase information for symmetry detection," Pattern Recogn. Lett., vol. 26, no. 13, pp. 1985-1994, 2005. (Pubitemid 41252204)
33. Z. Liu and R. Laganìere, "Phase congruence measurement for image similarity assessment," Pattern Recogn. Lett., vol. 28, no. 1, pp. 166-172, 2007. (Pubitemid 44646676)
34. G. Loy and A. Zelinsky, "Fast radial symmetry for detecting points of interest," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 8, pp. 959-973, Aug. 2003.
35. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vision, vol. 60, no. 2, pp. 91-110, 2004.
36. M. De Choudhury, H. Sundaram, A. John, and D. D. Seligmann, "What makes conversations interesting?: Themes, participants and consequences of conversations in online social media," in Proc. 18th WWW, 2009, pp. 331-340.
37. Q. Mei, C. Liu, H. Su, and C. Zhai, "A probabilistic approach to spatiotemporal theme pattern mining on Weblogs," in Proc. 15th WWW, 2006, pp. 533-542. (Pubitemid 46946647)
38. M. Dubinko, R. Kumar, J. Magnani, J. Novak, P. Raghavan, and A. Tomkins, "Visualizing tags over time," in Proc. 15th WWW, 2006, pp. 193-202. (Pubitemid 46946610)
39. J. Burgess and J. Green, YouTube: Online Video and Participatory Culture. Cambridge, U.K.: Polity, 2009.
40. M. Cha, H. Haddadi, F. Benevenuto, and K. Gummadi, "Measuring user influence in Twitter: The million follower fallacy," in Proc. 4th Int. AAAI ICWSM, 2010.
41. H. Kwak, C. Lee, H. Park, and S. Moon, "What is Twitter, a social network or a news media?" in Proc. WWW, 2010, pp. 591-600.
42. D. Boyd, S. Golder, and G. Lotan, "Tweet, tweet, retweet: Conversational aspects of retweeting on Twitter," in Proc. 43rd IEEE HICSS, 2010, pp. 1-10.
43. D. A. Shamma, L. Kennedy, and E. F. Churchill, "Tweetgeist: Can the Twittertimeline reveal the structure of broadcastevents?" in Proc. CSCWHorizons, 2010.
44. N. Diakopoulos, M. Naaman, and F. Kivran-Swaine, "Diamonds in the rough: Social media visual analytics for journalistic inquiry," in Proc. IEEE VAST, 2010, pp. 115-122.
45. A. Marcus, M. S. Bernstein, O. Badar, D. R. Karger, S. Madden, and R. C. Miller, "Twitinfo: Aggregating and visualizing microblogs for event exploration," in Proc. Annu. Conf. Human Factors Comput. Syst., 2011, pp. 227-236.
46. P. Snickars and P. Vonderau, The YouTube Reader. Stockholm, Sweden: Nat. Library of Sweden, 2010.
47. L. Xie, A. Natsev, M. Hill, J. R. Kender, and J. R. Smith, "Visual memes in social media: Tracking real-world news in YouTube videos," in Proc. ACM MULTIMEDIA, Nov. 2011, pp. 53-62.
48. J. Huang, S. Kumar, M. Mitra, W. Zhu, and R. Zabih, "Spatial color indexing and applications," Int. J. Comput. Visio, vol. 35, no. 3, Dec. 1999.
49. M. Muja and D. G. Lowe, "Fast approximate nearest neighbors with automatic algorithm configuration," in Proc. Int. Conf. Comput. Vision Theory Appl., 2009.
50. B. A. Galler and M. J. Fisher, "An improved equivalence algorithm," Commun. ACM, vol. 7, no. 5, pp. 301-303, 1964.
51. S. Wasserman and K. Faust, Social Network Analysis: Methods and Applications. Cambridge, U.K.: Cambridge Univ. Press, 1994.
52. M. Newman, "The structure and function of complex networks," SIAM Rev., vol. 45, no. 2, pp. 167-256, 2003.
53. M. Girvan and M. Newman, "Community structure in social and biological networks," Proc. Nat Acad. Sci., vol. 99, no. 12, p. 7821, 2002.
54. M. Newman and M. Girvan, "Finding and evaluating community structure in networks," Phys. Rev. E, vol. 69, no. 2, p. 26113, 2004.
55. L. Adamic and E. Adar, "Friends and neighbors on the Web," Social Netw., vol. 25, no. 3, pp. 211-230, 2003. (Pubitemid 36831776)
56. S. Fortunato, "Community detection in graphs," Phys. Rep., vol. 486, no. 3-5, pp. 75-174, 2010.
57. G. Flake, S. Lawrence, and C. Giles, "Efficient identification of Web communities," in Proc. 6th ACM SIGKDD KDD, 2000, pp. 150-160.
58. M. Newman, "Finding community structure in networks using the eigenvectors of matrices," Phys. Rev. E, vol. 74, no. 3, p. 036104, 2006.
59. M. Rosvall and C. Bergstrom, "An information-theoretic framework for resolving community structure in complex networks," Proc. Nat. Acad. Sci., vol. 104, no. 18, p. 7327, 2007.
60. J. Leskovec, K. Lang, A. Dasgupta, and M. Mahoney, "Statistical properties of community structure in large social and information networks," in Proc. 17th WWW, 2008, pp. 695-704.
61. H. Garfinkel, Studies in Ethnomethodology. Cambridge, U.K.: Polity, 1984.
62. Q. Jones, "Virtual-communities, virtual settlements & cyber-archaeology: A theoretical outline," J. Comput. Mediated Commun., vol. 3, no. 3, pp. 35-49, 1997.
63. Y.-R. Lin, H. Sundaram, Y. Chi, J. Tatemura, and B. Tseng, "Blog community discovery and evolution based on mutual awareness expansion, 2007.
64. L. S. Kennedy and M. Naaman, "Generating diverse and representative image search results for landmarks," in Proc. 17th WWW, 2008, pp. 297-306.
65. M. Smith, V. Barash, L. Getoor, and H. W. Lauw, "Leveraging social context for searching social media," in Proc. ACM SSM, 2008, pp. 91-94.
66. V. K. Singh, R. Jain, and M. S. Kankanhalli, "Motivating contributors in social media networks," in Proc. 1st ACM SIGMM WSM, 2009, pp. 11-18.
67. Q. Mei and C. Zhai, "Discovering evolutionary theme patterns from text: An exploration of temporal text mining," in Proc. 11th ACM SIGKDD KDD, 2005, pp. 198-207. (Pubitemid 43218281)
68. Y. Zhou, X. Guan, Z. Zhang, and B. Zhang, "Predicting the tendency of topic discussion on the online social networks using a dynamic probability model," in Proc. WebScience, Hypertext Workshop Collab. Collective Intell., 2008, pp. 7-11.
69. X. Ling, Q. Mei, C. Zhai, and B. Schatz, "Mining multi-faceted overviews of arbitrary topics in a text collection," in Proc. 14th ACM SIGKDD KDD, 2008, pp. 497-505.
70. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent dirichlet allocation," J. Mach. Learn. Res., vol. 3, pp. 993-1022, Mar. 2003.
71. D. M. Blei and J. D. Lafferty, "Dynamic topic models," in Proc. 23rd ACM ICML, 2006, pp. 113-120.
72. T. Iwata, T. Yamada, Y. Sakurai, and N. Ueda, 'Online multiscale dynamic topic models," in Proc. 16th ACM SIGKDD KDD, 2010, pp. 663-672.
73. V. Gómez, A. Kaltenbrunner, and V. López, "Statistical analysis of the social network and discussion threads in Slashdot," in Proc. 17th ACM WWW, 2008, pp. 645-654.
74. C. Honeycutt and S. C. Herring, "Beyond microblogging: Conversation and collaboration via Twitter," in Proc. 42nd HICSS, 2009, pp. 1-10.
75. M. Naaman, J. Boase, and C.-H. Lai, "Is it really about me?: Message content in social awareness streams," in Proc ACM CSCW, 2010, pp. 189-192.
76. M. Cha, H. Kwak, P. Rodriguez, Y.-Y. Ahn, and S. Moon, "I tube, you tube, everybody tubes: Analyzing the world's largest user generated content video system," in Proc. ACM IMC, 2007, pp. 1-14.
77. F. Benevenuto, F. Duarte, T. Rodrigues, V. A. Almeida, J. M. Almeida, and K. W. Ross, "Understanding video interactions in YouTube," in Proc. ACM MULTIMEDIA, 2008, pp. 761-764.
78. G. Szabo and B. A. Huberman, "Predicting the popularity of online content," Commun. ACM, vol. 53, pp. 80-88, Aug. 2010.
79. J. Leskovec, L. Backstrom, and J. Kleinberg, "Meme-tracking and the dynamics of the news cycle," inProc 15thACM SIGKDDKDD, 2009, pp. 497-506.
80. L. Kennedy and S.-F. Chang, "Internet image archaeology: Automatically tracing the manipulation history of photographs on the Web," in Proc. ACM MULTIMEDIA, 2008, pp. 349-358.
81. P. Schmitz, P. Shafton, R. Shaw, S. Tripodi, B. Williams, and J. Yang, "International remix: Video editing for the Web," in Proc. ACM MULTIMEDIA, 2006, p. 798.
82. P. Cesar, D. Bulterman, D. Geerts, J. Jansen, H. Knoche, and W. Seager, "Enhancing social sharing ofvideos: Fragment, annotate, enrich, and share," in Proc. ACM MULTIMEDIA, 2008, pp. 11-20.
83. M. Cherubini, R. de Oliveira, and N. Oliver, "Understanding near-duplicate videos: A user-centric approach," in Proc. ACM MULTIMEDIA, 2009, pp. 35-44.
84. H.-K. Tan, X. Wu, C.-W. Ngo, and W.-L. Zhao, "Accelerating near-duplicate video matching by combining visual similarity and alignment distortion," in Proc. ACM MULTIMEDIA, 2008, p. 861.
85. T. Liu, C. Rosenberg, and H. A. Rowley, "Clustering billions of images with large scale nearest neighbor search," in Proc. IEEE Workshop Appl. Comput. Vision, 2007, p. 28.
86. M. D. Choudhury, Y.-R. Lin, H. Sundaram, K. S. Candan, L. Xie, and A. Kelliher, "How does the data sampling strategy impact the discovery of information diffusion in social media?" in Proc. 4th Int. AAAI Conf. Weblogs Social Media, Washington, DC, May 23-26, 2010, pp. 34-41.
87. Y.-R. Lin, K. S. Candan, H. Sundaram, and L. Xie, "Scent: Scalable compressed monitoring of evolving multirelational social networks," Trans. Multimedia Comput, Commun., Appl., vol. 7S, pp. 29:1-29:22, Nov. 2011.
88. O. Frank, "Sampling and estimation in large social networks," Social Netw., vol. 1, no. 91, p. 101, 1978.
89. A. Klovdahl, Z. Dhofier, G. Oddy, J. óHara, S. Stoutjesdijk, and A. Whish, "Social networks in an urban area: First Canberra study," J. Sociol., vol. 13, no. 2, pp. 169-172, 1977.
90. P. Rusmevichientong, D. Pennock, S. Lawrence, and C. Giles, "Methods for sampling pages uniformly from the world wide Web," in Proc. AAAI Fall Symp. Using Uncertainty Within Comput., 2001, pp. 121-128.
91. J. Leskovec, J. Kleinberg, and C. Faloutsos, "Graphs over time: Densification laws, shrinking diameters and possible explanations," in Proc. 11th ACM SIGKDD KDD, 2005, p. 187.
92. J. Leskovec and C. Faloutsos, "Sampling from large graphs," in Proc. 12th ACM SIGKDD KDD, 2006, p. 636.
93. M. E. J. Newman, "Spread of epidemic disease on networks," Phys. Rev. E, vol. 66, no. 1, p. 016128+, Jul. 2002.
94. W. Zachary, "An information flow model for conflict and fission in small groups," J. Anthropol. Res., vol. 33, pp. 452-473, 1977.
95. D. Kempe, J. Kleinberg, and E. Tardos, "Maximizing the spread of influence through a social network," in Proc. 9th ACM SIGKDD KDD, 2003, pp. 137-146.
96. D. J. Watts and P. S. Dodds, "Influentials, networks, and public opinion formation," J. Consumer Res., vol. 34, no. 4, pp. 441-458, Dec. 2007.
97. Y. Chi, B. Tseng, and J. Tatemura, "Eigen-trend: Trend analysis in the blogosphere based on singular value decompositions," in Proc. 15th ACM Int. Conf. Inf. Knowl. Manage., 2006, p. 77.
98. J. Sun, D. Tao, and C. Faloutsos, "Beyond streams and graphs: Dynamic tensor analysis," in Proc. ACM SIGKDD KDD, 2006, pp. 374-383 (Pubitemid 44535534)
99. T. G. Kolda and J. Sun, "Scalable tensor decompositions for multi-aspect data mining," in Proc. ICDM, 2008, pp. 363-372.
100. P. Drineas and M. Mahoney, "A randomized algorithm for a tensor-based generalization of the singular value decomposition," Linear Algebra Appl., vol. 420, no. 2-3, pp. 553-571, 2007. (Pubitemid 44762244)
101. S. Brin and L. Page, "The anatomy of a large-scale hypertextual Web search engine," Comput. Netw. ISDN Syst., vol. 30, no. 1-7, pp. 107-117, 1998.
102. J. M. Kleinberg, "Authoritative sources in a hyperlinked environment," J. ACM, vol. 46, no. 5, pp. 604-632, 1999.
103. J. Shi and J. Malik, "Normalized cuts and image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 888-905, Aug. 2000.
104. T. Hofmann, "Probabilistic latent semantic indexing," in Proc. ACM SIGIR, 1999, pp. 50-57.
105. F. Chierichetti, R. Kumar, S. Lattanzi, M. Mitzenmacher, A. Panconesi, and P. Raghavan, "On compressing social networks," in Proc. 15th ACM SIGKDD KDD, 2009, pp. 219-228.
106. J. Leskovec and C. Faloutsos, "Sampling from large graphs," in Proc. 12th ACM SIGKDD KDD, 2006, pp. 631-636. (Pubitemid 44535566)
107. E. Candés and J. Romberg, "Sparsity and incoherence in compressive sampling," Inverse Prob., vol. 23, pp. 969-985, 2007. (Pubitemid 46838836)
108. E. Candés and T. Tao, "Near-optimal signal recovery from random projections: Universal encoding strategies?," IEEE Trans. Inf. Theory, vol. 52, no. 12, pp. 5406-5425, Dec. 2006.
109. E. Candés and M. Wakin, "An introduction to compressive sampling," IEEE Signal Process. Mag., vol. 25, no. 2, pp. 21-30, Mar. 2008.
110. L. Tucker, "Some mathematical notes on three-mode factor analysis," Psychometrika, vol. 31, no. 3, pp. 279-311, 1966.