An effective coherence measure to determine topical consistency in user-generated content

International Journal on Document Analysis and Recognition

Volumn 12, Issue 3, 2009, Pages 185-203

  He, Jiyin ^a   Weerkamp, Wouter ^a   Larson, Martha ^b   de Rijke, Maarten ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

Blog search; Coherence; Information retrieval; Topical structure; User generated content

Indexed keywords

BLOG SEARCH; COHERENCE; DATA SETS; LANGUAGE MODELING; LEXICAL COHESION; RETRIEVAL EFFECTIVENESS; RETRIEVAL PERFORMANCE; SEARCH RESULTS; SYNTHETIC DATA; TOPIC CLUSTERING; TOPICAL STRUCTURE; USER QUERY; USER-GENERATED CONTENT; WEIGHTING SCHEME;

COMPUTATIONAL LINGUISTICS; EXPERIMENTS; INFORMATION RETRIEVAL; INFORMATION SERVICES; NATURAL LANGUAGE PROCESSING SYSTEMS;

INTERNET;

EID: 70349969903     PISSN: 14332833     EISSN: 14332825     Source Type: Journal    
DOI: 10.1007/s10032-009-0089-5     Document Type: Conference Paper

References (40)

1. Allen, R.B., Obry, P., Littman, M.: An interface for navigating clustered document sets returned by queries. In: COCS'93, pp. 166-171. ACM, New York (1993)
2. Amitay, E., Carmel, D., Darlow, A., Herscovici, M., Lempel, R., Soffer, A., Kraft, R., Zien, J.: Juru at trec 2003 - topic distillation using query-sensitive tuning and cohesiveness filtering. In: TREC'03 Working Notes (2003)
3. Balog, K., Azzopardi, L., de Rijke, M.: Formal models for expert finding in enterprise corpora. In: SIGIR'06, pp. 43-50. ACM Press, New York (2006)
4. Balog, K., de Rijke, M., Weerkamp, W.: Bloggers as experts. In: SIGIR'08, pp. 753-754. ACM (2008)
5. Barzilay, R., Elhadad, M.: Using lexical chains for text summarization. In: Proceedings of the Intelligent Scalable Text Summarization Workshop (ISTS'97), ACL (1997)
6. Bock H.-H.: On some significance tests in cluster analysis. J. classif. 2(1), 77-108 (1985)
7. Cronen-Townsend, S., Croft, W.B.: Quantifying query ambiguity. In: HLT'02, pp. 94-98. (2002)
8. Cronen-Townsend, S., Zhou, Y., Croft, W.B.: Predicting query performance. In: SIGIR'02, pp. 299-306. ACM (2002)
9. Cutting, D.R., Karger, D.R., Pedersen, J.O., Tukey, J.W.: Scatter/ gather: A cluster-based approach to browsing large document collections. In: SIGIR '92, pp. 318-329, ACM, NY (1992)
10. Elsas, J., Arguello, J., Callan, J., Carbonell, J.: Retrieval and feedback models for blog distillation. In: TREC'07 Working Notes (2007)
11. Ernsting, B.J., Weerkamp, W., de Rijke, M.: The University of Amsterdam at the TREC 2007 Blog Track. In: TREC'07 Working Notes (2007)
12. Everitt B.S.: Unresolved problems in cluster analysis. Biometrics 35(1), 169-181 (1979)
13. Fellbaum, C. (eds): WordNet: An Electronic Lexical Database (Language, Speech, and Communication). MIT Press, Cambridge (1998)
14. Fujimura, K., Toda, H., Inoue, T., Hiroshima, N., Kataoka, R., Sugizaki, M.: Blogranger - a multi-faceted blog search engine. In: WWW'06 (2006)
15. Halliday M.A.K., Hasan R.: Cohesion in English (English Language). Longman, London (1976)
16. Hartigan J.A.: Statistical theory in clustering. J. classif. 2(1), 63-76 (1985)
17. He, J., Larson, M., de Rijke, M.: On the topical structure of the relevance feedback set. In: FGIR Workshop Information Retrieval (WIR 2008), Wurzburg, Germany (2008a)
18. He, J., Larson, M., de Rijke, M.: Using coherence-based measures to predict query difficulty. In: ECIR'08, pp. 689-694 (2008b)
19. He, J., Weerkamp, W., Larson, M., de Rijke, M.: Blogger, stick to your story: Modeling topical noise in blogs with coherence measures. In: AND '08: Proceedings of the Second Workshop on Analytics for Noisy Unstructured Text Data, pp. 39-46. ACM (2008c)
20. Lavrenko, V., Croft, W.B.: Relevance-based language models. In: SIGIR '01, pp. 120-127, ACM Press, New York (2001)
21. Lee, W.-L., Lommatzsch, A.: Feed distillation using adaboost and topic maps. In: TREC '07 Working Notes (2007)
22. Macdonald, C., Ounis, IC: The TREC Blogs06 collection: creating and analyzing a blog test collection. Technical Report TR-2006-224, Department of Computer Science, University of Glasgow (2006)
23. Macdonald, C., OuRis, I.: Key blog distillation: ranking aggregates. In: CIKM '08: Proceeding of the 17th ACM Conference on Information and Knowledge Management, pp. 1043-1052, ACM, New York (2008)
24. Macdonald, C., Ounis, I., Soboroff, I.: Overview of the TREC 2007 Blog Track. In: TREC '07 Working Notes, pp. 31-43 (2007)
25. Mackay D.J.C., Peto L.: A hierarchical dirichlet language model. Nat. Lang. Eng. 1(3), 1-19 (1994)
26. Mishne, G.: Applied text analytics for blogs. PhD thesis, University of Amsterdam (2007)
27. Mishne, G., de Rijke, M.: A study of blog search. In: Lalmas, M., MacFarlane, A., Rüger, S., Tombros, A., Tsikrika, T., Yavlinsky, A. (eds.) ECIR'06, vol. 3936, pp. 289-301 (2006)
28. Morris J., Hirst G.: Lexical cohesion computed by thesaural relations as an indicator of the structure of text. Comput. Linguist. 17(1), 21-48 (1991)
29. Ounis, I., Macdonald, C., de Rijke, M., Mishne, G., Soboroff, I.: Overview of the TREC 2006 Blog Track. In: TREC '06 Working Notes. NIST (2007)
30. Pilpel Y., Sudarsanam P., Church G.M.: Identifying regulatory networks by combinatiorial analysis of promoter elements. Nat. Genet. 29, 153-159 (2001)
31. Robertson, S., Callan, J.: Routing and filtering. In: TREC '05, pp. 99-122. MIT (2005)
32. Seki, K., Kino, Y., Sato, S.: TREC 2007 Blog Track experiments at Kobe University. In: TREC '07 Working Notes (2007)
33. Seo, J., Croft, W.B.: UMass at TREC 2007 Blog distillation task. In: TREC '07 Working Notes (2007)
34. Stokes, N., Newman, E., Carthy, J., Smeaton, A.F.: Broadcast news gisting using lexical cohesion analysis. In: The Proceedings of the 26th BCS-IRSG European Conference on Information Retrieval (ECIR-04), pp. 209-222. Springer (2004)
35. Weeds, J., Weir, D., Mccarthy, D.: Characterising measures of lexical distributional similarity. In: Proceedings of CoLing 2004, pp. 1015-1021 (2004)
36. Weerkamp, W., Balog, K., de Rijke, M.: Finding key bloggers, one post at a time. In: ECAI'08 (2008)
37. Weerkamp, W., Balog, K., de Rijke, M.: A generative blog post retrieval model that uses query expansion based on external collections. In: Joint Conference of the 47th Annual Meeting of the Association for Computational Linguistics and the 4th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing (ACL-ICNLP 2009) (2009)
38. Weerkamp, W., de Rijke, M.: Credibility improves topical blog post retrieval. In: Proceedings of ACL-08: HLT, pp. 923-931. Association for Computational Linguisticsages, Columbus (2008)
39. Willett P.: Recent trends in hierarchic docAment clustering: a critical review. Inf. Process Manag. 24(5), 577-597 (1988)
40. Zhai C., Lafferty J.: A study of smoothing methods for language models applied to information retrieval. ACM Trans. Inf. Syst. 22(2), 179-214 (2004)