Evaluating web search result summaries

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3936 LNCS, Issue , 2006, Pages 96-106

  Liang, Shao Fen ^a   Devlin, Siobhan ^a   Tait, John ^a  

^a UNIVERSITY OF SUNDERLAND   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ABSTRACTING; INFORMATION RETRIEVAL; WEBSITES; WORLD WIDE WEB;

EVALUATION METHODOLOGY; RESULT PAGE; SUMMAC/MUC/DUC; USERS' RELEVANCE JUDGEMENTS;

SEARCH ENGINES;

EID: 33745842165     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11735106_10     Document Type: Conference Paper

References (14)

1. Afantenos, S., Karkaletsis, V. and Stamatopoulos, P.: Summarization from medical documents: a survey. Artificial Intelligence in Medicine, 33, 2, February (2005), 157-177.
2. Berger, A. and Mittal, V.O.: Query-Relevant summarisation using FAQs. ACL (2000) 294-301.
3. Borko, H. and Bernier, C.L.: Abstracting concepts and methods. Academic Press, San Diego, Ca., USA (1975)
4. Chinchor, N. Hirschman, L. and Lewis, D.D.: Evaluating message understanding systems: An analysis of the third message understanding conference. Association for Computation Linguistics, 19, 3, (1993) 409-449.
5. Chinchor, N.: MUC-3 Evaluation metrics. Proceedings of third message understanding conference (1991) 17-24.
6. Harman, D. and Over P.: The effects of human variation in DUC summarisation evaluation. Proceedings of the ACL-04 Workshop in Text Summarization Branches Out (Barcelona, Spain, July, (2004) 10-17.
7. Liang, S.F., Devlin, S. and Tait, J.: Poster: Using query term order for result summarisation. SIGIR'05, Brazil (2005) 629-630.
8. Lin, C.Y.: ROUGE: a Package for Automatic Evaluation of Summaries. Proceedings of the Workshop on Text Summarization Branches Out, Barcelona, Spain, (2004) 25-26, July.
9. Mani, I., Firmin, T. and Sundheim, B.: The TIPSTER SUMMAC text summarisation evaluation. Proceedings of the ninth conference on European chapter of the Association ofr Computational Linguistics, Bergen, Norway (1999) 77-85.
10. Mani, I.: Automatic Summarization. John Benjamins, Amsterdam (2001).
11. Pagano, R.R.: Understanding statistics in the behavioural sciences. Wadsworth/Thomson Learning, USA (2001).
12. Sparck Jones, C. and Galliers, J.R.: Evaluating natural language processing systems: an analysis and review. Springer, New York (1996).
13. Tipster text phase III 18-month workshop notes, (1998), May, (1998) Fairfax, VA.
14. Voorhees, E.M.: Variations in Relevance Judgements and the Measurement of Retrieval Effectiveness. Information Processing & Management, 36, 5, (2000) 697-716, September.