Objective and automated protocols for the evaluation of biomedical search engines using No Title Evaluation protocols

BMC Bioinformatics

Volumn 9, Issue , 2008, Pages

  Campagne, Fabien ^a  

^a WEILL CORNELL MEDICAL COLLEGE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BIOMEDICAL APPLICATIONS; BIOMEDICAL INFORMATION RETRIEVAL; BIOMEDICAL SEARCH ENGINES; CORRELATION COEFFICIENT; EVALUATION PROTOCOL; PERFORMANCE RANKINGS; RELEVANCE JUDGMENT; RELEVANT DOCUMENTS;

DATA FUSION; MEDICAL APPLICATIONS; SEARCH ENGINES;

INFORMATION RETRIEVAL;

ARTICLE; AUTOMATION; BIOINFORMATICS; CLINICAL PROTOCOL; COMPUTER PROGRAM; CORRELATION COEFFICIENT; EVALUATION RESEARCH; INFORMATION RETRIEVAL; INTERMETHOD COMPARISON; MEDICAL RESEARCH; PERFORMANCE; SEARCH ENGINE; SENSITIVITY ANALYSIS; ALGORITHM; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; EVALUATION; LINGUISTICS; METHODOLOGY; NATURAL LANGUAGE PROCESSING; PUBLICATION;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; INFORMATION STORAGE AND RETRIEVAL; NATURAL LANGUAGE PROCESSING; PATTERN RECOGNITION, AUTOMATED; PERIODICALS AS TOPIC; SOFTWARE VALIDATION; VOCABULARY, CONTROLLED;

EID: 42149172286     PISSN: None     EISSN: 14712105     Source Type: Journal    
DOI: 10.1186/1471-2105-9-132     Document Type: Article

References (19)

1. Voorhees EM The philosophy of information retrieval evaluation Evaluation of Cross-Language Information Retrieval Systems: Second Workshop of the Cross-Language Evaluation Forum CLEF 2001 Darmstadt, Germany Peters C, Braschler M, Gonzalo J, Kluck M Lecture Notes in Computer Science 2001, 355-3370.
2. Amitay E Carmel D Lempel R Soffer A Scaling IR System Evaluation using Term Relevance Sets Annual ACM Conference on Research and Development in Information Retrieval Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval Sheffield, United Kingdom 2004.
3. Cohen AM Hersh WR The TREC 2004 genomics track categorization task: classifying full text biomedical documents J Biomed Discov Collab 2006, 1:4. 1440303 16722582
4. Kim SF Huri DA Snyder SH Inducible nitric oxide synthase binds, S-nitrosylates, and activates cyclooxygenase-2 Science 2005, 310(5756):1966-1970. 16373578
5. Buttcher S Clarke CLA Yeung PCK Index Pruning and Result Reranking: Effects on Ad-Hoc Retrieval and Named Page Finding: Gaithersburg, MA, USA. National Institute of Standards (NIST) 2006.
6. Soboroff I Nicholas C Cahan P Ranking retrieval systems without relevance judgments. Proceedings of the 24th ACM SIGIR conference 2001, 66-73.
7. Aslam JA Pavlu V Yilminaz E A statistical method for system evaluation using incomplete relevance judgments SIGIR'06 Seattle, Washington, USA, ACM 2006, 541-548.
8. Nuray R Can F Automatic ranking of information retrieval systems using data fusion Information Processing and Management 2006, 42:595-614.
9. Dong P Loh M Mondry A Relevance similarity: An alternative means to monitor information retrieval systems Biomed Digit Libr 2005, 2:6. 1181804 16029513
10. Demner-Fushman D Humphrey SM Ide NC Loane RF Ruch P Ruiz ME Smith LH Tanabe LK Wilbur WJ Aronson AR Finding Relevant Passages in Scientific Articles: Fusion of Automatic Approaches vs. an Interactive Team Effort.: Gaithersburg, MD, USA. National Institutes of Standards 2006
11. Yue Y Finley T Radlinski F Joachims T A Support Vector Method for Optimizing Average Precision SIGIR Amsterdam, The Netherlands. 2007
12. Dorff KC Wood MJ Campagne F Twease at TREC 2006: Breaking and fixing BM25 scoring with query expansion, a biologically inspired double mutant recovery experiment.: Gaithersburg, MD, USA. National Institutes of Standards 2006 Notebook paper 836-850.
13. Wood MJ Dorff KC Boldi P Vigna S Campagne F The Twease biomedical search engine http://www.twease.org
14. Sparck Jones K Walker S Robertson SE A probabilistic model of information retrieval: Development and comparative experiments, Part 2. Information Processing and Management 2000, 36:809-840.
15. Sparck Jones K Walker S Robertson SE A probabilistic model of information retrieval: Development and comparative experiments, Part 1. Information Processing and Management 2000, 36:779-808.
16. Boldi P Vigna S Efficient lazy algorithms for minimal-interval semantics. Proc SPIRE 2006, number 4209 in Lecture Notes in Computer Science Springer-Verlag In Fabio Crestani, Paolo Ferragina, and Mark Sanderson, editors 2006 pages 134-149.
17. Robertson SE On term selection for query expansion. Journal of Documentation 1990, 46:359-364.
18. Fuller M Zobel J Conflation-based Comparison of Stemming Algorithms Proc of the Third Australian Document Computing Symposium Sydney, Australia 1998.
19. NIST Trec eval program http://trec.nist.gov/trec_eval/