The methodology of manual assessment in the evaluation of link discovery

ADCS 2009 - Proceedings of the Fourteenth Australasian Document Computing Symposium

Volumn , Issue , 2009, Pages 110-114

  Huang, Wei Che ^a   Trotman, Andrew ^b   Geva, Shlomo ^a  

^a QUEENSLAND UNIVERSITY OF TECHNOLOGY   (Australia)

^b UNIVERSITY OF OTAGO   (New Zealand)

Author keywords

Evaluation; Link quality; Manual assessment; Wikipedia

Indexed keywords

AUTOMATED LINK; AUTOMATIC ASSESSMENT; EVALUATION; EVALUATION MEASURES; GROUND TRUTH; LINK DISCOVERY; LINK QUALITY; MANUAL ASSESSMENT; WIKIPEDIA;

WEBSITES;

QUALITY CONTROL;

EID: 84872863344     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Article

References (13)

1. Alexa, The Web Information Company http://www.alexa.com/topsites.
2. Geva, S., GPX: Ad-Hoc Queries and Automated Link Discovery in the Wikipedia, INEX 2007, pp. 404-416.
3. Jenkinson, D., K.-C. Leung, A. Trotman, Wikisearching and Wikilinking, INEX 2008, pp. 374-388.
4. Mihalcea, R., A. Csomai, Wikify!: linking documents to encyclopedic knowledge, CIKM 2007, pp. 233-242.
5. Milne, D., I.H. Witten, Learning to link with wikipedia, CIKM 2008, pp. 509-518.
6. INEX (2009) http://www.inex.otago.ac.nz/tracks/wiki-link/wiki-link.asp.
7. W.C. Huang, Trotman, A., Geva, S (2009), The Importance of Manual Assessment in Link Discovery, SIGIR 2009, pp. 698-699.
8. Denoyer, L., Gallinari, P. (2006) The Wikipedia XML Corpus, ACM SIGIR Forum, 40(1):64-69.
9. Schenkel, R., Suchanek, F. M., Kasneci, G. (2007) YAWN: A Semantically Annotated Wikipedia XML Corpus, BTW 2007, pp. 277-291.
10. WiQA: Question answering using Wikipedia (2006) http://ilps.science.uva.nl/WiQA/index.html
11. Jenkins, N., Can We Link It, http://en.wikipedia.org/wiki/User:Nickj/Can_We_Link_It.
12. Mitanura, T., Nyberg, E. Shima, H., Kato, T., Mori, T., Lin, C.Y., Song, R., Lin, C. J., Sakai, T., Ji, D., Kando, N., Overview of the NTCIR-7 ACLIA Taska: Advanced Cross-Language Information Access NTCIR-7, pp. 11-25.
13. Di Nunzio, G. M. and Ferro, N., DIRECT: A System for Evaluating Information Access Components of Digital Libraries, ECDL 2005, pp. 483-484.