Cross-evaluation: A new model for information system evaluation

Journal of the American Society for Information Science and Technology

Volumn 57, Issue 5, 2006, Pages 614-628

  Sun, Ying ^a   Kantor, Paul B ^a  

^a RUTGERS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYTICAL MODEL; CROSS-EVALUATION; INFORMATION SYSTEM EVALUATION;

COMPUTER SUPPORTED COOPERATIVE WORK; MATHEMATICAL MODELS; PROBLEM SOLVING;

INFORMATION SCIENCE;

EID: 33645030604     PISSN: 15322882     EISSN: 15322890     Source Type: Journal    
DOI: 10.1002/asi.20324     Document Type: Article

References (19)

1. Barry, C.L. (1994). User-defined relevance criteria: An exploratory study. Journal of the American Society for Information Science, 45, 149-159.
2. Boros, E., Kantor, P., & Neu, D.J. (1999). Pheromonic representation of user quests by digital structures. In Proceedings of the 62nd Annual Meeting of the American Society for Information Science (Vol. 36, pp. 633-642). Medford, NJ: Information Today.
3. Burger, J., Cardie, C., Chaudhri, V., Gaizauskas, R., Harabagui, S., Isreal, D., et al. (2001). Issues, tasks and program structures to roadmap research in question & answering (Q&A). Retrieved December 3, 2004, from http://www-nlpir.nist.gov/projects/duc/papers/qa.Roadmap-paper_v2.doc
4. Cleverdon, C.W. (1960). The ASLIB Cranfield Research Project on the Comparative Efficiency of Indexing Systems. ASLIB Proceedings, 12(12), 421-431.
5. DUC (2004). The Document Understanding Conference. Retrieved from http://duc.nist.gov
6. Kantor, P., Boros, E., Melamed B., & Meñkov, V. (1999) The information quest: A dynamic model of user's information needs. Proceedings of the 62nd Annual Meeting of the American Society for Information Science, 36 (pp. 536-545). Medford, NJ: Information Today.
7. Kantor, P., Boros, E., Melamed, B., Neu, D.J., Meñkov, V., Shi, Q., et al. (1999) AntWorld. In Proceedings of SIGIR'99, 22nd International Conference on Research and Development in Information Retrieval (p. 323). New York: Association for Computer Machinery.
8. Kantor, P., & Kelly, D. (2004). ARDA Challenge Workshop 2004: Metrics for question answering systems final report. Unpublished report.
9. Kantor, P., Kelly, D., & Morse, E. (2004). ARDA Challenge Workshop 2004: Metrics for question answering systems. Unpublished manuscript.
10. Kantor, P., & Voorhees, E. (2000). The TREC-5 confusion track: Comparing retrieval methods for scanned text. Information Retrieval, 2(2/3), 165-176.
11. Lagergren, E., & Over, P. (1998). Comparing interactive information retrieval systems across sites: The TREC-6 interactive track matrix experiment. In Proceedings of the 21st International Conference on Research and Development in Information Retrieval SIGIR'98 (pp. 164-172).
12. Over, P. (2001) The TREC interactive track: An annotated bibliography. Information Processing and Management, 37(3), 369-381.
13. Robertson, S., & Soboroff, I. (2002). The TREC 2002 filtering track report. In the Notebook of the Text REtrieval Conference, 2002. Retrieved December 3, 2004, from http://trec.nist.gov//pubs/trec11/papers/OVER.FILTERING. pdf
14. Saracevic, T., Kantor, P., Chamis, A.Y., & Trivison, D. (1988a). A study of information seeking and retrieving: 1. Background and methodology. Journal of the American Society for Information Science, 39(3), 161-176.
15. Saracevic, T., & Kantor. P. (1988b). A study of information seeking and retrieving: 2. Users, questions, and effectiveness. Journal of the American Society for Information Science 39(3), 177-196.
16. Saracevic, T., & Kantor. P. (1988c). A study of information seeking and retrieving: 3. Searchers, searches, overlap. Journal of the American Society for Information Science 39(3), 197-216.
17. Schamber, L. (1994). Relevance and information behavior. Annual Review of Information Science and Technology, 29, 3-48.
18. Sun, Y., Kantor, P., Strzalkowski, T., Rittman, R., & Wacholder, N. (2004). Cross evaluation - A pilot application of a new evaluation mechanism. In the Proceedings of the 2004 Annual Meeting of American Society for Information Science and Technology (pp. 383-392). Medford, NJ: Information Today.
19. TREC QA track. Retrieved December 3, 2004, from http://trec.nist.gov/ presentations/TREC 10/qa/