TREC-2006 legal track overview

NIST Special Publication

Volumn , Issue , 2006, Pages 79-98

  Baron, Jason R ^a   Lewis, David D ^b   Oard, Douglas W ^c  

^a United States National Archives and Records Administration   (United States)

^b David D Lewis Consulting   (United States)

^c UNIVERSITY OF MARYLAND   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CURRENT PRACTICES; E DISCOVERIES; FIRST YEAR; NATURAL LANGUAGE QUERIES; PROFESSIONAL TRAINING; RELEVANCE JUDGMENT; RESEARCH TEAMS; SIMILAR MATERIAL; TEST COLLECTION;

COPYING; PERSONNEL TRAINING;

INFORMATION RETRIEVAL;

EID: 84873540628     PISSN: 1048776X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. Agam, G., Argamon, S., Frieder, O., Grossman, D. and Lewis, D., "Complex Document Information Processing: Prototype, Test Collection, and Evaluation, " Document Recognition and Retrieval XIII, SPIE Proceedings vol. 6067, pp. 60670N1 - 60670N11, 2006.
2. Baron, J., "Toward a Federal Benchmarking Standard for Evaluating Information Retrieval Products Used in E-Discovery, " Sedona Conference Journal, vol. 6, pp. 237-246, 2005 (available from Westlaw and LEXIS).
3. Baron, J., Lewis, D., and Oard, D. '' "How To" Guide for Assessors - TREC Legal Track 2006.'' Version 4, Aug. 20, 2006. http://trec-legal.umiacs.umd.edu/TRECLegal-HowToGuide-Version4Final.doc.
4. Blair, D., and Maron, M. "An Evaluation of Retrieval Effectiveness for a Full-Text Document-Retrieval System, " Communications of the ACM, 28(3)289-299, 1985.
5. Buckley, C., Dimmick, D., Soboroff, I and Voorhees, E., "Bias and the Limits of Pooling, " in Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 619-620, Seattle, 2006.
6. Buckley, C. and Voorhees, E. "Retrieval System Evaluation, " in TREC: Experiment and Evaluation in Information Retrieval, E. M. Voorhees and D. K. Harman, eds., MIT Press, pp. 53-75, 2002.
7. Cochran, W. Sampling Techniques, 3rd edition. John Wiley & Sons, New York, 1977.
8. Coleman v. Morgan Stanley, 2005 WL 679071 (Fla. Cir. Ct. Mar. 1, 2005).
9. Collaborative Expedition Workshop #45, Advancing Information Sharing, Access, Discovery and Assimilation of Diverse Digital Collections Governed by Heterogeneous Sensitivities, held Nov. 8, 2005, see http://colab.cim3.net/cgi- bin/wiki.pl?AdvancingInformationSharing-DiverseDigitalCollections- HeterogeneousSensitivities-11-08-05.
10. Jacobs, P., "GE in TREC-2: Results of a Boolean Approximation Method for Routing and Retrieval, " in The Second Text Retrieval Conference (TREC-2), Gaithersburg, MD, August, 1993, pp. 191-200.
11. Lewis, D. "The TREC-5 Filtering Track, " in The Fifth Text Retrieval Conference (TREC-5), Gaithersburg, MD, November, 1996, pp. 75-96.
12. Lewis, D., Agam, G., Argamon, S., Frieder, O., Grossman, D., and Heard, J. "Building a Test Collection for Complex Document Information Processing, " in Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 665-666, Seattle, 2006.
13. Lu, X., Allan, J., Miller, D. "Boolean Systems Revisited: Its Performance and Behavior, " The Fourth Text Retrieval Conference (TREC-4), pp. 459-474, Gaithersburg, MD, November, 1995.
14. Schmidt, H.; Butter, K.; and Rider, C. "Building Digital Tobacco Document Libraries at the University of California, San Francisco Library/Center for Knowledge Management, " D-Lib Magazine, 8(2), 2002.
15. Sedona Conference, The Sedona Principles: Best Practices Recommendations & Principles for Addressing Electronic Document Production (2005 version), Principle 11, see http://www.thesedonaconference.org/content/miscFiles/ publications-html.
16. Turtle, H., "Natural Language vs. Boolean Query Evaluation: A Comparison of Retrieval Performance, " Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 212-220, Dublin, 1994.
17. U.S. Federal Rules of Civil Procedure, Rules 26 & 34, as amended (Dec. 1, 2006).
18. Voorhees, E., "Variations in Relevance Judgments and the Measurement of Retrieval Effectiveness, " Information Processing and Management, 36(5)697-716, 2000.
19. Zubulake v. UBS Warburg, 217 F.R.D. 309 (S.D.N.Y. 2004.