Document categorization in legal electronic discovery: Computer classification vs. manual review

Journal of the American Society for Information Science and Technology

Volumn 61, Issue 1, 2010, Pages 70-80

  Roitblat, Herbert L ^a   Kershaw, Anne ^b   Oot, Patrick ^c  

^a OrcaTec LLC   (United States)

^b Electronic Discovery Institute   (United States)

^c Electronic Discovery Institute   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATED PROCEDURES; AUTOMATED SYSTEMS; CATEGORIZATION SYSTEMS; COMPUTER CLASSIFICATION; DEPARTMENT OF JUSTICE; DOCUMENT CATEGORIZATION; ELECTRONIC DISCOVERIES; ELECTRONIC DOCUMENT; LEGAL SERVICES; RELEVANT DOCUMENTS;

AUTOMATION; INFORMATION SERVICES; LAWS AND LEGISLATION; SECURITY OF DATA; WORD PROCESSING;

INFORMATION RETRIEVAL SYSTEMS;

EID: 72849149280     PISSN: 15322882     EISSN: 15322890     Source Type: Journal    
DOI: 10.1002/asi.21233     Document Type: Review

References (16)

1. Bace, J. (2007). Cost of e-discovery threatens to skewjustice system. Gartner Report G00148170. Retrieved May 6, 2009, from http://www.akershaw.com/ Documents/cost-of-ediscovery-threatens-148170.pdf
2. Baron, J.R. (2008). Beyond keywords: Emerging best practices in the area of search and information retrieval. New Mexico Digital Preservation Conference, June 5, 2008. Retrieved July 29, 2009, from http://www.archives.gov/rocky- mountain/records-mgmt/conferences/digital-preservation/beyond-keywords.pdf
3. Baron, J.R., Lewis, D.D., & Oard, D.W. (2007). TREC-2006 Legal Track Overview. In Proceedings of the 15th Text REtrieval Conference (TREC 2006) (pp. 79-99). Gaithersburg, MD: NIST. Retrieved September 21, 2009, from http://trec.nist.gov/pubs/trec15/papers/LEGAL06. OVERVIEW.pdf
4. Barnett, T., Godjevac, S., Renders, J.-M., Privault, C., Schneider, J., & Wickstrom, R. (2009, June). Machine learning classification for document review. Paper presented at the ICAIL 2009 Workshop on Supporting Search and Sensemaking for Electronically Stored Information in Discovery. Retrieved July 24, 2009, from http://www.law.pitt.edu/DESI3-Workshop/Papers/DESI-III.Xerox- Barnett.Xerox.pdf
5. Blair, D.C., & Maron, M.E. (1985). An evaluation of retrieval effectiveness for a full-text document-retrieval system. Communications of the ACM, 28, 289-299.
6. Borko, H. (1964) Measuring the reliability of subject classification by men and machines. American Documentation, 15(4), 268-273.
7. Eichman, D., & Chin, S.-C. (2007, June). Concepts, semantics and syntax in e-Discovery. Paper presented at the ICAIL 2007 Workshop on Supporting Search and Sensemaking for Electronically Stored Information in Discovery. Retrieved July 24, 2009, from http://www.umiacs.umd.edu/~oard/desi-ws/papers/ eichmann.pdf
8. Green, D.M., & Swets, J.A. (1966). Signal detection theory and psychophysics. New York: John Wiley & Sons.
9. Gruner, R.H. (2008). Anatomy of a lawsuit. Retrieved July 24, 2009, from http://www.vallexfund.com/download/AnatomyLawsuit.pdf
10. Oard, D.W., Hedin, B., Tomlinson, S., & Baron, J.R. (2009). Overview of the TREC 2008 Legal Track. In Proceedings of the 17th Text Retrieval Conference (TREC 2008). Retrieved September 21, 2009, from http://trec.nist.gov/ pubs/trec17/papers/LEGAL.OVERVIEW08.pdf
11. Paul. G.L., & Baron, J.R. (2007). Information inflation: Can the legal system adapt? Richmond Journal of Law and Technology, 13, Article 10, 1-41. Retrieved July 28, 2009, from http://law.richmond.edu/jolt/v13i3/ article10.pdf
12. Rijsbergen, C.J. van (1979). Information retrieval, 2nd ed. London: Butterworths.
13. Swets, J.A. (1969). Effectiveness of information retrieval methods. American Documentation, 20(1), 72-89.
14. Tomlinson, S., Oard, D.W., Baron, J.R., & Thompson P. (2008). Overview of the TREC 2007 Legal Track. In Proceedings of the 16th Text REtrieval Conference (TREC 2007). Retrieved September 21, 2009, from http://trec.nist. gov/pubs/trec16/papers/LEGAL.OVERVIEW16.pdf
15. Tonta, Y. (1991). A study of indexing consistency between Library of Congress and British Library catalogers, Library Resources & Technical Services, 35(2), 177-185.
16. Voorhees, E.M. (1998). Variations in relevance judgments and the measurement of retrieval effectiveness. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 315-323). New York: ACM Press.