E-Discovery revisited: The need for artificial intelligence beyond information retrieval

Artificial Intelligence and Law

Volumn 18, Issue 4, 2010, Pages 321-345

  Conrad, Jack G ^a  

^a THOMSON REUTERS   (United Kingdom)

Author keywords

Data mining; E Disclosure; E Discovery; EDD; Electronically stored information; ESI; Information retrieval; Text REtrieval conference; TREC

Indexed keywords

E-DISCLOSURE; E-DISCOVERY; EDD; ELECTRONICALLY STORED INFORMATION; ESI; TEXT RETRIEVAL CONFERENCE; TREC;

ARTIFICIAL INTELLIGENCE; DATA MINING; SOCIAL SCIENCES COMPUTING;

INFORMATION RETRIEVAL;

EID: 79951774367     PISSN: 09248463     EISSN: 15728382     Source Type: Journal    
DOI: 10.1007/s10506-010-9096-6     Document Type: Article

References (49)

1. Ashley KD, Bridewell W (2010) Emerging AI & Law approaches to automating analysis and retrieval of electronically stored information in discovery proceedings. In: Artificial intelligence and law special issue on E-Discovery (This issue)
2. Barnett T, Godjevac S, Renders J-M, Privault C, Schneider J, Wickstrom R (2009) Machine learning classification for document review. In: Proceedings of the global E-Discovery/E-Disclosure workshop on electronically stored information in discovery at the 12th international conference on artificial intelligence and law (ICAIL09 DESI Workshop). DESI Press, Barcelona
3. Baron JR, Lewis DD, Oard DW (2006) TREC 2006 legal track overview. In: The fifteenth Text REtrieval Conference proceedings (TREC 2006), Gaithersburg, MD, Nov 2006. National Institute of Standards and Technology (NIST), USA
4. Baron JR, Thompson P (2007) The search problem posed by large heterogeneous data sets in litigation: Possible future approaches to research. In: Proceedings of the 11th international conference on artificial intelligence and law (ICAIL07). ACM Press, Palo Alto, CA
5. Baron JR (2008) Panning for gold in E-discovery: What every information scientist should know about how lawyers search for electronic evidence. In: CIKM panel on E-Discovery, 17th ACM conference on information and knowledge management (CIKM 2008). ACM, USA (Oct. CIKM Web site)
6. Barsocchini A (2005) Electronic discovery primer, in law technology News, 28 Aug 2005
7. Bauer RS, Jade T, Hedin B, Hogan C (2008) Automated legal sensemaking: The centrality of relevance and intentionality. In: Proceedings of the second international workshop on supporting search and sensemaking for electronically stored information in discovery at the international conference on digital evidence (ICDE 2008, DESI Workshop). DESI Press, UK
8. Blair DC, Maron ME (1985) An evaluation of retrieval effectiveness for a full-text document retrieval system. In: Communications of the ACM, 28(3). ACM Press, New York, pp 289-299 (Pubitemid 15599385)
9. Bobrow DG, King TH, Lee LC (2007) Enhancing legal discovery with linguistic processing. In: Proceedings of the first international workshop on supporting search and sensemaking for electronically stored information in discovery proceedings at the 11th international conference on artificial intelligence and law (ICAIL07 DESI Workshop, Stanford University). DESI Press, CA
10. Buckley C (2008) IR perspectives on the E-discovery problems. In: CIKM Panel on E-Discovery, 17th ACM conference on information and knowledge management (CIKM 2008). ACM, USA (CIKM Web Site)
11. Chaplin D, Jytyla R (2009) Conceptual search technology: Avoid sanctions, prevent privilege waiver, and understand your data. In: Proceedings of the global E-Discovery/E-Disclosure workshop on electronically stored information in discovery at the 12th international conference on artificial intelligence and law (ICAIL09 DESI Workshop). DESI Press, Barcelona
12. Conrad JG (2007) E-Discovery revisited: A broader perspective for IR researchers. In: Proceedings of the first international workshop on supporting search and sensemaking for electronically stored information in discovery proceedings at the 11th international conference on artificial intelligence and law (ICAIL07 DESI Workshop, Stanford University). DESI Press, CA
13. Cormack GV, Mojdeh M (2009) Machine learning for information retrieval: TREC 2009 Web, relevance feedback and legal tracks. In: The eighteenth Text REtrieval Conference proceedings (TREC 2009), Gaithersburg, MD, Nov 2009. National Institute of Standards and Technology (NIST), USA
14. Counsel C (2006) The American Bar Association (ABA), section of litigation, committee on Corporate Counsel. http://www.abanet.org/litigation/ committees/corporate/
15. Evans DA (2008) Why E-Discovery is a CIKM-hard problem. In: CIKM Panel on E-Discovery, 17th ACM conference on information and knowledge management (CIKM 2008). ACM, USA (Oct. CIKM Web site)
16. Evans S (2009) E-discovery market set for 2010 boom: Gartner, http://www.cbronline.com/news. 16 Dec 2009
17. Fios (2010) Discovery resources web site. Resources and news about E-discovery: http://www. discoveryresources.com
18. Hedin B, Tomlinson S, Baron JR, Oard DW (2009) Overview of the TREC 2009 legal track. In: The eighteenth Text REtrieval Conference proceedings (TREC 2009), Gaithersburg, MD, Nov 2009. National Institute of Standards and Technology (NIST), USA
19. Henseler H (2010) Network-based filtering for large e-mail collections in E-discovery. In: Artificial intelligence and law special issue on e-Discovery (This issue)
20. Hogan C, Brassil D, Rugani SM, Reinhart J, Gerber M, Jade T (2008) H5 at TREC 2008 legal interactive: User modeling, assessment & measurement. In: The seventeenth Text REtrieval Conference proceedings (TREC 2008), Gaithersburg, MD, Nov 2008. National Institute of Standards and Technology (NIST), USA
21. Hogan C, Bauer R, Brassil D (2010) Human-aided computer cognition for E-discovery. In: Artificial intelligence and law special issue on e-Discovery (This issue)
22. Isaza J, Jablonski JJ (2010) Legal holds: Define the scope: The third article in a series aimed at helping organizations discharge their duty to preserve ESI. From Law.com, http://www.almdc.com/jsp/ lawtechnologynews. 26 Feb 2010
23. Klimt B, Yang Y (2004) A new dataset: The Enron Corpus. In: ECML, pp 217-226
24. Lang JP, Baffa J (2010) Electronic discovery: An overview and practical pointers. "Firm News and Activities". Bates & Carey LLP Web site. http://www.batescarey.com/newsandarticles/ electronicdiscovery.asp
25. Law.com (2010) Web-based legal news and information network: http://www.Law.com
26. Lewis DD, Agam G, Argamon S, Frieder O, Grossman DA, Heard J (2006) Building a test collection for complex document information processing. In: Proceedings of the 29th annual international ACM SIGIR conference on research and development in information retrieval (SIGIR06). ACM Press, New York, pp 665-666
27. Losey R (2009) Jason Baron on search-how do you find anything when you have a billion emails? "E-Discovery Team" blog. http://www.e- discoveryteam.com, March 4 2009
28. Illinois Institute of Technology (IIT) (2006) Complex document information processing (CDIP) 1.0 collection. Master Settlement Agreement (MSA) subcollection of the Legacy Tobacco Documents Library (LTDL)
29. Oard DW, Hedin B, Tomlinson S, Baron JR (2008) Overview of the TREC 2008 legal track. In: The seventeenth Text REtrieval Conference proceedings (TREC 2008), Gaithersburg, MD, Nov 2008. National Institute of Standards and Technology (NIST), USA
30. Oard DW, Baron JR, Hedin B, Lewis DD, Tomlinson S (2010) Evaluation of information retrieval for E-Discovery. In: Artificial intelligence and law special issue on e-Discovery (This issue)
31. Radding A (2006) The forecast for EDD, special to Law.com, Nov 15 2006
32. Roitblat HL, Kershaw A, Oot P (2010) Document categorization in legal electronic discovery: Computer classification vs manual review. J Am Soc Info Sci Techn (JASIST), Wiley: Hoboken, NJ 61(1): 70-80
33. Scott J (2000) Social network analysis: A handbook, 2nd edn. Sage Publications, London
34. SearchFinancialSecurity.com (2009) Definitions: Electronic Discovery. http://searchfinancialsecurity. techtarget.com
35. Search Security (2010) IT site to keep corporate data and assets secure: http://www.SearchSecurity.com
36. The Sedona Conference (2009) Commentary on achieving quality in the E-Discovery process. Working group on best practices for document retention & production. Public Comment Version, May
37. The Sedona Conference (2010) Facilitates discussion among legal experts on topics like complex litigation: http://www.theSedonaConference.org
38. Socha G, Gelbmann T (2006) The 2006 Socha-Gelbmann electronic discovery survey report. Socha Consulting LLC and Gelbmann & Associates, MN
39. Socha G, Gelbmann T (2008) The 2008 Socha-Gelbmann 6th annual electronic discovery survey. Socha Consulting LLC and Gelbmann & Associates, MN
40. Socha G, Gelbmann T (2009a) Strange times, a summary of the 2009 Socha-Gelbmann 7th annual electronic discovery survey. Socha Consulting LLC and Gelbmann & Associates, MN. Law technology news, Law.com, 1 Aug 2009
41. Socha G, Gelbmann T (2009b) Electronic discovery reference model. edrm.net
42. Socha G (2008) Description of the electronic discovery reference model. Interview by Kenna Kim, PivotalDiscovery.com (Part 3) [on http://www.YouTube. com] At 12th Annual Thomson Reuters EDiscovery and Records Retention Conference. San Francisco, CA, Dec
43. Sterenzy T (2009) Equivio at TREC 2009 legal interactive. In: The eighteenth Text REtrieval Conference proceedings (TREC 2009), Gaithersburg, MD, Nov 2009. National Institute of Standards and Technology (NIST), USA
44. Third International Workshop on Supporting Search and Sensemaking for Electronically Stored Information in Discovery (DESI3) (2009) Proceedings of the global E-Discovery/E-Disclosure workshop on electronically stored information in discovery at the 12th international conference on artificial intelligence and law (ICAIL09 DESI Workshop). DESI Press, Barcelona. http://www. law.pitt.edu/DESI3-Workshop/
45. Thompson P, Turtle HR, Yang B, Flood J (1994) TREC-3 ad hoc retrieval and routing experiments using the WIN system. In: The third Text REtrieval Conference proceedings (TREC 1994), Gaithersburg, MD, Nov 1994. National Institute of Standards and Technology (NIST), USA
46. Tomlinson S, Oard DW, Baron JR, Thompson P (2007) Overview of the TREC 2007 legal track. In: The sixteenth Text REtrieval Conference proceedings (TREC 2007), Gaithersburg, MD, Nov 2007. National Institute of Standards and Technology (NIST), USA
47. Voorhees EM (2007) Overview of TREC 2007. In: The sixteenth Text REtrieval Conference proceedings (TREC 2007), Gaithersburg, MD, Nov 2007. National Institute of Standards and Technology (NIST), USA
48. Voorhees EM, Buckland LP (eds) (2008) Proceedings of the seventeenth Text REtrieval Conferences (TREC 2008), Gaithersburg MD, Nov 2008. National Institute of Standards and Technology (NIST), USA
49. Zhao FC, Oard DW, Baron JR (2009) Improving search effectiveness in the legal e-discovery process using relevance feedback. In: Proceedings of the global E-Discovery/E-Disclosure workshop on electronically stored information in discovery at the 12th international conference on artificial intelligence and law (ICAIL09 DESI Workshop). DESI Press, Barcelona