MT>3
  • Home
  • About
  • People
  • Services
    • e-Discovery
    • Managed Review
    • Information Governance
    • Due Diligence
  • Blog
  • News
  • Contact

Is Your Culling Method Reasonable?

8/11/2010

 
A study conducted as part of the 2009 Legal TREC found that conducting enterprise wide automated content analysis returned significantly more relevant documents than employing traditional culling-based methodologies.

To conduct its research, ZL Technologies had two teams – one using content analysis and the other employing manual culling, search through nearly 3 million emails from more than 100 mailboxes of Enron employees.

The results found that culling by first selecting custodians and then applying keyword filters led to incomplete information upon which to base their important legal decisions. The team failed to find 84% of relevant documents and only found four employees storing relevant information. The content analysis team, however, successfully found all relevant documents and identified all 77 relevant employees.

Of course, the above results are based in part on the skill, or lack thereof, of the people who made up the culling group in developing good search terms. This was highlighted recently in Victor Stanley, Inc. v. Creative Pipe Inc. In his May 29 opinion, U.S. Chief Magistrate Judge Paul Grimm faulted the defendant’s keyword search methodology. “[W]hile it is universally acknowledged that keyword searches are useful tools for search and retrieval of [electronically stored information], all keyword searches are not created equal; and there is a growing body of literature that highlights the risks associated with conducting an unreliable or inadequate keyword search or relying exclusively on such searches for privilege review”.

While a less than 100% accurate production is obviously a concern, the test should not be perfection. Instead, the litigator should be confident that the method used in deciding how to cull documents is reasonable. While that means that some records could potentially fall through the cracks, holding one to a standard of perfection is contrary to the concept of proportionality.

​Essentially, if you spend too much time being nervous about having a perfect collection and culling process, your results will not be cost-effective or practical. The process must be balanced – err on the side of caution, but with a reasonable approach.


Comments are closed.

    Categories

    All
    Artificial Intelligence
    Blockchain
    Cyber Security
    E Discovery
    Information Governance
    Legaltech
    Privacy
    Social Media
    Technology


    Archives

    February 2021
    November 2020
    October 2020
    July 2020
    June 2020
    April 2020
    March 2020
    February 2020
    January 2020
    November 2019
    October 2019
    September 2019
    June 2019
    May 2019
    April 2019
    March 2019
    February 2019
    January 2019
    May 2018
    April 2018
    March 2018
    September 2017
    August 2017
    February 2017
    January 2017
    December 2016
    November 2016
    October 2016
    September 2016
    August 2016
    July 2016
    June 2016
    May 2016
    April 2016
    March 2016
    February 2016
    January 2016
    December 2015
    November 2015
    October 2015
    September 2015
    August 2015
    July 2015
    June 2015
    May 2015
    April 2015
    March 2015
    February 2015
    January 2015
    December 2014
    November 2014
    October 2014
    September 2014
    August 2014
    July 2014
    June 2014
    May 2014
    April 2014
    March 2014
    February 2014
    January 2014
    December 2013
    November 2013
    October 2013
    September 2013
    August 2013
    July 2013
    June 2013
    May 2013
    April 2013
    March 2013
    February 2013
    January 2013
    December 2012
    November 2012
    October 2012
    September 2012
    August 2012
    July 2012
    June 2012
    April 2012
    March 2012
    February 2012
    January 2012
    December 2011
    November 2011
    October 2011
    September 2011
    August 2011
    June 2011
    April 2011
    March 2011
    February 2011
    January 2011
    December 2010
    November 2010
    October 2010
    September 2010
    August 2010
    July 2010
    June 2010
    May 2010
    March 2010
    February 2010
    January 2010
    October 2009
    September 2009
    August 2009
    December 2008
    March 2008
    November 2007
    October 2007

130 Adelaide Street West Suite 2020
Toronto, Ontario M5H 3P5
​ ​
t: 416-642-2220  
tf: 1-877-642-2220  
f: 416-868-0673
Contact MT>3
@MT>3 2018. All Rights Reserved
Picture

Privacy Policy and Terms of Use

  • Home
  • About
  • People
  • Services
    • e-Discovery
    • Managed Review
    • Information Governance
    • Due Diligence
  • Blog
  • News
  • Contact