But the advent of electronic discovery is putting pressure on law firms and service bureaus to deal with the legitimate million record case. Even a million records now is starting to seem small. Just a sample of Canadiancases recently coming in our door:
- Production (on four hard drives and multiple DVDs) of 17-25 million pages, at least 2-3 million records
- Production on 83 DVDs (equivalent of at least 250Gb)
- Backup tapes containing 600 Terabytes of data, in addition to the 160Gb of e-mail
- Significant time frames for copying, moving, processing high volumes of data (unless you have multiple dedicated workstations, copying 83 DVDs to a hard drive would take at least a week of around the clock processing)
- Cost. When hosting data on a per-page per-month basis, $0.003 per page seems very inexpensive, until you multiply it by 25,000,000.
- Database management. Traditional litigation support tools were not designed to support a million records very efficiently. Scalable, high-end tools are required, and that means additional support, IT infrastructure and complexity.
- Validation. When preparing such vast amounts of data, there is a fairly good chance that some problem will be encountered – whether it is corrupt disk sectors, overloads, interruptions, and simple operator errors. Any large data transfers from one firm to another must involve a significant quality control and validation effort.