We Have the Data, Now What

March 20, 2009

ZDNet’s Tom Espiner’s “Gov’t May Track All UK Facebook Traffic” here. I found the post interesting because of this comment:

Under the EU Data Retention Directive, from the 15 March, 2009, all UK Internet service providers (ISPs) are required to store customer traffic data for a year. The Intercept Modernisation Programme (IMP) is a government proposal, introduced last year, for legislation to use mass monitoring of traffic data as an anti-terrorism tool. The IMP has two strands: that the government use deep packet inspection to monitor the web communications of all UK citizens; and that all of the traffic data relating to those communications are stored in a centralised government database.

Let me be clear. I have zero problem with law enforcement taking such steps to fulfill their mandated duty. If that is a problem for you, quit reading my Web log. My concern is that lots of data poses a search and retrieval problem. When those data change, the problem gets bigger and quickly. Based on my research, there are only a handful of companies with the technology to tame these exascale data sets. One is Google. The other is Exalead. If you know of others, please, let me know. Just bring facts, gentle reader.

Stephen Arnold, March 20, 2009

Comments

Comments are closed.

  • Archives

  • Recent Posts

  • Meta