Enterprise Search: A Problem of Relevance to the Users

I enjoy email from those who read my for fee columns. I received an interesting comment from Australia about desktop search.


In a nutshell, the writer read one of my analyses of software intended for a single user looking for information on his local hard drives. The bigger the hard drives, the greater the likelihood, the user will operate in squirrel mode. The idea is that it is easier to save everything because “you never know.” Right, one doesn’t.

Here’s the passage I found interesting:

My concern is that with the very volatile environment where I saw my last mini OpenVMS environment now virtually consigned to the near-legacy basket and many other viable engines disappearing from Desktop search that there is another look required at the current computing environment.

I referred this person to Gaviri Search, which I use to examine email, and Effective File Search, which is useful for looking in specific directories. These suggestions sidestepped the larger issue:

There is no fast, easy to use, stable, and helpful way to look for information on a couple of terabytes of local storage. The files are a mixed bag: Excels, PowerPoints, image and text embedded PDFs, proprietary file formats like Framemaker, images, music, etc.

Such this problem was in the old days and such this problem is today. I don’t have a quick and easy fix. But these are single user problems, not an enterprise scale problem.

An hour after I read the email about my column, I received one of those frequent LinkedIn updates. The title of the thread to which LinkedIn wished to call my attention was/is: “What would you guess is behind a drop in query activity?”


I was enticed by the word “guess.” Most assume that the specialist discussion threads on LinkedIn attract the birds with the brightest plumage, not the YouTube commenter crowd.

I navigated to the provided link which may require that you become a member of LinkedIn and then appeal for admission to the colorful feather discussion for “Enterprise Search Professionals.”

The situation is that a company’s enterprise search engine is not being used by its authorized users. There was a shopping list of ideas for generating traffic to the search system. The reason is that the company spent money, invested human resources, and assumed that a new search system would deliver a benefit that the accountants could quantify.

What was fascinating was the response of the LinkedIn enterprise search professionals. The suggestions for improving the enterprise search engine included:

  • Asking for more information about usage? (Interesting but the operative fact is that traffic is low and evident to the expert initiating the thread.)
  • A thought that the user interface and “global navigation” might be an issue.
  • The idea that an “external factor” was the cause of the traffic drop. (Intriguing because I would include the search for a personal search system described in the email about my desktop search column as an “external factor.” The employee looking for a personal search solution was making lone wolf noises to me.)
  • An former English major’s insight that traffic drops when quality declines. I was hoping for a quote from a guy like Aristotle who said, “Quality is not an act, it is a habit.” The expert referenced “social software.”
  • My tongue in cheek suggestion that the search system required search engine optimization. The question sparked sturm und drang about enterprise search as something different from the crass Web site marketing hoopla.
  • A comment about the need for users to understand the vocabulary required to get information from an index of content and “search friendly” pages. (I am not sure what a search friendly page is, however? Is it what an employee creates, an interface, or a canned, training wheels “report”?)

Let’s step back. The email about desktop search and this collection of statements about lack of usage strike me as different sides of the same information access coin.

Read more »


Interview with Dave Hawking Offers Insight into Bing, FunnelBack and Enterprise Search

The article titled To Bing and Beyond on IDM provides an interview with Dave Hawking, an award-winner in the field of information retrieval and currently a Partner Architect for Bing. In the somewhat lengthy interview, Hawking answers questions on his own history, his work at Bing, natural language search, Watson, and Enterprise Search, among other things. At one point he describes how he arrived in the field of information retrieval after studying computer science at the Australian National University, where he the first search engine he encountered was the library’s card catalogue. He says,

“I worked in a number of computer infrastructure support roles at ANU and by 1991 I was in charge of a couple of supercomputers…In order to do a good job of managing a large-scale parallel machine I thought I needed to write a parallel program so I built a kind of parallel grep… I wrote some papers about parallelising text retrieval on supercomputers but I pretty soon decided that text retrieval was more interesting.”

When asked about the challenges of Enterprise Search, Hawking went into detail about the complications that arise due to the “diversity of repositories” as well as issues with access controls. Hawking’s work in search technology can’t be overstated, from his contributions to the Text Retrieval Conferences, CSIRO, FunnelBack in addition to his academic achievements.

Chelsea Kerwin, December 09, 2014

Sponsored by ArnoldIT.com, developer of Augmentext

Latest News

Smartlogic Brand Has Semantic Nibblers Munching Away

http://www.vizualogic.com/smartlogic-product-info I flipped through my Overflight about Smartlogic and noticed that the company has dropped off the radar in terms... Read more »

January 25, 2015 | | Comment

Sinequa Gets a CEO

Short honk: One of the French information access companies is following in the footsteps of Lucid Works (Really?) and Attivio. New blood is, according to the MBA... Read more »

January 25, 2015 | | Comment

Dataiku: Former Exalead Wizard Strikes Big Data Fire

I read “Big Data : Le Français Dataiku Lève 3 millions d’Euros.” The recipient of the cash infusion is Dataiku. Founded by former Exalead wizard Florian... Read more »

January 24, 2015 | | Comment

Unicorns and Search Satyrs

I read with considerable amusement “The Age of Unicorns.” The notion that in the last 12 months or so, we have entered an “age” is pretty darned silly. Toss... Read more »

January 23, 2015 | | Comment

Guide to Getting the Most Out of Your Unstructured Data

The article on Datamation titled Big Data: 9 Steps to Extract Insight Unstructured Data explores the process of analyzing all of the data organizations collect from... Read more »

January 23, 2015 | | Comment

Google X Labs Just Buys a Better Idea

Short honk: X Labs was to be part of the Google innovation push. The idea was “moon shots.” Well, Google came up with balloons, self driving cars, and a linguistic... Read more »

January 23, 2015 | | Comment

Are You Pedantic Enough to Work for Google?

A joke quiz on Clickhole titled Are You Smart Enough to Work For Google poses a series of questions that range from the philosophical to the absurd. Google has become... Read more »

January 23, 2015 | | Comment

IBM: Why Did Watson Fail to Generate Billions?

I read a number of IBM earnings-related articles. None of the ones I examined addressed the question in my mind: Why didn’t Watson, the smart search system, generate... Read more »

January 22, 2015 | | Comment

How to Sustain a Book Habit without Going Broke

The article on Lifehacker titled The Best Places to Find Books at a Bargain (or For Free) offers tips for bookworms to get their hands on hard copy and ebooks alike.... Read more »

January 22, 2015 | | Comment

Looking Beyond SharePoint

SharePoint owns a lion’s share of the enterprise market. While it is largely undisputed, there are products out there that seek to make a name within the marketplace.... Read more »

January 22, 2015 | | 1 Comment