Compete Data Tweak the Google
April 8, 2008
LiveSide.net provided a summary and helpful chart on April 4, 2008. The article’s sub title states, “New Compete.com search share numbers show surprising surge for Live Search.” The use of the word surge caught my attention. At age 64, surge to me has an old school meaning; namely, “a strong, wavelike, forward movement, rush, or sweep.” I read the article and looked at the Compete.com numbers and concluded that a post-modern meaning has been applied to surge.
The LiveSide.net article’s main point to me is:
Compete.com released their version of March US search market share numbers …, showing a surprising surge for Live Search, up nearly four percentage points from February (a notoriously slow, and short, month), and up 0.7% year over year. In addition, search volume (the number of searches performed) was up significantly as well. Also notable was that for the first time in nine months, Google lost market share.
Hmmm. I wondered about the surge. The table provides some clues here. I took these data and calculated the number of searches per minute by each service. Based on the Compete.com data, Google is averaging 2,346 queries per second. The surge notion is that Microsoft’s queries per second are 344 per minute, a difference of a few clicks, about 2,000.
The surge is more about percent change that clicks. Live.com, according to Compete.com, tallied 922 million in March 2007 searches up from 716 million in February 2007. Google, by contrast, generated about 6.3 billion searches in March 2008, up from 6.0 billion in February 2008. Not only is Microsoft’s base smaller than Google’s, the search differential is growing.
Perhaps I am misreading these data. Let me know if you think the gap is closing and the sky is falling in Google’s part of the world.
Note: Hitwise released numbers of its own recently; that consultancy says Google has a 64% marketshare in US searches for March, with MSN Search back at 5.25%.
The Google has a hefty lead, and it will take some time to bridge the gap.
Stephen Arnold, April 8, 2008
Time: Your Search Infrastructure’s Deadliest Enemy
April 8, 2008
Look at these two diagrams.
The first diagram–the one with a single red arrow–represents the volume of content your search and content processing system must process. Unless you work in a very unusual organization, you and your colleagues produce digital information. Let’s confine our discussion to text, but keep in mind that your organization will also produce digital images, audio, and video. At some point your search or content processing system will have to deal with these types of content as well.
The story in the chart with the single error is simple: each day the amount of content increases. The content is very distinct, and it falls into one of three broad categories. Some content is original; that is, there is no previous version or draft. You or one of your colleagues generates an original document and stores it on her computer. If your colleague is a tele worker, she might upload the document to your company’s server.
Gilbane Group Publishes Beyond Search
April 7, 2008
An important 270-page study about fixing enterprise search systems that don’t work…
The Gilbane Group published Beyond Search: What to Do When Your Enterprise Search System Doesn’t Work. The study includes more than 13 common problems and suggestions for fixing them. In addition, the study contains profiles of 24 vendors with next-generation search and content processing systems.
Mr. Arnold said, “I’ve made an effort to present the information in a simple, direct way. I’ve avoided jargon, and organized the information so a person with a search problem can find the answer fast. The vendor profiles contain no fluff. No vendor has paid to be included in this study. Readers get what my analysis of the system discovered. Facts, not fluff.”
More information about the study is available on the ArnoldIT.com Web site. The publisher’s information page and order form are available at the Gilbane Group’s Web site.
Stuart Schram IV, April 7, 2008
Beyond Search Published by the Gilbane Group
April 7, 2008
Stephen E. Arnold’s newest search and content processing study is now available for purchase. Beyond Search: What to Do When Your Enterprise Search System Doesn’t Work is an electronic book in Adobe PDF format. is available for purchase and immediate download.
This study contains a discussion of how-to’s, so you can fix your broken enterprise search system. You will also find a detailed discussion of today’s market for search and content processing systems, profiles of 24 vendors (many from outside the U.S.), and a plain-talk glossary that cuts through the verbal fog characterizing much of the analysis of search and content processing.
Enterprise Search–A Problem Reaching Its Boiling Point
Mr. Arnold, author of the first three editions of the Enterprise Search Report and the 2007 monograph Google Version 2.0, reveals actionable information about remediating “broken” enterprise search systems. He said, “Most vendors and IT professionals won’t talk openly about their users’ satisfaction with the incumbent search-and-retrieval system. The reason is that as many as two-thirds of a system’s users are dissatisfied with that system.”
Thunderstone’s John Turnbull Interviewed
April 7, 2008
John Turnbull, dhief executive of Thunderstone Software LLC, said, “People are quite surprised to learn that Thunderstone pioneeded concept-based searching, real-time searching, and simultaneous search of both structured and unstructured data in the 1980s.”
Thunderstone, based in Cleveland, Ohio, offers a full range of search and retrieval systems for entrprise (behind-the-firewall), Web, and Web site search. The company’s flagship system is Texis. He said in an interviewed with ArnoldIT.com:
Texis is our high-powered search platform that licensees can employ to build complex search applications. Texis offers NLP [natural language search], parametric search, and the ability to index non-text objects like video. Texis has application programming interfaces. Our customers embed, integrate, and customize Texis into many different enterprise applications. These range from BI [business intelligence] to litigation support.
The company has introduced a parametric search appliance that delivers significant performance gains over competing products such as Google’s Search Appliance. Describing the use of his company’s ready-to-run solution, he said:
… Let’s say an employee needs to search for a particular product-item description across the entire enterprise. Keyword, full-text search will certainly provide a good list of results from a variety of documents and content sources. But what if you were only interested in the item’s occurrence within a specific document type (say, a purchase order), and one that was issued after a certain date and by a specific purchasing agent? Keyword, full-text search simply cannot provide this context for the information you’re pursuing.
He added:
I think there’s a growing realization that there are many reasons for search, and that the most appropriate results will depend on what the user is doing at that time. This includes explicit search, where the user asks a question, and implicit search where results are available based on what the user is doing, as well as if the user is asking for specific information, trying to retrieve a specific document, looking for background information or something else.
You can read the complete interview on the ArnoldIT.com Web site in its exclusive “Search Wizards Speak” feature. Additional information about Thunderstone Texis and its other products may be found on the Thunderstone Web site.
Stephen Arnold, April 7, 2008
Stratify Acquired by Iron Mountain
April 6, 2008
Late in 2007, Iron Mountain acquired Stratify (formerly Purple Yogi). With the wave of acquisitions building in the search and content processing sector, Stratify is out of play.
In 1999, Purple Yogi was one of the first companies to discover meaning and generate rich indexing from documents. After an infusion of investment, Purple Yogi repositioned itself as Stratify and offered “intelligence at a glance”. By 2005, Stratify was finding success in the legal market, one of the hottest niches for search and content processing vendors. Litigation generates massive amounts of content, and law firms have shown greater willingness to invest in technology.
The Iron Mountain deal for the privately held Stratify was valued in the $160 million range, and Stratify’s knowledge based system and need for human interaction with the system add to Iron Mountain’s arsenal of storage and content services. More information about Stratify appears at www.stratify.com.
Stephen Arnold, April 6, 2008
Niche-ization: A New Source of Revenue Oxygen
April 6, 2008
A One-Minute, One-Act Comedy
Mise en scène. An industrial wasteland in Silicon Valley or a new Euro building in Stockholm.
Set up: a conference room. Nothing flashy. No windows. Plugs and Ethernet cables in a jumble under the table. So-so lighting. A screen. A projector. A plug seeking a video connection. The whisper of air conditioning.
The money folks: 30 to 50 year old guys, casual lux, recently groomed hair and nails, movie star smiles. Testosterone. Mucho testosterone.
The techno-serfs: 20 to 30 year old engineers. Mostly thin. Laptops. Dark clothes. A few hippie-dippie hair doos. Earnest. Serious and very earnest. Less testosterone.
The agenda: Generating revenue.
The testosterone-energized VC speaks,
Money person 1: “Hey, guys, let’s get started. The agenda today is pretty simple. Let me give you some back ground and then let’s dive right in?”
Money person 2: “Right. Right?”
Techno-serfs in unison: “Okay. Sounds good.”
Money person 3: “Let me do the background, guys. We put in $1.2 million over the last three months. You guys pulled out $400K a month. That sound right.”
Serf 1: “I think we are running under that figure. Maybe we’re at $185K this month and will use the rest for payroll next week.”
Money person 3: “Like I said, You have burned $1.2 million.”
Money person 1: “May I ask a question?”
Everyone in unison: “Sure”.
Money person 1: “What are you guys going to do to generate some revenue?”
Money person 2: “Let me rephrase that, ‘How are we doing relative to the plan?”
Money person 3: “Screw the plan. What are you guys going to do to make some sales. Generate revenue.”
Serf 2: “We’re in beta.
Serf 3: “We have some great leads.”
Serf 1: “The competition sucks, man.”
Money person 2: “Forget leads. Produce revenue or we’re cutting off your oxygen.”
Money person 3: “Let’s take a bio break, shall we?”
Curtain falls. House lights up.
Discussion of this Aeshylean Tragedy
Has this happened to you? If not, you’re lucky. If it has, you know what this means. The start up–what I have called the “serfs”–has not made any sales. The friendly venture capitalists–what I have called the “money person”–have shed their fraternity rush warmth. Beneath that cheerful Norman Vincent Peale veneer is the real VC illustrated below:
BigTable or BigFable?
April 5, 2008
From the “Possible Department”–TechCrunch reported on April 4, 2008, that Google may be poised to release a BigTable service. Mark Hendrickson wrote:
Google may be releasing BigTable, its internal database system, as a web service to compete with Amazon SimpleDB, according to a source with knowledge of the launch. There are also rumors that press is being pre-briefed on the product, although we [TechCrunchers] haven’t been contacted by Google.
If true, Amazon’s various Web services may face some competition. Google has cloud-based technology that Amazon has been able to roll out unchallenged. The BigTable technology is discussed in some detail in The Google Legacy (Infonortics, 2005) and the Google Version 2.0 (Infornortics, 2007).
Amazon’s Web services have been funded from a relatively modest information technology budget. Some service glitches underscore that Amazon’s engineering might need more investment. Google, on the other hand, has funneled billions into its research and engineering. Significant portions of that investment has made it possible for Google to address certain technical methods in interesting new ways.
Whether true or false, the TechCrunch article fires a shot across the Bezos bow. The Google may be aiming its fleet of data centers at the world’s biggest bookstore. Stay tuned. The Beyond Search goose will be monitoring this rumor channel.
Stephen Arnold, April 5, 2008
Solving the Yahoo Search Puzzle… Sort of
April 5, 2008
Yahoo–the stage-managed ingenue staying out of Mr. Microsoft’s sweaty grasp–has one foot in the Web search camp and one in the enterprise search camp. The problem is finding the software to download. After some clicking and scanning, I think I figured out where to get the software after a colleague asked me, “Where is this IBM Yahoo program?”
If you want to get a copy of IBM Omnifind Yahoo! Edition, navigate to IBM’s Web site here. To learn what you can and can’t do with the free system, start with this explanation by Todd Leyba here.
Be aware that if you search for “Yahoo desktop search”, you will get links that point to the X1 Yahoo desktop search system. You can download that product here.
I still don’t have a good grasp of Yahoo’s many “faces of search”. I was able to locate these IBM and Yahoo products using Google. Neither the IBM Web site search nor the “improved” Yahoo search were of much help to me. Keep in mind that these “free” products have some constraints if you want to push them beyond their performance envelope.
Stephen Arnold, April 5, 2008
The Disappearing Middle: Liposuction for High-Profile Search Vendors
April 5, 2008
Last week I received a telephone call from a perky MBA working at a European investment bank. The caller exuded confidence about one of the major publicly traded vendors of enterprise search. She wanted to know if I as a contrarian would speak with her.
No problem. I enjoy being contrary–especially to perky young MBAs with exotic accent-tinged English.
I spoke with her. She was confident about her belief that a share price surge for one company was imminent or “coming round the mountain” as we say in Kentucky.
I gave her my opinion that her stallion was a donkey. Her favored company (which shall remain unidentified) had a poor track record in the money and technology races. Furthermore, no company–including her dark horse–was not going to change its performance record quickly, if at all. She thanked me and disconnected without so much as a “merci” with the cute ascending note native speakers add.
Now it’s two days after this call. I am trapped on an Air Canada flight. The seat back video flickers to life, and I see a documentary about weight loss. The hero (not a sandwich) weighed about 450 pounds. After months of effort, the hero ette was a mere slice of the person’s former self, weighing a lean, mean 200 pounds. Amazing what chemicals can do, I thought. I could see that the blubber around the middle was gone. I killed the annoying LCD and looked out at the frozen wasteland that makes northern Canada the inviting clime it is.