Boomers and Millennials: Implications for Enterprise Search
June 20, 2008
Enterprise Search and the Age Gap
Employees, contractors, and consultants are becoming younger. For enterprise search, aging boomers are leaving the work force and younger employees moving in.
En route from San Francisco to the less civilized environs of rural Kentucky, I made a list of the differences between Millennials and Baby Boomers. Millennials are all digital all the time. Baby Boomers have luggage stuffed with printed books, paper calendars, and blank notebooks in which one letter at a time can be written using a pencil. For simplicity, I will call the Millennials the younger workers, and the Baby Boomers the aging dinosaurs. Keep in mind that you may be 25 and as mired in books and microfilm as an ossified Baby Boomer. The categories are not absolute. The two part division is intended to make it easy for me to communicate my thoughts about the changes wrought upon search as as Baby Boomers become the minority in organizations and Millennials become the majority.
I want to alert you that any one under the age of 35 will probably be annoyed at my thoughts. But this is a Web log, and I am going to capture these notions before I pass out from the brutalities of a red-eye flight seated next to the lavatory. In short, another red eye, another Web log essay about enterprise search from a different angle.
The generational differences mark a clean break with key word search and retrieval systems of the past and point to more sophisticated and complex information access solutions more youthful enterprise system users require.
Seven Differences between a Young Professional and a Near Retirement Professional
Difference 1: Under 35s don’t read anything long. I have the impression that the under 35 enterprise search user wants short, chunky information from search systems. Systems that return long documents that have to be printed out, annotated, and studies are not what users of search systems want from their information access systems. Over 55s (yes, I am generalizing) may not like long documents, but I for one will slog through this stuff. There may be gold in those hills, I think.
Difference 2: Under 35s want to have search suggestions, assisted navigation, Use For references, and See Also hints. Over 55s like me don’t have much resistance to formulating a query, scanning results, reformulating the query, scanning results, and finally narrowing the result set to a useful collection of documents which can then one-by-one be reviewed. I love shortcuts, but research is research.
Difference 3: Under 35s seem to have the uncanny ability to do several electronic tasks at once. At the Gilbane conference I watched as professional journalists listened to a speaker, sent messages on a BlackBerry, and chatted with the person sitting next to her. I am lucky if I can listen to the speaker; forget the digital activity. Over 55s are less adept multi taskers. The reason the BART train was speeding and crashed into a stopped train appears to have been a young train driver who was chatting on a mobile and controlling the subway train. I prefer single task focus to avoid collisions.
Another Google Should: Buy the Associated Press
June 20, 2008
I enjoy “Google should” essays. Google has money, technology, the number one global band, and the ability to move like a ninja. Wired’s Web log carries Betsy Schiffman’s interesting essay “Forget the New York Times: Google Should Buy The AP”. You can read it here.
The idea is one way for the Associated Press to jump from the tracks and avoid the same fate as a coin placed on the railroad tracks so the wheels can flatten it. Playing on train tracks is fun; letting the wheels of the locomotive rework a penny is a sudden transformation.
The most interesting point in her essay for me is this statement: “The flip side of the equation is that web companies are picking up where the newspapers left off.”
That nails it.
The implications for enterprise search are significant. More and more organizations want to create a Folger’s blend for their Intranet or behind the firewall search users. For fee content has been available to organizations for many years. Now, why bother? Even the high value information such as financial data are becoming more findable. Stock traders need their fancy Bloomberg terminals and Reuters data. But for a snapshot of a competitor Google Finance works well for me. (Yahoo, I fear may be slipping off my radar due to organic issues at that company.)
In June 2007 I made the suggestion that the Associated Press should find a way to “surf on Google”. Perhaps the tie up between Google and AP should become more formal, as Ms. Schiffman suggests. She’s on the right insight vibe as I. The Google is more than Web search and advertising. I am more convinced than ever that my describing the company as a “supranational corporation” is an understatement. The GOOD is our own informational revolution. Instead of sitting in the Black Country in England we are in Data Country. News is one piece of raw material in this new world.
Stephen Arnold, June 20, 2008
Forbes on Powerset
June 19, 2008
Forbes Magazine has an interesting article about Powerset, Chris Taylor’s “The Next Search Frontier: Just Ask Your Question“. I often have difficulty locating information on the Forbes’ Web site. Sometimes I grow frustrated with the pop up ads and page latency, so snag this article quickly.)
The key point in the article for me was this statement:
Powerset’s main asset is a partnership with PARC, the Palo Alto research center that incubated the computer mouse and the laser printer. In 2005, Pell discovered that PARC researchers had been working for 30 years on turning English into software code. Pell promptly licensed PARC’s research and hired the top scientists in the field, starting with Powerset co-founder Lorenzo Thione.
Xerox PARC (now simply PARC — it’s officially a subsidiary company of Xerox) has been an innovator for many years. But my experience has been that some of its better ideas are difficult to commercialize and convert into major revenue winners. Inxight Software, a PARC spin out, gained some market success and was acquired by Business Objects, which in turn was acquired by SAP. Powerset’s tie up with PARC will be another opportunity to convert ideas into revenue.
You can test drive Powerset here. Information about PARC is here.
I am accustomed to formulating queries with Boolean ANDs and NOTs. Typing questions is too much work for me. With the average query creeping up to 2.3 words on major public search engines, the idea that a well formed question will revolutionize search seems unlikely.
Natural language processing, like semantic and linguistics mechanisms, may be best suited for work behind the scenes, not in front of the user.
Stephen Arnold, June 19, 2008
Google’s Udi Manber on Search Quality
June 18, 2008
The Googlers were out in force, chipper and explaining, to the 150 or so attendees of the Gilbane Group’s annual content management conference.
The key reason that drives Google forward, asserted Dr. Manber, is that users have rising expectations. Google, therefore, must use smart software, innovate, and scale. In 2007, Google tweaked its PageRank algorithm more than 450 times. Google works to keep bureaucracy at a minimum, empowering engineers to make necessary changes.
PageRank changes are not based on hunches. Extensive data analysis underlies tweaks.
The 21st century, asserted Dr. Manber, is about understanding people; that is, social interactions. Starting points for analysis are user intent. Queries are diverse like “hairstyles for ears that stick out” or “i’m going to win the lottery”.
Like other search systems, Google looks terms up in its index. Then Google uses other functions in order to determine intent; for example, time, place, context, and user information from “individualized Google,” if available.
You can see this in action. Run the queries “GM cars” then “GM food”. Google returns different results for each query even though the acronym GM appears in each query.
User expectations are now growing quickly. Google, therefore, must innovate and continue to scale.
Some development features were referenced, but these were not active in “regular” Google when I ran these sample queries. The presentation was well received and triggered a flurry of questions about site search and universal or federated search. Attendees applauded enthusiastically. The Googley magic was working today.
Stephen Arnold, June 18, 2008
The LinkedIn Bet: $1 Billion Social Valuation
June 18, 2008
The chatter about the Linked In valuation of $1 billion is choking my trusty RSS readers. The voice that reached me was Om Malik’s comments here. The essay is “Is LinkedIn worth $1 Billion.” Mr. Malik makes two points that warrant highlighting in the midst of the cacophony:
- The notion that smart money has picked a winner may be suspect.
- The per subscriber valuation is generous.
Mr. Malik nails this financial optimism as out of step with the company’s performance.
There are three other factors that Mr. Malik’s must-read essay surfaced in my mind:
- Social networks can be gamed. My experience with Linked In suggests that the controls on abuse are not as fine-grained as they should be
- The layers of fees are annoying to me, and I suspect that others will find that invitations often carry along obligations I don’t want
- In a deteriorating economy, referrals are indeed important. However, LinkedIn often wobbles into probes for intelligence in the form of questions from people whom I don’t know and marketing in the form of thinly disguised marketing pitches.
These three factors when combined with Mr. Malik’s analysis suggest an optimistic valuation. “Social” is hot. I am not convinced that today’s flag carriers will be tomorrow’s winners.
Stephen Arnold, June 17, 2008
Gilbane Chats Up a Silly Goose: The Arnold Interview
June 18, 2008
On Wednesday, June 18, 2008, I will be interviewed in front of an audience completely unaware of why a fellow from Harrod’s Creek, Kentucky, is sitting on a stage answering questions. No one is more baffled than I. Based on my knowledge of the big city, I anticipate confusion, torpor, and indifference to my comments.
In this essay, which will become available on June 18, 2008, the curious will have a reference document that summarizes my thoughts on issues about which I may be asked. There has been no dry run for this interview. The last one in which I participated–the Associated Press’s invitation-only gathering last year–left the audience with little appetite for food. Some found the beverage table a more welcome destination.
Anticipated Question 1: What’s “beyond search” mean?
In research conducted by me and others, about two-thirds of the users of an enterprise search system are dissatisfied with that system. “Beyond search” implies that we have to move to another approach because what is now available in organizations with which I and the other researchers have investigated is not well liked. Due to the cost of some systems, annoying two-thirds of the users is tantamount to getting a D or an F on a report card.
Anticipated Question 2: What’s “behind the firewall search” mean?
I wrote about the search elephant here. Many different functions involving information access are made available to an employee, contractor, or authorized user. The idea is that “behind the firewall search” is not public and made available by an organization to a select group of users. The “search elephant” refers to the many different ways in which search is understood and perceived within an organization.
Anticipated Question 3: Why are there so many search vendors and more coming each day?
There is a belief that existing systems are not tapping into what I have estimated to be a $2.5 billion market for information access in the enterprise. Entrepreneurs and people with money look at Google and think, “We should be able to make gains like that in the enterprise market.” I also think that the market itself is trying to figure out the search elephant. Buyers don’t know what is needed. When entrepreneurs, money, and confused customers with severe information access problems come together, we have the type of market place that exists today.
Anticipated Question 4: What about Microsoft and Fast Search & Transfer?
I understand that it is business as usual at Microsoft and Fast Search. For Microsoft, this means trying to get 10,000 motorboats to go in roughly the same direction. For Fast Search, the company continues to license its Enterprise Search Platform and service customers. There are many bits of grit in the working parts where Microsoft and Fast Search mesh. It is too soon to tell if these inhibitors are trivial or whether the machine will sputter, maybe stop. What I tell people is to ignore the Microsoft-Fast Search tie up, and get a solution for a SharePoint environment that works. There are good choices ranging from a lower cost solution like dtSearch to a competitively priced system from Coveo, Exalead, ISYS Search Software, or another Microsoft Certified vendor.
Anticipated Question 5: What’s the impact of the Google Search Appliance?
Many vendors will tell you that Google has delivered a second-class system. That’s not exactly true. With the OneBox API, Google has a very solid solution. The impact is that Google has about 10,000 enterprise customers. These are sales made, in many cases, under the noses of incumbent vendors. Google’s a player in the enterprise market and a serious one. I have uncovered one impactful bit of research at Google that could–note, I said, could–change the search landscape. I have tried to ask Google about this development, but the GOOG thinks I am do not merit their attention. Too bad for me, I guess.
Anticipated Question 6: What’s the impact of text processing, semantic search, and other new technologies on enterprise search?
These are hot terms that will open doors. Some vendors will make sales because of their ability to mesh trendy concepts with more traditional search.
Stephen Arnold, June 18, 2008
Mark Logic: Content Applications Fuel Company’s Growth
June 17, 2008
Mark Logic provides information access and delivery solutions that accelerate the creation of content applications. Customers across a range of industries rely on Mark Logic to repurpose content and deliver that information through channels. Some vendors describe this suite of functions as an enterprise publishing system.
The company has been growing at a furious pace. Dave Kellogg, former Business Objects’ executive, said:
Mark Logic… is a database management system built to natively manage XML documents and optimized for handling vast numbers of them (I mean hundreds of terabytes) with high performance. It’s a read/write system. It has a query language (XQuery). It has transactions and logging. You can use it, by itself–without the need to bolt it on to either a relational database or an application server–as the basis for content applications.
The company’s customers include Oxford University Press, O’Reilly Media, and the Congressional Quarterly. The company builds relationships with its customers. Mr. Kellogg says, “Our philosophy is to sell sell solutions to problems and avoid the stereotypical “drive-by” technology sale, where companies dump the software in the parking lot and leave.”
The full interview appears as part of the Search Wizards Speak series published by ArnoldIT.com. You can read the transcript of the interview with Mr. Kellogg here. The index to the full series of interviews is here.
Stephen Arnold, June 17, 2008
Google: From the Disruptor to the Disrupted
June 17, 2008
I am a fan of ReadWriteWeb, and I found the essay by Bernard Lunn quite interesting. Mr. Lunn has identified the “11 Search Trends that May Disrupt Google.” ReadWriteWeb.com makes it easy to locate its articles, so you can track this story down easily.
I found the list of factors that may be moving Google into a different role: from disruptor to a company that is itself disrupted. On the whole, I agree with the ReadWriteWeb analysis. Of particular importance is the notion of “start ups using a new outsourced infrastructure.” Powerset is an example of a company taking a different approach. I have heard that Powerset makes use of Amazon Web Services, and I think this is an important aspect of the company to monitor if my information is accurate.
The other point that I found on target is the impact tagging may have upon Google. Not long ago Vivisimo announced that its system made it possible for a user to add a tag–that is, index term–to an item in a result list. Tagging is becoming one of the everyday activities for those who write Web logs. The Semantic Web has been slow in coming, but I think the “social tagging” function may be providing some opportunities that search engines, including Google, have yet to exploit fully.
I would add one other point to the factors that are likely to influence Google–the challenge of size. Google is now 10 years old, and it is getting big enough to encounter the friction that plagues any large organization. Google, therefore, changes more slowly even though certain innovations make users gasp. A competitor can exploit Google’s own inertia but that competitor must take care to stay clear of Google’s momentum.
A happy quack for a useful and thought provoking write up, ReadWriteWeb!
Stephen Arnold, June 17, 2008
Microsoft’s Web Search Strategy Revealed: The Scoble Goldberg Interview
June 16, 2008
Online video does not match my mode of learning. Robert Scoble, a laurel leaf wwearerin the new world of video and text Web logs, conducted an interview with Brad Goldberg.
The interview is part of the Fast Company videos, and it is available here. The interview is remarkable, and I urge you to spend 31 minutes and listen to Brad Goldberg, General Manager of Microsoft Search Business Group.
The interview reveals useful information about the time line for Microsoft to capture market share fro9m Google and Microsoft’s ideas for differentiating itself from Google in Web search.
Surprisingly, there were no references that I could pick up to enterprise search, nor was there any indication that Mr. Goldberg was aware of the Fast Search & Transfer Web search technology which was quite good. As you may know, Fast Search withdrew from Web search in 2003, selling its AllTheWeb.com Web index to Overture. Yahoo gobbled Overture and used bits and pieces of the Fast Search technology recently. The “auto suggest” feature is still available from Yahoo’s AllTheWeb.com site. My tests suggest that today’s AllTheWeb.com uses the Yahoo Search index built by the Slurp crawler and the Fast Search technology for some of the bells and whistles on the site. The news search function is actually quite useful. If you are not familiar with it, you can try it here.
During the interview, Mr. Goldberg uses some sample queries to illustrate his claims about Live.com’s search performance, precision, and recall. I ran the “Paris” query on each of these systems, and I ran comparative queries on this Web log as well. After the interview, I took a look at the 2005 analysis of mainstream Web search systems here so I could gauge how much change has taken place in the last three years. Quick impression: Not much. You may want to perform similar as-you-listen tests. It is easy to see what search system responds most quickly, how the search results differ, and the features that each system makes available.
Three points in Mr. Goldberg’s remarks stuck in my mind. I want to mention each of these and then offer a few observations. Judging from the edgy comments to some my essays, I want you to know that you may not agree with me. That’s okay with me. Please, use the comments section to set me straight. Providing some facts to go along with your push back is helpful to me.
Key Points for Me
1. Parity or Microsoft’s Relevancy Is As Good as Google’s
Mr. Goldberg asserted that the major search services were at parity in terms of relevance and coverage. I found this notion somewhat difficult to comprehend. The data about Web search market share undermines any argument about parity which means, according to my understanding of the word “equality” or “equivalence”. I have had difficulty interpreting comments by whiz kids before, so I may be off base. My thought was that Google continues to gain market share at the expense of both Microsoft and Yahoo. The dis-parity is significant because Google, according to data mavens, accounts for 60 percent of more of user queries in the US. In Europe, the market share is higher. US search systems do not hold commanding leads in China, Korea, and other Eastern markets.
Should parity mean visual appearance, yes, Microsoft is looking more like Google. Here is the result of one of my test queries: “real estate baltimore maryland”.
 |
 |
On the surface these look alike. Closer inspection reveals that Google includes a canned form so I can narrow my result by location and property type. Google eliminates a step in looking for real estate in Baltimore. Microsoft’s result does not offer this feature, preferring to show “related searches”. I like the Google approach. I don’t make much use of machine-generated related queries. I have specialized tools to discern relationships in result sets.
Google Customers, Actually Superstar Customers
June 15, 2008
Google is a secretive outfit, despite the river of information about various doings at the Googplex in Mountain View, California. If you want to know who some of Google’s enterprise customers are, you can find six of them with profiles here. I assume the notion of a “superstar” is different from being a real live Googler, but the designation is interesting as is the first name familiarity. These superstars may warrant a contact at Google who takes their calls and answers their emails. Grab the names and profiles before the range information drifts away. The enterprise applications range from federated search to collaboration.
Stephen Arnold, June 15, 2008
-
- Subscribe to Beyond Search
Feature archive
News archive
-
