YAGG Plagues Google Gmail

May 9, 2009

Short honk: The BBC reported here that Gmail suffered an outage’. You can read the May 8, 2009 story here. The Beeb’s headline tells the tale’ “Google Email Service Back Up After GFail.” For other Google glitches search this Web log for YAGG, yet another Google glitch.

Stephen Arnold, May 9, 2009

New Media, Old Media Spoofed

May 7, 2009

The story “Student’s Wikipedia Hoax Quote Used Worldwide in Newspaper Obituaries” here underscored for me the precarious nature of “information” in today’s world. The Irish Times reported that a fake quote in Wikipedia popped up in newspapers around the world. New media and old media both fell into the comfortable assumption that if it is online, information is correct, accurate, true, and well-formed.

At a conference yesterday, I spoke with a group of information professionals. The subject was the complexity of information. One of the people in the group said, “Most of the technical information goes right over my head. At work, people turn to me for answers.”

I don’t want to dip into epistemological waters. I can observe that the rising amount of digital information (right or wrong is irrelevant) poses some major challenges to individuals and organizations. The push for cost reduction fosters an environment suitable for short cuts.

Last Sunday, one of my publishers (Harry Collier, managing director, Infonortics Ltd.) and I were talking about the change in how large news organizations operated. He had worked from book and newspaper publishers earlier in his career as i had. He noted that the days of investigative reporting seem to have passed.

I had to agree. The advent of online has made research something that takes place within the cheerful confines of the Web browser. Interviews I once conducted face to face, now take place via email. Even the telephone has fallen from favor because it is difficult to catch a person when he or she is not busy.

A number of companies involved in content processing are experimenting with systems that can provide some clues to the “provenance” or “sentiment” of information. The idea is that tireless software can provide some guideposts one can use to determine if a statement is right or wrong, hot or cold, or some similar soft characteristic.

The quote story from the Irish Times highlights the pervasiveness of online short cuts. In this case, the quote is unlikely to do much lasting harm. Can the same be said of other information short cuts that are taken each day? Will one of these short cuts trigger a chain of unexpected events? Will the work processes that encourage short cuts create ever more chaotic information systems that act like a brake on performance? Who is spoofing whom? Maybe ourselves?

Stephen Arnold, June 8, 2009

Twitter Pumps Search

May 7, 2009

Newsfactor here and other Web news services posted stories about Twitter getting a dose of search steroids. You will want to read “Not-for-Sale Twitter Is Expanding Search Functionality” by Patricia Resende to get the details. Ms. Resende wrote:

Twitter Search will be used to crawl information from links by Twitters to analyze and then index the content for future use, Jayaram, a former vice president for search quality at Google, told Webware. Currently Twitter Search is only used to search words included in tweets, but not words in links. Along with its new crawling functionality, Twitter Search will also get a ranking system. When users do a search on trending topics — the top-10 topics people tweet about, which get their own link on the Twitter sidebar — Twitter will analyze the reputation of the tweet writer and rank search results partially based on that.

To me, I think this scoring will be an important step. Here’s why:

  1. Clickstream metrics by individuals about topics, links, and words provide important clues to smart software
  2. Individuals with large numbers of followers provide “stakes in the sand” for making some type of subjective, value-centric calculation; for example, a person with more followers can be interpreted as an “authority”
  3. Individuals who post large number of results and have followers and topics add additional scoring dimensions for calculating “reputation” and other squishy notions.

A number of commercial content processing companies are in the “reputation” and subjective scoring game, but Twitter is a free (for now) real time service with a large volume of posts. The combination makes Twitter a potential dark horse in the reputation analysis game. Believe me. That game has some high stakes. Nonsense about waiting in line at a restaurant becomes high value data when one can identify high score folks standing in line multiple times per week. You don’t have to be a rocket scientist to figure out that the restaurant is doing something right. The score may not be a Zagat type report, but it works pretty well for making certain types of marketing scans useful.

Twitter on steroids plus real time search. More than teen craziness I assert.

Stephen Arnold, May 8, 2009

Google and Publishing: Some Metrics

May 7, 2009

The Guardian reported some metrics about Google and publishing. You will find the summary of a Googler’s speech at a publishing conference here. The article is “Google: We Give Publishers £3.3bn”. Highlights from the news story include:

  • A quote attributed to Googler Matt Brittin, “We want to help publishers make money online”
  • Google sends a billion clicks to publishers each month
  • Google wants to “work with publishers to improve their digital revenues and help close the gap between print and online advertising returns”.

For me, the most interesting comment in the article was this passage:

He [Matt Brittin, Googler] said publishers should look to use technology to help their digital publications move at a greater pace and keep up with consumer demand, but that while it could help, Google could not offer all the necessary solutions.

The challenge that I see is that publishers think about technology in terms of putting color pictures in newspapers and slashing costs. Technology as the term is used by Googlers may a more sophisticated approach.

I don’t think the audience was able to see a path through the swamp. I wonder if any of those Google billions were jingling in the pockets of the attendees?

Stephen Arnold, June 7, 2009

Alternatives to Google Web Search

May 7, 2009

Abhijeet Mukherjee wrote “Ditch Google For A Day: 10 Amazing Search Engines to Try Out” here. This article provides a list of search engines that may be useful. The premised of the essay is to assert that a reader may want to set Google aside for a day or two and use these systems. I don’t want to reproduce the list. Please, visit the original write up. I would like to mention three of the systems and offer a brief comment.

First, Docjax is a metasearch system. I have noticed that Google’s coverage of PowerPoint files has been changing over the last year. There are fewer PowerPoints available and Google does not do a particularly stellar job of indexing the contents of presentations on services such as Scribd. Docjax may be useful to you. I find it helpful for certain queries.

Second, Yahoo Glue is one of those Yahoo search experiments that deliver some useful search features. I used Mindset, now removed from the Yahoo Labs’s site, for certain types of technical queries. I don’t like Yahoo Glue as well, but you may find that Yahoo is more useful with the Glue service. When I first saw Glue, I thought it was a variation on Google’s universal search.

Third, Freshbargains is a useful bargain search engine. I would classify this as a vertical search system. Some results are spot on, others less useful. Worth a shot when looking for deals.

In my opinion, none of these is a leap frog service, and I don’t any of these systems can scale like Google for a couple of reasons. First, the cost would be high and the economy is not too good in my view. Second, Google has a magnetic brand. Trucks of ad dollars would be needed to catch user’s attention.

Marginally better won’t close the gap between these systems’ market share and Google’s. That 10 year lead looks more formidable each day.

Stephen Arnold, May 8, 2009

Visualization: Interesting and Mostly Misleading

May 7, 2009

i fund the EVvie award for excellence in search system analysis. This year’s number two winner was Martin Baumgartel for his paper “Advanced Visualization of Search Results: More Risks, or More Chances?”. You can read the full text here and a brief interview with him here. You will want to read Mr. Baumgartel’s paper and then the Fast Company article called “Is Information Visualization the Next Frontier for Design?” here by Michael Cannell.

These two write ups point out the difference between a researcher’s approach to the role of visualization and a journalist’s approach to the subject. In a nutshell, visualization works in certain situations. In most information retrieval applications, visualization is not a benefit.

The Fast Company approach hits on the eye candy value of visualization. The title wisely references design. Visualization as illustration can enhance a page of text. Visualization as an aid to information analysis may not deliver the value desired.

Which side of the fence is right for your search system? Selective use of visualization or eye candy? The addled goose favors selectivity. Most visualizations of data distract me, but your response may be different. Functionality, not arts and crafts, appeal to the addled goose.

Stephen Arnold, May 7, 2009

Microsoft and the Twitter Imperative

May 7, 2009

I found Nicholas Carlson’s “Microsoft Must Buy Twitter” here an interesting analysis. My thought was that deal makers would have a day at the State Fair if Apple, Google, and Microsoft began a bidding war over Twitter.com. Mr. Carlson offers five reasons why Microsoft has a Twitter imperative. I can’t reproduce the five points here, but I can comment on two of them and invite you to navigate to Mr. Carlson’s article to get the full story.

Mr. Carlson suggests that Microsoft can’t make its dream of attending Google’s funeral a reality with Yahoo as its principal weapon. Microsoft needs the T bomb; that is, the Twitter user base, buzz, and monetization opportunity. I find the idea intriguing, but Microsoft has not made any progress in closing the gap between itself and Google in Web search. Now the GOOG is aiming at Microsoft’s enterprise business. Twitter could be, in my opinion, an expensive distraction that leaves Microsoft vulnerable in a business sector it can ill afford to see slip downhill.

Twitter is, Mr. Carlson implies, will get more expensive. So, buy now and save. Twitter is definitely hot at this moment. The challenge for a company like Microsoft is to acquire something hot and then prevent it from getting cold. Hot properties in the hands of big, slow moving entities often lose their zippiness. My hunch is that if Microsoft owned Twitter, Twitter would be surpassed by another real time messaging service and quickly.

Microsoft may buy Twitter. That opens the door for another Twitter and Microsoft is poorer and more vulnerable as a result. Microsoft needs to leapfrog to stay where it is. An acquisition won’t do the job in my opinion.

Stephen Arnold, June 7, 2009

Open Text Vignette: Canadian Omelet

May 6, 2009

A happy quack to the reader who alerted me to this big buck ($300 million plus) deal for Open Text to purchase the financially challenged content management vendor Vignette. You can read the Canadian press take on the announcement here. This story is hosted by Google, so it may disappear after a short time. I recall seeing a story by Matt Asay in August 2008 here that the two companies were talking. Well, the deal appears to be done. Open Text is a vendor with a collection of search systems, including Tim Bray’s SGML engine, Information Dimension’s BASIS, the mainframe centric BRS search, the Fulcrum system, and some built in query systems that came with acquisitions. Vignette, on the other hand, is complex and expensive content platform. The company has some who love it and some like me who think that it is a pretty messy bowl of clam linguini. The question is, “What will Open Text do with Vignette”?” Autonomy snagged Interwoven, snagged some up sell prospects, and fattened its eDiscovery calf. Open Text has systems that can manage content. Can Open Text manage the money losing Vignette? Autonomy in my opinion is pressuring Open Text. Open Text now has to manage the Vignette system and marshal its forces against the aggressive Autonomy. Joining me on the skepticism skateboard is ZDNet’s Stephen Powers. He wrote “Can Open Text Turn the Page on Vignette’s Recent History?” here. He wrote:

The other interesting question raised by this announcement: what to do about the Vignette brand? The press release states that Vignette will be run as a wholly-owned subsidiary. But will Open Text continue to invest in what some argue is a damaged brand? Or will they eventually go through a rebranding, as they did with their other ECM acquisitions, and retire the purple logo? Time will tell.

Mr. Powers is gentle. I think the complexity of the Vignette system, its money losing 2008, and the push back some of its licensees have directed at the company. Does Open Text have the management skill and the resources to deal with integration, support, and product stability issues? Will Open Text customers grasp the difference between Open Text’s overlapping product lines?

My hunch is that this deal is viewed by Autonomy as an opportunity, not a barrier.

Stephen Arnold, June 6, 2009

Google: A Victim of Success

May 6, 2009

If you are a person who sees Google as a victim, you may enjoy James B. Stewart’s essay “Few Match Google. Does that Make It a Monopoly?” here. This link may go dead at any time, but the hard copy version of this story appeared in the May 5, 2009, Wall Street Journal. The author argued that Google has been successful. As a result, Google should not be singled out for regulatory or any other action that would impede the company. For me, the most interesting comment in the write up was:

Google is indisputably a victim of its own success. Its market share of Internet search has continued to rise steadily, encompassing roughly two-thirds of total searches. At 76%, its share of search advertising is even higher, thanks to Google’s technological prowess at matching ads to people’s search queries. Given the accompanying high profit margins on this lucrative business, Google displays the telltale characteristics of a monopolist: high, even dominant market share, with high profits and pricing power that are evidence of high barriers to entry for competitors.

This is the MBA argument, and we know how well MBAs handled the financial industry.

The problem, in my opinion, is not regulatory. The problem is that Google is a new type of industrial enterprise. I argue that it is not a single firm. Google is something like the invention of the printing press. The company is transformational. Regulators have trouble with known entities such as utilities and pharmaceutical firms. The SEC was clueless when it came to Bernie Madoff’s alleged Ponzi scheme. Regulators are likely to be at sea without a life raft when it comes to understanding the “digital Gutenberg”. Should we trust MBAs? Should we trust Google? Ideas?

Stephen Arnold, May 6, 2009

Patricians, Cesspools and Rubber Boots

May 6, 2009

I became interested in ancient technology by accident. I ignored history, particularly ancient history, in college. Too fuzzy. A few years ago on a tour with some friends we were in a ruin somewhere in Turkey. I looked down and saw an exposed clay pipe. I asked the tour guide what the pipe was, and she replied, “The wealthy citizens had running water.” The ruins dated from the 800 BCE period, and I assumed that the folks who lived used the equivalent of outhouses. I was wrong. Someone had figured out how to make pipes and install indoor plumbing.

There were two classes of residents. Some had indoor plumbing and lived the good life. Others had a less good life. Patricians have used plumbing as one way to distinguish themselves from people like me. My ancestors had to use outdoor plumbing.

The image of the cesspool, then, is one that makes clear that there are two classes of people – an upper class and a lower class. When I read about metaphors invoking cesspools, I think about the class distinctions that are evident in the ruins of ancient cities. Those cities were much like the modern one in which I live. Order and disorder collide, and institutions make an attempt to prevent chaos from dominating simple activities like driving to work or shopping.

I thought about this dividing line when I read Jim Spanfeller’s “What Google Can Do to Make the Web Less of a Cesspool” here. The article makes some interesting points, yet I was troubled by assertion that a commercial enterprise can and should assume responsibility for information. A commercial enterprise has finite resources and, by definition, the need to clean up is likely to be a large job. Information is created by many, which leads to the implicit idea that a larger entity should become the janitor. If not Google, who? Well, one candidate is “the government” or perhaps a group of really smart and good people will will act as the government’s agent. Now we are back to the plumbing in the ancient city. As long as the patricians can keep the mess from their premises, life improves.

Mr. Spanfeller wrote:

At Forbes.com, we have estimated that Google makes roughly $60 million a year directing folks to our site. And by the way, 40 percent of those dollars are derived from the search terms of Forbes, Forbes.com or Forbes Magazine—simple navigation. Seems like a very nice chunk of change for simply being there. In the end, in attempting to “do no evil,” Google has done exactly that. I say this not just as someone running a content site but also as an end user. If this inequity of support continues along these lines, we will see a continuing destruction of our journalistic enterprises—enterprises that are one of the core building blocks of our democracy. Last year, while addressing the magazine publishers and editors of the MPA at the Google Campus, Eric Schmidt suggested that the web was a “cesspool” and that it was up to the major journalistic brands to clean it up. Well Eric, in a great many ways, Google has helped to create that cesspool, and as such I would hope that it can be part of the solution.

The idea that free flowing information can be cleaned up is an interesting one. I don’t think the job will be easy. I don’t think patricians from the dead tree world or from the online world are up to the task. We have a new context in which digital information is not a cause, but a consequence of our present way of existing.

The cesspool arguments are tempests in a chamber pot. Once the information flows outside the boundaries of restricted and tightly controlled channels, the information cannot be put back into those old containers. Get your boots on may be a better way to approach the situation.

Large flows of information, cesspools, and a digital mess are the characteristics of this time and place. The combined efforts of Forbes and Google will have little substantive impact. In fact, neither of these companies and not even the governments of Australia and China can contain the information flows, but these nation states keep trying to shut Pandora’s box.

The patricians want the good old days, but those days are gone. What’s interesting is that the newer modes of communication may be permanently outside the span of control of the Google and, it seems to me, existing mechanisms for control of human behavior. The fix is to abandon computers, electricity, and all things digital.

Mr. Spanfeller’s argument and his plea for Google to do its part are like the scholars’ reading of ancient texts: interesting, maybe intellectually satisfying, but markers of an era lost to history. Rubber boots, on the other hand, are practical, work reasonably well, and put the responsibility in the hands of an individual, not in fantasyland. Perhaps I will tweet that boot idea?

Stephen Arnold, May 6, 2009

« Previous PageNext Page »

  • Archives

  • Recent Posts

  • Meta