Machine Intelligence on One Big Poster
December 12, 2014
I need this in my office. I will dump my early 1940s French posters and go for logos.
Navigate to this link: http://bit.ly/1sdmBL0. You will be able to download a copy of an infographic (poster) that summarizes “The Current State of Machine Intelligence.” There are some interesting editorial decisions; for example, the cheery Google logo turns up in deep learning, predictive APIs, automotive, and personal assistant. I quite liked the inclusion of IBM Watson in artificial intelligence—recipes with tamarind and post-video editing game show champion. I found the listing of Palantir as one of the “intelligence tools” outfits. Three observations:
- I am not sure if the landscape captures what machine intelligence is
- The categories, while brightly colored, do not make clear how a core technology can be speech recognition but not part of the “rethinking industries” category
- Shouldn’t Google be in every category?
I am confident that mid tier consultants and reputation surfers like Dave Schubmehl will find the chart a source of inspiration. Does Digital Reasoning actually have a product? The company did not make the cut for the top 60 companies in NGIA systems. Hmmm. Live and learn.
Stephen E Arnold, December 12, 2014
Two Companies Offering Unified Search
December 9, 2014
I am confused. What exactly differentiates some of the vendors offering “unified” search? Another question is, “Are these many functions explicitly designed to deliver outputs that reflect real time content analytics on collected text, images, and videos?
I noted this Sinequa diagram on Twitter (http://bit.ly/12IXmnh):
A day ago I was preparing a short report for a client and came across this diagram for the Attivio active intelligence engine which delivers unified access:
The similarities are quite interesting. What came first, keyword search or the repositioning of search as an application that performs is like a giant Microsoft Office solution?
How do these two companies compare to a next generation information access system (NGIAs)? I see three differences:
- An NGIA system makes search a utility, not a core function or a principal plank in the platform
- The outputs of an NGIA system are designed to make or to trigger a tactical or strategic decision; for example, the output of an NGIA system goes into a system controlling a manufacturing robot
- The purpose of the NGIA system is to deliver a solution that pivots on predictive analytics.
I conclude, therefore, that neither Sinequa nor Attivio are NGIA systems at this time. The companies could engineer their search oriented approach toward an NGIA approach. Attivio has new management to help facilitate this important shift. Sinequa, according to a mid tier consulting firm, is one of the Big Dogs in information processing.
It will be interesting to see how search-centric vendors adapt to the next generation information access market. In my forthcoming monograph on this topic, I explore the substantive differences between search-centric “we do it all” systems and the forward looking NGIA system vendors.
Stephen E Arnold, December 9, 2014
Another Good Enough Challenge to Proprietary Enterprise Search
December 8, 2014
The protestations of the enterprise search vendors in hock for tens of millions to venture funders will get louder. The argument is that proprietary search solutions are just better.
Navigate to “Postgres Full-Text Search Is Good Enough!” This has been the mantra of some of the European Community academics for a number of years. I gave a talk at CeBIT a couple of years ago and noted that the proprietary vendors were struggling to deliver a coherent and compelling argument. Examples of too-much-chest-beating came from speakers representing and Exalead and a handful of consultants. See, for example, http://bit.ly/1zicaGw.
The point of the “Postgres Good Enough” article strikes me as:
Search has became an important feature and we’ve seen a big increase in the popularity of tools like Elasticsearch and SOLR which are both based on Lucent. They are great tools but before going down the road of Weapons of Mass Search, maybe what you need is something a bit lighter which is simply good enough! What do you I mean by ‘good enough’? I mean a search engine with the following features: stemming, ranking/boost, multiple languages, fuzzy search, accent support. Luckily PostgreSQL supports all these features.
So not only are the proprietary systems dismissed, so are the open source solutions that are at the core of a number of commercialization ventures.
I don’t want to argue with the premise. What is important is that companies trying to market enterprise search solutions now have to convince a buyer why good enough is not good enough.
For decades, enterprise search vendors have been engaged in a Cold War style escalation. With each feature addition from one vendor (Autonomy), other vendors pile on more features (Endeca).
The result is that enterprise search tries to push value on customers, not delivering solutions that are valued by customers.
The “good enough” argument is one more example of a push back against the wild and crazy jumbles of code that most enterprise search vendors offer.
The good news is that good enough search is available, and it should be used. In fact, next generation information access solution vendors are including “good enough” search in robust enterprise applications.
What is interesting is that the venture funding firms seem content to move executives in and out of companies not hitting their numbers. Examples include Attivio and LucidWorks (really?). Other vendors are either really quiet or out of business like Dieselpoint and Hakia. I pointed out that the wild and crazy revenue targets for HP Autonomy and IBM Watson are examples of what happens when marketing takes precedent over what a system can do and how many customers are available to generate billions for these big outfits.
Attention needs to shift to “good enough” and to NGIA (next generation information access) vendors able to make sales, generate sustainable revenue, and solve problems that matter.
Displaying a results list is not high on the list of priorities for many organizations. And when search becomes job one, that is a signal the company may not have diagnosed its technological needs accurately. I know there are many mid tier consultants and unemployed webmasters who wish my statements were not accurate. Alas, reality can be a harsh task master or mistress.
Stephen E Arnold, December 8, 2014
The Future of News: Looking East
December 5, 2014
I read “Hacking Media: Al Jazeera Hackathon Imagines the Future of News.” The write up is interesting because it suggests that fresh thinking about “real” journalism does not occur in Midtown Manhattan.
The other main point I noted was:
Another of the 19 projects that were chosen for the hackathon is somewhat similar to Perspectives: called ReFrame, it would pull in related information about a major news topic but focus specifically on local perspectives on a national or international story — to try and correct some of the misunderstandings that often surface during the reporting of stories like the Ebola crisis, where journalists are often writing about places they have never been. Another valuable effort, although perhaps a difficult one to automate.
Difficult for some to automate. I can name several firms in the NGIA space with this type of function up and running. I am not surprised if you find this suggestion at odds with the article. But you don’t know what you don’t know as the saying goes.
I also circled this comment about hackathons, which some search vendors are sponsoring in a hope that it will lead to either sales or the landing of a sleek programmer halibut:
Hackathons have gotten a bad rap in some circles because they are often exercises in futility: although everyone has fun drinking coffee or Red Bull for 48 hours straight and eating bad pizza, what comes out of them tends to be goofy little apps or widgets that don’t accomplish a whole lot.
Net net: what seems to be far out innovations may be closer—much closer—than you assume.
Stephen E Arnold, December 5, 2014
Enterprise Search: Gritters Are Ready, Enterprise Info Highway Is Resistant
December 3, 2014
In UK talk, a gritter is a giant machine that dumps sand (grit) on a highway to make it less slippery. Enterprise search gritters are ready to dump sand on my forthcoming report about next generation information access.
The reason is that enterprise search is running on a slippery surface. The potential customers are coated in Teflon. The dust up between HP and Autonomy, the indictment of a former Fast Search & Transfer executive, and the dormancy of some high flying vendors (Dieselpoint, Hakia, Siderean Software, et al)—these are reasons why enterprise customers are looking for something that takes the company into information access realms that are beyond search. Here’s an example: “Accounting Differences, Not Fraud, Led to HP’s Autonomy Write Down.” True or false, the extensive coverage of the $11 billion deal and the subsequent billions in write down has not built confidence in the blandishments of the enterprise search vendors.
Image source: http://thehappyhousewife.com/homeschool/files/2013/01/salt-truck.jpg
Enter the gritters. Enterprise search vendors are prepping to dump no skid bits on their prospects. Among the non skid silica will be pages from mid tier consultants’ reports about fast movers and three legged rabbits. There will be conference talks that pummel the audience with assertions about the primacy of search. There will be recycled open source technology and “Fast” think packaged as business intelligence. There will be outfits that pine for the days of libraries with big budgets pitching rich metadata to trucking companies and small medical clinics who rightly ask, “What’s metadata?”
Enterprise Search: Fee Versus Free
November 25, 2014
I read a pretty darned amazing article “Is Free Enterprise Search a Game Changer?” My initial reaction was, “Didn’t the game change with the failures of flagship enterprise search systems?” And “Didn’t the cost and complexity of many enterprise search deployments fuel the emergence of the free and open source information retrieval systems?”
Many proprietary vendors are struggling to generate sustainable revenues and pay back increasingly impatient stakeholders. The reality is that the proprietary enterprise search “survivors” fear meeting the fate of Convera, Delphes, Entopia, Perfect Search, Siderean Software, TREX, and other proprietary vendors. These outfits went away.
Many vendors of proprietary enterprise search systems have left behind an environment in which revenues are simply not sustainable. Customers learned some painful lessons after licensing brand name enterprise search systems and discovering the reality of their costs and functionality. A happy quack to http://bit.ly/1AMHBL6 for this image of desolation.
Other vendors, faced with mounting costs and zero growth in revenues, sold their enterprise search companies. The spate of sell outs that began in the mid 2000s were stark evidence that delivering information retrieval systems to commercial and governmental organizations was difficult to make work.
Consider these milestones:
Autonomy sold to Hewlett Packard. HP promptly wrote off billions of dollars and launched a fascinating lawsuit that blamed Autonomy for the deal. HP quickly discovered that Autonomy, like other complex content processing companies, was difficult to sell, difficult to support, and difficult to turn into a billion dollar baby.
Convera, the product of Excalibur’s scanning legacy and ConQuest Software, captured some big deals in the US government and with outfits like the NBA. When the system did not perform like a circus dog, the company wound down. One upside for Convera alums was that they were able to set up a consulting firm to keep other companies from making the Convera-type mistakes. The losses were measured in the tens of millions.
Enterprise Search to Walk a Rocky Road in 2015
November 19, 2014
The Arnold IT team is working on a new report that focuses on what my team is calling Next Generation Information Access or NGIA. The Information Today column for the next issue (maybe January 2015) addresses one of the several hurdles that enterprise search vendors will have to get over in order to close some of the larger information access deals available today.
In this write up, I want to identify five other issues that bedevil enterprise search. Please, understand that I am not talking about Web search, which is essentially a different application of string matching and online advertising.
Here’s the partial list with a short comment:
- A suite of components, not a one shot system like a download of Lucene
- An architecture that allows the licensee flexibility when integrating, scaling, or modifying certain operations of the system. The black box is an intriguing notion, just unsuited to today’s working environment.
- A suite of components that have been designed to inter-operate without extensive custom scripting or silly explanations about the difficulty of making Component A work with Component B of the same vendor’s software. Incompatible Lego blocks don’t fly in kindergarten, and they certainly don’t work in high risk information settings.
- Connectors that work and support the file types commonly in use in fast moving, flexible work situations. The notion that the licensee can just code up a widget makes sense only when the vendor lacks the expertise or the resources to do this job before selling an information access system.
- Native support for languages in which the licensee’s content resides. Again, telling the licensee that he or she can just connect a system to a third party translation system is a limp wristed solution to today’s global content environment.
There are other hurdles as well. I will be identifying more and mapping out the specific differences between some of the aggressively marketed “charade” information access systems and solutions from vendors who have been operating at a different level in today’s three dimensional information chess game.
Playing checkers is not the same as 3D chess in my view.
Stephen E Arnold, November 19, 2014
-
- Subscribe to Beyond Search
Feature archive
News archive
-
