Wolfram Alpha and Search
October 12, 2010
I read “Wolfram Alpha and the Future of Search.” When I first looked at Wolfram Alpha, I did not consider the system a search engine. Google has a similar function. The idea is that an appropriate query will generate an answer. In my first queries with Wolfram Alpha, the math questions worked well. The more generalized query elicited some head scratching from the Wolfram Alpha system.
The write up summarizes some remarks made by Stephen Wolfram, a well know wizard and software genius, whose Mathematica finds use in many PhD study areas, research labs in Silicon Valley, and puzzle solvers who find Mathematica just what the doctor ordered to avoid a silly addition error.
The write up contained two points which I found interesting.
First, Dr. Wolfram allegedly said something along the lines:
Traditional search engines help us find documents in that mountain of words. But they do very little to distill those words into knowledge, or to answer our questions. The challenge in the coming years, Wolfram said, was to make more of these files and documents computable. That would enable systems like Wolfram/Alpha to digest them, and to use them to produce answers and analysis.
Dr. Wolfram is right in the flow of the data fusion trend. The question I would raise is, “What happens when those generating the outputs fiddle the game?” I don’t think “trust”, “reputation,” or “honor” will satisfy my need for some substantive reassurance. The nifty interfaces and the point-and-click access to “the answer” may be a mixed blessing.
Second, Dr. Wolfram alleged said something along these lines:
But the way Wolfram sees it, more of us will produce information in a style (or on templates) that will make it computable, and machines like his will eventually be able to answer all sorts of questions. In a sense, an early stage of this pre-processing is already happening: An entire industry is formatting Web pages to make them more searchable.
Bingo. Data fusion. The question I would raise is, “What happens when one of the nifty acquisition and transformation systems cannot process certain content?” In my experience, the scale of operation at even Twitter content centric start ups is a significant amount of data. Presenting information as complete that may quite incomplete seems to be a sticky wicket to me.
Is this bulk content processing and machine answering the future? Google, Recorded Future, and DataSift are rushing toward that end zone. Trends are fascinating, and in this case, data fusion tells us more about the market’s need for an easy-as-pie way to get actionable information than about the validity of the methods and the appropriateness of the outputs.
Stephen E Arnold, October 12, 2010