Lexalytics Uses Text Analytics to Find the Most Popular Superhero
May 31, 2012
The LexaBlog recently posted some interesting information about popular superheroes in the article “The Avengers: Most Popular Superhero?”
According to the article, writer Seth Redmore analyzed 330,000 tweets regarding the new Avengers superhero movie by sending out query topics on the main characters as well as the actors playing them.
Redmore breaks the information down for us with several charts showing the most to least popular characters as well as the most to least popular themes as well as hash-tags.
When discussing his process, Redmore states:
“This actually does a good job of showing why I wanted to create query topics for the superheroes. Many of their names come out looking more like themes than like proper “names”. Many of these themes aren’t particularly useful, so, I excluded a bunch of them when I was doing other sorts of analysis. Next, I decided to see what themes were most commonly associated with each of said superheroes. As I said before, I pulled out things like “watching avengers” when I was doing this analysis, as it adds nothing in terms of what people were associating with this character/actor.”
How will this aid your business? Send us your ideas via the comments section of this blog.
Jasmine Ashton, May 31, 2012
Sponsored by PolySpot
Inteltrax: Top Stories, May 21 to May 25
May 28, 2012
Inteltrax, the data fusion and business intelligence information service, captured three key stories germane to search this week, specifically, the latest happenings with some of big data’s biggest names.
Our story, “Data Analytics Expert Points to the Crux of Big Data Issues,” looked at the CEO of Revolution Analytics and Digital Reasoning, catching up with their latest moves.
“EMC Provides a Lot of Analytic Good,” shows all the positive ways in which EMC is moving the analytic game ahead.
While, “MicroTech Wins Military Intelligence Contract” shows this up-and-coming firm making a name for itself with defense.
There are a million different directions that analytics are moving in at any given moment, but we’ll be providing snapshots of the scene, just like this, every day. Be sure to tune in.
Follow the Inteltrax news stream by visiting www.inteltrax.com
Patrick Roland, Editor, Inteltrax.
May 28, 2012
Inteltrax: Top Stories, May 14 to May 18
May 21, 2012
Inteltrax, the data fusion and business intelligence information service, captured three key stories germane to search this week, specifically, how unstructured data is shaping the way vendors operate.
In “A Mountain of Unstructured Data” the problem of collecting tweets, posts, pictures, videos and more and making analytic sense is laid out.
“Unstructured Data Investment on the Horizon” shows how many companies are investing in solving their own unstructured data crises.
Finally, “Another Analytics Partnership is Born” showed companies joining forces to tackle this massive problem.
We’ve talked about unstructured data before, but we keep returning to the well because it’s such a massive concern for companies. Thankfully, those problems are being solved and we’re monitoring it every step of the way.
Follow the Inteltrax news stream by visiting www.inteltrax.com
Patrick Roland, Editor, Inteltrax.
May 21, 2012
Inteltrax: Top Stories, May 7 to May 11
May 14, 2012
Inteltrax, the data fusion and business intelligence information service, captured three key stories germane to search this week, specifically, hot trends among the industry.
The hottest trend in most businesses is change and “How an Analytic Firm Handles Challenges” highlights the rapidly evolving Petri dish of data analytics.
The law has been a major topic of talk and “Google Indiscretions Prove Need for Secure Data Mining” looks at how the search giant’s analytics arm might be violating laws and trust.
Partnerships have been the biggest trend in big data this year and “Clients Win When Big Data Partners” examines Cloudera’s recent teamwork.
These are just a sampling of the big time changes moving this industry forward at a frantic pace. It’s exciting and you can catch the thrill every day as we cull analytic news from around the globe.
Follow the Inteltrax news stream by visiting www.inteltrax.com
Patrick Roland, Editor, Inteltrax.
May 14, 2012
Inteltrax: Top Stories, April 16 to April 20
April 23, 2012
Inteltrax, the data fusion and business intelligence information service, captured three key stories germane to search this week, specifically, how three of the biggest supporters of analytics are fairing.
Surprisingly, transportation has taken a shine to analytics, as we discovered in “Transportation Analytics Grows Crucial to Success”.
Not so surprisingly, government spending is leaning heavy on analytics. “Intelligence Community Leads Public Sector Analytics” showed how spy agencies love analytics.
Unfortunately, the one-time titan of analytic love, the medical field, is falling behind, as we learned in “Healthcare Analytics Needs a Boost”.
While there are thousands of industries that utilize big data analytics, these three are probably the most visible. Their successes and failures are important elements of the analytic story and ones we’ll be monitoring daily.
Follow the Inteltrax news stream by visiting www.inteltrax.com
Patrick Roland, Editor, Inteltrax.
April 23, 2012
Datameer Explains Its Services
April 20, 2012
SmartData Collective’s Bob Gourley gives his take on a fairly young company in “Datameer Provides End-User Focused BI Solutions for Big Data Analytics.” The company, founded in 2009, supplies a business intelligence platform that runs on top of the open source Hadoop engine from Apache. Gourley writes:
“Datameer provides a big data solution that focuses on perhaps the most important niche in this growing domain, the end-user. . . . I’ve met with the CEO (Stefan Groschupf) and other Datameer executives. I’ve also interacted with them in events like our Government Big Data Forum. Through these events plus demonstrations by some of their greatest engineers has led me to a few conclusions about Datameer. In general, I believe enterprise technologists should take note of this firm for several reasons.”
Those reasons include: familiar and easy-to-use interfaces; the availability of free trials; scalability; software wizards that guide non-techies through accessing and integrating data; the ability to deploy either on premises or in the cloud; and the ease with which capabilities can be expanded through plug-ins and open APIs.
These are all good features, it is true. But we still have one important question: what differentiates this outfit from such fast movers as Ikanow, Quid, and Digital Reasoning?
Cynthia Murrell, April 20, 2012
Sponsored by Pandia.com
Algorithms Can Deliver Skewed Results
April 18, 2012
After two days of lectures about the power of social media analytics, Stephen E Arnold raised doubts about the reliability of certain analytics outputs. He opined: “Faith in analytics may be misplaced.”
Arnold’s lecture focused on four gaps in social media analytics. He pointed out that many users were unaware of the trade offs in algorithm selection made by vendors’ programmers. Speaking at the Social Media Analytics Summit, he said:
Many companies purchase social media analytics reports without understanding that the questions answered by algorithms may not answer the customer’s actual question.
He continued:
The talk about big data leaves the impression that every item is analyzed and processed. The reality is that sampling methods, like the selection of numerical recipes can have a significant impact on what results become available.
The third gap, he added, “is that smart algorithms display persistence. With smart software, some methods predict a behavior and then look for that behavior because the brute force approach is computationally expensive and adds latency to a system.” He said:
Users assume results are near real time and comprehensive. The reality is that results are unlikely to be real time and built around mathematical methods which value efficiency and cleverness at the expense of more robust analytic methods. The characteristic is more pronounced in user friendly, click here type of systems than those which require to specify a method using SAS or SPSS syntax.”
The final gap is the distortion that affects outputs from “near term, throw forward biases.” Arnold said:
Modern systems are overly sensitive to certain short term content events. This bias is most pronounced when looking for emerging trend data. In these types of outputs the “now” data respond to spikes and users act on identified trends often without appropriate context.
The implication of these gaps is that outputs from some quite sophisticated systems can be misleading or present information as fact when that information has been shaped to a marketer’s purpose.
The Social Media Analytics conference was held in San Francisco, April 17 and 18, 2012. More information about the implications of these gaps may be found at the Augmentext.com Web site.
Donald C Anderson, April 18, 2012,
Sponsored by Pandia.com
Big Data: The Next Bubble
April 18, 2012
A colleague in Europe sent me information about a new study sponsored by SAS. To tow the line, I have done work for SAS in the past and we use SAS technology for certain types of analytic work. Nevertheless, the SAS report surprised me with its robust estimate of the uptake of big data, which is now the buzzword and trend poster child for 2012. The report was generated by CEBR, which is an azure chip outfit performing various analyses for government entities and enterprisers.
First, you will need to snag a copy of the report “Data Equity: Unlocking the Value of Big Data.” SAS did not “know” me, so I had to register again and you may have to jump through hoops as well. I don’t know if SAS will call to sell me something, but you may get a ringy dingy. Don’t blame me.
The main point of the study is that every industrial sector will be forced to deal with big data. Okay, as news flashes go, this is not one which lit up the Beyond Search editorial team. We did notice a number of interesting charts. The one reproduced below shows how much uptake in big data occurs by industrial sector today and in 2017. The key point is that the numbers and bars show big data becoming a “big” deal.
Source © 2012 Centre for Economics and business Research Ltd.
My view is that the study is interesting. Omitted is obvious weightings which consider:
- Economic downturns in the broad economy
- Facts which suggest even laggard sectors like manufacturing will embrace the big data shift
- Exogenous factors such as war in the Middle East or in the volatile areas bordering on China.
So big estimates go with big data. Big dreams are useful. Reality? Well, that is often different.
Stephen E Arnold, April 17, 2012
Sponsored by Pandia.com
Inteltrax: Top Stories, April 9 to April 13
April 16, 2012
Inteltrax, the data fusion and business intelligence information service, captured three key stories germane to search this week, specifically, the ways in which money is dealt with in analytic terms.
Saving money is the focus of “Knowing Needs and Wants Save Tons with Big Data” which aims to help buyers decide what they want in an analytic package before buying.
Making the right investment for you is covered in “Speed is the Analytic Key” which says, above all other factors, spend extra money on speed because that’s the quickest to get outdated.
Finally, “Series-B Investments Expand Analytic Growth” shows how smaller firms and startups depend on private investors to compete with the big names in a big data.
Money makes the world go around and the big data planet is no different. But the ways in which it is saved and spent and acquired could fill a book. We are writing a new chapter every day and hope you’ll join us.
Follow the Inteltrax news stream by visiting www.inteltrax.com
Patrick Roland, Editor, Inteltrax.
April 16, 2012
Exclusive Interview: Paul Doscher, President of Lucid Imagination
April 16, 2012
The Search Wizards Speak features Paul Doscher, the new president of Lucid Imagination. Mr. Doscher joined Lucid Imagination in December 2011. He had been president of Dassault Exalead USA prior to assuming the top spot at fast-growing, customer- and community-centric Lucid Imagination.
I spoke with Mr. Doscher when he was working for the Dassault Exalead organization. When he shifted to Lucid Imagination, I spoke with him about his views of open source search. After that brief initial conversation, I met again with Mr. Doscher and probed into his views about the impact open source search is having on traditional for-fee, proprietary search systems.
When I asked about the shift from proprietary search systems to open source search, he told me:
Today organizations need the flexibility to adapt and make changes. A proprietary solution may not permit the licensee to make enhancements. If a change is made, the proprietary search vendor may “own” the fix and will add that innovation to its core product. The licensee who created the fix gets nothing and may have had to pay for the right to innovate. As corporate information technology struggles to keep up with escalating business information demands and an ever increasing mountain of growing content of all types, open source search provides a cost effective and efficient way to develop applications to address the challenges and opportunities in today’s enterprise.
Mr. Doscher has strong views about how licensees of enterprise search systems have learned about costs, the time required to deploy a system, and the effort needed to keep a search system up and running. I asked him about Lucid Imagination’s approach to a search engagement. He said:
Our approach to an engagement is to listen to what our customers need, prepare an action plan, and then deliver. In a sense, our approach is the type of involvement that many software companies have stepped away from. We have an enthusiastic group of engineers and professionals who work with clients to meet their needs.
The full text of the interview appears on the ArnoldIT.com Web site. For more information about Lucid Imagination’s open source search system, you will want to explore the company’s Web site and its blog. In addition, an interview with one of the founders of Lucid Imagination, Marc Krellenstein, and with Eric Gries, a former executive at Lucid Imagination, is available in the Beyond Search archives.
Stephen E Arnold, April 16, 2012
Sponsored by Pandia.com
-
- Subscribe to Beyond Search
Feature archive
News archive
-
