PolySpot Technologies are Integral Piece to Best Practices with Big Data
November 22, 2012
Often times when the phrase big data is thrown around, organizations lose sight of the word ‘data’ and its relation to their overall goal as it pertains to extracting intelligence and information from the petabytes. HealthWorks Collective delivers up a reminder in the article, “Big Data, Small Data… Size Doesn’t Matter, Data Management Does.” It is east to get lost in the voluminous ‘big’, but that idea in itself would not amount to anything significant.
The article recommends that organizations in the healthcare industry take the initial step to benefiting from big data and transferring records from paper to digital files.
However, there is a step that precedes digitizing information:
But as the EHR/EMR supply grew and got more diverse, it seems that the problem is not so much to use or not to use these tools, but to find the right one that would adapt the physicians’ practice, workflow and habits. Through flexible, software-as-a-service-based solutions, for example. So, more than going digital, the first step would be to find a flexible, customizable tool to match the best the specifications of your practice.
The steps do not end there. Learning best practices with big data is an integral piece to the puzzle and should be another consideration in choosing a software vendor. Consulting and support matters in a vital way; best practices are the difference between information being delivered to the right users at the right time. We have been particularly impressed with PolySpot in this regard.
Megan Feil, November 22, 2012
Sponsored by ArnoldIT.com, developer of Augmentext.
Big Money for Open Source Company
November 22, 2012
If someone told you that there wasn’t any money to be made in open source technology, first tell them they are extremely wrong and then have them read this article from Tech Crunch called “Open Source Business Intelligence Company Pentaho Lands $23 Million Series C.” Pentaho is an open source business intelligence vendor and the company landed $23 million in funding from investors, the biggest contributor being New Enterprise Associates. Pentaho has led four prior funding rounds, bringing the total to $55 million.
Going over the company’s history, this is another success for them:
“The company was founded in 2004 and raised a $5 million series A from New Enterprise Associates with participation from Index Ventures. It later raised a $8 million series B from the same two firms in 2006. Venture Beat reported a $12 million 3rd round from Benchmark Capital in 2008, and according to SEC documents Pentaho raised an additional $7 million from undisclosed investors in 2010.”
As a major player in the open source field, Pentaho has most notably been known for its software that adds native support for NoSQL Databases, Apache Hadoop distributions, columnar databases, and traditional relational databases. Its Kettle, an data integration platform, was released earlier this year. Pentaho will use the money to fund more open source projects. We have to wait and see what develops. We already know what is to develop with LucidWorks, an open source search company. LucidWorks is where the open source search experts are and they have some of the most robust and powerful search applications for Big Data and the Cloud.
Whitney Grace, November 22, 2012
Sponsored by ArnoldIT.com, developer of Augmentext
Intrafind Focuses on Managing and Classifying Data Automatically
November 21, 2012
We continue our in-depth look into software publisher Intrafind this week with another focus on the many features we have found available from the company. In addition to the proven iFinder Enterprise Search product as well as the particularly useful Tagging Service, we noted other highlights on a recent navigation of the company’s Web site.
Of specific interest was TopicFinder, an automated text classification system for topic recognition and document analysis. This product allows users to automatically gather and use information which goes beyond the typical word-based content search of documents. The main purpose of the tool is to filter and manage information. The Web site explains:
“Using the TopicFinder, for example, incoming mail from customers can be automatically forwarded to the most appropriate person responsible, or depending on their content news from news tickers can be forwarded to the editorial staff responsible for sports, politics or economic affairs.
The TopicFinder can be either specially trained regarding the information needs of the customer or it can be used with a pretrained general hierarchy of topics. The tool works fully automatically. There is no need for manual tagging. The quality of the classification is very high as the TopicFinder is based on recent linguistic and mathematical / information-theoretical methods.”
We believe this automatic tool is groundbreaking in the attempt to manage and navigate Big Data, because not all data consists simply of words. We are impressed with Intrafind’s attempt to step into this territory. The enterprise data company is located in Germany and has been making such bold moves since beginning operation in 2000. The team consists of 25 specialists who provide analysis and support. For more information, please turn to the company’s homepage.
Andrea Hayden, November 21, 2012
Sponsored by ArnoldIT.com, developer of Augmentext
Big Data Profiling Hits Hadoop
November 21, 2012
IT News Online revealed some of the latest new featuring a leader in open source software: “Talend Simplifies Big Data Further with New Release of Enterprise Open Source Integration Platform.” Talend released version 5.2 of its next-generation integration platform, which is the only one that provides a unified environment for managing entire lifecycles for data, application, and process integration requirements. Version 5.2 has support for NoSQL databases and data profiling for Hadoop. Talend’s biggest concentration has been to make the Big Data process easier:
“In its mission to democratize big data, Talend has focused extensively on solutions that make deploying and managing Apache Hadoop and related technologies simple, without requiring specific expertise in these areas. With version 5.2, Talend has taken its big data strategy a step further by adding big data profiling for Hadoop, providing companies with the ability to discover and understand data in Hadoop clusters. Among the typical problems associated with data quality are duplication, incompleteness and inconsistency, which create inefficiencies in data processing. Talend Platform for Big Data includes new capabilities for visibility into big data in all its forms and locations.”
Version 5.2 also includes upgrades for products that use Talend’s Unifed Platform. Big Data is very complex and products like those from Talend make it easier to leverage the data and reap the benefits. LucidWorks has a Big Data search tool that was designed to find the hidden data in Big Data, making it another great tool for the Big Data handler. However, LucidWorks also has the trusted name and the customer support that others cannot boast.
Whitney Grace, November 21, 2012
Sponsored by ArnoldIT.com, developer of Augmentext
Renaissance in the Enterprise Calls for Proven Features
November 20, 2012
A general partner at venture capitalist firm Andreessen Horowitz stated the obvious at a recent conference: there are a lot of changes going on in the enterprise. Enough changes, says Andreessen Horowitz partner Peter Levine, that it could be considered a renaissance and an entirely new generation of creativity in the enterprise. According to the article “Andreessen Horowitz General Partner Peter Levine: There’s an Enterprise Renaissance Going On” on TechCrunch, Levine is comparing the enterprise renaissance to that that occurred in the city states of Italy.
The article states:
“[…]Levine said, there is lots of proof that the renaissance is underway — well illustrated in the shift from the personal computer to mobile. The infrastructure has to change in this shift; the applications will have to be built natively to the mobile device. Services out of the back-end will need to be secured. The devices are getting more powerful and will have to integrate with distributed infrastructures around the world. Data platforms are just emerging. The development is just starting.”
The changes and the Big Data renaissance call for new ways of dealing with and addressing data. We recommend Intrafind, which offers some renaissance features that are tried and true due to their maturity in the enterprise search market. We look forward to the changes in the new age and believe businesses should prepare with the right tools to help them learn and collaborate in the emerging market.
Andrea Hayden, November 20, 2012
Sponsored by ArnoldIT.com, developer of Augmentext
No Industry Escapes the Big Data Revolution
November 20, 2012
Those seeking objective and statistically produced facts know that big data is a major fuel source of such information. Every so often it is refreshing to take a peek at how big data influences many key fields of study and industry. The Guardian article “Big Data: Revolution by Numbers” outlines each of these areas and discusses the impact big data has had on each.
Everything from sports to medicine has been hugely revolutionized, or in the process of undergoing such changes, due to the utilization of big data. Powerful technologies and ideas have transformed daily operations and even yielded life-changing outcomes. For example, Cambridge researchers stopped an MRSA outbreak affecting 12 babies in the Rosie Hospital by rapidly sequencing the genome of the bacteria.
The article delves into some examples of data-intensive projects in scientific research:
The data recorded by each of the big experiments at the Large Hadron Collider (LHC) at Cern in Geneva is enough to fill around 100,000 DVDs every year. Or take the Sloan Digital Sky Survey, which is measuring 500 distinct attributes for each of 100m galaxies, 100m stars and 1m quasars. The result: three terabytes of data, where a terabyte is 1,000 gigabytes. Analysing that volume of data is beyond the capacity of humans, so it has to be done by computers.
Enterprise organizations used to deal with the same overwhelming amounts of data stored and managed using legacy software. Fortunately, the influx of even more data has prompted many innovative software vendors such as PolySpot to develop information delivery solutions.
Megan Feil, November 20, 2012
Sponsored by ArnoldIT.com, developer of Augmentext.
Connotate and Luminoso Team Up To Tackle Big Data
November 20, 2012
A big announcement was made last month in the Big Data arena about a partnership that is likely to help industries attain actionable insights such as product development and market research. According to “Connotate and Luminoso Partner to Deliver Seamless Solutions for Web-Based Market Research and Customer Sentiment Analysis” on MarketWatch, automated data collection provider Connotate and analytics provider Luminoso are joining forces to deliver new capabilities surrounding data management.
We hear from key players from both sides in the article. Connotate’s take on the partnership follows:
“‘Companies are just beginning to leverage agile text analysis applications to understand the Voice of the Customer,’ said Isai Shenker, vice president of product management for Connotate. ‘Luminoso’s selection of Connotate is an important milestone in combining the wealth of Web data with the advanced technology of customer sentiment analysis — creating solutions that are automated, scalable and rapidly deployable. The demand for this type of solution is exploding as companies seek near real-time feedback to adjust pricing and product positioning, as well as fresh insights into what people really think about their product or brand.'”
We believe this alignment could potentially be rewarding for customers as an ideal solution in changing unstructured data into real results. The two companies will be sharing real-world market research and customer sentiment analysis at an upcoming webinar. We look forward to seeing what else the partnership offers in the future.
Andrea Hayden, November 20, 2012
Sponsored by ArnoldIT.com, developer of Augmentext
eDiscovery Definition Confusion is Common but Unnecessary
November 20, 2012
Confusion over eDiscovery practices is common, even when turning to those that are supposed “experts” in the field. According to the post “Many Practitioners ‘Dazed and Confused’ Over Electronic Discovery Definitions” on the Clearwell Systems eDiscovery blog, numerous and various definitions on the term “electronic discovery” exist across the industry.
The blog post takes a look at the differences and missing factors in the definitions across the board:
“First, the EDRM definition focuses (as some might expect) on the tactics and practice of eDiscovery. This is a useful starting place, but they’ve missed out on other elements, like the overall market dynamics, which are discussed (again not surprisingly) by Gartner. Gartner likewise addresses how eDiscovery is accomplished, referencing the need for software and the escalating trend of taking eDiscovery tools in house. Sedona (coming from a legal theory perspective) relies heavily on the legal definition of ‘discovery,’ properly referencing its context in the legal process […]”
If experts do not seem to agree on even a definition and key points, what else is inconsistent in the field? Costs, risks, and and uses are likely conflicting as well. We cannot help but notice a striking similarity to the confusion about business intelligence and Big Data analytics. What is not confused today?
Andrea Hayden, November 20, 2012
Sponsored by ArnoldIT.com, developer of Augmentext
IntelTrax Summary: November 9 to November 15
November 19, 2012
This week, the IntelTrax advanced intelligence blog published some important information regarding the state of big data and its impact on some of the world’s most up and coming industries.
“The Ethics of Big Data” examines the possible ethical quandries that develop from big data analysis. However, despite the potential ethical challenges that face the industry in the end the pros, outweigh the cons.
The article states:
“Yet it cuts both ways: Consumers also can take advantage of the democratizing effects of big data. In fact, there’s an app for that: RateDriverenables users to quickly determine the appropriate rate they should expect to pay for attorney’s fees in 51 U.S. markets.
Big data holds promise to improve the legal profession and the quality of service that we deliver to clients, says Carolyn Elefant, a Washington, D.C., attorney and technology evangelist. “Significantly, big data would inject a strong dose of transparency into lawyer marketing and assist consumers in hiring lawyers. How so? Because big data can be used to show the likelihood of winning a case and the true cost.”
An article that shows the way that big data is transforming the healthcare industry is, “Big Data is the New Anti-Virus.” However, it looks at it from the angle of computer health and how to better detect viruses.
The article states:
“With Seculert Sense, customers can now upload log files using a Secure FTPS tunnel, or upstream logs through Syslog directly from a secure web gateway or web proxy devices, or log aggregation solution for real-time detection and forensics investigation. Built on Amazon Elastic MapReduce, Seculert Sense launches a “big data analysis cloud” that rapidly analyzes an organization’s vast amount of log data, going back months or even years and comparing it against the thousands of unique malware samples collected by Seculert. Over time, Seculert Sense continues to digest huge amounts of data in order to identify persistent attacks that are going undetected by next generation IPs, Anti-Bot and Secure Web Gateways.”
Big data analytics is not only taking off in America, it is becoming a world-wide phenomenon. “Asian Analytics on the Verge of a Boom” describes the potential for big data analytics success in Asia.
According to the article,
“Two different consumer analytics platforms from Singapore Management University (SMU) and StarHub respectively aim to provide insights into consumer behavior, so companies can develop and tailor initiatives that will be more relevant to and better received by customers.
Rajesh Balan, director of LiveLabs Urban Lifestyle Innovation Platform at SMU, said the platform will enable organizations to utilize real-time insights, helping their campaigns go to market and assess the outcome faster. On the consumer end, it will turn what most users perceive as intrusive spam messages on their phones into something useful.”
It does not matter what country you live in or what industry you work in. Big Data analytics technology is becoming too important to overlook. Digital Reasoning has been using automated understanding of big data for nearly a decade.
Jasmine Ashton, November 19, 2012
Sponsored by ArnoldIT.com, developer of Augmentext
PolySpot Technology Captures and Disseminates Information in Real Time
November 16, 2012
The uncertain economic times have evolved into a new paradigm, thanks to big data and the advent of business intelligence software. Business Finance discusses how many companies have been able to turn uncertainty into insights and opportunities. The article, “How Business Intelligence Software Solves Top Financial Challenges” explains that the three of the biggest barriers to handling big data are complexity, high costs, and the need for real-time insight.
The core of the article’s idea is summarized in it’s closing:
Some of the key trends driving next-generation solutions include visual displays for easier consumption of data as well as in-memory and mobile technologies that are changing the speed of data delivery as well as accessibility. BI success isn’t just about having a lot of data. Making the right information available to the right people at the right time is critical.
The ultimate realization for companies today is that insights and important information is not possible without the right enterprise software solutions. Innovations from PolySpot such as their Information At Work software delivers vital information to all users in the enterprise. From lower-level executives to the CFO, ideas will be captured and disseminated in near real-time.
Megan Feil, November 16, 2012
Sponsored by ArnoldIT.com, developer of Augmentext.