Big Data Architecture
January 8, 2013
Log files and their analysis are the next frontier in Big Data. Developers are now beginning to mine the data contained in log files for deeper analysis. SmartData Collective offers a post exploring this very topic. Read “Analyzing Logs and More – a Big Data Architecture” for all of the details.
After a discussion of the technical steps needed to mine this data out of log files, the author provides his conclusion and how he sees it affecting the Big Data developer community:
“Parsing and processing log files tactically is still a grep/awk/sed or some scripting exercise done by a lone super ranger in an IT department or elsewhere. But with the growing strategic value of the data in log files, major product and software vendors are looking to put together a robust technology stack to leverage this information across the enterprise. If done right, this would become a very powerful and unique ‘Big Data’ app providing meaningful insights across the enterprise from product support to engineering and marketing providing both operational and business intelligence from machine logs.”
There are a few noteworthy Big Data vendors who offer smart solutions out-of-the-box. LucidWorks is an industry-standard known for their enterprise search solutions. However, LucidWorks is also in the vanguard of Big Data solution development. LucidWorks Big Data is worth a second look.
Emily Rae Aldridge, January 08, 2013
Sponsored by ArnoldIT.com, developer of Augmentext
Comments
-
- Subscribe to Beyond Search
Feature archive
News archive
-
