An Existential Question: What Do Business Intelligence Tools Do?
February 10, 2021
Business intelligence tools are integral for enterprise systems to achieve their optimum performance, but without technology expertise it is difficult to understand their importance. Towards Data Science explains how BI tools can help a business in the article, “What BI Tools Can Do—The Six Different BI Artifacts You Should Know.”
According to the article, the six BI artifacts are spreadsheets, OLAP cube, visuals (reports and dashboards), stories, graphs, and direct access. Most BI tools do not feature all six BI tools and neither do companies. This does not allow end users to work at their best. There are work arounds and smart end users know how to utilize them.
Each artifact has its weaknesses and the only way to solve them is work around them like when there is a lack of tools:
“We basically have to do the same thing we do in the rest of our software architecture. We can build modular things, architectures where we can quickly exchange the EL in our EL (T). Where we can quickly exchange our storage, our reporting tool for a notebook based architecture. We can build evolutionary architectures, where we are perfectly clear on our fitting function, the quality of our answers to current problems. Where we know we will take small iterative steps towards providing better answers.”
It helps to be versed in all tools to improve BI structure, but it is even better to have access to the entire toolbox. Developers and workers are only as good as their tools.
Whitney Grace, February 10, 2021
Dashboards Evil? Worth a Thought. Nah, Just Take What Is Output
February 1, 2021
Business intelligence (BI) is jargon for the technologies and strategies used to manage business data analytics. It is a fancy term for standard operating procedures and looks good on a resume, but one IT CEO wants to make it obsolete. Diginomica discusses how BI could head to the recycling bin in the article: “ThoughtSpot CEO-‘I Want To Kill BI And I Want All Dashboards To Die.’”
COVID-19 has changed global business practices and technology experts spent 2020 investigating ways to aggregate business data. ThoughtSpot CEO Sudheesh Nair explained in the article that traditional aggregation patterns do not apply anymore and companies need to change in order to maintain their customers. Nair believes his ThoughtSpot platform, described as ‘Google for numbers,’ will deliver key insights the same way Google provides information.
Nair pointed out that opinions are easily accessible via a Google search, but facts are harder to find in the endless search results. Nair wants his ThoughSpot platform to make facts as easily accessible as opinions. ThoughtSpot combines hardened facts with a NLP interface to make finding facts easier, think Windows 95 versus the old command land interface:
“ThoughtSpot does this by allowing users to search enterprise data with hyper-personalized questions using natural language processing. It aims to not only give a result for the question you ask, but then also uses AI to offer up alternative questions and results that may be helpful. This is very different to traditional BI, which typically offers you a template for which to present historical, aggregate data.”
In other words, Nair wants to sift the information noise from facts. Today’s BI dashboards offer a plethora of information, but lack personalization notes that could win new customers and retain older ones.
ThoughtSpot will supposedly combine old data with new data to push out BI dashboards and create a new data analytics space for businesses. Nair’s description of ThoughtSpot is an interesting pitch, but it sounds more like a new way to search information. Instead of explaining how ThoughtSpot works it would be better to offer demonstrations of its capabilities.
But thinking? Not the core competency of the thumb typing generations.
Whitney Grace, February 1, 2021
InterSystems Releases BI Tool Adaptive Analytics
November 5, 2020
Data technology firm InterSystems is launching an addition to its IRIS platform, IRIS Adaptive Analytics. ChannelLife reports, “InterSystems Releases Solution for Self-Service BI.” InterSystem’s platform already provided data integration, data management, and analytics tools to its clients in the fields of finance, healthcare, business, and government. Adaptive Analytics adds advanced data analytics designed for use without having to call in the IT department at every turn. We learn:
“The solution provides business users with ease of use and self-service analytics capabilities to visualize, analyze, and interrogate live data and get the information they need in order to make business decisions without being experts in data design while providing the ability for IT and data stewards to apply centralized control. … The new solution provides seamless integration between live data in InterSystems IRIS and popular third-party business intelligence (BI) tools including Tableau, as well as Microsoft Power BI and Microsoft Excel. InterSystems IRIS Advanced Analytics simplifies the process for data designers to manage a common analytic data model and for business users to create and modify BI dashboards without needing IT involvement. The Adaptive Analytics solution also extends the scalability of InterSystems IRIS to support analytic workloads with larger data sets. … InterSystems IRIS Adaptive Analytics adds relational online analytical processing (ROLAP) capabilities to complement the existing multidimensional online analytical processing (MOLAP) capabilities already offered with InterSystems IRIS.”
InterSystems partnered with data virtualization firm AtScale to develop Adaptive Analytics, and it announced the development at its recent InterSystems Virtual Summit 2020. The new solution will be available in an upcoming IRIS release. Based in Cambridge, Massachusetts, InterSystems was founded back in 1978.
Cynthia Murrell, November 5, 2020
Web Scraping Made Easier
October 14, 2020
If one has a list of Web sites of interest, how can a person suck down the content? In the consumerized world of business intelligence, the answer is, “Every day.” Crawling Web sites is getting easier. Scrape Owl wants to make the process ever simpler. For as little as $30 per month you can chug along with 250,000 API calls and 10 concurrent requests. If you need more scraping horsepower, sign up for the $100 per month service. You use Scrape Owl’s API and can custom headers, cookies, and inject JavaScript. The more expensive service also allows proxies. These can be helpful under certain circumstances because some site operators are not keen on slurping. For more information, navigate to Scrape Owl’s FAQ page and take your first steps to becoming the new Google.
Stephen E Arnold, October 14, 2020
2020: Reactive, Semi-Proactive, and Missing the Next Big Thing
July 27, 2020
I wanted to wrap up my July 28, 2020, DarkCyber this morning. Producing my one hour pre recorded lecture for the US National Cyber Crime Conference sucked up my time.
But I scanned two quite different write ups AFTER I read “Public Asked To Report Receipt of any Unsolicited Packages of Seeds.” Call me suspicious, but I noted this passage in the news release from the Virginia Department of Agriculture and Consumer Services:
The Virginia Department of Agriculture and Consumer Services (VDACS) has been notified that several Virginia residents have received unsolicited packages containing seeds that appear to have originated from China. The types of seeds in the packages are unknown at this time and may be invasive plant species. The packages were sent by mail and may have Chinese writing on them. Please do not plant these seeds.
And why, pray tell. What’s the big deal with seeds possibly from China, America’s favorite place to sell soy beans? Here’s the key passage:
Invasive species wreak havoc on the environment, displace or destroy native plants and insects and severely damage crops. Taking steps to prevent their introduction is the most effective method of reducing both the risk of invasive species infestations and the cost to control and mitigate those infestations.
Call me suspicious, but the US is struggling with the Rona or what I call WuFlu, is it not? Now seeds. My mind suggested from parts unknown that perhaps, just perhaps, the soy bean buyers are testing another bio-vector.
As the other 49 states realize that they too may want to put some “real” scientists to work examining the freebie seeds, I noted two other articles.
I am less concerned with the intricate arguments, the charts, and the factoids and more about how I view each write up in the context of serious thinking about some individuals’ ability to perceive risk.
The first write up is by a former Andreessen Horowitz partner. The title of the essay is “Regulating Technology.” The article explains that technology is now a big deal, particularly online technology. The starting point is 1994, which is about 20 years after the early RECON initiatives. The key point is that regulators have had plenty of time to come to grips with unregulated digital information flows. (I want to point out that those in Mr. Evans’ circle tossed accelerants into the cyberfires which were containable decades ago.) My point is that current analysis makes what is happening so logical, just a half century too late.
The second write up is about TikTok, the Chinese centric app banned in India and accursed of the phone home tricks popular among the Huawai and Xiaomi crowd. “TikTok, the Facebook competitor?’s” point seems to be that TikTok has bought its way into the American market. The same big tech companies that continue to befuddle analysts and regulators took TikTok’s cash and said, “Come on down.” The TikTok prize may be a stream of free flowing data particularized to tasty demographics. My point is that this is a real time, happening event. There’s nothing like a “certain blindness” to ensure a supercharged online service will smash through data collection barriers.
News flash. The online vulnerabilities (lack of regulation, thumb typing clueless users, and lack of meaningful regulatory action) are the old threat vector.
The new threat vector? Seeds. Bio-attacks. Bio-probes. Bio-ignorance. Big, fancy thoughts are great. Charts are wonderful. Reformed Facebookers’ observations are interesting. But the now problem is the bio thing.
Just missing what in front of their faces maybe? Rona masks and seed packets. Probes or attacks? The motto may be a certain foreign power’s willingness to learn the lessons of action oriented people like Generals Curtis LeMay or George Patton. Add some soy sauce and stir in a cup of Sun Tzu. Yummy. Cheap. Maybe brutally effective?
So pundits and predictive analytics experts, analyze but look for the muted glowing of threat vector beyond the screen of one’s mobile phone.
Stephen E Arnold, July 27, 2020
Another Dust Up: A Consequence of Swisherism?
July 3, 2020
I associate Silicon Valley journalism with the dynamic duo of Swisher and Mossberg. The Walt has retired from the field of battle—almost. Kara Swisher sallies forth. The analytic approach taken by the “I” journalist has had a significant impact on others who want to reveal the gears, levers, and machine oil keeping the Silicon Valley factories running the way their owners and bankers intended.
Hence, Swisherism which I define as:
A critical look at Silicon Valley as a metaphor for the foibles of individuals who perceive themselves as smarter than anyone else, including those not in the room.
A good example of Swisherism’s consequences appears in “Silicon Valley Elite Discuss Journalists Having Too Much Power in Private App.” The write up is like a techno anime fueled with Jolt Cola.
For example:
During a conversation held Wednesday night on the invite-only Clubhouse app—an audio social network popular with venture capitalists and celebrities—entrepreneur Balaji Srinivasan, several Andreessen Horowitz venture capitalists, and, for some reason, television personality Roland Martin spent at least an hour talking about how journalists have too much power to “cancel” people and wondering what they, the titans of Silicon Valley, could do about it.
This is inside baseball given a dramatic twist. Big names (for some I suppose). A country-club app for insiders. An us versus them plot line worthy of Homer. The specter of retribution.
Yikes.
Even more interesting is that the article references a “recording” of what may have been perceived as a private conversation.
There’s nothing to inspire confidence like leaked recordings, right?
There is a sprinkling of foul language. A journalist becomes the target of interest. There is loaded language like “has been harassed and impersonated” to make sure that the reader understands that badness of the situation.
Swisherisms? Sort of, but the spirit is there. The under dog needs some support. Pitch in. Let’s make attitudes “better.” Rah rah.
I particularly like the use of Twitter as a weapon of myth destruction:
Lorenz’s tweet was immediately tweeted about by several Silicon Valley venture capitalists, most notably Srinivasan, who eventually made a seven-tweet thread in which he suggested Lorenz, and journalists like her, are “sociopaths.” That same day, a self-described Taylor Lorenz “parody” Twitter account started retweeting Srinivasan and other tech investors and executives critical of her work. The account’s bio also links to a website, also self-described as parody, which is dedicated to harassing Lorenz. (Twitter told Motherboard it deleted another account for impersonating Lorenz.)
“Lorenz” is the journalist who became the windmill toward which the Silicon Valley elite turned their digital lances.
Net net: Darned exciting. New type of “real” journalism. That’s the Swisherism in bright regalia. Snarkiness, insults, crude talk, and the other oddments of Silicon Valley excitement. No one like constructive criticism it seems. Politics, invective, overt and latent hostility, and a “you should do better” leitmotif. Sturm und drang to follow? Absolutely.
Stephen E Arnold, July 3, 2020
Business Intelligence: When Case Studies Are Not
June 25, 2020
A case study in the good old days was a little soft, a little firm, and a lot mushy. The precise definition of a case study is “it depends.” The problem is that case studies are often not easily duplicated. The data collection methods vary because many organizations do not keep data or, if kept, do not maintain data in a consistent manner. There’s a bright young sprout who wants data in a format unintelligible to other people and maybe systems.
Other minor potholes wander through thickets of subjectivity and into the mysterious world of sparse data. Ever heard, “Well, we don’t have that data, but we can take the inverse of these data and use them.”
The silly idea of answer who, what, why, where, where, and how are often discarded because the information is not available, secret, or just too much work. Just because you know. Meetings.
I thought about the murky world of case studies when I read “5 Valuable Business Intelligence Use Cases for Organizations.” First, there is the word “valuable.” Second, there is the phrase “business intelligence.” Third, there is the jargon “use cases.” Examples is a useful word. Why not employ it?
What caught my attention was that the examples illustrate the type of effort a group of volunteers make when no one wants to work very hard. You may have participated in filling a food basket with canned goods which few would actually consume.
Let’s look at one “use case,” and I will leave it to you to dig through the other four.
Use case number 2 explains how business intelligence can speed up and make better decision making manifest themselves. Okay, we have this pandemic thing. We have a bit of a financial downturn. We have the disruption of supply chains. We have the work from home method. We have Zoom solutions to knit together humans who like to hang out in break rooms and share gossip.
The fix is to use business intelligence to bring
together data mining, data analysis and data visualization to give executives and other business users a comprehensive view of enterprise data, which they can then use to make business decisions in a more informed way.
Now what do these terms mean? Data mining, data analysis, and data visualization. Where to the data come from? Are the data valid? Are the data comprehensive?
The “evidence” in the example is a survey conducted in a sample of an unknown number. The sample which may or may not be representative reports that “reliable data” is a hurdle. No kidding.
The case explains that the shift to real time data is important. Plus real time data piped into predictive analytics allows “fast action.”
The conclusion: Instantaneous decisions are possible.
Net net: The write up is a fluffy promotion of a nebulous concept. Use case my foot! I made an instant decision. Business intelligence like knowledge management and content management is a confection.
That’s why crazy “use case” explanations are needed. The other four examples in the article? Similar. Disconnected. A food basket filled with stuff no one will consume.
Stephen E Arnold, June 25, 2020
Conferences: A Juicy Source of Intelligence?
June 9, 2020
Conferences are interesting. These face-to-face experiences are becoming virtual. After decades of operating off the radar for most attendees, the content of conferences is “suddenly” getting some love.
Decades ago, I worked at a company which produced a database called CPI or Conference Papers Index. That database was sold to another firm, and I am not sure if the original product persists 39 years later. Only a handful of customers accessed this product compared to our flagship databases ABI/INFORM and Business Dateline.
“Potential Organized Fraud in ACM/IEEE Computer Architecture Conferences” caused me to think about who (the people) and the companies (the outfits hiring the people) used CPI. Almost 40 years ago, the who and the companies were either government agencies from countries which now provide high technology to the US and other nation states and companies either based in the US with non-US owners or outfits with names difficult to connect to a particular discipline. Did I care 40 years ago? Nope. We wanted to sell that database for several reasons:
- Conference organizers were among the most disorganized and distracted outfits we tapped for information; for example, copies of talks, abstracts, and names and affiliations of speakers. Much effort and many “let’s have lunch” and “yes, we will send that information tomorrow.” Sorry, lesson learned. Conferences 40 years ago were a different content animal. Fiefdoms, ego centric owners who wanted “total control”, trade associations eager to serve their members and preserve their mostly concierge type jobs, and similar flora and fauna. Much remains unchanged even as conferences undergo Rona-ization.
- Customers were not plentiful. The customers the CPI attracted wanted more: More images, more full text, more presentation foils. Delivering more cost money and it was not clear that if we invested the money to get “more” information that it would be a profitable operation. My hunch is that indexes of conferences, including the wonky listings one can find on the Internet, are essentially useless. Why? Sponsors are not indexed consistently. Names of speakers are not included as searchable content. The presentations, if one is lucky, becomes a YouTube video, usually delivered with both lousy audio and video. Sigh. Conferences are today a black hole of content. Going into the virtual conference business just makes the black hole deeper and weirder than before Rona.
- Conference organization is a remarkable exercise in rejecting, begging, and scrambling. Each conference wants stars for the keynotes. Each conference wants new talent to deliver hot information. Each conference desperately needs sponsors; that is, people to pay for snacks (yuck), liquor (much loved by attendees except for virtual presentations unless a company FedExes bottles to an attendee-with-a-budget’s home), and lunch (now a weird buffet brown bag thing which hopefully will disappear from real and virtual events completely). The organizer wants to put on a stellar show but lacks the expertise, money, and organizational talent to pull off most events.
What’s the fix?
If the information in the write up is accurate, it seems — note the hedge word “seems” — that individuals, companies, and countries are doing everything in their power to get their hands on the same information that people told us to include in our Conference Papers Index.
Valuable data include:
- Abstracts of proposed talks, some submitted a year before an event in certain event cycles
- The actual draft presentations: Text, PDFs of the visuals, author’s biography, and author details
- Names of speakers, addresses, email, etc.
The blog post suggests that some fancy dancing has been underway in the rarified world of big tech at the ACM and IEEE computer architecture conferences.
The article is worth reading.
However, there is context for what amounts to intelligence exploitation.
The question is, “Will most conference organizers care?” Another question, “Will most conference organizers be sufficiently adept at addressing the alleged problem?”
DarkCyber has a tentative answer, “Nope. The sucking of conference data is an institutionalized behavior for many “experts,” their employers, some government entities, and even employees of conference companies.
Net net: Squeeze the fruit for informational juice.
Stephen E Arnold, June 9, 2020
MBA Think Reveals a Stunningly Obvious Insight
April 16, 2020
I am not sure when I began to feel uncomfortable with MBA speak. Perhaps it was after I developed an aversion to lawyer speak? On the other hand, my reaction could have been triggered by the rash I developed when I was exposed to accountant speak. Each “specialty” has its own lingo. But MBA speak is usually fascinating.
I read “Coronavirus Clarity.” The write up explains that the present medical challenge makes it clear that large technology companies have “power.” There is the patois of the MBA; for example:
- Conversation
- Differentiation
- Scale
- Zero margins
There are examples: Apple, Facebook, et al.
What’s the main idea?
The big technology companies like Apple, Facebook, et al are powerful.
Amazing. Who knew these monopolies were capable of collusion and operating as nation states. I feel in a way similar to Jonathan Edwards’ reaction to his revelatory moment in the woods.
Who knew? Plus, those not associated with Apple, Facebook et al should be grateful these firms are just doing so much for everyone. Proof? Check out “Google’s Former CEO Hopes the Coronavirus Makes People More Grateful for Big Tech.” Absolutely.
Stephen E Arnold, April 16, 2020
Acquisdata: High Value Intelligence for Financial and Intelligence Analysts
March 31, 2020
Are venture capitalist, investment analysts, and other financial professionals like intelligence officers? The answer, according to James Harker-Mortlock, is, “Yes.”
The reasons, as DarkCyber understands them, are:
- Financial professionals to be successful have to be data omnivores; that is, masses of data, different types, and continuously flowing inputs
- The need for near real time or real time data streams can make the difference between making a profit and losses
- The impact of changing work patterns on the trading floor are forcing even boutique investment firms and global giants to rely upon smart software to provide a competitive edge. These smart systems require data for training machine learning modules.
James Harker-Mortlock, founder of Acquidata, told DarkCyber:
The need for high-value data from multiple sources in formats easily imported into analytic engines is growing rapidly. Our Acquisdata service provides what the financial analysts and their smart software require. We have numerous quant driven hedge funds downloading all our data every week to assist them in maintaining a comprehensive picture of their target companies and industries.”
According to the company’s Web site, Acquisdata:
Acquisdata is a fast growing digital financial publishing company. Established in 2010, we have quickly become a provider to the world’s leading financial news companies, including Thomson Reuters/Refinitiv, Bloomberg, Factset, IHS Markit, and Standard and Poor’s Capital IQ, part of McGraw Hill Financial, and ISI Emerging Markets. We also provide content to a range of global academic and business database providers, including EBSCO, ProQuest, OCLC, Research & Markets, CNKI and Thomson Reuters West. We know and understand the electronic publishing business well. Our management has experience in the electronic publishing industry going back 40 years. We aim to provide comprehensive and timely information for investors and others interested in the drivers of the global economy, primarily through our core products, the Industry SnapShot, Company SnapShot and Executive SnapShot products. Our units provide the annual and interim reports of public companies around the world and fundamental research on companies in emerging markets sectors, and aggregated data from third-party sources. In a world where electronic publishing is quickly changing the way we consume news and information, Acquisdata is at the very forefront of providing digital news and content solutions.
DarkCyber was able to obtain one of the firm’s proprietary Acquisdata Industry Snapshots. “United States Armaments, 16 March 2020” provides a digest of information about the US weapons industry. the contents of the 66 page report include news and commentary, selected news releases, research data, industry sector data, and company-specific information.
Obtaining these types of information from many commercial sources poses a problem for a financial professional. Some reports are in Word files; some are in Excel; some are in Adobe PDF image format; and some are in formats proprietary to a data aggregator. We provide data in XML which can be easily imported into an analytic system; for example, Palantir’s Metropolitan or similar analytical tool. PDF versions of the more than 100 weekly reports are available.
DarkCyber’s reaction to these intelligence “briefs” was positive. The approach is similar to the briefing documents prepared for the White House.
Net net: The service is of high value and warrants a close look for professionals who need current, multi-type data about a range of company and industry investment opportunities.
You can get more information about Acquisdata at www.acquidata.com.
Stephen E Arnold, March 31, 2020
-
- Subscribe to Beyond Search
Feature archive
News archive
-
