The JEDI Knight Wounds Amazon
April 17, 2020
The Bezos bulldozer has stalled against a bureaucratic stone wall. The overheated engine is idling in outside the Pentagon Metro stop. DarkCyber was informed by a couple of helpful readers that the US government is going Microsoft for the significant Joint Enterprise Defense Infrastructure Project. A representative summary of the review of the contract process appeared in “Pentagon: $10B Cloud Contract That Snubbed Amazon Was Legal.” The write up reported:
“We could not review this matter fully because of the assertion of a ‘presidential communications privilege,’ which resulted in several DOD witnesses being instructed by the DOD Office of General Counsel not to answer our questions about potential communications between White House and DOD officials about JEDI,” the report said.
“As a result, we could not be certain whether there were any White House communications with some DOD officials which may have affected the JEDI procurement,” it said.
“However, we believe the evidence we received showed that the DOD personnel who evaluated the contract proposals and awarded Microsoft the JEDI cloud contract were not pressured … by any DOD leaders more senior to them, who may have communicated with the White House,” the report said.
Clear enough. Amazon’s bulldozer may have to reverse and head over to other Executive Branch agencies. Copies of the Bezos bulldozer have been spotted in Australia pushing insurance data and in United Arab Emirates moving digital sand for the government.
The problem for Amazon is that displacing PowerPoint is a very, very tough mountain to move. Just ask Google. Palantir’s baby forklift moved some paperwork while forming a relationship with a certain figure of note in Washington, DC.
Maybe Amazon should wear a fashionable Azure T shirt and wear a Dwarven Ring of Power from The Lord of the Rings available on Etsy?
Stephen E Arnold, April 17, 2020
Acquisdata: High Value Intelligence for Financial and Intelligence Analysts
March 31, 2020
Are venture capitalist, investment analysts, and other financial professionals like intelligence officers? The answer, according to James Harker-Mortlock, is, “Yes.”
The reasons, as DarkCyber understands them, are:
- Financial professionals to be successful have to be data omnivores; that is, masses of data, different types, and continuously flowing inputs
- The need for near real time or real time data streams can make the difference between making a profit and losses
- The impact of changing work patterns on the trading floor are forcing even boutique investment firms and global giants to rely upon smart software to provide a competitive edge. These smart systems require data for training machine learning modules.
James Harker-Mortlock, founder of Acquidata, told DarkCyber:
The need for high-value data from multiple sources in formats easily imported into analytic engines is growing rapidly. Our Acquisdata service provides what the financial analysts and their smart software require. We have numerous quant driven hedge funds downloading all our data every week to assist them in maintaining a comprehensive picture of their target companies and industries.”
According to the company’s Web site, Acquisdata:
Acquisdata is a fast growing digital financial publishing company. Established in 2010, we have quickly become a provider to the world’s leading financial news companies, including Thomson Reuters/Refinitiv, Bloomberg, Factset, IHS Markit, and Standard and Poor’s Capital IQ, part of McGraw Hill Financial, and ISI Emerging Markets. We also provide content to a range of global academic and business database providers, including EBSCO, ProQuest, OCLC, Research & Markets, CNKI and Thomson Reuters West. We know and understand the electronic publishing business well. Our management has experience in the electronic publishing industry going back 40 years. We aim to provide comprehensive and timely information for investors and others interested in the drivers of the global economy, primarily through our core products, the Industry SnapShot, Company SnapShot and Executive SnapShot products. Our units provide the annual and interim reports of public companies around the world and fundamental research on companies in emerging markets sectors, and aggregated data from third-party sources. In a world where electronic publishing is quickly changing the way we consume news and information, Acquisdata is at the very forefront of providing digital news and content solutions.
DarkCyber was able to obtain one of the firm’s proprietary Acquisdata Industry Snapshots. “United States Armaments, 16 March 2020” provides a digest of information about the US weapons industry. the contents of the 66 page report include news and commentary, selected news releases, research data, industry sector data, and company-specific information.
Obtaining these types of information from many commercial sources poses a problem for a financial professional. Some reports are in Word files; some are in Excel; some are in Adobe PDF image format; and some are in formats proprietary to a data aggregator. We provide data in XML which can be easily imported into an analytic system; for example, Palantir’s Metropolitan or similar analytical tool. PDF versions of the more than 100 weekly reports are available.
DarkCyber’s reaction to these intelligence “briefs” was positive. The approach is similar to the briefing documents prepared for the White House.
Net net: The service is of high value and warrants a close look for professionals who need current, multi-type data about a range of company and industry investment opportunities.
You can get more information about Acquisdata at www.acquidata.com.
Stephen E Arnold, March 31, 2020
Smart Intelligence Analysis Software: What Operators Need Versus What Operators Get
February 24, 2020
DarkCyber noted “The ABCs of AI Enabled Intelligence Analysis.” The major problem with today’s intelware solutions is stated clearly:
The inability to adjust analysis tools to the operational environment is a prodigious problem.
Vendors want operators (licensees) to adapt to their environment. The idea is that the vendor’s environment is the only way to get the most out of an intelware system. What if the customer does not like this approach? Yeah.
Now the marketers, developers, and field engineers will insist that this statement is incorrect.
Here’s a passage from the write up which explains the operator’s point of view:
There are two key concepts to any data-centric system: First, analysis tools and applications should change with the data, and second, data should be easily accessible. Analysts must be able to configure the tools and algorithms of the systems to meet the realities of the battlefield, and data access should be as seamless as possible.
So what’s wrong? Here’s the explanation:
Within a data-centric context, the use of machine learning algorithms has led to breakthroughs in nearly every analysis endeavor, from fraud detection to image identification. To take advantage of these advances, intelligence analysts need systems that allow them to use computational tools and to constantly adjust, or retrain, their algorithms to a changing battlefield. Unfortunately, nearly all analysis software products in use today — including advanced systems like Palantir or Analyst Notebook — are closed systems that do not allow analysts to code custom algorithms, use the latest machine-learning algorithms, use the latest research in “explainable AI,” or even allow analysts to provide feedback to the software’s algorithms.
DarkCyber recommends taking a look at this write up.
Several observations:
- Marketers, vendors, and field engineers are busy with their own agendas. As a result, paying customers are usually ignored. Their requests are not on the road map, too difficult to make, or of no interest.
- Existing intelware solutions are purpose built to require training, support, and tradition. In one demo, the marketer could not understand that his actions were obscured by the control panel of the video conferencing system used to show off features. The person did not listen; the eager beaver was on auto pilot.
- Legacy systems like Analyst Notebook are often rarely used. The license is simply paid because, as one top dog law enforcement professional told me, “We don’t want to be without it. But no one has been to training recently. It is just here.”
These three problems are not part of the “AI baloney party.” I think these dot points underscore how deep the disconnect and how severe a problem today’s intelware helps foster.
For those who want to point out that certain tools developed in other countries are “better, faster, and cheaper.” Based on DarkCyber’s exposure to these systems, the newest tools are repeating the errors of the past 20 years.
A goldfish knows only water. The real world is different. But intelware fish don’t die. They force the customer to learn how to exist within their watery world.
Stephen E Arnold, February 24, 2020
Live at Five: Queue the Avatar! Slash Costs!
February 12, 2020
Thomson Reuters has been looking for a revenue hockey stick since Michael Brown and Gene Garlan departed. The company has not been a home run in the innovation department. Palantir Technology did not provide the zoom zoom some stakeholders wanted. The Thomson “labs”. Sorry, no TikTok from those hard working Thomson Reuter wizards.
The fix, however, may be deep fakes, automated news, and some AI sizzle. Reddit, a social information service, posted a link to “Reuters Built a Prototype for Automated News Videos Using Deepfakes Tech.” The write up explains:
Designed as a proof-of-concept, the system takes real-time scoring data from football matches and generates news reports complete with photographs and a script. Synthesia and Reuters then use a neural network similar to Deepfakes and prerecorded footage of a real news anchor to turn the script into a “live” video of the news anchor giving up-to-the-second scoring updates.
The technology comes from Synthesia, founded in 2017. (One of the company’s investors is the Sharktank and video savant Mark Cuban.) The company describes itself as a “next gen content creation” outfit.
You can try the service by navigating to this link. I said I was Nancy. And this fake humanoid delivered a short summary to me:
The company’s Web site says:
Go beyond the regular edit suite … forge more meaningful relationships with your global audiences using Synthesia’ powerful content tools.
Is this the winner Thomson Reuters has been seeking for a decade or so? If the company applies its 10-10-20 formula, that’s possible, just unlikely. If today’s Thomson Reuters can manage some of the Lord Thomson of Fleet magic, the professional publishing and news company could disrupt how news can be generated and streamed at bargain basement rates. Hasta la vista talking heads.
An avatar with real AI will present the news: Objective, content rich, and without the hassles of humans, vacations, benefits, and dealing with wimpy humanoid issues like “my manager is not treating me fairly.”
Worth watching.
Stephen E Arnold, February 12, 2020
About That Google-Rejected Project Maven
December 20, 2019
Anyone familiar with data-systems firm Palantir knows the company makes no apologies for supporting the U.S. military (among others) with their platforms. So it comes as no surprise that it is picking up where Google left off— The Next Web shares their “Report: Palantir Took Over Project Maven, the Military AI Program Too Unethical for Google.” Writer Tristan Greene explains:
“Project Maven, for those unfamiliar, is a Pentagon program to build an AI-powered surveillance platform for unmanned aerial vehicles. Basically, the job is to build a system for the US military to deploy and monitor autonomous drones. This system would, supposedly, give the government real-time battlefield command and control and the ability to track, tag, and spy on targets without human involvement. The limited, unclassified information available makes it appear as though the project stops just short of functioning as an AI weapons system capable of firing on self-designated targets as they become available in the battle space. …
“The Pentagon didn’t have to look very far to find a company willing to pick up where Google‘s ethics left off. Palantir, the company that powers ICE and CBP’s surveillance networks and builds software for police that circumvents the warrant process, is reportedly chugging away on Project Maven.”
We’re reminded Palantir founder Peter Thiel expressed disdain for Google after it dropped Maven following employee protest. Not only has Thiel insisted tech companies are honor bound to help the government with, seemingly, whatever it asks, he also points out Google’s history of working with the Chinese government. Greene notes that, though “we stand on the cusp of AI-powered warfare,” our federal government has yet to develop an official policy on the ethics of military use of AI. The possibilities are endless. Next up: Anduril, another outfit which finds joy where Google finds management challenges.
Cynthia Murrell, December 20, 2019
Ancient Search Recipes: Bread Pork Chops
December 16, 2019
I noted a report in the Times of Israel titled “Cache of Crypto-Jewish Recipes Dating to Inquisition Found in Miami Kitchen.” One of the recipes explained how to make a pork chop from bread and milk. (Dairy? Guess so.) Here’s what you and I can whip up using this ancient recipe:
The cookbook contains information which the author “didn’t think to question the idiosyncratic customs her mother and grandmothers practiced in the kitchen.”
By coincidence, my news alert spit out this article in the same list: “The Growth of Cognitive Search in the Enterprise, and Why It Matters.”
Magic. Bread pork chops created from zeros and ones.
Search matters. Cognitive search matters more. Who buys? The enterprise.
The write up recycles the equivalent of the break pork chop formula. Mix jargon, sprinkle with the notion of federated data, and bake until the checks clear the bank.
The article is fascinating, and it overlooks a few milestones in the history of enterprise search. What for example? Glad you asked:
- Forrester, the Wave folks, has created a report for its paying customers which reveal that search is now cognitive, able to tap dark data, and ready for prime time. Again! The Wave returns.
- Big companies are into search, including Microsoft with its Fast inspired solution and Amazon Kendra with an open source how de doo to Elastic and LucidWorks. Some use old spices; others, open source flavoring with proprietary special seasonings.
- Outfits which have been around for more than a decade like Coveo are now smarter than ever in their decade long effort to pay off their patient investors
- Autonomy gets a nod despite the interesting trial underway in the UK.
The point is that enterprise search is going to be in the news whether anyone wants to revisit hyperbole which makes the chatter around artificial intelligence and quantum computing seem rational and credible.
Here’s a quick refresher about why untapped data in an organization is likely to remained untapped or at the very least not tapped by vendors of smart key word search systems:
First, data are in silos for a reason. No enterprise search system with which I am familiar can navigate the permissions and access controls required to put siloed data in one index. There’s a chance that the Amazon blockchain permissions system can deliver this, but for now, the patents are explanations and federated enterprise search is a sales pitch.
This Snooping Stuff
December 14, 2019
The Economist’s story “Offering Software for Snooping to Governments Is a Booming Business” sounds good. The article is locked behind a paywall so you will have to sign up to read the quite British analysis. There are some interesting comments zipping around about the article. For example, a useful thread appears at this link.
Several observations struck me as informative; for example:
- The Economist does not mention Cisco. This is important because Cisco has an “intelligence” capability with some useful connections to innovators in other countries.
- Palantir, a recipient of another US government contract, is not mentioned in the write up. For information about this new Palantir project, navigate to “Palantir Wins New Pentagon Deal With $111 Million From the Army.” This is paywalled as well.
- There is even a reference to surveillance technology delivering a benefit.
Perhaps those interested in surveillance software will find the interview Robert Steele, a former CIA professional, conducted with me. You can find that information at this link.
Perhaps the Economist will revisit this topic and move beyond NSO Group and colloquial language like snooping?
Stephen E Arnold
Why Is MiningLamp Getting Ink?
December 3, 2019
The question “Why is MiningLamp getting ink?” is an interesting one to some people. The firm was founded in 2014. The company was a product of bunsha practiced by Miaozhen Systems, a company engaged in advertising “analysis.” The company is funded by Tencent, China Renaissance, and Sequoia Capital China. The firm may have revenues in the hundreds of millions of dollars. Data about the influence of the Chinese government is not available to the DarkCyber team at this time. MiningLamp may have received as much as $290 million from its backers.
Companies want publicity to get sales leads, attract investors, create buzz to lure new hires, and become known to procurement professionals in government agencies.
We noted talk about MiningLamp at a couple of law enforcement and intelligence conferences. The company provides policeware and intelware to customers in China and elsewhere. You can read about the firm on its Web site at this link. (Be patient. The service seems to provide a high latency experience.) Product pages also seem to be missing in action.
Nevertheless, “Chinese Data Mining Firm MiningLamp, Now a National AI Champion, Began by Helping Police Solve Crimes” does not talk about a dearth of public information. The write up states that “MiningLamp’s business analytics tools are used by more than 200 companies in the Fortune 200.” That’s a lot of big companies embracing investigative software. Judging from the attendees at law enforcement and intelligence conference, these big companies are finding out about a Chinese company somehow.
The news story states that “Like Palantir, this Chinese start up uses AI to help corporate clients convert huge volumes of data into actionable information.” Palantir is a big ticket item. Perhaps price is a factor or Fortune 200 companies want to rely on a business intelligence system operated by a company located outside the span of control of some government authorities.
The company has been named a Chinese champion. The article reveals:
Although not as well known as US equivalent Palantir Technologies, which reportedly contributed to America’s success in hunting down Osama bin Laden, MiningLamp’s data mining software is used to spot crime patterns, track drug dealers and prevent human trafficking.
DarkCyber thinks that any company which has 200 Fortune listed companies as customers is reasonably well known.
We learned:
“Cases are being resolved on our platforms every day” in more than 60 cities and regions in China, said founder and CEO Wu Minghui. “We can run fast analysis on potential drug dealers or major suspects, improving the overall case-solving efficiency several hundred times.”
DarkCyber for December 3, 2019, Now Available
December 3, 2019
DarkCyber for December 3, 2019, is now available at on Vimeo, YouTube, and on the DarkCyber blog.
The program is a production of Stephen E Arnold. It is the only weekly video news shows focusing on the Dark Web, cybercrime, and lesser known Internet services.
This week’s program features an interview with Trent Livingston, founder and chief executive officer of ESI Analyst. Livingston highlights the principal features of ESI Analyst. The cloud-centric software generated positive discussion at a recent law enforcement and digital security conference.
In the 10 minute interview, Livingston explains what makes ESI Analyst different from other investigative and eDiscovery systems. He said, “The system’s principal differentiators are its ease of use and affordability.” Livingston explained that licenses pay for blocks of data processed for an investigation or a legal discovery process. There are no per-user fees or annual fees. Cost savings range from 30 to 70 percent in typical use cases.
Other features of ESI Analyst include one-click analytics, options to display data on a map, and link analysis. Plus the system does not require classroom instruction. He noted, “Some users are up and running in as little as 30 minutes.”
In the next release of the software, Livingston’s team will be adding connectors and new report formats. Users will be able to output chat streams and maps in a form suitable for use in a legal matter. Livingston also revealed support for Amazon Web Services and Elasticsearch to add additional information access flexibility to ESI Analyst.
Stephen E Arnold, author of CyberOSINT: Next Generation Information Access, said, “ESI Analyst advances beyond the challenging interfaces and rigid pricing models for IBM Analysts Notebook- and Palantir Technologies Gotham-type systems. More predictable pricing and eliminating tedious classroom instruction reduces costs and improves efficiency. ESI Analyst makes clear the value of innovation for policeware.”
DarkCyber is a weekly production of Stephen E Arnold. The currency series of videos ends with the August 27, 2019, program. The new series of DarkCyber videos begins on November 5, 2019. The new series will focus on policeware with an emphasis on Amazon’s products and services for law enforcement, intelligence professionals, and regulatory authorities in the US, Canada, Australia, New Zealand, and the United Kingdom.
DarkCyber programs are published twice each month without a charge, advertising, or commercial endorsements.
Stephen E Arnold will be speaking on December 11, 2019, at the Mayflower Hotel in Washington, DC. The event is sponsored by DG Vision. Media interested in speaking with Stephen can write darkcyber333 at yandex dot com to arrange a time to discuss the Dark Web and its impact on corporate governance.
Kenny Toth, December 3, 2019
Open Source Goodness? Not So Fast
November 18, 2019
DarkCyber does not have a dog in the fight. Open source software has been an interesting sector. However, there may be some tension in open source land. If you have a stake in open source software, you will want to read “Venture Capital Shillscapegoating Free Software’s Failures.” I noted this statement in the article:
Venture capitalists and hireling lawyers make convenient scapegoats. The old, creaky pillars of the free software movement need convenient scapegoats, because the facts on the ground raise serious doubt about the effectiveness of their leadership and the byzantine, insular ideology of copyleft they impose. When the facts don’t help, substitute narrative. You can rule on narrative alone, at least for a while.
Free software has found its way into some interesting products and services. Some of these are backed by big money; for example, LucidWorks, Palantir, and even IBM Watson.
So what?
No answers shall be forthcoming from DarkCyber. You, gentle reader, are on your own to ponder the Amazon open source plays, the future of proprietary software stripped of open source goodness, and venture firms betting that the “community” will keep on being communal.
Stephen E Arnold, November 18, 2019
-
- Subscribe to Beyond Search
Feature archive
News archive
-
