Quote to Note: Google and Its Red Herrings
March 9, 2017
I read “Google Makes Such a Big Deal Out of Everything But Its Search Business.” Wake up call. Google is going on 20 years of fun and excitement in online and content processing. It’s been running the same game plan for maybe 14, 15 years. It is good that CNBC is sort of thinking about the GOOG.
In the write up, there is a quote which I noted. The rest of the write up is pretty forgettable. Here’s the statement allegedly made by Peter Thiel, founder of Palantir Technologies and adviser to the new US administration. Here’s the comment:
If you have a monopoly, you will tell people you are in a super-competitive business. And if you are in a super-competitive business, you will tell people that you have a monopoly of sorts. So for example, if you have a search company in Silicon Valley that I will not name, if you were to go around to CEOs saying, ‘We have a bigger share of the market and higher profit margins than Microsoft ever had in the 1990s,’ you wouldn’t do that…You don’t even talk about search. You say, ‘We are a technology company with an enormous space called technology, and we’re competing with Apple on smartphones, and we’re competing on self-driving cars, and there’s competition in everything we’re doing except this one thing called search, and we never talk about that.'”
Stephen E Arnold, March 9, 2017
Companies As Countries: Facebook Plans for Its Social Nation State
February 26, 2017
I read some of the Facebook manifesto. About half way through the screed I thought I was back in a class I audited decades ago about alternative political structures. That class struck me as intellectual confection, a bit like science fiction in 1962. The Facebook manifesto shared some ingredients, but it is an altogether different recipe for a new type of political construct. Facebook, not Google, is the big dog of information control. Lots of folks will not be happy; for example, traditional “real” journalists who want to pull the info-yarn and knit their vision of the perfect muffler and other countries who want to manage their information flows.
I thought about my “here we go again” reaction when I read “Facebook Plans to Rewire Your Life. Be Afraid.” Sorry, I am not afraid. Maybe when I was a bit younger, but 74 years of “innovative” thinking have dulled my senses. The write up which is from the “real” journalism outfit Bloomberg is more sensitive than I am. If you are a Facebooker, you will be happy with the Zuck’s manifesto. If you are struggling to figure out what is going on with hundreds of millions of people checking their “friends” and their “likes,” you will want to read the “real news” about Facebook.
Spoiler: Facebook is a new type of country.
The write up “reports”:
Facebook — launched, in Zuckerberg’s own words five years ago, to “extend people’s capacity to build and maintain relationships” — is turning into something of an extraterritorial state run by a small, unelected government that relies extensively on privately held algorithms for social engineering.
Yep, the same “we can do it better” thinking has infused many other high technology companies. Some see the attitude as arrogance. I see the approach as an extension of a high school math team. No one in the high school cares that much about the boys and girls who do not struggle to understand calculus. Those in the math club know that the other kids in the school just don’t “get it.”
The thinking has created some nifty technology. There’s the GOOG. There’s Palantir. There’s Uber. No doubt these companies have found traction in a world which seems to lack shared cultural norms and nation states which seem to be like a cookie jar from which elected officials take handfuls of cash.
The write up points out:
As for the “rewired” information infrastructure, it has helped to chase people into ideological silos and feed them content that reinforces confirmation biases. Facebook actively created the silos by fine-tuning the algorithm that lies at its center — the one that forms a user’s news feed. The algorithm prioritizes what it shows a user based, in large measure, on how many times the user has recently interacted with the poster and on the number of “likes” and comments the post has garnered. In other words, it stresses the most emotionally engaging posts from the people to whom you are drawn — during an election campaign, a recipe for a filter bubble and, what’s more, for amplifying emotional rather than rational arguments.
The traditional real journalists are supposed to do this job. Well, that’s real news. The New York Times wants to be like Netflix. Sounds great. In practice, well, the NYT is a newspaper with some baggage and maybe not enough cash to buy a ticket to zip zip land.
The real news story makes an interesting assertion:
It’s absurd to expect humility from Silicon Valley heroes. But Zuckerberg should realize that by trying to shape how people use Facebook, he may be creating a monster. His company’s other services — Messenger and WhatsApp — merely allow users to communicate without any interference, and that simple function is the source of the least controversial examples in Zuckerberg’s manifesto. “In Kenya, whole villages are in WhatsApp groups together, including their representatives,” the Facebook CEO writes. Well, so are my kids’ school mates, and that’s great.
But great translates to “virtual identify suicide.”
The fix? Get those billion people to cancel their accounts. Yep, that will work in the country of Facebook. I am, however, not afraid. Of course, I don’t use Facebook, worry about likes, or keep in touch with those folks from that audited class.
From my point of view, Facebook and Google to a lesser extent have been chugging along for years. Now the railroad want to lay new track. Your farm in the way? Well, there is a solution. Build the track anyway.
Stephen E Arnold, February 26, 2017
HonkinNews for January 31, 2017 Now Available
January 31, 2017
This weeks’ seven minute HonkinNews includes some highlights from the Beyond Search coverage of Alphabet Google. If you have not followed, Sergey Brin’s participation at the World Economic Forum, you may have missed the opportunity that Google did not recognize. More surprising is that Alphabet Google owns a stake in a company which specializes in predicting the future. IBM Watson had a busy holiday season. The company which has compiled 19 consecutive quarters of declining revenue invented a new alcoholic “spirit”, sometimes referred to as booze, hooch, the bane of Mothers Against Drunk Driving. How did Watson, a software system, jump from reading text to inventing rum? We tell what Watson really did. How did Palantir Technologies respond to a protest in front of its Palo Alto headquarters, known by some as the Shire? Think free coffee, and we reveal what the Beyond Search goose wants when she attends a protest. Beyond Search has an interest in voice search, which seems to be more than an oddity. Learn about the battle between Amazon and Google. The stakes are high because Amazon is not a big player in search, but Alexa technology way be about to kick on of the legs from Google’s online hegemony. DuckDuckGo honked loudly that it experienced significant growth in online search traffic. How close is DuckDuckGo to Google? Find out. Mind that gap. Microsoft has “invented”, rediscovered, or simply copied Autonomy’s Kenjin service from the 1990s. The lucky Word users will experience automatic search and the display of third party information in an Outlook style paneled interface. HonkinNews believes that those writing term papers will be happy with the new “Research.” Yahoot or Yabba Dabba Hoot warrants a mention. The US Securities & Exchange Commission is allegedly poking into Yahoo’s ill timed public release of information about losing its users information. Yep, Yabba Dabba Hoot. Enjoy Beyond Search which is filmed on 8 mm film from the Beyond Search cabin in rural Kentucky.
If you are looking for previous HonkinNews videos, you can find them by navigating to www.googlevideo.com and running the query HonkinNews. Watch for Stephen E Arnold’s new information service, Beyond Alexa. Who wants to type a search query? That’s like real work and definitely not the future.
Kenny Toth, January 31, 2017
Indexing: The Big Wheel Keeps on Turning
January 23, 2017
Yep, indexing is back. The cacaphone “ontology” is the next big thing yet again. Folks, an ontology is a form of metadata. There are key words, categories, and classifications. Whipping these puppies into shape has been the thankless task of specialists for hundreds if not thousands of years. “What Is an Ontology and Why Do I Want One?” tries to make indexing more alluring. When an enterprise search system delivers results which are off the user’s information need or just plain wrong, it is time for indexing. The problem is that machine based indexing requires some well informed humans to keep the system on point. Consider Palantir Gotham. Content finds its way into the system when a human performs certain tasks. Some of these tasks are riding herd on the indexing of the content object. IBM Analyst’s Notebook and many other next generation information access systems work hand in glove with expensive humans. Why? Smart software is still only sort of smart.
The write up dances around the need for spending money on indexing. The write up prefers to confuse a person who just wants to locate the answer to a business related question without pointing, clicking, and doing high school research paper dog work. I noted this passage:
Think of an ontology as another way to classify content (like a taxonomy) that allows you to identify what the content is about and how it relates to other types of content.
Okay, but enterprise search generally falls short of the mark for 55 to 70 percent of a search system’s users. This is a downer. What makes enterprise search better? An ontology. But without the cost and time metrics, the yap about better indexing ends up with “smart content” companies looking confused when their licenses are not renewed.
What I found amusing about the write up is that use of an ontology improves search engine optimization. How about some hard data? Generalities are presented, not instead of some numbers one can examine and attempt to verify.
SEO means getting found when a user runs a query. That does not work too well for general purpose Web search systems like Google. SEO is struggling to deal with declining traffic to many Web sites and the problem mobile search presents.
But in an organization, SEO is not what the user wants. The user needs the purchase order for a client and easy access to related data. Will an ontology deliver an actionable output. To be fair, different types of metadata are needed. An ontology is one such type, but there are others. Some of these can be extracted without too high an error rate when the content is processed; for example, telephone numbers. Other types of data require different processes which can require knitting together different systems.
To build a bubble gum card, one needs to parse a range of data, including images and content from a range of sources. In most organizations, silos of data persist and will continue to persist. Money is tight. Few commercial enterprises can afford to do the computationally intensive content processing under the watchful eye and informed mind of an indexing professional.
Cacaphones like “ontology” exacerbate the confusion about indexing and delivering useful outputs to users who don’t know a Boolean operator from a SQL expression.
Indexing is a useful term. Why not use it?
Stephen E Arnold, January 23, 2017
HonkinNews for January 17, 2017 Now Available
January 17, 2017
This week’s HonkinNews takes a look at Yahoo’s post Verizon name. No, our suggestion of yabba dabba hoo or was it “hoot” was not ignored by Yahoo’s marketing wizards. We also highlight Alphabet Google’s erasure of two letters from its “alphabet.” Goners are “S” and “T”. Palantir is hiring a people centric person. The fancy title may have an interesting spin. Two enterprise search vendors kick off 2017 with a blizzard of buzzwords. The depth of the cacaphones is remarkable because search by any other name would return results with questionable precision and recall. The featured story is the Mitre’s Corporation Jason Report. If you have an interest in artificial intelligence and warfighting, the report provides some insight into what the US Department of Defense may be considering. But the highlight of the unclassified document is a helpful description of Google’s TPU. The seven minute program is at this link. For fans of XQuery, we have a bit of input for you too. Proprietary XQuery too. The program is produced in old fashioned black and white and enhanced with theme music from the days of the Stutz Bearcat. From the hotbed of search and content processing, HonkinNews is different. We’re presenting information other big time outfits ignore. Mitre is a variant of Massachusetts Institute of Technology Research. There you go. Live from Harrod’s Creek.
Kenny Toth, January 17, 2017
BAE Lands US Air Force Info Fusion Job
January 6, 2017
I read “BAE Systems Awarded $49 Million Air Force Research Lab Contract to Enhance Intelligence Sharing.” The main point is that the US Air Force has a pressing need for integrating, analyzing, and sharing text, audio, images, and data. The write up states:
The U.S. Air Force Research Lab (AFRL) has awarded BAE Systems a five-year contract worth up to $49 million to develop, deploy, and maintain cross domain solutions for safeguarding the sharing of sensitive information between government networks.
The $49 million contract will enhance virtualization, boost data processing, and support the integration of machine learning solutions.
I recall reading that the Distributed Common Ground System performs some, if not most, of these “fusion” type functions. The $49 million seems a pittance when compared to the multi-billion dollar investments in DCGS.
My hunch is that Palantir Technologies may point to this new project as an example of the US government’s penchant for inventing, not using commercial off the shelf software.
Tough problem it seems.
Stephen E Arnold, January 6, 2016
First God, Then History, and Now Prediction: All Dead Like Marley
January 3, 2017
I read a chunk of what looks to me like content marketing called “The Death of Prediction.” Prediction seems like a soft target. There were the polls which made clear that Donald J. Trump was a loser. Well, how did that work out? For some technology titans, the predictions omitted a grim pilgrimage to Trump Tower to meet the deal maker in person. Happy faces? Not so many, judging from the snaps of the Sillycon Valley crowd and one sycophant from Armonk.
The write up points out that predictive analytics are history. The future is “explanatory analytics.” An outfit called Quantifind has figured out that explaining is better than predicting. My hunch is that explaining is little less risky. Saying that the Donald would lose is tough to explain when the Donald allegedly “won.”
Explaining is like looser. The black-white, one-two, or yes-no thing is a bit less gelatinous.
So what’s the explainer explaining? The checklist is interesting:
- Alert me when it matters. The idea is that a system or smart software will proactively note when something important happens and send one of those mobile phone icon things to get a human to shift attention to the new thing. Nothing like distraction I say.
- Explore why on one’s own. Yep, this works really well for spelunkers who find themselves trapped. Exploration is okay, but it is helpful to [a] know where one is, [b] know where one is going, and [c] know the territory. Caves can be killers, not just dark and damp.
- Quantify impact in “real” dollars. The notion of quantifying strikes me as important. But doesn’t one quantify to determine if the prediction were on the money. I sniff a bit of flaming contradiction. The notion of knowing something in real time is good too. Now the problem becomes, “What’s real time?” I have tilled this field before and saying “real time” is different from delivering what one expects and what the system can do and what the outfit can afford.
It’s not even 2017, and I have learned that “prediction” is dead. I hope someone tells the folks at Recorded Future and Palantir Technologies. Will they listen?
Buzzwording with cacaphones is definitely alive and kicking.
Stephen E Arnold, January 3, 2017
Smarter Content for Contentier Intelligence
December 28, 2016
I spotted a tweet about making smart content smarter. It seems that if content is smarter, then intelligence becomes contentier. I loved my logic class in 1962.
Here’s the diagram from this tweet. Hey, if the link is wonky, just attend the conference and imbibe the intelligence directly, gentle reader.
The diagram carries the identifier Data Ninja, which echoes Palantir’s use of the word ninja for some of its Hobbits. Data Ninja’s diagram has three parts. I want to focus on the middle part:
What I found interesting is that instead of a single block labeled “content processing,” the content processing function is broken into several parts. These are:
A Data Ninja API
A Data Ninja “knowledgebase,” which I think is an iPhrase-type or TeraText type of method. Not familiar with iPhrase and TeraText, feel free to browse the descriptions at the links.
A third component in the top box is the statement “analyze unstructured text.” This may refer to indexing and such goodies as entity extraction.
The second box performs “text analysis.” Obviously this process is different from “the analyze unstructured text” step; otherwise, why run the same analyses again? The second box performs what may be clustering of content into specific domains. This is important because a “terminal” in transportation may be different from a “terminal” in a cloud hosting facility. Disambiguation is important because the terminal may be part of a diversified transportation company’s computing infrastructure. I assume Data Ninja’s methods handles this parsing of “concepts” without many errors.
Once the selection of a domain area has been performed, the system appears to perform four specific types of operations as the Data Ninja practice their katas. These are the smart components:
- Smart sentiment; that is, is the content object weighted “positive” or “negative”, “happy” or “sad”, or green light or red light, etc.
- Smart data; that is, I am not sure what this means
- Smart content; that is, maybe a misclassification because the end result should be smart content, but the diagram shows smart content as a subcomponent within the collection of procedures/assertions in the middle part of the diagram
- Smart learning; that is, the Data Ninja system is infused with artificial intelligence, smart software, or machine learning (perhaps the three buzzwords are combined in practice, not just in diagram labeling?)
- The end result is an iPhrase-type representation of data. (Note: that this approach infuses TeraText, MarkLogic, and other systems which transform unstructured data to metadata tagged structured information).
The diagram then shows a range of services “plugging” into the box performing the functions referenced in my description of the middle box.
If the system works as depicted, Data Ninjas may have the solution to the federation challenge which many organizations face. Smarter content should deliver contentier intelligence or something along that line.
Stephen E Arnold, November 28, 2016
The Google: A Real Newspaper Discovers Modern Research
December 4, 2016
I read “Google, Democracy and the Truth about Internet Search.” One more example of a person who thinks he or she is an excellent information hunter and gatherer. Let’s be candid. A hunter gatherer flailing away for 15 or so years using online research tools, libraries, and conversations with actual humans should be able to differentiate a bunny rabbit from a female wolf with baby wolves at her feet.
Natural selection works differently in the hunting and gathering world of online. The intrepid knowledge warrior can make basic mistakes, use assumptions without consequence, and accept whatever a FREE online service delivers. No natural selection operates.
A “real” journalist discovers the basics of online search’s power. Great insight, just 50 years from the time online search became available to this moment of insight in December 2017. Slow on the trigger or just clueless?
That’s scary. When the 21st century hunter gatherer seems to have an moment of inspiration and realizes that online services—particularly ad supported free services—crank out baloney, it’s frightening. The write up makes clear that a “real” journalist seems to have figured out that online outputs are not exactly the same as sitting at a table with several experts and discussing an issue. Online is not the same as going to a library and reading books and journal articles, thinking about what each source presents as actual factoids.
Here’s an example of the “understanding” one “real” journalist has about online information:
Google is knowledge. It’s where you go to find things out.
There you go. Reliance on one service to provide “knowledge.” From an ad supported. Free. Convenient. Ubiquitous. Online service.
Yep, that’s the way to keep track of “knowledge.”
Tips for DCGS Vendors Staff If RIFed
December 4, 2016
DCGS (pronounced dee-sigs by those inside the Beltway and dee-see-gee-ess by folks in Harrod’s Creek) may be heading to some changes. What is DCGS? Who are the DCGS vendors? What are the contracts worth? DCGS is a 15 year old project to provide one screen with federated intelligence, war fighting, and Web information. What are the contracts worth? Lots. Think hundreds of millions for some Beltway outfits. Some of the vendors appear in the list below:
Now to the meat of this write up. Here are the top 10 tips for DCGS incumbent vendors to have on hand if [a] their employer loses some DCGS deals, [b] employees and contractors working on DCGS projects get fired, RIFed, or terminated but without extreme prejudice, or [c] need some ideas to prepare for a future elsewhere (perhaps Palantir?).
Tip 10
Identify six different Starbuck’s and rotate your visits. You don’t want the “regulars” to know you are flipping rocks for work.
Tip 9
Hit Second Story Books or Capitol Hill Books for a copy of the classic job hunters’ manual What Color Is Your Parachute?
Tip 8
Convert your home office into an AirBnB rental to generate some extra dolares en efectivo.
Tip 7
Inform your significant other that he/she has to get a second job, possibly at Wendy’s or McDonald’s.
Tip 6
Add more content to your Microsoft LinkedIn résumé. (Note: Do not select need the “secret” job search option. You do not have an employer.)
Tip 5
Switch to Sunmark antacids with calcium instead of Whole Foods’ select mixed nuts.
Tip 4
Sign up to drive for Uber.
Tip 3
Tell your children they need more exposure to diversity and will switch to local public schools immediately.
Tip 2
Inform your family that holiday gifts will be purchased at the Montgomery County Thrift Shop in Bethesda or the Goodwill in Ashburn.
Tip 1
Cancel that cruise to the Norwegian fjords. Vacation this year is a trip to Wal-Mart Supercenter on Georgia Avenue NW.
Please, have a footless and fancy free 2017. Plus, remember to sign up for unemployment.
Stephen E Arnold, December 4, 2016