Exit Shakespeare, for He Had a Coauthor
November 22, 2016
Shakespeare is regarded as the greatest writer in the English language. Many studies, however, are devoted to the theory that he did not pen all of his plays and poems. Some attribute them to Francis Bacon, Edward de Vere, Christopher Marlowe, and others. Whether Shakespeare was a singular author or one of many, two facts remain: he was a dirty, old man and it could be said he plagiarized his ideas from other writers. Shall he still be regarded as the figurehead for English literature?
Philly.com takes the Shakespeare authorship into question in the article, “Penn Engineers Use Big Data To Show Shakespeare Had Coauthor On ‘Henry VI’ Plays.” Editors of a new edition of Shakespeare’s complete works listed Marlowe as a coauthor on the Henry VI plays due to a recent study at the University of Pennsylvania. Alejandro Ribeiro used his experience researching networks could be applied to the Shakespeare authorship question using big data.
Ribeiro learned that Henry VI was among the works for which scholars thought Shakespeare might have had a co-author, so he and lab members Santiago Segarra and Mark Eisen tackled the question with the tools of big data. Working with Shakespeare expert Gabriel Egan of De Montfort University in Leicester, England, they analyzed the proximity of certain target words in the playwright’s works, developing a statistical fingerprint that could be compared with those of other authors from his era.
Two other research groups had the same conclusion with other analytical techniques. The results from all three studies were enough to convince the lead general editor of the New Oxford Shakespeare Gary Taylor, who decided to list Marlowe as a coauthor to Henry VI. More research has been conducted to determine other potential Shakespeare coauthors and six more will also be credited in the New Oxford editions.
Ribeiro and his team created “word-adjacency networks” that discovered patterns in Shakespeare’s writing style and six other dramatists. They discovered that many scenes in Henry VI were non-written in Shakespeare’s style, enough to prove a coauthor.
Some Shakespeare purists remain against the theory that Shakespeare did not pen all of his plays, but big data analytics proves many of the theories that other academics have theorized for generations. The dirty old man was not old alone as he wrote his ditties.
Whitney Grace, November 22, 2016
Sponsored by ArnoldIT.com, publisher of the CyberOSINT monograph
In Connected World, Users Are Getting Reared as Slaughter Animals
November 22, 2016
Yahoo, Facebook, Google, WhatsApp, Instagram and Microsoft all have one thing in common; for any service that they provide for free, they are harnessing your private data to be sold to advertisers.
Mirror UK recently published an Op-Ed titled Who Is Spying on You? What Yahoo Hack Taught Us About Facebook, Google, and WhatsApp in which the author says:
Think about this for a second. All those emails you’ve written and received with discussions about politics and people that were assumed to be private and meant as inside jokes for you and your friends were being filtered through CIA headquarters. Kind of makes you wonder what you’ve written in the past few years, doesn’t it?
The services be it free email or free instant messaging have been designed and developed in such a way that the companies that own them end up with a humongous amount of information about its users. This data is sugarcoated and called as Big Data. It is then sold to advertisers and marketers who in the garb of providing immersive and customized user experience follow every click of yours online. This is akin to rearing animals for slaughtering them later.
The data is not just for sale to the corporates; law enforcement agencies can snoop on you without any warrants. As pointed out in the article:
While hypocritical in many ways, these tech giants are smart enough to know who butters their bread and that the perception of trust outweighs the reality of it. But isn’t it the government who ultimately ends up with the data if a company is intentionally spying on us and building a huge record about each of us?
None of the tech giants accept this fact, but most are selling your data to the government, including companies like Samsung that are into the hardware business.
Is there are a way that can help you evade this online snooping? Probably no if you consider mainstream services and social media platforms. Till then, if you want to stay below the radar, delete your accounts and data on all mainstream email service providers, instant messaging apps, service providing websites and social media platform.
Vishal Ingole, November 22, 2016
Sponsored by ArnoldIT.com, publisher of the CyberOSINT monograph
Lip Reading: A Modest Advance?
November 21, 2016
Watching surveillance videos without sound? Wish you could read lips? Don’t have time to learn how to read lips? Alphabet Google’s DeepMind has a solution for anyone in this predicament. “Google’s DeepMind AI Can Lip-Read TV Shows Better Than a Pro” reveals:
A project by Google’s DeepMind and the University of Oxford applied deep learning to a huge data set of BBC programs to create a lip-reading system that leaves professionals in the dust.
How accurate is the system? The write up states:
The professional annotated just 12.4 per cent of words without any error. But the AI annotated 46.8 per cent of all words in the March to September data set without any error. And many of its mistakes were small slips, like missing an ‘s’ at the end of a word. With these results, the system also outperforms all other automatic lip-reading systems.
I think this means that the Google method is almost four times more accurate. Software is faster and does not require health care, vacation days, and coddling.
The write up sidesteps law enforcement use of the system by emphasizing “improved hearing aids, silent dictation in public spaces, and speech recognition in noisy environments.”
There are other applications, however.
Stephen E Arnold, November 28, 2016
All the Things Watson Could Do
November 21, 2016
One of our favorite artificial intelligence topics has made the news again: Watson. Technology Review focuses on Watson’s job descriptions and his emergence in new fields, “IBM’s Watson Is Everywhere-But What Is It?” We all know that Watson won Jeopardy and has been deployed as the ultimate business intelligence solution, but what exactly does Watson do for a company?
The truth about Watson’s Jeopardy appearance is that very little of the technology was used. In reality, Watson is an umbrella name IBM uses for an entire group of their machine learning and artificial intelligence technology. The Watson brand is employed in a variety of ways from medical disease interpretation to creating new recipes via experimentation. The technology can be used for many industries and applied to a variety of scenarios. It all depends on what the business needs resolved. There is another problem:
Beyond the marketing hype, Watson is an interesting and potentially important AI effort. That’s because, for all the excitement over the ways in which companies like Google and Facebook are harnessing AI, no one has yet worked out how AI is going to fit into many workplaces. IBM is trying to make it easier for companies to apply these techniques, and to tap into the expertise required to do so.
IBM is experiencing problems of its own, but beyond those another consideration to take is Watson’s expense. Businesses are usually eager to incorporate new technology, if the benefit is huge. However, they are reluctant for the initial payout, especially if the technology is still experimental and not standard yet. Nobody wants to be a guinea pig, but someone needs to set the pace for everyone else. So who wants to deploy Watson?
Whitney Grace, November 21, 2016
Sponsored by ArnoldIT.com, publisher of the CyberOSINT monograph
Surprise, Most Dark Web Content Is Legal
November 21, 2016
If you have been under the impression that Dark Web is that big chunk of the Internet where all activities and content is illegal, you are wrong.
In a news report published by Neowin, and titled Terbium Labs: Most of the Dark Web Content, Visible Through Tor, Is Legal reveals:
Contrary to popular belief that the majority of the dark web, accessible through Tor is mostly legal… or offline! With extremism making up just a minuscule 0.2% of the content looked at.
According to this Quora thead, Dark Web was developed by US Military and Intelligence to communicate with their assets securely. The research started in 1995 and in 1997, mathematicians at Naval Research Laboratory developed The Onion Router Project or Tor. People outside Military Intelligence started using Tor to communicate with others for various reasons securely. Of course, people with ulterior motives spotted this opportunity and began utilizing Tor. This included arms and drug dealers, human traffickers, pedophiles. Mainstream media thus propagated the perception that Dark Web is an illegal place where criminal actors lurk, and all content is illegal.
Terbium Labs study indicates that 47.7% of content is legal and rest is borderline legal in the form of hacking services. Very little content is technically illegal like child pornography, arms dealing, drug dealing, and human trafficking related.
The Dark Web, however, is not a fairyland where illegal activities do not occur. As the news report points out:
While this report does prove that seedy websites exist on the dark web, they are in fact a minority, contradictory to what many popular news reports would have consumers believe.
Multiple research agencies have indicated that most content is legal on Dark Web with figures to back that up. But they still have not revealed, what this major chunk of legal content is made of? Any views?
Vishal Ingole, November 21, 2016
Sponsored by ArnoldIT.com, publisher of the CyberOSINT monograph
Examples of Visualizations
November 20, 2016
If you want a quick look at what visualizations to use for use cases, you may find “An Overview of Text Mining Visualizations Possibilities with R on the CETA Trade Agreement.” The article focuses on trade agreement data, but the graphics provide a darned good refresher about visualization options. One caveat: Some of the links in the write up do not work. Nevertheless, we found the illustrations and commentary helpful.
Stephen E Arnold, November 20, 2016
The Next Web Portal Revolution: Video Gateways
November 19, 2016
Navigate to “Yahoo and Google Face Challenge As Social Media Sites Aim To Be Video Gateways.” The leaders in this new gold rush are Facebook and Snapchat. The write up reports:
Facebook and Snapchat have overtaken the homepages of Yahoo and Google as the front doors to the internet for hundreds of millions of people.
Okay, Google has invested in Snapchat. The outfit won’t be left out in the cold. Some other high flying Web outfits may be caught napping. Video is the thing, the biggie, the next money machine.
The write up continues:
Recurring shows are hitting Facebook from cable companies such as E! and business news provider Cheddar.
And Snapchat is also beavering away:
Snapchat has co-invested in two media brands exclusive to Discover.
What’s happened to dear, old, almost impenetrable YouTube? The write up reports:
YouTube has come closer than any video app to surpassing TV. But industry experts say the service is flooded with competition, associated with on-demand viewing and set in its style. Facebook and Snapchat represent uncharted terrain and potentially more lucrative opportunities, so that’s where money is flowing.
I think this means no cigar.
And the new content flowing to Facebook and Snapchat has one appealing factor to the cost conscious:
“No need for editing,” she says. “We’re just done.”
Good enough. Just like the title for the article and almost nothing of substance about Yahoo. For the shows which are capturing eyeballs, consult the original write up.
Stephen E Arnold, November 18, 2016
Watson: Who Is Intu You?
November 18, 2016
I read “IBM Launches Project Intu for Embodied Cognition.” When I saw the word “Intu”, my mind began generating referents for the “intu” reference. These included:
- The 2009 film “He’s Just Not That Into You.” This is the story about a woman seeking her prince charming. The film is a comedy.
- The 2006 book “He’s Just Not That Into You: The No Excuses Truth to Understanding Guys,” which is available in a newly expanded edition. Amazon it here.
- Lil’ Mo’s “Just Not That Into You,” one of our favorite tunes in Harrod’s Creek when we have old time hoedowns. Yee haw.
But these thoughts of the arts are not directly germane to the Intu system for embodied cognition. The write up explains:
IBM launched the experimental release of its Project Intu, a new system-agnostic platform designed to enable embodied cognition. Embodied cognition is the application of artificial intelligence to form factors, such as robots, devices or other objects.
Embodied cognition is putting artificial intelligence in the physical world. Examples include robots.
The write up quotes an IBM wizard as saying:
IBM is taking cognitive technology beyond a physical technology interface like a smartphone or a robot toward an even more natural form of human and machine interaction. Project Intu allows users to build embodied systems that reason, learn and interact with humans to create a presence with the people that use them—these cognitive-enabled avatars and devices could transform industries like retail, elder care, and industrial and social robotics.
The write up includes some philosophical ideas as well; for example:
One maven suggests that Intu is “after a different sort of game.” The maven opines, “If IBM’s Project Intu succeeds, it could go a long way toward normalizing IoT [Internet of Things] use cases.” Yes, normalize, which I don’t understand to be candid.
Another IBM poobah says:
“Our philosophy at IBM is to put our technology in the hands of developers, because for every good idea we have, we know they’re thinking up thousands more.”
My view of IBM Watson is that I think I love Google DeepMind. So Watson, as Mary asks in “He’s Just Not That Into You”:
What if you meet the love of your life, but you already married somebody else, are you supposed to let them pass you by?
For some, the answer is, “Yes, Mary. Let them pass on by.” Hey, another song for me to get Intu, Pass on By by Kelly Hogan.
Stephen E Arnold, November 18, 2016
Big Data: Stunners from Researchers
November 18, 2016
I read “Big Data Shows People’s Collective Behavior Follows Strong Periodic Patterns.” May I suggest you sit down, take a deep breath, and contemplate a field of spring flowers before you read these findings. I am not kidding. Hot stuff, gentle reader.
According to the write up,
New research has revealed that by using big data to analyze massive data sets of modern and historical news, social media and Wikipedia page views, periodic patterns in the collective behavior of the population can be observed that could otherwise go unnoticed.
Here are the findings. I take no responsibility for the impact of these Big Data verified outputs. You are on your own. You now have your trigger warning about the findings from online news, newspapers, tweets, and Wikipedia usage. The findings are:
- “People’s leisure and work were regulated by the weather with words like picnic or excursion consistently peaking every summer in the UK and the US.”
- Diet, fruits, foods, and flowers were influenced by the seasons.
- Measles surface in the spring
- Gooseberries appear in June. (Well, maybe not in Harrod’s Creek.)
- Football and Oktoberfest become popular in the fall. (Yep, October for Oktoberfest, right?)
- People get depressed in the winter.
Now you have it. Big Data delivers.
Stephen E Arnold, November 18, 2016
Neural-Net AI Service Echobox Manages Newspaper Presences on Social Media
November 18, 2016
An article at Bloomberg Technology, titled “It Took Robots for This French Newspaper to Conquer Twitter,” introduces Echobox, a startup that uses a neural-network approach to managing clients’ social media presences. The newspaper mentioned in the title is the esteemed Liberation, but Echobox also counts among its clients the French Le Monde, Argentinia’s La Nacion, and The Straits Times out of Singapore, among many others. Apparently, the site charges by the page view, though more pricing details are not provided. Writer Jeremy Kahn reports that Echobox:
… Determines the most opportune time to post a particular story to drive readership, can recommend what headline or tweet to send out, and can select the best photograph to illustrate the post. Using the software to post an average of 27 articles per day, Grainger [Liberation’s CTO] said that Liberation had seen a 37 percent increase in the number of people it reached on Facebook and a 42 percent boost in its reach on Twitter. ‘We have way more articles being seen by 100,000 people or more than before,’ Grangier said. He also said it made life easier for his digital editors, allowing them to spend more time curating the stories they wanted to publish to social media and less on the logistics of actually posting that content.
So, it seems like the service is working. Echobox’s CTO Marc Fletcher described his company’s goal—to create a system that could look at content from an editor’s point of view. The company tailors their approach to each customer, of course. There are competitors in the social-media-management space, like SocialFlow and Buffer, but Kahn says Echobox goes further. He writes:
Echobox professes to offer a fuller range of automation than those services, with its software able to alter a posting schedule to adjust to breaking news, posting content related to that event, and delaying publication of less relevant stories. Echobox uses a neural network, a type of machine learning that is designed to mimic the way parts of the human brain works. This system first learns the audience composition and reading habits for each publication and then makes predictions about the best way to optimize a particular story for social media. Over time, the predictions should get more accurate as it ‘learns’ the nuances of the brand’s audience.
This gives us one more example of how AI capabilities are being put to practical use. Founded in 2013, Echobox is based in London and maintains an office in New York City. The company also happens to be hiring as I write this.
Cynthia Murrell, November 18, 2016
Sponsored by ArnoldIT.com, publisher of the CyberOSINT monograph
-
- Subscribe to Beyond Search
Feature archive
News archive
-
