November 29, 2014
The idea that numerical recipes can identify a person in video footage is a compelling one. I know one or two folks involved in law enforcement who would find a reliable, low cost, high speed solution very desirable.
The face on the left is a reverse engineered FR image. The chap on the right is the original Creature from the Black Lagoon. Toss in a tattoo and this Black Lagoon fellow would not warrant a second look at Best Buy on Cyber Monday.
I read “This Is What Happens When You Reverse Engineer Facial Recognition.” the internal data about an image is not a graduation photograph. The write up contains an interesting statement:
The resulting meshes were then 3D-printed, creating masks that could be worn by people, presenting cameras with an image that is no longer an actual face, yet still recognizable as one to software.
Does this statement point to a way to degrade the performance of today’s systems? A person wanting to be unrecognized could flip this reverse engineering process and create a mash up of two or more “faces.” Sure, the person would look a bit like the Creature from the Black Lagoon, but today’s facial recognition systems might be uncertain about who was wearing the mask.
Stephen E Arnold, November 29, 2014
October 16, 2014
Image search is touted as being intuitive and accurate. Users simply need to submit an image to the search engine and based off the picture analyzing algorithms similar images will be returned. It, however, is still in the works. Image search still proves to be a difficult task for search engines to master. Search Engine Watch brings us the news “Bing Unveils Responsive Design For Image Search” that the search engine is ramping up to improve its image search.
The newest improvements optimizes image search for touch screen mobile devices. Bing has changed the way uses can browse through images, making it simpler to explore and refine results. Pinterest board searches have been added and a mini-header that will slide with users as they scroll down will offer quick access to popular results. The image hover feature has also been updated.
Along with the updates, Bing has these tips to improve image search:
• “Quality: No matter what the user is searching for, Bing is focused on providing high-quality and relevant image search results.
• Suggestions: Users that are scrolling page after page are clearly having a difficult time finding what they are looking for. Bing maintains a set of search suggestions and collections to help users find what they need.
• Actions: There are many different ways to search and endless topics to search about. Bing has provided the tools necessary to filer results, create an image match, and create one-click access to Pinterest.”
These upgrades will improve image search, but it still has a long way to go.
July 30, 2014
Robots. Magic stuff like semantic concept lenses. Logical wackiness like software that delivers knowledge.
I read “Twitter Acquires Deep Learning Startup Madbits.” The write up points out to the drooling venture capitalists that Twitter’s purchase is “the latest in a spate of deep learning and computer vision acquisitions that also includes Google, Yahoo, Dropbox, and Pinterest.” What this means is that these oh-so-hot outfits are purchasing companies that purport to have software that can figure stuff out.
I recall a demonstration in Japan in the late 1990s. I was giving some talks in Osaka and Tokyo. One of the groups I met showed me a software system that could process a picture and spit out what was in the picture. I remember that the system was able to analyze a photo of a black and white cow standing in a green pasture.
The software nailed it. The system displayed in Japanese, ?. My hosts explained that the idiograph meant “cow.” High fives ensued. On other pictures, the system did not perform particularly well.
Flash forward 30 years. In a demonstration of image recognition at an intelligence conference, the system worked like a champ on clear images that allowed the algorithm to identify key points, compute distances, and then scurry off to match the numeric values of one face with those in the demo system’s index. The system, after decades of effort and massive computational horsepower increases, was batting about .500.
The problem is that different pictures have different looks. When the subject is wearing a baseball cap, has grown a beard, or is simply laughing, the system does not do particularly well.
You can see how Google performs. Navigate to Google Images, select a picture of a monument, and let Google find matches. Some are spot on. I use a perfect match example in my lectures about open source intelligence tools. I have some snaps in my presentatio0n that do not work particularly well. Here’s an example of a Google baffler:
This is a stuffed pony wearing a hat. Photo was taken in Santiago, Chile at an outdoor flea market.
This is the match that Google returned:
Notice that there were no stuffed horses in the retrieved data set. The “noise” in the original image does not fool a human. Google algorithms are another kettle of fish or booth filled with stuffed ponies.
The Twitter purchase of Madbits (the name suggests swarming or ant methods) delivers some smart folks who have, according to the write up, developed software that:
automatically understands, organizes and extracts relevant information from raw media. Understanding the content of an image, whether or not there are tags associated with that image, is a complex challenge. We developed our technology based on deep learning, an approach to statistical machine learning that involves stacking simple projections to form powerful hierarchical models of a signal.
Once some demonstrations of Twitter’s scaling of this interesting technology is available, I can run the radiation poisoning test. Math is wonderful except when it is not able to do what users expect, hope, or really want to get.
Marketing is good. Perhaps Twitter will allow me to track down this vendor of stuffed ponies. (Yep, it looked real to me.) I know, I know. This stuff works like a champ in the novels penned by Alastair Reynolds. Someday.
Stephen E Arnold, July 30, 2014
July 25, 2014
A new image-based search tool can take some of the research out of adopting a pet. Lifehacker turns our attention to the free iOS app in, “PetMatch Searches for an Adoptable Pet Based on Appearance.” Now, pet lovers who see their perfect pet on the street can take a picture and find local doppelgangers in need of homes. Perhaps this will help lower dog-napping rates. Reporter Dave Greenbaum notes:
“You should never adopt an animal solely based on looks, of course—you should research the personality of the breed you want—but looks are a factor. This app works great for mixed breed dogs when you aren’t sure what kind of dog you are looking at. I like the fact it will look at local adoption agencies to find a match, too. Online services like Petfinder.com help you find local pets to adopt, but you have to know which breed you are looking for first, and searching for mixed breed dogs (common at shelters) is difficult. This app makes it easy to do a reverse image search and do your research based on the results.”
Another point to note is that PetMatch includes a gallery of dog and cat breeds, so if the picture is in your head instead of your phone, you can still search for a look-alike. It’s a clever idea, and an innovative use of image search functionality.
Cynthia Murrell, July 25, 2014
June 17, 2014
The Metropolitan Museum of Art offers the new picture archive The Collection Online, with some 400,000 images of art searchable by artist, culture, method, material, geographic location, date or era, and even by department. From costumes to books to ceramics to the more obvious paintings and sculpture in limestone or bronze, this collection is incredible in its scope and detail. Searching, say, for a painting by Vincent Van Gogh yields a list of 124 records. Many of these were not works by Van Gogh, but there is an option to limit to the records by that painter. Click on The Potato Peeler and find not only the stats of the painting (oil on canvas from 1885, 16 x 12 1/2in.) but also where to find it in the Museum (Gallery 826) if available. Beneath the image there is some additional information available,
“This painting from February/March 1885, with its restricted palette of dark tones, coarse facture, and blocky drawing, is typical of the works Van Gogh painted in Nuenen the year before he left Holland for France. His peasant studies of 1885 culminated in his first important painting, The Potato Eaters (Van Gogh Museum, Amsterdam).”
You are also informed that on the reverse of the same canvas is a Van Gogh’s Self Portrait with a Straw Hat. Users have the possibility of registering for free, which would enable them to create their own assortment by saving images to an individual collection. The Met is no stranger to successful online endeavors, having just recently won a Webby for their Instagram account through the Academy of Digital Arts & Sciences.
Chelsea Kerwin, June 17, 2014
February 10, 2014
Here’s a new way to search from one of the minds that helped loose Twitter upon the world. The Los Angeles Times shares an interview with a Twitter co-founder in, “Biz Stone Answers our Questions About New Q&A App Jelly.” Forget algorithms; this app lets you take or upload a picture and pose a question about it to other humans, both within and outside your social-media circles.
Stone and co-founder, Ben Finkel, started with a question: if we were to design a search tool around today’s online landscape, as opposed to the one that existed about a decade ago, what would it look like? As the app’s website explains, “It’s not hard to imagine that the true promise of a connected society is people helping each other.” (Finkel, by the way, founded Q&A site Fluther.com and served as its CEO until that service was acquired by Twitter in 2010.)
One of Jelly‘s rules may annoy some: users cannot post a question without including an image. Writer Jessica Guynn asks Stone why he incorporated that requirement. He responds:
“We did a lot of testing and more often than not, an image very much deepens the context of a question. That’s why we made it so you can either take a picture with your camera and say, ‘What kind of tree is this?’ Or you can pull from the photo albums you already have. Or you can get [a photo] from the Web. Photos are what make mobile mobile. We are really taking advantage of the fact that this is a mobile native application…. Everyone is carrying around these great cameras. It’s a uniquely mobile experience to pair a short question with a photo. It might frustrate a few people in the long run but it will only end up with better quality for us. There is a higher bar to submitting a question.”
The image requirement is just one way Jelly differs from Twitter. The team also worked toward making the new app less conversational in order to avoid the clutter of non-answers. (And we thought 140 characters was limiting.) We’re curious to see how well users will warm to this unique service.
Cynthia Murrell, February 10, 2014
July 20, 2012
LifeHacker catches us up with some developments in “Remains of the Day: Google Image Search Gets Knowledge Graph Integration.” The headlining item promises smarter and more comprehensive “Search by Image” results. The article quotes Google’s blog on a feature I’ve been looking forward to (the second one):
“Google updated its Image Search with a couple of new features. One being an expanded view that lets searchers see the text around matching images, and the other being added support for Knowledge Graph to image search results, which means Google will attempt to identity any photo that you upload or link to and provide more information about the subject.”
In other news, the write up notes that the Mac video player VLC is now at version 2.0.2, updated for Windows and OS X. Several small tweaks and bug fixes are addressed, and Retina Display support has been added. Also, Sparrow, an OS X email client, released an update to its desktop version. The update includes support for Retina Display and Mountain Lion. Amazon’s Flow app, already available for iOS, now brings barcode scanning and augmented reality to Android users.
Finally, Google is continuing its name-shuffle game. The Google Places iOS app follows the Google Places service in being renamed Google+ Local. A voice-search feature is now included in the app version.
Cynthia Murrell, July 20, 2012
Sponsored by PolySpot
July 16, 2012
Creative commons offers a lot of versatility, but up until now the available finders have been limited. Flexibility was needed and AbelsSoft’s new creative commons image finder provides just that. Lifehacker’s article “CCFinder Simplifies Creative Commons Image Searches” talks about the pluses and minuses of this new program.
AbelsSoft offers a few perks when it comes to defining search, such as:
“You can filter your search to omit or include various types of CC restrictions such as non-commercial use only, references required to the original author, etc. Once you perform a search you can select a single or multiple images and either download to your preferred folder, visit the source image web site, or set the image as your desktop wallpaper.”
One taut aspect of CCFinder’s search engine is that it only utilizes Flickr, which ironically has the largest selection of CC licensed images available. Creative Commons offers users several sites to choose from, like Google Images, Open Clip Art Library, and Fotopedia, however users are still limited to one site per search.
The download is free for CCFinder, but registration does sign users up to receive an occasional newsletter. In itself, that is not a lot to ask for the convenience of well-defined search. AbelsSoft also offers a professional version of CCFinder that further defines how users search by implementing color filters. At first glance, CCFinder seems a user friendly program with search flexibility. We will have to see how far they stretch.
Jennifer Shockley, July 16, 2012
October 29, 2010
Short honk: One never knows when this type of list will be needed. “7 Image Search Tools That Will Change Your Life” provides descriptions, some screenshots, and links to seven image search tools. My life has not been changed, but a happy quack to Brain Pickings for the information. One example:
Retrievr at http://labs.systemone.at/retrievr/
Stephen E Arnold, October 29, 2010
July 23, 2010
It seems that Google isn’t immune to adopting good ideas when it sees them in other places. Reading Google Positively Bing-Like With New Image Search Capabilities we see they’ve updated their search technology to view over 1000 images on each page. It shows that even Google knows when they need to change and keep moving ahead and it shows that they’re not immune to influences from the likes of Microsoft.
There are other noteworthy changes and these include increasing the density of the search results page and the ability to get a bigger preview of an image by hovering a mouse over it.
Of course no changes would be complete without some kind of advertising friendly features as well. Hence the new image format called Google Search Ads. Still the Microsoft influence makes us wonder whatever happened to innovation at Google? Strange for a company where searches are the lifeblood.
I don’t like the endless page “thing”. Latency remains an issue with certain network connections. How about a button to reclaim the “old” image search. Better yet, do something original.
Stephen E Arnold, July 23, 2010