Source Code Search Engine Meanpath
August 25, 2013
I am surprised it took this long; we have learned about a relatively new search engine dedicated to ferreting out source code: meanpath. Each day, the service crawls some 220 million sites to capture text, page sources, and server headers. Their website explains:
“Meanpath is a new search engine that allows software developers to access detailed snapshots of millions of websites without having to run their own crawlers. Our clients use the information we gather from your site to help solve problems in these areas: Semantic analysis; Linguistics; Identity theft protection; Malware and virus analysis; We also request your favicon and apple-touch-icon if available for our favicond.com service.”
Well, okay. Meanpath goes on to explain how it accesses sites, and diligently supplies instructions for those who would keep its bot at bay. Also included is a disclaimer, noting that spammers and other unethical operatives might refuse to heed the directives specified in a robots.text file, but advises that a reverse DNS lookup will suss out any bad actors.
Founded last year, meanpath serves a variety of internet-savvy businesses, from SEO consultants to hosting companies. The company makes its home in California.
Cynthia Murrell, August 25, 2013