A Reminder about What Is Available to Search

July 5, 2015

Navigate to “Big Data, Big Problems: 4 Major Link Indexes Compared.” The write up explains why indexes have different content in their indexes. The services referenced in the write up are:

  • Ahrefs. A backlink index updated every 15 minutes.
  • Majestic. A big data solution for marketers and others. The company says, “Majestic-12 has crawled the web again, and again, and again. We have seen 2.7 trillion URLs come and go, and in the last 90 days we have seen, checked, scored and categorized 715 billion URLs.”
  • Moz. Products for in bound marketers.
  • SEMrush. Search engine marketing for digital marketers.

Despite the marketing focus, there were some interesting comments based on the analysis of backlink services (who links to what). Here’s one point I highlighted:

Each organization has to create a crawl prioritization strategy.

The article points out:\

The bigger the crawl, the more the crawl prioritization will cause disparities. This is not a deficiency; this is just the nature of the beast.

Yep, editorial choice. Inclusions and exclusions. Take away. When you run a query, chances are you are getting biased, incomplete information for the query.

The most important statement in the write up, in my opinion, is this one:

If anything rings true, it is that once again it makes sense to get data from as many sources as possible.

Good advice for search experts and sixth graders. Oh, MBAs may want to heed the statement as well.

But who cares? Probably not too many Internet users. Exciting when these “incomplete” information searchers make decisions.

Stephen E Arnold, July 5, 2015

Comments

Comments are closed.

  • Archives

  • Recent Posts

  • Meta