Search the Web: Maybe Find a Nugget or Two for Intrepid Researchers?
June 21, 2022
“A Look at Search Engines with Their Own Indexes” has been updated. The article provides a run down of systems and services which offer Web search services.
Some of the factoids in the article are ones often overlooked by many of the “search experts” generating information about how to find information via open sources. Here are a few which deserve more attention from students of search:
- Bing is the most promiscuous supporter of metasearch
- YaCy is included in the “unusable” category; however, it is not. YaCy has some interesting properties of interest to cyber sleuths
- Neeva’s index is exposed as a mix of some original crawl content with Bing results. (Where’s the Google love for a former Googler’s search system.)
- Qwant is exposed for using Bing data
- Exalead, arguably better than Pertimm which influenced Qwant, takes some bullets. But Dassault is into other, more lucrative businesses than “search”
- Kagi is a for fee service which uses its own index and, like other metasearch systems, taps results from Bing and Google. (Is Google excited yet?)
- The Thunderstone service is noted. (How long has Thunderstone been around? Answer: A long time.)
Worth noting the links. Perhaps someone will create a list of the services indexing content for specialized software applications and government agencies. There are hundreds of “data aggregators” but how does one search them for useful results?
I addressed findability issue in my recent OSINT lecture for the National Cyber Crime Conference attendees and in a follow up session for the Mass. Asso. of Crime Analysts.
Stephen E Arnold, June 21, 2022