New Address for Yahoo!’s Search Crawler
June 5th, 2007
Yahoo! today completed the migration of their search crawler, Yahoo! Slurp, over to the new domain at crawl.yahoo.net.
As of today, all machines crawling as Slurp are now in crawl.yahoo.net. You can see this change in your web server logs, where the page accesses from inktomisearch.com are being fully replaced by crawl.yahoo.net contacts. This does not cover other Yahoo! crawlers, such Yahoo! China, and other verticals, like Yahoo! Shopping, Yahoo! Travel, etc., which have their own user-agent.
Entry Filed under: Yahoo!
