Yahoo Tames Slurp and Updates Index
Yahoo is rolling out these days fresh updates to its “crawl, index and ranking systems.” You should be able to see a significant reduction Slurp’s crawling intensity as it should now be more efficient and less aggressive.
According to Yahoo Search Blog:
Tags: Crawlet, Slurp, Weather-UpdateIn response to feedback from the community, we’re reducing our crawling machines by a significant amount with this update, so you might have observed a significant reduction in crawl load from us along with fewer machine IP addresses hitting you over the last few days.
The new crawler continues to improve comprehensiveness and freshness of coverage while also enhancing crawl efficiency, which reduces spurious load on websites.
Related Stories
POSTED IN: Yahoo
0 opinions for Yahoo Tames Slurp and Updates Index
No one has left a comment yet. You know what this means, right? You could be first!
Have an opinion? Leave a comment: