Yahoo Tips On Crawling Issues

The Yahoo Search Blog has some webmaster tips out today: Yahoo! Search Tips for Webmasters: Saving Bandwidth.
Gzip your files, and they’ll unzip and save you bandwidth when crawling. Respond with the right HTTP code, and it will only download pages if there’s been a change to them.
Getting slammed by the Slurp crawler? Make it sip rather than slurp through the crawl-delay mechanism.

Related reading

Virtual reality headset
An image from The Simpsons showing a yellow-fingered hand holding up a newspaper whose headline reads: Bumblebee Man Caught In Sting
product-reviewing
flat design mobile payments
Simple Share Buttons