Yahoo is addressing the needs of site owners with dynamic URLs with new dynamic URL rewriting features in Site Explorer. The new feature lets webmasters identify the dynamic parameters in URLs that Yahoo should ignore, such as parameters that don’t affect the content of a page, but that have other important uses. Yahoo can then strip the dynamic parameters in URLs and rewrite them, making crawling more efficient, and making display of URLs in search results easier to read. It can also improve a page’s ranking in results, since it will counteract the dissipation of “link juice” from links to different URLs linking to the same page.
In addition, Yahoo has made improvements to its crawling and indexing systems. The changes are intended to create a fresher, more comprehensive index, while also reducing load requirements on Web sites being crawled.