In addition to redirects, your web server will be needed to set up proper 404error handling. Servers are often a mysterious area, even for experienced search engine optimization (SEO) specialists. For example, you may want to utilize a content...
It may surprise you to learn that the way a Web site handles 404errorpages can affect search engine rankings. Although some would argue how much negative weighting is placed on sites with inconsistent or custom 404errorpages.
During times of either configuration problems or simply an outage, a search engine may see one of the following: DNS is unavailable, Network is not available, 500s in a large volume, and if a server is setup incorrectly, it could see redirects to...
Most webservers return a generic 404error page or a sitemap when a user's desired page cannot be found. To solve that problem, Microsoft Live Search will now enable Web site owners to create errorpages that recommend help even if the exact URL...
Up Funny AdWords Error Message, Search Engine Roundtable Google blocking privacy technology over at Boing Boing has Cory Doctrow
writing up how Google is blocking some proxy servers from making requests.
VeriSign redirects errorpages, News.com VeriSign is now resolving requests for non-existent .COM and .NET domains to an error page that features a search engine that it operates called Site Finder, a move that's quickly raised controversy.
We've always tried to be as conservative as possible when we crawl, so until recently if we got a 403 error on a robots.txt, we would not crawl pages from that domain. The search engine has also changed the way it reacts if given a 403 "forbidden...
Along with the code, most webservers will send the content of a 404error page -- which is typically useless, saying nothing helpful other than that the page can't be located. Nor, as sometimes suggested, did the change replace the "page not found...