I covered news at my blog this morning that MSN has assigned names to all their robots or crawlers. When MSN Search first launched, they had one robot named, msnbot. MSNbot did the work of all, from normal web search to image search to news and images. Now, MSN has clarified the roles and assigned names to each robot.
The MSN Shopping bot is msnbot-products, the MSN News bot is msnbot-news, the MSN Image Search bot is msnbot-media and the MSN Search bot is still msnbot. This is important for SEOs, now you can define in your robots.txt file if you want msnbot-media to index your images or not.
Related reading
Q&A with SEMrush CEO / Cofounder, Oleg Shchegolev
Interview with SEMrush CEO on where the company is headed, what they're working on, pain points as an SEO, diversity in tech, and much more.
Facebook is a local search engine. Are you treating it like one?
Over 600 million users visit FB business pages every day. 52% of consumers have discovered a brand there. Why and how to optimize for Facebook local search.
17 top plugins and extensions for SEO
(According to experienced SEOs.) We asked SEO experts which plugins and extensions they use for easier, more productive work. Here are their top 17 answers.
How did the Gillette video impact search traffic?
Gillette's “The Best a Man Can Be” ad sparked lots of coverage. The real question is, "What impact did that video have on search traffic?" The trends since.
