MSN Assigns Names To Vertical Search Crawlers

I covered news at my blog this morning that MSN has assigned names to all their robots or crawlers. When MSN Search first launched, they had one robot named, msnbot. MSNbot did the work of all, from normal web search to image search to news and images. Now, MSN has clarified the roles and assigned names to each robot.

The MSN Shopping bot is msnbot-products, the MSN News bot is msnbot-news, the MSN Image Search bot is msnbot-media and the MSN Search bot is still msnbot. This is important for SEOs, now you can define in your robots.txt file if you want msnbot-media to index your images or not.

Want SEW higher in your Google results?Add as a preferred source

More in Industry

View more
Industry

Paid Media Is the Future

Marketers are evolving away from the need to be paid search and display specialists and toward the need to be more broadly educated paid media specialists.

Industry

Google Folds Blog Search Into News

Google users who want to search for content from blogs must now filter their queries in Google News instead of using the separate Blog Search page.