SEO News

MSN Assigns Names To Vertical Search Crawlers

by ,  Comments

I covered news at my blog this morning that MSN has assigned names to all their robots or crawlers. When MSN Search first launched, they had one robot named, msnbot. MSNbot did the work of all, from normal web search to image search to news and images. Now, MSN has clarified the roles and assigned names to each robot.

The MSN Shopping bot is msnbot-products, the MSN News bot is msnbot-news, the MSN Image Search bot is msnbot-media and the MSN Search bot is still msnbot. This is important for SEOs, now you can define in your robots.txt file if you want msnbot-media to index your images or not.


ClickZ Live Vancouver | July 18, 2013 Marketers Rejoice! ClickZ has launched ClickZ Live, an educational series to bring you innovative online marketing strategies and techniques. Learn to construct and successfully execute multi-channel marketing campaigns, plus identify key metrics and translate them into actionable plans.
Thursday, July 18: ClickZ Live will be in Vancouver, BC. Register before July 1 to save $100!

Recommend this story

Commenting policy Add a Comment