I covered news at my blog this morning that MSN has assigned names to all their robots or crawlers. When MSN Search first launched, they had one robot named, msnbot. MSNbot did the work of all, from normal web search to image search to news and images. Now, MSN has clarified the roles and assigned names to each robot.
The MSN Shopping bot is msnbot-products, the MSN News bot is msnbot-news, the MSN Image Search bot is msnbot-media and the MSN Search bot is still msnbot. This is important for SEOs, now you can define in your robots.txt file if you want msnbot-media to index your images or not.
Related reading
Something to hide? The rise of privacy-focused search engines
In this editorial from Marc Smith, founder of Mojeek, argues that alternative, privacy-focused search engines have an opportunity in this post-truth era
Artificial intelligence for marketers
In this editorial from Amanda DiSilvestro, she puts the case forward for AI as an essential tool for search marketers.
The end of DoubleClick and Adwords? Google simplifies its branding with Google Ads, Marketing Platform and Ad Manager
Google is rebranding Adwords and DoubleClick. How will these changes affect us? Here’s everything you need to know.
How to monitor your competitors’ content marketing efforts
Competitor monitoring informs content marketing strategy, inspires more content marketing tactics and helps you prevent content marketing mistakes.
