I covered news at my blog this morning that MSN has assigned names to all their robots or crawlers. When MSN Search first launched, they had one robot named, msnbot. MSNbot did the work of all, from normal web search to image search to news and images. Now, MSN has clarified the roles and assigned names to each robot.
The MSN Shopping bot is msnbot-products, the MSN News bot is msnbot-news, the MSN Image Search bot is msnbot-media and the MSN Search bot is still msnbot. This is important for SEOs, now you can define in your robots.txt file if you want msnbot-media to index your images or not.
Related reading
What does visual search mean for ecommerce in 2017?
Since the early 2010s, visual search has been offering users a novel alternative to keyword-based search results. But what commercial opportunities does it offer brands today?
What will Google’s expanded policy on harmful content mean for SEO companies?
Google recently announced that it will be expanding its hate-speech policy for publishers that use the company’s ad network. How does this affect SEO companies, and what can we do to make sure we and our clients stay on the right side of the policy?
Pump the brakes: SEO and its sweeping statements
Search Engine Optimization is an imperfect science, and the sheer amount of sometimes contradictory information available about Google updates and SEO best practices has led to a tendency for knee-jerk reactions and sweeping generalizations among the community. Here's why you don't need to panic.
What do we know so far about Google’s new homepage?
Google has released a new, feed-based mobile homepage in the US, in perhaps the most drastic and significant update of its homepage since 1996. We take a look at what the relaunch entails, and how it might change things for marketers.
