I covered news at my blog this morning that MSN has assigned names to all their robots or crawlers. When MSN Search first launched, they had one robot named, msnbot. MSNbot did the work of all, from normal web search to image search to news and images. Now, MSN has clarified the roles and assigned names to each robot.
The MSN Shopping bot is msnbot-products, the MSN News bot is msnbot-news, the MSN Image Search bot is msnbot-media and the MSN Search bot is still msnbot. This is important for SEOs, now you can define in your robots.txt file if you want msnbot-media to index your images or not.
Related reading
Seven ways to future-proof your digital strategy
Nurcin Erdogan Loeffler, head of strategy and innovation, Vizeum China, outlines the seven ways businesses can future proof their digital strategies.
Six most important search marketing news stories of the week
Welcome to our weekly round-up of all the latest news and research from around the world of search marketing and beyond.
Penguin 4.0 is finally here, Google confirms
After a couple of years waiting, and various algorithm fluctuations described as 'normal turbulence', Google has finally confirmed today that it's Penguin algorithm update is rolling out in all languages.
12 companies hit with a Google manual penalty
Just in case you're ever tempted to try a few black-hat practices to manipulate your search positions in Google, here are 12 tales to persuade you otherwise.
