The robots.txt file allows you to prevent search engines from indexing documents on your web server, assuming they respect the convention. Most major search engines do. Ian McCanerin, one of our forum moderators, has posted a nice new tool to help you generate a robots.txt file. You can also discuss it in this forum thread.
Save up to $400! Register now for SES New York 2012, the Leading Search & Social Marketing Event, taking place March 19-23. Google's Digital Marketing Evangelist Avinash Kaushik will keynote. Hurry, pre-agenda rate expires March 2!
