A paper presented at the 10th International Conference on Extending Database Technology conference in Munich near the end of March, Indexing Shared Content in Information Retrieval Systems (pdf), jointly authored by employees of Yahoo, Google, and IBM, discusses how to limit index sizes of search engines by reducing the amount of duplicate content contained in their indexes.
After reading it, I started considering and listing some of the problems that sites may have that could cause search engines to not index the pages of those sites, or display them in search results. My list is in a post at SEO by the Sea, titled Duplicate Content Issues and Search Engines.
Save up to $400! Register now for SES New York 2012, the Leading Search & Social Marketing Event, taking place March 19-23. Google's Digital Marketing Evangelist Avinash Kaushik will keynote. Hurry, pre-agenda rate expires March 2!
