Huge databases that generate Web site content on the fly can be the bane of search engine spiders' existence. They can't find pages; they can't see URLs. So they can't index pages. In a two-part SearchDay series, "Search Engine Visibility and Site Crawlability, Part 1," and "Search Engine Visibility and Site Crawlability, Part 2," Eric Enge looks at key problem areas with sites that have dynamically generated content, including information architecture and keyword research; robots.txt files; and the use of Sitemaps.
Meet Your Favorite Search Engine Watch Contributors
Many of SEW's leading expert contributors will be at ClickZ Live, the new online and digital marketing event kicking off in New York (March 31-April 3). Hear from the likes of: Thom Craver, Josh Braaten, Lisa Barone, Simon Heseltine, Josh McCoy, Lisa Raehsler, Greg Jarboe, Dan Cristo, Joseph Kerschbaum, John Gagnon, Eric Enge and more!