Search Engine Visibility and Crawlability of Dynamic Sites

Huge databases that generate Web site content on the fly can be the bane of search engine spiders’ existence. They can’t find pages; they can’t see URLs. So they can’t index pages. In a two-part SearchDay series, “Search Engine Visibility and Site Crawlability, Part 1,” and “Search Engine Visibility and Site Crawlability, Part 2,” Eric Enge looks at key problem areas with sites that have dynamically generated content, including information architecture and keyword research; robots.txt files; and the use of Sitemaps.

Related reading

Man looking at rows of boxes in storage room, side view
A picture of a spider diagram drawn in red marker in the foreground, with the word SEO in the middle and other terms leading off it: marketing, keywords, strategy, metadata, design, backlinks, intuitive. A blurred person in the background is holding the marker, writing the diagram on what appears to be a clear glass pane.
pr
tools
Simple Share Buttons