In addition to looking for duplicate title tags, make sure that your keywords are the first words in the title tag (and H1 tag). Go to Google Webmaster Tools and use the built-in robots.txt checker (you can find this in the Crawler Access section...
Use keywords in the alt tag attribute. The best way to handle this is to use robots.txt to prevent the crawler from looking at the versions you don't want indexed (most likely this would be the thumbnail or the full size image).
Search for anything using your favorite crawler-based search engine. So, how do crawler-based search engines go about determining relevancy, when confronted with hundreds of millions of web pages to sort through?
A query on a crawler-based search engine often turns up thousands or even millions of matching web pages. Failure to put target keywords in the title tag is the main reason why perfectly relevant web pages may be poorly ranked.
Over Meta Tag Keywords: The new medium of search collides with trademark law, for the first time. Maybe Google's not our friend and we should own our own crawler-based technology to protect ourselves.
Deep Submission Tools: Designed to submit many pages from your site to crawler-based search engines. Multisubmit Tools: Designed to submit your web site to hundreds of crawler-based search engines and human-powered directories at the same time.
There's a meta tag generator, a "Page Primer" analysis tool that offers basic advice for changes that may help with crawler-based search engines, a submission tool to send your URLs to many search engines at once as well as a "deep" submit of many...
With crawler listings, each page stands on its own merits, apart from others in your site. Just saying you are Google does nothing to cause your browser to act the way Google's crawler actually does, any more than saying to someone that you are a...
AltaVista's Scooter crawler begins trials These previously came from the World Wide Web Worm crawler that GoTo.com acquired in 1997. Excite and Infoseek play laser tag, instead. Compaq announces it will put one button access on its new computer...
I've yet to test this, but if so, I think it would make it the only major crawler that can spider frame content without the webmaster having to make special links to help. NOTE: New information on the MSN crawler has been updated into the Crawler...
This leaves the crawler-based search engines entirely dependent on ranking the page in the top results solely off of link data, and I'm guessing not many people are linking over to it using the phrase.
In my earlier parts of this series on local search, I covered Overture's new local paid listings and crawler-based methods from Google and Mobilemaps as attempts to improve local searching on general purpose search engines.
If you paid for a crawler-based search engine to list a particular page, any changes you make to that page will be automatically detected each time the crawler revisits over the period of your paid inclusion subscription.
Spend the money only because you think the listing within the Yahoo Directory itself will bring you traffic, not because you think it will help you with crawler-based search engines using link analysis.
The best way for pages from a web site to be listed with AllTheWeb is for the crawler to find the pages naturally, as it moves around the web following links. If your brand new site has even one link pointing at it, AllTheWeb's crawler may...
As with most major crawler-based search engines, Inktomi will rank pages better in response to particular queries if they contain the search terms in their HTML body copy with some degree of frequency.
Crawler-based search engines generally have not depended on the HTML language meta tag to classify pages by language. This is because the tag isn't always present or sometime is incorrect. The charset meta tag has also been used.
In general, for crawler based search engines, getting in them once anywhere is enough. For a crawler, this almost certainly won't happen. The only HTML text is in the title and meta description tag. In order to help search engines crawl our web...
Thus, some mistakenly assumed that alphabetical titles would help with crawler-based search engines such as Google. Two popular myths are that alphabetization in the HTML title tag or using a keyword in a URL can improve ranking.
Over the past two months, there's been a run on crawler-based search engines. Overture announced its intention last month to purchase a second crawler-based search engine in as many weeks, that owned by FAST.
