To Cloak or Not to Cloak?

Hello everyone --

This is Chris, resuming the helm of SearchDay once again. Special thanks to Danny Sullivan for providing yesterday's issue on finding disaster information with search engines. I was in Washington during the attacks. Though in retrospect never in any direct danger, it was a deeply disturbing experience to be so close to one of the targets. I sincerely hope all of you and your loved ones were not directly affected by this despicable act of terrorism.

To Cloak or Not to Cloak?

by Greg Boser, Guest Writer

A special report from the Search Engine Strategies 2001 Conference, August 16-17, San Francisco CA.

A longer, more detailed version of this article is
available to Search Engine Watch members.
Click here to learn more about becoming a member

If you're a regular reader of Search Day, then you probably already know that the most controversial topic in the world of search engine marketing is cloaking. Cloaking (also commonly referred to as IP delivery) is a process used by some webmasters to deliver custom tailored content to search engine spiders.

Over the last year, cloaking has been the focus of numerous articles, as well as the topic of debate in some of the Web's most prominent marketing related discussion forums and newsletters.

The often extreme rhetoric that has come from people on both sides of the issue, combined with a recent flurry of contradictory statements from several search engine representatives on the topic, has created an environment that has left the average Webmaster a bit confused when it comes to cloaking.

One of the best resources I've found to get a handle on the various issues relating to the use of IP delivery as a marketing tool is the "Cloaking & Doorways Advanced Track Roundtables" that take place at any of' s Search Engine Strategies conferences.

The expertise in attendance combined with the higher level of civility discussions conducted in the 3-D world tend to produce, always seem to create an environment that is both extremely informative as well as entertaining. And last month's conference in San Francisco was certainly no exception.

The first, and newest speaker on the cloaking panel was Alan Perkins, CTO of e-Brand Management a U.K based company that produces search engine optimization and submission software (

Alan had the daunting task of presenting the anti-cloaking viewpoint in a room that was admittedly pro-cloaking. His opening remarks expanded upon the general views contained in a white paper published on e Brand Management's website, ( which includes a rather unique definition of what types of customized content delivery constitutes spam.

According to Alan, "all IP cloaking delivers spam." Part of his reasoning for his position was that in order for IP delivery to be acceptable, both parties must be willing participants. Using IP delivery for SEO purposes isn't appropriate because the particular search engine hasn't agreed to accept content based upon IP identification. However, he went on to state that using IP detection to deliver content based on geographic location (a form of IP delivery used by most search engines) was an acceptable practice. (Even though the end user clearly never consents to being redirected to a specific site based upon their IP address).

He also stated that "alternative technologies such as agent based delivery or any other technology that doesn't involve detecting search engine IP addresses is acceptable."

His somewhat contradictory statements that seemed to focus solely on the act of tracking and identifying search engine IP addresses, seemed to leave the audience a bit confused as to Alan's actual position on the broader question on whether or not it's acceptable to present a search engine with content that may be different than what is seen by the majority of human visitors.

The second panelist was John Heard, President of Beyond Engineering ( As the developer of one of the first commercially available pieces of cloaking software, John was able to provide attendees with insight into the history and development of cloaking as a defensive tool used to prevent competitors from stealing optimized html code (a process commonly referred to as pagejacking). According to John, despite the fact that many engines now incorporate off-the-page criteria in their ranking algorithms, pagejacking is still quite common and does result in a substantial amount of traffic being stolen.

The third, and certainly most animated panelist was Mikkel Demib Svendsen. As both a veteran SEO consultant and former product manager for the largest Scandinavian search engine, Mikkel has had the opportunity to experience the issues involved with cloaking from "both sides of the fence."

Mikkel presented the opinion that search engines should focus their efforts on detecting and eliminating spam, regardless of the methods used to deliver it. He went on to explain that although it's certainly possible for search engines to implement programs designed to detect and eliminate content delivered via IP delivery, doing so amounts to stepping out on a very slippery slope, due to the increasing level of personalization that exists on the web. Developing programs that attempt to conduct any kind of comparative page analysis of a site in order to determine whether or not a page has been cloaked, would more than likely catch and ban many legitimate sites.

After the three panelists finished their opening statements, the session moved into the Q & A phase. The initial questions from audience members were from people wanting more examples from the panelists as to their individual interpretations of what would and would not constitute inappropriate cloaking. That lead to a few heated exchanges between Mikkel and Alan over their differing viewpoints on the definition of spam. Other than a brief comment that Alan's viewpoint amounted to "splitting hairs" John chose to remain fairly quiet.

When the verbal sparring died down, one audience member stood up and asked the main questions on everyone's mind.

What do search engines REALLY think about cloaking, and which engines, if any are actually attempting to catch and ban sites that use it?

According to John, most engines will state publicly that they don't approve of the practice, but at the present time, he was unaware of any engines that are actually targeting and banning sites simply for using IP delivery techniques. Instead, they seem to have chosen to adopt policies that are more in line with the opinions expressed by Mikkel.

Will any search engines be changing their policies towards cloaking in the near future?

It's quite possible. At the Boston Search Engine Strategies conference last March, Google Software Engineer Matt Cutts announced that Google would be launching a new automated cloaking detection system over the next 60 days. However, the consensus among the numerous attendees who admitted to using cloaking is that this hasn't yet happened.

Additional Cloaking Information:

Cloaking Forum at WebmasterWorld

AltaVista Cloaking Policy

Google Cloaking Policy

Inktomi Cloaking Policy

Greg Boser is the founder of WebGuerrilla (, a consultancy that develops customized visibility programs for clients, to ensure they are well positioned in search engines, directories, and online forums.

A longer, more detailed version of this article is
available to Search Engine Watch members.
Click here to learn more about becoming a member

Search Headlines

NOTE: Article links often change. In case of a bad link, use the publication's search facility, which most have, and search for the headline.

Terrorist search leads to ISPs...
CNET Sep 12 2001 11:42PM GMT
Who Said the Web Fell Apart?...
Wired News Sep 12 2001 7:57PM GMT
Search start-up answers Ask Jeeves call...
CNET Sep 12 2001 7:26PM GMT
Lycos Europe slashes 300 staff...
FTMarketWatch Sep 12 2001 4:13PM GMT
Amazon, Yahoo take Red Cross donations...
CNET Sep 12 2001 3:30PM GMT
Jeeves gives engine a boost... Sep 12 2001 2:08PM GMT
Finding Disaster Coverage At Search Engines...
Search Engine Report Sep 12 2001 1:30PM GMT
FBI sets up Web site to gather attack information...
ZDNet Sep 12 2001 9:23AM GMT
Tragedy Results In Web News Gridlock...
AtNewYork Sep 12 2001 6:30AM GMT
Web Offers Both News And Comfort...
New York Times Sep 12 2001 3:18AM GMT
Federal Web Sites Get Poor Grade...
Washington Post Sep 10 2001 11:39PM GMT
powered by

About the author

Chris Sherman is a frequent contributor to several information industry journals. He's written several books, including The McGraw-Hill CD ROM Handbook and The Invisible Web: Uncovering Information Sources Search Engines Can't See, co-authored with Gary Price. Chris has written about search and search engines since 1994, when he developed online searching tutorials for several clients. From 1998 to 2001, he was's Web Search Guide.