Yes, Google Does Alert You To New Blog Finds

ZDNet’s David Berlind rants
that Google Alerts don’t include
blogs, so he can’t get an email update on news found via the new
Google Blog
service. David, you can have an RSS feed of anything you want on blog
search. I explain that
here. It’s
not even that hard. There are links to keyword-based feeds at the bottom of each
page. So you want the latest from blogs via Google — there you go.

Want to get huffy about something? Stick to the bigger problem that for the
blog RSS alerts I get, there’s still a ton of spam and off-topic material, not
to mention it misses stuff because it’s not an full-text index of actual blog
posts yet. Of course, it’s only been out for less than two weeks, so I’ll cut
them a little slack for now.

Berlind’s just flat wrong when he goes into this part:

I can understand if Google feels as though the blogosphere isn’t a part of
"news."  But isn’t the blogosphere part of the Web? Or is the blogosphere not
the Web?  This problem with Google Alerts is nothing new.  For example, Yahoo!’s
Jeremy Zawodny

made hay about the exclusion
over two years ago.

Google, of course, does index blogs as part of its web index. In fact, anyone
who has half an ear to the blogosphere knows the conventional wisdom that blogs
have supernatural ranking powers that can push ordinary web pages aside in
Google web search.

It’s not quite like that, but blogs can, do and have existed in Google web
search. So if you have a Google Alert to monitor the web, and a new blog page
shows up in the top rankings, you’ll get that alert. The real problem with
watching web search is that it’s not really time sensitive. If the top results
don’t change a lot — and they really generally shouldn’t — then there’s
nothing to alert you to. News search, blog search — these change often, since
new material is purposely flowing in and given a deliberate relevancy boost, as
it makes sense for that content.

As for what Jeremy was making hay about, let’s be clear. It wasn’t an
exclusion of blogs from web search. It was the exclusion of blogs as part of
NEWS search. Not web search, got it? Blogs have always been part of web search.

This part is fun:

I’d do a fact check with Google to find out why the Blog Search isn’t
included as a new type in Google Alerts (doesn’t it make sense for Google to
do this?), but, as an employee of CNET Networks, I’m included in Google CEO
Eric Schmidt’s blackout.

Yeah, that sucks. They’re stupid for doing that to Bad, bad Google
— and example of why this will keep blowing up in their face as well as why it
hurts the communication process. Of course, Berlind probably wouldn’t be so
ticked it he hadn’t been banned. More to the point, he can certainly fact check
in other ways. Hmm, maybe even by reading the

Postscript: Dave Winer
says I’m
wrong and unfair in my post above:

Google doesn’t include blogs in Google News, or at least that’s what they
claim. However, a lot of the supposed non-blogs they include are in every way

Yes, Dave — I know that. David wasn’t writing about how Google keeps blogs
out of news search. He acknowledges in the story that blogs aren’t part of news
search — as I wrote in my summary. In fact, he even says he "understands" why
Google doesn’t include blogs in news search.

Where David was wrong, and what I was correcting, was his suggestion that
blogs aren’t in WEB search.
Blogs, of course, are in web search.

Postscript 2: And now David Berlind’s
not happy and STILL
incorrect again. Since he feels so taken to task that he wants to take me to
task, I’ll answer what he said:

First things first. Sullivan never bothered to call me before questioning
the integrity of my coverage when, in referring to Google’s blacklisting of
journalists that work for CNET Networks, he wrote "Of course, Berlind probably
wouldn’t be so ticked it he hadn’t been banned. " Had you called Mr. Sullivan,
or if you’ve read anything I’ve written in my 15 years as a hi-tech
journalist, you’d know that I’ve never and will never take vendors’ personal
treatment of me into consideration when writing about them. This is true in
both respects. My coverage cannot be swayed to the positive by currying favor,
nor can it be swayed to the negative by treating me negatively.

OK, first, I didn’t need to call you because the key fact in your story about
blogs not being in web search was wrong. I could see that. It would be like
calling you up and saying, "David, you said 2+2=5. I disagree with this. How are
you doing the math." What were you going to explain to me? How further wrong
they were?

Question whether you were ticked at Google? Of course you were. You should
be. They have a stupid policy of not talking to CNET, and it means you can’t get
direct answers from them, when you should. Could you verify the facts another
way, if you really cared. Of course you could. You didn’t. And did that ticked
tone come through in your story? It did from where I sit. Rather than using the
standard CNET line that all your collegues I talk with regularly with at about having tried to ask for a response and not getting one, you went
with a brand new "I’m on the blacklist" tone.

As for Sullivan’s explanation of why I was wrong about Google Alerts, I
think the fact that he provides a workaround instead of factual evidence that
I am wrong to ask the question I asked actually supports my position. Instead
of discussing Google Alerts, as I did, he discusses Google’s new blog search
and how to set it up to satisfy my needs. So, let me fall back to the original
facts, and the original question.

It’s not a workaround. You want to be alerted to new blog finds. RSS feeds at
Google give you this. You want it fast? RSS is faster than web alerts. You can’t
get it via email, no. The Google Alerts may not be working right. But the point
is, you want blog content from Google, but you with "15 years as a hi-tech
journalist" don’t seem to know that Google’s new blog search offers exactly what
you want. Did you read any of the coverage of Google’s blog search launch last
week? This type of alert is what you want. Numerous people including myself
mentioned it exists. It’s right on the blog search result pages. Is there some
additional road map you need?

And back to the original incorrect fact, you were wrong before and you’re yet
WRONG again:

Google Alert says it can watch for me: News and the Web. Not that I agree
(it’s the subject of huge debate), but I understand the reasons that a search
engine company might fall on the side of saying blogs are not news. But,
there’s just no way anyone can say that they’re not part of the Web.

No one is saying that. Google isn’t saying that. They’ve never, ever said
blogs aren’t part of the web. In fact, they said the exact OPPOSITE when some
people worried that blogs might get pulled from web search back in 2003. From my

By the way, one thing NOT in
the cards for future index changes are any plans to pull blog content out of
Google’s regular search results. Google made a special point of stressing that
blogs are staying, during my interview with them last week.

Google offers you a web search alert. Blogs, as I wrote before, are part of
web search. Here, do this
for your name. Plenty of blogs there for your name. Go sign up for a
Google web alert to that, and if some new blog (or anything) in web search shows
up, you’ll see it. Suggesting that because it doesn’t say "web & blogs" is like
saying you aren’t getting oxygen because the canister of air doesn’t say "air &
oxygen" on it. There’s oxygen in the air. There are blogs in web search.

I don’t know how else to say it. Blogs are in web search. They ARE in web
search. You get a web search alert, you get blogs in there. If you JUST want
blogs, then you have to do something else. That’s what you want, I know. But
you’re wrong to suggest that blogs aren’t already in web search results. They

I don’t know much about ranking algorithms. But, I have a difficult time
understanding how I can be alerted to something "as it happens" if that
something has to get ranked by an algorithm first. In Sullivan’s words, some
blogs "have supernatural ranking powers that can push ordinary web pages aside
in Google web search." Thanks but no thanks. I’m not looking for the bloggers
that have figured out how to manipulate search engines. I’m looking for the
ones with the most interesting things to say about Vista (including ones that
work at Microsoft). So, the pages I actually want to see are probably the
unranked ones. At the very least, this should be a configurable item (like a
checkbox that says "filter results based on Google’s rankings").

This isn’t about knowing ranking algorithms. It’s about understanding the
basics of search. What does the search engine include, and how does it sort things.

Google web search includes content from across the web, including blogs.
Scoring is done by relevancy, rather than currency/freshness. IE, just because
you are the newest site doesn’t mean you’ll be the site at the top.

So you want bloggers that seem to be most relevant for Windows Vista over
time. Web search helps there. You want the very latest things being posted? You
have to use a blog search engine where the default sort is on currency.

Over at Google’s blog search, you can do both. The default is on relevancy
overall, but you can switch to getting the most recent. The underlying results
so far aren’t that great either way, to me.

Overall, sorry you wrote a column where you made a major factual error about
what’s in Google’s web search. Sorry you were upset I felt like I had to comment
on a piece written by a major IT journalist who thinks blogs aren’t part of WEB
search. But that’s what you said, and it was wrong.

Postscript 3: Just in case there is any confusion, I wholehearted apologize to David for giving any impression that he somehow wrote a slanted article because of the policy of Google not talking to CNET. I did feel the tone of his piece seemed upset at Google, but upset doesn’t mean you can’t be fair. In short, I really wasn’t trying to imply he was unfair. I can’t apologize for the fact that he made a factual error in saying blogs aren’t part of web search or that he could have fact checked this in ways other than contacting Google.

Postscript 4: One more wholehearted and unreserved apology. I certainly could have written my critique of his piece without it being so personal or in a better tone.

Related reading

A pair of yellow cartoon hands holds the newspaper The Springfield Shopper, which bears the headline SLEEP IMPORTANT, SAY EXPERTS.
facebook at work
The front page of the Simpsons newspaper Springfield Shopper, with the headline Wiccan Curse Blinds Half the Town. Underneath the subheading reads, Newspaper sales plunge 50 percent
Simple Share Buttons