SES Chicago - December 7-11, 2009

November 28, 2006

Google Quality Raters Leaving Traces When They Visit Sites

This morning I reported at SER that Google's EWOQ Search Referral String are being found in webmasters web analytics tools. For example, some people are recently noticing the URL https://www.google.com/evaluation/search/rating/task-edit?task=XXXXXX coming up in their referrals analytics. When I try to go to that URL, it tells me I do not have sufficient privileges to access that area. This EWOQ is the place for Google quality raters to leave feedback to Google on relevancy and search quality of the results.

Posted by Barry Schwartz at 10:27 AM | Permalink

December 7, 2005

Google Once Again Looking for Ad Quality Raters

We've blogged numerous times about Google and their quality rater program. A quick note to let you know that once again Google is looking for ad quality raters. It's a temp job for people who are able to work in the US or Canada. Here's a link to the job posting that went live on Monday. This post has a look back at other postngs about human quality raters at Google, MSN, and Yahoo inclduing this item about the raters hub in use at Google.

Postscript: I just noticed that G is also looking for rateers in more languages: + Quality Rater, Chinese Language (Work in U.S., or Canada) + Ads Quality Rater - German Language (Work in U.S., or Canada) + Quality Rater, French Language (Work in U.S., Canada, or France)

Posted by Gary Price at 10:53 AM | Permalink

June 2, 2005

Interested in Evaluating Search Quality and Advertising for Google?

About three months ago I posted about Google looking for "quality raters" to evalaute advertising. These could be some of the people using the "reviewers hub" that Danny and Henk are talking about in their posts. According to a couple of job engines, some of these "temporary" and "off-site" positions to evaluate both "search quality" and advertising and are still available.

Here's how the "search quality" position is described:

This is a temporary assignment at Google through ABE Services. ABE/Kelly Services are recruiting part-time remote workers to help with search quality evaluation on a project basis for Google, Inc., the search engine company based in Mountain View, California. Candidates must be web-savvy and analytical, have excellent web research skills and a broad range of interests. Specific areas of expertise are highly desirable. Participants in web evaluation projects must have a high speed internet connection. All work will be performed in the U.S. or Canada and participants must be able to demonstrate legal eligibility to work in one of those countries...n particular, applicants will be asked to draw on experience living, studying, and keeping in touch with Chinese (web) culture and language.

In a quick search this morning, I come across "quality rater" positions posted for people who speak the following languages:

+ Chinese Language + Dutch Language + French Language + German Language + Italian Language + Japanese Language + Korean Language + Spanish Language

Google is also looking for temporary workers to evaluate "ad quality. Positions for German and French speakers are also still posted.

Update: Many of these same positions along with a few "quality evaluation" positions are also listed on the Google job opportunities page. (Thanks M.N.)

Posted by Gary Price at 11:00 AM | Permalink

Google Rater Hub - Details Of Human Review System Unveiled

Google Secret Lab, Prelude from Henk van Ess's new Search Bistro blog looks at how Google uses human reviewers to improve search quality. Ess has a screenshot and a Flash movie of how the system works, for Google's temporarily hired Q&A checkers. Very nice details so far that I've never seen posted anywhere before. However, this type of system isn't new.

WebCrawler used to have a feedback system like this back in the late 90s, and other major search engines have had human reviewers, as well. Gather enough data of what's deemed good and bad, and the hope is that you can create a better search algorithm to improve relevancy.

What almost certainly is not happening is that the human reviewers are actually moving sites up and down with their ratings. Ess is promising more details in future posts, so watch his blog. Want to discuss? Visit our forum thread, Secrets of http://eval.google.com revealed?

Posted by Danny Sullivan at 3:17 AM | Permalink

See More Posts From:

This Week | This Month

  var gaJsHost = (("https:" == document.location.protocol) ? "https://ssl." : "http://www."); document.write(unescape("%3Cscript src='" + gaJsHost + "google-analytics.com/ga.js' type='text/javascript'%3E%3C/script%3E")); var pageTracker = _gat._getTracker("UA-564586-7"); pageTracker._setDomainName(".searchenginewatch.com"); pageTracker._trackPageview(); window.collarity_appid = "incmedia"; //> //>
Top Jobs
more Jobs

Senior Digital Planner
U.S. International Media Los Angeles, United States

Senior Search Analyst
U.S. International Media Los Angeles, United States New York, United States

Webmaster - Marketing
West Virginia School of Osteopathic Medicine Lewisburg, United States

Web Marketing Manager
Harvard Business Publishing Watertown, United States

White Papers
more Research

0