Using data from human "quality raters," Google hopes to teach its algorithms how to better spot offensive and often factually incorrect information.
Google is undertaking a new effort to better identify content that is potentially upsetting or Offensive to searchers. It hopes this will prevent such content from crowding out factual, accurate and trustworthy information in the top Search results.
“We’re explicitly avoiding the term ‘fake news,’ because we think it is too vague,” said Paul Haahr, one of Google’s senior engineers who is involved with search quality. “Demonstrably inaccurate information, however, we want to target.”
New role for Google’s army of ‘quality raters’
The effort revolves around Google’s quality raters, over 10,000 contractors that Google uses worldwide to evaluate search results. These raters are given actual searches to conduct, drawn from real searches that Google sees. They then rate pages that appear in the top results as to how good those seem as answers.
Quality raters do not have the power to alter Google’s results directly. A rater marking a particular result as low quality will not cause that page to plunge in rankings. Instead, the data produced by quality raters is used to improve Google’s search algorithms generally. In time, that data might have an impact on low-quality pages that are spotted by raters, as well as on others that weren’t reviewed.
Quality raters use a set of guidelines that are nearly 200 pages long, instructing them on how to assess website quality and whether the results they review meet the needs of those who might search for particular queries.
The new ‘Upsetting-Offensive’ content flag
Those guidelines have been updated with an entirely new section about “Upsetting-Offensive” content that covers a new flag that’s been added for raters to use. Until now, pages could not be flagged by raters with this designation.
The guidelines say that upsetting or offensive content typically includes the following things (the bullet points below are quoted directly from the guide):
- Content that promotes hate or violence against a group of people based on criteria including (but not limited to) race or ethnicity, religion, gender, nationality or citizenship, disability, age, sexual orientation, or veteran status.
- Content with racial slurs or extremely offensive terminology.
- Graphic violence, including animal cruelty or child abuse.
- Explicit how to information about harmful activities (e.g., how tos on human trafficking or violent assault).
- Other types of content which users in your locale would find extremely upsetting or offensive.
The guidelines also include examples. For instance, here’s one for a search on “holocaust history,” giving two different results that might have appeared and how to rate them:
[Read the Full Article]