Google's UGC spam guidance: what AI tools should index

By Redacción Usanzia · Published

Since 26 October 2026, Google has asked tools that publish shared pages, generated content or web apps to index only what's meant for Search. For shared chats, artifacts and user-built apps, it recommends noindex or a crawl block by default; if those pages are already indexed, use noindex without blocking them in robots.txt, or Google won't see the rule.

See the steps

A grid of ink-outlined pages, a green barrier and a frame holding just two green pages, on a paper-coloured background.

Key points

  • On 26 October 2026 Google updated its guide to preventing user-generated spam to cover tools that let users publish shared pages, generated content or web apps.
  • A new section, Only index content meant for Search, recommends noindex or a robots.txt block by default for pages made for sharing, collaboration or utility, although robots.txt doesn't guarantee the URL leaves the index.
  • Google doesn't name any specific tool, and the guide doesn't announce new manual actions: it tells you to verify your site in Search Console to receive alerts.
  • Blocking a URL in robots.txt won't reliably keep it out of Google; to deindex a page, it must be crawlable and return noindex.
  • Warning signs to watch: spikes in indexed pages, queries unrelated to your platform, or a handful of users producing a large share of indexable URLs.

What has Google changed in its user-generated spam guidance?

Google has expanded its guide Prevent user-generated spam on your site and platform to explicitly cover hosting platforms and tools that let users publish shared pages, generated content or web apps. According to the Search Central documentation changelog, the update went live on 26 October 2026 and adds guidance on blocking the indexing of link-shared content and on monitoring abuse in Search Console.

The guide notes that these platforms can be as open to abuse as an unprotected comment form: spammers may create large numbers of pages or sites that break Google's spam policies and add little or no value to the web. There are three main changes:

Google's stated reason is to help platforms keep user-created pages that aren't meant for Search out of the index, and to detect spam earlier.

Google warns tools on user-generated spam guidance and adds a new section for only index content meant for Search

What does the new "Only index content meant for Search" section say?

It asks services that let users create shareable pages, generated outputs or interactive tools to decide whether that content is meant to be found through search engines or only reached by people who have the link. Where pages exist for direct sharing, collaboration or utility rather than public discovery, Google recommends applying the noindex rule (via the robots meta tag or the X-Robots-Tag HTTP header) or blocking crawling in robots.txt by default.

"By default" is the important part: the guidance isn't about cleaning up later, it's about making sure anything not meant for Search never enters the index in the first place.

Does this cover shared chats, artifacts and AI-built apps?

In our reading, yes. A shared chat, an artifact (a piece of content or mini app produced by an AI assistant that can be published via a link) or a web app built with an AI tool fits the categories the guide describes: shareable pages, generated outputs and interactive tools. Google, however, doesn't name any specific tool.

Others in the industry read it the same way. Lily Ray wrote on X that her first thought was "Claude artifacts, ChatGPT pages/sites" and other social and AI tools that make it easy to churn out indexable UGC at scale (her post, 26 October 2026). Marie Haynes asked whether new manual actions were coming for AI tools and app-building platforms, and argued that Google is putting "the burden of curation" onto tool makers (her post, 26 October 2026).

Two points we checked against the documentation:

What do Google's spam policies say about this kind of content?

Google's spam policies define user-generated spam as spammy content that users add to a site through a channel intended for user content, often without the owner knowing. Examples include spammy accounts on hosting services anyone can sign up for and spammy files uploaded to file hosting platforms.

The same page defines scaled content abuse as generating many pages mainly to manipulate rankings rather than help users, "no matter how it's created". One of its examples is using generative AI or similar tools to produce many pages without adding value for users. If you host that kind of content, Google says to exclude it from Search.

For an AI product, the practical takeaway is that the risk isn't just what the company publishes, but what its users can turn into public, indexable URLs.

noindex or robots.txt: which should you use for shared pages?

For pages that shouldn't appear in Google, noindex (as a meta tag or an X-Robots-Tag header) is the safer choice, because a robots.txt block doesn't guarantee the URL leaves the results. The prevention guide accepts both, but Google's documentation on robots.txt and noindex draws some important distinctions:

Criterionmeta robots noindexX-Robots-Tag: noindex headerDisallow in robots.txt
What it doesAsks Google not to index the pageAsks Google not to index the page or resourceAsks Google not to crawl the URL
Removes the page from resultsYes, once Googlebot crawls the page and reads the ruleYes, once Googlebot crawls the URL and reads the headerNot necessarily: the URL can still show without a description if other pages link to it
Works for non-HTML filesNoYes (PDFs, images, video)Yes; for images, video and audio it also keeps them out of results
RequirementURL must be crawlableURL must be crawlable—
Our suggested useHTML templates for shared pagesServer-side rules by URL pattern and for generated filesAreas that should never be crawled, aren't already indexed and aren't shared publicly by link

A URL blocked in robots.txt but linked from other pages can still show in results without a description, so for chats, artifacts and apps shared by link, noindex is the way to go.

The mistake to avoid is doing both on the same URL. Google warns that if a page is blocked by robots.txt, the crawler never sees the noindex rule and the page can still appear in results. So if shared pages are already indexed, our advice is to add noindex and not block them in robots.txt until they've dropped out. Google also notes that it doesn't support noindex inside robots.txt. And the rule should live in the HTML your server returns or in the X-Robots-Tag header. We recommend not adding or removing it with JavaScript, because according to Google's JavaScript SEO basics, when Google finds noindex it may skip rendering and JavaScript execution.

Which generated content deserves to be indexed?

Only content a user has deliberately published to be found, and that stands on its own; everything else should stay out of the index by default. Google's guide offers two levers:

Our rule of thumb for AI tools: indexable only if the user explicitly publishes it as a public page (generating a share link isn't enough), the page makes sense without the chat context, and it has passed some form of review, automated or human.

How do you monitor abuse in Search Console?

Verify the site or subdomain where user pages live and check the indexing and performance reports regularly. Google's guide spells out what to look for:

The guide also keeps its long-standing preventive measures: a clear abuse policy shown at sign-up, a way for trusted users to report content, manual moderation for suspicious interactions, blocklists, and reCAPTCHA or similar checks against automated account creation.

Step by step

  1. Map every public URL your users can create

    List each page type your tool can publish: shared chats, artifacts, generated apps or sites, profiles, uploaded files and any other output reachable without logging in. Note the URL pattern and the domain or subdomain for each.

  2. Sort each type by intent

    Decide whether each type is meant to be found in search or only by people with the link. If it's for sharing, collaboration or utility, keep it out of the index by default, as Google recommends.

  3. Default to noindex for anything not meant for Search

    Send an X-Robots-Tag: noindex header by URL pattern from the server, or a meta robots noindex tag in the HTML your server returns. Never add or remove it with JavaScript: Google may not render the page. Use the header for generated non-HTML files too, such as PDFs or images.

  4. Don't block in robots.txt what you want deindexed

    If shared pages are already indexed, let Googlebot crawl them so it can read the noindex rule, and keep them crawlable with noindex for as long as they need to stay out. A robots.txt block would hide the rule and the URL could keep showing in results.

  5. Decide when indexing is allowed

    Only allow indexing when a user explicitly publishes a page and, where relevant, once they've built a reputation on the platform. Keep noindex on content from new users, as Google suggests. Set or remove noindex in the server-returned HTML or the X-Robots-Tag header, never with JavaScript, because Google may not render the page.

  6. Qualify links in user content

    Add rel="ugc" or rel="nofollow" to links in untrusted content. You can remove it for users with a consistent record of high-quality contributions.

  7. Tighten sign-up and moderation

    Publish an abuse policy and show it at sign-up, let users report content, use reCAPTCHA or similar checks against automated sign-ups, moderate suspicious interactions and keep blocklists.

  8. Verify the domain in Search Console and set alerts

    Verify the site or subdomain that hosts user pages so you receive manual action and security alerts. Review the Page Indexing and Search performance reports, and set internal alerts for spikes in new public pages or a few users producing many indexable URLs.

  9. Check that noindex is working

    Use the URL Inspection tool to see the HTML and headers Googlebot received, and the Page Indexing report to track URLs excluded by noindex. If you need a page gone urgently, the Search Console Removals tool only hides it temporarily (about six months); to keep it out, you need noindex or a 404 or 410 status.

Trust and evidence

Sources

  1. Prevent user-generated spam on your site and platform. Google Search Central (26 October 2026), accessed 27 October 2026.
  2. Latest Google Search Documentation Updates — «Updated guidance on preventing user-generated spam», 26/10/2026. Google Search Central (26 October 2026), accessed 27 October 2026.
  3. Spam policies for Google web search — apartados «User-generated spam» y «Scaled content abuse». Google Search Central (28 August 2026), accessed 27 October 2026.
  4. Block Search indexing with noindex. Google Search Central (10 December 2025), accessed 27 October 2026.
  5. Introduction to robots.txt. Google Search Central (10 December 2025), accessed 27 October 2026.
  6. Qualify your outbound links to Google. Google Search Central (10 December 2025), accessed 27 October 2026.
  7. Understand the JavaScript SEO basics — apartado «Use meta robots tags carefully». Google Search Central (4 March 2026), accessed 27 October 2026.
  8. Removals and SafeSearch reports Tool — ayuda de Search Console (consultado). Google Search Console Help, accessed 27 October 2026.
  9. Google Warns Tools On User-Generated Spam Guidance & More. Barry Schwartz, Search Engine Roundtable (26 October 2026), accessed 27 October 2026.
  10. Post de Barry Schwartz en X sobre la actualización. Barry Schwartz (26 October 2026), accessed 27 October 2026.
  11. Post de Lily Ray en X sobre la actualización. Lily Ray (26 October 2026), accessed 27 October 2026.
  12. Post de Marie Haynes en X sobre la actualización. Marie Haynes (26 October 2026), accessed 27 October 2026.

Keep reading

Subscribe via RSS