GOOGLE WANTS ONE OPT-OUT SWITCH FOR AI TRAINING, NOT TEN.
On October 30, 2026, Google said it plans to support a shared robots.txt signal that lets a website opt out of AI training across multiple AI companies at once, instead of writing separate rules for each one. Here is what that actually means if you run a small business site.
AT A GLANCE
By Conqueror Capital · Published
The change: Google announced on that it intends to support a shared "policy token" in robots.txt, letting site owners set one AI-training preference that multiple AI providers can read, instead of a separate rule per company.1
WHAT GOOGLE ANNOUNCED
Right now, if a website owner wants to stop their pages from being used to train AI models, they generally have to add a separate line to their robots.txt file for each AI company — one rule to block Google's training crawler, another for a different provider, and so on. Google's post describes a plan to simplify that into a single, shared signal.1
The mechanism is based on work from the AIPREF group at the IETF (the standards body that helps define how the open web works), and Google says it is a draft proposal it intends to support alongside other AI providers starting in 2027.1 It sits alongside Google-Extended, the company-specific AI training control Google has offered since 2023 — that control keeps working exactly as it does today.1
HOW THE SIGNAL WOULD WORK
Instead of maintaining a list of per-company rules, a site owner would add one broad opt-out token to robots.txt. Google says that if a site uses this shared token to opt out and doesn't separately mention Google-Extended, it plans to treat that the same as if the site had blocked Google-Extended directly. Other AI providers that choose to support the same signal could do the same.1
Site owners keep the option to be more specific: the broad signal sets a default, and a company-specific rule (like Google-Extended) can still override it for that one provider. So a business could, for example, opt out broadly but still choose to allow Google specifically, since Google notes that sites which allow Google-Extended stay eligible to be named and linked in Gemini App answers.1
WHY THIS MATTERS FOR A SMALL BUSINESS SITE
Nothing changes on your site today — Google says it is aiming to support this in 2027, and the detail is still being worked out with the IETF group.1 But it is worth having on your radar for two reasons that affect how customers find a local business:
- Fewer technical rules to keep track of. Most small business owners never touch robots.txt directly — a developer or platform does it for them. A single shared switch means whoever manages your site in 2027 won't have to chase down a separate rule for every AI company that crawls the web.
- It is a training signal, not a visibility signal. Blocking AI training is a different choice from being named by ChatGPT, Google's AI Overviews, or Gemini when someone asks "best plumber near me." A business that opts out of AI training can still show up in AI answers the way it shows up in regular search — the training control and the answer-visibility question are separate decisions, and worth thinking about separately before anyone flips the switch.
We cover the broader AI-visibility side of this — what it takes for a local business to actually get named in AI answers — in our AI search guide for local business.
WHAT TO DO NOW
- Nothing to change today. The shared signal isn't live yet, and existing per-provider controls like Google-Extended keep working as-is.1
- Know what your robots.txt currently allows, so that when a shared opt-out option does arrive, you (or whoever manages your site) can make an informed choice rather than a default one.
- Separate the two questions before deciding anything: do you want your content used to train AI models, and do you want your business named in AI answers. They are not the same switch.
If you'd rather someone else track platform changes like this one and tell you only when it actually requires a decision, that's part of what we do for clients whose websites we manage.
SOURCES
- Google Search Central Blog, Supporting a shared AI training control for websites, October 30, 2026.
Platforms change often. Check the source for the current version before acting.
KEEP READING
BOOK A STRATEGY CALL
Not sure what a platform change means for your business? Ask us on a 15-minute call.