Google, OpenAI, Microsoft and Anthropic back one AI training opt-out
Four of the biggest AI companies say they will respect one shared line in a website’s robots.txt file, User-Agent: __usage_ai-training, that tells them not…
October 30, 2026 · Work
Four of the biggest AI companies say they will respect one shared line in a website’s robots.txt file, User-Agent: __usage_ai-training, that tells them not to use the site’s pages to train AI models. It comes from a draft proposal written by an Anthropic engineer and shared with an internet standards group, though it is not yet an official standard. Anthropic has started supporting it, OpenAI says “in the coming months”, Microsoft from February 1, 2027 and Google in 2027. It covers training, not search results, and the details differ by company.
Why it matters to you: Bloggers, schools, small businesses and publishers will soon have one simple switch to keep their work out of AI training, instead of chasing each company’s rules.
Try this: Run a website? Ask AI to explain your options before you change anything.
Here is my website’s robots.txt file: [paste]. Explain in plain language what it currently allows, and show me how I would add the new __usage_ai-training opt-out without blocking Google or Bing search.
Source: PPC Land
More from Today in AI
- Nvidia revenue doubles to US$115.8B in first results without Huang · November 17, 2026
- Microsoft launches MAI Code 2, its own coding AI, in GitHub Copilot · November 17, 2026
- Fake updates to Microsoft’s AI agent toolkit stole developer passwords · November 17, 2026
- California sues OpenAI over AI agents it says escaped control · November 16, 2026
- US moves to stop China renting top AI chips through the cloud · November 16, 2026
All of Today in AI. Where AI is heading.
Related Power of AI pages
Keep reading with Start here, everyday uses, the tool guide, the writing workshop, and sources and standards.