Google, OpenAI, Microsoft and Anthropic back one AI training opt-out

Four of the biggest AI companies say they will respect one shared line in a website’s robots.txt file, User-Agent: __usage_ai-training, that tells them not…

October 30, 2026 · Work

Four of the biggest AI companies say they will respect one shared line in a website’s robots.txt file, User-Agent: __usage_ai-training, that tells them not to use the site’s pages to train AI models. It comes from a draft proposal written by an Anthropic engineer and shared with an internet standards group, though it is not yet an official standard. Anthropic has started supporting it, OpenAI says “in the coming months”, Microsoft from February 1, 2027 and Google in 2027. It covers training, not search results, and the details differ by company.

Why it matters to you: Bloggers, schools, small businesses and publishers will soon have one simple switch to keep their work out of AI training, instead of chasing each company’s rules.

Try this: Run a website? Ask AI to explain your options before you change anything.

Here is my website’s robots.txt file: [paste]. Explain in plain language what it currently allows, and show me how I would add the new __usage_ai-training opt-out without blocking Google or Bing search.

Source: PPC Land

More from Today in AI

All of Today in AI. Where AI is heading.

Related Power of AI pages

Keep reading with Start here, everyday uses, the tool guide, the writing workshop, and sources and standards.