
OpenAI, Google, Microsoft and Anthropic back a shared robots.txt signal to let sites block AI training in one step
The four companies committed on October 30 to honor a common robots.txt policy token that lets any website refuse AI training across all participating crawlers at once. Anthropic already supports it; the others plan to implement in 2027.




































