Google, Microsoft, OpenAI and Anthropic back one AI training opt-out in robots.txt
Four major AI companies—Google, Microsoft, OpenAI, and Anthropic—have agreed to honor a shared opt-out mechanism for AI training data via the robots.txt standard. This means website owners can use a single robots.txt dir...