OpenAI, Google, Microsoft and Anthropic will adopt a single signal for websites to opt out of AI training
Published in edition no. 1 of Noticiário do Joãozinho ·
Translated by Joãozinho AI from the original Brazilian Portuguese edition. Facts, numbers and sources are the same as in the original; quotes, video titles and source names stay in their original language. Read the original in Portuguese
The shared policy token was proposed at the IETF by Kevin Kelley, of Anthropic, and lives in robots.txt. The four companies say they will restrict their AI crawlers when they find it. Anthropic has already adopted the signal, Google and Microsoft will support it next year and OpenAI in the coming months. Meta expressed support but did not say whether it will respect it.
Original source: The Verge — https://www.theverge.com/tech/1023763/openai-google-microsoft-ai-scraping-standard-opt-out