← All AI news
OpenAIIndustry

Website owners get a simpler way to state AI training preferences

OpenAI plans to honor a shared robots.txt signal, reducing the need to maintain separate preferences for each participating provider.

THE UPDATE

What changed

OpenAI says it will support a common robots.txt signal for expressing preferences about foundational AI training. The voluntary effort would let website operators communicate one preference to multiple participating providers. OpenAI plans implementation in the coming months; its existing crawler controls remain in place.

One useful next step

Ask whoever manages your website to review your existing crawler settings and watch for implementation instructions before changing them.

Read the AI safety field notes ↗

Before you dive in

This is a voluntary signal for participating providers. It is not a universal technical block on content use.

GO TO THE ORIGINAL

Source & announcement date

OpenAI ·

Making it easier for websites to express AI training preferences ↗ (opens in a new tab)

This brief summarizes the linked announcement. “The AI Superpower take” and the next step are our editorial interpretation, not claims from the source.

KEEP YOUR CURIOSITY GOING

A few more worth knowing.

All AI news ↗