Making it easier for websites to express AI training preferences

Making it easier for websites to express AI training preferences \| OpenAI

October 30, 2026

Company

Making it easier for websites to express AI training preferences

Why we’re supporting a common signal that lets website operators communicate their choices to multiple AI providers at once.

Share

Today, we’re announcing that OpenAI will honor a common signal⁠(opens in a new window) in robots.txt, the file that lets websites express their preferences about the use of their content for foundational generative AI training. This voluntary effort makes it easier for publishers and website operators to communicate the same preference to multiple participating providers at once.

Previously, website operators would identify individual crawlers and maintain separate rules for each and every provider. Having a shared signal across multiple providers reduces that work for operators.

We aim to implement the signal in the coming months, and will share another update with details about our implementation when we do so. This new signal will not replace the controls we already provide through robots.txt. Our existing crawler controls⁠(opens in a new window), which provide web publishers flexibility and control over their pages, will continue to apply and be respected.

This draws on the ongoing work⁠(opens in a new window) of the Internet Engineering Task Force’s (IETF) AI Preferences working group. We’re joining other participants in the working group in today’s announcement of this shared signal, and believe this strengthens our continued participation in the IETF standards discussions. OpenAI will continue to adapt its practices as those conversations and the landscape continue to evolve in view of appropriate controls and fairness.

We believe this is a practical step toward an open web where people can publish and discover information, and website owners have clearer, simpler ways to communicate their choices about how their content is used. We encourage other AI providers to honor the signal.

• Policies and Procedures
• 2026

Author

OpenAI

Keep reading

View all

!OpenAI and ServiceNow expand partnership across enterprise workflows, software development and security — Cover

OpenAI and ServiceNow expand partnership across enterprise workflows\\ \\ CompanyOct 28, 2026

!OpenAI expands partnership with Oracle to bring its apps to ChatGPT — Cover

OpenAI expands partnership with Oracle to bring its apps to ChatGPT\\ \\ CompanyOct 27, 2026

!Uber brings ChatGPT Work to all employees — cover

Uber brings ChatGPT Work to all employees with OpenAI\\ \\ CompanyOct 22, 2026