Add Content-Signal directives to robots.txt to declare whether AI crawlers may search, ingest, or train on your content. An emerging IETF AI Preferences / IAB Tech Lab proposal that some validators already check.
IETF AI Preferences WG (aipref) — drafts
IAB Tech Lab — Content Monetization Protocols (CoMP) for AI
Is It Agent Ready? — Content Signals check