# LLMs Access Control File # Controls how AI agents may use and crawl your content. User-Agent: OpenAI Allow: / User-Agent: Anthropic Allow: / User-Agent: Google-Extended Allow: / User-Agent: PerplexityBot Disallow: / User-Agent: AppleBot Allow: / User-Agent: CCBot Disallow: / # Default rule for unknown LLM crawlers User-Agent: * Disallow: /private/ Allow: /