# Blocks AI agents # ChatGPT User-agent: ChatGPT-User Disallow: / User-agent: GPTBot Disallow: / # Cohere User-agent: cohere-ai Disallow: / # Anthropic User-agent: anthropic-ai Disallow: / # Bytespider (Bytedance) User-agent: Bytespider Disallow: / # Common Crawl User-agent: CCBot Disallow: / # Bard User-agent: Google-Extended Disallow: / # Perplexity User-agent: PerplexityBot Disallow: / User-agent: Perplexity-User Disallow: / # Webz User-agent: OmigiliBot Disallow: / # Mistral User-agent: MistralAI-User Disallow: / # Claude User-agent: ClaudeBot Disallow: / User-agent: claude-web Disallow: / # Bing User-agent: BingBot Disallow: / # Amazon User-agent: Amazonbot Disallow: / # Apple User-agent: Applebot Disallow: / User-agent: Applebot-Extended Disallow: / # Facebook User-agent: FacebookBot Disallow: / User-agent: meta-externalagent Disallow: / # LinkedIn User-agent: LinkedInBot Disallow: / # DuckAssist User-agent: DuckAssistBot Disallow: / # Semantic Scholar User-agent: AI2Bot Disallow: / # Diffbot User-agent: Diffbot Disallow: / # omgili User-agent: omgili Disallow: / # Timpi User-agent: TimpiBot Disallow: / # You User-agent: YouBot Disallow: /