anthropic-ai

anthropic-ai is a secondary user agent from Anthropic (the company behind Claude) used for web crawling. It complements ClaudeBot for training data collection and research purposes.

Why It Matters for GEO

For maximum visibility in Claude, you need to allow TWO bots: ClaudeBot AND anthropic-ai. Missing either one may limit how well your content is indexed.

How to Optimize

Add to your robots.txt:

User-agent: ClaudeBot
Allow: /

User-agent: anthropic-ai
Allow: /

Key Distinction

• ClaudeBot: Primary bot for Claude products
• anthropic-ai: Secondary bot for research