Google-Extended

Google-Extended is the Google user agent that collects data for AI products like Gemini and AI Overviews. It is distinct from Googlebot (search) and can be allowed or blocked independently.

Why It Matters for GEO

Allowing Google-Extended makes your content eligible for Google AI Overviews. Blocking this bot excludes you from Google's AI search while keeping your presence in traditional search results.

This separation gives website owners nuanced control, but it also creates a common trap: businesses that want to limit data collection by Google's AI products may block Google-Extended without realizing it removes them from AI Overviews entirely. For most businesses, Google-Extended should be allowed.

How to Optimize

Add to your robots.txt:

User-agent: Google-Extended
Allow: /

Key Distinction

• Googlebot: Traditional search (required)
• Google-Extended: Google AI products (optional)

Blocking Google-Extended does not affect your traditional SEO rankings.

Practical Example

A publishing company is cautious about AI companies using their content for model training without compensation. They research the distinction between Googlebot and Google-Extended, then make a deliberate decision: they allow Google-Extended to maintain visibility in Google AI Overviews (which drives traffic back to their site), while blocking certain other AI crawlers whose products do not provide citation links. This nuanced robots.txt strategy preserves their AI search visibility on Google while limiting exposure on other platforms.

Common Mistakes

• Blocking Google-Extended as part of a blanket AI crawler block: If you use User-agent: GPTBot and Disallow: / to block OpenAI, then add Google-Extended to the same block, you lose AI Overview visibility without gaining any traffic benefit.
• Assuming Googlebot permission covers Google-Extended: Explicitly allowing User-agent: Googlebot Allow: / does not extend to Google-Extended. Each user agent requires its own robots.txt rule.
• Not monitoring the impact of blocking: Some businesses block Google-Extended, then complain about declining AI search visibility months later without connecting the two events. If you block this bot, track your AI Overview impressions in Google Search Console for the following quarter.
• Forgetting to update after a site migration: Robots.txt files are often rebuilt during platform migrations. If Google-Extended was previously allowed and the new robots.txt does not include it, you may lose AI Overview eligibility without noticing for weeks.