Metric: Bot Access Score

How it's calculated

SEODiff checks robots.txt for 5 AI crawler user-agents. Each allowed bot contributes 20 points:

BotAccessScore = AllowedBots × 20   (max 100)

Bot	Operator	Points
GPTBot	OpenAI	20
ClaudeBot	Anthropic	20
CCBot	Common Crawl	20
Google-Extended	Google (Gemini)	20
Googlebot	Google (Search)	20

Interpretation

• 100: All 5 bots allowed — full AI accessibility.
• 60–80: Some bots blocked — you're excluded from certain AI pipelines.
• 0–40: Most bots blocked — critical AI visibility issue.

Gatekeeper effect

Bot Access triggers hard caps on the overall AI Readiness Score:

• Both GPTBot AND ClaudeBot blocked → AI Readiness capped at 15
• WAF / CAPTCHA detected → AI Readiness capped at 10

This makes Bot Access the most impactful subscore. Fix access issues before optimising anything else.

Common causes of low score

• Explicit Disallow: / rules for AI bot user-agents in robots.txt
• WAF or bot management (Cloudflare, Akamai) challenging unknown user-agents
• Overly restrictive default robots.txt blocking all non-Google bots