arxiv.org achieves a 67/100 on the AI-Crawler Reality Index, reflecting above-average readiness for AI-driven discovery. Content is delivered server-side, meaning bots and AI agents can parse the full page without executing JavaScript. With a 4.4× bloat ratio, the page delivers its content without excessive boilerplate, giving AI systems a clean extraction path. No structured data was detected, which means AI systems must infer all entities and relationships from raw HTML alone. The site maintains an open-door policy for AI crawlers — GPTBot, ClaudeBot, and other major agents are all allowed.
🧮 Score Transparency — How is this calculated?
📊 ACRI Sub-Scores (AI Readiness Detail)
arxiv.org punches above its weight in AI — AI visibility exceeds Google ranking. This is a competitive moat worth protecting. ACRI measures technical crawler readiness. Read the methodology →
Why arxiv.org ranks here
Fastest improvements
- Add basic Organization and WebSite JSON-LD to fix “0 schema blocks” (see Schema Coverage).
- Reduce token bloat (navigation/footer/code) so agents reach your main content faster (see Token Bloat).
- Create an
llms.txtfile so AI crawlers can discover your content structure without heavy crawling. Generate llms.txt → - Run a full entropy audit to find which DOM regions waste the most tokens. Run Entropy Audit →
Traditional SEO
39/100 25 % of Global Score 🟡 Medium Confidence📝 Title Tag
Optimal range: 30–60 characters for SERP display.
📋 Meta Description
Optimal range: 120–160 characters for snippet control.
🔤 Heading Hierarchy
- ✓ Exactly 1 <h1> tag — found 1
- ✓ Has <h2> headings — found 10
- ✓ <h2> not before <h1>
🔍 Indexability
- ✗ Canonical tag present
- ✓ No noindex directive
- ✓ Meta viewport set
- ✓ HTML lang attribute →
en - ✗ Hreflang tags
- ✓ Googlebot allowed by robots.txt
🌐 Social / OpenGraph
- ✗ og:title
- ✗ og:description
- ✗ og:image
- ✗ twitter:card
📐 How the SEO Pillar score is calculated
SEO Pillar = Title (20 pts) + Meta Desc (20 pts) + Heading Hierarchy (20 pts) + Indexability (20 pts) + Social/OG (20 pts)
Each sub-score is derived from the checks above. Canonical tag, lang attribute, og:image, and a single H1 are the highest-impact items.
AI Readiness / GEO
77/100 40 % of Global Score 🟢 High ConfidenceThis pillar aggregates citation share, hallucination risk, bot access, schema health, and content extractability. The individual diagnostic sections below contribute to this score.
Is AI lying about your brand? This panel measures how likely LLMs are to hallucinate facts when extracting information from your page.
🤖 Bot Access Matrix
📊 Structure & Information Density Docs
🏷️ Schema Health Docs
Schema Coverage Map
📐 AI Efficiency Metrics Docs
Token Bloat Research
Multimodal Readiness
TDM Rights
🔥 Structural Entropy Check Research
🔬 AI-Crawler Simulation
See your website the way AI crawlers do. CSS stripped, structure labeled, content chunked.
Toggle to "AI Agent View" to see what GPTBot, ClaudeBot, and other AI crawlers actually extract from this page.
AI Answer Preview
NEWSee how AI models summarize your site. Left: your actual content. Right: what the LLM extracts and says about you.
The LLM Interpretation
AI-VERIFIEDA local LLM (mlx-community/Qwen2.5-7B-Instruct-4bit) analyzed the extracted content of arxiv.org and produced this structured business intelligence. Fields marked SEMANTIC VOID indicate information the AI could not find — a critical gap in your site’s machine-readability.
🔧 Tech Stack
Performance & Speed
80/100 20 % of Global Score 🟢 High Confidence⏱️ Time to First Byte
Google considers <200 ms "good". AI crawlers may have even shorter timeouts.
📦 Page Weight
DOM nodes
HTML payload
🗄️ Cache & CDN
- ✗ Cache-Control header
- ✗ CDN cache status
- ✗ CDN detected
🔬 Tracker Tax
tracker scripts
third-party domains
token overhead
📐 How the Performance Pillar score is calculated
Perf Pillar = TTFB (35 pts) + Page Weight (25 pts) + Cache/CDN (20 pts) + Tracker Tax (20 pts)
TTFB <200 ms = full marks. DOM >3000 or payload >300 KB incurs heavy penalties. Tracker scripts beyond 5 reduce score.
Architecture & Trust
76/100 15 % of Global Score 🟡 Medium Confidence🗺️ Sitemap & Robots
- ✗ Sitemap declared in robots.txt
- ✓ Googlebot allowed
- ✓ GPTBot allowed
- ✓ ClaudeBot allowed
🔗 Linking
internal links
external links
🔒 Security & Trust
- ✗ HSTS header (Strict-Transport-Security)
- ✓ Content-Security-Policy header
- ✓ HTTP status 200 OK (got 200)
♿ Accessibility Signals
- ✓ HTML lang attribute → en
- ✓ Meta viewport for mobile
- ✓ Single H1 for screen readers
📐 How the Architecture Pillar score is calculated
Arch Pillar = Sitemap & Robots (30 pts) + Linking (25 pts) + Security (25 pts) + Accessibility (20 pts)
Having a valid sitemap, allowing AI bots, HSTS, and a good internal link count are the highest-impact items.
🏅 AI-Verified Trust Badge
Your site scores 50/100. Reach 80+ to unlock the green "AI-Verified" badge. Fix the issues below to improve your score.
<a href="https://seodiff.io/radar/domains/arxiv.org" rel="noopener"><img src="https://seodiff.io/api/v1/badge?domain=arxiv.org" alt="AI-Verified by SEODiff" width="280" height="52"></a>
💡 Paste in your site footer, GitHub README, or email signature. Badge updates automatically as your score changes.
� Deep Crawl Analysis 4 pages · Deep-10
| Page | Type | ACRI | Token Bloat | Words | Status |
|---|---|---|---|---|---|
| support | 72 | 2.0× | 372 | ✓ | |
| about | 49 | 44.8× | 424 | ✓ | |
| support | 49 | 87.6× | 212 | ✓ | |
| support | 43 | 226.2× | 216 | ✓ |
| Path | Pages | Avg ACRI | Ghost % | Bloat | Top Issue |
|---|---|---|---|---|---|
| /faq/ | 1 | 72 | 0% | 2.0× | Healthy |
| /about/ | 1 | 49 | 0% | 44.8× | High JS Bloat |
| /help/ | 1 | 49 | 0% | 87.6× | High JS Bloat |
| /support/ | 1 | 43 | 1% | 226.2× | Bot Blocked |
Scores update automatically each month. Create a free account for on-demand re-crawls (3/month free).
🔌 API Access
Pull this data programmatically. All sub-page metrics are available via our public API.
curl https://seodiff.io/api/v1/deep10/domain/arxiv.orgGet your free API key — 100 requests/month included.
🔗 Similar Sites
Domains with a similar tech stack, industry, and AI readiness profile to arxiv.org. Compare side-by-side.
| Domain | ACRI | AI Score | Tech Stack | Token Bloat | Schema | |
|---|---|---|---|---|---|---|
| arxiv.org (this site) | 50 | 67 | Custom / Proprietary | 4.4× | 0 | — |
| monodigital.ru | 60 | 74 | Custom / Proprietary | 3.9× | 0 | Compare → |
| skkdc.ru | 60 | 72 | Custom / Proprietary | 3.4× | 0 | Compare → |
| fejlesztesiprogramok.uni-nke.hu | 60 | 72 | Custom / Proprietary | 3.2× | 0 | Compare → |
| bellwayplc.co.uk | 60 | 78 | Custom / Proprietary | 3.0× | 0 | Compare → |
| kataloger.wuerth.no | 60 | 70 | Custom / Proprietary | 4.5× | 1 | Compare → |
Bait & Switch Delta
A 3 PAGESCompares your homepage rendering quality with inner pages. A high drift score means AI crawlers see a polished homepage but degraded inner content — the "bait & switch" that erodes trust.
Worst Inner Pages
E-E-A-T Trust Signals
F 15/100Trust indicators extracted from surface pages. These signals help AI systems verify your site's Experience, Expertise, Authoritativeness, and Trustworthiness.
Citation Profile
9 DOMAINSOutbound citation patterns across surface-crawled pages. Sites that cite diverse, authoritative sources signal higher E-E-A-T to AI systems.
AI trust scores for the domains arxiv.org links to. Citing high-trust sources lifts your own credibility signal.
Remediation Patches
COPY-PASTEAuto-generated code fixes tailored to arxiv.org. Copy and paste these into your codebase to improve AI visibility. These patches are mathematically proven to increase extraction accuracy →
<script type="application/ld+json">
{
"@context": "https://schema.org",
"@type": "Organization",
"name": "Arxiv",
"url": "https://arxiv.org",
"logo": "https://arxiv.org/static/browse/0.3.4/images/icons/apple-touch-icon.png",
"sameAs": []
}
</script>
<script type="application/ld+json">
{
"@context": "https://schema.org",
"@type": "WebSite",
"name": "Arxiv",
"url": "https://arxiv.org",
"potentialAction": {
"@type": "SearchAction",
"target": "https://arxiv.org/search?q={search_term_string}",
"query-input": "required name=search_term_string"
}
}
</script>
<script type="application/ld+json">
{
"@context": "https://schema.org",
"@type": "FAQPage",
"mainEntity": [
{
"@type": "Question",
"name": "What is Arxiv?",
"acceptedAnswer": {
"@type": "Answer",
"text": "Add your answer here — describe what Arxiv does in 1-2 sentences."
}
},
{
"@type": "Question",
"name": "How does Arxiv work?",
"acceptedAnswer": {
"@type": "Answer",
"text": "Explain the key features and how users interact with Arxiv."
}
}
]
}
</script>
Projected Impact
ROI EST.If you apply the patches above, here's the estimated improvement for arxiv.org:
*Estimates based on SEODiff's scoring model. Actual results depend on implementation quality.
📋 Data Export
Download scores and metadata for audits, client reports, or CI/CD pipelines. Exports contain computed metrics only (no copyrighted content).
All data is generated automatically and updated with each crawl. JSON exports contain scores and metadata only (no copyrighted content).
Is this your company?
Monitor your AI visibility score weekly and get alerted when changes happen.
Start Free →