With only 15/100 on the AI-Readiness Index, lobste.rs is at severe risk of being overlooked by AI-powered search and answer engines. Compared to other developer sites (avg score: 58), lobste.rs is trailing the benchmark, indicating room for competitive improvement. The low ghost ratio (0%) confirms that what crawlers see matches what users see — a hallmark of strong SSR implementation. A tight 4.7× token bloat ratio reflects disciplined markup: minimal noise between the crawler and the content it needs. Zero schema blocks puts this site at a disadvantage in knowledge graph and AI-answer pipelines that rely on explicit structured data. Complete AI crawler restriction cuts this domain off from the growing AI search ecosystem entirely.
🧮 Score Transparency — How is this calculated?
📊 ACRI Sub-Scores (AI Readiness Detail)
lobste.rs punches above its weight in AI — AI visibility exceeds Google ranking. This is a competitive moat worth protecting. ACRI measures technical crawler readiness. Read the methodology →
Why lobste.rs ranks here
Fastest improvements
- Allow GPTBot in robots.txt so AI crawlers can access your pages (see Crawl Access).
- Allow ClaudeBot (many assistants rely on it) — blocking it often correlates with “AI invisibility.”
- Add basic Organization and WebSite JSON-LD to fix “0 schema blocks” (see Schema Coverage).
- Reduce token bloat (navigation/footer/code) so agents reach your main content faster (see Token Bloat).
- Create an
llms.txtfile so AI crawlers can discover your content structure without heavy crawling. Generate llms.txt → - Run a full entropy audit to find which DOM regions waste the most tokens. Run Entropy Audit →
Traditional SEO
0/100 25 % of Global Score 🟡 Medium Confidence📝 Title Tag
Optimal range: 30–60 characters for SERP display.
📋 Meta Description
Optimal range: 120–160 characters for snippet control.
🔤 Heading Hierarchy
- ✗ Exactly 1 <h1> tag — found 0
- ✗ Has <h2> headings — found 0
- ✓ <h2> not before <h1>
🔍 Indexability
- ✗ Canonical tag present
- ✓ No noindex directive
- ✓ Meta viewport set
- ✓ HTML lang attribute →
en - ✗ Hreflang tags
- ✗ Googlebot allowed by robots.txt
🌐 Social / OpenGraph
- ✓ og:title — Lobsters
- ✓ og:description — A computing-focused community centered around link aggregation and discussion.
- ✓ og:image — preview
- ✗ twitter:card
📐 How the SEO Pillar score is calculated
SEO Pillar = Title (20 pts) + Meta Desc (20 pts) + Heading Hierarchy (20 pts) + Indexability (20 pts) + Social/OG (20 pts)
Each sub-score is derived from the checks above. Canonical tag, lang attribute, og:image, and a single H1 are the highest-impact items.
AI Readiness / GEO
69/100 40 % of Global Score 🟡 Medium ConfidenceThis pillar aggregates citation share, hallucination risk, bot access, schema health, and content extractability. The individual diagnostic sections below contribute to this score.
Is AI lying about your brand? This panel measures how likely LLMs are to hallucinate facts when extracting information from your page.
🤖 Bot Access Matrix
Allow: / under User-agent: GPTBot in your robots.txt.📊 Structure & Information Density Docs
🏷️ Schema Health Docs
Schema Coverage Map
📐 AI Efficiency Metrics Docs
Token Bloat Research
Multimodal Readiness
TDM Rights
🔥 Structural Entropy Check Research
🔬 AI-Crawler Simulation
See your website the way AI crawlers do. CSS stripped, structure labeled, content chunked.
Toggle to "AI Agent View" to see what GPTBot, ClaudeBot, and other AI crawlers actually extract from this page.
AI Answer Preview
NEWSee how AI models summarize your site. Left: your actual content. Right: what the LLM extracts and says about you.
🔧 Tech Stack
Performance & Speed
49/100 20 % of Global Score 🟢 High Confidence⏱️ Time to First Byte
Google considers <200 ms "good". AI crawlers may have even shorter timeouts.
📦 Page Weight
DOM nodes
HTML payload
🗄️ Cache & CDN
- ✓ Cache-Control header →
max-age=0, private, must-revalidate - ✗ CDN cache status
- ✗ CDN detected
🔬 Tracker Tax
tracker scripts
third-party domains
token overhead
📐 How the Performance Pillar score is calculated
Perf Pillar = TTFB (35 pts) + Page Weight (25 pts) + Cache/CDN (20 pts) + Tracker Tax (20 pts)
TTFB <200 ms = full marks. DOM >3000 or payload >300 KB incurs heavy penalties. Tracker scripts beyond 5 reduce score.
Architecture & Trust
100/100 15 % of Global Score 🟢 High Confidence🗺️ Sitemap & Robots
- ✓ Sitemap declared in robots.txt →
https://lobste.rs/sitemap.xml.gz - ✗ Googlebot allowed
- ✗ GPTBot allowed
- ✗ ClaudeBot allowed
🔗 Linking
internal links
external links
🔒 Security & Trust
- ✓ HSTS header (Strict-Transport-Security)
- ✓ Content-Security-Policy header
- ✓ HTTP status 200 OK (got 200)
♿ Accessibility Signals
- ✓ HTML lang attribute → en
- ✓ Meta viewport for mobile
- ✗ Single H1 for screen readers
📐 How the Architecture Pillar score is calculated
Arch Pillar = Sitemap & Robots (30 pts) + Linking (25 pts) + Security (25 pts) + Accessibility (20 pts)
Having a valid sitemap, allowing AI bots, HSTS, and a good internal link count are the highest-impact items.
🏅 AI-Verified Trust Badge
Your site scores 36/100. Reach 80+ to unlock the green "AI-Verified" badge. Fix the issues below to improve your score.
<a href="https://seodiff.io/radar/domains/lobste.rs" rel="noopener"><img src="https://seodiff.io/api/v1/badge?domain=lobste.rs" alt="AI-Verified by SEODiff" width="280" height="52"></a>
💡 Paste in your site footer, GitHub README, or email signature. Badge updates automatically as your score changes.
� Deep Crawl Analysis 56 pages · Deep-10
| Page | Type | ACRI | Token Bloat | Words | Status |
|---|---|---|---|---|---|
| pricing | 82 | 2.0× | 2485 | 💰 Pricing | |
| other | 82 | 2.8× | 543 | ✓ | |
| pricing | 82 | 4.5× | 1735 | 💰 Pricing | |
| about | 77 | 7.2× | 767 | ✓ | |
| other | 67 | 7.0× | 234 | ✓ | |
| other | 64 | 19.0× | 625 | ✓ | |
| other | 64 | 19.0× | 619 | ✓ | |
| other | 57 | 10.2× | 217 | ✓ | |
| trust | 57 | 10.1× | 269 | ✓ | |
| other | 54 | 14.6× | 255 | ✓ | |
| other | 47 | 15.0× | 106 | ✓ | |
| pricing | 44 | 13.7× | 133 | 💰 Pricing | |
| trust | 39 | 29.3× | 51 | ✓ | |
| other | 39 | 25.9× | 60 | ✓ | |
| other | 39 | 22.7× | 71 | ✓ | |
| other | 39 | 27.2× | 51 | ✓ | |
| other | 39 | 20.7× | 75 | ✓ | |
| blog | 39 | 27.4× | 65 | ✓ | |
| other | 39 | 29.6× | 52 | ✓ | |
| other | 39 | 26.3× | 76 | ✓ |
| Path | Pages | Avg ACRI | Ghost % | Bloat | Top Issue |
|---|---|---|---|---|---|
| /s/ | 51 | 34 | 0% | 31.3× | High JS Bloat |
| /recent/ | 1 | 64 | 0% | 19.0× | High JS Bloat |
| /newest/ | 1 | 64 | 0% | 19.0× | High JS Bloat |
| /about/ | 1 | 82 | 0% | 2.0× | Healthy |
| /chat/ | 1 | 82 | 0% | 2.9× | Healthy |
| /comments/ | 1 | 82 | 0% | 4.5× | Healthy |
aws.amazon.com
×2
Scores update automatically each month. Create a free account for on-demand re-crawls (3/month free).
🔌 API Access
Pull this data programmatically. All sub-page metrics are available via our public API.
curl https://seodiff.io/api/v1/deep10/domain/lobste.rsGet your free API key — 100 requests/month included.
🔗 Similar developer Sites
Domains with a similar tech stack, industry, and AI readiness profile to lobste.rs. Compare side-by-side.
| Domain | ACRI | AI Score | Tech Stack | Token Bloat | Schema | |
|---|---|---|---|---|---|---|
| lobste.rs (this site) | 36 | 15 | Ruby on Rails | 4.7× | 0 | — |
| developer.travis-ci.com | 61 | 80 | Custom / Proprietary | 5.0× | 0 | Compare → |
| pomoc.sellintegro.pl | 61 | 84 | Hugo | 3.7× | 0 | Compare → |
| gentoo.org | 61 | 75 | Express | 3.6× | 0 | Compare → |
| sport.univ-lille.fr | 61 | 73 | TYPO3 | 3.2× | 0 | Compare → |
| sbom.ecosyste.ms | 61 | 82 | Cloudflare Pages | 3.0× | 0 | Compare → |
Remediation Patches
COPY-PASTEAuto-generated code fixes tailored to lobste.rs. Copy and paste these into your codebase to improve AI visibility. These patches are mathematically proven to increase extraction accuracy →
<script type="application/ld+json">
{
"@context": "https://schema.org",
"@type": "Organization",
"name": "Lobste",
"url": "https://lobste.rs",
"logo": "https://lobste.rs/touch-icon-144.png",
"sameAs": []
}
</script>
<script type="application/ld+json">
{
"@context": "https://schema.org",
"@type": "WebSite",
"name": "Lobste",
"url": "https://lobste.rs",
"potentialAction": {
"@type": "SearchAction",
"target": "https://lobste.rs/search?q={search_term_string}",
"query-input": "required name=search_term_string"
}
}
</script>
User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: /
User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: /
<script type="application/ld+json">
{
"@context": "https://schema.org",
"@type": "FAQPage",
"mainEntity": [
{
"@type": "Question",
"name": "What is Lobste?",
"acceptedAnswer": {
"@type": "Answer",
"text": "Add your answer here — describe what Lobste does in 1-2 sentences."
}
},
{
"@type": "Question",
"name": "How does Lobste work?",
"acceptedAnswer": {
"@type": "Answer",
"text": "Explain the key features and how users interact with Lobste."
}
}
]
}
</script>
Projected Impact
ROI EST.If you apply the patches above, here's the estimated improvement for lobste.rs:
*Estimates based on SEODiff's scoring model. Actual results depend on implementation quality.
📋 Data Export
Download scores and metadata for audits, client reports, or CI/CD pipelines. Exports contain computed metrics only (no copyrighted content).
All data is generated automatically and updated with each crawl. JSON exports contain scores and metadata only (no copyrighted content).
Is this your company?
Monitor your AI visibility score weekly and get alerted when changes happen.
Start Free →