The Global AI Blocklist Index

Which websites are blocking AI crawlers? Updated daily.

1000233
Domains Indexed
8.6%
Block GPTBot
8.0%
Block ClaudeBot
7.0%
Block CCBot
7.8%
Block Google-Extended

🏆 Most-Blocked Sites

All SaaS News E-commerce Finance
Bot filter: All Blocks GPTBot Blocks ClaudeBot Blocks Any Blocks All
#DomainGPTBotClaudeBotCCBotGoogle-ExtTechScoreLast Crawled
1 google.com ✅ ✅ ✅ ✅ Blogger 82 Feb 26, 2026
2 microsoft.com ✅ ✅ ✅ ✅ Adobe Experience Manager 75 Feb 26, 2026
3 mail.ru ❌ ❌ ❌ ❌ Custom / Proprietary 15 Feb 26, 2026
4 gtld-servers.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 26, 2026
5 facebook.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Feb 26, 2026
6 googleapis.com ✅ ✅ ✅ ✅ Custom / Proprietary 18 Feb 26, 2026
7 cloudflare.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 26, 2026
8 apple.com ✅ ✅ ✅ ✅ Custom / Proprietary 76 Feb 26, 2026
9 youtube.com ✅ ✅ ✅ ✅ Custom / Proprietary 10 Feb 26, 2026
10 amazonaws.com ✅ ✅ ✅ ✅ Custom / Proprietary 70 Feb 26, 2026
11 dzen.ru ✅ ✅ ✅ ✅ React 10 Feb 26, 2026
12 instagram.com ❌ ❌ ❌ ❌ Custom / Proprietary 10 Feb 26, 2026
13 gstatic.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Feb 26, 2026
14 akamai.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 25, 2026
15 office.com ✅ ✅ ✅ ✅ Custom / Proprietary 75 Feb 26, 2026
16 twitter.com ❌ ❌ ❌ ❌ Express 15 Feb 26, 2026
17 googlevideo.com ✅ ✅ ✅ ✅ Blogger 82 Feb 26, 2026
18 live.com ✅ ✅ ✅ ✅ Custom / Proprietary 10 Feb 26, 2026
19 linkedin.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Feb 26, 2026
20 fbcdn.net ❌ ❌ ❌ ❌ Custom / Proprietary 10 Feb 26, 2026
21 googletagmanager.com ✅ ✅ ✅ ✅ Custom / Proprietary 18 Feb 26, 2026
22 akadns.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 25, 2026
23 akamaiedge.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 25, 2026
24 amazon.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Feb 26, 2026
25 microsoftonline.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 24, 2026
26 workers.dev ✅ ✅ ✅ ✅ Astro 63 Feb 24, 2026
27 azure.com ✅ ✅ ✅ ✅ Express 72 Feb 26, 2026
28 googleusercontent.com ✅ ✅ ✅ ✅ Custom / Proprietary 18 Feb 26, 2026
29 wikipedia.org ✅ ✅ ✅ ✅ MediaWiki 85 Feb 26, 2026
30 windowsupdate.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 24, 2026
31 github.com ✅ ✅ ✅ ✅ Ruby on Rails 74 Feb 26, 2026
32 doubleclick.net ✅ ✅ ✅ ✅ Custom / Proprietary 71 Feb 26, 2026
33 digicert.com ✅ ✅ ✅ ✅ Custom / Proprietary 59 Feb 26, 2026
34 bing.com ✅ ✅ ✅ ✅ Express 10 Feb 26, 2026
35 netflix.com ❌ ❌ ❌ ❌ Next.js 15 Feb 24, 2026
36 whatsapp.net ❌ ❌ ✅ ❌ Wix 15 Feb 24, 2026
37 fastly.net ✅ ✅ ✅ ✅ Gatsby 72 Feb 26, 2026
38 domaincontrol.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 24, 2026
39 apple-dns.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 25, 2026
40 office.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 24, 2026
41 wordpress.org ✅ ✅ ✅ ✅ WordPress 82 Feb 26, 2026
42 e2ro.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 24, 2026
43 aaplimg.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 25, 2026
44 appsflyersdk.com ✅ ✅ ✅ ✅ Custom / Proprietary 18 Feb 24, 2026
45 youtu.be ✅ ✅ ✅ ✅ Custom / Proprietary 10 Feb 24, 2026
46 icloud.com ✅ ✅ ✅ ✅ Custom / Proprietary 10 Feb 24, 2026
47 pinterest.com ❌ ❌ ❌ ❌ Express 10 Feb 26, 2026
48 sharepoint.com ✅ ✅ ✅ ✅ Custom / Proprietary 60 Feb 24, 2026
49 yahoo.com ✅ ✅ ✅ ✅ Custom / Proprietary 62 Feb 26, 2026
50 trafficmanager.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 24, 2026
51 ripn.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 24, 2026
52 whatsapp.com ❌ ❌ ✅ ❌ Wix 15 Feb 26, 2026
53 googlesyndication.com ✅ ✅ ✅ ✅ Blogger 82 Feb 26, 2026
54 goo.gl ✅ ✅ ✅ ✅ Custom / Proprietary 18 Feb 24, 2026
55 windows.net ✅ ✅ ✅ ✅ Express 72 Feb 26, 2026
56 skype.com ✅ ✅ ✅ ✅ Custom / Proprietary 59 Feb 24, 2026
57 akam.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 25, 2026
58 x.com ❌ ❌ ❌ ❌ Express 15 Feb 26, 2026
59 msn.com ✅ ✅ ✅ ✅ Custom / Proprietary 10 Feb 26, 2026
60 cloudfront.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 24, 2026
61 gandi.net ✅ ✅ ✅ ✅ PrestaShop 74 Feb 26, 2026
62 spotify.com ✅ ✅ ✅ ✅ Custom / Proprietary 10 Feb 26, 2026
63 pv-cdn.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 24, 2026
64 ntp.org ✅ ✅ ✅ ✅ Hugo 69 Feb 24, 2026
65 tiktok.com ✅ ✅ ✅ ✅ Custom / Proprietary 59 Feb 26, 2026
66 vimeo.com ❌ ❌ ✅ ❌ Custom / Proprietary 3 Feb 26, 2026
67 tiktokcdn.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 24, 2026
68 adobe.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 25, 2026
69 venmo.com ✅ ✅ ✅ ✅ Gatsby 67 Feb 26, 2026
70 gvt1.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 26, 2026
71 cloudflare.net ✅ ✅ ✅ ✅ Custom / Proprietary 13 Feb 26, 2026
72 roblox.com ✅ ✅ ✅ ✅ Custom / Proprietary 10 Feb 26, 2026
73 gvt2.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 26, 2026
74 ytimg.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 24, 2026
75 tiktokv.com ✅ ✅ ✅ ✅ Custom / Proprietary 18 Feb 26, 2026
76 yandex.net ✅ ✅ ✅ ✅ React 10 Feb 26, 2026
77 googledomains.com ✅ ✅ ✅ ✅ Squarespace 69 Feb 26, 2026
78 zoom.us ✅ ✅ ✅ ✅ Nuxt.js 81 Feb 26, 2026
79 nic.ru ✅ ✅ ✅ ✅ Custom / Proprietary 10 Feb 24, 2026
80 wa.me ✅ ✅ ✅ ✅ Custom / Proprietary 64 Feb 26, 2026
81 qq.com ✅ ✅ ✅ ✅ Custom / Proprietary 69 Feb 26, 2026
82 yandex.ru ✅ ✅ ✅ ✅ React 10 Feb 24, 2026
83 edgekey.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 26, 2026
84 nginx.org ✅ ✅ ✅ ✅ Custom / Proprietary 73 Feb 26, 2026
85 google-analytics.com ✅ ✅ ✅ ✅ Custom / Proprietary 71 Feb 26, 2026
86 office365.com ❌ ❌ ❌ ❌ Adobe Experience Manager 15 Feb 26, 2026
87 opera.com ✅ ✅ ✅ ✅ Custom / Proprietary 76 Feb 26, 2026
88 cloudflare-dns.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 26, 2026
89 baidu.com ❌ ❌ ❌ ❌ Custom / Proprietary 15 Feb 26, 2026
90 root-servers.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 24, 2026
91 samsung.com ✅ ✅ ✅ ✅ Express 77 Feb 26, 2026
92 chatgpt.com ❌ ❌ ❌ ❌ Custom / Proprietary 5 Feb 26, 2026
93 bit.ly ✅ ✅ ✅ ✅ Gatsby 78 Feb 26, 2026
94 nginx.com ✅ ✅ ✅ ✅ Custom / Proprietary 60 Feb 26, 2026
95 vedcdnlb.com ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 24, 2026
96 edgesuite.net ✅ ✅ ✅ ✅ Custom / Proprietary 3 Feb 24, 2026
97 wordpress.com ✅ ✅ ✅ ✅ WordPress 83 Feb 26, 2026
98 okcdn.ru ✅ ✅ ✅ ✅ Custom / Proprietary 18 Feb 26, 2026
99 intuit.com ✅ ✅ ✅ ✅ Next.js 81 Feb 26, 2026
100 ui.com ✅ ✅ ✅ ✅ Custom / Proprietary 10 Feb 24, 2026

Want the full dataset?

Download the complete CSV with all indexed domains. Free for all users.

Sign Up Free →