crawlindex

Tranco rank 113

b-cdn.net

b-cdn.net scores 60 out of 100 for agent readiness. It allows every answer-surface AI crawler.

Score 60 out of 100, grade C
Last measured
2026-08-09 17:58 UTC
First seen
2026-08-09
Rubric / probe
v1.0.0 / v2.0.0

Served through Bunny. Compare against everything else on the same stack.

How this score is made up

Agent access45 / 45

  • Answer-surface crawlers allowed. All 11 answer-surface crawlers are allowed.
  • Secondary crawlers allowed. All 12 secondary crawlers are allowed.
  • Serves crawlers the same content. A crawler and a browser receive comparable responses.

Machine-readable surface0 / 25

  • robots.txt published. No robots.txt. Crawler policy is undeclared.
  • Sitemap declared in robots.txt. robots.txt does not declare a sitemap.
  • llms.txt published. No /llms.txt.
  • agents.md published. No /agents.md.

Content structure15 / 30

  • Organization schema. No Organization JSON-LD. Agents cannot reliably attribute this site to an entity.
  • WebSite schema. No WebSite JSON-LD.
  • Additional structured data. Also declares: Product.
  • Readable without JavaScript. 9,801 characters of text in the server response. Most crawlers do not execute JavaScript.
  • Single top-level heading. 0 h1 elements found.
  • Semantic landmarks. Uses main, nav, header, footer.

Crawler policy

Read from b-cdn.net/robots.txt. A crawler is listed as blocked when the rules deny it the site root. This operator names no AI crawler explicitly.

AI crawler access policy for b-cdn.net
CrawlerOperatorTierNamedStatus
GPTBotOpenAI1noAllowed
OAI-SearchBotOpenAI1noAllowed
ChatGPT-UserOpenAI1noAllowed
ClaudeBotAnthropic1noAllowed
Claude-UserAnthropic1noAllowed
Claude-SearchBotAnthropic1noAllowed
PerplexityBotPerplexity1noAllowed
Perplexity-UserPerplexity1noAllowed
Google-ExtendedGoogle1noAllowed
Applebot-ExtendedApple1noAllowed
meta-externalagentMeta1noAllowed
CCBotCommon Crawl2noAllowed
AmazonbotAmazon2noAllowed
BytespiderByteDance2noAllowed
cohere-aiCohere2noAllowed
MistralAI-UserMistral2noAllowed
YouBotYou.com2noAllowed
DuckAssistBotDuckDuckGo2noAllowed
kagi-fetcherKagi2noAllowed
DiffbotDiffbot2noAllowed
Google-NotebookLMGoogle2noAllowed
TavilyBotTavily2noAllowed
FirecrawlAgentFirecrawl2noAllowed

Show this score

Free to embed. Always reflects the latest measurement, and links back here so anyone can check the working.

CrawlIndex badge for b-cdn.net, score 60
<a href="https://crawlindex.org/site/b-cdn.net"><img src="https://crawlindex.org/badge/b-cdn.net.svg" alt="CrawlIndex agent readiness score for b-cdn.net" width="196" height="28"></a>

This measurement as JSON

Using these figures

Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.

CrawlIndex by Fidget Labs BV. "b-cdn.net agent readiness." https://crawlindex.org (measured 2026-08-09). Licensed CC BY 4.0.