Platform
Contentful
50 measured sites. 1 of them, 2.0%, block at least one answer-surface AI crawler. Mean readiness score 70.6.
Compare against every other platform
| Rank | Domain | Score | Answer-surface crawlers | Stack |
|---|---|---|---|---|
| 30 | github.com | Score 70 out of 100, grade C | all allowed | Contentful |
| 117 | openai.comrefused GPTBot | Score 57 out of 100, grade D | all allowed | Contentful . Cloudflare |
| 186 | afternic.com | Score 62 out of 100, grade C | all allowed | Contentful . Akamai |
| 373 | calendly.com | Score 87 out of 100, grade B | all allowed | Contentful . Cloudflare |
| 571 | grammarly.com | Score 67 out of 100, grade C | all allowed | Contentful . Amazon CloudFront |
| 577 | hotjar.com | Score 64 out of 100, grade C | all allowed | Contentful . Amazon CloudFront |
| 609 | ubi.com | Score 56 out of 100, grade D | all allowed | Contentful . Amazon CloudFront |
| 753 | mlb.com | Score 64 out of 100, grade C | all allowed | Contentful . Fastly |
| 1045 | xerox.comrefused GPTBot | Score 59 out of 100, grade D | all allowed | Contentful |
| 1108 | coursera.org | Score 84 out of 100, grade B | 1 blocked | Contentful . Amazon CloudFront |
| 1156 | finn.no | Score 72 out of 100, grade C | all allowed | Contentful . Google Cloud / GFE |
| 1206 | psu.edu | Score 68 out of 100, grade C | all allowed | Contentful . Amazon CloudFront |
| 1250 | elsevier.com | Score 75 out of 100, grade B | all allowed | Contentful . Cloudflare |
| 1286 | livescore.com | Score 71 out of 100, grade C | all allowed | Contentful . Google Cloud / GFE |
| 1381 | auth0.com | Score 95 out of 100, grade A | all allowed | Contentful . Cloudflare |
| 1426 | trello.com | Score 64 out of 100, grade C | all allowed | Contentful . Amazon CloudFront |
| 1862 | notion.com | Score 74 out of 100, grade C | all allowed | Contentful . Cloudflare |
| 2056 | notion.so | Score 74 out of 100, grade C | all allowed | Contentful . Cloudflare |
| 2058 | matterport.com | Score 64 out of 100, grade C | all allowed | Contentful . Cloudflare |
| 2192 | metamask.io | Score 87 out of 100, grade B | all allowed | Contentful . Cloudflare |
| 2336 | fullstory.com | Score 73 out of 100, grade C, partial assessment | all allowed | Contentful . Netlify |
| 2391 | notion.site | Score 59 out of 100, grade D | all allowed | Contentful . Cloudflare |
| 2397 | clickup.com | Score 84 out of 100, grade B | all allowed | Contentful . Amazon CloudFront |
| 2477 | hatena.ne.jp | Score 59 out of 100, grade D | all allowed | Contentful |
| 2703 | 1password.com | Score 67 out of 100, grade C | all allowed | Contentful . Cloudflare |
| 2752 | zapier.com | Score 95 out of 100, grade A | all allowed | Contentful . Amazon CloudFront |
| 2777 | affirm.com | Score 67 out of 100, grade C | all allowed | Contentful . Cloudflare |
| 2875 | splashtop.com | Score 75 out of 100, grade B | all allowed | Contentful . Fastly |
| 2880 | ubisoft.com | Score 64 out of 100, grade C | all allowed | Contentful . Amazon CloudFront |
| 2992 | instructables.com | Score 48 out of 100, grade D | all allowed | Contentful . Amazon CloudFront |
| 3023 | robinhood.com | Score 61 out of 100, grade C | all allowed | Contentful . Amazon CloudFront |
| 3086 | sprinklr.com | Score 84 out of 100, grade B | all allowed | Contentful . Amazon CloudFront |
| 3170 | hootsuite.com | Score 75 out of 100, grade B | all allowed | Contentful . Vercel |
| 3174 | docusign.com | Score 83 out of 100, grade B | all allowed | Contentful . Netlify |
| 3448 | simplisafe.com | Score 61 out of 100, grade C | all allowed | Contentful . Amazon CloudFront |
| 3515 | wistia.com | Score 75 out of 100, grade B | all allowed | Contentful . Fastly |
| 3589 | shawcable.net | Score 64 out of 100, grade C | all allowed | Contentful . Akamai |
| 3744 | porsche.com | Score 68 out of 100, grade C | all allowed | Contentful . Akamai |
| 3913 | raspberrypi.org | Score 67 out of 100, grade C | all allowed | Contentful . Cloudflare |
| 3979 | trimble.com | Score 95 out of 100, grade A, partial assessment | all allowed | Contentful . Netlify |
| 4101 | alamy.comrefused GPTBot | Score 64 out of 100, grade C | all allowed | Contentful |
| 4273 | sketchup.com | Score 95 out of 100, grade A | all allowed | Contentful . Netlify |
| 4391 | runescape.comrefused GPTBot | Score 49 out of 100, grade D | all allowed | Contentful . Cloudflare |
| 4473 | githubcopilot.com | Score 59 out of 100, grade D | all allowed | Contentful |
| 4565 | todoist.com | Score 64 out of 100, grade C | all allowed | Contentful . Amazon CloudFront |
| 4739 | grammarly.net | Score 67 out of 100, grade C | all allowed | Contentful . Amazon CloudFront |
| 4901 | compass.com | Score 91 out of 100, grade A | all allowed | Contentful . Amazon CloudFront |
| 4948 | ghcr.io | Score 59 out of 100, grade D | all allowed | Contentful |
| 4963 | rogers.com | Score 72 out of 100, grade C | all allowed | Contentful . Akamai |
| 4995 | marksandspencer.com | Score 71 out of 100, grade C | all allowed | Contentful . Akamai |
Using these figures
Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.
CrawlIndex by Fidget Labs BV. "Agent readiness on Contentful." https://crawlindex.org (measured 2026-08-09). Licensed CC BY 4.0.