Platform

Next.js

Name: CrawlIndex dataset
License: https://creativecommons.org/licenses/by/4.0/

280 measured sites. 43 of them, 15.4%, block at least one answer-surface AI crawler. Mean readiness score 68.4.

Sites on Next.js
Rank	Domain	Score	Answer-surface crawlers	Stack
60	yahoo.comrefused GPTBot	Score 52 out of 100, grade D	5 blocked	Next.js
80	vimeo.com	Score 57 out of 100, grade D	3 blocked	Next.js . Cloudflare
97	nginx.com	Score 56 out of 100, grade D	all allowed	Next.js . Vercel
119	snapchat.com	Score 35 out of 100, grade F	5 blocked	Next.js . Google Cloud / GFE
141	kaspersky.com	Score 67 out of 100, grade C	all allowed	Next.js
158	one.one	Score 91 out of 100, grade A	all allowed	Next.js . Varnish
164	applovin.com	Score 80 out of 100, grade B	all allowed	Next.js . Google Cloud / GFE
200	forbes.com	Score 63 out of 100, grade C, partial assessment	5 blocked	Next.js . Fastly
207	bbc.com	Score 38 out of 100, grade F	9 blocked	Next.js . Fastly
209	t-online.de	Score 56 out of 100, grade D	6 blocked	Next.js . Amazon CloudFront
212	miui.com	Score 53 out of 100, grade D	all allowed	Next.js
234	oxylabs.io	Score 76 out of 100, grade B	all allowed	Next.js . Cloudflare
238	stripe.com	Score 88 out of 100, grade B	all allowed	Next.js
290	inmobi.com	Score 64 out of 100, grade C	all allowed	Next.js . Google Cloud / GFE
320	launchdarkly.com	Score 75 out of 100, grade B	all allowed	Next.js . Netlify
342	issuu.com	Score 67 out of 100, grade C	all allowed	Next.js . Fastly
355	walmart.com	Score 100 out of 100, grade A, partial assessment	all allowed	Next.js
358	zendesk.com	Score 95 out of 100, grade A	all allowed	Next.js . Cloudflare
406	netangels.ru	Score 67 out of 100, grade C	all allowed	Next.js
474	aol.comrefused GPTBot	Score 40 out of 100, grade D	5 blocked	Next.js
483	eventbrite.com	Score 64 out of 100, grade C	all allowed	Next.js . Amazon CloudFront
487	scribd.com	Score 71 out of 100, grade C	all allowed	Next.js . Fastly
493	duckduckgo.com	Score 67 out of 100, grade C	all allowed	Next.js
522	timeweb.ru	Score 64 out of 100, grade C	all allowed	Next.js
535	time.com	Score 79 out of 100, grade B	all allowed	Next.js . Fastly
547	ipinfo.io	Score 79 out of 100, grade B	all allowed	Next.js . Google Cloud / GFE
573	target.com	Score 83 out of 100, grade B	all allowed	Next.js
595	supercell.com	Score 67 out of 100, grade C	all allowed	Next.js . Amazon CloudFront
599	surveymonkey.com	Score 87 out of 100, grade B	all allowed	Next.js . Amazon CloudFront
611	free.fr	Score 64 out of 100, grade C	all allowed	Next.js
620	dreamhost.com	Score 79 out of 100, grade B	all allowed	Next.js . Cloudflare
622	nintendo.com	Score 51 out of 100, grade D	5 blocked	Next.js . Fastly
623	digitalocean.com	Score 67 out of 100, grade C	all allowed	Next.js . Cloudflare
635	att.netrefused GPTBot	Score 52 out of 100, grade D	all allowed	Next.js
656	nike.com	Score 83 out of 100, grade B	all allowed	Next.js . Akamai
669	optimizely.com	Score 67 out of 100, grade C	all allowed	Next.js . Vercel
705	deepl.com	Score 78 out of 100, grade B	all allowed	Next.js . Cloudflare
708	cursor.sh	Score 84 out of 100, grade B	all allowed	Next.js . Vercel
714	ted.com	Score 47 out of 100, grade D	5 blocked	Next.js . Fastly
745	vercel.app	Score 63 out of 100, grade C	all allowed	Next.js . Vercel
789	ameblo.jp	Score 67 out of 100, grade C	all allowed	Next.js
796	rakuten.com	Score 65 out of 100, grade C	all allowed	Next.js
805	hbr.org	Score 53 out of 100, grade D	3 blocked	Next.js . Amazon CloudFront
816	nbcnews.com	Score 34 out of 100, grade F	11 blocked	Next.js . Akamai
837	curseforge.com	Score 62 out of 100, grade C	all allowed	Next.js . Cloudflare
841	hostgator.com.br	Score 72 out of 100, grade C	all allowed	Next.js . Cloudflare
880	lg.com	Score 80 out of 100, grade B	all allowed	Next.js . Akamai
959	note.comrefused GPTBot	Score 53 out of 100, grade D	all allowed	Next.js . Amazon CloudFront
968	theatlantic.com	Score 50 out of 100, grade D	8 blocked	Next.js . Cloudflare
976	digitaloceanspaces.com	Score 59 out of 100, grade D	all allowed	Next.js . Cloudflare
979	onet.pl	Score 78 out of 100, grade B	all allowed	Next.js . Amazon CloudFront
985	giphy.com	Score 59 out of 100, grade D	all allowed	Next.js . Fastly
1002	theconversation.com	Score 29 out of 100, grade F	11 blocked	Next.js . Fastly
1004	costco.com	Score 59 out of 100, grade D	all allowed	Next.js . Akamai
1031	goal.com	Score 64 out of 100, grade C	all allowed	Next.js
1048	pendo.io	Score 95 out of 100, grade A	all allowed	Next.js . Vercel
1054	n-tv.de	Score 65 out of 100, grade C	2 blocked	Next.js . Amazon CloudFront
1070	wise.com	Score 75 out of 100, grade B	all allowed	Next.js . Cloudflare
1087	crazygames.com	Score 68 out of 100, grade C	all allowed	Next.js . Cloudflare
1095	lge.com	Score 80 out of 100, grade B	all allowed	Next.js . Akamai
1132	clarin.comrefused GPTBot	Score 76 out of 100, grade B	all allowed	Next.js . Cloudflare
1133	gofundme.com	Score 67 out of 100, grade C	all allowed	Next.js . Amazon CloudFront
1148	triplinkintl.com	Score 68 out of 100, grade C	all allowed	Next.js
1154	plex.tv	Score 62 out of 100, grade C	all allowed	Next.js . Cloudflare
1182	dmm.co.jp	Score 53 out of 100, grade D	all allowed	Next.js . Amazon CloudFront
1188	vinted.fr	Score 59 out of 100, grade D	3 blocked	Next.js . Cloudflare
1243	abc.net.au	Score 63 out of 100, grade C	6 blocked	Next.js
1272	vietnam.vn	Score 64 out of 100, grade C	4 blocked	Next.js . Cloudflare
1287	supabase.co	Score 75 out of 100, grade B	all allowed	Next.js . Vercel
1291	cricbuzz.com	Score 65 out of 100, grade C	all allowed	Next.js
1335	badoo.com	Score 67 out of 100, grade C	all allowed	Next.js
1354	subito.it	Score 64 out of 100, grade C	all allowed	Next.js
1355	digikala.com	Score 53 out of 100, grade D	all allowed	Next.js
1362	publicnode.com	Score 61 out of 100, grade C	all allowed	Next.js . Cloudflare
1364	deepseek.com	Score 53 out of 100, grade D	all allowed	Next.js . Amazon CloudFront
1369	buzzfeed.com	Score 41 out of 100, grade D	7 blocked	Next.js . Fastly
1397	action.com	Score 60 out of 100, grade C	all allowed	Next.js . Cloudflare
1418	varzesh3.com	Score 69 out of 100, grade C	all allowed	Next.js
1425	zedge.net	Score 64 out of 100, grade C	1 blocked	Next.js . Cloudflare
1439	otomoto.pl	Score 79 out of 100, grade B	all allowed	Next.js . Amazon CloudFront
1470	jagran.com	Score 79 out of 100, grade B	all allowed	Next.js
1504	torob.com	Score 72 out of 100, grade C	all allowed	Next.js
1512	bt.dk	Score 65 out of 100, grade C	1 blocked	Next.js . Cloudflare
1532	kooora.com	Score 64 out of 100, grade C	all allowed	Next.js
1551	kakuyomu.jp	Score 59 out of 100, grade D	all allowed	Next.js . Amazon CloudFront
1662	promiedos.com.ar	Score 59 out of 100, grade D	all allowed	Next.js . Amazon CloudFront
1682	ecnavi.jp	Score 63 out of 100, grade C	all allowed	Next.js . Amazon CloudFront
1696	betpawa.ug	Score 48 out of 100, grade D	all allowed	Next.js . Cloudflare
1754	rapid7.com	Score 91 out of 100, grade A	all allowed	Next.js . Cloudflare
1783	tawk.to	Score 59 out of 100, grade D	all allowed	Next.js . Cloudflare
1802	one.com	Score 91 out of 100, grade A	all allowed	Next.js . Varnish
1828	gdemoideti.ru	Score 91 out of 100, grade A	all allowed	Next.js
1831	va.gov	Score 66 out of 100, grade C	all allowed	Next.js
1835	geocities.comrefused GPTBot	Score 61 out of 100, grade C	all allowed	Next.js
1838	samsungknox.com	Score 67 out of 100, grade C	all allowed	Next.js
1860	rustore.rurefused GPTBot	Score 73 out of 100, grade C	all allowed	Next.js
1903	sky.com	Score 80 out of 100, grade B	all allowed	Next.js . Akamai
1930	sportfilm800.comrefused GPTBot	Score 34 out of 100, grade F	5 blocked	Next.js . Cloudflare
1968	meetup.com	Score 85 out of 100, grade B	1 blocked	Next.js
2052	stripe.network	Score 68 out of 100, grade C	all allowed	Next.js
2063	nba.com	Score 50 out of 100, grade D	6 blocked	Next.js . Akamai
2104	evernote.com	Score 87 out of 100, grade B	all allowed	Next.js . Google Cloud / GFE
2125	mongodb.com	Score 84 out of 100, grade B	all allowed	Next.js . Amazon CloudFront
2204	strava.com	Score 61 out of 100, grade C	4 blocked	Next.js . Amazon CloudFront
2208	bytedance.com	Score 59 out of 100, grade D	all allowed	Next.js
2214	adkernel.com	Score 59 out of 100, grade D	all allowed	Next.js
2221	cpmstar.com	Score 61 out of 100, grade C	all allowed	Next.js . Vercel
2242	polymarket.com	Score 83 out of 100, grade B	all allowed	Next.js . Cloudflare
2246	asana.com	Score 92 out of 100, grade A	all allowed	Next.js . Netlify
2266	nodejs.org	Score 79 out of 100, grade B	all allowed	Next.js . Cloudflare
2267	coinmarketcap.com	Score 88 out of 100, grade B	all allowed	Next.js . Amazon CloudFront
2296	bigcartel.com	Score 64 out of 100, grade C	all allowed	Next.js . Cloudflare
2300	axon.ai	Score 80 out of 100, grade B	all allowed	Next.js . Google Cloud / GFE
2307	peacocktv.com	Score 83 out of 100, grade B	all allowed	Next.js
2311	smi2.net	Score 59 out of 100, grade D	all allowed	Next.js
2342	tutu.ru	Score 70 out of 100, grade C	all allowed	Next.js
2345	nubank.com.br	Score 64 out of 100, grade C	all allowed	Next.js . Amazon CloudFront
2354	hbomax.comrefused GPTBot	Score 64 out of 100, grade C	all allowed	Next.js . Akamai
2422	netscape.comrefused GPTBot	Score 49 out of 100, grade D	all allowed	Next.js
2470	verkada.com	Score 79 out of 100, grade B	all allowed	Next.js . Cloudflare
2471	msu.edu	Score 67 out of 100, grade C	all allowed	Next.js . Netlify
2517	here.comrefused GPTBot	Score 64 out of 100, grade C	all allowed	Next.js . Amazon CloudFront
2519	wetransfer.com	Score 52 out of 100, grade D	all allowed	Next.js . Amazon CloudFront
2535	crypto.com	Score 79 out of 100, grade B	all allowed	Next.js . Cloudflare
2552	mparticle.com	Score 38 out of 100, grade F	8 blocked	Next.js . Vercel
2576	ionos.de	Score 79 out of 100, grade B	all allowed	Next.js
2599	getpocket.com	Score 62 out of 100, grade C	all allowed	Next.js . Amazon CloudFront
2662	hindustantimes.com	Score 80 out of 100, grade B	all allowed	Next.js . Akamai
2719	stumbleupon.com	Score 49 out of 100, grade D	all allowed	Next.js
2725	accor.com	Score 59 out of 100, grade D	all allowed	Next.js . Amazon CloudFront
2733	elastic.co	Score 67 out of 100, grade C	all allowed	Next.js . Fastly
2751	ps.kz	Score 64 out of 100, grade C	all allowed	Next.js
2753	anchor.fm	Score 59 out of 100, grade D	all allowed	Next.js . Fastly
2763	suno.com	Score 85 out of 100, grade B	all allowed	Next.js . Cloudflare
2774	zalo.me	Score 61 out of 100, grade C	all allowed	Next.js
2811	history.com	Score 80 out of 100, grade B	all allowed	Next.js . Fastly
2820	fotmob.com	Score 76 out of 100, grade B	all allowed	Next.js . Amazon CloudFront
2824	philips.com	Score 67 out of 100, grade C	all allowed	Next.js . Cloudflare
2831	schwab.com	Score 67 out of 100, grade C	all allowed	Next.js . Akamai
2895	grok.comrefused GPTBot	Score 42 out of 100, grade D	6 blocked	Next.js . Cloudflare
2920	zdf.de	Score 71 out of 100, grade C	all allowed	Next.js
2930	today.com	Score 37 out of 100, grade F	11 blocked	Next.js . Akamai
2950	nic.tv	Score 45 out of 100, grade D	all allowed	Next.js
2993	bybit.com	Score 57 out of 100, grade D	all allowed	Next.js . Akamai
2998	starmakerstudios.comrefused GPTBot	Score 67 out of 100, grade C	all allowed	Next.js
3019	sproutsocial.com	Score 91 out of 100, grade A	all allowed	Next.js . Amazon CloudFront
3034	intercomcdn.com	Score 95 out of 100, grade A	all allowed	Next.js . Amazon CloudFront
3050	newsbreak.com	Score 54 out of 100, grade D	9 blocked	Next.js . Amazon CloudFront
3051	bumble.com	Score 67 out of 100, grade C	all allowed	Next.js
3053	flashbots.net	Score 59 out of 100, grade D	all allowed	Next.js . Vercel
3062	economictimes.com	Score 76 out of 100, grade B	1 blocked	Next.js . Akamai
3079	max.comrefused GPTBot	Score 64 out of 100, grade C	all allowed	Next.js . Akamai
3082	esquire.com	Score 68 out of 100, grade C	all allowed	Next.js
3092	elle.com	Score 68 out of 100, grade C	all allowed	Next.js
3096	drpc.org	Score 95 out of 100, grade A	all allowed	Next.js . Cloudflare
3104	merkle.io	Score 56 out of 100, grade D	all allowed	Next.js . Cloudflare
3121	fool.com	Score 66 out of 100, grade C	all allowed	Next.js . Cloudflare
3130	mapquest.com	Score 50 out of 100, grade D	8 blocked	Next.js . Amazon CloudFront
3173	cbssports.com	Score 68 out of 100, grade C	1 blocked	Next.js
3187	freshdesk.com	Score 71 out of 100, grade C	all allowed	Next.js . Cloudflare
3199	profi.rurefused GPTBot	Score 64 out of 100, grade C	all allowed	Next.js
3206	cosmopolitan.com	Score 68 out of 100, grade C	all allowed	Next.js
3212	ifood.com.brrefused GPTBot	Score 68 out of 100, grade C	all allowed	Next.js . Cloudflare
3232	goodhousekeeping.com	Score 80 out of 100, grade B	all allowed	Next.js
3234	hotstar.com	Score 49 out of 100, grade D	all allowed	Next.js . Akamai
3245	fox.com	Score 83 out of 100, grade B	all allowed	Next.js . Fastly
3267	rtbhouse.com	Score 95 out of 100, grade A	all allowed	Next.js . Google Cloud / GFE
3277	vanguard.com	Score 62 out of 100, grade C	all allowed	Next.js . Akamai
3278	kinghost.com.br	Score 61 out of 100, grade C	all allowed	Next.js . Cloudflare
3294	vercel.com	Score 83 out of 100, grade B	all allowed	Next.js . Vercel
3301	joyn.de	Score 67 out of 100, grade C	all allowed	Next.js . Vercel
3344	eventbrite.co.uk	Score 64 out of 100, grade C	all allowed	Next.js . Amazon CloudFront
3385	postman.com	Score 83 out of 100, grade B	all allowed	Next.js . Cloudflare
3420	feedly.com	Score 67 out of 100, grade C	all allowed	Next.js . Cloudflare
3425	mobilefuse.com	Score 79 out of 100, grade B	all allowed	Next.js . Amazon CloudFront
3437	brightcove.com	Score 53 out of 100, grade D	all allowed	Next.js
3442	edx.org	Score 80 out of 100, grade B	all allowed	Next.js . Cloudflare
3454	flightaware.com	Score 56 out of 100, grade D	1 blocked	Next.js . Cloudflare
3457	gitee.com	Score 76 out of 100, grade B	all allowed	Next.js
3461	ouraring.com	Score 67 out of 100, grade C	all allowed	Next.js . Amazon CloudFront
3466	vinted.com	Score 59 out of 100, grade D	3 blocked	Next.js . Cloudflare
3475	yahoo.netrefused GPTBot	Score 52 out of 100, grade D	5 blocked	Next.js
3497	code.org	Score 68 out of 100, grade C	all allowed	Next.js . Amazon CloudFront
3500	17track.net	Score 87 out of 100, grade B	all allowed	Next.js . Cloudflare
3558	zaloapp.com	Score 61 out of 100, grade C	all allowed	Next.js
3575	10jqka.com.cn	Score 56 out of 100, grade D	all allowed	Next.js
3606	hbs.edu	Score 67 out of 100, grade C	all allowed	Next.js . Amazon CloudFront
3627	prtimes.jp	Score 71 out of 100, grade C	all allowed	Next.js . Fastly
3660	hotmart.com	Score 91 out of 100, grade A	all allowed	Next.js . Amazon CloudFront
3670	scw.cloud	Score 75 out of 100, grade B	all allowed	Next.js . Cloudflare
3674	indiatoday.in	Score 83 out of 100, grade B	all allowed	Next.js . Akamai
3734	myfitnesspal.com	Score 61 out of 100, grade C	1 blocked	Next.js . Cloudflare
3782	arbeitsagentur.de	Score 64 out of 100, grade C	all allowed	Next.js
3798	menshealth.com	Score 68 out of 100, grade C	all allowed	Next.js
3811	aol.derefused GPTBot	Score 37 out of 100, grade F	5 blocked	Next.js
3817	sbs.com.au	Score 76 out of 100, grade B	1 blocked	Next.js
3863	cursor.com	Score 84 out of 100, grade B	all allowed	Next.js . Vercel
3866	nos.nl	Score 41 out of 100, grade D	7 blocked	Next.js . Amazon CloudFront
3890	elevenlabs.io	Score 91 out of 100, grade A	all allowed	Next.js . Google Cloud / GFE
3938	netbird.io	Score 67 out of 100, grade C	all allowed	Next.js . Vercel

Showing the 200 most-visited.

Using these figures

Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.

CrawlIndex by Fidget Labs BV. "Agent readiness on Next.js." https://crawlindex.org (measured 2026-08-09). Licensed CC BY 4.0.