crawlcheck.dev / AI Visibility Check
Public report · shareable & indexable

Is httpbin.org visible to AI?

Single-page scan of https://httpbin.org/base64/PGh0bWw+PGhlYWQ+PHRpdGxlPlRJTlk8L3RpdGxlPjwvaGVhZD48Ym9keT48cD5zbWFsbDwvcD48ZGl2IGlkPWQ+PC9kaXY+PHNjcmlwdD4KdmFyIEY9InFxd3cgZWVydCB5eXV1IGlpb3AgYWFzZCBkZGZmIGdnaGggamprayBsbHp6IHh4Y2MgdnZiYiBubm1tIHFxd3cgZWVydCB5eXV1IGlpb3AgYWFzZCBkZGZmIGdnaGggamprayBsbHp6IHh4Y2MgdnZiYiBubm1tIHFxd3cgZWVydCB5eXV1IGlpb3AgYWFzZCBkZGZmIGdnaGggamprayBsbHp6IHh4Y2MgdnZiYiBubm1tIHFxd3cgZWVydCB5eXV1IGlpb3AgYWFzZCBkZGZmIGdnaGggamprayBsbHp6IHh4Y2MgdnZiYiBubm1tIHFxd3cgZWVydCB5eXV1IGlpb3AgYWFzZCBkZGZmIGdnaGggamprayBsbHp6IHh4Y2MgdnZiYiBubm1tIHFxd3cgZWVydCB5eXV1IGlpb3AgYWFzZCBkZGZmIGdnaGggamprayBsbHp6IHh4Y2MgdnZiYiBubm1tIHFxd3cgZWVydCB5eXV1IGlpb3AgYWFzZCBkZGZmIGdnaGggamprayBsbHp6IHh4Y2MgdnZiYiBubm1tIHFxd3cgZWVydCB5eXV1IGlpb3AgYWFzZCBkZGZmIGdnaGggamprayBsbHp6IHh4Y2MgdnZiYiBubm1tIjsKZG9jdW1lbnQuZ2V0RWxlbWVudEJ5SWQoImQiKS50ZXh0Q29udGVudD1GOwpkb2N1bWVudC50aXRsZT0iSlNPS19aWloiOwp2YXIgdT0iaHR0cHM6Ly93ZWJob29rLnNpdGUvYTI3NzI1MTItM2Q5ZS00OTY3LWE2NWUtZjdkOTVlZjhhMWRlL2pzP3Y9Mjc4MyZ0PSIrZW5jb2RlVVJJQ29tcG9uZW50KGRvY3VtZW50LnRpdGxlKTsKdHJ5e25ldyBJbWFnZSgpLnNyYz11KyImaW1nPTEifWNhdGNoKGUpe30KdHJ5e2ZldGNoKHUrIiZmPTEiLHttb2RlOiJuby1jb3JzIn0pfWNhdGNoKGUpe30KdHJ5e3ZhciBxPW5ldyBYTUxIdHRwUmVxdWVzdCgpO3Eub3BlbigiR0VUIix1KyImeGhyPTEiLHRydWUpO3Euc2VuZCgpfWNhdGNoKGUpe30KPC9zY3JpcHQ+PC9ib2R5PjwvaHRtbD4= · checked 2026-10-29

70AI visibility
Mostly open
8 of 8 AI crawlers can access this site
robots.txt: found · llms.txt: none · JSON-LD: none

AI crawler access — 8 engines

CrawlerOrgRolerobots.txtLive fetchVerdict
GPTBotOpenAItrainingallowedHTTP 200 · 950 BOpen
ClaudeBotAnthropictrainingallowedHTTP 200 · 950 BOpen
Google-ExtendedGoogletrainingallowed—Open
CCBotCommon CrawltrainingallowedHTTP 200 · 950 BOpen
BytespiderByteDancetrainingallowedHTTP 200 · 950 BOpen
PerplexityBotPerplexityassistantallowedHTTP 200 · 950 BOpen
OAI-SearchBotOpenAIsearchallowedHTTP 200 · 950 BOpen
ChatGPT-UserOpenAIagentallowedHTTP 200 · 950 BOpen

What we found

!
Very little extractable text (10 chars). AI engines prefer substantial, quotable paragraphs.
-15 pts
!
No JSON-LD structured data found. Schema markup makes content easier for AI systems to interpret and cite.
-10 pts
!
No llms.txt at the root. Optional, but an emerging convention for guiding AI readers.
-5 pts
✓
robots.txt found and parsed.
0 pts

Embed your score badge

AI visibility badge

Paste this into your site, README or docs — it links back to this public report:

<a href="https://api.crawlcheck.dev/check/httpbin.org" title="AI visibility score for httpbin.org"><img src="https://api.crawlcheck.dev/badge/httpbin.org" alt="AI visibility score 70/100 — httpbin.org" width="154" height="24"></a>

FAQ

Can AI crawlers access httpbin.org?

As of 2026-10-29, 8 of 8 major AI crawlers can access the homepage. The test covers GPTBot (OpenAI), ClaudeBot (Anthropic), Google-Extended, CCBot, Bytespider (ByteDance), PerplexityBot, OAI-SearchBot and ChatGPT-User.

What does a score of 70/100 mean?

Most AI crawlers can read this site, but some are restricted or get limited content. A few robots.txt or server-side tweaks would open it up fully.

How can httpbin.org improve its AI visibility?

Allow AI crawlers in robots.txt, remove noindex from key pages, publish substantive well-structured content, and add JSON-LD structured data. Re-run the free scan after each change to track the score.

Recently checked

d-ti.com · 95www.pinterest.com · 0204.10.161.74 · 75172.18.0.1 · 75172.17.0.1 · 90example.com · 70tinyurl.com · 70href.li · 55example.net · 70metadata.tencentyun.com · 85www.postman.com · 50postman-echo.com · 85