Is example.com visible to AI?
Single-page scan of https://example.com/ · checked 2026-10-24
70AI visibility
AI crawler access — 8 engines
| Crawler | Org | Role | robots.txt | Live fetch | Verdict |
|---|---|---|---|---|---|
| GPTBot | OpenAI | training | allowed* | HTTP 200 · 577 B | Open |
| ClaudeBot | Anthropic | training | allowed* | HTTP 200 · 577 B | Open |
| Google-Extended | training | allowed* | — | Open | |
| CCBot | Common Crawl | training | allowed* | HTTP 200 · 577 B | Open |
| Bytespider | ByteDance | training | allowed* | HTTP 200 · 577 B | Open |
| PerplexityBot | Perplexity | assistant | allowed* | HTTP 200 · 577 B | Open |
| OAI-SearchBot | OpenAI | search | allowed* | HTTP 200 · 577 B | Open |
| ChatGPT-User | OpenAI | agent | allowed* | HTTP 200 · 577 B | Open |
What we found
!
Very little extractable text (171 chars). AI engines prefer substantial, quotable paragraphs.
-15 pts
!
No JSON-LD structured data found. Schema markup makes content easier for AI systems to interpret and cite.
-10 pts
!
No llms.txt at the root. Optional, but an emerging convention for guiding AI readers.
-5 pts
!
No robots.txt found. Everything is allowed by default, but you are not steering any crawler explicitly.
0 pts
Embed your score badge
Paste this into your site, README or docs — it links back to this public report:
<a href="https://api.crawlcheck.dev/check/example.com" title="AI visibility score for example.com"><img src="https://api.crawlcheck.dev/badge/example.com" alt="AI visibility score 70/100 — example.com" width="154" height="24"></a>
FAQ
Can AI crawlers access example.com?
As of 2026-10-24, 8 of 8 major AI crawlers can access the homepage. The test covers GPTBot (OpenAI), ClaudeBot (Anthropic), Google-Extended, CCBot, Bytespider (ByteDance), PerplexityBot, OAI-SearchBot and ChatGPT-User.
What does a score of 70/100 mean?
Most AI crawlers can read this site, but some are restricted or get limited content. A few robots.txt or server-side tweaks would open it up fully.
How can example.com improve its AI visibility?
Allow AI crawlers in robots.txt, remove noindex from key pages, publish substantive well-structured content, and add JSON-LD structured data. Re-run the free scan after each change to track the score.