Is href.li visible to AI?
Single-page scan of https://href.li/?http://172.17.0.1:8080/admin/login · checked 2026-10-30
55AI visibility
AI crawler access — 8 engines
| Crawler | Org | Role | robots.txt | Live fetch | Verdict |
|---|---|---|---|---|---|
| GPTBot | OpenAI | training | allowed* | HTTP 403 · 2 KB | Server block |
| ClaudeBot | Anthropic | training | allowed* | HTTP 403 · 2 KB | Server block |
| Google-Extended | training | allowed* | — | Open | |
| CCBot | Common Crawl | training | allowed* | HTTP 429 · 229 B | Server block |
| Bytespider | ByteDance | training | allowed* | HTTP 429 · 173 B | Server block |
| PerplexityBot | Perplexity | assistant | allowed* | HTTP 403 · 2 KB | Server block |
| OAI-SearchBot | OpenAI | search | allowed* | HTTP 403 · 2 KB | Server block |
| ChatGPT-User | OpenAI | agent | allowed* | HTTP 403 · 2 KB | Server block |
What we found
✕
Live request as GPTBot returned HTTP 403 — the server itself blocks it, not just robots.txt.
-20 pts
!
Very little extractable text (56 chars). AI engines prefer substantial, quotable paragraphs.
-15 pts
!
No JSON-LD structured data found. Schema markup makes content easier for AI systems to interpret and cite.
-10 pts
!
No robots.txt found. Everything is allowed by default, but you are not steering any crawler explicitly.
0 pts
✓
llms.txt found.
0 pts
Embed your score badge
Paste this into your site, README or docs — it links back to this public report:
<a href="https://api.crawlcheck.dev/check/href.li" title="AI visibility score for href.li"><img src="https://api.crawlcheck.dev/badge/href.li" alt="AI visibility score 55/100 — href.li" width="154" height="24"></a>
FAQ
Can AI crawlers access href.li?
As of 2026-10-30, 1 of 8 major AI crawlers can access the homepage. The test covers GPTBot (OpenAI), ClaudeBot (Anthropic), Google-Extended, CCBot, Bytespider (ByteDance), PerplexityBot, OAI-SearchBot and ChatGPT-User.
What does a score of 55/100 mean?
Several major AI crawlers cannot properly access this site. That means less visibility in AI answers today — and less presence in training data tomorrow.
How can href.li improve its AI visibility?
Allow AI crawlers in robots.txt, remove noindex from key pages, publish substantive well-structured content, and add JSON-LD structured data. Re-run the free scan after each change to track the score.