crawlcheck.dev / AI Visibility Check
Public report · shareable & indexable

Is 172.17.0.1 visible to AI?

Single-page scan of http://172.17.0.1:8080/robots.txt · checked 2026-10-30

90AI visibility
AI-Ready
8 of 8 AI crawlers can access this site
robots.txt: missing · llms.txt: found · JSON-LD: none

AI crawler access — 8 engines

CrawlerOrgRolerobots.txtLive fetchVerdict
GPTBotOpenAItrainingallowed*HTTP 200 · 1 KBOpen
ClaudeBotAnthropictrainingallowed*HTTP 200 · 1 KBOpen
Google-ExtendedGoogletrainingallowed*—Open
CCBotCommon Crawltrainingallowed*HTTP 200 · 1 KBOpen
BytespiderByteDancetrainingallowed*HTTP 200 · 1 KBOpen
PerplexityBotPerplexityassistantallowed*HTTP 200 · 1 KBOpen
OAI-SearchBotOpenAIsearchallowed*HTTP 200 · 1 KBOpen
ChatGPT-UserOpenAIagentallowed*HTTP 200 · 1 KBOpen

What we found

!
No JSON-LD structured data found. Schema markup makes content easier for AI systems to interpret and cite.
-10 pts
!
No robots.txt found. Everything is allowed by default, but you are not steering any crawler explicitly.
0 pts
✓
llms.txt found.
0 pts

Embed your score badge

AI visibility badge

Paste this into your site, README or docs — it links back to this public report:

<a href="https://api.crawlcheck.dev/check/172.17.0.1" title="AI visibility score for 172.17.0.1"><img src="https://api.crawlcheck.dev/badge/172.17.0.1" alt="AI visibility score 90/100 — 172.17.0.1" width="154" height="24"></a>

FAQ

Can AI crawlers access 172.17.0.1?

As of 2026-10-30, 8 of 8 major AI crawlers can access the homepage. The test covers GPTBot (OpenAI), ClaudeBot (Anthropic), Google-Extended, CCBot, Bytespider (ByteDance), PerplexityBot, OAI-SearchBot and ChatGPT-User.

What does a score of 90/100 mean?

This site is highly accessible to AI crawlers — robots.txt allows most AI agents, pages return real content to bots, and the content is easy for AI systems to extract and quote.

How can 172.17.0.1 improve its AI visibility?

Allow AI crawlers in robots.txt, remove noindex from key pages, publish substantive well-structured content, and add JSON-LD structured data. Re-run the free scan after each change to track the score.

Recently checked

d-ti.com · 95www.pinterest.com · 0204.10.161.74 · 75172.18.0.1 · 75172.17.0.1 · 90example.com · 70tinyurl.com · 70href.li · 55example.net · 70metadata.tencentyun.com · 85www.postman.com · 50postman-echo.com · 85