Is metadata.tencentyun.com visible to AI?
Single-page scan of http://metadata.tencentyun.com/latest/user-data · checked 2026-10-30
85AI visibility
AI crawler access — 8 engines
| Crawler | Org | Role | robots.txt | Live fetch | Verdict |
|---|---|---|---|---|---|
| GPTBot | OpenAI | training | allowed* | HTTP 200 · 368 B | Open |
| ClaudeBot | Anthropic | training | allowed* | HTTP 200 · 368 B | Open |
| Google-Extended | training | allowed* | — | Open | |
| CCBot | Common Crawl | training | allowed* | HTTP 200 · 368 B | Open |
| Bytespider | ByteDance | training | allowed* | HTTP 200 · 368 B | Open |
| PerplexityBot | Perplexity | assistant | allowed* | HTTP 200 · 368 B | Open |
| OAI-SearchBot | OpenAI | search | allowed* | HTTP 200 · 368 B | Open |
| ChatGPT-User | OpenAI | agent | allowed* | HTTP 200 · 368 B | Open |
What we found
!
No JSON-LD structured data found. Schema markup makes content easier for AI systems to interpret and cite.
-10 pts
!
No llms.txt at the root. Optional, but an emerging convention for guiding AI readers.
-5 pts
!
No robots.txt found. Everything is allowed by default, but you are not steering any crawler explicitly.
0 pts
Embed your score badge
Paste this into your site, README or docs — it links back to this public report:
<a href="https://api.crawlcheck.dev/check/metadata.tencentyun.com" title="AI visibility score for metadata.tencentyun.com"><img src="https://api.crawlcheck.dev/badge/metadata.tencentyun.com" alt="AI visibility score 85/100 — metadata.tencentyun.com" width="154" height="24"></a>
FAQ
Can AI crawlers access metadata.tencentyun.com?
As of 2026-10-30, 8 of 8 major AI crawlers can access the homepage. The test covers GPTBot (OpenAI), ClaudeBot (Anthropic), Google-Extended, CCBot, Bytespider (ByteDance), PerplexityBot, OAI-SearchBot and ChatGPT-User.
What does a score of 85/100 mean?
Most AI crawlers can read this site, but some are restricted or get limited content. A few robots.txt or server-side tweaks would open it up fully.
How can metadata.tencentyun.com improve its AI visibility?
Allow AI crawlers in robots.txt, remove noindex from key pages, publish substantive well-structured content, and add JSON-LD structured data. Re-run the free scan after each change to track the score.