Is www.postman.com visible to AI?
Single-page scan of https://www.postman.com/postman/workspace/published-postman-templates/documentation/631643-f695cab7-6878-eb55-7943-ad88e1ccfd65?ctx=documentation · checked 2026-10-30
AI crawler access — 8 engines
| Crawler | Org | Role | robots.txt | Live fetch | Verdict |
|---|---|---|---|---|---|
| GPTBot | OpenAI | training | allowed* | HTTP 404 · 0 B | Server block |
| ClaudeBot | Anthropic | training | allowed* | HTTP 200 · 100 KB | Open |
| Google-Extended | training | allowed* | — | Open | |
| CCBot | Common Crawl | training | allowed* | HTTP 200 · 100 KB | Open |
| Bytespider | ByteDance | training | allowed* | HTTP 200 · 100 KB | Open |
| PerplexityBot | Perplexity | assistant | allowed* | HTTP 200 · 100 KB | Open |
| OAI-SearchBot | OpenAI | search | allowed* | HTTP 404 · 0 B | Server block |
| ChatGPT-User | OpenAI | agent | allowed* | HTTP 404 · 0 B | Server block |
What we found
Embed your score badge
Paste this into your site, README or docs — it links back to this public report:
FAQ
As of 2026-10-30, 5 of 8 major AI crawlers can access the homepage. The test covers GPTBot (OpenAI), ClaudeBot (Anthropic), Google-Extended, CCBot, Bytespider (ByteDance), PerplexityBot, OAI-SearchBot and ChatGPT-User.
Several major AI crawlers cannot properly access this site. That means less visibility in AI answers today — and less presence in training data tomorrow.
Allow AI crawlers in robots.txt, remove noindex from key pages, publish substantive well-structured content, and add JSON-LD structured data. Re-run the free scan after each change to track the score.