io.github.hamzawamiqhq/ai-crawler-check

AI Crawler Access Check

Can GPTBot, ClaudeBot and PerplexityBot reach a site? Real fetch per crawler, firewall/CDN blocks.

1.0.0
Version
remote
Transport
1
Tools

Security review

Review passed

Reviewed 1d ago.

  • tools: 1 tools scanned
  • metadata: scanned

No findings.

Tools (1)

  • check_ai_crawler_access

    Checks whether AI crawlers (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended and others) can actually reach a website. Goes beyond robots.txt: fetches the site as each crawler and detects firewall/CDN blocks (Cloudflare, Akamai, Imperva), challenge pages, noindex and llms.txt. Returns a 0-100 AI Access Score, a per-crawler verdict and the top issues with fixes. Takes 15-60 seconds.