io.github.hamzawamiqhq/ai-crawler-check

up checked 2026-11-11T03:38:36.579Z

Unclaimed · Unverified

Agent searches it appeared in, last 30 days: 0. Run this server? Claim the listing: verified label, uptime alerts and analytics.

Publisher-provided title

AI Crawler Access Check

Publisher-provided description

Can GPTBot, ClaudeBot and PerplexityBot reach a site? Real fetch per crawler, firewall/CDN blocks.

Summary by lookupd

Lets an agent test whether major AI crawlers like GPTBot and ClaudeBot can actually reach a given website, including firewall or CDN blocks.

Install

Claude Code, remote (streamable-http)

claude mcp add --transport http ai-crawler-check 'https://check.citant.ai/mcp?src=registry'

Codex, remote (streamable-http)

codex mcp add ai-crawler-check --url 'https://check.citant.ai/mcp?src=registry'

Cursor, remote (streamable-http) → .cursor/mcp.json

{
  "mcpServers": {
    "ai-crawler-check": {
      "url": "https://check.citant.ai/mcp?src=registry"
    }
  }
}

Other clients: docs. Or tell your agent: Set up lookupd for me: read https://lookupd.com/agent.md and follow it.

Tools (1 tools)

Publisher-provided text

• check_ai_crawler_access Checks whether AI crawlers (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended and others) can actually reach a website. Goes beyond

Details

• Version: 1.0.0
• Transports: streamable-http
• Uptime (7 days): 100%
• Median latency: 435 ms
• First indexed: 2026-11-01T09:32:26.148Z
• Last seen in registry: 2026-11-01T09:32:26.148Z
• Website: https://check.citant.ai/

Badge for your README

Shows this live status and links here; updates hourly.

[![lookupd status](https://lookupd.com/badge/io.github.hamzawamiqhq/ai-crawler-check.svg)](https://lookupd.com/servers/io.github.hamzawamiqhq/ai-crawler-check)

• 62141 servers
• Last crawl: 2026-11-11T18:39:04.612Z
• API base: https://api.lookupd.com
• MCP URL: https://api.lookupd.com/mcp