lookupd

io.github.kriton-dev/ai-crawler-access-check

needs login checked

Unclaimed · Unverified

Agent searches it appeared in, last 30 days: 0. Run this server? Claim the listing: verified label, uptime alerts and analytics.

Publisher-provided title

AI Crawler Checker — Robots.txt Policy for Six Bots

Publisher-provided description

Check declared robots.txt permissions for six AI crawlers at URL paths

Summary by lookupd

Checks a site's robots.txt to report whether six AI crawlers are allowed or blocked from specified URL paths.

Install

Claude Code, remote (streamable-http)

claude mcp add --transport http ai-crawler-access-check 'https://mcp.apify.com/?tools=hermeskd/ai-crawler-access-check'

Codex, remote (streamable-http)

codex mcp add ai-crawler-access-check --url 'https://mcp.apify.com/?tools=hermeskd/ai-crawler-access-check'

Cursor, remote (streamable-http) → .cursor/mcp.json

{
  "mcpServers": {
    "ai-crawler-access-check": {
      "url": "https://mcp.apify.com/?tools=hermeskd/ai-crawler-access-check"
    }
  }
}

Other clients: docs. Or tell your agent: Set up lookupd for me: read https://lookupd.com/agent.md and follow it.

Details

Badge for your README

Shows this live status and links here; updates hourly.

lookupd status badge for io.github.kriton-dev/ai-crawler-access-check

[![lookupd status](https://lookupd.com/badge/io.github.kriton-dev/ai-crawler-access-check.svg)](https://lookupd.com/servers/io.github.kriton-dev/ai-crawler-access-check)