io.github.sharozdawa/robotstxt-ai

not probeable (local package)

Unclaimed · Unverified

Publisher-provided description

Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.

Summary by lookupd

Lets an agent analyze existing robots.txt files and generate new ones, including rules targeting over 20 AI crawlers such as GPTBot and…

Install

Claude Code, npm package (stdio)

claude mcp add robotstxt-ai -- npx -y robotstxt-ai-mcp

Codex, npm package (stdio)

codex mcp add robotstxt-ai -- npx -y robotstxt-ai-mcp

Cursor, npm package (stdio) → .cursor/mcp.json

{
  "mcpServers": {
    "robotstxt-ai": {
      "command": "npx",
      "args": [
        "-y",
        "robotstxt-ai-mcp"
      ]
    }
  }
}

Other clients: docs. Or tell your agent: Set up lookupd for me: read https://lookupd.com/agent.md and follow it.

Shows this live status and links here; updates hourly.

[![lookupd status](https://lookupd.com/badge/io.github.sharozdawa/robotstxt-ai.svg)](https://lookupd.com/servers/io.github.sharozdawa/robotstxt-ai)