lookupd

io.github.ryuamarines/robots-txt-checker

up checked

Unclaimed · Unverified

Agent searches it appeared in, last 30 days: 0. Run this server? Claim the listing: verified label, uptime alerts and analytics.

Publisher-provided description

Checks if a URL path is allowed by robots.txt. x402 payment required (Base mainnet USDC).

Summary by lookupd

Checks whether a given URL path is permitted by the site's robots.txt rules; requires per-call payment in USDC.

Install

Claude Code, remote (streamable-http)

claude mcp add --transport http robots-txt-checker https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp

Codex, remote (streamable-http)

codex mcp add robots-txt-checker --url https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp

Cursor, remote (streamable-http) → .cursor/mcp.json

{
  "mcpServers": {
    "robots-txt-checker": {
      "url": "https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp"
    }
  }
}

Other clients: docs. Or tell your agent: Set up lookupd for me: read https://lookupd.com/agent.md and follow it.

Tools (1 tools)

Publisher-provided text

Details

Badge for your README

Shows this live status and links here; updates hourly.

lookupd status badge for io.github.ryuamarines/robots-txt-checker

[![lookupd status](https://lookupd.com/badge/io.github.ryuamarines/robots-txt-checker.svg)](https://lookupd.com/servers/io.github.ryuamarines/robots-txt-checker)