lookupd

io.github.mark1russell7/polite-crawler

not probeable (local package)

Unclaimed · Unverified

Agent searches it appeared in, last 30 days: 0. Run this server? Claim the listing: verified label, uptime alerts and analytics.

Publisher-provided title

polite-crawler

Publisher-provided description

A polite crawler for agents: obeys robots.txt, fetches each page once, finds and verifies quotes.

Summary by lookupd

Fetches web pages while respecting robots.txt, caches each page once, and locates and verifies quoted text within them.

Install

Claude Code, npm package (stdio)

claude mcp add polite-crawler -- npx -y polite-crawler-mcp

Codex, npm package (stdio)

codex mcp add polite-crawler -- npx -y polite-crawler-mcp

Cursor, npm package (stdio) → .cursor/mcp.json

{
  "mcpServers": {
    "polite-crawler": {
      "command": "npx",
      "args": [
        "-y",
        "polite-crawler-mcp"
      ]
    }
  }
}

Other clients: docs. Or tell your agent: Set up lookupd for me: read https://lookupd.com/agent.md and follow it.

Details

Badge for your README

Shows this live status and links here; updates hourly.

lookupd status badge for io.github.mark1russell7/polite-crawler

[![lookupd status](https://lookupd.com/badge/io.github.mark1russell7/polite-crawler.svg)](https://lookupd.com/servers/io.github.mark1russell7/polite-crawler)