lookupd

io.github.manchittlab/thecrawler

not probeable (local package)

Unclaimed · Unverified

Agent searches it appeared in, last 30 days: 0. Run this server? Claim the listing: verified label, uptime alerts and analytics.

Publisher-provided title

TheCrawler

Publisher-provided description

Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.

Summary by lookupd

Scrapes web pages into LLM-ready markdown with RAG chunking, and extracts text from PDF and DOCX documents.

Install

Claude Code, npm package (stdio)

claude mcp add thecrawler -- npx -y thecrawler

Codex, npm package (stdio)

codex mcp add thecrawler -- npx -y thecrawler

Cursor, npm package (stdio) → .cursor/mcp.json

{
  "mcpServers": {
    "thecrawler": {
      "command": "npx",
      "args": [
        "-y",
        "thecrawler"
      ]
    }
  }
}

Other clients: docs. Or tell your agent: Set up lookupd for me: read https://lookupd.com/agent.md and follow it.

Details

Badge for your README

Shows this live status and links here; updates hourly.

lookupd status badge for io.github.manchittlab/thecrawler

[![lookupd status](https://lookupd.com/badge/io.github.manchittlab/thecrawler.svg)](https://lookupd.com/servers/io.github.manchittlab/thecrawler)