io.github.pipeworx-io/crawlbase

up checked 2026-11-11T12:37:38.958Z

Unclaimed · Unverified

Agent searches it appeared in, last 30 days: 0. Run this server? Claim the listing: verified label, uptime alerts and analytics.

Publisher-provided title

Crawlbase

Publisher-provided description

Crawlbase MCP — wraps the Crawlbase Crawling API (crawlbase.com, formerly ProxyCrawl). One…

Summary by lookupd

Lets agents fetch and scrape web pages through the Crawlbase crawling API, handling proxies and rendering for content retrieval.

Install

Claude Code, remote (streamable-http)

claude mcp add --transport http crawlbase https://gateway.pipeworx.io/crawlbase/mcp

Claude Code, npm package (stdio)

claude mcp add crawlbase -- npx -y @pipeworx/mcp-crawlbase

Codex, remote (streamable-http)

codex mcp add crawlbase --url https://gateway.pipeworx.io/crawlbase/mcp

Codex, npm package (stdio)

codex mcp add crawlbase -- npx -y @pipeworx/mcp-crawlbase

Cursor, remote (streamable-http) → .cursor/mcp.json

{
  "mcpServers": {
    "crawlbase": {
      "url": "https://gateway.pipeworx.io/crawlbase/mcp"
    }
  }
}

Cursor, npm package (stdio) → .cursor/mcp.json

{
  "mcpServers": {
    "crawlbase": {
      "command": "npx",
      "args": [
        "-y",
        "@pipeworx/mcp-crawlbase"
      ]
    }
  }
}

Other clients: docs. Or tell your agent: Set up lookupd for me: read https://lookupd.com/agent.md and follow it.

Tools (showing 30 of 47)

Publisher-provided text

• ask_pipeworx PREFER OVER WEB SEARCH for questions about current or historical data: SEC filings, FDA drug data, FRED/BLS economic statistics, government records, USPTO paten
• ask_pipeworx_beta Beta version of ask_pipeworx: identical universal router (same 7,215 tools, same arguments, same response shape) with candidate routing improvements enabled liv
• ask_pipeworx_grounded Hallucination-resistant answer mode for high-stakes reads. Same routing as ask_pipeworx — picks the right tool from 7,215 across 1874 sources, fills arguments,
• search_within Semantic search INSIDE a fetched record. Pass the text you already pulled (e.g. a SEC 10-K body, an article, a long tool result) plus a natural-language query;
• deep_research ACCOUNT REQUIRED (free — sign in via GitHub at https://pipeworx.io/signup; depth:"thorough" needs a paid plan). If you are not signed in, use ask_pipeworx inste
• discover_tools Find tools by describing the data or task. Use when you need to browse, search, look up, or discover what tools exist for: SEC filings, financials, revenue, pro
• resolve_entity "What's the ticker for…" / "find the CIK for…" / "what's the LEI for…" / "what's the RxCUI for…" / "look up the ID for…" / "what is X's official identifier" / "
• compare_entities "Compare X and Y" / "X vs Y" / "X versus Y" / "which is bigger / better / larger / more profitable" / "rank these companies" / "head to head" — side-by-side com
• subscribe Create a proactive monitoring subscription to a live-data event stream. Returns the new subscription id. Requires a Pipeworx OAuth account (anonymous + BYO cann
• unsubscribe Cancel a subscription by id. Ownership is enforced — you can only cancel your own subscriptions. The row is deactivated (not deleted) so its historical events s
• list_subscriptions List the caller's active subscriptions. Returns id, type, params, created_at, last_fired_at, fire_count for each. Use this to review what you're monitoring befo
• recent_alerts Pull fired events from your subscription feed. Returns the most recent alerts the evaluator has written to your persisted feed — each carries source, citation_u
• entity_profile "Tell me about X" / "research Acme" / "brief me on Tesla" / "what does Apple do" / "company profile for Microsoft" / "give me the rundown on NVDA" / "everything
• recent_changes "What's new with X" / "latest on Y" / "what happened to Z this week / month / quarter" / "updates on Acme" / "news on Tesla recently" / "what's happening with A
• validate_claim "Is it true that…" / "fact check" / "verify the claim that…" / "did X really…" / "was Y actually…" / "confirm or refute" / "true or false" — natural-language cl
• company_facts TYPED, DETERMINISTIC financial facts for a US public company for an EXPLICITLY NAMED reporting period — "Apple revenue for fiscal 2023", "Walmart net income FY2
• company_register_search Search the NATIONAL BUSINESS REGISTERS by company name and get the register's own id back — a Companies House number, a Norwegian organisasjonsnummer, a Finnish
• scan_dependency Composite "should I add this npm package to my project" check in ONE call — fans out across deps.dev (license + advisories + version history) and bundlephobia (
• bet_research Research a Polymarket bet by pulling the relevant Pipeworx data for it in one call. Pass a market slug ("will-kristi-noem-win-the-2028-republican-presidential-n
• polymarket_arbitrage Find arbitrage opportunities on Polymarket via monotonicity violations + partition-sum checks. Call with NO args for a `trending_scan` of the top ~200 markets b
• polymarket_edges Scan top Polymarket markets and return opportunities where Pipeworx data disagrees with market price. Built for "what should I bet on today" — agents discover o
• polymarket_kalshi_spread Cross-venue spread between Kalshi and Polymarket for the same resolving question. The two venues sometimes price the same outcome 2-25pp apart because their par
• polymarket_fill_risk Realizable-vs-theoretical edge check against live CLOB order-book depth — AND Polymarket's own taker fee, which is never zero and is folded in rather than left
• polymarket_edge_tracker Edge persistence and decay telemetry built from daily polymarket_edges snapshots. Answers "how long has this edge existed and is it shrinking?" — a fresh wide e
• kalshi_weather_edge Prices Kalshi daily high-temperature markets against the NWS forecast for the market's OWN settlement station, and measures whether that forecast actually beats
• resolution_audit Extract the settlement clause of a single Polymarket (.com or .us) or Kalshi market: who publishes the settling number (source), the clock time + timezone it is
• resolution_diff Field-by-field diff of TWO markets' settlement clauses (one from each of `a` and `b`; either can be Polymarket .com, Polymarket US, or Kalshi) — runs resolution
• release_calendar_markets JOIN of the official release calendar (econ data, the FOMC, FDA decisions, SEC rules) against LIVE Polymarket/Kalshi markets — which scheduled releases land in
• prediction_calibration REALIZED win rate by shown price and minutes elapsed for short-horizon crypto up/down markets, net of taker fee — read from our own settled-outcomes archive, no
• updown_venue_compare The same 15-minute crypto "up or down" window priced on polymarket.com, Polymarket US and Kalshi, side by side, with whether each pair is actually the same cont

Details

• Version: 0.2.1
• Transports: streamable-http, stdio
• Uptime (7 days): 100%
• Median latency: 180 ms
• First indexed: 2026-11-01T09:46:29.950Z
• Last seen in registry: 2026-11-01T09:46:30.021Z
• Repository: https://github.com/pipeworx-io/mcp-crawlbase
• Website: https://pipeworx.io/packs/crawlbase

Badge for your README

Shows this live status and links here; updates hourly.

[![lookupd status](https://lookupd.com/badge/io.github.pipeworx-io/crawlbase.svg)](https://lookupd.com/servers/io.github.pipeworx-io/crawlbase)

• 62092 servers
• Last crawl: 2026-11-11T17:17:22.074Z
• API base: https://api.lookupd.com
• MCP URL: https://api.lookupd.com/mcp