io.github.OfficialSpicrawl/mcp

up checked 2026-11-11T01:37:25.006Z

Unclaimed · Unverified

Agent searches it appeared in, last 30 days: 0. Run this server? Claim the listing: verified label, uptime alerts and analytics.

Publisher-provided title

Spicrawl

Publisher-provided description

Web scraping MCP server: any URL to Markdown or JSON, with JavaScript rendering and batch jobs.

Summary by lookupd

Lets an agent fetch any URL as Markdown or JSON, render JavaScript pages, run batch scrape jobs and manage sessions and usage.

Install

Claude Code, remote (streamable-http)

claude mcp add --transport http mcp https://mcp.spicrawl.com/mcp

Claude Code, npm package (stdio)

claude mcp add mcp -- npx -y @spicrawl/mcp

Codex, remote (streamable-http)

codex mcp add mcp --url https://mcp.spicrawl.com/mcp

Codex, npm package (stdio)

codex mcp add mcp -- npx -y @spicrawl/mcp

Cursor, remote (streamable-http) → .cursor/mcp.json

{
  "mcpServers": {
    "mcp": {
      "url": "https://mcp.spicrawl.com/mcp"
    }
  }
}

Cursor, npm package (stdio) → .cursor/mcp.json

{
  "mcpServers": {
    "mcp": {
      "command": "npx",
      "args": [
        "-y",
        "@spicrawl/mcp"
      ]
    }
  }
}

Other clients: docs. Or tell your agent: Set up lookupd for me: read https://lookupd.com/agent.md and follow it.

Tools (27 tools)

Publisher-provided text

• spicrawl_scrape Retrieve a web page and return its content as markdown (default), text, HTML, a JSON envelope, or a printed PDF. Handles the fetch vs. browser decision, charset
• spicrawl_batch_submit Submit many URLs to be scraped as one asynchronous job, with shared settings applied to every URL. Give EITHER `urls` or `items`, not both (at least one URL, un
• spicrawl_batch_list List this API key's project's batch jobs, newest first, with status and progress. Returns `{ batches: [...], next_cursor? }`; pass `next_cursor` back as `cursor
• spicrawl_batch_status Return one batch job with its status and progress (total/completed/succeeded/failed/remaining, credits charged). Poll this after `spicrawl_batch_submit`; once s
• spicrawl_batch_results Return a page of FINISHED items of a batch job (one record per item: seq, url, external_id, status, error, and content, or a `result_url` API path (GET /v1/batc
• spicrawl_batch_task_content Return the full payload one item of a batch job produced, by its `seq` (items are numbered from 0 in submission order). Cheaper than paging results when you nee
• spicrawl_batch_cancel Cancel a batch job: items not yet started are cancelled and will never run; items already finished keep their results; items already running finish first, so th
• spicrawl_batch_retry Re-queue every FAILED item of a batch job so it runs again (succeeded items are untouched; a job with no failures is returned unchanged). Returns `{ job, items_
• spicrawl_batch_add_items Append URLs to a batch job that was submitted with `open: true`. Same item vocabulary as `spicrawl_batch_submit` (EITHER `urls` or `items`, not both, plus share
• spicrawl_batch_close Stop an open batch job accepting items, so it completes once its queued work drains. Idempotent (closing a closed job succeeds). Returns the job object.
• spicrawl_session_create Create a session: a persistent browser identity (cookie jar, localStorage, a fixed rendering tier and, by default, a sticky exit IP) that survives across scrape
• spicrawl_session_list List this API key's project's sessions, newest first. Returns `{ sessions: [...], next_cursor? }`; pass `next_cursor` back as `cursor` for the next page. Never
• spicrawl_session_get Return one session's metadata: status, `engine` (its rendering tier), proxy/exit, usage count, expiry, lease holder, and a summary of its stored context. Never
• spicrawl_session_context Return the full stored state of a LIVE session — cookies, localStorage and other credentials — plus its fingerprint and domain scores. The `session_context` obj
• spicrawl_session_release End a session when you are done with it: frees its exit IP and browser state; it can no longer be used with spicrawl_scrape. Its stored cookies and storage are
• spicrawl_session_delete Permanently delete a session and its stored state, including the record itself (prefer spicrawl_session_release if you only want to stop using it). Idempotent:
• spicrawl_usage Billing-grade usage for your org over a date window, from the daily rollup (usage_daily), grouped by day, project, engine, feature or key. group_by=key returns
• spicrawl_usage_summary A compact current-period summary of your org's usage (totals as of now, from the daily rollup). No parameters. Use for a quick 'how much have I used so far'; us
• spicrawl_usage_reconciliation Drift report for ONE day: re-derives usage from that day's request log and compares it with the billed daily rollup, so you can see whether the rollup missed or
• spicrawl_requests_list Recent API calls in your key's project, newest first, each with project_id, status, engine, http_status, error_code/error_detail, attempts, URL, proxy used, lat
• spicrawl_request_get The full log record of one past API call by its request id. Every response carries its id in the X-Request-Id header (and error bodies carry it too), so this is
• spicrawl_browser_connect_url Mints a single-use connect URL for Spicrawl's remote browser (GET /v1/browser, a DevTools Protocol (CDP) WebSocket) so YOUR code can drive it with any CDP clien
• spicrawl_browser_live_view Gets a link a person can open to watch the remote browser your CDP connection is driving, and take control of it: the same tabs, cookies and page. Use it when a
• spicrawl_browser_control Reads or changes who drives a connected remote browser: `agent` (your CDP connection) or `human` (a person in its live view, see spicrawl_browser_live_view). `s
• spicrawl_docs_search Full-text search over the Spicrawl documentation (guides, API reference, errors, limits). Use it to look up a parameter name, value or combination for a spicraw
• spicrawl_docs_read Fetches one Spicrawl documentation page as Markdown. `path` may be a page path (`guides/anti-bot`), a docs URL from spicrawl_docs_search (url or md_url), or eit
• spicrawl_docs_index The docs' llms.txt: every Spicrawl documentation page with its title, a one-line description and its Markdown URL. Use it to find the right page when a search d

Details

• Version: 0.2.0
• Transports: streamable-http, stdio
• Uptime (7 days): 100%
• Median latency: 1950 ms
• First indexed: 2026-11-01T09:13:30.269Z
• Last seen in registry: 2026-11-10T12:17:21.128Z
• Repository: https://github.com/OfficialSpicrawl/mcp
• Website: https://docs.spicrawl.com/agents/mcp

Badge for your README

Shows this live status and links here; updates hourly.

[![lookupd status](https://lookupd.com/badge/io.github.OfficialSpicrawl/mcp.svg)](https://lookupd.com/servers/io.github.OfficialSpicrawl/mcp)

• 62033 servers
• Last crawl: 2026-11-11T15:38:39.561Z
• API base: https://api.lookupd.com
• MCP URL: https://api.lookupd.com/mcp