com.thenextgennexus/web-scraping-mcp-server

up checked 2026-11-11T08:37:54.355Z

Unclaimed · Unverified

Agent searches it appeared in, last 30 days: 1. Run this server? Claim the listing: verified label, uptime alerts and analytics.

Publisher-provided description

Website crawling, Google search and Wikipedia lookup as agent tools.

Summary by lookupd

Lets an agent crawl websites into structured content, run Google searches for ranked results, and look up Wikipedia articles.

Install

Claude Code, remote (streamable-http)

claude mcp add --transport http web-scraping-mcp-server https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp

Codex, remote (streamable-http)

codex mcp add web-scraping-mcp-server --url https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp

Cursor, remote (streamable-http) → .cursor/mcp.json

{
  "mcpServers": {
    "web-scraping-mcp-server": {
      "url": "https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp"
    }
  }
}

Other clients: docs. Or tell your agent: Set up lookupd for me: read https://lookupd.com/agent.md and follow it.

Tools (3 tools)

Publisher-provided text

• crawl_website Crawl a website and extract its content as structured data. Args: url: Website URL to crawl (e.g. 'https://example.com') max_pages: Max pages to crawl
• google_search Search Google and return organic results with titles, URLs, snippets. Args: query: Search query (e.g. 'best python libraries 2026') max_results: Max re
• wikipedia_lookup Look up a Wikipedia article and return its content. Args: topic: Topic to look up (e.g. 'Artificial intelligence')

Details

• Version: 1.0.1
• Transports: streamable-http
• Uptime (7 days): 100%
• Median latency: 161 ms
• First indexed: 2026-11-01T08:59:18.609Z
• Last seen in registry: 2026-11-07T23:17:16.079Z
• Website: https://apify.com/nexgendata/web-scraping-mcp-server?fpr=2ayu9b

Badge for your README

Shows this live status and links here; updates hourly.

[![lookupd status](https://lookupd.com/badge/com.thenextgennexus/web-scraping-mcp-server.svg)](https://lookupd.com/servers/com.thenextgennexus/web-scraping-mcp-server)

• 62071 servers
• Last crawl: 2026-11-11T16:39:06.253Z
• API base: https://api.lookupd.com
• MCP URL: https://api.lookupd.com/mcp