MCP Server

Give AI agents the web.

The Model Context Protocol connects Claude, Cursor, Windsurf, OpenCode, Codex, Antigravity, and any MCP-compatible AI agent directly to webclaw's extraction engine. One JSON config. Full web access. 12 tools your agent can call.

Read full docs

12 tools

Everything your agent needs to read, extract, and monitor.

scrape

Extract content from supported public URLs

crawl

Crawl linked pages within configured limits

url, depth, max_pages

map

Discover URLs through sitemap parsing

url

batch

Extract multiple URLs concurrently

urls[], format, concurrency

extract

LLM-powered structured data extraction

url, prompt, schema

summarize

AI-generated page summaries

url, max_sentences

diff

Track content changes between snapshots

url, previous_snapshot

brand

Extract available brand identity from a public site

url (returns colors, fonts, logos)

search

Web search with optional result scraping

query, num_results, country, lang, scrape

research

Multi-source research with a completed report

query, deep, topic

vertical_scrape

Run a site-specific vertical extractor for typed JSON

url, extractor

list_extractors

List every vertical extractor and its output schema

(no params)

Smart Fetch

Local tools can perform supported extraction without hosted API credits. Cloud-backed operations require an API key and use the hosted service’s credit or Research allowance. Available behavior depends on your MCP configuration.

Quick setup

Pick your client. Paste the config. Done.

{  "mcpServers": {    "webclaw": {      "command": "npx",      "args": ["-y", "@webclaw/mcp"],      "env": {        "WEBCLAW_API_KEY": "<YOUR_API_KEY>"      }    }  }}

Installation

Two ways to get the binary.

curl -fsSL https://github.com/0xMassi/webclaw/releases/latest/download/webclaw-mcp-aarch64-apple-darwin \  -o webclaw-mcp && chmod +x webclaw-mcp

Configuration

All config through environment variables.

Set them in your MCP client config or your shell.

WEBCLAW_API_KEY

Enables cloud extraction for bot-protected sites, handled transparently

OPENAI_API_KEY / ANTHROPIC_API_KEY

Enables extract and summarize tools (LLM features)

OLLAMA_HOST

Use local Ollama for LLM features (default: localhost:11434)

proxies.txt

Place a proxies.txt file in working directory to route requests through your own proxies

Related guides

How the MCP server fits the wider stack.

Start extracting. Connect in seconds.

Get an API key for cloud features, or run the MCP server fully local with zero configuration.

Read full docs