webclaw-mcp (stdio)
Real-time web data for AI agents
Give your AI agent live eyes on the web. One MCP install.
AI agents that can only read their training data are stuck in the past. webclaw exposes 8 web tools over the Model Context Protocol so Claude, Cursor, and any MCP-compatible agent can scrape, crawl, search, and extract from the live web in real time.
The problem
Your AI agent can write code, analyze documents, and reason about complex problems, but it cannot read a webpage reliably. Most scraping tools fail on modern bot-protected sites, and integrating them requires custom middleware for every agent framework.
The webclaw solution
webclaw-mcp is a Model Context Protocol server that exposes 8 web extraction tools over stdio. Install it once and your AI agent gets scrape, crawl, search, batch, extract, summarize, diff, and screenshot tools with automatic Cloudflare bypass. No middleware, no custom code.
Why webclaw for ai agents
- Native MCP server, works with Claude Desktop, Cursor, Windsurf out of the box
- Automatic bot protection bypass (Cloudflare, DataDome, AWS WAF)
- 8 tools exposed: scrape, crawl, batch, search, extract, summarize, diff, map
- 118ms response keeps agents responsive, no multi-second waits
- Structured output (JSON, markdown) that agents can reason over
Code example
Claude Desktop config
{
"mcpServers": {
"webclaw": {
"command": "webclaw-mcp",
"env": {
"WEBCLAW_API_KEY": "wc_..."
}
}
}
}webclaw features for this use case
- MCP server with 8 tools over stdio
- Works with Claude Desktop, Claude Code, Cursor, Windsurf, OpenCode
- Automatic antibot bypass
- Real-time web access (no stale training data)
- Structured JSON or markdown output
Frequently asked questions
Which AI clients support webclaw's MCP server?
webclaw-mcp works with any MCP-compatible client: Claude Desktop, Claude Code, Cursor, Windsurf, OpenCode, Codex, Antigravity, and any custom agent built on the official MCP SDK.
Can my agent bypass Cloudflare and bot protection?
Yes. webclaw uses browser-grade TLS fingerprinting to bypass Cloudflare, DataDome, AWS WAF, and hCaptcha automatically. Your agent does not need to configure anything, it just calls the tool and gets clean content back.
How do I give my Cursor agent live web access?
Install webclaw-mcp, add it to your Cursor MCP config with your API key, and your agent will have 8 web tools available immediately. No other setup required.