MCP SERVER

Web scraping inside Cursor IDE

Give your Cursor agent access to the live web.

Cursor is an AI-first code editor with full MCP support. Install webclaw-mcp and your Cursor agent can read documentation, scrape API references, and research codebases on the live web while you're coding.

Setup

~/.cursor/mcp.json

{
  "mcpServers": {
    "webclaw": {
      "command": "webclaw-mcp",
      "env": {
        "WEBCLAW_API_KEY": "wc_..."
      }
    }
  }
}

Why webclaw for Cursor

  • Installs as a standard MCP server
  • Cursor agent gets 8 tools automatically
  • Bypass Cloudflare on docs sites and forums
  • Fast enough to not slow down your flow

Common use cases

  • Cursor agent reads real library documentation in real time
  • Scrape API specs and reference pages on demand
  • Research Stack Overflow or GitHub issues while coding
  • Extract code examples from docs

Frequently asked questions

Where does the Cursor MCP config go?

Cursor reads ~/.cursor/mcp.json on startup. Add the webclaw entry there, then restart Cursor. The tools will show up in the MCP panel.

Can I use webclaw and other MCP servers at the same time?

Yes. MCP servers compose. Add multiple entries under mcpServers and Cursor will expose tools from all of them to the agent.

Ready to connect?

Start extracting.

7-day Starter trial. Cancel anytime. Deploy in under a minute or self-host forever. Open source.