MCP SERVER
Web scraping inside Cursor IDE
Give your Cursor agent access to the live web.
Cursor is an AI-first code editor with full MCP support. Install webclaw-mcp and your Cursor agent can read documentation, scrape API references, and research codebases on the live web while you're coding.
Setup
~/.cursor/mcp.json
{
"mcpServers": {
"webclaw": {
"command": "webclaw-mcp",
"env": {
"WEBCLAW_API_KEY": "wc_..."
}
}
}
}Why webclaw for Cursor
- Installs as a standard MCP server
- Cursor agent gets 8 tools automatically
- Bypass Cloudflare on docs sites and forums
- Fast enough to not slow down your flow
Common use cases
- Cursor agent reads real library documentation in real time
- Scrape API specs and reference pages on demand
- Research Stack Overflow or GitHub issues while coding
- Extract code examples from docs
Frequently asked questions
Where does the Cursor MCP config go?
Cursor reads ~/.cursor/mcp.json on startup. Add the webclaw entry there, then restart Cursor. The tools will show up in the MCP panel.
Can I use webclaw and other MCP servers at the same time?
Yes. MCP servers compose. Add multiple entries under mcpServers and Cursor will expose tools from all of them to the agent.