MCP SERVER

Web scraping inside Claude Code

Let Claude Code read live docs, issues, specs, and sites while it works.

Claude Code supports MCP servers through its command-line configuration. Add webclaw-mcp and Claude Code can scrape, crawl, search, summarize, and extract live web content directly inside coding sessions without copy-pasting browser tabs into the prompt.

Setup

Claude Code MCP server

claude mcp add --transport stdio --scope user \
  --env WEBCLAW_API_KEY=wc_... \
  webclaw -- webclaw-mcp

# Verify inside Claude Code
/mcp

Why webclaw for Claude Code

  • Standard MCP server for Claude Code
  • 8 web tools available from one local server
  • Bot bypass for documentation, forums, and protected pages
  • Clean markdown output fits coding-agent context windows

Common use cases

  • Read current framework docs while editing code
  • Scrape API references and examples during implementation
  • Research GitHub issues, changelogs, and release notes
  • Extract structured data from public pages into code or tests

Frequently asked questions

How do I add webclaw to Claude Code?

Use claude mcp add with the stdio transport and pass WEBCLAW_API_KEY as an environment variable. The example above installs it at user scope so it is available across projects.

How do I check whether Claude Code sees the tools?

Run /mcp inside Claude Code. Claude Code shows configured MCP servers and their connection status there.

Ready to connect?

Start extracting.

7-day Starter trial. Cancel anytime. Deploy in under a minute or self-host forever. Open source.