webclaw

The platform

One engine. Three ways to ship.

Webclaw is one Rust extraction engine, served as a hosted Cloud API, a single-binary CLI, and an MCP server for AI agents. Same clean, LLM-ready output everywhere, with SDKs for Python, TypeScript and Go.

REST

Cloud API

Web extraction, as a service.

A REST API for production apps. Automatic bot protection, JS rendering, LLM-optimized output, and structured extraction. One key, every format.

  • Scrape, crawl, search, extract, batch and research over one API
  • Bot protection and JS rendering handled for you
  • Python, TypeScript and Go SDKs
Explore the Cloud API
Binary

CLI Tool

Extraction from your terminal.

A single Rust binary that scrapes, crawls, extracts structured data, runs web searches, deep research, and AI-guided agents. Runs anywhere.

  • One binary, zero dependencies
  • Every output format, pipe-friendly for scripts
  • Local LLM features via Ollama, or self-host the whole stack
Explore the CLI
Agents

MCP Server

Give AI agents the web.

A Model Context Protocol server that connects Claude, Cursor, Windsurf, Codex and any MCP client to webclaw's extraction engine. One JSON config, full web access.

  • 12 tools your agent can call over stdio
  • Works with Claude Desktop, Cursor, Windsurf, OpenCode, Codex
  • Real-time web access with no custom middleware
Explore the MCP server

Under the hood

Same engine, every surface.

The API, CLI, and MCP server share the core extraction library. The hosted API also manages fetching, caching, authentication, and billing, so supported behavior differs between deployments.

LLM-ready output

Markdown, JSON, text, and an LLM format that removes page markup and boilerplate.

Bot protection handled

Automatic handling for supported protected and dynamic pages, with errors when the source cannot be accessed.

Fast by default

Fetch static page content directly and request JavaScript rendering when needed. Timing depends on the page and processing.

Nine output formats

Markdown, text, json, llm, links, rawHtml, attributes, query, and extract. Screenshots are a separate option.

Built in Rust

A single fast engine under every surface, with no heavy infrastructure to babysit.

Open source

AGPL-3.0. Run the API, CLI and MCP server on your own hardware without hosted API credits.

Official SDKs for Python, TypeScript and Go.

Type-safe clients over the same REST API, so you can call every endpoint in the language you already ship in.

Read the SDK docs

Pick your surface. Ship today.

Cancel anytime. API, CLI, or MCP, the engine is the same.

View on GitHub