Changelog
Every release. Every commit.
Webclaw ships in the open. Releases, features, fixes, and performance work — straight from the repository, as they land.
Releases
- v0.6.22LatestAug 30, 2026
v0.6.22 — Features & fixes
- Added support for an optional hosted model provider while preserving existing provider priority.
- Improved hosted-service model discovery so managed deployments do not probe local inference services they do not use.
- MCP requests made before initialization now return the accurate invalid-parameters error when required negotiation data is missing.
- Encoded characters are preserved while parsing documents and sitemaps.
- Valid PDFs whose header appears at the end of the permitted prefix are accepted.
- Updated document parsers and added practical bounds for pathological PDFs.
- @XiaoHuo888-hue made their first contribution in #116.
- Full comparison: https://github.com/0xMassi/webclaw/compare/v0.6.21...v0.6.22
- v0.6.21Aug 16, 2026
v0.6.21 — Fixes & improvements
- clarify EmptyPdf condition
- finish the EmptyPdf wording sweep
- stop CI fetching 1000 live sites, drop a dead workflow, refresh the MCP manifest
- upgrade rmcp to 3.1 so an unreadable line no longer ends the session
- 0.6.21
- @ayushcodes13 made their first contribution in https://github.com/0xMassi/webclaw/pull/111
- v0.6.20Aug 16, 2026
v0.6.20 — Fixes & improvements
- reply -32601 to pre-handshake requests instead of exiting
- 0.6.20
- v0.6.19Aug 10, 2026
v0.6.19 — Performance & fixes
- skip fallback probes when robots.txt declares sitemaps
- 0.6.19
- v0.6.18Aug 7, 2026
v0.6.18 — Features & fixes
- remove RapidProxy, refresh NodeMaven banner + links
- add Trendshift trending badge
- uncapped crawl, streaming batch, and one real fetch budget
- 0.6.17 — drop competitor name from zh README, reconcile version
- promote staging to main — uncapped crawl, streaming batch, one fetch budget, 0.6.17 reconcile
- 0.6.18
- v0.6.16Jul 22, 2026
v0.6.16 — Features & fixes
- reword server.json description (drop competitor name), bump 0.6.17
- remove stale in-core skill copies; single source of truth = webclaw-skill
- add Atlas Cloud as an opt-in provider
- --urls-file with a single row now works
- add Simplified Chinese README (README_zh-CN.md)
- 0.6.16 — Atlas Cloud opt-in provider + --urls-file single-row fix
- v0.6.15Jul 18, 2026
v0.6.15 — Fixes & improvements
- remove Proxy-Seller
- switch Star History chart to shieldcn
- hide secret env values in --help output
- scrub public SKILL.md of competitor/vendor wording and over-claims
- add "Use as an agent skill" section
- v0.6.14Jun 27, 2026
v0.6.14 — Fixes & improvements
- document search, map, and perf
- write WEBCLAW_API_KEY in generated .env
- remove Quantum Proxies (no longer sponsoring)
- repair binary install on Windows (and all platforms)
- build Linux binaries on ubuntu-22.04 for older-glibc support
- add musl static Linux builds (glibc-independent)
- guard prerelease tags from clobbering :latest / Homebrew
- bump version to 0.6.14
- v0.6.13Jun 17, 2026
v0.6.13 — Performance & fixes
- hot-path extraction speedups (selector hoist, shared og, QuickJS gating)
- v0.6.12Jun 17, 2026
v0.6.12 — Features & fixes
- standalone web search via Serper.dev (bring-your-own-key)
- layered URL discovery with bounded crawl fallback
- accept boolean params sent as JSON strings
- v0.6.11Jun 16, 2026
v0.6.11 — New features
- add MangoProxy studio partner
- Gemini provider + fix retired Anthropic default model
- v0.6.10Jun 15, 2026
v0.6.10 — Fixes & improvements
- single multi-platform Docker build + dispatch re-publish
- add NodeMaven studio partner to README
- Add Windows binaries to README
- accept numeric MCP params sent as strings
- @raffaelemancuso made their first contribution in https://github.com/0xMassi/webclaw/pull/57
- @crossi-dev made their first contribution in https://github.com/0xMassi/webclaw/pull/59
- v0.6.9Jun 10, 2026
v0.6.9 — Maintenance & updates
- release v0.6.9 (fix multi-arch Docker publish)
- v0.6.8Jun 10, 2026
v0.6.8 — Fixes & improvements
- add ColdProxy proxy-backed crawling walkthrough
- harden LLM providers, UTF-8 handling, and webhook/batch reliability
- v0.6.7Jun 9, 2026
v0.6.7 — Maintenance & updates
- Bump wreq 6.0.0-rc.29 / wreq-util 3.0.0-rc.12 (fingerprint-neutral)
- v0.6.6Jun 9, 2026
v0.6.6 — Maintenance & updates
- Salvage progress line + --url-encoded from #49
- v0.6.5Jun 4, 2026
v0.6.5 — New features
- URL truncation warning + --url-encoded flag
- periodic progress stderr line on slow fetches
- pin wreq/wreq-util to exact rc versions
- describe in-process wreq TLS, drop stale patched-deps
- use Option::zip to satisfy clippy
- v0.6.5
- parse old.reddit.com HTML instead of the dead .json API
- Add sponsor preview placements
- v0.6.4May 21, 2026
v0.6.4 — New features
- endpoints module for API surface extraction from HTML and JS
- v0.6.3May 19, 2026
v0.6.3 — Fixes & improvements
- harden core (WASM-safe gating, SSRF, path-traversal, recursion caps)
- v0.6.2May 18, 2026
v0.6.2 — Fixes & improvements
- add community plugins section
- clean llm output noise
- v0.6.1May 12, 2026
v0.6.1 — Fixes & improvements
- prepare 0.6.1 hardening
- v0.6.0May 10, 2026
v0.6.0 — Maintenance & updates
- Improve --format llm output quality on news index pages
- v0.5.9May 10, 2026
v0.5.9 — Fixes & improvements
- replace shields.io badges with shieldcn badges
- @jal-co made their first contribution in https://github.com/0xMassi/webclaw/pull/33
- v0.5.8May 4, 2026
v0.5.8 — Fixes & improvements
- improve brand extraction signals
- validate self-host route URLs consistently
- credit SSRF report
- v0.5.7May 4, 2026
v0.5.7 — Fixes & improvements
- harden fetch URL validation
- note youtube.rs role and yt-dlp short-circuit in server
- add h1 brand heading
- Add GitHub Sponsors username to FUNDING.yml
- add star history chart
- add hosted API callout above Get Started
- guard markdown pipe slice + detect trustpilot/reddit verify walls
- send bot-identifying UA on reddit .json API to bypass browser UA block
- v0.5.6Apr 23, 2026
v0.5.6 — New features
- add fetch_smart with Reddit + Akamai rescue paths, bump 0.5.6
- v0.5.5Apr 23, 2026
v0.5.5 — New features
- expose safari-ios browser profile + bump to 0.5.5
- drop sidecar references, mention ProductionFetcher
- v0.5.4Apr 23, 2026
v0.5.4 — Docs & tooling
- simplify 0.5.4 entry
- Bump to 0.5.4: SafariIos profile + Chrome fingerprint alignment + locale helper
- v0.5.3Apr 22, 2026
v0.5.3 — Fixes & improvements
- vertical_scrape uses Firefox profile, not default Chrome
- v0.5.2Apr 22, 2026
v0.5.2 — New features
- vertical extractor support (28 extractors discoverable + callable)
- v0.5.1Apr 22, 2026
v0.5.1 — New features
- Fetcher trait so vertical extractors work under any HTTP backend
- fix stale primp references, document wreq + Fetcher trait
- v0.5.0Apr 22, 2026
v0.5.0 — Features & fixes
- release v0.5.0 (28 vertical extractors + cloud integration)
- perfect-score follow-ups (trustpilot 2025 schema, amazon/etsy fallbacks, cloud docs)
- synthesize HTML from cloud response instead of requesting raw html
- detect AWS WAF verifying-connection page, add OG fallback to ecommerce_product
- wave 6b, etsy_listing + HTML fallbacks for substack/youtube
- wave 6a, 5 easy verticals (27 total)
- wave 5 \u2014 Amazon, eBay, Trustpilot via cloud fallback
- consolidate CloudClient + smart_fetch into webclaw-fetch
- v0.4.0Apr 22, 2026
v0.4.0 — Features & fixes
- v0.4.0: self-hosted REST server, bench subcommand, mcp warning fix (#26, #29, #30)
- v0.3.19Apr 17, 2026
v0.3.19 — Fixes & improvements
- reproducible 3-way comparison vs trafilatura + firecrawl
- entrypoint shim so child images with custom CMD work
- v0.3.18Apr 17, 2026
v0.3.18 — Fixes & improvements
- UTF-8 char boundary panic in find_content_position
- v0.3.17Apr 16, 2026
v0.3.17 — Features & fixes
- close --on-change command injection via sh -c (P0)
- surface semaphore-closed as typed error instead of panic (P1)
- DoS hardening + glob validation + cleanup (P2)
- robots parser + firefox client cache + Acquire ordering (P3)
- @0xMassi made their first contribution in https://github.com/0xMassi/webclaw/pull/20
- v0.3.13Apr 14, 2026
v0.3.13 — Fixes & improvements
- use ENTRYPOINT instead of CMD in Dockerfiles for proper arg passthrough
- v0.3.12Apr 14, 2026
v0.3.12 — New features
- add allow_subdomains and allow_external_links to CrawlConfig
- v0.3.11Apr 10, 2026
v0.3.11 — Maintenance & updates
Release notes - v0.3.10Apr 10, 2026
v0.3.10 — New features
- add fallback sitemap paths for broader discovery
- fix rustfmt for 2-element delay array
- reduce fetch timeout to 12s and retries to 2
- v0.3.9Apr 4, 2026
v0.3.9 — Fixes & improvements
- layout tables rendered as sections instead of markdown tables
- @devnen made their first contribution in https://github.com/0xMassi/webclaw/pull/14
- v0.3.8Apr 3, 2026
v0.3.8 — Fixes & improvements
- MCP research saves to file, returns compact response
- v0.3.7Apr 3, 2026
v0.3.7 — New features
- CLI --research flag + MCP cloud fallback + structured research output
- v0.3.6Apr 2, 2026
v0.3.6 — Features & fixes
- structured data in markdown/LLM output + v0.3.6
- update all 4 Homebrew checksums after Docker build completes
- v0.3.5Apr 2, 2026
v0.3.5 — New features
- extract __NEXT_DATA__ into structured_data
- update npm package license to AGPL-3.0
- update README license references from MIT to AGPL-3.0
- v0.3.4Apr 1, 2026
v0.3.4 — New features
- SvelteKit data extraction + license change to AGPL-3.0
- v0.3.3Apr 1, 2026
v0.3.3 — Features & fixes
- fix aarch64 cross-compilation for BoringSSL (boring-sys2)
- add SKILL.md to repo root for skills.sh discoverability
- cargo fmt
- remove reqwest_unstable rustflag (no longer needed)
- update Dockerfile for BoringSSL build deps (cmake, clang)
- replace custom TLS stack with wreq (BoringSSL), bump v0.3.3
- v0.3.2Mar 31, 2026
v0.3.2 — New features
- bump to v0.3.2, update changelog
- add --cookie-file support for JSON cookie files
- v0.3.1Mar 30, 2026
v0.3.1 — Features & fixes
- collapse nested if per clippy
- bump v0.3.1, update CHANGELOG, fix fmt
- cookie warmup fallback for Akamai-protected pages
- update webclaw-tls dependencies
- fix fmt in client.rs test
- adapt to webclaw-tls v0.1.1 HeaderMap API change
- fix ambiguous reqwest version in dependency sync
- replace stale primp check with webclaw-tls dependency sync
- v0.3.0Mar 29, 2026
v0.3.0 — Features & fixes
- clippy empty-line-after-doc-comment in browser.rs
- cargo fmt
- replace primp with webclaw-tls, bump to v0.3.0
- add QEMU for arm64 apt-get in Docker build
- single Docker job with plain docker build + manifest
- align Cargo.toml version with v0.2.3 tag
- fix Docker binary path extraction from release tarball
- use pre-built binaries for Docker instead of QEMU cross-compilation
Latest commits
The development feed, straight from main.
commitMerge pull request #126 from 0xMassi/codex/nodemaven-banner-20260909Sep 9, 202623c706edocsreplace NodeMaven sponsor bannerSep 9, 20260c953a3docsrefresh NodeMaven sponsor links and offersSep 9, 2026a0acaddcommitMerge pull request #121 from 0xMassi/codex/release-0.6.22-correctionAug 30, 202617aba82fixharden the release supply chainAug 30, 20267551eb4docsstate the portable tag grammarAug 30, 2026237c86dfixclose metadata and workflow review gapsAug 30, 2026badafd6fixenforce strict tag syntaxAug 30, 2026f7c1411fixreconcile v0.6.22 metadata and gatesAug 30, 2026076250bcommitMerge pull request #120 from 0xMassi/codex/audit-coreAug 30, 2026989a03cfixhonor full header offset windowAug 30, 202634243effeaturelet hosted services skip Ollama probeAug 30, 20266f9ed27fixremediate document parser advisoriesAug 30, 20263e99462commitMerge pull request #119 from 0xMassi/fix/guard-invalid-paramsAug 26, 202655c6dd1fixrefuse pre-handshake requests with -32602 when the method existsAug 26, 2026d8c895fcommitMerge pull request #116 from XiaoHuo888-hue/add-orcarouter-providerAug 26, 20265a137aacommitMerge pull request #118 from 0xMassi/fix/clippy-chunks-exactAug 26, 20260ba90defixsatisfy clippy::chunks_exact_to_as_chunks so CI is green againAug 25, 20269d4b8c9featureadd OrcaRouter LLM providerAug 19, 20268b86418commitMerge pull request #115 from 0xMassi/release/0.6.21Aug 16, 20263af4704chore0.6.21Aug 16, 202698c678ccommitMerge pull request #112 from 0xMassi/fix/rmcp-3.1-codecAug 16, 2026554c8d1commitMerge pull request #114 from 0xMassi/chore/repo-hygieneAug 16, 20263f27943commitMerge pull request #113 from 0xMassi/docs/finish-emptypdf-sweepAug 16, 2026623fc04
View full history on GitHub