Changelog
Every release. Every commit.
Webclaw ships in the open. Releases, features, fixes, and performance work — straight from the repository, as they land.
Releases
- v0.6.16LatestJul 22, 2026
v0.6.16 — Features & fixes
- reword server.json description (drop competitor name), bump 0.6.17
- remove stale in-core skill copies; single source of truth = webclaw-skill
- add Atlas Cloud as an opt-in provider
- --urls-file with a single row now works
- add Simplified Chinese README (README_zh-CN.md)
- 0.6.16 — Atlas Cloud opt-in provider + --urls-file single-row fix
- v0.6.15Jul 18, 2026
v0.6.15 — Fixes & improvements
- remove Proxy-Seller
- switch Star History chart to shieldcn
- hide secret env values in --help output
- scrub public SKILL.md of competitor/vendor wording and over-claims
- add "Use as an agent skill" section
- v0.6.14Jun 27, 2026
v0.6.14 — Fixes & improvements
- document search, map, and perf
- write WEBCLAW_API_KEY in generated .env
- remove Quantum Proxies (no longer sponsoring)
- repair binary install on Windows (and all platforms)
- build Linux binaries on ubuntu-22.04 for older-glibc support
- add musl static Linux builds (glibc-independent)
- guard prerelease tags from clobbering :latest / Homebrew
- bump version to 0.6.14
- v0.6.13Jun 17, 2026
v0.6.13 — Performance & fixes
- hot-path extraction speedups (selector hoist, shared og, QuickJS gating)
- v0.6.12Jun 17, 2026
v0.6.12 — Features & fixes
- standalone web search via Serper.dev (bring-your-own-key)
- layered URL discovery with bounded crawl fallback
- accept boolean params sent as JSON strings
- v0.6.11Jun 16, 2026
v0.6.11 — New features
- add MangoProxy studio partner
- Gemini provider + fix retired Anthropic default model
- v0.6.10Jun 15, 2026
v0.6.10 — Fixes & improvements
- single multi-platform Docker build + dispatch re-publish
- add NodeMaven studio partner to README
- Add Windows binaries to README
- accept numeric MCP params sent as strings
- @raffaelemancuso made their first contribution in https://github.com/0xMassi/webclaw/pull/57
- @crossi-dev made their first contribution in https://github.com/0xMassi/webclaw/pull/59
- v0.6.9Jun 10, 2026
v0.6.9 — Maintenance & updates
- release v0.6.9 (fix multi-arch Docker publish)
- v0.6.8Jun 10, 2026
v0.6.8 — Fixes & improvements
- add ColdProxy proxy-backed crawling walkthrough
- harden LLM providers, UTF-8 handling, and webhook/batch reliability
- v0.6.7Jun 9, 2026
v0.6.7 — Maintenance & updates
- Bump wreq 6.0.0-rc.29 / wreq-util 3.0.0-rc.12 (fingerprint-neutral)
- v0.6.6Jun 9, 2026
v0.6.6 — Maintenance & updates
- Salvage progress line + --url-encoded from #49
- v0.6.5Jun 4, 2026
v0.6.5 — New features
- URL truncation warning + --url-encoded flag
- periodic progress stderr line on slow fetches
- pin wreq/wreq-util to exact rc versions
- describe in-process wreq TLS, drop stale patched-deps
- use Option::zip to satisfy clippy
- v0.6.5
- parse old.reddit.com HTML instead of the dead .json API
- Add sponsor preview placements
- v0.6.4May 21, 2026
v0.6.4 — New features
- endpoints module for API surface extraction from HTML and JS
- v0.6.3May 19, 2026
v0.6.3 — Fixes & improvements
- harden core (WASM-safe gating, SSRF, path-traversal, recursion caps)
- v0.6.2May 18, 2026
v0.6.2 — Fixes & improvements
- add community plugins section
- clean llm output noise
- v0.6.1May 12, 2026
v0.6.1 — Fixes & improvements
- prepare 0.6.1 hardening
- v0.6.0May 10, 2026
v0.6.0 — Maintenance & updates
- Improve --format llm output quality on news index pages
- v0.5.9May 10, 2026
v0.5.9 — Fixes & improvements
- replace shields.io badges with shieldcn badges
- @jal-co made their first contribution in https://github.com/0xMassi/webclaw/pull/33
- v0.5.8May 4, 2026
v0.5.8 — Fixes & improvements
- improve brand extraction signals
- validate self-host route URLs consistently
- credit SSRF report
- v0.5.7May 4, 2026
v0.5.7 — Fixes & improvements
- harden fetch URL validation
- note youtube.rs role and yt-dlp short-circuit in server
- add h1 brand heading
- Add GitHub Sponsors username to FUNDING.yml
- add star history chart
- add hosted API callout above Get Started
- guard markdown pipe slice + detect trustpilot/reddit verify walls
- send bot-identifying UA on reddit .json API to bypass browser UA block
- v0.5.6Apr 23, 2026
v0.5.6 — New features
- add fetch_smart with Reddit + Akamai rescue paths, bump 0.5.6
- v0.5.5Apr 23, 2026
v0.5.5 — New features
- expose safari-ios browser profile + bump to 0.5.5
- drop sidecar references, mention ProductionFetcher
- v0.5.4Apr 23, 2026
v0.5.4 — Docs & tooling
- simplify 0.5.4 entry
- Bump to 0.5.4: SafariIos profile + Chrome fingerprint alignment + locale helper
- v0.5.3Apr 22, 2026
v0.5.3 — Fixes & improvements
- vertical_scrape uses Firefox profile, not default Chrome
- v0.5.2Apr 22, 2026
v0.5.2 — New features
- vertical extractor support (28 extractors discoverable + callable)
- v0.5.1Apr 22, 2026
v0.5.1 — New features
- Fetcher trait so vertical extractors work under any HTTP backend
- fix stale primp references, document wreq + Fetcher trait
- v0.5.0Apr 22, 2026
v0.5.0 — Features & fixes
- release v0.5.0 (28 vertical extractors + cloud integration)
- perfect-score follow-ups (trustpilot 2025 schema, amazon/etsy fallbacks, cloud docs)
- synthesize HTML from cloud response instead of requesting raw html
- detect AWS WAF verifying-connection page, add OG fallback to ecommerce_product
- wave 6b, etsy_listing + HTML fallbacks for substack/youtube
- wave 6a, 5 easy verticals (27 total)
- wave 5 \u2014 Amazon, eBay, Trustpilot via cloud fallback
- consolidate CloudClient + smart_fetch into webclaw-fetch
- v0.4.0Apr 22, 2026
v0.4.0 — Features & fixes
- v0.4.0: self-hosted REST server, bench subcommand, mcp warning fix (#26, #29, #30)
- v0.3.19Apr 17, 2026
v0.3.19 — Fixes & improvements
- reproducible 3-way comparison vs trafilatura + firecrawl
- entrypoint shim so child images with custom CMD work
- v0.3.18Apr 17, 2026
v0.3.18 — Fixes & improvements
- UTF-8 char boundary panic in find_content_position
- v0.3.17Apr 16, 2026
v0.3.17 — Features & fixes
- close --on-change command injection via sh -c (P0)
- surface semaphore-closed as typed error instead of panic (P1)
- DoS hardening + glob validation + cleanup (P2)
- robots parser + firefox client cache + Acquire ordering (P3)
- @0xMassi made their first contribution in https://github.com/0xMassi/webclaw/pull/20
- v0.3.13Apr 14, 2026
v0.3.13 — Fixes & improvements
- use ENTRYPOINT instead of CMD in Dockerfiles for proper arg passthrough
- v0.3.12Apr 14, 2026
v0.3.12 — New features
- add allow_subdomains and allow_external_links to CrawlConfig
- v0.3.11Apr 10, 2026
v0.3.11 — Maintenance & updates
Release notes - v0.3.10Apr 10, 2026
v0.3.10 — New features
- add fallback sitemap paths for broader discovery
- fix rustfmt for 2-element delay array
- reduce fetch timeout to 12s and retries to 2
- v0.3.9Apr 4, 2026
v0.3.9 — Fixes & improvements
- layout tables rendered as sections instead of markdown tables
- @devnen made their first contribution in https://github.com/0xMassi/webclaw/pull/14
- v0.3.8Apr 3, 2026
v0.3.8 — Fixes & improvements
- MCP research saves to file, returns compact response
- v0.3.7Apr 3, 2026
v0.3.7 — New features
- CLI --research flag + MCP cloud fallback + structured research output
- v0.3.6Apr 2, 2026
v0.3.6 — Features & fixes
- structured data in markdown/LLM output + v0.3.6
- update all 4 Homebrew checksums after Docker build completes
- v0.3.5Apr 2, 2026
v0.3.5 — New features
- extract __NEXT_DATA__ into structured_data
- update npm package license to AGPL-3.0
- update README license references from MIT to AGPL-3.0
- v0.3.4Apr 1, 2026
v0.3.4 — New features
- SvelteKit data extraction + license change to AGPL-3.0
- v0.3.3Apr 1, 2026
v0.3.3 — Features & fixes
- fix aarch64 cross-compilation for BoringSSL (boring-sys2)
- add SKILL.md to repo root for skills.sh discoverability
- cargo fmt
- remove reqwest_unstable rustflag (no longer needed)
- update Dockerfile for BoringSSL build deps (cmake, clang)
- replace custom TLS stack with wreq (BoringSSL), bump v0.3.3
- v0.3.2Mar 31, 2026
v0.3.2 — New features
- bump to v0.3.2, update changelog
- add --cookie-file support for JSON cookie files
- v0.3.1Mar 30, 2026
v0.3.1 — Features & fixes
- collapse nested if per clippy
- bump v0.3.1, update CHANGELOG, fix fmt
- cookie warmup fallback for Akamai-protected pages
- update webclaw-tls dependencies
- fix fmt in client.rs test
- adapt to webclaw-tls v0.1.1 HeaderMap API change
- fix ambiguous reqwest version in dependency sync
- replace stale primp check with webclaw-tls dependency sync
- v0.3.0Mar 29, 2026
v0.3.0 — Features & fixes
- clippy empty-line-after-doc-comment in browser.rs
- cargo fmt
- replace primp with webclaw-tls, bump to v0.3.0
- add QEMU for arm64 apt-get in Docker build
- single Docker job with plain docker build + manifest
- align Cargo.toml version with v0.2.3 tag
- fix Docker binary path extraction from release tarball
- use pre-built binaries for Docker instead of QEMU cross-compilation
- v0.2.3Mar 27, 2026
v0.2.3 — Maintenance & updates
- build multi-platform Docker images (amd64 + arm64)
- v0.2.2Mar 27, 2026
v0.2.2 — Fixes & improvements
- v0.2.2 pre-release check
- add weekly primp compatibility check
- add reqwest to patch list, sync with primp 1.2.0
- add SKILL.md for Claude Code skill integration
- v0.2.1Mar 27, 2026
v0.2.1 — New features
- v0.2.1 — Docker image on GHCR, QuickJS data island extraction
- add Docker image build to release workflow
- enable quickjs for JS data island extraction
- upgrade README badges to for-the-badge style, add X/Twitter
- v0.2.0Mar 26, 2026
v0.2.0 — Document extraction, HTML format, multi-URL watch
- webclaw now auto-detects and extracts content from document files:
- DOCX — Word documents parsed into markdown with headings preserved
- XLSX/XLS — Spreadsheets converted to markdown tables (multi-sheet support)
- CSV — Parsed with quoted field handling, output as markdown table
- Auto-detected by Content-Type header or URL extension. Works in batch mode too:
- Returns sanitized HTML. Works with crawl, batch, and --output-dir (.html extension).
- Monitors all URLs in parallel. Reports aggregate changes per check.
- Combines batch fetching with LLM extraction. Processes URLs sequentially to respect rate limits.
- v0.1.7Mar 26, 2026
v0.1.7 — Fix extraction options in batch mode
- --only-main-content, --include, and --exclude flags now work correctly in batch mode
- Previously these options were silently ignored when using --urls-file or multiple URLs
- Thanks @mixxr for reporting.
Latest commits
The development feed, straight from main.
commitMerge pull request #95 from 0xMassi/docs/trendshift-badgeJul 23, 2026a107c63docsadd Trendshift trending badgeJul 23, 202650a8364commitMerge pull request #94 from 0xMassi/chore/sponsors-rapidproxy-nodemavenJul 23, 20266cbac16choreremove rapidproxy, refresh nodemaven banner + linksJul 23, 20261e2715ecommitMerge pull request #93 from 0xMassi/release/0.6.16Jul 22, 202650a17d2chore0.6.16Jul 22, 2026ca601c1featurewire Atlas Cloud as opt-in last-resort providerJul 22, 2026bf7d747docsadd Simplified Chinese README (README_zh-CN.md) (#90)Jul 22, 2026c02295bcommitMerge pull request #91 from 0xMassi/fix/urls-file-single-rowJul 22, 2026026b97cfixalso fix --diff/--brand for single-row --urls-file (review)Jul 22, 202636cde1dcommitMerge pull request #92 from 0xMassi/feat/atlascloud-providerJul 22, 202663056a8choremake Atlas Cloud opt-in, not a default-chain memberJul 22, 2026bacc63bcommitApply rustfmt to Atlas Cloud providerJul 13, 2026a76d931commitSupport Atlas Cloud base URL overrideJul 13, 2026a7e7753commitAdd Atlas Cloud LLM providerJul 13, 20260124ab9fix--urls-file with a single row now works (#86)Jul 22, 20267f63d2fcommitMerge pull request #89 from 0xMassi/chore/skill-consolidation-cleanupJul 22, 20264072861choreremove stale in-core skill copies; point docs at webclaw-skillJul 22, 20265ae92f8commitMerge pull request #88 from 0xMassi/chore/server-json-reword-0.6.17Jul 22, 2026fd25625chorereword server.json (drop competitor name), bump to 0.6.17Jul 22, 20268d3483cfixadd files allowlist so npm never ships secretsJul 22, 2026d497c5echoreflip .mcp.json to npx @webclaw/mcp; gitignore registry tokensJul 22, 2026b5818ferefactorwrite the npx @webclaw/mcp config, drop binary downloadJul 22, 2026d387669fixrename @webclaw/mcp bin to avoid npx PATH shadowingJul 22, 2026248da0a
View full history on GitHub