https://webclaw.io 2026-04-03T10:51:00.527Z weekly 1 https://webclaw.io/pricing 2026-04-03T10:51:00.527Z monthly 0.8 https://webclaw.io/blog 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/changelog 2026-04-03T10:51:00.527Z weekly 0.6 https://webclaw.io/terms 2026-04-03T10:51:00.527Z yearly 0.3 https://webclaw.io/privacy 2026-04-03T10:51:00.527Z yearly 0.3 https://webclaw.io/products/cli 2026-04-03T10:51:00.527Z monthly 0.7 https://webclaw.io/products/api 2026-04-03T10:51:00.527Z monthly 0.7 https://webclaw.io/products/mcp 2026-04-03T10:51:00.527Z monthly 0.7 https://webclaw.io/about 2026-04-03T10:51:00.527Z monthly 0.5 https://webclaw.io/llms.txt 2026-04-03T10:51:00.527Z weekly 0.5 https://webclaw.io/docs 2026-04-03T10:51:00.527Z weekly 0.9 https://webclaw.io/docs/getting-started 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/docs/cli 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/docs/api 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/docs/api/scrape 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/docs/api/crawl 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/docs/api/batch 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/docs/api/map 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/docs/api/extract 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/docs/api/summarize 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/docs/api/diff 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/docs/api/brand 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/docs/api/search 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/docs/api/research 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/docs/api/agent-scrape 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/docs/api/watch 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/docs/mcp 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/docs/self-hosting 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/docs/cloud 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/docs/sdks 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/docs/sdks/python 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/docs/sdks/go 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/docs/sdks/typescript 2026-04-03T10:51:00.527Z weekly 0.7 https://webclaw.io/blog/bypass-cloudflare-bot-protection-web-scraping 2026-04-02T00:00:00.000Z monthly 0.6 https://webclaw.io/blog/extract-structured-data-from-any-webpage 2026-03-31T00:00:00.000Z monthly 0.6 https://webclaw.io/blog/rag-pipeline-web-data 2026-03-27T00:00:00.000Z monthly 0.6 https://webclaw.io/blog/mcp-and-web-scraping 2026-03-24T00:00:00.000Z monthly 0.6 https://webclaw.io/blog/html-to-markdown-for-llms 2026-03-20T00:00:00.000Z monthly 0.6 https://webclaw.io/blog/web-scraping-for-ai-agents 2026-03-17T00:00:00.000Z monthly 0.6 https://webclaw.io/blog/why-i-built-webclaw 2026-03-12T00:00:00.000Z monthly 0.6 https://webclaw.io/compare 2026-04-03T10:51:00.527Z monthly 0.7 https://webclaw.io/compare/firecrawl 2026-04-03T10:51:00.527Z monthly 0.8 https://webclaw.io/compare/crawl4ai 2026-04-03T10:51:00.527Z monthly 0.8 https://webclaw.io/compare/apify 2026-04-03T10:51:00.527Z monthly 0.8 https://webclaw.io/compare/scrapingbee 2026-04-03T10:51:00.527Z monthly 0.8