CRW

Lightweight web scraper and crawler built in Rust, designed as a Firecrawl alternative for AI agents.

us 473 ↓ 6.9k
Claude CodeClaude DesktopGeneric
View source ↗

High-performance web scraping and crawling tool that outputs markdown, HTML, plain text, or JSON. Supports single-page application rendering, CSS selectors, XPath extraction, and LLM-powered structured data extraction using JSON schemas. Runs as a single binary with minimal resource usage (6.6 MB idle RAM) and includes SSRF protection, rate limiting, and robots.txt compliance. Available via npm (crw-mcp), Cargo, Docker, or direct binary download.

Source

Repository: https://github.com/us/crw

Maintain CRW?

Let people know it's listed here — add the badge (live metrics, light/dark aware) or a plain link to your README or docs.

CRW on getagentictools
[![CRW on getagentictools](https://getagentictools.com/badge/mcp/us-crw.svg)](https://getagentictools.com/mcp/us-crw?ref=badge)