Crawl4AI RAG
Integrates web crawling with RAG functionality to enable website content retrieval, storage in vector databases, and semantic sear
This MCP server integrates web crawling capabilities from Crawl4AI with RAG (Retrieval Augmented Generation) functionality, enabling AI agents and coding assistants to crawl websites, store content in Supabase vector databases, and perform semantic searches over the crawled data. Developed by Cole Medin, it provides four essential tools: single page crawling, intelligent recursive website crawling with automatic URL type detection, source retrieval, and vector-based RAG queries with optional source filtering. The implementation is designed to be incorporated into Archon as a knowledge engine for AI coding assistants, with future plans to support different embedding models and local deployment options using Ollama.
Source
Repository: https://github.com/coleam00/mcp-crawl4ai-rag
Maintain Crawl4AI RAG?
Let people know it's listed here — add the badge (live metrics, light/dark aware) or a plain link to your README or docs.
[](https://getagentictools.com/mcp/coleam00-mcp-crawl4ai-rag?ref=badge) Related mcp
PaperBanana Generates publication-quality methodology diagrams and statistical plots from text descriptions using a multi-agent pipeline with
Apify Extract data from any website with thousands of scrapers, crawlers, and automations on Apify Store. Use ready-made tools to access
DevDocs Free, private, UI-based software documentation context management server. Designed with software developers in mind.
Agent Mail Coordinates multiple agents through structured messaging, exclusive file path claims, and persistent Git-based project archives wi
Perplexity Connector for the Perplexity API, to enable web search without leaving the MCP ecosystem.
Tavily Search Integrates with Tavily API to provide real-time web search and content extraction capabilities for research, aggregation, and fact