Document Crawler & Search
Crawls websites to generate searchable Markdown documentation with vector embeddings for semantic search capabilities beyond train
MCPDocSearch is a tool for crawling websites, generating Markdown documentation, and making it searchable via an MCP server. It consists of two main components: a crawler CLI that extracts content from documentation sites and converts it to Markdown, and an MCP server that loads these documents, chunks them into searchable sections, and generates vector embeddings using sentence-transformers. The server exposes tools for listing documents, retrieving document structures, and performing semantic searches over the content, making it particularly useful for AI agents that need to access up-to-date documentation beyond their training cutoff.
Source
Repository: https://github.com/alizdavoodi/mcpdocsearch
Maintain Document Crawler & Search?
Let people know it's listed here — add the badge (live metrics, light/dark aware) or a plain link to your README or docs.
[Document Crawler & Search on getagentictools](https://getagentictools.com/mcp/alizdavoodi-mcpdocsearch?ref=badge)