AI Cursor Scraping Assistant

Streamlines web scraper development for e-commerce sites by analyzing website structure, detecting anti-bot protections, and gener

thewebscrapingclub 55
Claude CodeClaude DesktopGeneric
View source ↗

AI-Cursor-Scraping-Assistant combines Cursor AI with MCP tools to streamline web scraper development for e-commerce sites. Developed by The Web Scraping Club, this implementation provides a structured workflow for website analysis, detection of anti-bot protections, and automated generation of Scrapy or Camoufox scrapers. The server component offers tools for fetching page content, stripping CSS, generating XPath selectors, and creating complete scrapers from templates, while the rule system guides Cursor through the process of analyzing website structure and implementing appropriate scraping strategies for different page types.

Source

Repository: https://github.com/thewebscrapingclub/ai-cursor-scraping-assistant

Maintain AI Cursor Scraping Assistant?

Let people know it's listed here — add the badge (live metrics, light/dark aware) or a plain link to your README or docs.

[AI Cursor Scraping Assistant on getagentictools](https://getagentictools.com/mcp/thewebscrapingclub-ai-cursor-scraping-assistant?ref=badge)