data-scraper-agent

data scraper agent

affaan-m 232k ↓ 4.8k MIT updated 25d ago
Claude Code
View source ↗

What it does

  • User wants to gather or monitor any public website or API
  • User says "build a bot that checks...", "monitor X for me", "collect data from..."
  • User wants to track jobs, prices, news, repos, sports scores, events, listings
  • User asks how to automate data collection without paying for hosting
  • User wants an agent that gets smarter over time based on their decisions
  • Job boards → score relevance to resume
  • Product prices → alert on drops

Requirements & configuration

  • cron: "0 /3 " # every 3 hours — adjust to your needs

Derived from the skill's own SKILL.md documentation · extracted 2026-07-23

data scraper agent

Source

Repository: https://github.com/affaan-m/everything-claude-code

data-scraper-agent FAQ

What does the data-scraper-agent skill do?

Build a fully automated AI-powered data collection agent for any public source — job boards, prices, news, GitHub, sports, anything. Runs on a schedule, enriches data with a free LLM (Gemini Flash), stores results in Notion/Sheets/Supabase, and learns from user feedback. Runs 100% free on GitHub Actions. Use when the user wants to monitor, collect, or track any public data automatically. User wants to gather or monitor any public website or API User says "build a bot that checks...", "monitor X for me", "collect data from..."

What does data-scraper-agent require?

cron: "0 /3 " # every 3 hours — adjust to your needs

How do I install data-scraper-agent?

Run: npx -y skills add https://github.com/affaan-m/everything-claude-code --skill data-scraper-agent --agent claude-code — the source lives at github.com/affaan-m/everything-claude-code.

Maintain data-scraper-agent?

Let people know it's listed here — add the badge (live metrics, light/dark aware) or a plain link to your README or docs.

[data-scraper-agent on getagentictools](https://getagentictools.com/skills/affaan-m-everything-claude-code-data-scraper-agent?ref=badge)
npx agentictools info skills/affaan-m-everything-claude-code-data-scraper-agent

The second line is the CLI lookup for this page — handy in READMEs and docs.