cyberneticlibrary

Extract data from any website intelligently

universal-scraping-architectpluginsetup L217,464
alirezarezvani/claude-skills
What it does

Route scraping tasks with intelligent token budget and quota awareness

Best for

Scraping web content with automatic fallback to local extraction when Firecrawl quota is low, avoiding token blowouts on large batch jobs

Inputs
  • · target URL
  • · extraction schema
Outputs
  • · scraped data
  • · token usage report
  • · quota status
Requires
  • · Firecrawl
  • · local Python extraction (pandas, requests, beautifulsoup4)
  • · token counter
Preconditions

Firecrawl API key (free tier or paid) or local extraction stack installed; target URL publicly accessible

Failure modes

Firecrawl quota exhausted mid-scrape; local extraction fails on dynamic JavaScript; token budget tracking lags behind actual usage

Trust signals
  • · Supports both Firecrawl and local extraction
  • · Free-tier compatible
  • · BYOK (bring your own key)
  • · Token budget tracking included
  • · Quota-aware routing