Map entire site content via Firecrawl
seo-firecrawlskillsetup L2★128
AgriciDaniel/codex-seo ↗What it does
Full-site crawl and site mapping via Firecrawl
Best for
Pre-audit discovery phase to enumerate all indexable content before running SEO analysis.
Inputs
- · Domain URL
- · Optional: crawl depth, format filters
Outputs
- · Site map
- · Discovered URLs
- · Page structure
- · Metadata extraction
Requires
- · Firecrawl MCP
- · firecrawl_map / firecrawl_crawl
Preconditions
- · Firecrawl MCP installed
- · Domain crawl allowed by robots.txt
Failure modes
- · Robots.txt blocks crawl
- · Crawl timeout on large sites
- · JavaScript-heavy SPA incomplete
Trust signals
- · Full-site crawl capability
- · Metadata extraction (title, meta description)
- · Structure discovery
- · robots.txt honor