cyberneticlibrary

Audit crawlability and Core Web Vitals

seo-technicalskillsetup L26,595
AgriciDaniel/claude-seo
What it does

Audit 9 technical SEO categories and AI crawler rules

Best for

Ensuring crawlability, mobile-first readiness, Core Web Vitals, and selective AI crawler blocking per brand strategy.

Inputs
  • · Domain URL
Outputs
  • · 9-category audit report
  • · AI crawler detection (GPTBot, ClaudeBot, PerplexityBot, etc.)
  • · Critical/High/Medium/Low issue list
  • · robots.txt recommendations
Requires
  • · WebFetch
  • · Bash (for HTTP checks)
Preconditions
  • · Domain must be live and crawlable
Failure modes
  • · JS-rendered content only
  • · Rate limiting on crawl checks
  • · Mixed content warnings
Trust signals
  • · INP (Interaction to Next Paint) metric (FID deprecated Sept 2024)
  • · Mobile-first indexing complete (July 2024)
  • · AI crawler table (8 major crawlers)
  • · HSTS preload list integration
  • · Security header validation