cyberneticlibrary

Evaluate AI plans like a Chief AI Officer

caio-reviewskillsetup L117,464
alirezarezvani/claude-skills
What it does

Interrogate AI plans for eval, risk, cost, hiring, and regulatory compliance

Best for

When evaluating any AI feature ship, multi-year vendor commitment, or AI team expansion for soundness before execution.

Inputs
  • · plan involving AI feature/vendor/team hire
Outputs
  • · 6-question CAIO pressure-test
  • · eval discipline check
  • · risk tier (EU AI Act)
  • · cost projection
  • · role mapping
Requires
  • · ai_risk_classifier.py
  • · model_buildvsbuy_calculator.py
  • · ai_cost_economics.py
Preconditions

Plan articulates what AI needs to be good at OR involves vendor contract/team hire

Failure modes
  • · eval set not defined causing SLO breach
  • · risk tier misclassified (PROHIBITED vs HIGH)
  • · cost projection missing hidden ops costs
Trust signals
  • · Six forcing questions grounded in real failure modes
  • · EU AI Act tier classification with conformity assessment workflow
  • · model selection decision framework with TCO