cyberneticlibrary

Analyze agent loop execution metrics

ralph-analyticsskillsetup L2131
jmagly/aiwg
What it does

Analyze agent loop execution metrics and patterns

Best for

Agent development where you need quantified evidence of loop quality improvement—when optimizing stuck detection, reflection patterns, or escalation thresholds.

Inputs
  • · loop history from .aiwg/ralph/ directory
  • · reflections from .aiwg/ralph/reflections/
  • · debug memory from .aiwg/ralph/debug-memory/
Outputs
  • · success rate percentage
  • · average iterations to completion
  • · reflection reuse rate
  • · stuck loop detection rate
  • · escalation rate
  • · failure pattern analysis with recommendations
Requires
  • · AIWG ralph system (loop history storage)
  • · Reflection memory schema (JSON)
Preconditions
  • · AIWG ralph loops executed and logged
  • · Reflections and debug memory written to disk
Failure modes
  • · Loop history incomplete or corrupted
  • · Reflections not written → reuse rate unfalsifiable
  • · Debug memory schema mismatch → parsing fails
Trust signals
  • · Named metrics: success rate, average iterations, reflection reuse rate, stuck detection, escalation
  • · Pattern analysis with trend indicators (improving/stable/degrading)
  • · Recommendations for improvement included
  • · References to schema files (reflection-memory.json, debug-memory.yaml)