Version and test production prompts

Version, test, and prevent regressions on production prompts

Managing prompt changes in production by preventing silent quality regressions and running structured experiments before rollout

• · prompt variants
• · eval dataset

• · prompt registry
• · A/B test results
• · regression detection report

• · prompt versioning system
• · A/B testing framework
• · eval pipeline

Production LLM-backed feature running; eval dataset available or synthetically generated

A/B tests underpowered; eval dataset biased; version control overhead slows iteration; regression detector produces false positives

• · Covers versioning, A/B testing, and eval pipelines
• · Addresses production prompt governance specifically
• · v2.9.0 stable release