cyberneticlibrary

Enforce structured output with grammars

guidanceskillsetup L29,423
Orchestra-Research/AI-Research-SKILLs
What it does

Constrain LLM generation to valid output formats using grammar-guided sampling

Best for

Structured extraction when you need 100% format compliance and can define the grammar precisely.

Inputs
  • · grammar spec (GBNF/regex)
  • · prompt
  • · LLM inference parameters
Outputs
  • · valid output matching grammar
Requires
  • · guidance
  • · llama-cpp-python or compatible inference engine
Preconditions

Grammar spec is valid; LLM supports constrained decoding; output format is expressible in grammar

Failure modes

Over-constrained grammar causes repeated prefix-matching failures; grammar ambiguity produces invalid output

Trust signals
  • · Used in LMQL research
  • · Supports multiple backend LLMs