Observe and debug LLM traces
mcp-servermcp_serversetup L2★0
langwatch/langwatch ↗What it does
Query LLM observability data and manage prompts, datasets, and evaluators
Best for
Observing and debugging LLM traces, managing prompt versions, and running scenario evaluations.
Inputs
- · trace filter criteria
- · prompt query specs
- · dataset records
- · scenario definitions
Outputs
- · trace records with metadata
- · prompt version history
- · dataset records
- · evaluation results
Requires
- · LangWatch API key (optional for docs, required for platform tools)
Preconditions
- · LangWatch account (free or paid)
- · API key
Failure modes
- · pagination with scrollId required
- · date range off-by-one
- · analytics metric naming
Trust signals
- · comprehensive tool documentation
- · format: digest|json toggle
- · full dataset CRUD
- · evaluator management