Reverse-engineer transformer internals
transformer-lens-interpretabilityskillsetup L3★9,423
Orchestra-Research/AI-Research-SKILLs ↗What it does
Provides guidance for
Best for
guidance for mechanistic interpretability research using TransformerLens to inspect and manipulate transformer internals via HookPoints a...
Inputs
- · Transformer Lens Interpretability requirement
- · Implementation context
Outputs
- · Implementation guide
- · Best practices
- · Reference examples
Requires
- · Build system
- · Testing framework
- · Package manager
Preconditions
- · Understanding of Transformer
- · Appropriate development environment
Failure modes
- · Missing dependencies or incompatible versions
- · Configuration or environment issues
- · Incorrect implementation or testing gaps
Trust signals
- · Code examples provided
- · Published with source
- · Open source licensed