Assistant response evaluation
Compare assistant answers across evaluation batches and record useful review decisions.
What it does
- Answers and benchmarks reviewed together
- Comparison across evaluation batches
- Editable review decisions and CSV export
Inputs
- Questions and assistant responses from evaluation batches
- Benchmark responses and available scores
- Categories and review criteria
Outputs
- Response comparisons
- Scope, pass/fail, and failure-reason annotations
- Filtered evaluation records as CSV
Example use
Compare answers to the same question across batches, review them against the benchmark, and record why each passes or fails.