# Comprehensive Evaluation Results

Generated: 2026-04-23T12:28:00.944Z
Total Time: 409.6s
Suite: full
Models: 1
Scenarios: 5
Total evaluations: 5
LLM Judge: enabled

## Success Metrics

| Metric | Value |
|--------|-------|
| Overall Pass Rate | 100.0% |
| Memory-First Compliance | 100.0% |
| Tool Ordering Accuracy | 100.0% |
| Skill-First Rate | 100.0% |
| Avg Latency | 7.5s |
| p50 Latency | 8.0s |
| p95 Latency | 9.2s |

## LLM Judge Metrics

Average Score: 10.0/10

| Model | Judge Score |
|-------|-------------|
| kimi-k2.6 | 10.0/10 |

### Criteria Pass Rates

| Criterion | Pass Rate |
|-----------|-----------|
| appropriateFormat | 100% |
| citesGroundTruth | 100% |
| entityCorrect | 100% |
| factuallyAccurate | 100% |
| hasDebrief | 100% |
| isActionable | 100% |
| isCoherent | 100% |
| noContradictions | 100% |
| noHallucinations | 100% |
| personaMatch | 100% |

## Pass Rate by Model

| Model | Pass Rate | Memory-First | Tool Ordering | Avg Latency |
|-------|-----------|--------------|---------------|-------------|
| kimi-k2.6 | 100% | 100% | 100% | 7.5s |

## Pass Rate by Scenario

| Scenario | Pass Rate |
|----------|-----------|
| ✅ banker_vague_disco | 100% |
| ✅ vc_vague_openautoglm | 100% |
| ✅ next_banker_vague_disco_cover_this_week | 100% |
| ✅ next_exec_tool_cost_model | 100% |
| ✅ next_product_vague_make_usable_ui | 100% |
