# Comprehensive Evaluation Results

Generated: 2026-04-23T01:56:04.056Z
Total Time: 251.4s
Suite: quick
Models: 1
Scenarios: 10
Total evaluations: 10
LLM Judge: enabled

## Success Metrics

| Metric | Value |
|--------|-------|
| Overall Pass Rate | 100.0% |
| Memory-First Compliance | 100.0% |
| Tool Ordering Accuracy | 100.0% |
| Skill-First Rate | 100.0% |
| Avg Latency | 127.8s |
| p50 Latency | 149.7s |
| p95 Latency | 173.8s |

## LLM Judge Metrics

Average Score: 9.7/10

| Model | Judge Score |
|-------|-------------|
| kimi-k2.6 | 9.7/10 |

### Criteria Pass Rates

| Criterion | Pass Rate |
|-----------|-----------|
| appropriateFormat | 100% |
| citesGroundTruth | 100% |
| entityCorrect | 100% |
| factuallyAccurate | 90% |
| hasDebrief | 100% |
| isActionable | 100% |
| isCoherent | 100% |
| noContradictions | 90% |
| noHallucinations | 90% |
| personaMatch | 100% |

## Pass Rate by Model

| Model | Pass Rate | Memory-First | Tool Ordering | Avg Latency |
|-------|-----------|--------------|---------------|-------------|
| kimi-k2.6 | 100% | 100% | 100% | 127.8s |

## Pass Rate by Scenario

| Scenario | Pass Rate |
|----------|-----------|
| ✅ banker_vague_disco | 100% |
| ✅ vc_vague_openautoglm | 100% |
| ✅ cto_vague_quickjs | 100% |
| ✅ exec_vague_gemini | 100% |
| ✅ ecosystem_vague_soundcloud | 100% |
| ✅ founder_salesforce_positioning | 100% |
| ✅ academic_ryr2_anchor | 100% |
| ✅ quant_disco_signal | 100% |
| ✅ product_disco_card | 100% |
| ✅ sales_disco_onepager | 100% |
