# Comprehensive Evaluation Results

Generated: 2026-01-13T00:54:58.614Z
Total Time: 116.2s
Suite: core
Models: 2
Scenarios: 5
Total evaluations: 10
LLM Judge: disabled

## Success Metrics

| Metric | Value |
|--------|-------|
| Overall Pass Rate | 100.0% |
| Memory-First Compliance | 100.0% |
| Tool Ordering Accuracy | 100.0% |
| Skill-First Rate | 100.0% |
| Avg Latency | 68.9s |
| p50 Latency | 76.7s |
| p95 Latency | 116.2s |

## Pass Rate by Model

| Model | Pass Rate | Memory-First | Tool Ordering | Avg Latency |
|-------|-----------|--------------|---------------|-------------|
| devstral-2-free | 100% | 100% | 100% | 54.4s |
| mimo-v2-flash-free | 100% | 100% | 100% | 83.4s |

## Pass Rate by Scenario

| Scenario | Pass Rate |
|----------|-----------|
| ✅ banker_vague_disco | 100% |
| ✅ vc_vague_openautoglm | 100% |
| ✅ cto_vague_quickjs | 100% |
| ✅ exec_vague_gemini | 100% |
| ✅ ecosystem_vague_soundcloud | 100% |
