# Comprehensive Evaluation Results

Generated: 2026-01-13T01:00:16.328Z
Total Time: 302.6s
Suite: core
Models: 2
Scenarios: 10
Total evaluations: 20
LLM Judge: disabled

## Success Metrics

| Metric | Value |
|--------|-------|
| Overall Pass Rate | 100.0% |
| Memory-First Compliance | 100.0% |
| Tool Ordering Accuracy | 100.0% |
| Skill-First Rate | 100.0% |
| Avg Latency | 78.4s |
| p50 Latency | 76.7s |
| p95 Latency | 168.5s |

## Pass Rate by Model

| Model | Pass Rate | Memory-First | Tool Ordering | Avg Latency |
|-------|-----------|--------------|---------------|-------------|
| devstral-2-free | 100% | 100% | 100% | 65.4s |
| mimo-v2-flash-free | 100% | 100% | 100% | 91.3s |

## Pass Rate by Scenario

| Scenario | Pass Rate |
|----------|-----------|
| ✅ banker_vague_disco | 100% |
| ✅ vc_vague_openautoglm | 100% |
| ✅ cto_vague_quickjs | 100% |
| ✅ exec_vague_gemini | 100% |
| ✅ ecosystem_vague_soundcloud | 100% |
| ✅ founder_salesforce_positioning | 100% |
| ✅ academic_ryr2_anchor | 100% |
| ✅ quant_disco_signal | 100% |
| ✅ product_disco_card | 100% |
| ✅ sales_disco_onepager | 100% |
