# Fully Parallel Evaluation Results

Generated: 2026-01-07T20:18:56.986Z
Total Time: 101.5s
Suite: core
Models: 3
Scenarios: 10
Total evaluations: 30

## Summary by Model

| Model | Total | Passed | Failed | Avg Time (s) |
|-------|-------|--------|--------|--------------|
| gpt-5-mini | 10 | 10 | 0 | 50.0 |
| claude-haiku-4.5 | 10 | 10 | 0 | 22.0 |
| gemini-3-flash | 10 | 10 | 0 | 16.4 |

## Summary by Scenario

| Scenario | Total | Passed | Failed |
|----------|-------|--------|--------|
| Banker vague outreach debrief | 3 | 3 | 0 |
| VC wedge from OSS signal | 3 | 3 | 0 |
| CTO risk exposure + patch plan | 3 | 3 | 0 |
| Exec vendor evaluation | 3 | 3 | 0 |
| Ecosystem second-order effects | 3 | 3 | 0 |
| Founder positioning vs incumbent | 3 | 3 | 0 |
| Academic literature anchor | 3 | 3 | 0 |
| Quant signal extraction | 3 | 3 | 0 |
| Product designer schema card | 3 | 3 | 0 |
| Sales engineer one-screen summary | 3 | 3 | 0 |

## Detailed Results

### gpt-5-mini

| Scenario | Status | Time (s) | Failures |
|----------|--------|----------|----------|
| Banker vague outreach debrief | ✅ PASS | 55.1 | - |
| VC wedge from OSS signal | ✅ PASS | 33.7 | - |
| CTO risk exposure + patch plan | ✅ PASS | 54.5 | - |
| Exec vendor evaluation | ✅ PASS | 43.4 | - |
| Ecosystem second-order effects | ✅ PASS | 41.7 | - |
| Founder positioning vs incumbent | ✅ PASS | 101.5 | - |
| Academic literature anchor | ✅ PASS | 43.9 | - |
| Quant signal extraction | ✅ PASS | 47.3 | - |
| Product designer schema card | ✅ PASS | 41.9 | - |
| Sales engineer one-screen summary | ✅ PASS | 37.4 | - |

### claude-haiku-4.5

| Scenario | Status | Time (s) | Failures |
|----------|--------|----------|----------|
| Banker vague outreach debrief | ✅ PASS | 21.8 | - |
| VC wedge from OSS signal | ✅ PASS | 19.8 | - |
| CTO risk exposure + patch plan | ✅ PASS | 17.7 | - |
| Exec vendor evaluation | ✅ PASS | 16.4 | - |
| Ecosystem second-order effects | ✅ PASS | 33.5 | - |
| Founder positioning vs incumbent | ✅ PASS | 37.0 | - |
| Academic literature anchor | ✅ PASS | 16.8 | - |
| Quant signal extraction | ✅ PASS | 24.5 | - |
| Product designer schema card | ✅ PASS | 15.9 | - |
| Sales engineer one-screen summary | ✅ PASS | 16.8 | - |

### gemini-3-flash

| Scenario | Status | Time (s) | Failures |
|----------|--------|----------|----------|
| Banker vague outreach debrief | ✅ PASS | 15.9 | - |
| VC wedge from OSS signal | ✅ PASS | 12.5 | - |
| CTO risk exposure + patch plan | ✅ PASS | 13.4 | - |
| Exec vendor evaluation | ✅ PASS | 12.4 | - |
| Ecosystem second-order effects | ✅ PASS | 17.2 | - |
| Founder positioning vs incumbent | ✅ PASS | 33.6 | - |
| Academic literature anchor | ✅ PASS | 15.3 | - |
| Quant signal extraction | ✅ PASS | 13.4 | - |
| Product designer schema card | ✅ PASS | 14.4 | - |
| Sales engineer one-screen summary | ✅ PASS | 16.2 | - |
