# Multi-SDK Benchmark Report

**Date:** 2026-03-18T17:49:32.623Z
**Duration:** 600.0s
**Runs:** 4 (3 success, 1 failed)
**Success Rate:** 75.0%

## SDK Comparison

| SDK           | Tier     | Avg Score | Avg Time | Avg Cost | Success |
| ------------- | -------- | --------- | -------- | -------- | ------- |
| Google Gemini | balanced | 76.0      | 42.6s    | $0.3069  | 100%    |
| OpenAI        | balanced | 87.6      | 2.0m     | $1.8438  | 50%     |

## Variant Rankings (by avg score)

| Rank | Variant              | Score | Time  | Cost    | Success |
| ---- | -------------------- | ----- | ----- | ------- | ------- |
| 1    | openai-multi-agent-1 | 87.6  | 2.0m  | $1.8438 | 50%     |
| 2    | google-multi-agent-0 | 76.0  | 42.6s | $0.3069 | 100%    |

## Per-Commit Results

### Weather Card (simple)

- **Avg Score:** 81.8
- **Best:** openai-multi-agent-1
- **Worst:** google-multi-agent-0

### Interactive Periodic Table (complex)

- **Avg Score:** 76.0
- **Best:** google-multi-agent-0
- **Worst:** google-multi-agent-0

## Failures

- **openai-multi-agent-1** × periodic-table: Timeout after 600000ms
