# Multi-SDK Benchmark Report

**Date:** 2026-03-18T14:31:09.495Z
**Duration:** 600.0s
**Runs:** 4 (1 success, 3 failed)
**Success Rate:** 25.0%

## SDK Comparison

| SDK           | Tier     | Avg Score | Avg Time | Avg Cost | Success |
| ------------- | -------- | --------- | -------- | -------- | ------- |
| Google Gemini | balanced | 79.0      | 2.4m     | $0.2719  | 25%     |

## Variant Rankings (by avg score)

| Rank | Variant              | Score | Time | Cost    | Success |
| ---- | -------------------- | ----- | ---- | ------- | ------- |
| 1    | google-multi-agent-1 | 79.0  | 2.4m | $0.2719 | 50%     |
| 2    | google-default-0     | 0.0   | 0ms  | $0.0000 | 0%      |

## Per-Commit Results

### Weather Card (simple)

- **Avg Score:** 79.0
- **Best:** google-multi-agent-1
- **Worst:** google-multi-agent-1

### Interactive Periodic Table (complex)

- **Avg Score:** 0.0
- **Best:** none
- **Worst:** none

## Failures

- **google-default-0** × weather-card: {"error":{"message":"","code":404,"status":"Not Found"}}
- **google-default-0** × periodic-table: {"error":{"message":"","code":404,"status":"Not Found"}}
- **google-multi-agent-1** × periodic-table: Timeout after 600000ms
