# Multi-SDK Benchmark Report

**Date:** 2026-03-24T06:24:34.430Z
**Duration:** 241.0s
**Runs:** 8 (1 success, 7 failed)
**Success Rate:** 12.5%

## SDK Comparison

| SDK           | Tier     | Avg Score | Avg Time | Avg Cost | Success |
| ------------- | -------- | --------- | -------- | -------- | ------- |
| Google Gemini | balanced | 83.6      | 4.0m     | $0.0473  | 13%     |

## Variant Rankings (by avg score)

| Rank | Variant          | Score | Time | Cost    | Success | Tier Eval |
| ---- | ---------------- | ----- | ---- | ------- | ------- | --------- |
| 1    | google-default-0 | 83.6  | 4.0m | $0.0473 | 13%     | 0P/1W/0F  |

## Per-Commit Results

### Weather Card (simple)

- **Avg Score:** 0.0
- **Best:** none
- **Worst:** none

### Multi-Step Survey Form (medium)

- **Avg Score:** 0.0
- **Best:** none
- **Worst:** none

### Kanban Task Board (medium)

- **Avg Score:** 0.0
- **Best:** none
- **Worst:** none

### Interactive Periodic Table (complex)

- **Avg Score:** 83.6
- **Best:** google-default-0
- **Worst:** google-default-0
- **Tier Eval:** 0 pass, 1 warn, 0 fail

### E-Commerce Product Page (complex)

- **Avg Score:** 0.0
- **Best:** none
- **Worst:** none

### Chat Interface (medium)

- **Avg Score:** 0.0
- **Best:** none
- **Worst:** none

### Stock Ticker Dashboard (simple)

- **Avg Score:** 0.0
- **Best:** none
- **Worst:** none

### Onboarding Wizard (medium)

- **Avg Score:** 0.0
- **Best:** none
- **Worst:** none

## Failures

- **google-default-0** × weather-card: Request timed out.
- **google-default-0** × survey-form: Request timed out.
- **google-default-0** × kanban-board: Request timed out.
- **google-default-0** × product-page: Request timed out.
- **google-default-0** × chat-interface: Request timed out.
- **google-default-0** × stock-ticker: Request timed out.
- **google-default-0** × onboarding-wizard: Request timed out.
