# A/B Performance Report

Run live_20260220_004301 | Generated 2026-02-20T09:53:01.684317
Dataset: malicious-only, 8480 prompts | Proxy auth: bearer token

## Key Metrics

Direct Mean
4269.48 ms
Proxy Mean
9522.70 ms
Delta Mean (P-D)
5253.22 ms
Paired Rows
8480

## Direct vs Proxy

Metric | Direct | Proxy
--- | --- | ---
requests | 8480 | 8480
ok | 8480 | 8480
errors | 0 | 0
mean_ms | 4269.48 | 9522.70
p50_ms | 4174.71 | 3854.52
p95_ms | 5796.73 | 20182.57
p99_ms | 5996.06 | 24075.16
max_ms | 7248.66 | 37251.77
avg_total_tokens | 168.75 | 168.65

## Same-Prompt Delta (Proxy - Direct)

Metric | Value
--- | ---
paired_rows | 8480
paired_success_rows | 8480
delta_mean_ms | 5253.22
delta_p50_ms | -7.64
delta_p95_ms | 16197.56
delta_p99_ms | 19142.46
proxy_faster_count | 4284
proxy_slower_count | 4196
same_count | 0

## Artifacts

- ab_full_malicious_report.md
- ab_full_malicious_summary.json
- direct_full_malicious_rows.json
- proxy_full_malicious_rows.json
- proxy_run_meta.json