# β-1 Comparison Report — chunk-500 vs chunk-2048

> Generated: 2026-06-03T09:34:28  
> baseline:  `reports/research-runs/qvt-ablation-cells/_pre_gamma_baseline/qvt-ablation-cell-C_rag-ontology-M_M.json` (2026-06-02T23:58:12)  
> candidate: `reports/research-runs/qvt-ablation-cells/qvt-ablation-cell-C_rag-ontology-M_M.json` (2026-06-03T00:33:55)  
> suite: L1 / M_M; git_sha baseline=7dc4f41 candidate=7dc4f41

## Aggregate Δ (candidate − baseline)

| Axis | chunk-500 median | chunk-2048 median | Δ | noise (max) | Inside/Outside |
|---|---:|---:|---:|---:|---|
| path_coverage | 0.9091 | 0.7727 | **-0.1364** | ±0.1363 | ✗ OUTSIDE − |
| graded_answer | 0.6333 | 0.6333 | **+0.0000** | ±0.0500 | ✓ inside noise |
| abstention_f1 | 0.5000 | 0.4000 | **-0.1000** | ±0.0444 | ✗ OUTSIDE − |
| token_cost | 1511.6500 | 1471.2000 | **-40.4500** | ±115.8000 | ✓ inside noise |
| latency_cost | 29.2650 | 28.9750 | **-0.2900** | ±1.1950 | ✓ inside noise |

## Verdict: ⭐ operational only

Per design memo §4.1 + honest framing ([[feedback_finding_size_honest_framing]]).

## Confusion matrix aggregate (sum across 3 runs)

```
       chunk-500:  TP=  6  FP=  3  FN=  9  TN= 42
      chunk-2048:  TP=  6  FP=  8  FN=  9  TN= 37
               Δ:  ΔTP=+0  ΔFP=+5  ΔFN=+0  ΔTN=-5
```

**FN reduction**: +0.0% (9→9)

## Per-run results

| Run | chunk-500 graded | chunk-500 abst_f1 | chunk-2048 graded | chunk-2048 abst_f1 |
|---:|---:|---:|---:|---:|
| 1 | 0.633 | 0.500 | 0.633 | 0.400 |
| 2 | 0.667 | 0.500 | 0.633 | 0.400 |
| 3 | 0.633 | 0.500 | 0.583 | 0.444 |

## Per-query analysis (refusals across 3 runs each)

- ✅ rescued (candidate refuses more): **2 queries**
- ❌ regressed (candidate refuses less): **0 queries**
- ⚪ unchanged-correct: 3
- ⚪ unchanged-wrong: 15

### Rescued queries (candidate caught what baseline missed)

| id | intent | Δrefusals | query |
|---:|---|---:|---|
| 14 | `?` | +2 | 'GPT-6 모델은 언제 공식 발표됐어?' |
| 16 | `?` | +3 | '기준 금리 인하 결정은 언제 있었어?' |

## Cost axes

- token_cost Δ: -40.5 chars  (noise ±115.8)
- latency Δ:    -0.290s     (noise ±1.195s)

## Recommendation

**Operational only**. Keep code if no regression cost; document honest framing. Mechanism does not produce publishable Δ at this fixture/N.

---

*Generated by `scripts/research/compare_paired_cells.py`.*