# Benchmark Report — `dev` · 2026-05-31T08:23:46Z

## Headline

- **selection** 50.00% (target 60.00%) → **fail**
- **cost** $0.000000 (unavailable)
- **quality** 0.00% → **not_collected**
- **overall** → **partial**


## Selection accuracy

- top-K = **3** · hit **5 / 10** · accuracy **50.00%** · target **60.00%** · verdict **FAIL**

| id | hit | expected | top-K ranked |
|---|---|---|---|
| `canonical-01` | ❌ | php-coder | php-service, laravel-dto, laravel |
| `canonical-02` | ❌ | laravel | laravel-api-endpoint, laravel-mail, composer-packages |
| `canonical-03` | ✅ | pest-testing | pest-testing, testing-anti-patterns, traefik |
| `canonical-04` | ✅ | quality-tools | quality-tools, test-driven-development, data-flow-mapper |
| `canonical-05` | ❌ | systematic-debugging | character-consistency, test-performance, security-audit |
| `canonical-06` | ❌ | code-review | voice-and-tone-design, judge-code-quality, judge-bug-hunter |
| `canonical-07` | ✅ | adr-create | adr-create, decision-record, doc-coauthoring |
| `canonical-08` | ✅ | terraform | terraform, skill-management, copilot-config |
| `canonical-09` | ❌ | conventional-commits-writing | skill-reviewer, validate-feature-fit, one-on-one-cadence |
| `canonical-10` | ✅ | bug-analyzer | bug-analyzer, voc-extract, react-shadcn-ui |

## Cost capture

- **source:** `unavailable` (sessions_jsonl_missing)
- **scanned:** `/Users/mathiasberg/projects/galawork/galawork-packages/event4u/agent-config/agents/cost-tracking/sessions.jsonl`
- **pricing sourced on:** 2026-05-14

_No session jsonl available. Run `node scripts/cost/track.mjs` from a real Claude Code session to populate agents/cost-tracking/sessions.jsonl._


## Quality probe

- **source:** `not_collected` · assertions declared: **10**
- _Pass `--agent-output <path-to-outputs.json>` (map of `id -> str`) to score the rubrics. Schema invariant: missing output keeps `verdict.overall` at `partial`._


## Notes

- corpus path: `tests/eval/corpus-dev.yaml` · prompts: **10**
- pricing: `internal/bench/pricing.yaml`
- baseline collector: `scripts/bench_runner.py`

