# Pilot Success Metrics (12-week baseline)

Use this as the default scorecard for buyer pilots.

## Scope

- ICP: NGOs / implementing orgs preparing institutional donor proposals
- Workflow: one live opportunity from intake to review-ready package

## Primary outcomes (must-have)

1. Cycle time reduction
   - Target: 30-50% faster draft package preparation vs baseline
2. Review loop reduction
   - Target: 20-40% fewer major revision rounds before submission-ready state
3. Compliance completeness
   - Target: >=95% required sections/checklist fields present at first formal review
4. Traceability coverage
   - Target: >=90% critical claims linked to source/citation/event trace

## Secondary outcomes (nice-to-have)

- Reviewer time saved: 15-30%
- Export/package preparation time: 40-60% faster
- Fewer late-stage structural rewrites

## Instrumentation (in-product)

- `GET /status/{job_id}/metrics` includes `pilot_success_kpis` with cycle-time, review-loop, and traceability KPI signals.
- `GET /status/{job_id}/export-payload` mirrors `pilot_success_kpis` under `payload.quality_summary` for export packaging.
- Baseline comparison (for reduction %) remains pilot-operator input.

## Evidence to collect weekly

- median lead time: intake -> first review-ready package
- number of major revision rounds per package
- checklist completeness score at first review
- traceability coverage score (critical claims)
- qualitative notes from proposal manager + MEL lead

## Go / No-Go gate (pilot end)

Go if all are true:
- at least 2/4 primary outcomes hit target range
- no severe governance/compliance incident
- pilot team requests expansion to next donor/workstream

No-Go if any are true:
- cycle time worsens for 3+ consecutive weeks
- compliance completeness remains <85%
- traceability repeatedly fails on critical sections
