# Full-Stack Eval

Generated: 2026-04-21T08:22:01.570Z
Readiness: not_ready

## Phase Status

| Phase | Status | Duration |
|---|---|---|
| typecheck | passed | 757ms |
| build | passed | 31.1s |
| capability_compare | passed | 235.0s |
| dogfood_strict | passed | 925.6s |
| notebook_capacity | passed | 200.1s |
| product_history_soak | passed | 20.0s |

## Capability

Overall pass rate: 55.6%
LLM judge average: 6.0/10
p95 latency: 138.5s

| Model | Pass Rate | Judge Score | Avg Latency |
|---|---|---|---|
| claude-haiku-4.5 | 66.7% | 6.0 | 96.4s |
| gpt-5-mini | 100.0% | 6.0 | 64.4s |
| gemini-3-flash | 0.0% | 0.0 | 9.6s |

## UX / Dogfood

Dogfood score: 88/100 (B)
Real issues: 1

## Capacity

Notebook worst p95: 215ms | worst unexpected error rate: 0.00%
History soak worst p95: 639ms | worst error rate: 0.00%

### Notebook Load Rows

| Scenario | p95 | Error % | Notes |
|---|---|---|---|
| concurrent_insert | 152ms | 0.00% |  |
| sustained_append | 169ms | 0.00% |  |
| paginated_read | 203ms | 0.00% |  |
| multi_tab_edit | 215ms | 0.00% |  |
| multi_tab_conflict | 142ms | 80.30% | expected conflict guards: REVISION_MISMATCH |
| shared_session_insert | 144ms | 0.00% |  |

### Product History Rows

| Scenario | p95 | Error % |
|---|---|---|
| start_session | 183ms | 0.00% |
| complete_session | 516ms | 0.00% |
| session_e2e | 639ms | 0.00% |
| list_sessions | 101ms | 0.00% |
| get_session | 114ms | 0.00% |
| get_session_messages | 113ms | 0.00% |
| list_reports | 112ms | 0.00% |
| get_report | 108ms | 0.00% |
| get_entity_notebook | 127ms | 0.00% |

## Verdict

Capability OK: false
Dogfood OK: false
Notebook OK: true
History OK: true
Failing phases: none

## Artifacts

- [Full-stack JSON](D:/VSCode Projects/cafecorner_nodebench/nodebench_ai4/nodebench-ai/docs/architecture/benchmarks/full-stack-eval-2026-04-21T07-58-29.json)
- [Capability JSON](D:/VSCode Projects/cafecorner_nodebench/nodebench_ai4/nodebench-ai/docs/architecture/benchmarks/comprehensive-eval-2026-04-21T08-02-55-metrics.json)
- [Notebook load JSON](D:/VSCode Projects/cafecorner_nodebench/nodebench_ai4/nodebench-ai/.tmp/evals/notebook-load-latest.json)
- [Product history JSON](D:/VSCode Projects/cafecorner_nodebench/nodebench_ai4/nodebench-ai/.tmp/evals/product-chat-history-latest.json)