# Expanded Evaluation Results

Generated: 2026-01-08T10:35:43.499Z
Model: gemini-3-flash
Category: all
Total Time: 260.9s

## Summary

| Metric | Value |
|--------|-------|
| Total Scenarios | 15 |
| Passed | 13 |
| Failed | 2 |
| Pass Rate | 86.7% |

## Results by Category

### Calendar

| Scenario | Status | Time | Tools Called | Issues |
|----------|--------|------|--------------|--------|
| Calendar: Schedule DISCO review meeting | ❌ FAIL | 19.0s | lookupGroundTruthEntity, createEvent | persona mismatch: got EARLY_STAGE_VC expected JPM_STARTUP_BA |
| Calendar: Schedule Salesforce demo | ✅ PASS | 30.4s | lookupGroundTruthEntity, linkupSearch, createEvent, lookupGroundTruthEntity | - |
| Calendar: Schedule Ambros follow-up | ✅ PASS | 17.8s | lookupGroundTruthEntity, createEvent | - |

### Spreadsheet

| Scenario | Status | Time | Tools Called | Issues |
|----------|--------|------|--------------|--------|
| Spreadsheet: DISCO funding metrics | ✅ PASS | 11.3s | lookupGroundTruthEntity | - |
| Spreadsheet: Ambros deal pipeline | ✅ PASS | 21.8s | lookupGroundTruthEntity, listSpreadsheets | - |
| Spreadsheet: Gemini pricing comparison | ✅ PASS | 18.7s | lookupGroundTruthEntity, createSpreadsheet | - |

### Document

| Scenario | Status | Time | Tools Called | Issues |
|----------|--------|------|--------------|--------|
| Document: DISCO investment memo | ✅ PASS | 13.3s | lookupGroundTruthEntity | - |
| Document: QuickJS security assessment | ✅ PASS | 15.9s | lookupGroundTruthEntity | - |
| Document: GenomiQ due diligence | ✅ PASS | 12.2s | lookupGroundTruthEntity | - |

### Web

| Scenario | Status | Time | Tools Called | Issues |
|----------|--------|------|--------------|--------|
| Web: DISCO news search | ✅ PASS | 13.2s | lookupGroundTruthEntity | - |
| Web: Salesforce Agentforce deep dive | ✅ PASS | 33.3s | initScratchpad, getSystemDateTime, lookupGroundTruthEntity, setActiveSection, linkupSearch, lookupGroundTruthEntity | - |
| Web: DISCO multi-source verification | ✅ PASS | 11.3s | lookupGroundTruthEntity | - |

### Media

| Scenario | Status | Time | Tools Called | Issues |
|----------|--------|------|--------------|--------|
| Media: DISCO pitch deck assets | ❌ FAIL | 12.2s | lookupGroundTruthEntity | persona mismatch: got EARLY_STAGE_VC expected PRODUCT_DESIGN |
| Media: SoundCloud incident timeline | ✅ PASS | 12.5s | lookupGroundTruthEntity | - |
| Media: VaultPay sales materials | ✅ PASS | 18.0s | lookupGroundTruthEntity | - |
