# Expanded Evaluation Results

Generated: 2026-04-23T05:51:39.195Z
Model: kimi-k2.6
Category: all
Total Time: 3031.2s

## Summary

| Metric | Value |
|--------|-------|
| Total Scenarios | 31 |
| Passed | 31 |
| Failed | 0 |
| Pass Rate | 100.0% |

## Results by Category

### Calendar

| Scenario | Status | Time | Tools Called | Issues |
|----------|--------|------|--------------|--------|
| Calendar: Schedule DISCO review meeting | ✅ PASS | 98.7s | searchAvailableSkills, lookupGroundTruthEntity | - |
| Calendar: Schedule Salesforce demo | ✅ PASS | 157.9s | searchAvailableSkills, lookupGroundTruthEntity, linkupSearch, getSystemDateTime, listEvents | - |
| Calendar: Schedule Ambros follow-up | ✅ PASS | 69.3s | searchAvailableSkills, lookupGroundTruthEntity, createEvent | - |

### Spreadsheet

| Scenario | Status | Time | Tools Called | Issues |
|----------|--------|------|--------------|--------|
| Spreadsheet: DISCO funding metrics | ✅ PASS | 50.4s | searchAvailableSkills, lookupGroundTruthEntity, createSpreadsheet | - |
| Spreadsheet: Ambros deal pipeline | ✅ PASS | 50.1s | searchAvailableSkills, lookupGroundTruthEntity, listSpreadsheets, createSpreadsheet | - |
| Spreadsheet: Gemini pricing comparison | ✅ PASS | 44.9s | searchAvailableSkills, lookupGroundTruthEntity, linkupSearch, createSpreadsheet | - |

### Document

| Scenario | Status | Time | Tools Called | Issues |
|----------|--------|------|--------------|--------|
| Document: DISCO investment memo | ✅ PASS | 146.9s | searchAvailableSkills, lookupGroundTruthEntity | - |
| Document: QuickJS security assessment | ✅ PASS | 58.0s | searchAvailableSkills, lookupGroundTruthEntity, createDossier | - |
| Document: GenomiQ due diligence | ✅ PASS | 71.4s | searchAvailableSkills, lookupGroundTruthEntity, createDossier | - |

### Web

| Scenario | Status | Time | Tools Called | Issues |
|----------|--------|------|--------------|--------|
| Web: DISCO news search | ✅ PASS | 88.7s | searchAvailableSkills, lookupGroundTruthEntity, linkupSearch | - |
| Web: Salesforce Agentforce deep dive | ✅ PASS | 200.3s | searchAvailableSkills, lookupGroundTruthEntity, linkupSearch, getSystemDateTime | - |
| Web: DISCO multi-source verification | ✅ PASS | 181.3s | searchAvailableSkills, lookupGroundTruthEntity, linkupSearch | - |

### Media

| Scenario | Status | Time | Tools Called | Issues |
|----------|--------|------|--------------|--------|
| Media: DISCO UI card design | ✅ PASS | 52.9s | searchAvailableSkills, lookupGroundTruthEntity, describeSkill | - |
| Media: SoundCloud incident timeline | ✅ PASS | 155.2s | searchAvailableSkills, lookupGroundTruthEntity | - |
| Media: VaultPay sales materials | ✅ PASS | 99.1s | searchAvailableSkills, lookupGroundTruthEntity, describeSkill, linkupSearch, getBankerGradeEntityInsights | - |

### Skills

| Scenario | Status | Time | Tools Called | Issues |
|----------|--------|------|--------------|--------|
| Skills: Banker skill discovery | ✅ PASS | 93.0s | searchAvailableSkills, lookupGroundTruthEntity, describeSkill | - |
| Skills: VC thesis skill | ✅ PASS | 154.9s | searchAvailableSkills, lookupGroundTruthEntity | - |
| Skills: Quant signal skill | ✅ PASS | 87.5s | searchAvailableSkills, lookupGroundTruthEntity, describeSkill, getBankerGradeEntityInsights, evaluateEntityForPersona | - |
| Skills: Digest persona skill | ✅ PASS | 161.4s | searchAvailableSkills, lookupGroundTruthEntity, getDailyBrief, getLiveFeed | - |

### Tools

| Scenario | Status | Time | Tools Called | Issues |
|----------|--------|------|--------------|--------|
| Tools: Basic tool discovery | ✅ PASS | 86.8s | searchAvailableSkills, searchAvailableTools, lookupGroundTruthEntity, listToolCategories, describeTools | - |
| Tools: Describe tool schemas | ✅ PASS | 34.4s | searchAvailableSkills, describeTools | - |
| Tools: Gateway invocation | ✅ PASS | 40.5s | searchAvailableSkills, invokeTool, lookupGroundTruthEntity | - |
| Tools: Safe tier tool | ✅ PASS | 37.5s | searchAvailableSkills, lookupGroundTruthEntity | - |

### Hybrid

| Scenario | Status | Time | Tools Called | Issues |
|----------|--------|------|--------------|--------|
| Hybrid: Memory-first retrieval | ✅ PASS | 146.1s | searchAvailableSkills, lookupGroundTruthEntity, queryMemory | - |
| Hybrid: Fusion search ranking | ✅ PASS | 134.1s | searchAvailableSkills, lookupGroundTruthEntity | - |
| Hybrid: Cross-source aggregation | ✅ PASS | 94.2s | searchAvailableSkills, lookupGroundTruthEntity, queryMemory, fusionSearch | - |
| Hybrid: Stale data detection | ✅ PASS | 65.5s | searchAvailableSkills, lookupGroundTruthEntity | - |

### Disclosure

| Scenario | Status | Time | Tools Called | Issues |
|----------|--------|------|--------------|--------|
| Disclosure: P0 telemetry events | ✅ PASS | 56.3s | searchAvailableSkills, lookupGroundTruthEntity, getBankerGradeEntityInsights, evaluateEntityForPersona | - |
| Disclosure: P1 persona classification | ✅ PASS | 77.9s | searchAvailableSkills, lookupGroundTruthEntity | - |
| Disclosure: P2 skill allowlist | ✅ PASS | 84.5s | searchAvailableSkills, lookupGroundTruthEntity | - |
| Disclosure: P3 full disclosure trace | ✅ PASS | 151.2s | searchAvailableSkills, lookupGroundTruthEntity | - |
