Original: Use when the user asks how Rudder works or how to use, configure, extend, operate, or troubleshoot Rudder; needs current guidance for Rudder agents, issues, Chat, runs, reviews, approvals, automations, Library, projects, skills, workspaces, CLI, MCP tools, APIs, or source behavior; or needs an exact supported command or product contract. Do not use for greetings, ordinary work merely running inside Rudder, routine actions already clear from the active context and typed tools, or general coding and research tasks that do not ask about Rudder.
Best: Use when the user asks how Rudder works or how to use, configure, extend, operate, or troubleshoot Rudder; needs current guidance for Rudder agents, issues, Chat, runs, reviews, approvals, automations, Library, projects, skills, workspaces, CLI, MCP tools, APIs, or source behavior; or needs an exact supported command or product contract. Do not use for greetings, ordinary work merely running inside Rudder, routine actions already clear from the active context and typed tools, or general coding and research tasks that do not ask about Rudder.
Best Score: 8/8 (test)
Iterations: 1 | Train: 12 | Test: 8
| Iter | Train | Test | Description | Rudder 显示这个 skill 已 enabled,但刚才的 run 没有使用它。这是 selected、loaded 和 used 语义不同,还是运行时出了 bug?请核对当前契约。 | 我把交付文档写进 Rudder Library 后,为什么评论里必须使用返回的 markdownLink,不能手写 library-entry URL?请给出准确规则。 | 我需要给 agent 添加 agent-browser。Rudder 的 skills enable 和 skills sync 到底哪个是增量、哪个会替换完整集合?请核对精确策略后回答。 | Where in the official Rudder source are bundled skills materialized for local runtime adapters, and which tests protect stale managed-skill cleanup? | Rudder 里 Chat 和 issue 的职责边界到底是什么?我们团队正在设计交接流程,请给我当前官方文档链接,并说明什么时候应该保留在 Chat。 | Before I write this integration, verify which Rudder MCP tools this agent can actually call in the current run. Please use live capability evidence instead of memory. | 这个 React 组件在当前 Rudder run 里渲染成空白了,帮我修复状态更新逻辑并补一个组件测试。 | 帮我设计一个名叫 Rudder 的船舵图标:深蓝色、圆形徽章、透明背景,输出 1024px PNG。 | Please fix the spelling mistakes on the docs page in this repository, preserve its existing tone, and run the markdown linter afterward. | hi | Write a short email to the design team saying the issue is complete and that the new screenshots are ready for review. | 用当前已经暴露的 Library 文件读取工具打开季度计划,把第二节复制到这条聊天里;路径和权限都已在上下文中。 | Which Rudder API endpoint is the compatibility fallback behind the CLI issue checkout command, and under what failure conditions is direct API fallback allowed? | How do I configure Codex as a Rudder runtime on the latest released version? I need the supported fields and exact official setup page, not an example from the development branch. | 我 checkout 一个已分配的 Rudder issue 时返回了 409。为什么不能直接重试?请对照当前产品契约、源码和测试解释冲突语义。 | RUD-248 已分配给我,但标记 done 失败了。请先查清当前 Rudder 对完成评论和验证证据的精确要求,再告诉我应该用哪个受支持的操作。 | Use the exposed Rudder skill tool to enable agent-browser for this agent; the exact selection and target agent are already present in the active context. | 在这个 Rudder run 里分析附件中的三家竞品定价表,算出年付折扣并推荐我们的套餐价格。 | RUD-248 这个 issue 已经分配给我,检查结果也都在上下文里;直接用当前 typed tool 把它标成 done。 | 把下面这段提到 rudder control 的英文产品文案总结成三条中文要点;这里的 rudder 是船舵控制,不是软件产品。 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 36/36 | 24/24 | Use when the user asks how Rudder works or how to use, configure, extend, operate, or troubleshoot Rudder; needs current guidance for Rudder agents, issues, Chat, runs, reviews, approvals, automations, Library, projects, skills, workspaces, CLI, MCP tools, APIs, or source behavior; or needs an exact supported command or product contract. Do not use for greetings, ordinary work merely running inside Rudder, routine actions already clear from the active context and typed tools, or general coding and research tasks that do not ask about Rudder. | ✓3/3 | ✓3/3 | ✓3/3 | ✓3/3 | ✓3/3 | ✓3/3 | ✓0/3 | ✓0/3 | ✓0/3 | ✓0/3 | ✓0/3 | ✓0/3 | ✓3/3 | ✓3/3 | ✓3/3 | ✓3/3 | ✓0/3 | ✓0/3 | ✓0/3 | ✓0/3 |