经 AI Skill Hub 精选评估,多模型AI辩论工具 获评「推荐使用」。这款Agent工作流在功能完整性、社区活跃度和易用性方面表现出色,AI 评分 7.0 分,适合有一定技术背景的用户使用。
多模型AI辩论工具 是一套完整的 AI Agent 自动化工作流方案。通过可视化的节点编排,将复杂的多步骤任务拆解为清晰的自动化流程,实现全程无人值守的智能处理。支持与数百种外部服务和 API 无缝集成,适合构建数据处理管线、业务自动化和 AI 辅助决策系统。
多模型AI辩论工具 是一套完整的 AI Agent 自动化工作流方案。通过可视化的节点编排,将复杂的多步骤任务拆解为清晰的自动化流程,实现全程无人值守的智能处理。支持与数百种外部服务和 API 无缝集成,适合构建数据处理管线、业务自动化和 AI 辅助决策系统。
# 方式一:npm 全局安装 npm install -g llm-peer-review # 方式二:npx 直接运行(无需安装) npx llm-peer-review --help # 方式三:项目依赖安装 npm install llm-peer-review # 方式四:从源码运行 git clone https://github.com/mayankmankhand/llm-peer-review cd llm-peer-review npm install npm start
# 命令行使用
llm-peer-review --help
# 基本用法
llm-peer-review [options] <input>
# Node.js 代码中使用
const llm_peer_review = require('llm-peer-review');
const result = await llm_peer_review.run(options);
console.log(result);
# llm-peer-review 配置说明 # 查看配置选项 llm-peer-review --config-example > config.yml # 常见配置项 # output_dir: ./output # log_level: info # workers: 4 # 环境变量(覆盖配置文件) export LLM_PEER_REVIEW_CONFIG="/path/to/config.yml"
AI peer review for your work. (Also: a structured workflow.)
<img src="docs/images/ask-gpt-summary.png" alt="ask-gpt summary showing agreed points, disagreed points, recommended actions, and key insights" width="700">
A real /ask-gpt debate output: Claude and ChatGPT argue across three rounds and hand you a structured verdict (what they agreed on, where they disagreed, and a prioritized action list). You approve what gets implemented.
This toolkit gives you slash commands for every step of a project: explore the problem, create a plan, build, review, then run a 3-round debate between Claude and ChatGPT (or Gemini). Works for product specs, research plans, competitive analysis, and code.
Inspired by Zevi Arnovitz's workflow on Lenny's Podcast. The key difference: Zevi manually copies feedback between models. This toolkit automates the entire debate loop with two commands (/ask-gpt and /ask-gemini).
This is the same consensus/divergence synthesis that Perplexity's Model Council produces and what Karpathy's LLM Council does for general Q&A, applied to a full project lifecycle with multi-round adversarial debate and an implementation workflow.
New to slash commands? A slash command is a shortcut you type into your AI editor's chat panel - it starts with / and tells the AI to run a specific workflow. The editors that support them are Claude Code (Anthropic's CLI plus editor panel for Claude) and Cursor (an AI-powered code editor built on VS Code). You'll need one of these installed; see SETUP.md if you're starting from scratch.
---
Latest release: v5.2.0 (June 2026). Highlights:
--dry-run shows an upgrade with zero changes. The "your custom files are never modified" guarantee is enforced by a test suite./review dispatches leaner specialist payloads, /index runs its heavy lifting on a cheaper model, and plan HTML renders about 2x faster.Upgrading from v5.0.0 or earlier? This release also carries everything from v5.0.1 (reliable HTML opening on WSL, Windows installer fixes) and v5.1.0 (the HTML render pipeline) - one re-run of setup picks up all of it.
Full history: the version-by-version rollup in CHANGELOG.md or the GitHub releases page.
---
This toolkit runs on macOS, Linux, or WSL (Windows Subsystem for Linux). Windows users: install WSL first. Native Windows PowerShell also works for setup and all non-debate commands; only /ask-gpt and /ask-gemini require bash/WSL.
---
Asks 3-4 focused questions about scope, success criteria, and constraints before any code is written. Has two modes: scoping (you have a concrete idea, pressure-test the scope) and vision (you're thinking big-picture, challenge the premise itself). It picks a mode by reading your input, then asks you to confirm. You can switch modes any time. Useful when you're not yet sure what you're actually building.
Full prompt: .claude/commands/explore.md
Walks through the plan step by step, updating status emojis and progress in real time. Spawns parallel agents for [parallel] steps, runs [sequential] steps in order. Stops on critical blockers (e.g. the plan assumed an API supports a feature it doesn't) instead of pushing through a broken plan.
Full prompt: .claude/commands/execute.md
Prefer to run the setup script yourself? Pick the script that matches your shell:
Bash (WSL, macOS, Linux):
bash /path/to/llm-peer-review/scripts/setup/setup.sh /path/to/your-project
PowerShell (setup and non-debate commands - see Requirements):
powershell -ExecutionPolicy Bypass -File C:\path\to\llm-peer-review\scripts\setup\setup.ps1 -Target "C:\path\to\your-project"
Or run from inside your project directory (no target needed):
cd /path/to/your-project
bash /path/to/llm-peer-review/scripts/setup/setup.sh
Note: If you run the script from inside the toolkit repository without specifying a target, it shows an error to prevent accidentally copying files into the wrong place.
Preview first (optional): add --dry-run (bash) or -DryRun (PowerShell) to see exactly what an install or upgrade would do - version gap, migrations, files that would be overwritten, custom files that are left alone, and where backups go - without changing anything:
bash /path/to/llm-peer-review/scripts/setup/setup.sh /path/to/your-project --dry-run
Every real run prints the same pre-flight report before it touches anything.
What setup does: - Copies into your project: commands, skills (including the prebuilt HTML shells), both rules files (toolkit.md, html-outputs.md), and all runtime and helper scripts (ask-gpt.js, ask-gemini.js, browse.js, generate-index.js, render-html.js, session-init.js, open-artifact.sh), plus VERSION and .env.local.example. Detects and removes any legacy INDEX.md. CODEBASE_MAP.md (a semantic map of your project) is generated on your first /explore run, when Claude auto-invokes /index. - Preserves your work: CLAUDE.md, LESSONS.md (plus its companion LESSONS-detail.md), and settings.local.json are skipped if they already exist - those are yours to customize. Custom files you add inside .claude/commands/, .claude/skills/, .claude/scripts/, or .claude/rules/ are never modified or deleted (this guarantee is covered by the toolkit's installer test suite), and anything setup does overwrite is backed up to a timestamped .toolkit-backup-* folder first. - Always updates: the managed rules files (.claude/rules/toolkit.md, .claude/rules/html-outputs.md). - Stays in the toolkit repo: setup scripts (setup.sh, setup.ps1, install-alias.*) are never copied.
See How It Works for details on which files are yours vs. managed by the toolkit.
npx --prefix .claude/scripts playwright-core install chromium
```
The debate commands and the browser command are optional. Skip the API keys if you don't want/ask-gptand/ask-gemini. Skip the Chromium install if you don't want/review-browser. The core workflow commands work either way.
</details>
Never set up a dev environment before? Follow the step-by-step guide in SETUP.md. It covers Windows (WSL), Mac, Node.js, GitHub CLI, Cursor, and API keys - everything you need from scratch.
Not using Cursor? The setup guide assumes Cursor, but the toolkit works with any editor that supports Claude Code. Copy the relevant setup page into any AI assistant and ask it to rewrite the steps for your editor.
---
npm install --prefix .claude/scripts
You: /ask-gpt
Claude: What would you like me to review?
1. Plan 2. Code 3. Branch 4. Feature 5. Other
You: Review the auth middleware
Claude: [Gathers context → sends to ChatGPT → they debate 3 rounds]
--- Summary ---
Agreed: Add token expiry check, extract magic numbers
Recommended Actions:
- [ ] Add token expiry validation
- [ ] Move 3600 to TOKEN_EXPIRY_SECONDS
Want me to implement these?
You: Yes
Want a different perspective? Run /ask-gemini next.
API costs: Each 3-round debate typically costs $0.01-$0.10 in API credits depending on context size. You'll need an OpenAI and/or Gemini API key with credits. See API-KEYS.md for a step-by-step setup guide.
Choosing what to review:
<img src="docs/images/ask-gpt-prompt.png" alt="ask-gpt prompt showing review options" width="700">
---
cp .env.local.example .env.local
cp .env.local.example .env.local
If the diagram doesn't render:/worktree(optional) ->/explore->/create-plan->/execute->/review->/ask-gptor/ask-gemini->/document
You don't have to use every command every time. Following the order prevents the most common mistake: coding before you've thought it through.
Want to see this in action? Follow the 5-minute walkthrough in DEMO-SCRIPT.md.
Working on multiple things at once? Use/worktreefirst to create an isolated copy, then open it in a new Cursor window and run/explorethere.
---
npm install --prefix .claude/scripts
npx --prefix .claude/scripts playwright-core install chromium
.claude/commands/ exists in your project root with .md files inside. The editor workspace root must be the folder that contains .claude/./ask-gpt or /ask-gemini fails - Check that npm install --prefix .claude/scripts was run and .env.local has valid API keys./ask-gpt or /ask-gemini prints a "deprecated model" warning - v4.5.0 auto-overrides outdated GPT_MODEL or GEMINI_MODEL env values with the current default. Edit .env.local to remove or update the stale value if you want to silence the warning. See API-KEYS.md.setup.sh on its own.mkdir -p /path/to/project/bin/bash^M or "bad interpreter" - Line-ending issue. Your shell scripts have Windows-style line endings (CRLF) instead of Unix-style (LF). Easiest fix: delete the folder and clone fresh. Advanced fix: run git add --renormalize . && git checkout -- . in the repo..toolkit-backup-<timestamp>/ at the project root before overwriting. Copy it back if you want to keep your version. Safe to delete the backup directory when done./tmp/tmp.* folders are harmless and can be deleted. .toolkit-backup-*/ directories from prior runs are also safe to delete once you have confirmed you do not need the originals.~/.claude/commands/. Global copies override project commands and cause stale behavior. The setup script warns about this automatically.---
llm-peer-review 是一个专为开发者设计的 AI Peer Review 工具,它不仅是一个评审工具,更是一套结构化的开发工作流。通过集成 Claude 和 ChatGPT 的辩论机制,该工具能够针对你的 Plan 或 Code 进行多轮深度讨论,并最终为你提供一份结构化的判决报告(Verdict),清晰列出双方达成一致的点、存在分歧的地方以及优先级排序后的建议操作(Recommended Actions),帮助你提升代码质���。
自 v4.3.3 版本升级以来,本项目引入了多项重大功能。v4.4.0 版本新增了 Codebase map 功能,通过 `/index` 生成语义化的 `CODEBASE_MAP.md`,供 `/explore`、`/create-plan` 和 `/pair-debug` 等指令调用,取代了传统的扁平化索引。v4.4.1 版本则增强了 `/review-*` 系列技能的解释能力,采用更丰富的 4 字段结构来呈现发现的问题,让评审结果更加透明、易读。
本项目支持 macOS、Linux 以及 Windows 的 WSL (Windows Subsystem for Linux) 环境。对于 Windows 用户,建议优先安装 WSL 以获得最佳的 Bash 工作流体验。确保你的开发环境能够运行 Node.js 相关脚本,并具备访问 AI 模型 API 的网络条件。
安装过程主要依赖于对项目脚本的初始化。请确保在项目根目录下执行相关安装命令。如果涉及浏览器自动化评审(/review-browser),需要通过 `npx --prefix .claude/scripts playwright-core install chromium` 来安装 Chromium 浏览器内核。此外,请确保项目结构符合指令识别规范,特别是 `.claude/commands/` 目录的存在。
本项目提供了一套完整的指令化操作体验。你可以使用 `/explore` 在编写代码前进行需求边界测试(Scoping)或愿景挑战(Vision);使用 `/execute` 按照计划逐步执行任务,该指令支持并行([parallel])与串行([sequential])任务处理,并能实时更新进度。当需要评审时,调用 `/ask-gpt` 或 `/ask-gemini`,AI 会自动进行多轮辩论并输出总结,你可以直接根据建议进行确认或修改。
配置过程非常简单。你需要通过编辑项目根目录下的 `.env.local` 文件来配置必要的 API 密钥。请将你的 `OPENAI_API_KEY` 和 `GEMINI_API_KEY` 填入其中。如果该文件不存在,请先从 `.env.local.example` 复制一份副本,以确保 AI 辩论指令能够正常调用后端模型。
本项目通过 `/ask-gpt` 和 `/ask-gemini` 指令调用大模型能力。在使用这些 AI 辩论指令前,必须完成 API 密钥的配置工作。操作步骤为:首先复制模板文件 `cp .env.local.example .env.local`,然后将获取到的 API Key 写入该文件,从而实现与 OpenAI 或 Google Gemini 模型的安全连接。
本项目定义了一套严谨的自动化开发工作流:从可选的 `/worktree` 开始,经过 `/explore` 探索需求,`/create-plan` 生成计划,再到 `/execute` 执行任务。执行完成后进入 `/review` 评审阶段,通过 `/ask-gpt` 或 `/ask-gemini` 进行 AI 辩论,最终生成包含 Agreed、Disagreed 和 Actions 的总结。只有当你批准(Approve)这些结果后,才会进入最后的 `/document` 文档化阶段。
常见问题解答:1. 如果在 Cursor 中无法显示指令,请检查项目根目录是否存在 `.claude/commands/` 文件夹及其内部的 .md 文件,并确保编辑器打开的是该文件夹的父级。2. 如果 `/ask-gpt` 或 `/ask-gemini` 运行失败,请检查是否已运行 `npm install --prefix .claude/scripts`。3. 浏览器评审功能需要额外安装 Chromium 内核。
创新的多模型对比评审框架,适合需要多角度论证的场景。但项目热度不高,文档生态待完善。
AI Skill Hub 为第三方内容聚合平台,本页面信息基于公开数据整理,不对工具功能和质量作任何法律背书。
建议在沙箱或测试环境中充分验证后,再部署至生产环境,并做好必要的安全评估。
✅ MIT 协议 — 最宽松的开源协议之一,可自由商用、修改、分发,仅需保留版权声明。
AI Skill Hub 点评:多模型AI辩论工具 的核心功能完整,质量良好。对于自动化工程师和运维人员来说,这是一个值得纳入个人工具库的选择。建议先在非生产环境试用,再逐步推广。
| 原始名称 | llm-peer-review |
| 原始描述 | 开源AI工作流:Multi-model AI debate for your entire project lifecycle. Plans, specs, research,。⭐6 · JavaScript |
| Topics | AI辩论多模型代码审查工作流JavaScript |
| GitHub | https://github.com/mayankmankhand/llm-peer-review |
| License | MIT |
| 语言 | JavaScript |
收录时间:2026-05-24 · 更新时间:2026-05-30 · License:MIT · AI Skill Hub 不对第三方内容的准确性作法律背书。
选择 Agent 类型,复制安装指令后粘贴到对应客户端