AI Skill Hub 推荐使用:红队框架 是一款优质的Agent工作流。AI 综合评分 7.5 分,在同类工具中表现稳健。如果你正在寻找可靠的Agent工作流解决方案,这是一个值得深入了解的选择。
白盒和黑盒红队框架,用于LLMs和Agentic AI应用
红队框架 是一套完整的 AI Agent 自动化工作流方案。通过可视化的节点编排,将复杂的多步骤任务拆解为清晰的自动化流程,实现全程无人值守的智能处理。支持与数百种外部服务和 API 无缝集成,适合构建数据处理管线、业务自动化和 AI 辅助决策系统。
白盒和黑盒红队框架,用于LLMs和Agentic AI应用
红队框架 是一套完整的 AI Agent 自动化工作流方案。通过可视化的节点编排,将复杂的多步骤任务拆解为清晰的自动化流程,实现全程无人值守的智能处理。支持与数百种外部服务和 API 无缝集成,适合构建数据处理管线、业务自动化和 AI 辅助决策系统。
# 方式一:pip 安装(推荐)
pip install wb-red-team
# 方式二:虚拟环境安装(推荐生产环境)
python -m venv .venv
source .venv/bin/activate # Windows: .venv\Scripts\activate
pip install wb-red-team
# 方式三:从源码安装(获取最新功能)
git clone https://github.com/votal-ai-hq/wb-red-team
cd wb-red-team
pip install -e .
# 验证安装
python -c "import wb_red_team; print('安装成功')"
# 命令行使用
wb-red-team --help
# 基本用法
wb-red-team input_file -o output_file
# Python 代码中调用
import wb_red_team
# 示例
result = wb_red_team.process("input")
print(result)
# wb-red-team 配置文件示例(config.yml) app: name: "wb-red-team" debug: false log_level: "INFO" # 运行时指定配置文件 wb-red-team --config config.yml # 或通过环境变量配置 export WB_RED_TEAM_API_KEY="your-key" export WB_RED_TEAM_OUTPUT_DIR="./output"
White-box red teaming for agentic AI apps. Reads your code, finds bugs specific to your stack — not generic prompt injections.
Most LLM red-teaming tools are black-box: they treat your agent as an opaque endpoint and fire generic adversarial prompts at it. That finds the obvious stuff. It does not find the bug where your JWT secret is hardcoded in lib/auth.ts:47, or the path through tools read_file → send_email that no single-call check would catch.
Red-Team AI is built for that gap. It reads your application's source code first, learns your tools, roles, and guardrails, and then generates attacks tailored to your implementation.
📖 Full product documentation: docs/index.md — comprehensive manual covering configuration, white-box scanning, attack catalog, compliance, deployment, and the extension API.
---
docker buildx create --name amd64builder --platform linux/amd64 --use
For developers — implement the AttackModule interface in attacks/, ~30 lines:
import type { Attack, AttackModule } from "../lib/types.js";
const category = "my_custom_check" as const;
export const myCustomModule: AttackModule = {
category,
getSeedAttacks() { return [{ id: "mc-1", category, name: "...", ... }]; },
getGenerationPrompt(analysis) { return "You are a red-team attacker..."; },
};
See CONTRIBUTING.md for the full guide.
---
git clone https://github.com/sundi133/wb-red-team.git cd wb-red-team && npm install
```bash cp .env.example .env
curl -X POST http://localhost:4200/api/run \ -H "Content-Type: application/json" \ -d "$(cat configs/config.my-app.json | sed 's/localhost:4000/host.docker.internal:4000/g')"
Prerequisites: OpenShift CLI (oc), Docker Hub account, access to an OpenShift cluster.
1. Build and push the amd64 image:
```bash
docker buildx build --builder amd64builder --platform linux/amd64 \ --no-cache --pull -t <your-dockerhub-user>/wb-red-team:latest --push .
**2. Configure secrets:**
Edit `deploy/openshift.yaml` and update the `wb-red-team-secrets` Secret with your API keys, auth credentials, and session secret. Alternatively, create the secret from your `.env` file:
bash oc create secret generic wb-red-team-secrets --from-env-file=.env -n <your-namespace>
**3. Update the namespace:**
The YAML defaults to `sundi133-dev`. If your namespace is different, update all `namespace:` fields in `deploy/openshift.yaml`.
**4. Deploy:**
bash oc project <your-namespace> oc apply -f deploy/openshift.yaml
**5. Verify:**
bash
docker buildx build --builder amd64builder --platform linux/amd64 \ --no-cache --pull -t <your-dockerhub-user>/wb-red-team:latest --push .
oc rollout restart deployment/wb-red-team
**Troubleshooting:**
- `exec format error` — Image was built for ARM, not amd64. Rebuild with `--platform linux/amd64 --pull --no-cache`.
- `ImagePullBackOff` — Docker Hub repo is private. Either make it public or create a pull secret:
bash oc create secret docker-registry dockerhub-pull \ --docker-server=docker.io \ --docker-username=<user> \ --docker-password=<token> oc secrets link default dockerhub-pull --for=pull ```
---
Deploy anywhere — AWS, GCP, Azure, Railway, on-prem, or any environment that runs Docker + Postgres.
Prerequisites: Docker runtime, Postgres 13+, OIDC identity provider (Clerk, Okta, Azure AD, Auth0, Keycloak)
Features:
X-API-Key header) for CI/CDAUTH_MODE=dev) for frictionless local testingEnvironment Variables:
| Variable | Required | Description |
|---|---|---|
ANTHROPIC_API_KEY | Yes (one LLM key) | Anthropic provider |
OPENAI_API_KEY | No | OpenAI provider |
OPENROUTER_API_KEY | No | OpenRouter provider |
TOGETHER_API_KEY | No | Together AI provider |
AZURE_OPENAI_API_KEY | No | Azure OpenAI provider |
AZURE_OPENAI_ENDPOINT | With Azure key | Azure endpoint (e.g. https://myresource.openai.azure.com) |
AZURE_OPENAI_API_VERSION | No | Azure API version (default: 2024-06-01) |
CUSTOM_LLM_BASE_URL | No | Custom OpenAI-compatible endpoint (Trussed AI, vLLM, LiteLLM, Ollama) |
CUSTOM_LLM_API_KEY | With custom URL | API key for custom endpoint |
CODEBASE_REPO_TOKEN | No | Git token for private repo white-box scanning |
DATABASE_URL | No | Postgres connection. Enables enterprise features |
MASTER_ENCRYPTION_KEY | With DB | 64 hex chars. Encrypts report data at rest |
AUTH_MODE | No | dev = no login required. Omit for OIDC auth |
CLERK_PUBLISHABLE_KEY | No | Clerk publishable key for browser SSO |
MAX_CONCURRENT_RUNS | No | Max parallel scans (default: 100) |
```bash cp .env.example .env
```bash
npm run gen:interactive ```
The interactive generator walks you through app details, authentication, smart category selection with reasoning, strategy selection, intensity, and LLM provider. Iterate until satisfied, then save and run.
```bash cp config.example.json config.json
npm start ```
```bash npm run ai
docker compose up -d
```bash
curl -X POST http://localhost:4200/api/run \ -H "Content-Type: application/json" \ -d @configs/config.my-app.json
DATABASE_URL=postgres://user:pass@host:5432/redteam MASTER_ENCRYPTION_KEY=<openssl rand -hex 32> CLERK_PUBLISHABLE_KEY=pk_live_...
CUSTOM_LLM_BASE_URL=https://your-internal-gateway.com/provider/generic CUSTOM_LLM_API_KEY=your-key
json { "attackConfig": { "llmProvider": "custom", "llmModel": "your-deployment-name", "judgeProvider": "custom", "judgeModel": "your-deployment-name" } }
If your OpenAI-compatible gateway supports request-level guardrails, you can attach them only when needed:
json { "target": { "customApiTemplate": { "guardrails": ["votal-input-guard", "votal-output-guard"] } }, "attackConfig": { "llmProvider": "custom", "llmModel": "qwen3.5-27b", "llmGuardrails": ["votal-input-guard", "votal-output-guard"], "judgeProvider": "custom", "judgeModel": "qwen3.5-27b", "judgeGuardrails": ["votal-input-guard", "votal-output-guard"] } }
When configured, outbound OpenAI-style requests are sent in this shape:
json { "model": "qwen3.5-27b", "messages": [{ "role": "user", "content": "user message" }], "guardrails": ["votal-input-guard", "votal-output-guard"] }
**API keys for programmatic access:**
bash npx tsx scripts/create-api-key.ts --tenant default --role admin --name "CI pipeline"
curl -X POST http://localhost:4200/api/run \ -H "X-API-Key: rtk_your_api_key" \ -H "Content-Type: application/json" \ -d @configs/config.insurance.json ```
---
Copy-paste configs for the agent frameworks people actually use:
See the full integrations index for the shared pattern (only three config fields define an integration).
---
| Capability | Black-box scanner | Red-Team AI |
|---|---|---|
| Generic prompt-injection tests | ✅ | ✅ |
| Reads source code | ❌ | ✅ |
| Detects hardcoded secrets used in auth paths | ❌ | ✅ |
| Builds attacks from the actual tool graph | ❌ | ✅ |
| Generates compliance-aware reports | sometimes | ✅ |
| Dashboard with live progress + risk scoring | varies | ✅ |
---
Both are MIT-licensed, TypeScript-based. Promptfoo has 20k+ stars, OpenAI backing, and is the most mature LLM red-team tool. Red-Team AI is early-stage but fills a structural gap: white-box testing.
Where Red-Team AI is stronger:
| Area | Red-Team AI | Promptfoo |
|---|---|---|
| Source code analysis | Reads codebase — discovers tools, roles, guardrails, hardcoded secrets, call graphs | No source access |
| Agentic attacks | 13 categories (tool chain hijack, workflow bypass, scope creep, reflection exploit, multi-agent delegation) | ~5 (coding agent, tool abuse) |
| Social engineering strategies | 20+ (authority, victim, emergency, flattery, guilt, grief, therapeutic, whistleblower) | ~3 (citation, authoritative markup) |
| RAG attacks | 9 categories (corpus poisoning, ranking manipulation, vector store, chunk boundary, tenant bleed) | ~3 (RAG poisoning, indirect injection) |
| Adaptive rounds | Multi-round — defense profiling → strategy rotation → re-targeting on partial successes | Single pass (Meta Agent has cross-plugin memory) |
| Strategy × category composition | 155 strategies × 141 categories orthogonally composable | Strategies applied per-plugin |
| Self-hosted enterprise | Built-in Postgres, AES-256 encryption, SSO/OIDC, RBAC, audit log, tenant isolation | Enterprise SaaS plan |
| Risk quantification | LLM-powered business impact, financial exposure, real-world incident mapping | Not built-in |
| Guardrail recommendations | Maps findings to Votal Shield configs | Not built-in |
| Compliance frameworks | 11 built-in (OWASP LLM, OWASP Agentic, MITRE ATLAS, NIST AI RMF, NIST 800-53, EU AI Act, GDPR, HIPAA, ISO 27001, PCI-DSS, Saudi PDPL) | 6 (OWASP, NIST, MITRE ATLAS, ISO 42001, GDPR, EU AI Act) |
Where Promptfoo is stronger:
| Area | Promptfoo | Red-Team AI |
|---|---|---|
| Maturity & community | 20k+ stars, OpenAI-backed, production-tested at scale | Beta, early stage |
| Provider support | 50+ LLM providers | 4 (Anthropic, OpenAI, OpenRouter, Together) |
| Compliance plugins | 56 granular plugins (FERPA, COPPA, accessibility, billing, product safety) | 10 industry-specific categories |
| Dataset benchmarks | 11 curated datasets (HarmBench, BeaverTails, ToxicChat, XSTest) | None |
| CI/CD | First-class GitHub Action, PR code scanning | API-based (curl/npm run scan) |
| Eval + red-team | Combined accuracy eval + security testing in one tool | Security testing only |
| Meta Agent | Builds custom attack taxonomy with persistent scan-wide memory | Round-based defense profiling |
| Multi-turn agents | Hydra (adaptive branching with scan-wide memory), GOAT, crescendo | Scripted, adaptive (LLM follow-ups), crescendo |
| GCG attacks | Gradient-based adversarial optimization (research-grade) | Not available |
| Multimodal encoding | Image, video, audio encoding bypass | Semantic multimodal attacks (ghost injection, cross-modal conflict) |
Use both — they're complementary:
Promptfoo is DAST for AI. Red-Team AI is SAST+DAST for AI. Application security has always needed both.
---
白盒红队测试工具,专为智能应用程序设计,能够读取您的代码,找出与您的技术栈相关的特定错误,而不是通用的提示注入。
创建 amd64 构建器(在 Apple Silicon / ARM Mac 上必需)
1. 克隆并安装 git clone https://github.com/sundi133/wb-red-team.git cd wb-red-team && npm install 选项 D:Docker Dashboard ```bash cp .env.example .env ```
选项 A:交互式配置生成器(推荐用于第一次使用)
使用 API 密钥(企业模式)
集成 复制粘贴配置文件,适用于人们实际使用的代理框架: - [LangChain / LangServe](docs/integrations/langchain.md) - [LlamaIndex (RAG)](docs/integrations/llamaindex.md) - [Vercel AI SDK (Next.js)](docs/integrations/vercel-ai-sdk.md) - [OpenAI Agents SDK](docs/integrations/openai-agents-sdk.md)
高质量的开源AI工作流,值得关注
AI Skill Hub 为第三方内容聚合平台,本页面信息基于公开数据整理,不对工具功能和质量作任何法律背书。
建议在沙箱或测试环境中充分验证后,再部署至生产环境,并做好必要的安全评估。
✅ MIT 协议 — 最宽松的开源协议之一,可自由商用、修改、分发,仅需保留版权声明。
总体来看,红队框架 是一款质量良好的Agent工作流,在同类工具中具备一定竞争力。AI Skill Hub 将持续追踪其更新动态,建议收藏备用,结合自身场景选择合适时机引入使用。
| 原始名称 | wb-red-team |
| 原始描述 | 开源AI工作流:Whitebox & Blackbox red-teaming framework for LLMs & Agentic AI apps. It analyze。⭐20 · Python |
| Topics | ai-securityagentic-aipython |
| GitHub | https://github.com/votal-ai-hq/wb-red-team |
| License | MIT |
| 语言 | Python |
收录时间:2026-05-31 · 更新时间:2026-05-31 · License:MIT · AI Skill Hub 不对第三方内容的准确性作法律背书。
选择 Agent 类型,复制安装指令后粘贴到对应客户端